2024-03-30T14:43:44.499 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-30T14:43:44.499 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/teuthology-2024-03-29_21:08:02-orch-squid-distro-default-smithi/7630227 --owner scheduled_teuthology@teuthology --name teuthology-2024-03-29_21:08:02-orch-squid-distro-default-smithi --description orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} --verbose -- /home/teuthworker/archive/teuthology-2024-03-29_21:08:02-orch-squid-distro-default-smithi/7630227/orig.config.yaml 2024-03-30T14:43:44.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T14:43:44.622 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-03-29_21:08:02-orch-squid-distro-default-smithi/7630227 branch: squid description: orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} email: ceph-qa@ceph.com first_in_suite: false job_id: '7630227' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-03-29_21:08:02-orch-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: squid ceph: conf: client: debug ms: 1 global: mon election default strategy: 1 ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon warn on pool no app: false osd: debug ms: 1 debug osd: 20 osd class default list: '*' osd class load list: '*' osd shutdown pgref assert: true flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - reached quota - but it is still running - overall HEALTH_ - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) sha1: 4e50bbcdd1630c7760b708f3a5b4d38a121e66cb ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} cephadm: cephadm_mode: cephadm-package install: ceph: flavor: default sha1: 4e50bbcdd1630c7760b708f3a5b4d38a121e66cb extra_packages: - cephadm workunit: branch: squid sha1: 5af0400050a123dc31f105425174f106e057276a owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - ceph.rgw.foo.a - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b - ceph.iscsi.iscsi.a seed: 8777 sha1: 4e50bbcdd1630c7760b708f3a5b4d38a121e66cb sleep_before_teardown: 0 subset: 43/64 suite: orch suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_5af0400050a123dc31f105425174f106e057276a/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 5af0400050a123dc31f105425174f106e057276a targets: smithi072.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLDrGCM5YnTIRFCgd04DjIlbjuUUX8qdJclG7AvneYbXD/zwcX66oBqJ4zoICKCYSZKbPAemjdg7WqIG54kbzzw= smithi172.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHtUqScG8eLIjj/ltc4EDQqu/B9XXmVW+Pnfy6P/c+NblD9UrVykeBI/5QBS47J9t1C9Sdv1DQKTqfOTYnwuIVc= tasks: - install: null - cephadm: conf: mgr: debug mgr: 20 debug ms: 1 - workunit: clients: client.0: - rados/test.sh - rados/test_pool_quota.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-29_21:08:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-30T14:43:44.622 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_5af0400050a123dc31f105425174f106e057276a/qa; will attempt to use it 2024-03-30T14:43:44.623 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_5af0400050a123dc31f105425174f106e057276a/qa/tasks 2024-03-30T14:43:44.623 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-30T14:43:44.625 INFO:teuthology.task.internal:Checking packages... 2024-03-30T14:43:44.651 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '4e50bbcdd1630c7760b708f3a5b4d38a121e66cb' 2024-03-30T14:43:44.651 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-30T14:43:44.651 INFO:teuthology.packaging:ref: None 2024-03-30T14:43:44.651 INFO:teuthology.packaging:tag: None 2024-03-30T14:43:44.651 INFO:teuthology.packaging:branch: squid 2024-03-30T14:43:44.651 INFO:teuthology.packaging:sha1: 4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:43:44.652 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=squid 2024-03-30T14:43:44.817 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1973-g5af04000-1jammy 2024-03-30T14:43:44.819 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-30T14:43:44.825 INFO:teuthology.task.internal:no buildpackages task found 2024-03-30T14:43:44.825 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-30T14:43:44.871 INFO:teuthology.task.internal:Saving configuration 2024-03-30T14:43:44.882 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-30T14:43:44.896 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-30T14:43:44.920 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-03-29_21:08:02-orch-squid-distro-default-smithi/7630227', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-30 14:37:14.111235', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAID1Dy2z0HiL5CBPF1F7WwQtTzOk+nvjzmArKNkFp3iLm'} 2024-03-30T14:43:44.943 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-03-29_21:08:02-orch-squid-distro-default-smithi/7630227', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-30 14:37:14.113272', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINbl6DFzQl/sRW4ZpKpqSq4hB0RNldlq4cEv/8iACUTW'} 2024-03-30T14:43:44.943 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-30T14:43:44.948 INFO:teuthology.task.internal:roles: ubuntu@smithi072.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.foo.a', 'node-exporter.a', 'alertmanager.a'] 2024-03-30T14:43:44.948 INFO:teuthology.task.internal:roles: ubuntu@smithi172.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a'] 2024-03-30T14:43:44.948 INFO:teuthology.run_tasks:Running task console_log... 2024-03-30T14:43:45.036 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6a4f54e3a0>, signals=[15]) 2024-03-30T14:43:45.036 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-30T14:43:45.042 INFO:teuthology.task.internal:Opening connections... 2024-03-30T14:43:45.042 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi072.front.sepia.ceph.com 2024-03-30T14:43:45.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T14:43:45.128 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi172.front.sepia.ceph.com 2024-03-30T14:43:45.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T14:43:45.211 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-30T14:43:45.218 DEBUG:teuthology.orchestra.run.smithi072:> uname -m 2024-03-30T14:43:45.223 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64 2024-03-30T14:43:45.223 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2024-03-30T14:43:45.267 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-03-30T14:43:45.268 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="Ubuntu" 2024-03-30T14:43:45.268 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="22.04" 2024-03-30T14:43:45.268 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-03-30T14:43:45.268 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_CODENAME=jammy 2024-03-30T14:43:45.268 INFO:teuthology.orchestra.run.smithi072.stdout:ID=ubuntu 2024-03-30T14:43:45.268 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE=debian 2024-03-30T14:43:45.268 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://www.ubuntu.com/" 2024-03-30T14:43:45.268 INFO:teuthology.orchestra.run.smithi072.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-03-30T14:43:45.268 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-03-30T14:43:45.268 INFO:teuthology.orchestra.run.smithi072.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-03-30T14:43:45.269 INFO:teuthology.orchestra.run.smithi072.stdout:UBUNTU_CODENAME=jammy 2024-03-30T14:43:45.269 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2024-03-30T14:43:45.299 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2024-03-30T14:43:45.304 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2024-03-30T14:43:45.304 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2024-03-30T14:43:45.350 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-03-30T14:43:45.351 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="Ubuntu" 2024-03-30T14:43:45.351 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="22.04" 2024-03-30T14:43:45.351 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-03-30T14:43:45.351 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_CODENAME=jammy 2024-03-30T14:43:45.351 INFO:teuthology.orchestra.run.smithi172.stdout:ID=ubuntu 2024-03-30T14:43:45.351 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE=debian 2024-03-30T14:43:45.351 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://www.ubuntu.com/" 2024-03-30T14:43:45.352 INFO:teuthology.orchestra.run.smithi172.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-03-30T14:43:45.352 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-03-30T14:43:45.352 INFO:teuthology.orchestra.run.smithi172.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-03-30T14:43:45.352 INFO:teuthology.orchestra.run.smithi172.stdout:UBUNTU_CODENAME=jammy 2024-03-30T14:43:45.352 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2024-03-30T14:43:45.374 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-30T14:43:45.384 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-30T14:43:45.404 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-30T14:43:45.404 DEBUG:teuthology.orchestra.run.smithi072:> test '!' -e /home/ubuntu/cephtest 2024-03-30T14:43:45.407 DEBUG:teuthology.orchestra.run.smithi172:> test '!' -e /home/ubuntu/cephtest 2024-03-30T14:43:45.412 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-30T14:43:45.430 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-30T14:43:45.430 DEBUG:teuthology.orchestra.run.smithi072:> test -z $(ls -A /var/lib/ceph) 2024-03-30T14:43:45.454 DEBUG:teuthology.orchestra.run.smithi172:> test -z $(ls -A /var/lib/ceph) 2024-03-30T14:43:45.463 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-30T14:43:45.518 INFO:teuthology.run_tasks:Running task kernel... 2024-03-30T14:43:45.539 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-03-30T14:43:45.539 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-03-30T14:43:45.540 DEBUG:teuthology.orchestra.run.smithi072:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-30T14:43:45.540 DEBUG:teuthology.orchestra.run.smithi172:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-30T14:43:45.545 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T14:43:45.545 DEBUG:teuthology.orchestra.run.smithi172:> uname -r 2024-03-30T14:43:45.546 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T14:43:45.546 DEBUG:teuthology.orchestra.run.smithi072:> uname -r 2024-03-30T14:43:45.591 INFO:teuthology.orchestra.run.smithi172.stdout:5.15.0-56-generic 2024-03-30T14:43:45.592 INFO:teuthology.task.kernel:Running kernel on smithi172: 5.15.0-56-generic 2024-03-30T14:43:45.592 DEBUG:teuthology.orchestra.run.smithi172:> sudo apt-get clean 2024-03-30T14:43:45.593 INFO:teuthology.orchestra.run.smithi072.stdout:5.15.0-56-generic 2024-03-30T14:43:45.593 INFO:teuthology.task.kernel:Running kernel on smithi072: 5.15.0-56-generic 2024-03-30T14:43:45.593 DEBUG:teuthology.orchestra.run.smithi072:> sudo apt-get clean 2024-03-30T14:43:45.717 DEBUG:teuthology.orchestra.run.smithi172:> sudo apt-get update 2024-03-30T14:43:45.753 DEBUG:teuthology.orchestra.run.smithi072:> sudo apt-get update 2024-03-30T14:43:45.896 INFO:teuthology.orchestra.run.smithi172.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-03-30T14:43:45.915 INFO:teuthology.orchestra.run.smithi072.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-03-30T14:43:45.998 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-30T14:43:46.018 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-30T14:43:46.080 INFO:teuthology.orchestra.run.smithi172.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-03-30T14:43:46.100 INFO:teuthology.orchestra.run.smithi072.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-03-30T14:43:46.125 INFO:teuthology.orchestra.run.smithi172.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,303 kB] 2024-03-30T14:43:46.152 INFO:teuthology.orchestra.run.smithi072.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,303 kB] 2024-03-30T14:43:46.235 INFO:teuthology.orchestra.run.smithi172.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [436 kB] 2024-03-30T14:43:46.239 INFO:teuthology.orchestra.run.smithi172.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [233 kB] 2024-03-30T14:43:46.242 INFO:teuthology.orchestra.run.smithi172.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-03-30T14:43:46.242 INFO:teuthology.orchestra.run.smithi172.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [33.7 kB] 2024-03-30T14:43:46.243 INFO:teuthology.orchestra.run.smithi172.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,616 kB] 2024-03-30T14:43:46.265 INFO:teuthology.orchestra.run.smithi172.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [271 kB] 2024-03-30T14:43:46.268 INFO:teuthology.orchestra.run.smithi172.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-03-30T14:43:46.268 INFO:teuthology.orchestra.run.smithi172.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [599 kB] 2024-03-30T14:43:46.273 INFO:teuthology.orchestra.run.smithi172.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [852 kB] 2024-03-30T14:43:46.280 INFO:teuthology.orchestra.run.smithi172.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-03-30T14:43:46.282 INFO:teuthology.orchestra.run.smithi172.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-03-30T14:43:46.282 INFO:teuthology.orchestra.run.smithi172.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-03-30T14:43:46.282 INFO:teuthology.orchestra.run.smithi172.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.1 kB] 2024-03-30T14:43:46.283 INFO:teuthology.orchestra.run.smithi172.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,476 B] 2024-03-30T14:43:46.308 INFO:teuthology.orchestra.run.smithi072.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [436 kB] 2024-03-30T14:43:46.316 INFO:teuthology.orchestra.run.smithi072.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [233 kB] 2024-03-30T14:43:46.317 INFO:teuthology.orchestra.run.smithi172.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-03-30T14:43:46.320 INFO:teuthology.orchestra.run.smithi072.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-03-30T14:43:46.321 INFO:teuthology.orchestra.run.smithi072.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,616 kB] 2024-03-30T14:43:46.349 INFO:teuthology.orchestra.run.smithi072.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [33.7 kB] 2024-03-30T14:43:46.350 INFO:teuthology.orchestra.run.smithi072.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [271 kB] 2024-03-30T14:43:46.355 INFO:teuthology.orchestra.run.smithi072.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-03-30T14:43:46.355 INFO:teuthology.orchestra.run.smithi072.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [852 kB] 2024-03-30T14:43:46.366 INFO:teuthology.orchestra.run.smithi072.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [599 kB] 2024-03-30T14:43:46.373 INFO:teuthology.orchestra.run.smithi072.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-03-30T14:43:46.374 INFO:teuthology.orchestra.run.smithi072.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-03-30T14:43:46.375 INFO:teuthology.orchestra.run.smithi072.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-03-30T14:43:46.375 INFO:teuthology.orchestra.run.smithi072.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.1 kB] 2024-03-30T14:43:46.397 INFO:teuthology.orchestra.run.smithi072.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,476 B] 2024-03-30T14:43:46.397 INFO:teuthology.orchestra.run.smithi072.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-03-30T14:43:46.434 INFO:teuthology.orchestra.run.smithi172.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-03-30T14:43:46.463 INFO:teuthology.orchestra.run.smithi072.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-03-30T14:43:46.573 INFO:teuthology.orchestra.run.smithi172.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [602 kB] 2024-03-30T14:43:46.601 INFO:teuthology.orchestra.run.smithi072.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,518 kB] 2024-03-30T14:43:46.770 INFO:teuthology.orchestra.run.smithi172.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,518 kB] 2024-03-30T14:43:46.903 INFO:teuthology.orchestra.run.smithi072.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [602 kB] 2024-03-30T14:43:46.917 INFO:teuthology.orchestra.run.smithi172.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [293 kB] 2024-03-30T14:43:46.932 INFO:teuthology.orchestra.run.smithi172.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-03-30T14:43:46.933 INFO:teuthology.orchestra.run.smithi172.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [35.3 kB] 2024-03-30T14:43:46.935 INFO:teuthology.orchestra.run.smithi172.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,644 kB] 2024-03-30T14:43:46.942 INFO:teuthology.orchestra.run.smithi072.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [293 kB] 2024-03-30T14:43:46.957 INFO:teuthology.orchestra.run.smithi072.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-03-30T14:43:46.958 INFO:teuthology.orchestra.run.smithi072.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,644 kB] 2024-03-30T14:43:46.994 INFO:teuthology.orchestra.run.smithi172.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [274 kB] 2024-03-30T14:43:47.000 INFO:teuthology.orchestra.run.smithi172.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-03-30T14:43:47.018 INFO:teuthology.orchestra.run.smithi072.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [35.3 kB] 2024-03-30T14:43:47.019 INFO:teuthology.orchestra.run.smithi072.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [274 kB] 2024-03-30T14:43:47.026 INFO:teuthology.orchestra.run.smithi072.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-03-30T14:43:47.165 INFO:teuthology.orchestra.run.smithi172.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,061 kB] 2024-03-30T14:43:47.189 INFO:teuthology.orchestra.run.smithi072.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,061 kB] 2024-03-30T14:43:47.801 INFO:teuthology.orchestra.run.smithi172.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [698 kB] 2024-03-30T14:43:47.821 INFO:teuthology.orchestra.run.smithi072.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [698 kB] 2024-03-30T14:43:47.842 INFO:teuthology.orchestra.run.smithi172.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [241 kB] 2024-03-30T14:43:47.855 INFO:teuthology.orchestra.run.smithi172.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-03-30T14:43:47.856 INFO:teuthology.orchestra.run.smithi172.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [49.6 kB] 2024-03-30T14:43:47.858 INFO:teuthology.orchestra.run.smithi072.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [241 kB] 2024-03-30T14:43:47.859 INFO:teuthology.orchestra.run.smithi172.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [6,028 B] 2024-03-30T14:43:47.860 INFO:teuthology.orchestra.run.smithi172.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [12.0 kB] 2024-03-30T14:43:47.860 INFO:teuthology.orchestra.run.smithi172.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-03-30T14:43:47.861 INFO:teuthology.orchestra.run.smithi172.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-03-30T14:43:47.871 INFO:teuthology.orchestra.run.smithi072.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-03-30T14:43:47.872 INFO:teuthology.orchestra.run.smithi072.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [49.6 kB] 2024-03-30T14:43:47.875 INFO:teuthology.orchestra.run.smithi072.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [6,028 B] 2024-03-30T14:43:47.875 INFO:teuthology.orchestra.run.smithi072.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [12.0 kB] 2024-03-30T14:43:47.876 INFO:teuthology.orchestra.run.smithi072.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-03-30T14:43:47.876 INFO:teuthology.orchestra.run.smithi072.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-03-30T14:43:47.883 INFO:teuthology.orchestra.run.smithi172.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-03-30T14:43:47.886 INFO:teuthology.orchestra.run.smithi172.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-03-30T14:43:47.903 INFO:teuthology.orchestra.run.smithi072.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-03-30T14:43:47.906 INFO:teuthology.orchestra.run.smithi072.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-03-30T14:43:48.051 INFO:teuthology.orchestra.run.smithi172.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-03-30T14:43:48.071 INFO:teuthology.orchestra.run.smithi072.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-03-30T14:43:48.134 INFO:teuthology.orchestra.run.smithi172.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-03-30T14:43:48.153 INFO:teuthology.orchestra.run.smithi072.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-03-30T14:43:48.216 INFO:teuthology.orchestra.run.smithi172.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-03-30T14:43:48.260 INFO:teuthology.orchestra.run.smithi072.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-03-30T14:43:48.298 INFO:teuthology.orchestra.run.smithi172.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-03-30T14:43:48.319 INFO:teuthology.orchestra.run.smithi072.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-03-30T14:43:48.327 INFO:teuthology.orchestra.run.smithi172.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-03-30T14:43:48.353 INFO:teuthology.orchestra.run.smithi072.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-03-30T14:43:52.513 INFO:teuthology.orchestra.run.smithi172.stdout:Fetched 12.6 MB in 3s (4,957 kB/s) 2024-03-30T14:43:52.853 INFO:teuthology.orchestra.run.smithi072.stdout:Fetched 12.6 MB in 3s (4,979 kB/s) 2024-03-30T14:43:53.920 INFO:teuthology.orchestra.run.smithi172.stdout:Reading package lists... 2024-03-30T14:43:53.937 DEBUG:teuthology.orchestra.run.smithi172:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-03-30T14:43:53.999 INFO:teuthology.orchestra.run.smithi172.stdout:Reading package lists... 2024-03-30T14:43:54.197 INFO:teuthology.orchestra.run.smithi172.stdout:Building dependency tree... 2024-03-30T14:43:54.197 INFO:teuthology.orchestra.run.smithi172.stdout:Reading state information... 2024-03-30T14:43:54.367 INFO:teuthology.orchestra.run.smithi172.stdout:The following packages were automatically installed and are no longer required: 2024-03-30T14:43:54.367 INFO:teuthology.orchestra.run.smithi172.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-30T14:43:54.367 INFO:teuthology.orchestra.run.smithi172.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-30T14:43:54.368 INFO:teuthology.orchestra.run.smithi172.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-30T14:43:54.368 INFO:teuthology.orchestra.run.smithi172.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-03-30T14:43:54.368 INFO:teuthology.orchestra.run.smithi172.stdout: python2.7-minimal 2024-03-30T14:43:54.368 INFO:teuthology.orchestra.run.smithi172.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-30T14:43:54.369 INFO:teuthology.orchestra.run.smithi172.stdout:The following additional packages will be installed: 2024-03-30T14:43:54.369 INFO:teuthology.orchestra.run.smithi172.stdout: linux-generic linux-headers-5.15.0-101 linux-headers-5.15.0-101-generic 2024-03-30T14:43:54.369 INFO:teuthology.orchestra.run.smithi172.stdout: linux-headers-generic linux-image-5.15.0-101-generic 2024-03-30T14:43:54.370 INFO:teuthology.orchestra.run.smithi172.stdout: linux-modules-5.15.0-101-generic linux-modules-extra-5.15.0-101-generic 2024-03-30T14:43:54.372 INFO:teuthology.orchestra.run.smithi172.stdout:Suggested packages: 2024-03-30T14:43:54.372 INFO:teuthology.orchestra.run.smithi172.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-03-30T14:43:54.372 INFO:teuthology.orchestra.run.smithi172.stdout:Recommended packages: 2024-03-30T14:43:54.372 INFO:teuthology.orchestra.run.smithi172.stdout: thermald 2024-03-30T14:43:54.419 INFO:teuthology.orchestra.run.smithi172.stdout:The following NEW packages will be installed: 2024-03-30T14:43:54.419 INFO:teuthology.orchestra.run.smithi172.stdout: linux-headers-5.15.0-101 linux-headers-5.15.0-101-generic 2024-03-30T14:43:54.420 INFO:teuthology.orchestra.run.smithi172.stdout: linux-image-5.15.0-101-generic linux-modules-5.15.0-101-generic 2024-03-30T14:43:54.420 INFO:teuthology.orchestra.run.smithi172.stdout: linux-modules-extra-5.15.0-101-generic 2024-03-30T14:43:54.421 INFO:teuthology.orchestra.run.smithi172.stdout:The following packages will be upgraded: 2024-03-30T14:43:54.422 INFO:teuthology.orchestra.run.smithi172.stdout: linux-generic linux-headers-generic linux-image-generic 2024-03-30T14:43:54.481 INFO:teuthology.orchestra.run.smithi172.stdout:3 upgraded, 5 newly installed, 0 to remove and 311 not upgraded. 2024-03-30T14:43:54.481 INFO:teuthology.orchestra.run.smithi172.stdout:Need to get 113 MB of archives. 2024-03-30T14:43:54.481 INFO:teuthology.orchestra.run.smithi172.stdout:After this operation, 582 MB of additional disk space will be used. 2024-03-30T14:43:54.481 INFO:teuthology.orchestra.run.smithi172.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-101-generic amd64 5.15.0-101.111 [22.6 MB] 2024-03-30T14:43:54.940 INFO:teuthology.orchestra.run.smithi172.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-101-generic amd64 5.15.0-101.111 [11.5 MB] 2024-03-30T14:43:55.037 INFO:teuthology.orchestra.run.smithi072.stdout:Reading package lists... 2024-03-30T14:43:55.042 INFO:teuthology.orchestra.run.smithi172.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-101-generic amd64 5.15.0-101.111 [63.9 MB] 2024-03-30T14:43:55.055 DEBUG:teuthology.orchestra.run.smithi072:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-03-30T14:43:55.112 INFO:teuthology.orchestra.run.smithi072.stdout:Reading package lists... 2024-03-30T14:43:55.309 INFO:teuthology.orchestra.run.smithi072.stdout:Building dependency tree... 2024-03-30T14:43:55.310 INFO:teuthology.orchestra.run.smithi072.stdout:Reading state information... 2024-03-30T14:43:55.479 INFO:teuthology.orchestra.run.smithi072.stdout:The following packages were automatically installed and are no longer required: 2024-03-30T14:43:55.479 INFO:teuthology.orchestra.run.smithi072.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-30T14:43:55.479 INFO:teuthology.orchestra.run.smithi072.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-30T14:43:55.479 INFO:teuthology.orchestra.run.smithi072.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-30T14:43:55.479 INFO:teuthology.orchestra.run.smithi072.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-03-30T14:43:55.480 INFO:teuthology.orchestra.run.smithi072.stdout: python2.7-minimal 2024-03-30T14:43:55.480 INFO:teuthology.orchestra.run.smithi072.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-30T14:43:55.480 INFO:teuthology.orchestra.run.smithi072.stdout:The following additional packages will be installed: 2024-03-30T14:43:55.480 INFO:teuthology.orchestra.run.smithi072.stdout: linux-generic linux-headers-5.15.0-101 linux-headers-5.15.0-101-generic 2024-03-30T14:43:55.480 INFO:teuthology.orchestra.run.smithi072.stdout: linux-headers-generic linux-image-5.15.0-101-generic 2024-03-30T14:43:55.480 INFO:teuthology.orchestra.run.smithi072.stdout: linux-modules-5.15.0-101-generic linux-modules-extra-5.15.0-101-generic 2024-03-30T14:43:55.481 INFO:teuthology.orchestra.run.smithi072.stdout:Suggested packages: 2024-03-30T14:43:55.482 INFO:teuthology.orchestra.run.smithi072.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-03-30T14:43:55.482 INFO:teuthology.orchestra.run.smithi072.stdout:Recommended packages: 2024-03-30T14:43:55.482 INFO:teuthology.orchestra.run.smithi072.stdout: thermald 2024-03-30T14:43:55.529 INFO:teuthology.orchestra.run.smithi072.stdout:The following NEW packages will be installed: 2024-03-30T14:43:55.530 INFO:teuthology.orchestra.run.smithi072.stdout: linux-headers-5.15.0-101 linux-headers-5.15.0-101-generic 2024-03-30T14:43:55.530 INFO:teuthology.orchestra.run.smithi072.stdout: linux-image-5.15.0-101-generic linux-modules-5.15.0-101-generic 2024-03-30T14:43:55.530 INFO:teuthology.orchestra.run.smithi072.stdout: linux-modules-extra-5.15.0-101-generic 2024-03-30T14:43:55.531 INFO:teuthology.orchestra.run.smithi072.stdout:The following packages will be upgraded: 2024-03-30T14:43:55.532 INFO:teuthology.orchestra.run.smithi072.stdout: linux-generic linux-headers-generic linux-image-generic 2024-03-30T14:43:55.592 INFO:teuthology.orchestra.run.smithi072.stdout:3 upgraded, 5 newly installed, 0 to remove and 311 not upgraded. 2024-03-30T14:43:55.592 INFO:teuthology.orchestra.run.smithi072.stdout:Need to get 113 MB of archives. 2024-03-30T14:43:55.592 INFO:teuthology.orchestra.run.smithi072.stdout:After this operation, 582 MB of additional disk space will be used. 2024-03-30T14:43:55.592 INFO:teuthology.orchestra.run.smithi072.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-101-generic amd64 5.15.0-101.111 [22.6 MB] 2024-03-30T14:43:55.931 INFO:teuthology.orchestra.run.smithi172.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.101.98 [1,698 B] 2024-03-30T14:43:55.931 INFO:teuthology.orchestra.run.smithi172.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.101.98 [2,486 B] 2024-03-30T14:43:55.931 INFO:teuthology.orchestra.run.smithi172.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-101 all 5.15.0-101.111 [12.3 MB] 2024-03-30T14:43:56.059 INFO:teuthology.orchestra.run.smithi172.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-101-generic amd64 5.15.0-101.111 [2,876 kB] 2024-03-30T14:43:56.083 INFO:teuthology.orchestra.run.smithi172.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.101.98 [2,332 B] 2024-03-30T14:43:56.124 INFO:teuthology.orchestra.run.smithi072.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-101-generic amd64 5.15.0-101.111 [11.5 MB] 2024-03-30T14:43:56.232 INFO:teuthology.orchestra.run.smithi072.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-101-generic amd64 5.15.0-101.111 [63.9 MB] 2024-03-30T14:43:56.472 INFO:teuthology.orchestra.run.smithi172.stdout:Fetched 113 MB in 2s (68.4 MB/s) 2024-03-30T14:43:56.650 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package linux-modules-5.15.0-101-generic. 2024-03-30T14:43:57.563 INFO:teuthology.orchestra.run.smithi072.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.101.98 [1,698 B] 2024-03-30T14:43:57.690 INFO:teuthology.orchestra.run.smithi072.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.101.98 [2,486 B] 2024-03-30T14:43:57.695 INFO:teuthology.orchestra.run.smithi072.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-101 all 5.15.0-101.111 [12.3 MB] 2024-03-30T14:43:57.999 INFO:teuthology.orchestra.run.smithi072.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-101-generic amd64 5.15.0-101.111 [2,876 kB] 2024-03-30T14:43:58.041 INFO:teuthology.orchestra.run.smithi072.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.101.98 [2,332 B] 2024-03-30T14:43:58.419 INFO:teuthology.orchestra.run.smithi072.stdout:Fetched 113 MB in 3s (45.2 MB/s) 2024-03-30T14:43:58.611 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package linux-modules-5.15.0-101-generic. 2024-03-30T14:43:58.643 INFO:teuthology.orchestra.run.smithi172.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-03-30T14:43:58.647 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../0-linux-modules-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-03-30T14:43:58.780 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking linux-modules-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-30T14:44:00.880 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package linux-image-5.15.0-101-generic. 2024-03-30T14:44:00.902 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../1-linux-image-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-03-30T14:44:00.990 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking linux-image-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-30T14:44:01.450 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-101-generic. 2024-03-30T14:44:01.462 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-03-30T14:44:01.500 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking linux-modules-extra-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-30T14:44:01.602 INFO:teuthology.orchestra.run.smithi072.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-03-30T14:44:01.606 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../0-linux-modules-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-03-30T14:44:01.686 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-modules-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-30T14:44:04.732 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package linux-image-5.15.0-101-generic. 2024-03-30T14:44:04.754 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../1-linux-image-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-03-30T14:44:04.864 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-image-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-30T14:44:05.406 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-101-generic. 2024-03-30T14:44:05.427 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-03-30T14:44:05.465 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-modules-extra-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-30T14:44:08.022 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../3-linux-generic_5.15.0.101.98_amd64.deb ... 2024-03-30T14:44:08.150 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking linux-generic (5.15.0.101.98) over (5.15.0.56.54) ... 2024-03-30T14:44:08.484 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.101.98_amd64.deb ... 2024-03-30T14:44:08.613 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking linux-image-generic (5.15.0.101.98) over (5.15.0.56.54) ... 2024-03-30T14:44:08.907 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package linux-headers-5.15.0-101. 2024-03-30T14:44:08.919 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../5-linux-headers-5.15.0-101_5.15.0-101.111_all.deb ... 2024-03-30T14:44:08.949 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking linux-headers-5.15.0-101 (5.15.0-101.111) ... 2024-03-30T14:44:12.965 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../3-linux-generic_5.15.0.101.98_amd64.deb ... 2024-03-30T14:44:13.091 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-generic (5.15.0.101.98) over (5.15.0.56.54) ... 2024-03-30T14:44:13.426 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.101.98_amd64.deb ... 2024-03-30T14:44:13.549 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-image-generic (5.15.0.101.98) over (5.15.0.56.54) ... 2024-03-30T14:44:13.854 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package linux-headers-5.15.0-101. 2024-03-30T14:44:13.876 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../5-linux-headers-5.15.0-101_5.15.0-101.111_all.deb ... 2024-03-30T14:44:13.912 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-headers-5.15.0-101 (5.15.0-101.111) ... 2024-03-30T14:44:14.715 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package linux-headers-5.15.0-101-generic. 2024-03-30T14:44:14.752 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../6-linux-headers-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-03-30T14:44:14.790 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking linux-headers-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-30T14:44:17.394 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.101.98_amd64.deb ... 2024-03-30T14:44:17.517 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking linux-headers-generic (5.15.0.101.98) over (5.15.0.56.54) ... 2024-03-30T14:44:17.884 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up linux-headers-5.15.0-101 (5.15.0-101.111) ... 2024-03-30T14:44:17.988 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up linux-headers-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-30T14:44:18.089 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up linux-headers-generic (5.15.0.101.98) ... 2024-03-30T14:44:18.218 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up linux-image-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-30T14:44:19.540 INFO:teuthology.orchestra.run.smithi172.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-03-30T14:44:19.540 INFO:teuthology.orchestra.run.smithi172.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-03-30T14:44:19.540 INFO:teuthology.orchestra.run.smithi172.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-101-generic 2024-03-30T14:44:19.540 INFO:teuthology.orchestra.run.smithi172.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-101-generic 2024-03-30T14:44:19.695 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up linux-modules-extra-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-30T14:44:20.045 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package linux-headers-5.15.0-101-generic. 2024-03-30T14:44:20.082 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../6-linux-headers-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-03-30T14:44:20.128 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-headers-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-30T14:44:21.120 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up linux-modules-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-30T14:44:22.513 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up linux-image-generic (5.15.0.101.98) ... 2024-03-30T14:44:22.623 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up linux-generic (5.15.0.101.98) ... 2024-03-30T14:44:22.749 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for linux-image-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-30T14:44:22.828 INFO:teuthology.orchestra.run.smithi172.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-03-30T14:44:22.828 INFO:teuthology.orchestra.run.smithi172.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-101-generic 2024-03-30T14:44:23.724 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.101.98_amd64.deb ... 2024-03-30T14:44:23.825 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-headers-generic (5.15.0.101.98) over (5.15.0.56.54) ... 2024-03-30T14:44:24.191 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-headers-5.15.0-101 (5.15.0-101.111) ... 2024-03-30T14:44:24.319 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-headers-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-30T14:44:24.454 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-headers-generic (5.15.0.101.98) ... 2024-03-30T14:44:24.585 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-image-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-30T14:44:25.937 INFO:teuthology.orchestra.run.smithi072.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-03-30T14:44:25.937 INFO:teuthology.orchestra.run.smithi072.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-03-30T14:44:25.937 INFO:teuthology.orchestra.run.smithi072.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-101-generic 2024-03-30T14:44:25.937 INFO:teuthology.orchestra.run.smithi072.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-101-generic 2024-03-30T14:44:26.102 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-modules-extra-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-30T14:44:27.514 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-modules-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-30T14:44:29.600 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-image-generic (5.15.0.101.98) ... 2024-03-30T14:44:29.727 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-generic (5.15.0.101.98) ... 2024-03-30T14:44:29.856 INFO:teuthology.orchestra.run.smithi072.stdout:Processing triggers for linux-image-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-30T14:44:29.926 INFO:teuthology.orchestra.run.smithi072.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-03-30T14:44:29.926 INFO:teuthology.orchestra.run.smithi072.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-101-generic 2024-03-30T14:44:37.462 INFO:teuthology.orchestra.run.smithi172.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-03-30T14:44:37.462 INFO:teuthology.orchestra.run.smithi172.stdout:Sourcing file `/etc/default/grub' 2024-03-30T14:44:37.472 INFO:teuthology.orchestra.run.smithi172.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-30T14:44:37.498 INFO:teuthology.orchestra.run.smithi172.stdout:Generating grub configuration file ... 2024-03-30T14:44:37.774 INFO:teuthology.orchestra.run.smithi172.stdout:Found linux image: /boot/vmlinuz-5.15.0-101-generic 2024-03-30T14:44:37.800 INFO:teuthology.orchestra.run.smithi172.stdout:Found initrd image: /boot/initrd.img-5.15.0-101-generic 2024-03-30T14:44:38.085 INFO:teuthology.orchestra.run.smithi172.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-03-30T14:44:38.091 INFO:teuthology.orchestra.run.smithi172.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-03-30T14:44:38.165 INFO:teuthology.orchestra.run.smithi172.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-03-30T14:44:38.170 INFO:teuthology.orchestra.run.smithi172.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-03-30T14:44:38.340 INFO:teuthology.orchestra.run.smithi172.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-03-30T14:44:38.341 INFO:teuthology.orchestra.run.smithi172.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-03-30T14:44:38.341 INFO:teuthology.orchestra.run.smithi172.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-03-30T14:44:38.378 INFO:teuthology.orchestra.run.smithi172.stdout:done 2024-03-30T14:44:38.845 DEBUG:teuthology.orchestra.run.smithi172:> dpkg -s linux-image-generic 2024-03-30T14:44:38.921 INFO:teuthology.orchestra.run.smithi172.stdout:Package: linux-image-generic 2024-03-30T14:44:38.922 INFO:teuthology.orchestra.run.smithi172.stdout:Status: install ok installed 2024-03-30T14:44:38.922 INFO:teuthology.orchestra.run.smithi172.stdout:Priority: optional 2024-03-30T14:44:38.922 INFO:teuthology.orchestra.run.smithi172.stdout:Section: kernel 2024-03-30T14:44:38.922 INFO:teuthology.orchestra.run.smithi172.stdout:Installed-Size: 21 2024-03-30T14:44:38.922 INFO:teuthology.orchestra.run.smithi172.stdout:Maintainer: Ubuntu Kernel Team 2024-03-30T14:44:38.922 INFO:teuthology.orchestra.run.smithi172.stdout:Architecture: amd64 2024-03-30T14:44:38.922 INFO:teuthology.orchestra.run.smithi172.stdout:Source: linux-meta 2024-03-30T14:44:38.923 INFO:teuthology.orchestra.run.smithi172.stdout:Version: 5.15.0.101.98 2024-03-30T14:44:38.923 INFO:teuthology.orchestra.run.smithi172.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-101), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-03-30T14:44:38.923 INFO:teuthology.orchestra.run.smithi172.stdout:Depends: linux-image-5.15.0-101-generic, linux-modules-extra-5.15.0-101-generic, linux-firmware, intel-microcode, amd64-microcode 2024-03-30T14:44:38.923 INFO:teuthology.orchestra.run.smithi172.stdout:Recommends: thermald 2024-03-30T14:44:38.924 INFO:teuthology.orchestra.run.smithi172.stdout:Description: Generic Linux kernel image 2024-03-30T14:44:38.924 INFO:teuthology.orchestra.run.smithi172.stdout: This package will always depend on the latest generic kernel image 2024-03-30T14:44:38.924 INFO:teuthology.orchestra.run.smithi172.stdout: available. 2024-03-30T14:44:38.924 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-101-generic 2024-03-30T14:44:38.924 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-30T14:44:38.925 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-30T14:44:38.925 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-03-30T14:44:38.925 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi172.front.sepia.ceph.com, path=None, version=distro) 2024-03-30T14:44:38.926 DEBUG:teuthology.orchestra.run.smithi172:> sudo apt-get clean 2024-03-30T14:44:39.129 DEBUG:teuthology.orchestra.run.smithi172:> sudo apt-get update 2024-03-30T14:44:39.259 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-30T14:44:39.270 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-03-30T14:44:39.290 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-03-30T14:44:39.374 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-03-30T14:44:40.596 INFO:teuthology.orchestra.run.smithi172.stdout:Reading package lists... 2024-03-30T14:44:40.613 DEBUG:teuthology.orchestra.run.smithi172:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-03-30T14:44:40.664 INFO:teuthology.orchestra.run.smithi172.stdout:Reading package lists... 2024-03-30T14:44:40.838 INFO:teuthology.orchestra.run.smithi172.stdout:Building dependency tree... 2024-03-30T14:44:40.839 INFO:teuthology.orchestra.run.smithi172.stdout:Reading state information... 2024-03-30T14:44:40.994 INFO:teuthology.orchestra.run.smithi172.stdout:linux-image-generic is already the newest version (5.15.0.101.98). 2024-03-30T14:44:40.994 INFO:teuthology.orchestra.run.smithi172.stdout:The following packages were automatically installed and are no longer required: 2024-03-30T14:44:40.994 INFO:teuthology.orchestra.run.smithi172.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-30T14:44:40.994 INFO:teuthology.orchestra.run.smithi172.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-30T14:44:40.994 INFO:teuthology.orchestra.run.smithi172.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-30T14:44:40.994 INFO:teuthology.orchestra.run.smithi172.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-30T14:44:40.994 INFO:teuthology.orchestra.run.smithi172.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-30T14:44:40.994 INFO:teuthology.orchestra.run.smithi172.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-30T14:44:41.028 INFO:teuthology.orchestra.run.smithi172.stdout:0 upgraded, 0 newly installed, 0 to remove and 311 not upgraded. 2024-03-30T14:44:41.030 DEBUG:teuthology.orchestra.run.smithi172:> dpkg -s linux-image-generic 2024-03-30T14:44:41.089 INFO:teuthology.orchestra.run.smithi172.stdout:Package: linux-image-generic 2024-03-30T14:44:41.089 INFO:teuthology.orchestra.run.smithi172.stdout:Status: install ok installed 2024-03-30T14:44:41.089 INFO:teuthology.orchestra.run.smithi172.stdout:Priority: optional 2024-03-30T14:44:41.090 INFO:teuthology.orchestra.run.smithi172.stdout:Section: kernel 2024-03-30T14:44:41.090 INFO:teuthology.orchestra.run.smithi172.stdout:Installed-Size: 21 2024-03-30T14:44:41.090 INFO:teuthology.orchestra.run.smithi172.stdout:Maintainer: Ubuntu Kernel Team 2024-03-30T14:44:41.090 INFO:teuthology.orchestra.run.smithi172.stdout:Architecture: amd64 2024-03-30T14:44:41.090 INFO:teuthology.orchestra.run.smithi172.stdout:Source: linux-meta 2024-03-30T14:44:41.090 INFO:teuthology.orchestra.run.smithi172.stdout:Version: 5.15.0.101.98 2024-03-30T14:44:41.090 INFO:teuthology.orchestra.run.smithi172.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-101), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-03-30T14:44:41.090 INFO:teuthology.orchestra.run.smithi172.stdout:Depends: linux-image-5.15.0-101-generic, linux-modules-extra-5.15.0-101-generic, linux-firmware, intel-microcode, amd64-microcode 2024-03-30T14:44:41.090 INFO:teuthology.orchestra.run.smithi172.stdout:Recommends: thermald 2024-03-30T14:44:41.090 INFO:teuthology.orchestra.run.smithi172.stdout:Description: Generic Linux kernel image 2024-03-30T14:44:41.090 INFO:teuthology.orchestra.run.smithi172.stdout: This package will always depend on the latest generic kernel image 2024-03-30T14:44:41.090 INFO:teuthology.orchestra.run.smithi172.stdout: available. 2024-03-30T14:44:41.091 DEBUG:teuthology.orchestra.run.smithi172:> mktemp 2024-03-30T14:44:41.134 INFO:teuthology.orchestra.run.smithi172.stdout:/tmp/tmp.6SmjtzdZlH 2024-03-30T14:44:41.134 DEBUG:teuthology.orchestra.run.smithi172:> sudo cp /boot/grub/grub.cfg /tmp/tmp.6SmjtzdZlH 2024-03-30T14:44:41.192 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0666 /tmp/tmp.6SmjtzdZlH 2024-03-30T14:44:41.321 DEBUG:teuthology.orchestra.remote:smithi172:/tmp/tmp.6SmjtzdZlH is 10KB 2024-03-30T14:44:41.334 DEBUG:teuthology.orchestra.run.smithi172:> rm -fr /tmp/tmp.6SmjtzdZlH 2024-03-30T14:44:41.340 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-03-30T14:44:41.395 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-03-30T14:44:41.395 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-03-30T14:44:41.395 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-03-30T14:44:41.492 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-101-generic 2024-03-30T14:44:41.492 DEBUG:teuthology.orchestra.run.smithi172:> sudo update-grub 2024-03-30T14:44:42.627 INFO:teuthology.orchestra.run.smithi172.stderr:Sourcing file `/etc/default/grub' 2024-03-30T14:44:42.628 INFO:teuthology.orchestra.run.smithi172.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-30T14:44:42.630 INFO:teuthology.orchestra.run.smithi172.stderr:Generating grub configuration file ... 2024-03-30T14:44:42.816 INFO:teuthology.orchestra.run.smithi172.stderr:Found linux image: /boot/vmlinuz-5.15.0-101-generic 2024-03-30T14:44:42.822 INFO:teuthology.orchestra.run.smithi172.stderr:Found initrd image: /boot/initrd.img-5.15.0-101-generic 2024-03-30T14:44:43.054 INFO:teuthology.orchestra.run.smithi172.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-03-30T14:44:43.059 INFO:teuthology.orchestra.run.smithi172.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-03-30T14:44:43.100 INFO:teuthology.orchestra.run.smithi172.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-03-30T14:44:43.105 INFO:teuthology.orchestra.run.smithi172.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-03-30T14:44:43.248 INFO:teuthology.orchestra.run.smithi172.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-03-30T14:44:43.248 INFO:teuthology.orchestra.run.smithi172.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-03-30T14:44:43.249 INFO:teuthology.orchestra.run.smithi172.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-03-30T14:44:43.268 INFO:teuthology.orchestra.run.smithi172.stderr:done 2024-03-30T14:44:43.277 DEBUG:teuthology.orchestra.run.smithi172:> sudo shutdown -r now 2024-03-30T14:44:46.889 INFO:teuthology.orchestra.run.smithi072.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-03-30T14:44:46.890 INFO:teuthology.orchestra.run.smithi072.stdout:Sourcing file `/etc/default/grub' 2024-03-30T14:44:46.921 INFO:teuthology.orchestra.run.smithi072.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-30T14:44:46.944 INFO:teuthology.orchestra.run.smithi072.stdout:Generating grub configuration file ... 2024-03-30T14:44:47.256 INFO:teuthology.orchestra.run.smithi072.stdout:Found linux image: /boot/vmlinuz-5.15.0-101-generic 2024-03-30T14:44:47.302 INFO:teuthology.orchestra.run.smithi072.stdout:Found initrd image: /boot/initrd.img-5.15.0-101-generic 2024-03-30T14:44:47.589 INFO:teuthology.orchestra.run.smithi072.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-03-30T14:44:47.595 INFO:teuthology.orchestra.run.smithi072.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-03-30T14:44:47.679 INFO:teuthology.orchestra.run.smithi072.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-03-30T14:44:47.684 INFO:teuthology.orchestra.run.smithi072.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-03-30T14:44:47.983 INFO:teuthology.orchestra.run.smithi072.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-03-30T14:44:47.983 INFO:teuthology.orchestra.run.smithi072.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-03-30T14:44:47.983 INFO:teuthology.orchestra.run.smithi072.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-03-30T14:44:48.073 INFO:teuthology.orchestra.run.smithi072.stdout:done 2024-03-30T14:44:48.605 DEBUG:teuthology.orchestra.run.smithi072:> dpkg -s linux-image-generic 2024-03-30T14:44:48.630 INFO:teuthology.orchestra.run.smithi072.stdout:Package: linux-image-generic 2024-03-30T14:44:48.630 INFO:teuthology.orchestra.run.smithi072.stdout:Status: install ok installed 2024-03-30T14:44:48.630 INFO:teuthology.orchestra.run.smithi072.stdout:Priority: optional 2024-03-30T14:44:48.630 INFO:teuthology.orchestra.run.smithi072.stdout:Section: kernel 2024-03-30T14:44:48.630 INFO:teuthology.orchestra.run.smithi072.stdout:Installed-Size: 21 2024-03-30T14:44:48.630 INFO:teuthology.orchestra.run.smithi072.stdout:Maintainer: Ubuntu Kernel Team 2024-03-30T14:44:48.630 INFO:teuthology.orchestra.run.smithi072.stdout:Architecture: amd64 2024-03-30T14:44:48.630 INFO:teuthology.orchestra.run.smithi072.stdout:Source: linux-meta 2024-03-30T14:44:48.630 INFO:teuthology.orchestra.run.smithi072.stdout:Version: 5.15.0.101.98 2024-03-30T14:44:48.630 INFO:teuthology.orchestra.run.smithi072.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-101), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-03-30T14:44:48.631 INFO:teuthology.orchestra.run.smithi072.stdout:Depends: linux-image-5.15.0-101-generic, linux-modules-extra-5.15.0-101-generic, linux-firmware, intel-microcode, amd64-microcode 2024-03-30T14:44:48.631 INFO:teuthology.orchestra.run.smithi072.stdout:Recommends: thermald 2024-03-30T14:44:48.631 INFO:teuthology.orchestra.run.smithi072.stdout:Description: Generic Linux kernel image 2024-03-30T14:44:48.631 INFO:teuthology.orchestra.run.smithi072.stdout: This package will always depend on the latest generic kernel image 2024-03-30T14:44:48.631 INFO:teuthology.orchestra.run.smithi072.stdout: available. 2024-03-30T14:44:48.631 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-101-generic 2024-03-30T14:44:48.631 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-30T14:44:48.631 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-30T14:44:48.631 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-03-30T14:44:48.632 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi072.front.sepia.ceph.com, path=None, version=distro) 2024-03-30T14:44:48.632 DEBUG:teuthology.orchestra.run.smithi072:> sudo apt-get clean 2024-03-30T14:44:48.817 DEBUG:teuthology.orchestra.run.smithi072:> sudo apt-get update 2024-03-30T14:44:48.932 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-30T14:44:48.933 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-03-30T14:44:48.945 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-03-30T14:44:48.965 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-03-30T14:44:50.291 INFO:teuthology.orchestra.run.smithi072.stdout:Reading package lists... 2024-03-30T14:44:50.309 DEBUG:teuthology.orchestra.run.smithi072:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-03-30T14:44:50.370 INFO:teuthology.orchestra.run.smithi072.stdout:Reading package lists... 2024-03-30T14:44:50.567 INFO:teuthology.orchestra.run.smithi072.stdout:Building dependency tree... 2024-03-30T14:44:50.568 INFO:teuthology.orchestra.run.smithi072.stdout:Reading state information... 2024-03-30T14:44:50.741 INFO:teuthology.orchestra.run.smithi072.stdout:linux-image-generic is already the newest version (5.15.0.101.98). 2024-03-30T14:44:50.741 INFO:teuthology.orchestra.run.smithi072.stdout:The following packages were automatically installed and are no longer required: 2024-03-30T14:44:50.741 INFO:teuthology.orchestra.run.smithi072.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-30T14:44:50.741 INFO:teuthology.orchestra.run.smithi072.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-30T14:44:50.741 INFO:teuthology.orchestra.run.smithi072.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-30T14:44:50.741 INFO:teuthology.orchestra.run.smithi072.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-30T14:44:50.742 INFO:teuthology.orchestra.run.smithi072.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-30T14:44:50.742 INFO:teuthology.orchestra.run.smithi072.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-30T14:44:50.782 INFO:teuthology.orchestra.run.smithi072.stdout:0 upgraded, 0 newly installed, 0 to remove and 311 not upgraded. 2024-03-30T14:44:50.784 DEBUG:teuthology.orchestra.run.smithi072:> dpkg -s linux-image-generic 2024-03-30T14:44:50.797 INFO:teuthology.orchestra.run.smithi072.stdout:Package: linux-image-generic 2024-03-30T14:44:50.797 INFO:teuthology.orchestra.run.smithi072.stdout:Status: install ok installed 2024-03-30T14:44:50.797 INFO:teuthology.orchestra.run.smithi072.stdout:Priority: optional 2024-03-30T14:44:50.797 INFO:teuthology.orchestra.run.smithi072.stdout:Section: kernel 2024-03-30T14:44:50.797 INFO:teuthology.orchestra.run.smithi072.stdout:Installed-Size: 21 2024-03-30T14:44:50.797 INFO:teuthology.orchestra.run.smithi072.stdout:Maintainer: Ubuntu Kernel Team 2024-03-30T14:44:50.797 INFO:teuthology.orchestra.run.smithi072.stdout:Architecture: amd64 2024-03-30T14:44:50.797 INFO:teuthology.orchestra.run.smithi072.stdout:Source: linux-meta 2024-03-30T14:44:50.797 INFO:teuthology.orchestra.run.smithi072.stdout:Version: 5.15.0.101.98 2024-03-30T14:44:50.797 INFO:teuthology.orchestra.run.smithi072.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-101), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-03-30T14:44:50.797 INFO:teuthology.orchestra.run.smithi072.stdout:Depends: linux-image-5.15.0-101-generic, linux-modules-extra-5.15.0-101-generic, linux-firmware, intel-microcode, amd64-microcode 2024-03-30T14:44:50.798 INFO:teuthology.orchestra.run.smithi072.stdout:Recommends: thermald 2024-03-30T14:44:50.798 INFO:teuthology.orchestra.run.smithi072.stdout:Description: Generic Linux kernel image 2024-03-30T14:44:50.798 INFO:teuthology.orchestra.run.smithi072.stdout: This package will always depend on the latest generic kernel image 2024-03-30T14:44:50.798 INFO:teuthology.orchestra.run.smithi072.stdout: available. 2024-03-30T14:44:50.798 DEBUG:teuthology.orchestra.run.smithi072:> mktemp 2024-03-30T14:44:50.843 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.cqPRCbtUfm 2024-03-30T14:44:50.843 DEBUG:teuthology.orchestra.run.smithi072:> sudo cp /boot/grub/grub.cfg /tmp/tmp.cqPRCbtUfm 2024-03-30T14:44:50.898 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0666 /tmp/tmp.cqPRCbtUfm 2024-03-30T14:44:51.025 DEBUG:teuthology.orchestra.remote:smithi072:/tmp/tmp.cqPRCbtUfm is 10KB 2024-03-30T14:44:51.037 DEBUG:teuthology.orchestra.run.smithi072:> rm -fr /tmp/tmp.cqPRCbtUfm 2024-03-30T14:44:51.043 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-03-30T14:44:51.095 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-30T14:44:51.095 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-03-30T14:44:51.095 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-03-30T14:44:51.185 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-101-generic 2024-03-30T14:44:51.186 DEBUG:teuthology.orchestra.run.smithi072:> sudo update-grub 2024-03-30T14:44:53.348 INFO:teuthology.orchestra.run.smithi072.stderr:Sourcing file `/etc/default/grub' 2024-03-30T14:44:53.354 INFO:teuthology.orchestra.run.smithi072.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-30T14:44:53.376 INFO:teuthology.orchestra.run.smithi072.stderr:Generating grub configuration file ... 2024-03-30T14:44:53.588 INFO:teuthology.orchestra.run.smithi072.stderr:Found linux image: /boot/vmlinuz-5.15.0-101-generic 2024-03-30T14:44:53.594 INFO:teuthology.orchestra.run.smithi072.stderr:Found initrd image: /boot/initrd.img-5.15.0-101-generic 2024-03-30T14:44:53.837 INFO:teuthology.orchestra.run.smithi072.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-03-30T14:44:53.842 INFO:teuthology.orchestra.run.smithi072.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-03-30T14:44:53.885 INFO:teuthology.orchestra.run.smithi072.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-03-30T14:44:53.890 INFO:teuthology.orchestra.run.smithi072.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-03-30T14:44:54.013 INFO:teuthology.orchestra.run.smithi072.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-03-30T14:44:54.013 INFO:teuthology.orchestra.run.smithi072.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-03-30T14:44:54.014 INFO:teuthology.orchestra.run.smithi072.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-03-30T14:44:54.050 INFO:teuthology.orchestra.run.smithi072.stderr:done 2024-03-30T14:44:54.052 DEBUG:teuthology.orchestra.run.smithi072:> sudo shutdown -r now 2024-03-30T14:45:13.298 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-03-30T14:45:13.299 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-03-30T14:45:13.299 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T14:45:24.063 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-03-30T14:45:24.063 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-03-30T14:45:24.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T14:45:42.559 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-03-30T14:45:47.934 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-03-30T14:45:51.562 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-03-30T14:45:51.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T14:45:54.622 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-03-30T14:45:56.936 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-03-30T14:45:56.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T14:46:06.633 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-03-30T14:46:06.634 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T14:46:15.326 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-03-30T14:46:25.058 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-03-30T14:46:27.330 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-03-30T14:46:27.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T14:46:27.333 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-03-30T14:46:40.063 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-03-30T14:46:40.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T14:46:42.335 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-03-30T14:46:42.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T14:46:42.421 DEBUG:teuthology.orchestra.run.smithi072:> true 2024-03-30T14:46:42.592 DEBUG:teuthology.orchestra.run.smithi172:> true 2024-03-30T14:46:43.137 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-03-30T14:46:43.137 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-101-generic"... 2024-03-30T14:46:43.138 DEBUG:teuthology.orchestra.run.smithi172:> uname -r 2024-03-30T14:46:43.184 INFO:teuthology.orchestra.run.smithi172.stdout:5.15.0-101-generic 2024-03-30T14:46:43.184 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-101-generic vs 5.15.0-101-generic 2024-03-30T14:46:43.184 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-30T14:46:43.184 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-03-30T14:46:43.665 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-03-30T14:46:43.665 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-101-generic"... 2024-03-30T14:46:43.666 DEBUG:teuthology.orchestra.run.smithi072:> uname -r 2024-03-30T14:46:43.670 INFO:teuthology.orchestra.run.smithi072.stdout:5.15.0-101-generic 2024-03-30T14:46:43.671 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-101-generic vs 5.15.0-101-generic 2024-03-30T14:46:43.671 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-30T14:46:43.671 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-03-30T14:46:44.185 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-03-30T14:46:44.185 DEBUG:teuthology.orchestra.run.smithi172:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-30T14:46:44.553 INFO:teuthology.orchestra.run.smithi172.stdout:ttyS1 2024-03-30T14:46:44.593 DEBUG:teuthology.parallel:result is None 2024-03-30T14:46:44.672 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-03-30T14:46:44.672 DEBUG:teuthology.orchestra.run.smithi072:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-30T14:46:45.047 INFO:teuthology.orchestra.run.smithi072.stdout:ttyS1 2024-03-30T14:46:45.077 DEBUG:teuthology.parallel:result is None 2024-03-30T14:46:45.077 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-30T14:46:45.084 INFO:teuthology.task.internal:Creating test directory... 2024-03-30T14:46:45.084 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-30T14:46:45.087 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-30T14:46:45.092 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-30T14:46:45.115 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-30T14:46:45.148 INFO:teuthology.task.internal:Creating archive directory... 2024-03-30T14:46:45.149 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-30T14:46:45.151 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-30T14:46:45.193 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-30T14:46:45.199 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-30T14:46:45.200 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-30T14:46:45.232 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-30T14:46:45.250 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-30T14:46:45.257 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-30T14:46:45.272 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-30T14:46:45.282 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-30T14:46:45.283 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-30T14:46:45.289 INFO:teuthology.task.internal:Configuring sudo... 2024-03-30T14:46:45.290 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-30T14:46:45.328 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-30T14:46:45.340 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-30T14:46:45.350 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-30T14:46:45.350 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-30T14:46:45.384 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-30T14:46:45.389 DEBUG:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-30T14:46:45.434 DEBUG:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-30T14:46:45.482 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-30T14:46:45.483 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-30T14:46:45.555 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-30T14:46:45.561 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-30T14:46:45.608 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-03-30T14:46:45.608 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-30T14:46:45.667 DEBUG:teuthology.orchestra.run.smithi072:> sudo service rsyslog restart 2024-03-30T14:46:45.670 DEBUG:teuthology.orchestra.run.smithi172:> sudo service rsyslog restart 2024-03-30T14:46:45.741 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-30T14:46:45.749 INFO:teuthology.task.internal:Starting timer... 2024-03-30T14:46:45.749 INFO:teuthology.run_tasks:Running task pcp... 2024-03-30T14:46:45.830 INFO:teuthology.run_tasks:Running task selinux... 2024-03-30T14:46:45.867 DEBUG:teuthology.task.selinux:Excluding smithi072: OS 'ubuntu' does not support SELinux 2024-03-30T14:46:45.867 DEBUG:teuthology.task.selinux:Excluding smithi172: OS 'ubuntu' does not support SELinux 2024-03-30T14:46:45.868 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-30T14:46:45.868 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-03-30T14:46:45.868 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-30T14:46:45.868 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-30T14:46:45.903 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-03-30T14:46:45.909 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-03-30T14:46:46.040 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-30T14:46:46.059 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-30T14:46:46.060 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi072.front.sepia.ceph.com,smithi172.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-30T14:53:48.213 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi072.front.sepia.ceph.com'), Remote(name='ubuntu@smithi172.front.sepia.ceph.com')] 2024-03-30T14:53:48.214 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-03-30T14:53:48.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T14:53:48.297 DEBUG:teuthology.orchestra.run.smithi072:> true 2024-03-30T14:53:48.374 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-03-30T14:53:48.375 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-03-30T14:53:48.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T14:53:48.454 DEBUG:teuthology.orchestra.run.smithi172:> true 2024-03-30T14:53:48.534 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-03-30T14:53:48.534 INFO:teuthology.run_tasks:Running task clock... 2024-03-30T14:53:48.544 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-30T14:53:48.544 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-30T14:53:48.545 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-30T14:53:48.547 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-30T14:53:48.547 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-30T14:53:48.572 INFO:teuthology.orchestra.run.smithi072.stdout:30 Mar 14:53:48 ntpd[17209]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-03-30T14:53:48.573 INFO:teuthology.orchestra.run.smithi072.stdout:30 Mar 14:53:48 ntpd[17209]: Command line: ntpd -gq 2024-03-30T14:53:48.573 INFO:teuthology.orchestra.run.smithi072.stdout:30 Mar 14:53:48 ntpd[17209]: ---------------------------------------------------- 2024-03-30T14:53:48.573 INFO:teuthology.orchestra.run.smithi072.stdout:30 Mar 14:53:48 ntpd[17209]: ntp-4 is maintained by Network Time Foundation, 2024-03-30T14:53:48.573 INFO:teuthology.orchestra.run.smithi072.stdout:30 Mar 14:53:48 ntpd[17209]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-03-30T14:53:48.573 INFO:teuthology.orchestra.run.smithi072.stdout:30 Mar 14:53:48 ntpd[17209]: corporation. Support and training for ntp-4 are 2024-03-30T14:53:48.573 INFO:teuthology.orchestra.run.smithi072.stdout:30 Mar 14:53:48 ntpd[17209]: available at https://www.nwtime.org/support 2024-03-30T14:53:48.573 INFO:teuthology.orchestra.run.smithi072.stdout:30 Mar 14:53:48 ntpd[17209]: ---------------------------------------------------- 2024-03-30T14:53:48.574 INFO:teuthology.orchestra.run.smithi072.stdout:30 Mar 14:53:48 ntpd[17209]: proto: precision = 0.044 usec (-24) 2024-03-30T14:53:48.574 INFO:teuthology.orchestra.run.smithi072.stdout:30 Mar 14:53:48 ntpd[17209]: basedate set to 2022-02-04 2024-03-30T14:53:48.574 INFO:teuthology.orchestra.run.smithi072.stdout:30 Mar 14:53:48 ntpd[17209]: gps base set to 2022-02-06 (week 2196) 2024-03-30T14:53:48.575 INFO:teuthology.orchestra.run.smithi072.stdout:30 Mar 14:53:48 ntpd[17209]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-30T14:53:48.575 INFO:teuthology.orchestra.run.smithi072.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-30T14:53:48.575 INFO:teuthology.orchestra.run.smithi072.stderr:restrict ::: KOD does nothing without LIMITED. 2024-03-30T14:53:48.576 INFO:teuthology.orchestra.run.smithi072.stdout:30 Mar 14:53:48 ntpd[17209]: restrict ::: KOD does nothing without LIMITED. 2024-03-30T14:53:48.576 INFO:teuthology.orchestra.run.smithi072.stdout:30 Mar 14:53:48 ntpd[17209]: Listen and drop on 0 v6wildcard [::]:123 2024-03-30T14:53:48.576 INFO:teuthology.orchestra.run.smithi072.stdout:30 Mar 14:53:48 ntpd[17209]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-03-30T14:53:48.576 INFO:teuthology.orchestra.run.smithi072.stdout:30 Mar 14:53:48 ntpd[17209]: Listen normally on 2 lo 127.0.0.1:123 2024-03-30T14:53:48.576 INFO:teuthology.orchestra.run.smithi072.stdout:30 Mar 14:53:48 ntpd[17209]: Listen normally on 3 enp3s0f1 172.21.15.72:123 2024-03-30T14:53:48.576 INFO:teuthology.orchestra.run.smithi072.stdout:30 Mar 14:53:48 ntpd[17209]: Listen normally on 4 lo [::1]:123 2024-03-30T14:53:48.576 INFO:teuthology.orchestra.run.smithi072.stdout:30 Mar 14:53:48 ntpd[17209]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:b765%5]:123 2024-03-30T14:53:48.576 INFO:teuthology.orchestra.run.smithi072.stdout:30 Mar 14:53:48 ntpd[17209]: Listening on routing socket on fd #22 for interface updates 2024-03-30T14:53:48.608 INFO:teuthology.orchestra.run.smithi172.stdout:30 Mar 14:53:48 ntpd[17170]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-03-30T14:53:48.608 INFO:teuthology.orchestra.run.smithi172.stdout:30 Mar 14:53:48 ntpd[17170]: Command line: ntpd -gq 2024-03-30T14:53:48.608 INFO:teuthology.orchestra.run.smithi172.stdout:30 Mar 14:53:48 ntpd[17170]: ---------------------------------------------------- 2024-03-30T14:53:48.608 INFO:teuthology.orchestra.run.smithi172.stdout:30 Mar 14:53:48 ntpd[17170]: ntp-4 is maintained by Network Time Foundation, 2024-03-30T14:53:48.608 INFO:teuthology.orchestra.run.smithi172.stdout:30 Mar 14:53:48 ntpd[17170]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-03-30T14:53:48.608 INFO:teuthology.orchestra.run.smithi172.stdout:30 Mar 14:53:48 ntpd[17170]: corporation. Support and training for ntp-4 are 2024-03-30T14:53:48.608 INFO:teuthology.orchestra.run.smithi172.stdout:30 Mar 14:53:48 ntpd[17170]: available at https://www.nwtime.org/support 2024-03-30T14:53:48.608 INFO:teuthology.orchestra.run.smithi172.stdout:30 Mar 14:53:48 ntpd[17170]: ---------------------------------------------------- 2024-03-30T14:53:48.609 INFO:teuthology.orchestra.run.smithi172.stdout:30 Mar 14:53:48 ntpd[17170]: proto: precision = 0.044 usec (-24) 2024-03-30T14:53:48.609 INFO:teuthology.orchestra.run.smithi172.stdout:30 Mar 14:53:48 ntpd[17170]: basedate set to 2022-02-04 2024-03-30T14:53:48.609 INFO:teuthology.orchestra.run.smithi172.stdout:30 Mar 14:53:48 ntpd[17170]: gps base set to 2022-02-06 (week 2196) 2024-03-30T14:53:48.609 INFO:teuthology.orchestra.run.smithi172.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-30T14:53:48.609 INFO:teuthology.orchestra.run.smithi172.stdout:30 Mar 14:53:48 ntpd[17170]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-30T14:53:48.610 INFO:teuthology.orchestra.run.smithi172.stdout:30 Mar 14:53:48 ntpd[17170]: restrict ::: KOD does nothing without LIMITED. 2024-03-30T14:53:48.610 INFO:teuthology.orchestra.run.smithi172.stderr:restrict ::: KOD does nothing without LIMITED. 2024-03-30T14:53:48.611 INFO:teuthology.orchestra.run.smithi172.stdout:30 Mar 14:53:48 ntpd[17170]: Listen and drop on 0 v6wildcard [::]:123 2024-03-30T14:53:48.611 INFO:teuthology.orchestra.run.smithi172.stdout:30 Mar 14:53:48 ntpd[17170]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-03-30T14:53:48.611 INFO:teuthology.orchestra.run.smithi172.stdout:30 Mar 14:53:48 ntpd[17170]: Listen normally on 2 lo 127.0.0.1:123 2024-03-30T14:53:48.611 INFO:teuthology.orchestra.run.smithi172.stdout:30 Mar 14:53:48 ntpd[17170]: Listen normally on 3 enp3s0f1 172.21.15.172:123 2024-03-30T14:53:48.611 INFO:teuthology.orchestra.run.smithi172.stdout:30 Mar 14:53:48 ntpd[17170]: Listen normally on 4 lo [::1]:123 2024-03-30T14:53:48.611 INFO:teuthology.orchestra.run.smithi172.stdout:30 Mar 14:53:48 ntpd[17170]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7f91%5]:123 2024-03-30T14:53:48.611 INFO:teuthology.orchestra.run.smithi172.stdout:30 Mar 14:53:48 ntpd[17170]: Listening on routing socket on fd #22 for interface updates 2024-03-30T14:53:49.574 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:49 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T14:53:49.574 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:49 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T14:53:49.574 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:49 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T14:53:49.574 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:49 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T14:53:49.574 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:49 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T14:53:49.574 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:49 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T14:53:49.574 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:49 ntpd[17209]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-30T14:53:49.574 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:49 ntpd[17209]: can't open /var/log/ntpstats/peerstats.20240330: Permission denied 2024-03-30T14:53:49.575 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:49 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T14:53:49.575 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:49 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T14:53:49.575 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:49 ntpd[17209]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-30T14:53:49.575 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:49 ntpd[17209]: can't open /var/log/ntpstats/peerstats.20240330: Permission denied 2024-03-30T14:53:49.608 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:49 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T14:53:49.608 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:49 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T14:53:49.609 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:49 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T14:53:49.609 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:49 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T14:53:49.609 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:49 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T14:53:49.609 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:49 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T14:53:49.609 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:49 ntpd[17170]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-30T14:53:49.609 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:49 ntpd[17170]: can't open /var/log/ntpstats/peerstats.20240330: Permission denied 2024-03-30T14:53:50.573 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:50 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T14:53:50.573 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:50 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T14:53:51.574 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:51 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T14:53:51.574 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:51 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T14:53:51.574 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:51 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T14:53:51.574 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:51 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T14:53:51.574 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:51 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T14:53:51.574 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:51 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T14:53:51.574 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:51 ntpd[17209]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-30T14:53:51.574 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:51 ntpd[17209]: can't open /var/log/ntpstats/peerstats.20240330: Permission denied 2024-03-30T14:53:51.574 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:51 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T14:53:51.574 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:51 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T14:53:51.574 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:51 ntpd[17209]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-30T14:53:51.575 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:51 ntpd[17209]: can't open /var/log/ntpstats/peerstats.20240330: Permission denied 2024-03-30T14:53:51.609 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:51 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T14:53:51.609 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:51 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T14:53:51.609 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:51 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T14:53:51.609 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:51 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T14:53:51.609 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:51 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T14:53:51.609 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:51 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T14:53:51.609 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:51 ntpd[17170]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-30T14:53:51.609 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:51 ntpd[17170]: can't open /var/log/ntpstats/peerstats.20240330: Permission denied 2024-03-30T14:53:51.609 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:51 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T14:53:51.609 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:51 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T14:53:51.609 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:51 ntpd[17170]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-30T14:53:51.610 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:51 ntpd[17170]: can't open /var/log/ntpstats/peerstats.20240330: Permission denied 2024-03-30T14:53:52.573 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:52 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T14:53:52.573 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:52 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T14:53:52.573 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:52 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T14:53:52.573 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:52 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T14:53:52.573 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:52 ntpd[17209]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-30T14:53:52.574 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:52 ntpd[17209]: can't open /var/log/ntpstats/peerstats.20240330: Permission denied 2024-03-30T14:53:53.573 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:53 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T14:53:53.574 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:53 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T14:53:53.574 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:53 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T14:53:53.574 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:53 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T14:53:53.574 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:53 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T14:53:53.574 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:53 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T14:53:53.574 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:53 ntpd[17209]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-30T14:53:53.574 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:53 ntpd[17209]: can't open /var/log/ntpstats/peerstats.20240330: Permission denied 2024-03-30T14:53:53.574 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:53 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T14:53:53.574 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:53 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T14:53:53.574 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:53 ntpd[17209]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-30T14:53:53.574 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:53 ntpd[17209]: can't open /var/log/ntpstats/peerstats.20240330: Permission denied 2024-03-30T14:53:53.609 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:53 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T14:53:53.609 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:53 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T14:53:53.610 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:53 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T14:53:53.610 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:53 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T14:53:53.610 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:53 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T14:53:53.610 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:53 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T14:53:53.610 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:53 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T14:53:53.610 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:53 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T14:53:53.610 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:53 ntpd[17170]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-30T14:53:53.610 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:53 ntpd[17170]: can't open /var/log/ntpstats/peerstats.20240330: Permission denied 2024-03-30T14:53:53.610 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:53 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T14:53:53.610 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:53 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T14:53:53.610 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:53 ntpd[17170]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-30T14:53:53.610 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:53 ntpd[17170]: can't open /var/log/ntpstats/peerstats.20240330: Permission denied 2024-03-30T14:53:53.610 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:53 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T14:53:53.610 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:53 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T14:53:53.611 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:53 ntpd[17170]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-30T14:53:53.611 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:53 ntpd[17170]: can't open /var/log/ntpstats/peerstats.20240330: Permission denied 2024-03-30T14:53:54.573 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:54 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T14:53:54.573 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:54 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T14:53:54.573 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:54 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T14:53:54.573 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:54 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T14:53:54.574 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:54 ntpd[17209]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-30T14:53:54.574 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:54 ntpd[17209]: can't open /var/log/ntpstats/peerstats.20240330: Permission denied 2024-03-30T14:53:55.573 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:55 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T14:53:55.573 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:55 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T14:53:55.574 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:55 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T14:53:55.574 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:55 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T14:53:55.574 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:55 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T14:53:55.574 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:55 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T14:53:55.574 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:55 ntpd[17209]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-30T14:53:55.574 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:55 ntpd[17209]: can't open /var/log/ntpstats/peerstats.20240330: Permission denied 2024-03-30T14:53:55.574 INFO:teuthology.orchestra.run.smithi072.stdout:30 Mar 14:53:55 ntpd[17209]: ntpd: time slew -0.001331 s 2024-03-30T14:53:55.574 INFO:teuthology.orchestra.run.smithi072.stdout:ntpd: time slew -0.001331s 2024-03-30T14:53:55.575 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:55 ntpd[17209]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-03-30T14:53:55.575 INFO:teuthology.orchestra.run.smithi072.stderr:30 Mar 14:53:55 ntpd[17209]: can't open /var/log/ntpstats/loopstats.20240330: Permission denied 2024-03-30T14:53:55.609 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:55 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T14:53:55.609 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:55 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T14:53:55.609 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:55 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T14:53:55.609 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:55 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T14:53:55.610 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:55 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T14:53:55.610 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:55 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T14:53:55.610 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:55 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T14:53:55.610 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:55 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T14:53:55.610 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:55 ntpd[17170]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-30T14:53:55.610 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:55 ntpd[17170]: can't open /var/log/ntpstats/peerstats.20240330: Permission denied 2024-03-30T14:53:55.610 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:55 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T14:53:55.610 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:55 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T14:53:55.610 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:55 ntpd[17170]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-30T14:53:55.610 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:55 ntpd[17170]: can't open /var/log/ntpstats/peerstats.20240330: Permission denied 2024-03-30T14:53:55.610 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:55 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-30T14:53:55.610 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:55 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240330: Permission denied 2024-03-30T14:53:55.610 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:55 ntpd[17170]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-30T14:53:55.610 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:55 ntpd[17170]: can't open /var/log/ntpstats/peerstats.20240330: Permission denied 2024-03-30T14:53:55.611 INFO:teuthology.orchestra.run.smithi172.stdout:30 Mar 14:53:55 ntpd[17170]: ntpd: time slew -0.001489 s 2024-03-30T14:53:55.611 INFO:teuthology.orchestra.run.smithi172.stdout:ntpd: time slew -0.001489s 2024-03-30T14:53:55.611 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:55 ntpd[17170]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-03-30T14:53:55.611 INFO:teuthology.orchestra.run.smithi172.stderr:30 Mar 14:53:55 ntpd[17170]: can't open /var/log/ntpstats/loopstats.20240330: Permission denied 2024-03-30T14:53:55.626 INFO:teuthology.orchestra.run.smithi072.stdout: remote refid st t when poll reach delay offset jitter 2024-03-30T14:53:55.626 INFO:teuthology.orchestra.run.smithi072.stdout:============================================================================== 2024-03-30T14:53:55.626 INFO:teuthology.orchestra.run.smithi072.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-30T14:53:55.626 INFO:teuthology.orchestra.run.smithi072.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-30T14:53:55.626 INFO:teuthology.orchestra.run.smithi072.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-30T14:53:55.626 INFO:teuthology.orchestra.run.smithi072.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-30T14:53:55.659 INFO:teuthology.orchestra.run.smithi172.stdout: remote refid st t when poll reach delay offset jitter 2024-03-30T14:53:55.659 INFO:teuthology.orchestra.run.smithi172.stdout:============================================================================== 2024-03-30T14:53:55.659 INFO:teuthology.orchestra.run.smithi172.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-30T14:53:55.659 INFO:teuthology.orchestra.run.smithi172.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-30T14:53:55.659 INFO:teuthology.orchestra.run.smithi172.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-30T14:53:55.659 INFO:teuthology.orchestra.run.smithi172.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-30T14:53:55.659 INFO:teuthology.run_tasks:Running task install... 2024-03-30T14:53:55.668 DEBUG:teuthology.task.install:project ceph 2024-03-30T14:53:55.668 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '4e50bbcdd1630c7760b708f3a5b4d38a121e66cb'}, 'extra_packages': ['cephadm']} 2024-03-30T14:53:55.668 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '4e50bbcdd1630c7760b708f3a5b4d38a121e66cb'} 2024-03-30T14:53:55.668 INFO:teuthology.task.install:Using flavor: default 2024-03-30T14:53:55.673 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-30T14:53:55.674 INFO:teuthology.task.install:extra packages: [] 2024-03-30T14:53:55.674 DEBUG:teuthology.orchestra.run.smithi072:> sudo apt-key list | grep Ceph 2024-03-30T14:53:55.674 DEBUG:teuthology.orchestra.run.smithi172:> sudo apt-key list | grep Ceph 2024-03-30T14:53:55.732 INFO:teuthology.orchestra.run.smithi072.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-03-30T14:53:55.753 INFO:teuthology.orchestra.run.smithi172.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-03-30T14:53:55.760 INFO:teuthology.orchestra.run.smithi072.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-03-30T14:53:55.760 INFO:teuthology.orchestra.run.smithi072.stdout:uid [ unknown] Ceph.com (release key) 2024-03-30T14:53:55.761 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-03-30T14:53:55.761 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:53:55.779 INFO:teuthology.orchestra.run.smithi172.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-03-30T14:53:55.779 INFO:teuthology.orchestra.run.smithi172.stdout:uid [ unknown] Ceph.com (release key) 2024-03-30T14:53:55.781 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-03-30T14:53:55.781 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:53:55.928 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default/ 2024-03-30T14:53:55.928 INFO:teuthology.task.install.deb:Package version is 19.0.0-1967-g4e50bbcd-1jammy 2024-03-30T14:53:55.981 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default/ 2024-03-30T14:53:55.981 INFO:teuthology.task.install.deb:Package version is 19.0.0-1967-g4e50bbcd-1jammy 2024-03-30T14:53:56.052 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-03-30T14:53:56.052 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-03-30T14:53:56.066 DEBUG:teuthology.orchestra.run.smithi172:> sudo apt-get update 2024-03-30T14:53:56.089 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-30T14:53:56.089 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-03-30T14:53:56.103 DEBUG:teuthology.orchestra.run.smithi072:> sudo apt-get update 2024-03-30T14:53:56.236 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-30T14:53:56.236 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-03-30T14:53:56.247 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-03-30T14:53:56.267 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-03-30T14:53:56.278 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-03-30T14:53:56.284 INFO:teuthology.orchestra.run.smithi172.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy InRelease 2024-03-30T14:53:56.305 INFO:teuthology.orchestra.run.smithi172.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-03-30T14:53:56.325 INFO:teuthology.orchestra.run.smithi072.stdout:Ign:2 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy InRelease 2024-03-30T14:53:56.326 INFO:teuthology.orchestra.run.smithi172.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy Release.gpg 2024-03-30T14:53:56.347 INFO:teuthology.orchestra.run.smithi172.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-03-30T14:53:56.348 INFO:teuthology.orchestra.run.smithi072.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-03-30T14:53:56.369 INFO:teuthology.orchestra.run.smithi072.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy Release.gpg 2024-03-30T14:53:56.374 INFO:teuthology.orchestra.run.smithi172.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,412 B] 2024-03-30T14:53:56.390 INFO:teuthology.orchestra.run.smithi072.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-03-30T14:53:56.396 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-30T14:53:56.417 INFO:teuthology.orchestra.run.smithi072.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,412 B] 2024-03-30T14:53:56.475 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-03-30T14:53:56.556 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-03-30T14:53:56.604 INFO:teuthology.orchestra.run.smithi172.stdout:Fetched 28.9 kB in 0s (82.2 kB/s) 2024-03-30T14:53:56.696 INFO:teuthology.orchestra.run.smithi072.stdout:Fetched 28.9 kB in 0s (70.0 kB/s) 2024-03-30T14:53:57.574 INFO:teuthology.orchestra.run.smithi172.stdout:Reading package lists... 2024-03-30T14:53:57.590 DEBUG:teuthology.orchestra.run.smithi172:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-1967-g4e50bbcd-1jammy cephadm=19.0.0-1967-g4e50bbcd-1jammy ceph-mds=19.0.0-1967-g4e50bbcd-1jammy ceph-mgr=19.0.0-1967-g4e50bbcd-1jammy ceph-common=19.0.0-1967-g4e50bbcd-1jammy ceph-fuse=19.0.0-1967-g4e50bbcd-1jammy ceph-test=19.0.0-1967-g4e50bbcd-1jammy ceph-volume=19.0.0-1967-g4e50bbcd-1jammy radosgw=19.0.0-1967-g4e50bbcd-1jammy python3-rados=19.0.0-1967-g4e50bbcd-1jammy python3-rgw=19.0.0-1967-g4e50bbcd-1jammy python3-cephfs=19.0.0-1967-g4e50bbcd-1jammy python3-rbd=19.0.0-1967-g4e50bbcd-1jammy libcephfs2=19.0.0-1967-g4e50bbcd-1jammy libcephfs-dev=19.0.0-1967-g4e50bbcd-1jammy librados2=19.0.0-1967-g4e50bbcd-1jammy librbd1=19.0.0-1967-g4e50bbcd-1jammy rbd-fuse=19.0.0-1967-g4e50bbcd-1jammy 2024-03-30T14:53:57.601 INFO:teuthology.orchestra.run.smithi072.stdout:Reading package lists... 2024-03-30T14:53:57.617 DEBUG:teuthology.orchestra.run.smithi072:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-1967-g4e50bbcd-1jammy cephadm=19.0.0-1967-g4e50bbcd-1jammy ceph-mds=19.0.0-1967-g4e50bbcd-1jammy ceph-mgr=19.0.0-1967-g4e50bbcd-1jammy ceph-common=19.0.0-1967-g4e50bbcd-1jammy ceph-fuse=19.0.0-1967-g4e50bbcd-1jammy ceph-test=19.0.0-1967-g4e50bbcd-1jammy ceph-volume=19.0.0-1967-g4e50bbcd-1jammy radosgw=19.0.0-1967-g4e50bbcd-1jammy python3-rados=19.0.0-1967-g4e50bbcd-1jammy python3-rgw=19.0.0-1967-g4e50bbcd-1jammy python3-cephfs=19.0.0-1967-g4e50bbcd-1jammy python3-rbd=19.0.0-1967-g4e50bbcd-1jammy libcephfs2=19.0.0-1967-g4e50bbcd-1jammy libcephfs-dev=19.0.0-1967-g4e50bbcd-1jammy librados2=19.0.0-1967-g4e50bbcd-1jammy librbd1=19.0.0-1967-g4e50bbcd-1jammy rbd-fuse=19.0.0-1967-g4e50bbcd-1jammy 2024-03-30T14:53:57.653 INFO:teuthology.orchestra.run.smithi172.stdout:Reading package lists... 2024-03-30T14:53:57.679 INFO:teuthology.orchestra.run.smithi072.stdout:Reading package lists... 2024-03-30T14:53:57.847 INFO:teuthology.orchestra.run.smithi172.stdout:Building dependency tree... 2024-03-30T14:53:57.847 INFO:teuthology.orchestra.run.smithi172.stdout:Reading state information... 2024-03-30T14:53:57.876 INFO:teuthology.orchestra.run.smithi072.stdout:Building dependency tree... 2024-03-30T14:53:57.877 INFO:teuthology.orchestra.run.smithi072.stdout:Reading state information... 2024-03-30T14:53:58.018 INFO:teuthology.orchestra.run.smithi172.stdout:The following packages were automatically installed and are no longer required: 2024-03-30T14:53:58.018 INFO:teuthology.orchestra.run.smithi172.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-30T14:53:58.019 INFO:teuthology.orchestra.run.smithi172.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-30T14:53:58.019 INFO:teuthology.orchestra.run.smithi172.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-30T14:53:58.019 INFO:teuthology.orchestra.run.smithi172.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-30T14:53:58.019 INFO:teuthology.orchestra.run.smithi172.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-30T14:53:58.019 INFO:teuthology.orchestra.run.smithi172.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-30T14:53:58.021 INFO:teuthology.orchestra.run.smithi172.stdout:The following additional packages will be installed: 2024-03-30T14:53:58.021 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-03-30T14:53:58.021 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-03-30T14:53:58.021 INFO:teuthology.orchestra.run.smithi172.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-03-30T14:53:58.021 INFO:teuthology.orchestra.run.smithi172.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-03-30T14:53:58.021 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-03-30T14:53:58.021 INFO:teuthology.orchestra.run.smithi172.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-03-30T14:53:58.021 INFO:teuthology.orchestra.run.smithi172.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-03-30T14:53:58.021 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-03-30T14:53:58.021 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-03-30T14:53:58.021 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-03-30T14:53:58.022 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-03-30T14:53:58.022 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-03-30T14:53:58.022 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-03-30T14:53:58.022 INFO:teuthology.orchestra.run.smithi172.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-03-30T14:53:58.022 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-03-30T14:53:58.022 INFO:teuthology.orchestra.run.smithi172.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-03-30T14:53:58.023 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-03-30T14:53:58.023 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-03-30T14:53:58.023 INFO:teuthology.orchestra.run.smithi172.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-03-30T14:53:58.023 INFO:teuthology.orchestra.run.smithi172.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-03-30T14:53:58.023 INFO:teuthology.orchestra.run.smithi172.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-03-30T14:53:58.023 INFO:teuthology.orchestra.run.smithi172.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-03-30T14:53:58.023 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-03-30T14:53:58.023 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet zip 2024-03-30T14:53:58.024 INFO:teuthology.orchestra.run.smithi172.stdout:Suggested packages: 2024-03-30T14:53:58.024 INFO:teuthology.orchestra.run.smithi172.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-03-30T14:53:58.024 INFO:teuthology.orchestra.run.smithi172.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-03-30T14:53:58.024 INFO:teuthology.orchestra.run.smithi172.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-03-30T14:53:58.024 INFO:teuthology.orchestra.run.smithi172.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-03-30T14:53:58.024 INFO:teuthology.orchestra.run.smithi172.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-03-30T14:53:58.024 INFO:teuthology.orchestra.run.smithi172.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-03-30T14:53:58.024 INFO:teuthology.orchestra.run.smithi172.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-03-30T14:53:58.024 INFO:teuthology.orchestra.run.smithi172.stdout:Recommended packages: 2024-03-30T14:53:58.024 INFO:teuthology.orchestra.run.smithi172.stdout: btrfs-tools 2024-03-30T14:53:58.069 INFO:teuthology.orchestra.run.smithi072.stdout:The following packages were automatically installed and are no longer required: 2024-03-30T14:53:58.069 INFO:teuthology.orchestra.run.smithi072.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-30T14:53:58.070 INFO:teuthology.orchestra.run.smithi072.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-30T14:53:58.070 INFO:teuthology.orchestra.run.smithi072.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-30T14:53:58.070 INFO:teuthology.orchestra.run.smithi072.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-30T14:53:58.070 INFO:teuthology.orchestra.run.smithi072.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-30T14:53:58.070 INFO:teuthology.orchestra.run.smithi072.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-30T14:53:58.072 INFO:teuthology.orchestra.run.smithi072.stdout:The following additional packages will be installed: 2024-03-30T14:53:58.072 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-03-30T14:53:58.072 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-03-30T14:53:58.072 INFO:teuthology.orchestra.run.smithi072.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-03-30T14:53:58.072 INFO:teuthology.orchestra.run.smithi072.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-03-30T14:53:58.072 INFO:teuthology.orchestra.run.smithi072.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-03-30T14:53:58.072 INFO:teuthology.orchestra.run.smithi072.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-03-30T14:53:58.072 INFO:teuthology.orchestra.run.smithi072.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-03-30T14:53:58.073 INFO:teuthology.orchestra.run.smithi072.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-03-30T14:53:58.073 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-03-30T14:53:58.073 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-03-30T14:53:58.073 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-03-30T14:53:58.073 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-03-30T14:53:58.073 INFO:teuthology.orchestra.run.smithi072.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-03-30T14:53:58.073 INFO:teuthology.orchestra.run.smithi072.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-03-30T14:53:58.073 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-03-30T14:53:58.073 INFO:teuthology.orchestra.run.smithi072.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-03-30T14:53:58.073 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-03-30T14:53:58.074 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-03-30T14:53:58.074 INFO:teuthology.orchestra.run.smithi072.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-03-30T14:53:58.074 INFO:teuthology.orchestra.run.smithi072.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-03-30T14:53:58.074 INFO:teuthology.orchestra.run.smithi072.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-03-30T14:53:58.074 INFO:teuthology.orchestra.run.smithi072.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-03-30T14:53:58.074 INFO:teuthology.orchestra.run.smithi072.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-03-30T14:53:58.074 INFO:teuthology.orchestra.run.smithi072.stdout: xmlstarlet zip 2024-03-30T14:53:58.074 INFO:teuthology.orchestra.run.smithi072.stdout:Suggested packages: 2024-03-30T14:53:58.075 INFO:teuthology.orchestra.run.smithi072.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-03-30T14:53:58.075 INFO:teuthology.orchestra.run.smithi072.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-03-30T14:53:58.075 INFO:teuthology.orchestra.run.smithi072.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-03-30T14:53:58.075 INFO:teuthology.orchestra.run.smithi072.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-03-30T14:53:58.075 INFO:teuthology.orchestra.run.smithi072.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-03-30T14:53:58.075 INFO:teuthology.orchestra.run.smithi072.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-03-30T14:53:58.076 INFO:teuthology.orchestra.run.smithi072.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-03-30T14:53:58.076 INFO:teuthology.orchestra.run.smithi072.stdout:Recommended packages: 2024-03-30T14:53:58.076 INFO:teuthology.orchestra.run.smithi072.stdout: btrfs-tools 2024-03-30T14:53:58.121 INFO:teuthology.orchestra.run.smithi172.stdout:The following NEW packages will be installed: 2024-03-30T14:53:58.121 INFO:teuthology.orchestra.run.smithi172.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-03-30T14:53:58.121 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-03-30T14:53:58.122 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-03-30T14:53:58.122 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-03-30T14:53:58.122 INFO:teuthology.orchestra.run.smithi172.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-03-30T14:53:58.122 INFO:teuthology.orchestra.run.smithi172.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-03-30T14:53:58.122 INFO:teuthology.orchestra.run.smithi172.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-03-30T14:53:58.122 INFO:teuthology.orchestra.run.smithi172.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-03-30T14:53:58.122 INFO:teuthology.orchestra.run.smithi172.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-03-30T14:53:58.122 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-03-30T14:53:58.122 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-03-30T14:53:58.122 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-03-30T14:53:58.122 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-03-30T14:53:58.122 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-03-30T14:53:58.123 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-03-30T14:53:58.123 INFO:teuthology.orchestra.run.smithi172.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-03-30T14:53:58.123 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-03-30T14:53:58.123 INFO:teuthology.orchestra.run.smithi172.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-03-30T14:53:58.123 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-03-30T14:53:58.123 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-03-30T14:53:58.123 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-03-30T14:53:58.123 INFO:teuthology.orchestra.run.smithi172.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-03-30T14:53:58.123 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-03-30T14:53:58.124 INFO:teuthology.orchestra.run.smithi172.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-03-30T14:53:58.124 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-03-30T14:53:58.124 INFO:teuthology.orchestra.run.smithi172.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-03-30T14:53:58.176 INFO:teuthology.orchestra.run.smithi072.stdout:The following NEW packages will be installed: 2024-03-30T14:53:58.177 INFO:teuthology.orchestra.run.smithi072.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-03-30T14:53:58.177 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-03-30T14:53:58.177 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-03-30T14:53:58.177 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-03-30T14:53:58.177 INFO:teuthology.orchestra.run.smithi072.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-03-30T14:53:58.177 INFO:teuthology.orchestra.run.smithi072.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-03-30T14:53:58.177 INFO:teuthology.orchestra.run.smithi072.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-03-30T14:53:58.177 INFO:teuthology.orchestra.run.smithi072.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-03-30T14:53:58.177 INFO:teuthology.orchestra.run.smithi072.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-03-30T14:53:58.177 INFO:teuthology.orchestra.run.smithi072.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-03-30T14:53:58.177 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-03-30T14:53:58.177 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-03-30T14:53:58.177 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-03-30T14:53:58.178 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-03-30T14:53:58.178 INFO:teuthology.orchestra.run.smithi072.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-03-30T14:53:58.178 INFO:teuthology.orchestra.run.smithi072.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-03-30T14:53:58.178 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-03-30T14:53:58.178 INFO:teuthology.orchestra.run.smithi072.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-03-30T14:53:58.178 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-03-30T14:53:58.178 INFO:teuthology.orchestra.run.smithi072.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-03-30T14:53:58.178 INFO:teuthology.orchestra.run.smithi072.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-03-30T14:53:58.178 INFO:teuthology.orchestra.run.smithi072.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-03-30T14:53:58.178 INFO:teuthology.orchestra.run.smithi072.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-03-30T14:53:58.178 INFO:teuthology.orchestra.run.smithi072.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-03-30T14:53:58.178 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-03-30T14:53:58.178 INFO:teuthology.orchestra.run.smithi072.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-03-30T14:53:58.182 INFO:teuthology.orchestra.run.smithi172.stdout:0 upgraded, 118 newly installed, 0 to remove and 298 not upgraded. 2024-03-30T14:53:58.183 INFO:teuthology.orchestra.run.smithi172.stdout:Need to get 178 MB of archives. 2024-03-30T14:53:58.183 INFO:teuthology.orchestra.run.smithi172.stdout:After this operation, 815 MB of additional disk space will be used. 2024-03-30T14:53:58.183 INFO:teuthology.orchestra.run.smithi172.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-03-30T14:53:58.243 INFO:teuthology.orchestra.run.smithi072.stdout:0 upgraded, 118 newly installed, 0 to remove and 298 not upgraded. 2024-03-30T14:53:58.243 INFO:teuthology.orchestra.run.smithi072.stdout:Need to get 178 MB of archives. 2024-03-30T14:53:58.243 INFO:teuthology.orchestra.run.smithi072.stdout:After this operation, 815 MB of additional disk space will be used. 2024-03-30T14:53:58.243 INFO:teuthology.orchestra.run.smithi072.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-03-30T14:53:58.283 INFO:teuthology.orchestra.run.smithi172.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-03-30T14:53:58.286 INFO:teuthology.orchestra.run.smithi172.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-03-30T14:53:58.305 INFO:teuthology.orchestra.run.smithi172.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-03-30T14:53:58.316 INFO:teuthology.orchestra.run.smithi072.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-1967-g4e50bbcd-1jammy [3,544 kB] 2024-03-30T14:53:58.334 INFO:teuthology.orchestra.run.smithi172.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-1967-g4e50bbcd-1jammy [3,544 kB] 2024-03-30T14:53:58.344 INFO:teuthology.orchestra.run.smithi072.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-03-30T14:53:58.347 INFO:teuthology.orchestra.run.smithi072.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-03-30T14:53:58.367 INFO:teuthology.orchestra.run.smithi072.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-03-30T14:53:58.368 INFO:teuthology.orchestra.run.smithi172.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-03-30T14:53:58.373 INFO:teuthology.orchestra.run.smithi172.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-03-30T14:53:58.385 INFO:teuthology.orchestra.run.smithi172.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-03-30T14:53:58.389 INFO:teuthology.orchestra.run.smithi172.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-03-30T14:53:58.390 INFO:teuthology.orchestra.run.smithi172.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-03-30T14:53:58.391 INFO:teuthology.orchestra.run.smithi172.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-03-30T14:53:58.399 INFO:teuthology.orchestra.run.smithi172.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-03-30T14:53:58.401 INFO:teuthology.orchestra.run.smithi172.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-03-30T14:53:58.403 INFO:teuthology.orchestra.run.smithi172.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-03-30T14:53:58.405 INFO:teuthology.orchestra.run.smithi172.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-03-30T14:53:58.413 INFO:teuthology.orchestra.run.smithi172.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-03-30T14:53:58.415 INFO:teuthology.orchestra.run.smithi172.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-03-30T14:53:58.417 INFO:teuthology.orchestra.run.smithi172.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-03-30T14:53:58.419 INFO:teuthology.orchestra.run.smithi172.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-03-30T14:53:58.433 INFO:teuthology.orchestra.run.smithi172.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-03-30T14:53:58.433 INFO:teuthology.orchestra.run.smithi172.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-03-30T14:53:58.434 INFO:teuthology.orchestra.run.smithi172.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-03-30T14:53:58.434 INFO:teuthology.orchestra.run.smithi172.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-03-30T14:53:58.435 INFO:teuthology.orchestra.run.smithi172.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-03-30T14:53:58.435 INFO:teuthology.orchestra.run.smithi172.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-03-30T14:53:58.440 INFO:teuthology.orchestra.run.smithi072.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-03-30T14:53:58.445 INFO:teuthology.orchestra.run.smithi072.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-03-30T14:53:58.453 INFO:teuthology.orchestra.run.smithi172.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-03-30T14:53:58.453 INFO:teuthology.orchestra.run.smithi172.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-03-30T14:53:58.453 INFO:teuthology.orchestra.run.smithi172.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-03-30T14:53:58.456 INFO:teuthology.orchestra.run.smithi172.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-03-30T14:53:58.458 INFO:teuthology.orchestra.run.smithi072.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-03-30T14:53:58.462 INFO:teuthology.orchestra.run.smithi072.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-03-30T14:53:58.463 INFO:teuthology.orchestra.run.smithi072.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-03-30T14:53:58.463 INFO:teuthology.orchestra.run.smithi072.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-03-30T14:53:58.472 INFO:teuthology.orchestra.run.smithi072.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-03-30T14:53:58.472 INFO:teuthology.orchestra.run.smithi172.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-03-30T14:53:58.473 INFO:teuthology.orchestra.run.smithi172.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-03-30T14:53:58.473 INFO:teuthology.orchestra.run.smithi172.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-03-30T14:53:58.474 INFO:teuthology.orchestra.run.smithi072.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-03-30T14:53:58.475 INFO:teuthology.orchestra.run.smithi172.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-03-30T14:53:58.475 INFO:teuthology.orchestra.run.smithi172.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-03-30T14:53:58.475 INFO:teuthology.orchestra.run.smithi172.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-03-30T14:53:58.476 INFO:teuthology.orchestra.run.smithi072.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-03-30T14:53:58.477 INFO:teuthology.orchestra.run.smithi072.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-03-30T14:53:58.484 INFO:teuthology.orchestra.run.smithi072.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-03-30T14:53:58.487 INFO:teuthology.orchestra.run.smithi072.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-03-30T14:53:58.489 INFO:teuthology.orchestra.run.smithi072.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-03-30T14:53:58.492 INFO:teuthology.orchestra.run.smithi172.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-03-30T14:53:58.492 INFO:teuthology.orchestra.run.smithi172.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-03-30T14:53:58.493 INFO:teuthology.orchestra.run.smithi172.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-03-30T14:53:58.498 INFO:teuthology.orchestra.run.smithi172.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-03-30T14:53:58.504 INFO:teuthology.orchestra.run.smithi072.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-03-30T14:53:58.505 INFO:teuthology.orchestra.run.smithi072.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-03-30T14:53:58.505 INFO:teuthology.orchestra.run.smithi072.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-03-30T14:53:58.506 INFO:teuthology.orchestra.run.smithi072.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-03-30T14:53:58.506 INFO:teuthology.orchestra.run.smithi072.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-03-30T14:53:58.507 INFO:teuthology.orchestra.run.smithi072.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-03-30T14:53:58.507 INFO:teuthology.orchestra.run.smithi072.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-03-30T14:53:58.511 INFO:teuthology.orchestra.run.smithi172.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-03-30T14:53:58.512 INFO:teuthology.orchestra.run.smithi172.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-03-30T14:53:58.512 INFO:teuthology.orchestra.run.smithi172.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-03-30T14:53:58.513 INFO:teuthology.orchestra.run.smithi172.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-03-30T14:53:58.515 INFO:teuthology.orchestra.run.smithi172.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-03-30T14:53:58.516 INFO:teuthology.orchestra.run.smithi172.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-03-30T14:53:58.523 INFO:teuthology.orchestra.run.smithi072.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-03-30T14:53:58.524 INFO:teuthology.orchestra.run.smithi072.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-03-30T14:53:58.524 INFO:teuthology.orchestra.run.smithi072.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-03-30T14:53:58.531 INFO:teuthology.orchestra.run.smithi172.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-03-30T14:53:58.531 INFO:teuthology.orchestra.run.smithi172.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-03-30T14:53:58.534 INFO:teuthology.orchestra.run.smithi172.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-03-30T14:53:58.534 INFO:teuthology.orchestra.run.smithi172.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-03-30T14:53:58.543 INFO:teuthology.orchestra.run.smithi072.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-03-30T14:53:58.544 INFO:teuthology.orchestra.run.smithi072.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-03-30T14:53:58.544 INFO:teuthology.orchestra.run.smithi072.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-03-30T14:53:58.545 INFO:teuthology.orchestra.run.smithi072.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-03-30T14:53:58.546 INFO:teuthology.orchestra.run.smithi072.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-03-30T14:53:58.546 INFO:teuthology.orchestra.run.smithi072.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-03-30T14:53:58.546 INFO:teuthology.orchestra.run.smithi072.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-03-30T14:53:58.550 INFO:teuthology.orchestra.run.smithi172.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-03-30T14:53:58.552 INFO:teuthology.orchestra.run.smithi172.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-03-30T14:53:58.574 INFO:teuthology.orchestra.run.smithi072.stdout:Get:36 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-1967-g4e50bbcd-1jammy [3,217 kB] 2024-03-30T14:53:58.577 INFO:teuthology.orchestra.run.smithi072.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-03-30T14:53:58.579 INFO:teuthology.orchestra.run.smithi072.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-03-30T14:53:58.580 INFO:teuthology.orchestra.run.smithi072.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-03-30T14:53:58.607 INFO:teuthology.orchestra.run.smithi172.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-03-30T14:53:58.607 INFO:teuthology.orchestra.run.smithi172.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-03-30T14:53:58.609 INFO:teuthology.orchestra.run.smithi172.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-03-30T14:53:58.609 INFO:teuthology.orchestra.run.smithi172.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-03-30T14:53:58.610 INFO:teuthology.orchestra.run.smithi172.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-03-30T14:53:58.611 INFO:teuthology.orchestra.run.smithi072.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-03-30T14:53:58.611 INFO:teuthology.orchestra.run.smithi072.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-03-30T14:53:58.612 INFO:teuthology.orchestra.run.smithi072.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-03-30T14:53:58.613 INFO:teuthology.orchestra.run.smithi072.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-03-30T14:53:58.615 INFO:teuthology.orchestra.run.smithi072.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-03-30T14:53:58.618 INFO:teuthology.orchestra.run.smithi072.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-03-30T14:53:58.619 INFO:teuthology.orchestra.run.smithi072.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-03-30T14:53:58.632 INFO:teuthology.orchestra.run.smithi172.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-03-30T14:53:58.634 INFO:teuthology.orchestra.run.smithi172.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-03-30T14:53:58.634 INFO:teuthology.orchestra.run.smithi172.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-03-30T14:53:58.642 INFO:teuthology.orchestra.run.smithi072.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-03-30T14:53:58.644 INFO:teuthology.orchestra.run.smithi072.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-03-30T14:53:58.647 INFO:teuthology.orchestra.run.smithi072.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-03-30T14:53:58.653 INFO:teuthology.orchestra.run.smithi172.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-03-30T14:53:58.654 INFO:teuthology.orchestra.run.smithi172.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-03-30T14:53:58.654 INFO:teuthology.orchestra.run.smithi172.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-03-30T14:53:58.654 INFO:teuthology.orchestra.run.smithi172.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-03-30T14:53:58.655 INFO:teuthology.orchestra.run.smithi172.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-03-30T14:53:58.655 INFO:teuthology.orchestra.run.smithi172.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-03-30T14:53:58.662 INFO:teuthology.orchestra.run.smithi072.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-03-30T14:53:58.663 INFO:teuthology.orchestra.run.smithi072.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-03-30T14:53:58.667 INFO:teuthology.orchestra.run.smithi072.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-03-30T14:53:58.668 INFO:teuthology.orchestra.run.smithi172.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-03-30T14:53:58.668 INFO:teuthology.orchestra.run.smithi172.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-03-30T14:53:58.674 INFO:teuthology.orchestra.run.smithi172.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-03-30T14:53:58.698 INFO:teuthology.orchestra.run.smithi172.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-03-30T14:53:58.699 INFO:teuthology.orchestra.run.smithi172.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-03-30T14:53:58.700 INFO:teuthology.orchestra.run.smithi172.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-03-30T14:53:58.703 INFO:teuthology.orchestra.run.smithi172.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-03-30T14:53:58.706 INFO:teuthology.orchestra.run.smithi172.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-03-30T14:53:58.707 INFO:teuthology.orchestra.run.smithi172.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-03-30T14:53:58.707 INFO:teuthology.orchestra.run.smithi172.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-03-30T14:53:58.727 INFO:teuthology.orchestra.run.smithi072.stdout:Get:53 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-1967-g4e50bbcd-1jammy [711 kB] 2024-03-30T14:53:58.731 INFO:teuthology.orchestra.run.smithi172.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-03-30T14:53:58.732 INFO:teuthology.orchestra.run.smithi172.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-03-30T14:53:58.734 INFO:teuthology.orchestra.run.smithi172.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-03-30T14:53:58.740 INFO:teuthology.orchestra.run.smithi072.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-03-30T14:53:58.742 INFO:teuthology.orchestra.run.smithi072.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-03-30T14:53:58.743 INFO:teuthology.orchestra.run.smithi072.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-03-30T14:53:58.744 INFO:teuthology.orchestra.run.smithi072.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-03-30T14:53:58.745 INFO:teuthology.orchestra.run.smithi072.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-03-30T14:53:58.750 INFO:teuthology.orchestra.run.smithi072.stdout:Get:59 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-1967-g4e50bbcd-1jammy [356 kB] 2024-03-30T14:53:58.756 INFO:teuthology.orchestra.run.smithi172.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-03-30T14:53:58.757 INFO:teuthology.orchestra.run.smithi172.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-03-30T14:53:58.757 INFO:teuthology.orchestra.run.smithi172.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-03-30T14:53:58.759 INFO:teuthology.orchestra.run.smithi172.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-03-30T14:53:58.759 INFO:teuthology.orchestra.run.smithi172.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-03-30T14:53:58.761 INFO:teuthology.orchestra.run.smithi072.stdout:Get:60 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-1967-g4e50bbcd-1jammy [32.8 kB] 2024-03-30T14:53:58.762 INFO:teuthology.orchestra.run.smithi072.stdout:Get:61 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-1967-g4e50bbcd-1jammy [180 kB] 2024-03-30T14:53:58.766 INFO:teuthology.orchestra.run.smithi172.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-03-30T14:53:58.766 INFO:teuthology.orchestra.run.smithi172.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-03-30T14:53:58.783 INFO:teuthology.orchestra.run.smithi172.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-03-30T14:53:58.785 INFO:teuthology.orchestra.run.smithi172.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-03-30T14:53:58.785 INFO:teuthology.orchestra.run.smithi172.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-03-30T14:53:58.792 INFO:teuthology.orchestra.run.smithi072.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-03-30T14:53:58.792 INFO:teuthology.orchestra.run.smithi072.stdout:Get:63 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-1967-g4e50bbcd-1jammy [64.6 kB] 2024-03-30T14:53:58.794 INFO:teuthology.orchestra.run.smithi072.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-03-30T14:53:58.794 INFO:teuthology.orchestra.run.smithi072.stdout:Get:65 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-1967-g4e50bbcd-1jammy [330 kB] 2024-03-30T14:53:58.794 INFO:teuthology.orchestra.run.smithi072.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-03-30T14:53:58.800 INFO:teuthology.orchestra.run.smithi072.stdout:Get:67 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-1967-g4e50bbcd-1jammy [6,577 kB] 2024-03-30T14:53:58.805 INFO:teuthology.orchestra.run.smithi172.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-1967-g4e50bbcd-1jammy [3,217 kB] 2024-03-30T14:53:58.809 INFO:teuthology.orchestra.run.smithi072.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-03-30T14:53:58.809 INFO:teuthology.orchestra.run.smithi072.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-03-30T14:53:58.809 INFO:teuthology.orchestra.run.smithi072.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-03-30T14:53:58.810 INFO:teuthology.orchestra.run.smithi072.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-03-30T14:53:58.810 INFO:teuthology.orchestra.run.smithi072.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-03-30T14:53:58.811 INFO:teuthology.orchestra.run.smithi072.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-03-30T14:53:58.822 INFO:teuthology.orchestra.run.smithi072.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-03-30T14:53:58.822 INFO:teuthology.orchestra.run.smithi072.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-03-30T14:53:58.826 INFO:teuthology.orchestra.run.smithi072.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-03-30T14:53:58.841 INFO:teuthology.orchestra.run.smithi072.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-03-30T14:53:58.843 INFO:teuthology.orchestra.run.smithi072.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-03-30T14:53:58.844 INFO:teuthology.orchestra.run.smithi072.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-03-30T14:53:58.847 INFO:teuthology.orchestra.run.smithi072.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-03-30T14:53:58.850 INFO:teuthology.orchestra.run.smithi072.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-03-30T14:53:58.851 INFO:teuthology.orchestra.run.smithi072.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-03-30T14:53:58.851 INFO:teuthology.orchestra.run.smithi072.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-03-30T14:53:58.861 INFO:teuthology.orchestra.run.smithi072.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-03-30T14:53:58.862 INFO:teuthology.orchestra.run.smithi072.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-03-30T14:53:58.865 INFO:teuthology.orchestra.run.smithi072.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-03-30T14:53:58.881 INFO:teuthology.orchestra.run.smithi072.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-03-30T14:53:58.882 INFO:teuthology.orchestra.run.smithi072.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-03-30T14:53:58.882 INFO:teuthology.orchestra.run.smithi072.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-03-30T14:53:58.883 INFO:teuthology.orchestra.run.smithi072.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-03-30T14:53:58.884 INFO:teuthology.orchestra.run.smithi072.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-03-30T14:53:58.891 INFO:teuthology.orchestra.run.smithi072.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-03-30T14:53:58.891 INFO:teuthology.orchestra.run.smithi072.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-03-30T14:53:58.900 INFO:teuthology.orchestra.run.smithi072.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-03-30T14:53:58.903 INFO:teuthology.orchestra.run.smithi072.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-03-30T14:53:58.903 INFO:teuthology.orchestra.run.smithi072.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-03-30T14:53:59.055 INFO:teuthology.orchestra.run.smithi172.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-1967-g4e50bbcd-1jammy [711 kB] 2024-03-30T14:53:59.114 INFO:teuthology.orchestra.run.smithi172.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-1967-g4e50bbcd-1jammy [356 kB] 2024-03-30T14:53:59.141 INFO:teuthology.orchestra.run.smithi072.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-1967-g4e50bbcd-1jammy [112 kB] 2024-03-30T14:53:59.145 INFO:teuthology.orchestra.run.smithi072.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-1967-g4e50bbcd-1jammy [466 kB] 2024-03-30T14:53:59.152 INFO:teuthology.orchestra.run.smithi172.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-1967-g4e50bbcd-1jammy [32.8 kB] 2024-03-30T14:53:59.154 INFO:teuthology.orchestra.run.smithi172.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-1967-g4e50bbcd-1jammy [180 kB] 2024-03-30T14:53:59.167 INFO:teuthology.orchestra.run.smithi172.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-1967-g4e50bbcd-1jammy [64.6 kB] 2024-03-30T14:53:59.170 INFO:teuthology.orchestra.run.smithi172.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-1967-g4e50bbcd-1jammy [330 kB] 2024-03-30T14:53:59.174 INFO:teuthology.orchestra.run.smithi072.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-1967-g4e50bbcd-1jammy [25.2 MB] 2024-03-30T14:53:59.198 INFO:teuthology.orchestra.run.smithi172.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-1967-g4e50bbcd-1jammy [6,577 kB] 2024-03-30T14:53:59.751 INFO:teuthology.orchestra.run.smithi172.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-1967-g4e50bbcd-1jammy [112 kB] 2024-03-30T14:53:59.760 INFO:teuthology.orchestra.run.smithi172.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-1967-g4e50bbcd-1jammy [466 kB] 2024-03-30T14:53:59.798 INFO:teuthology.orchestra.run.smithi172.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-1967-g4e50bbcd-1jammy [25.2 MB] 2024-03-30T14:54:00.622 INFO:teuthology.orchestra.run.smithi072.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-1967-g4e50bbcd-1jammy [5,077 kB] 2024-03-30T14:54:00.796 INFO:teuthology.orchestra.run.smithi072.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-1967-g4e50bbcd-1jammy [244 kB] 2024-03-30T14:54:00.809 INFO:teuthology.orchestra.run.smithi072.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-1967-g4e50bbcd-1jammy [124 kB] 2024-03-30T14:54:00.817 INFO:teuthology.orchestra.run.smithi072.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-1967-g4e50bbcd-1jammy [1,526 kB] 2024-03-30T14:54:00.898 INFO:teuthology.orchestra.run.smithi072.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-1967-g4e50bbcd-1jammy [6,247 kB] 2024-03-30T14:54:01.230 INFO:teuthology.orchestra.run.smithi072.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-1967-g4e50bbcd-1jammy [22.7 MB] 2024-03-30T14:54:02.014 INFO:teuthology.orchestra.run.smithi172.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-1967-g4e50bbcd-1jammy [5,077 kB] 2024-03-30T14:54:02.346 INFO:teuthology.orchestra.run.smithi172.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-1967-g4e50bbcd-1jammy [244 kB] 2024-03-30T14:54:02.364 INFO:teuthology.orchestra.run.smithi172.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-1967-g4e50bbcd-1jammy [124 kB] 2024-03-30T14:54:02.371 INFO:teuthology.orchestra.run.smithi172.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-1967-g4e50bbcd-1jammy [1,526 kB] 2024-03-30T14:54:02.479 INFO:teuthology.orchestra.run.smithi172.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-1967-g4e50bbcd-1jammy [6,247 kB] 2024-03-30T14:54:02.571 INFO:teuthology.orchestra.run.smithi072.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-1967-g4e50bbcd-1jammy [14.0 kB] 2024-03-30T14:54:02.572 INFO:teuthology.orchestra.run.smithi072.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-1967-g4e50bbcd-1jammy [869 kB] 2024-03-30T14:54:02.588 INFO:teuthology.orchestra.run.smithi072.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-1967-g4e50bbcd-1jammy [2,434 kB] 2024-03-30T14:54:02.698 INFO:teuthology.orchestra.run.smithi072.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-1967-g4e50bbcd-1jammy [777 kB] 2024-03-30T14:54:02.744 INFO:teuthology.orchestra.run.smithi072.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-1967-g4e50bbcd-1jammy [145 kB] 2024-03-30T14:54:02.753 INFO:teuthology.orchestra.run.smithi072.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-1967-g4e50bbcd-1jammy [2,229 kB] 2024-03-30T14:54:02.892 INFO:teuthology.orchestra.run.smithi072.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-1967-g4e50bbcd-1jammy [8,625 kB] 2024-03-30T14:54:02.902 INFO:teuthology.orchestra.run.smithi172.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-1967-g4e50bbcd-1jammy [22.7 MB] 2024-03-30T14:54:03.423 INFO:teuthology.orchestra.run.smithi072.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-1967-g4e50bbcd-1jammy [14.2 kB] 2024-03-30T14:54:03.423 INFO:teuthology.orchestra.run.smithi072.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-1967-g4e50bbcd-1jammy [50.0 MB] 2024-03-30T14:54:04.607 INFO:teuthology.orchestra.run.smithi172.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-1967-g4e50bbcd-1jammy [14.0 kB] 2024-03-30T14:54:04.608 INFO:teuthology.orchestra.run.smithi172.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-1967-g4e50bbcd-1jammy [869 kB] 2024-03-30T14:54:04.625 INFO:teuthology.orchestra.run.smithi172.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-1967-g4e50bbcd-1jammy [2,434 kB] 2024-03-30T14:54:04.756 INFO:teuthology.orchestra.run.smithi172.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-1967-g4e50bbcd-1jammy [777 kB] 2024-03-30T14:54:04.807 INFO:teuthology.orchestra.run.smithi172.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-1967-g4e50bbcd-1jammy [145 kB] 2024-03-30T14:54:04.819 INFO:teuthology.orchestra.run.smithi172.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-1967-g4e50bbcd-1jammy [2,229 kB] 2024-03-30T14:54:04.979 INFO:teuthology.orchestra.run.smithi172.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-1967-g4e50bbcd-1jammy [8,625 kB] 2024-03-30T14:54:05.596 INFO:teuthology.orchestra.run.smithi172.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-1967-g4e50bbcd-1jammy [14.2 kB] 2024-03-30T14:54:05.596 INFO:teuthology.orchestra.run.smithi172.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-1967-g4e50bbcd-1jammy [50.0 MB] 2024-03-30T14:54:06.931 INFO:teuthology.orchestra.run.smithi072.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-1967-g4e50bbcd-1jammy [121 kB] 2024-03-30T14:54:06.933 INFO:teuthology.orchestra.run.smithi072.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-1967-g4e50bbcd-1jammy [38.9 kB] 2024-03-30T14:54:06.934 INFO:teuthology.orchestra.run.smithi072.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-1967-g4e50bbcd-1jammy [13.0 MB] 2024-03-30T14:54:07.495 INFO:teuthology.orchestra.run.smithi072.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-1967-g4e50bbcd-1jammy [91.5 kB] 2024-03-30T14:54:08.054 INFO:teuthology.orchestra.run.smithi072.stdout:Fetched 178 MB in 9s (19.1 MB/s) 2024-03-30T14:54:08.186 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-03-30T14:54:08.244 INFO:teuthology.orchestra.run.smithi072.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165997 files and directories currently installed.) 2024-03-30T14:54:08.249 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-03-30T14:54:08.320 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-03-30T14:54:08.395 INFO:teuthology.orchestra.run.smithi172.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-1967-g4e50bbcd-1jammy [121 kB] 2024-03-30T14:54:08.397 INFO:teuthology.orchestra.run.smithi172.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-1967-g4e50bbcd-1jammy [38.9 kB] 2024-03-30T14:54:08.398 INFO:teuthology.orchestra.run.smithi172.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-1967-g4e50bbcd-1jammy [13.0 MB] 2024-03-30T14:54:08.661 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-03-30T14:54:08.687 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-03-30T14:54:08.728 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-03-30T14:54:08.732 INFO:teuthology.orchestra.run.smithi172.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/squid/4e50bbcdd1630c7760b708f3a5b4d38a121e66cb/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-1967-g4e50bbcd-1jammy [91.5 kB] 2024-03-30T14:54:09.041 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-03-30T14:54:09.067 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-03-30T14:54:09.108 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-03-30T14:54:09.284 INFO:teuthology.orchestra.run.smithi172.stdout:Fetched 178 MB in 11s (16.8 MB/s) 2024-03-30T14:54:09.429 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-03-30T14:54:09.528 INFO:teuthology.orchestra.run.smithi172.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165997 files and directories currently installed.) 2024-03-30T14:54:09.534 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-03-30T14:54:09.557 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-03-30T14:54:09.584 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-30T14:54:09.603 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-03-30T14:54:09.641 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-30T14:54:09.973 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-03-30T14:54:09.999 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-03-30T14:54:10.040 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-03-30T14:54:10.082 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-03-30T14:54:10.108 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-30T14:54:10.148 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-30T14:54:10.487 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-03-30T14:54:10.513 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-30T14:54:10.555 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-30T14:54:10.584 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-03-30T14:54:10.610 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-03-30T14:54:10.651 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-03-30T14:54:10.878 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-03-30T14:54:10.904 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-03-30T14:54:10.978 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-03-30T14:54:11.088 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-03-30T14:54:11.114 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-30T14:54:11.163 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-30T14:54:11.310 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package librados2. 2024-03-30T14:54:11.336 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../007-librados2_19.0.0-1967-g4e50bbcd-1jammy_amd64.deb ... 2024-03-30T14:54:11.376 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking librados2 (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:11.583 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-03-30T14:54:11.609 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-30T14:54:11.649 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-30T14:54:12.019 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-03-30T14:54:12.045 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-30T14:54:12.085 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-30T14:54:12.190 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package librbd1. 2024-03-30T14:54:12.216 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../008-librbd1_19.0.0-1967-g4e50bbcd-1jammy_amd64.deb ... 2024-03-30T14:54:12.258 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking librbd1 (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:12.430 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-03-30T14:54:12.456 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-03-30T14:54:12.497 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-03-30T14:54:12.722 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libcephfs2. 2024-03-30T14:54:12.748 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-1967-g4e50bbcd-1jammy_amd64.deb ... 2024-03-30T14:54:12.789 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libcephfs2 (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:12.833 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package librados2. 2024-03-30T14:54:12.860 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../007-librados2_19.0.0-1967-g4e50bbcd-1jammy_amd64.deb ... 2024-03-30T14:54:12.900 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking librados2 (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:13.078 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-rados. 2024-03-30T14:54:13.093 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../010-python3-rados_19.0.0-1967-g4e50bbcd-1jammy_amd64.deb ... 2024-03-30T14:54:13.136 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-rados (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:13.312 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package librbd1. 2024-03-30T14:54:13.340 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../008-librbd1_19.0.0-1967-g4e50bbcd-1jammy_amd64.deb ... 2024-03-30T14:54:13.378 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking librbd1 (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:13.458 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-03-30T14:54:13.484 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-1967-g4e50bbcd-1jammy_all.deb ... 2024-03-30T14:54:13.525 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-ceph-argparse (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:13.772 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-cephfs. 2024-03-30T14:54:13.787 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-1967-g4e50bbcd-1jammy_amd64.deb ... 2024-03-30T14:54:13.797 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libcephfs2. 2024-03-30T14:54:13.824 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-1967-g4e50bbcd-1jammy_amd64.deb ... 2024-03-30T14:54:13.831 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-cephfs (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:13.863 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libcephfs2 (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:14.102 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-ceph-common. 2024-03-30T14:54:14.116 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-rados. 2024-03-30T14:54:14.128 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-1967-g4e50bbcd-1jammy_all.deb ... 2024-03-30T14:54:14.143 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../010-python3-rados_19.0.0-1967-g4e50bbcd-1jammy_amd64.deb ... 2024-03-30T14:54:14.169 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-ceph-common (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:14.183 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-rados (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:14.484 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-wcwidth. 2024-03-30T14:54:14.502 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-03-30T14:54:14.510 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-03-30T14:54:14.529 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-1967-g4e50bbcd-1jammy_all.deb ... 2024-03-30T14:54:14.551 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-03-30T14:54:14.569 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-ceph-argparse (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:14.804 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-cephfs. 2024-03-30T14:54:14.820 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-1967-g4e50bbcd-1jammy_amd64.deb ... 2024-03-30T14:54:14.824 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-prettytable. 2024-03-30T14:54:14.850 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-03-30T14:54:14.863 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-cephfs (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:14.891 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-03-30T14:54:15.137 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-rbd. 2024-03-30T14:54:15.149 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-ceph-common. 2024-03-30T14:54:15.163 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-1967-g4e50bbcd-1jammy_amd64.deb ... 2024-03-30T14:54:15.176 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-1967-g4e50bbcd-1jammy_all.deb ... 2024-03-30T14:54:15.204 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-rbd (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:15.207 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-ceph-common (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:15.486 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-wcwidth. 2024-03-30T14:54:15.512 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-03-30T14:54:15.553 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-03-30T14:54:15.579 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-03-30T14:54:15.619 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-03-30T14:54:15.738 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-03-30T14:54:15.890 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-03-30T14:54:15.917 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-03-30T14:54:15.957 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-03-30T14:54:16.239 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-prettytable. 2024-03-30T14:54:16.264 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-03-30T14:54:16.265 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-03-30T14:54:16.279 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-03-30T14:54:16.305 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-03-30T14:54:16.322 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-03-30T14:54:16.566 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-rbd. 2024-03-30T14:54:16.593 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-1967-g4e50bbcd-1jammy_amd64.deb ... 2024-03-30T14:54:16.630 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package lua5.1. 2024-03-30T14:54:16.633 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-rbd (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:16.656 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-03-30T14:54:16.696 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-03-30T14:54:16.961 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-03-30T14:54:16.987 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-03-30T14:54:17.018 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package lua-any. 2024-03-30T14:54:17.019 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-03-30T14:54:17.045 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-03-30T14:54:17.112 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking lua-any (27ubuntu1) ... 2024-03-30T14:54:17.280 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-03-30T14:54:17.295 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-03-30T14:54:17.338 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-03-30T14:54:17.367 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package zip. 2024-03-30T14:54:17.382 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-03-30T14:54:17.425 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking zip (3.0-12build2) ... 2024-03-30T14:54:17.641 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-03-30T14:54:17.667 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-03-30T14:54:17.708 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-03-30T14:54:17.741 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package unzip. 2024-03-30T14:54:17.767 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-03-30T14:54:17.808 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-03-30T14:54:18.061 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package lua5.1. 2024-03-30T14:54:18.089 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-03-30T14:54:18.128 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-03-30T14:54:18.241 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package luarocks. 2024-03-30T14:54:18.267 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-03-30T14:54:18.308 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-03-30T14:54:18.448 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package lua-any. 2024-03-30T14:54:18.474 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-03-30T14:54:18.514 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking lua-any (27ubuntu1) ... 2024-03-30T14:54:18.657 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package librgw2. 2024-03-30T14:54:18.683 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../025-librgw2_19.0.0-1967-g4e50bbcd-1jammy_amd64.deb ... 2024-03-30T14:54:18.724 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking librgw2 (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:18.750 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package zip. 2024-03-30T14:54:18.765 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-03-30T14:54:18.800 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking zip (3.0-12build2) ... 2024-03-30T14:54:19.087 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package unzip. 2024-03-30T14:54:19.113 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-03-30T14:54:19.153 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-03-30T14:54:19.430 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-rgw. 2024-03-30T14:54:19.456 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-1967-g4e50bbcd-1jammy_amd64.deb ... 2024-03-30T14:54:19.496 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-rgw (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:19.582 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package luarocks. 2024-03-30T14:54:19.608 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-03-30T14:54:19.649 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-03-30T14:54:19.828 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package liboath0:amd64. 2024-03-30T14:54:19.854 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-03-30T14:54:19.895 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-03-30T14:54:20.048 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package librgw2. 2024-03-30T14:54:20.074 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../025-librgw2_19.0.0-1967-g4e50bbcd-1jammy_amd64.deb ... 2024-03-30T14:54:20.123 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking librgw2 (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:20.192 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libradosstriper1. 2024-03-30T14:54:20.207 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-1967-g4e50bbcd-1jammy_amd64.deb ... 2024-03-30T14:54:20.242 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libradosstriper1 (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:20.674 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-common. 2024-03-30T14:54:20.675 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-rgw. 2024-03-30T14:54:20.700 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../029-ceph-common_19.0.0-1967-g4e50bbcd-1jammy_amd64.deb ... 2024-03-30T14:54:20.702 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-1967-g4e50bbcd-1jammy_amd64.deb ... 2024-03-30T14:54:20.742 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-rgw (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:20.749 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-common (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:21.045 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package liboath0:amd64. 2024-03-30T14:54:21.071 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-03-30T14:54:21.103 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-03-30T14:54:21.406 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libradosstriper1. 2024-03-30T14:54:21.433 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-1967-g4e50bbcd-1jammy_amd64.deb ... 2024-03-30T14:54:21.472 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libradosstriper1 (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:21.901 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-common. 2024-03-30T14:54:21.927 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../029-ceph-common_19.0.0-1967-g4e50bbcd-1jammy_amd64.deb ... 2024-03-30T14:54:21.967 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-common (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:22.636 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-base. 2024-03-30T14:54:22.662 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../030-ceph-base_19.0.0-1967-g4e50bbcd-1jammy_amd64.deb ... 2024-03-30T14:54:22.712 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-base (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:23.206 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-base. 2024-03-30T14:54:23.232 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../030-ceph-base_19.0.0-1967-g4e50bbcd-1jammy_amd64.deb ... 2024-03-30T14:54:23.274 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-base (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:23.378 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-03-30T14:54:23.405 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-03-30T14:54:23.445 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-03-30T14:54:23.743 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-cheroot. 2024-03-30T14:54:23.770 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-03-30T14:54:23.810 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-03-30T14:54:23.871 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-03-30T14:54:23.897 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-03-30T14:54:23.937 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-03-30T14:54:24.107 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-03-30T14:54:24.133 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-03-30T14:54:24.174 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-03-30T14:54:24.240 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-cheroot. 2024-03-30T14:54:24.266 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-03-30T14:54:24.306 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-03-30T14:54:24.480 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-jaraco.text. 2024-03-30T14:54:24.507 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-03-30T14:54:24.547 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-03-30T14:54:24.627 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-03-30T14:54:24.653 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-03-30T14:54:24.693 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-03-30T14:54:24.896 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-03-30T14:54:24.922 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-03-30T14:54:24.929 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-jaraco.text. 2024-03-30T14:54:24.955 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-03-30T14:54:24.962 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-03-30T14:54:24.996 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-03-30T14:54:25.259 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-tempora. 2024-03-30T14:54:25.286 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-03-30T14:54:25.299 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-03-30T14:54:25.325 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-03-30T14:54:25.334 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-03-30T14:54:25.365 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-03-30T14:54:25.641 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-portend. 2024-03-30T14:54:25.667 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-03-30T14:54:25.677 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-tempora. 2024-03-30T14:54:25.703 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-03-30T14:54:25.707 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-03-30T14:54:25.743 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-03-30T14:54:25.996 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-03-30T14:54:26.022 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-03-30T14:54:26.064 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-03-30T14:54:26.184 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-portend. 2024-03-30T14:54:26.210 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-03-30T14:54:26.279 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-03-30T14:54:26.370 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-cherrypy3. 2024-03-30T14:54:26.396 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-03-30T14:54:26.445 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-03-30T14:54:26.591 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-03-30T14:54:26.617 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-03-30T14:54:26.657 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-03-30T14:54:26.769 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-natsort. 2024-03-30T14:54:26.796 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-03-30T14:54:26.836 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-03-30T14:54:26.960 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-cherrypy3. 2024-03-30T14:54:26.987 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-03-30T14:54:27.027 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-03-30T14:54:27.151 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-logutils. 2024-03-30T14:54:27.178 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-03-30T14:54:27.218 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-03-30T14:54:27.339 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-natsort. 2024-03-30T14:54:27.365 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-03-30T14:54:27.405 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-03-30T14:54:27.506 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-markupsafe. 2024-03-30T14:54:27.533 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-03-30T14:54:27.589 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-03-30T14:54:27.742 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-logutils. 2024-03-30T14:54:27.768 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-03-30T14:54:27.809 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-03-30T14:54:27.880 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-mako. 2024-03-30T14:54:27.906 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-03-30T14:54:27.946 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-03-30T14:54:28.095 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-markupsafe. 2024-03-30T14:54:28.121 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-03-30T14:54:28.161 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-03-30T14:54:28.277 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-simplegeneric. 2024-03-30T14:54:28.303 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-03-30T14:54:28.345 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-03-30T14:54:28.406 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-mako. 2024-03-30T14:54:28.432 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-03-30T14:54:28.464 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-03-30T14:54:28.642 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-singledispatch. 2024-03-30T14:54:28.668 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-03-30T14:54:28.709 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-03-30T14:54:28.725 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-simplegeneric. 2024-03-30T14:54:28.740 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-03-30T14:54:28.792 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-03-30T14:54:29.007 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-webob. 2024-03-30T14:54:29.033 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-03-30T14:54:29.082 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-03-30T14:54:29.112 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-singledispatch. 2024-03-30T14:54:29.138 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-03-30T14:54:29.178 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-03-30T14:54:29.429 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-waitress. 2024-03-30T14:54:29.456 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-03-30T14:54:29.481 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-webob. 2024-03-30T14:54:29.499 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-03-30T14:54:29.507 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-03-30T14:54:29.547 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-03-30T14:54:29.811 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-tempita. 2024-03-30T14:54:29.838 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-03-30T14:54:29.886 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-03-30T14:54:29.917 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-waitress. 2024-03-30T14:54:29.943 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-03-30T14:54:29.996 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-03-30T14:54:30.184 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-paste. 2024-03-30T14:54:30.211 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-03-30T14:54:30.245 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-tempita. 2024-03-30T14:54:30.251 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-03-30T14:54:30.267 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-03-30T14:54:30.303 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-03-30T14:54:30.548 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-03-30T14:54:30.564 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-03-30T14:54:30.581 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-paste. 2024-03-30T14:54:30.607 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-03-30T14:54:30.607 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-03-30T14:54:30.648 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-03-30T14:54:30.897 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pastedeploy. 2024-03-30T14:54:30.924 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-03-30T14:54:30.959 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-03-30T14:54:30.963 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-03-30T14:54:30.975 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-03-30T14:54:31.009 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-03-30T14:54:31.262 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-webtest. 2024-03-30T14:54:31.289 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-03-30T14:54:31.320 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pastedeploy. 2024-03-30T14:54:31.337 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-03-30T14:54:31.347 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-03-30T14:54:31.387 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-03-30T14:54:32.207 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-webtest. 2024-03-30T14:54:32.234 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-03-30T14:54:32.424 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-03-30T14:54:32.727 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pecan. 2024-03-30T14:54:32.753 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-03-30T14:54:32.793 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-03-30T14:54:33.085 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pecan. 2024-03-30T14:54:33.112 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-03-30T14:54:33.152 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-03-30T14:54:33.165 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-certifi. 2024-03-30T14:54:33.192 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-03-30T14:54:33.231 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-03-30T14:54:33.504 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-certifi. 2024-03-30T14:54:33.531 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-03-30T14:54:33.551 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-idna. 2024-03-30T14:54:33.570 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-03-30T14:54:33.578 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-03-30T14:54:33.617 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-idna (3.3-1) ... 2024-03-30T14:54:33.869 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-idna. 2024-03-30T14:54:33.879 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-urllib3. 2024-03-30T14:54:33.896 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-03-30T14:54:33.906 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-03-30T14:54:33.935 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-idna (3.3-1) ... 2024-03-30T14:54:33.937 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-03-30T14:54:34.207 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-requests. 2024-03-30T14:54:34.223 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-03-30T14:54:34.242 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-urllib3. 2024-03-30T14:54:34.257 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-03-30T14:54:34.258 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-03-30T14:54:34.292 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-03-30T14:54:34.552 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-werkzeug. 2024-03-30T14:54:34.579 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-03-30T14:54:34.606 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-requests. 2024-03-30T14:54:34.618 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-03-30T14:54:34.633 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-03-30T14:54:34.673 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-03-30T14:54:34.905 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-03-30T14:54:34.931 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-1967-g4e50bbcd-1jammy_all.deb ... 2024-03-30T14:54:34.963 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mgr-modules-core (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:34.971 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-werkzeug. 2024-03-30T14:54:34.998 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-03-30T14:54:35.038 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-03-30T14:54:35.328 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-03-30T14:54:35.344 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-1967-g4e50bbcd-1jammy_all.deb ... 2024-03-30T14:54:35.351 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-03-30T14:54:35.378 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-1967-g4e50bbcd-1jammy_amd64.deb ... 2024-03-30T14:54:35.387 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mgr-modules-core (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:35.426 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:35.695 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-bcrypt. 2024-03-30T14:54:35.722 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-03-30T14:54:35.747 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-03-30T14:54:35.762 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-03-30T14:54:35.773 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-1967-g4e50bbcd-1jammy_amd64.deb ... 2024-03-30T14:54:35.822 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:36.040 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-openssl. 2024-03-30T14:54:36.066 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-03-30T14:54:36.106 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-03-30T14:54:36.118 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-bcrypt. 2024-03-30T14:54:36.145 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-03-30T14:54:36.185 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-03-30T14:54:36.451 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mgr. 2024-03-30T14:54:36.478 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-1967-g4e50bbcd-1jammy_amd64.deb ... 2024-03-30T14:54:36.483 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-openssl. 2024-03-30T14:54:36.510 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-03-30T14:54:36.558 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-03-30T14:54:36.679 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mgr (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:36.907 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mgr. 2024-03-30T14:54:36.934 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-1967-g4e50bbcd-1jammy_amd64.deb ... 2024-03-30T14:54:36.974 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mgr (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:37.079 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mon. 2024-03-30T14:54:37.106 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-1967-g4e50bbcd-1jammy_amd64.deb ... 2024-03-30T14:54:37.146 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mon (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:37.371 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mon. 2024-03-30T14:54:37.398 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-1967-g4e50bbcd-1jammy_amd64.deb ... 2024-03-30T14:54:37.438 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mon (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:37.691 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-osd. 2024-03-30T14:54:37.718 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-1967-g4e50bbcd-1jammy_amd64.deb ... 2024-03-30T14:54:37.757 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-osd (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:38.446 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-osd. 2024-03-30T14:54:38.472 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-1967-g4e50bbcd-1jammy_amd64.deb ... 2024-03-30T14:54:38.512 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-osd (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:38.869 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph. 2024-03-30T14:54:38.884 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../066-ceph_19.0.0-1967-g4e50bbcd-1jammy_amd64.deb ... 2024-03-30T14:54:38.927 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:39.247 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-fuse. 2024-03-30T14:54:39.274 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-1967-g4e50bbcd-1jammy_amd64.deb ... 2024-03-30T14:54:39.313 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-fuse (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:39.658 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mds. 2024-03-30T14:54:39.685 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-1967-g4e50bbcd-1jammy_amd64.deb ... 2024-03-30T14:54:39.724 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mds (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:39.828 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph. 2024-03-30T14:54:39.843 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../066-ceph_19.0.0-1967-g4e50bbcd-1jammy_amd64.deb ... 2024-03-30T14:54:39.886 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:40.120 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package cephadm. 2024-03-30T14:54:40.146 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../069-cephadm_19.0.0-1967-g4e50bbcd-1jammy_amd64.deb ... 2024-03-30T14:54:40.186 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking cephadm (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:40.208 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-fuse. 2024-03-30T14:54:40.234 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-1967-g4e50bbcd-1jammy_amd64.deb ... 2024-03-30T14:54:40.275 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-fuse (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:40.505 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-asyncssh. 2024-03-30T14:54:40.532 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-03-30T14:54:40.572 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-03-30T14:54:40.632 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mds. 2024-03-30T14:54:40.658 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-1967-g4e50bbcd-1jammy_amd64.deb ... 2024-03-30T14:54:40.698 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mds (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:40.883 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python-babel-localedata. 2024-03-30T14:54:40.898 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-03-30T14:54:40.941 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-03-30T14:54:41.147 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package cephadm. 2024-03-30T14:54:41.173 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../069-cephadm_19.0.0-1967-g4e50bbcd-1jammy_amd64.deb ... 2024-03-30T14:54:41.213 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking cephadm (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:41.527 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-asyncssh. 2024-03-30T14:54:41.553 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-03-30T14:54:41.593 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-03-30T14:54:41.891 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python-babel-localedata. 2024-03-30T14:54:41.907 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-03-30T14:54:41.950 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-03-30T14:54:42.013 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-babel. 2024-03-30T14:54:42.040 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-03-30T14:54:42.079 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-03-30T14:54:42.407 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-jinja2. 2024-03-30T14:54:42.434 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-03-30T14:54:42.474 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-03-30T14:54:42.853 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-03-30T14:54:42.879 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-1967-g4e50bbcd-1jammy_all.deb ... 2024-03-30T14:54:42.918 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-babel. 2024-03-30T14:54:42.919 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mgr-cephadm (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:42.946 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-03-30T14:54:42.985 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-03-30T14:54:43.255 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-repoze.lru. 2024-03-30T14:54:43.282 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-03-30T14:54:43.309 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-jinja2. 2024-03-30T14:54:43.322 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-03-30T14:54:43.336 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-03-30T14:54:43.376 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-03-30T14:54:43.591 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-routes. 2024-03-30T14:54:43.618 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-03-30T14:54:43.649 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-03-30T14:54:43.723 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-03-30T14:54:43.749 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-1967-g4e50bbcd-1jammy_all.deb ... 2024-03-30T14:54:43.798 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mgr-cephadm (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:43.953 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-03-30T14:54:43.980 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-1967-g4e50bbcd-1jammy_all.deb ... 2024-03-30T14:54:44.011 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mgr-dashboard (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:44.122 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-repoze.lru. 2024-03-30T14:54:44.149 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-03-30T14:54:44.197 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-03-30T14:54:44.512 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-routes. 2024-03-30T14:54:44.539 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-03-30T14:54:44.578 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-03-30T14:54:44.909 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-03-30T14:54:44.936 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-1967-g4e50bbcd-1jammy_all.deb ... 2024-03-30T14:54:44.976 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mgr-dashboard (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:45.299 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-03-30T14:54:45.315 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-03-30T14:54:45.357 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-03-30T14:54:45.886 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-joblib. 2024-03-30T14:54:45.913 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-03-30T14:54:45.952 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-03-30T14:54:46.281 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-03-30T14:54:46.308 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-03-30T14:54:46.347 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-03-30T14:54:46.592 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-sklearn. 2024-03-30T14:54:46.603 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-03-30T14:54:46.619 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-03-30T14:54:46.630 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-03-30T14:54:46.658 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-03-30T14:54:46.670 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-03-30T14:54:47.161 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-joblib. 2024-03-30T14:54:47.188 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-03-30T14:54:47.236 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-03-30T14:54:47.534 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-03-30T14:54:47.562 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-1967-g4e50bbcd-1jammy_all.deb ... 2024-03-30T14:54:47.569 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-03-30T14:54:47.597 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-03-30T14:54:47.635 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-03-30T14:54:47.686 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:47.924 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-sklearn. 2024-03-30T14:54:47.951 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-03-30T14:54:47.992 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-03-30T14:54:48.618 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-03-30T14:54:48.646 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-1967-g4e50bbcd-1jammy_all.deb ... 2024-03-30T14:54:48.648 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-cachetools. 2024-03-30T14:54:48.675 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-03-30T14:54:48.714 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-03-30T14:54:48.773 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:49.009 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pyasn1. 2024-03-30T14:54:49.036 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-03-30T14:54:49.092 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-03-30T14:54:49.387 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-03-30T14:54:49.403 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-03-30T14:54:49.437 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-03-30T14:54:49.698 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-rsa. 2024-03-30T14:54:49.714 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-03-30T14:54:49.748 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-rsa (4.8-1) ... 2024-03-30T14:54:50.069 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-google-auth. 2024-03-30T14:54:50.073 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-cachetools. 2024-03-30T14:54:50.097 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-03-30T14:54:50.101 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-03-30T14:54:50.135 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-03-30T14:54:50.140 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-03-30T14:54:50.437 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pyasn1. 2024-03-30T14:54:50.455 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-03-30T14:54:50.464 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-03-30T14:54:50.482 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-03-30T14:54:50.503 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-03-30T14:54:50.522 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-03-30T14:54:50.800 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-websocket. 2024-03-30T14:54:50.811 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-03-30T14:54:50.816 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-03-30T14:54:50.838 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-03-30T14:54:50.849 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-03-30T14:54:50.886 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-03-30T14:54:51.103 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-kubernetes. 2024-03-30T14:54:51.119 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-03-30T14:54:51.161 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-03-30T14:54:51.193 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-rsa. 2024-03-30T14:54:51.220 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-03-30T14:54:51.259 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-rsa (4.8-1) ... 2024-03-30T14:54:51.566 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-google-auth. 2024-03-30T14:54:51.594 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-03-30T14:54:51.634 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-03-30T14:54:51.775 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-03-30T14:54:51.791 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-1967-g4e50bbcd-1jammy_all.deb ... 2024-03-30T14:54:51.824 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:51.931 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-03-30T14:54:51.948 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-03-30T14:54:51.981 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-03-30T14:54:52.153 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libonig5:amd64. 2024-03-30T14:54:52.180 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-03-30T14:54:52.219 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-03-30T14:54:52.280 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-websocket. 2024-03-30T14:54:52.308 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-03-30T14:54:52.355 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-03-30T14:54:52.581 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libjq1:amd64. 2024-03-30T14:54:52.608 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-03-30T14:54:52.680 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-03-30T14:54:52.703 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-kubernetes. 2024-03-30T14:54:52.730 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-03-30T14:54:52.779 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-03-30T14:54:52.942 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package jq. 2024-03-30T14:54:52.957 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-03-30T14:54:53.000 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-03-30T14:54:53.403 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package socat. 2024-03-30T14:54:53.430 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-03-30T14:54:53.469 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-03-30T14:54:53.781 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package xmlstarlet. 2024-03-30T14:54:53.808 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-03-30T14:54:53.847 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-03-30T14:54:53.991 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-03-30T14:54:54.021 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-1967-g4e50bbcd-1jammy_all.deb ... 2024-03-30T14:54:54.066 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:54.210 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-test. 2024-03-30T14:54:54.238 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../097-ceph-test_19.0.0-1967-g4e50bbcd-1jammy_amd64.deb ... 2024-03-30T14:54:54.277 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-test (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:54.388 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libonig5:amd64. 2024-03-30T14:54:54.416 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-03-30T14:54:54.454 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-03-30T14:54:54.795 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libjq1:amd64. 2024-03-30T14:54:54.822 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-03-30T14:54:54.861 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-03-30T14:54:55.118 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package jq. 2024-03-30T14:54:55.145 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-03-30T14:54:55.193 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-03-30T14:54:55.448 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package socat. 2024-03-30T14:54:55.475 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-03-30T14:54:55.514 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-03-30T14:54:55.830 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package xmlstarlet. 2024-03-30T14:54:55.846 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-03-30T14:54:55.888 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-03-30T14:54:56.230 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-test. 2024-03-30T14:54:56.247 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../097-ceph-test_19.0.0-1967-g4e50bbcd-1jammy_amd64.deb ... 2024-03-30T14:54:56.280 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-test (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:56.522 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-volume. 2024-03-30T14:54:56.538 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-1967-g4e50bbcd-1jammy_all.deb ... 2024-03-30T14:54:56.572 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-volume (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:56.860 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libcephfs-dev. 2024-03-30T14:54:56.888 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-1967-g4e50bbcd-1jammy_amd64.deb ... 2024-03-30T14:54:56.926 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libcephfs-dev (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:57.254 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package lua-socket:amd64. 2024-03-30T14:54:57.281 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-03-30T14:54:57.321 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-03-30T14:54:57.867 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package lua-sec:amd64. 2024-03-30T14:54:57.895 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-03-30T14:54:57.933 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-03-30T14:54:58.329 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package nvme-cli. 2024-03-30T14:54:58.357 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-03-30T14:54:58.395 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-03-30T14:54:58.859 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package pkg-config. 2024-03-30T14:54:58.887 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-03-30T14:54:58.934 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-03-30T14:54:59.195 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-03-30T14:54:59.211 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-03-30T14:54:59.253 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-03-30T14:54:59.473 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-volume. 2024-03-30T14:54:59.502 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-1967-g4e50bbcd-1jammy_all.deb ... 2024-03-30T14:54:59.550 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-volume (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:59.657 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-iniconfig. 2024-03-30T14:54:59.685 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-03-30T14:54:59.723 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-03-30T14:54:59.840 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libcephfs-dev. 2024-03-30T14:54:59.856 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-1967-g4e50bbcd-1jammy_amd64.deb ... 2024-03-30T14:54:59.898 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libcephfs-dev (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:54:59.992 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pastescript. 2024-03-30T14:55:00.009 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-03-30T14:55:00.042 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-03-30T14:55:00.203 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package lua-socket:amd64. 2024-03-30T14:55:00.220 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-03-30T14:55:00.253 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-03-30T14:55:00.338 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pluggy. 2024-03-30T14:55:00.365 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-03-30T14:55:00.396 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-03-30T14:55:00.588 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package lua-sec:amd64. 2024-03-30T14:55:00.616 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-03-30T14:55:00.655 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-03-30T14:55:00.682 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-psutil. 2024-03-30T14:55:00.710 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-03-30T14:55:00.748 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-03-30T14:55:01.005 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package nvme-cli. 2024-03-30T14:55:01.033 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-03-30T14:55:01.072 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-03-30T14:55:01.093 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-py. 2024-03-30T14:55:01.121 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-03-30T14:55:01.176 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-py (1.10.0-1) ... 2024-03-30T14:55:01.474 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package pkg-config. 2024-03-30T14:55:01.502 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-03-30T14:55:01.505 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pygments. 2024-03-30T14:55:01.533 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-03-30T14:55:01.541 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-03-30T14:55:01.571 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-03-30T14:55:01.806 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-03-30T14:55:01.822 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-03-30T14:55:01.864 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-03-30T14:55:02.034 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pyinotify. 2024-03-30T14:55:02.055 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-03-30T14:55:02.092 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-03-30T14:55:02.329 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-iniconfig. 2024-03-30T14:55:02.356 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-03-30T14:55:02.372 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-toml. 2024-03-30T14:55:02.397 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-03-30T14:55:02.400 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-03-30T14:55:02.430 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-03-30T14:55:02.694 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pastescript. 2024-03-30T14:55:02.708 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pytest. 2024-03-30T14:55:02.721 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-03-30T14:55:02.736 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-03-30T14:55:02.760 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-03-30T14:55:02.774 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-03-30T14:55:03.026 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pluggy. 2024-03-30T14:55:03.042 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-03-30T14:55:03.084 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-03-30T14:55:03.119 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-simplejson. 2024-03-30T14:55:03.136 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-03-30T14:55:03.177 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-03-30T14:55:03.390 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-psutil. 2024-03-30T14:55:03.417 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-03-30T14:55:03.456 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-03-30T14:55:03.464 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-03-30T14:55:03.480 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-03-30T14:55:03.514 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-03-30T14:55:03.796 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-py. 2024-03-30T14:55:03.824 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-03-30T14:55:03.863 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-py (1.10.0-1) ... 2024-03-30T14:55:04.193 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package radosgw. 2024-03-30T14:55:04.220 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../116-radosgw_19.0.0-1967-g4e50bbcd-1jammy_amd64.deb ... 2024-03-30T14:55:04.259 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking radosgw (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:04.537 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pygments. 2024-03-30T14:55:04.565 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-03-30T14:55:04.604 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-03-30T14:55:05.038 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pyinotify. 2024-03-30T14:55:05.066 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-03-30T14:55:05.071 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package rbd-fuse. 2024-03-30T14:55:05.099 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-1967-g4e50bbcd-1jammy_amd64.deb ... 2024-03-30T14:55:05.113 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-03-30T14:55:05.137 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking rbd-fuse (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:05.426 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-toml. 2024-03-30T14:55:05.450 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-03-30T14:55:05.454 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-03-30T14:55:05.492 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-03-30T14:55:05.700 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-03-30T14:55:05.799 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pytest. 2024-03-30T14:55:05.801 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-03-30T14:55:05.827 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-03-30T14:55:05.874 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-03-30T14:55:06.051 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-03-30T14:55:06.224 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-simplejson. 2024-03-30T14:55:06.251 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-03-30T14:55:06.290 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-03-30T14:55:06.360 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-03-30T14:55:06.545 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-03-30T14:55:06.561 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-03-30T14:55:06.603 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-03-30T14:55:06.776 INFO:teuthology.orchestra.run.smithi172.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-03-30T14:55:06.853 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up cephadm (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:07.377 INFO:teuthology.orchestra.run.smithi172.stdout:Adding system user cephadm....done 2024-03-30T14:55:07.479 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package radosgw. 2024-03-30T14:55:07.506 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../116-radosgw_19.0.0-1967-g4e50bbcd-1jammy_amd64.deb ... 2024-03-30T14:55:07.534 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-03-30T14:55:07.545 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking radosgw (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:07.802 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-03-30T14:55:08.044 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-03-30T14:55:08.171 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-03-30T14:55:08.430 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-03-30T14:55:08.494 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package rbd-fuse. 2024-03-30T14:55:08.510 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-1967-g4e50bbcd-1jammy_amd64.deb ... 2024-03-30T14:55:08.552 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking rbd-fuse (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:08.673 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-03-30T14:55:08.791 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-py (1.10.0-1) ... 2024-03-30T14:55:08.850 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-03-30T14:55:09.092 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-03-30T14:55:09.096 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-03-30T14:55:09.223 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-03-30T14:55:09.436 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-03-30T14:55:09.484 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-03-30T14:55:09.704 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-03-30T14:55:09.820 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-03-30T14:55:09.972 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-03-30T14:55:10.207 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-03-30T14:55:10.243 INFO:teuthology.orchestra.run.smithi072.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-03-30T14:55:10.337 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up cephadm (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:10.441 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-03-30T14:55:10.700 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-03-30T14:55:10.968 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-ceph-argparse (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:11.219 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-03-30T14:55:11.345 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-03-30T14:55:11.471 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-03-30T14:55:11.569 INFO:teuthology.orchestra.run.smithi072.stdout:Adding system user cephadm....done 2024-03-30T14:55:11.588 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-03-30T14:55:11.726 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-03-30T14:55:11.827 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-03-30T14:55:11.996 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-03-30T14:55:12.230 INFO:teuthology.orchestra.run.smithi172.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-03-30T14:55:12.250 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-03-30T14:55:12.262 INFO:teuthology.orchestra.run.smithi172.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-03-30T14:55:12.326 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-03-30T14:55:12.360 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-03-30T14:55:12.435 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-03-30T14:55:12.612 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-03-30T14:55:12.779 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-03-30T14:55:12.866 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-03-30T14:55:12.904 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-03-30T14:55:12.976 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-py (1.10.0-1) ... 2024-03-30T14:55:13.280 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-03-30T14:55:13.421 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-03-30T14:55:13.643 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-03-30T14:55:13.673 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-03-30T14:55:13.895 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-03-30T14:55:13.958 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up zip (3.0-12build2) ... 2024-03-30T14:55:14.084 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-03-30T14:55:14.155 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-03-30T14:55:14.416 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-03-30T14:55:14.653 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-03-30T14:55:14.794 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-03-30T14:55:15.054 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-03-30T14:55:15.105 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-03-30T14:55:15.179 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-03-30T14:55:15.289 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-03-30T14:55:15.357 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-ceph-argparse (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:15.573 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-03-30T14:55:15.609 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-03-30T14:55:15.721 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-03-30T14:55:15.848 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-03-30T14:55:15.974 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-03-30T14:55:15.975 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-03-30T14:55:16.225 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-03-30T14:55:16.235 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-03-30T14:55:16.594 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-03-30T14:55:16.631 INFO:teuthology.orchestra.run.smithi072.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-03-30T14:55:16.661 INFO:teuthology.orchestra.run.smithi072.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-03-30T14:55:16.726 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-03-30T14:55:16.836 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-03-30T14:55:16.878 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-03-30T14:55:17.198 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-03-30T14:55:17.221 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-03-30T14:55:17.325 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-03-30T14:55:17.464 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-03-30T14:55:17.565 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-ceph-common (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:17.569 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-03-30T14:55:17.829 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-03-30T14:55:17.841 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-idna (3.3-1) ... 2024-03-30T14:55:18.141 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up zip (3.0-12build2) ... 2024-03-30T14:55:18.159 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-03-30T14:55:18.260 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-03-30T14:55:18.914 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-03-30T14:55:19.166 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-03-30T14:55:19.277 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-03-30T14:55:19.340 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-03-30T14:55:19.404 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-03-30T14:55:19.583 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-30T14:55:19.698 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-03-30T14:55:19.717 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-toml (0.10.2-1) ... 2024-03-30T14:55:19.993 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-03-30T14:55:20.117 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-03-30T14:55:20.119 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-03-30T14:55:20.245 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-03-30T14:55:20.370 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-03-30T14:55:20.547 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-03-30T14:55:20.748 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-03-30T14:55:20.789 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-03-30T14:55:21.032 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-30T14:55:21.034 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-03-30T14:55:21.158 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-03-30T14:55:21.397 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-03-30T14:55:21.459 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-03-30T14:55:21.649 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-03-30T14:55:21.719 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-03-30T14:55:21.767 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-ceph-common (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:21.978 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-03-30T14:55:22.053 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-idna (3.3-1) ... 2024-03-30T14:55:22.247 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-03-30T14:55:22.365 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-03-30T14:55:22.489 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-03-30T14:55:22.740 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-03-30T14:55:22.866 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-03-30T14:55:23.142 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-03-30T14:55:23.251 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-03-30T14:55:23.536 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-03-30T14:55:23.536 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-03-30T14:55:23.780 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-30T14:55:23.845 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-03-30T14:55:23.917 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-toml (0.10.2-1) ... 2024-03-30T14:55:24.099 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-03-30T14:55:24.161 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-03-30T14:55:24.197 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-03-30T14:55:24.288 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-03-30T14:55:24.298 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-03-30T14:55:24.370 INFO:teuthology.orchestra.run.smithi172.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-03-30T14:55:24.414 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-03-30T14:55:24.608 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-03-30T14:55:24.710 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-03-30T14:55:24.734 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-03-30T14:55:24.945 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-03-30T14:55:25.119 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-03-30T14:55:25.198 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-30T14:55:25.324 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-03-30T14:55:25.412 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up lua-any (27ubuntu1) ... 2024-03-30T14:55:25.538 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-portend (3.0.0-1) ... 2024-03-30T14:55:25.629 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-03-30T14:55:25.789 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-30T14:55:25.881 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-03-30T14:55:25.915 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-03-30T14:55:26.141 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-03-30T14:55:26.224 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-03-30T14:55:26.401 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-03-30T14:55:26.525 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-03-30T14:55:26.655 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-03-30T14:55:26.785 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-03-30T14:55:26.911 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-rsa (4.8-1) ... 2024-03-30T14:55:26.915 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-03-30T14:55:27.075 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-03-30T14:55:27.179 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-03-30T14:55:27.353 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-03-30T14:55:27.455 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-03-30T14:55:27.481 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-03-30T14:55:27.766 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-03-30T14:55:27.800 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-03-30T14:55:28.069 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-03-30T14:55:28.151 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-03-30T14:55:28.329 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-03-30T14:55:28.420 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-03-30T14:55:28.441 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-03-30T14:55:28.568 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-03-30T14:55:28.657 INFO:teuthology.orchestra.run.smithi072.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-03-30T14:55:28.781 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-03-30T14:55:28.904 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-03-30T14:55:28.906 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up librados2 (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:29.014 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-03-30T14:55:29.033 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libsqlite3-mod-ceph (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:29.150 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-03-30T14:55:29.410 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-03-30T14:55:29.478 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libcephfs2 (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:29.613 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libradosstriper1 (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:29.671 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up lua-any (27ubuntu1) ... 2024-03-30T14:55:29.739 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-03-30T14:55:29.798 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-portend (3.0.0-1) ... 2024-03-30T14:55:30.015 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up librbd1 (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:30.049 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-30T14:55:30.141 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mgr-modules-core (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:30.178 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-03-30T14:55:30.251 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-fuse (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:30.447 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-30T14:55:30.448 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-30T14:55:30.488 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-03-30T14:55:30.774 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-03-30T14:55:30.885 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libcephfs-dev (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:31.011 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-rados (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:31.051 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-03-30T14:55:31.137 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up librgw2 (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:31.179 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-rsa (4.8-1) ... 2024-03-30T14:55:31.263 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-03-30T14:55:31.440 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-03-30T14:55:31.700 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-03-30T14:55:32.041 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-03-30T14:55:32.461 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-03-30T14:55:32.483 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-rbd (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:32.626 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up rbd-fuse (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:32.752 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-rgw (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:32.756 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-03-30T14:55:32.878 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-cephfs (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:33.004 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-common (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:33.103 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-03-30T14:55:33.230 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up librados2 (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:33.359 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libsqlite3-mod-ceph (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:33.469 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-03-30T14:55:33.547 INFO:teuthology.orchestra.run.smithi172.stdout:Adding group ceph....done 2024-03-30T14:55:33.793 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libcephfs2 (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:33.840 INFO:teuthology.orchestra.run.smithi172.stdout:Adding system user ceph....done 2024-03-30T14:55:33.945 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libradosstriper1 (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:34.009 INFO:teuthology.orchestra.run.smithi172.stdout:Setting system user ceph properties....done 2024-03-30T14:55:34.027 INFO:teuthology.orchestra.run.smithi172.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-03-30T14:55:34.072 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-03-30T14:55:34.168 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-03-30T14:55:34.333 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up librbd1 (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:34.462 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mgr-modules-core (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:34.501 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-03-30T14:55:34.572 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-fuse (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:34.775 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-30T14:55:34.775 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-30T14:55:34.947 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-test (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:35.073 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up radosgw (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:35.358 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libcephfs-dev (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:35.485 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-rados (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:35.541 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-30T14:55:35.541 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-30T14:55:35.613 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up librgw2 (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:35.740 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-03-30T14:55:35.983 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-base (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:36.330 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-03-30T14:55:36.801 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mds (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:36.874 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-rbd (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:37.000 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up rbd-fuse (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:37.019 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-30T14:55:37.019 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-30T14:55:37.127 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-rgw (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:37.254 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-cephfs (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:37.374 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-common (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:37.486 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mgr (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:37.704 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-30T14:55:37.704 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-30T14:55:37.931 INFO:teuthology.orchestra.run.smithi072.stdout:Adding group ceph....done 2024-03-30T14:55:38.188 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-osd (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:38.301 INFO:teuthology.orchestra.run.smithi072.stdout:Adding system user ceph....done 2024-03-30T14:55:38.446 INFO:teuthology.orchestra.run.smithi072.stdout:Setting system user ceph properties....done 2024-03-30T14:55:38.461 INFO:teuthology.orchestra.run.smithi072.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-03-30T14:55:38.468 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-30T14:55:38.468 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-30T14:55:38.598 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-03-30T14:55:38.930 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-03-30T14:55:38.939 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mgr-k8sevents (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:39.074 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:39.200 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mon (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:39.378 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-test (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:39.433 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-30T14:55:39.433 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-30T14:55:39.505 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up radosgw (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:39.893 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mgr-cephadm (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:39.953 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-30T14:55:39.953 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-30T14:55:40.044 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:40.170 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mgr-dashboard (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:40.321 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-volume (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:40.400 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-base (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:40.673 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-03-30T14:55:40.747 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-03-30T14:55:40.766 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-03-30T14:55:40.910 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-03-30T14:55:41.214 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mds (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:41.422 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-30T14:55:41.422 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-30T14:55:41.867 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mgr (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:42.027 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-03-30T14:55:42.083 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-30T14:55:42.083 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-30T14:55:42.529 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-osd (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:42.680 INFO:teuthology.orchestra.run.smithi172.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-03-30T14:55:42.690 DEBUG:teuthology.parallel:result is None 2024-03-30T14:55:42.803 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-30T14:55:42.803 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-30T14:55:43.291 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mgr-k8sevents (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:43.409 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:43.553 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mon (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:43.768 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-30T14:55:43.768 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-30T14:55:44.223 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mgr-cephadm (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:44.350 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:44.477 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mgr-dashboard (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:44.629 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-volume (19.0.0-1967-g4e50bbcd-1jammy) ... 2024-03-30T14:55:44.977 INFO:teuthology.orchestra.run.smithi072.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-03-30T14:55:45.086 INFO:teuthology.orchestra.run.smithi072.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-03-30T14:55:45.240 INFO:teuthology.orchestra.run.smithi072.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-03-30T14:55:46.380 INFO:teuthology.orchestra.run.smithi072.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-03-30T14:55:47.186 INFO:teuthology.orchestra.run.smithi072.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-03-30T14:55:47.191 DEBUG:teuthology.parallel:result is None 2024-03-30T14:55:47.192 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:55:47.337 DEBUG:teuthology.orchestra.run.smithi072:> dpkg-query -W -f '${Version}' ceph 2024-03-30T14:55:47.356 INFO:teuthology.orchestra.run.smithi072.stdout:19.0.0-1967-g4e50bbcd-1jammy 2024-03-30T14:55:47.356 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1967-g4e50bbcd-1jammy 2024-03-30T14:55:47.356 INFO:teuthology.task.install:The correct ceph version 19.0.0-1967-g4e50bbcd-1jammy is installed. 2024-03-30T14:55:47.358 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:55:47.582 DEBUG:teuthology.orchestra.run.smithi172:> dpkg-query -W -f '${Version}' ceph 2024-03-30T14:55:47.602 INFO:teuthology.orchestra.run.smithi172.stdout:19.0.0-1967-g4e50bbcd-1jammy 2024-03-30T14:55:47.602 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1967-g4e50bbcd-1jammy 2024-03-30T14:55:47.603 INFO:teuthology.task.install:The correct ceph version 19.0.0-1967-g4e50bbcd-1jammy is installed. 2024-03-30T14:55:47.606 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-30T14:55:47.606 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-30T14:55:47.606 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-30T14:55:47.620 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-03-30T14:55:47.620 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-30T14:55:47.656 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-30T14:55:47.656 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-30T14:55:47.656 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/daemon-helper 2024-03-30T14:55:47.676 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-30T14:55:47.731 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-03-30T14:55:47.731 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/daemon-helper 2024-03-30T14:55:47.744 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-30T14:55:47.801 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-30T14:55:47.802 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-30T14:55:47.802 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-30T14:55:47.815 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-30T14:55:47.870 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-03-30T14:55:47.870 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-30T14:55:47.884 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-30T14:55:47.939 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-30T14:55:47.939 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-30T14:55:47.939 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/stdin-killer 2024-03-30T14:55:47.952 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-30T14:55:48.008 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-03-30T14:55:48.009 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/stdin-killer 2024-03-30T14:55:48.021 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-30T14:55:48.075 INFO:teuthology.run_tasks:Running task cephadm... 2024-03-30T14:55:48.174 INFO:tasks.cephadm:Config: {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'client': {'debug ms': 1}, 'global': {'mon election default strategy': 1, 'ms type': 'async'}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': '4e50bbcdd1630c7760b708f3a5b4d38a121e66cb', 'cephadm_mode': 'cephadm-package'} 2024-03-30T14:55:48.174 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:55:48.175 INFO:tasks.cephadm:Cluster fsid is 97f8e564-eea5-11ee-b647-cb9ed24678a4 2024-03-30T14:55:48.175 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-03-30T14:55:48.175 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.72', 'mon.c': '[v2:172.21.15.72:3301,v1:172.21.15.72:6790]', 'mon.b': '172.21.15.172'} 2024-03-30T14:55:48.175 INFO:tasks.cephadm:First mon is mon.a on smithi072 2024-03-30T14:55:48.175 INFO:tasks.cephadm:First mgr is y 2024-03-30T14:55:48.175 INFO:tasks.cephadm:Normalizing hostnames... 2024-03-30T14:55:48.175 DEBUG:teuthology.orchestra.run.smithi072:> sudo hostname $(hostname -s) 2024-03-30T14:55:48.190 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname $(hostname -s) 2024-03-30T14:55:48.214 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb on all hosts... 2024-03-30T14:55:48.214 DEBUG:teuthology.orchestra.run.smithi072:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb pull 2024-03-30T14:55:48.233 DEBUG:teuthology.orchestra.run.smithi172:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb pull 2024-03-30T14:55:48.398 INFO:teuthology.orchestra.run.smithi072.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb... 2024-03-30T14:55:48.412 INFO:teuthology.orchestra.run.smithi172.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb... 2024-03-30T14:56:43.647 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-03-30T14:56:43.648 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_version": "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)", 2024-03-30T14:56:43.648 INFO:teuthology.orchestra.run.smithi172.stdout: "image_id": "b0c4478f1d83795df4d538bf108aee5fac57194348fb16dcdbb3115f3e2fe95e", 2024-03-30T14:56:43.648 INFO:teuthology.orchestra.run.smithi172.stdout: "repo_digests": [ 2024-03-30T14:56:43.648 INFO:teuthology.orchestra.run.smithi172.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:8f3809717761e681477c3ef1d8d2c03114aee2c597cd7380b93b8c10f47fcb5d" 2024-03-30T14:56:43.648 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-03-30T14:56:43.648 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-03-30T14:56:52.318 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-30T14:56:52.318 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_version": "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)", 2024-03-30T14:56:52.318 INFO:teuthology.orchestra.run.smithi072.stdout: "image_id": "b0c4478f1d83795df4d538bf108aee5fac57194348fb16dcdbb3115f3e2fe95e", 2024-03-30T14:56:52.318 INFO:teuthology.orchestra.run.smithi072.stdout: "repo_digests": [ 2024-03-30T14:56:52.318 INFO:teuthology.orchestra.run.smithi072.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:8f3809717761e681477c3ef1d8d2c03114aee2c597cd7380b93b8c10f47fcb5d" 2024-03-30T14:56:52.318 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-03-30T14:56:52.318 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-30T14:56:52.353 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /etc/ceph 2024-03-30T14:56:52.367 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /etc/ceph 2024-03-30T14:56:52.382 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 777 /etc/ceph 2024-03-30T14:56:52.421 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 777 /etc/ceph 2024-03-30T14:56:52.434 INFO:tasks.cephadm:Writing seed config... 2024-03-30T14:56:52.436 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-03-30T14:56:52.436 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-03-30T14:56:52.436 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-03-30T14:56:52.436 INFO:tasks.cephadm: override: [global] mon election default strategy = 1 2024-03-30T14:56:52.436 INFO:tasks.cephadm: override: [global] ms type = async 2024-03-30T14:56:52.436 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-03-30T14:56:52.436 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-03-30T14:56:52.436 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-03-30T14:56:52.436 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-03-30T14:56:52.437 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-03-30T14:56:52.437 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-03-30T14:56:52.437 INFO:tasks.cephadm: override: [osd] osd class default list = * 2024-03-30T14:56:52.437 INFO:tasks.cephadm: override: [osd] osd class load list = * 2024-03-30T14:56:52.437 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-03-30T14:56:52.437 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-30T14:56:52.437 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-03-30T14:56:52.468 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 97f8e564-eea5-11ee-b647-cb9ed24678a4 mon election default strategy = 1 ms type = async [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 osd class default list = * osd class load list = * [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] debug ms = 1 2024-03-30T14:56:52.468 DEBUG:teuthology.orchestra.run.smithi072:mon.a> sudo journalctl -f -n 0 -u ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@mon.a.service 2024-03-30T14:56:52.512 DEBUG:teuthology.orchestra.run.smithi072:mgr.y> sudo journalctl -f -n 0 -u ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@mgr.y.service 2024-03-30T14:56:52.556 INFO:tasks.cephadm:Bootstrapping... 2024-03-30T14:56:52.556 DEBUG:teuthology.orchestra.run.smithi072:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -v bootstrap --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.72 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-03-30T14:56:52.763 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2024-03-30T14:56:52.764 INFO:teuthology.orchestra.run.smithi072.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb', '-v', 'bootstrap', '--fsid', '97f8e564-eea5-11ee-b647-cb9ed24678a4', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'y', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.72', '--skip-admin-label'] 2024-03-30T14:56:52.764 INFO:teuthology.orchestra.run.smithi072.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-03-30T14:56:52.765 INFO:teuthology.orchestra.run.smithi072.stdout:Verifying podman|docker is present... 2024-03-30T14:56:52.765 INFO:teuthology.orchestra.run.smithi072.stdout:Verifying lvm2 is present... 2024-03-30T14:56:52.765 INFO:teuthology.orchestra.run.smithi072.stdout:Verifying time synchronization is in place... 2024-03-30T14:56:52.770 INFO:teuthology.orchestra.run.smithi072.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-03-30T14:56:52.770 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-03-30T14:56:52.776 INFO:teuthology.orchestra.run.smithi072.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-03-30T14:56:52.777 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stdout inactive 2024-03-30T14:56:52.780 INFO:teuthology.orchestra.run.smithi072.stdout:Non-zero exit code 1 from systemctl is-enabled chronyd.service 2024-03-30T14:56:52.780 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stderr Failed to get unit file state for chronyd.service: No such file or directory 2024-03-30T14:56:52.783 INFO:teuthology.orchestra.run.smithi072.stdout:Non-zero exit code 3 from systemctl is-active chronyd.service 2024-03-30T14:56:52.783 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stdout inactive 2024-03-30T14:56:52.787 INFO:teuthology.orchestra.run.smithi072.stdout:Non-zero exit code 1 from systemctl is-enabled systemd-timesyncd.service 2024-03-30T14:56:52.787 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stdout masked 2024-03-30T14:56:52.791 INFO:teuthology.orchestra.run.smithi072.stdout:Non-zero exit code 3 from systemctl is-active systemd-timesyncd.service 2024-03-30T14:56:52.791 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stdout inactive 2024-03-30T14:56:52.795 INFO:teuthology.orchestra.run.smithi072.stdout:Non-zero exit code 1 from systemctl is-enabled ntpd.service 2024-03-30T14:56:52.796 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stderr Failed to get unit file state for ntpd.service: No such file or directory 2024-03-30T14:56:52.799 INFO:teuthology.orchestra.run.smithi072.stdout:Non-zero exit code 3 from systemctl is-active ntpd.service 2024-03-30T14:56:52.799 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stdout inactive 2024-03-30T14:56:52.803 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stdout enabled 2024-03-30T14:56:52.807 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stdout active 2024-03-30T14:56:52.807 INFO:teuthology.orchestra.run.smithi072.stdout:Unit ntp.service is enabled and running 2024-03-30T14:56:52.807 INFO:teuthology.orchestra.run.smithi072.stdout:Repeating the final host check... 2024-03-30T14:56:52.807 INFO:teuthology.orchestra.run.smithi072.stdout:docker (/usr/bin/docker) is present 2024-03-30T14:56:52.807 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl is present 2024-03-30T14:56:52.807 INFO:teuthology.orchestra.run.smithi072.stdout:lvcreate is present 2024-03-30T14:56:52.810 INFO:teuthology.orchestra.run.smithi072.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-03-30T14:56:52.810 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-03-30T14:56:52.814 INFO:teuthology.orchestra.run.smithi072.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-03-30T14:56:52.814 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stdout inactive 2024-03-30T14:56:52.817 INFO:teuthology.orchestra.run.smithi072.stdout:Non-zero exit code 1 from systemctl is-enabled chronyd.service 2024-03-30T14:56:52.817 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stderr Failed to get unit file state for chronyd.service: No such file or directory 2024-03-30T14:56:52.820 INFO:teuthology.orchestra.run.smithi072.stdout:Non-zero exit code 3 from systemctl is-active chronyd.service 2024-03-30T14:56:52.820 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stdout inactive 2024-03-30T14:56:52.824 INFO:teuthology.orchestra.run.smithi072.stdout:Non-zero exit code 1 from systemctl is-enabled systemd-timesyncd.service 2024-03-30T14:56:52.824 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stdout masked 2024-03-30T14:56:52.827 INFO:teuthology.orchestra.run.smithi072.stdout:Non-zero exit code 3 from systemctl is-active systemd-timesyncd.service 2024-03-30T14:56:52.827 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stdout inactive 2024-03-30T14:56:52.831 INFO:teuthology.orchestra.run.smithi072.stdout:Non-zero exit code 1 from systemctl is-enabled ntpd.service 2024-03-30T14:56:52.831 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stderr Failed to get unit file state for ntpd.service: No such file or directory 2024-03-30T14:56:52.834 INFO:teuthology.orchestra.run.smithi072.stdout:Non-zero exit code 3 from systemctl is-active ntpd.service 2024-03-30T14:56:52.834 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stdout inactive 2024-03-30T14:56:52.838 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stdout enabled 2024-03-30T14:56:52.842 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stdout active 2024-03-30T14:56:52.842 INFO:teuthology.orchestra.run.smithi072.stdout:Unit ntp.service is enabled and running 2024-03-30T14:56:52.842 INFO:teuthology.orchestra.run.smithi072.stdout:Host looks OK 2024-03-30T14:56:52.843 INFO:teuthology.orchestra.run.smithi072.stdout:Cluster fsid: 97f8e564-eea5-11ee-b647-cb9ed24678a4 2024-03-30T14:56:52.843 INFO:teuthology.orchestra.run.smithi072.stdout:Acquiring lock 139768104709872 on /run/cephadm/97f8e564-eea5-11ee-b647-cb9ed24678a4.lock 2024-03-30T14:56:52.843 INFO:teuthology.orchestra.run.smithi072.stdout:Lock 139768104709872 acquired on /run/cephadm/97f8e564-eea5-11ee-b647-cb9ed24678a4.lock 2024-03-30T14:56:52.843 INFO:teuthology.orchestra.run.smithi072.stdout:Verifying IP 172.21.15.72 port 3300 ... 2024-03-30T14:56:52.843 INFO:teuthology.orchestra.run.smithi072.stdout:Verifying IP 172.21.15.72 port 6789 ... 2024-03-30T14:56:52.843 INFO:teuthology.orchestra.run.smithi072.stdout:Base mon IP(s) is [172.21.15.72:3300, 172.21.15.72:6789], mon addrv is [v2:172.21.15.72:3300,v1:172.21.15.72:6789] 2024-03-30T14:56:52.846 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 2024-03-30T14:56:52.846 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.72 metric 100 2024-03-30T14:56:52.846 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/sbin/ip: stdout 158.69.67.47 via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.72 metric 100 2024-03-30T14:56:52.846 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/sbin/ip: stdout 172.17.0.0/16 dev docker0 proto kernel scope link src 172.17.0.1 linkdown 2024-03-30T14:56:52.846 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.72 metric 100 2024-03-30T14:56:52.846 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/sbin/ip: stdout 172.21.0.1 dev enp3s0f1 proto dhcp scope link src 172.21.15.72 metric 100 2024-03-30T14:56:52.846 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/sbin/ip: stdout 172.21.0.2 dev enp3s0f1 proto dhcp scope link src 172.21.15.72 metric 100 2024-03-30T14:56:52.846 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/sbin/ip: stdout 172.21.15.254 dev enp3s0f1 proto dhcp scope link src 172.21.15.72 metric 100 2024-03-30T14:56:52.847 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-03-30T14:56:52.847 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-03-30T14:56:52.848 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 expires 1799sec pref medium 2024-03-30T14:56:52.850 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-03-30T14:56:52.850 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/sbin/ip: stdout inet6 ::1/128 scope host 2024-03-30T14:56:52.850 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-03-30T14:56:52.850 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-03-30T14:56:52.850 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:b765/64 scope link 2024-03-30T14:56:52.850 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-03-30T14:56:52.851 INFO:teuthology.orchestra.run.smithi072.stdout:Mon IP `172.21.15.72` is in CIDR network `172.21.0.0/20` 2024-03-30T14:56:52.851 INFO:teuthology.orchestra.run.smithi072.stdout:Mon IP `172.21.15.72` is in CIDR network `172.21.0.0/20` 2024-03-30T14:56:52.851 INFO:teuthology.orchestra.run.smithi072.stdout:Mon IP `172.21.15.72` is in CIDR network `172.21.0.1/32` 2024-03-30T14:56:52.851 INFO:teuthology.orchestra.run.smithi072.stdout:Mon IP `172.21.15.72` is in CIDR network `172.21.0.1/32` 2024-03-30T14:56:52.851 INFO:teuthology.orchestra.run.smithi072.stdout:Mon IP `172.21.15.72` is in CIDR network `172.21.0.2/32` 2024-03-30T14:56:52.851 INFO:teuthology.orchestra.run.smithi072.stdout:Mon IP `172.21.15.72` is in CIDR network `172.21.0.2/32` 2024-03-30T14:56:52.851 INFO:teuthology.orchestra.run.smithi072.stdout:Mon IP `172.21.15.72` is in CIDR network `172.21.15.254/32` 2024-03-30T14:56:52.852 INFO:teuthology.orchestra.run.smithi072.stdout:Mon IP `172.21.15.72` is in CIDR network `172.21.15.254/32` 2024-03-30T14:56:52.852 INFO:teuthology.orchestra.run.smithi072.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20', '172.21.0.1/32', '172.21.0.1/32', '172.21.0.2/32', '172.21.0.2/32', '172.21.15.254/32', '172.21.15.254/32'] 2024-03-30T14:56:52.852 INFO:teuthology.orchestra.run.smithi072.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-03-30T14:56:52.852 INFO:teuthology.orchestra.run.smithi072.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb... 2024-03-30T14:56:53.127 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/docker: stdout 4e50bbcdd1630c7760b708f3a5b4d38a121e66cb: Pulling from ceph-ci/ceph 2024-03-30T14:56:53.127 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/docker: stdout Digest: sha256:8f3809717761e681477c3ef1d8d2c03114aee2c597cd7380b93b8c10f47fcb5d 2024-03-30T14:56:53.127 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/docker: stdout Status: Image is up to date for quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:56:53.127 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/docker: stdout quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:56:54.744 INFO:teuthology.orchestra.run.smithi072.stdout:ceph: stdout ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev) 2024-03-30T14:56:54.744 INFO:teuthology.orchestra.run.smithi072.stdout:Ceph version: ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev) 2024-03-30T14:56:54.744 INFO:teuthology.orchestra.run.smithi072.stdout:Extracting ceph user uid/gid from container image... 2024-03-30T14:56:56.088 INFO:teuthology.orchestra.run.smithi072.stdout:stat: stdout 167 167 2024-03-30T14:56:56.088 INFO:teuthology.orchestra.run.smithi072.stdout:Creating initial keys... 2024-03-30T14:56:57.473 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-authtool: stdout AQA4KAhmYctIMxAAwpdu++oHzv8T9g3ApfHX2w== 2024-03-30T14:56:58.800 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-authtool: stdout AQA6KAhmVZJlDRAAhLEwL5bVhZWamECyx0mVlw== 2024-03-30T14:57:00.134 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-authtool: stdout AQA7KAhmGpU6IBAAK3IMlvNIyDMNKvAkI0e1mw== 2024-03-30T14:57:00.135 INFO:teuthology.orchestra.run.smithi072.stdout:Creating initial monmap... 2024-03-30T14:57:01.423 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-03-30T14:57:01.423 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-03-30T14:57:01.423 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 97f8e564-eea5-11ee-b647-cb9ed24678a4 2024-03-30T14:57:01.423 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-03-30T14:57:01.423 INFO:teuthology.orchestra.run.smithi072.stdout:monmaptool for a [v2:172.21.15.72:3300,v1:172.21.15.72:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-03-30T14:57:01.424 INFO:teuthology.orchestra.run.smithi072.stdout:setting min_mon_release = quincy 2024-03-30T14:57:01.424 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/monmaptool: set fsid to 97f8e564-eea5-11ee-b647-cb9ed24678a4 2024-03-30T14:57:01.424 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-03-30T14:57:01.424 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-30T14:57:01.424 INFO:teuthology.orchestra.run.smithi072.stdout:Creating mon... 2024-03-30T14:57:02.873 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 0 set uid:gid to 167:167 (ceph:ceph) 2024-03-30T14:57:02.873 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 1 imported monmap: 2024-03-30T14:57:02.873 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr epoch 0 2024-03-30T14:57:02.873 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 2024-03-30T14:57:02.873 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr last_changed 2024-03-30T14:57:00.883324+0000 2024-03-30T14:57:02.873 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr created 2024-03-30T14:57:00.883324+0000 2024-03-30T14:57:02.873 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr min_mon_release 17 (quincy) 2024-03-30T14:57:02.873 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr election_strategy: 1 2024-03-30T14:57:02.873 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr 0: [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] mon.a 2024-03-30T14:57:02.873 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr 2024-03-30T14:57:02.873 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 0 /usr/bin/ceph-mon: set fsid to 97f8e564-eea5-11ee-b647-cb9ed24678a4 2024-03-30T14:57:02.873 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: RocksDB version: 7.9.2 2024-03-30T14:57:02.874 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr 2024-03-30T14:57:02.874 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Git sha 0 2024-03-30T14:57:02.874 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Compile date 2024-03-29 15:06:16 2024-03-30T14:57:02.874 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: DB SUMMARY 2024-03-30T14:57:02.874 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr 2024-03-30T14:57:02.874 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: DB Session ID: B0UV2IG2TPR37D3C9BAL 2024-03-30T14:57:02.874 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr 2024-03-30T14:57:02.874 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 0, files: 2024-03-30T14:57:02.874 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr 2024-03-30T14:57:02.874 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 2024-03-30T14:57:02.874 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr 2024-03-30T14:57:02.874 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.error_if_exists: 0 2024-03-30T14:57:02.874 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.create_if_missing: 1 2024-03-30T14:57:02.874 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.paranoid_checks: 1 2024-03-30T14:57:02.875 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.flush_verify_memtable_count: 1 2024-03-30T14:57:02.875 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-30T14:57:02.875 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-30T14:57:02.875 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.env: 0x564b4486bc60 2024-03-30T14:57:02.875 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.fs: PosixFileSystem 2024-03-30T14:57:02.875 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.info_log: 0x564b46b34d60 2024-03-30T14:57:02.875 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.max_file_opening_threads: 16 2024-03-30T14:57:02.875 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.statistics: (nil) 2024-03-30T14:57:02.875 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.use_fsync: 0 2024-03-30T14:57:02.875 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.max_log_file_size: 0 2024-03-30T14:57:02.875 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-30T14:57:02.876 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.log_file_time_to_roll: 0 2024-03-30T14:57:02.876 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.keep_log_file_num: 1000 2024-03-30T14:57:02.876 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.recycle_log_file_num: 0 2024-03-30T14:57:02.876 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.allow_fallocate: 1 2024-03-30T14:57:02.876 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.allow_mmap_reads: 0 2024-03-30T14:57:02.876 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.allow_mmap_writes: 0 2024-03-30T14:57:02.876 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.use_direct_reads: 0 2024-03-30T14:57:02.876 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-30T14:57:02.876 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.create_missing_column_families: 0 2024-03-30T14:57:02.876 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.db_log_dir: 2024-03-30T14:57:02.876 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.wal_dir: 2024-03-30T14:57:02.876 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.table_cache_numshardbits: 6 2024-03-30T14:57:02.876 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-03-30T14:57:02.877 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-03-30T14:57:02.877 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-30T14:57:02.877 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-30T14:57:02.877 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-03-30T14:57:02.877 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.advise_random_on_open: 1 2024-03-30T14:57:02.877 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.db_write_buffer_size: 0 2024-03-30T14:57:02.877 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.write_buffer_manager: 0x564b46b09360 2024-03-30T14:57:02.877 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-30T14:57:02.877 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-30T14:57:02.877 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.use_adaptive_mutex: 0 2024-03-30T14:57:02.877 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.rate_limiter: (nil) 2024-03-30T14:57:02.877 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-30T14:57:02.877 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.wal_recovery_mode: 2 2024-03-30T14:57:02.877 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.enable_thread_tracking: 0 2024-03-30T14:57:02.877 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.enable_pipelined_write: 0 2024-03-30T14:57:02.878 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.unordered_write: 0 2024-03-30T14:57:02.878 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-30T14:57:02.878 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-30T14:57:02.878 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-30T14:57:02.878 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-30T14:57:02.878 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.row_cache: None 2024-03-30T14:57:02.878 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.wal_filter: None 2024-03-30T14:57:02.878 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-30T14:57:02.878 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.allow_ingest_behind: 0 2024-03-30T14:57:02.878 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.two_write_queues: 0 2024-03-30T14:57:02.878 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.manual_wal_flush: 0 2024-03-30T14:57:02.878 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.wal_compression: 0 2024-03-30T14:57:02.878 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.atomic_flush: 0 2024-03-30T14:57:02.878 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-30T14:57:02.879 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.persist_stats_to_disk: 0 2024-03-30T14:57:02.879 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-03-30T14:57:02.879 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.log_readahead_size: 0 2024-03-30T14:57:02.879 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-30T14:57:02.879 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.best_efforts_recovery: 0 2024-03-30T14:57:02.879 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-30T14:57:02.879 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-30T14:57:02.879 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.allow_data_in_errors: 0 2024-03-30T14:57:02.879 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.db_host_id: __hostname__ 2024-03-30T14:57:02.879 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.enforce_single_del_contracts: true 2024-03-30T14:57:02.879 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.max_background_jobs: 2 2024-03-30T14:57:02.879 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.max_background_compactions: -1 2024-03-30T14:57:02.879 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.max_subcompactions: 1 2024-03-30T14:57:02.879 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-30T14:57:02.879 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-30T14:57:02.880 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.delayed_write_rate : 16777216 2024-03-30T14:57:02.880 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.max_total_wal_size: 0 2024-03-30T14:57:02.880 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-30T14:57:02.880 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.stats_dump_period_sec: 600 2024-03-30T14:57:02.880 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.stats_persist_period_sec: 600 2024-03-30T14:57:02.880 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-30T14:57:02.880 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.max_open_files: -1 2024-03-30T14:57:02.880 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.bytes_per_sync: 0 2024-03-30T14:57:02.880 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-03-30T14:57:02.880 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-03-30T14:57:02.880 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.compaction_readahead_size: 0 2024-03-30T14:57:02.880 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.max_background_flushes: -1 2024-03-30T14:57:02.880 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Compression algorithms supported: 2024-03-30T14:57:02.880 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-30T14:57:02.880 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: kZSTD supported: 0 2024-03-30T14:57:02.881 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: kXpressCompression supported: 0 2024-03-30T14:57:02.881 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: kLZ4HCCompression supported: 1 2024-03-30T14:57:02.881 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: kZlibCompression supported: 1 2024-03-30T14:57:02.881 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: kSnappyCompression supported: 1 2024-03-30T14:57:02.881 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: kLZ4Compression supported: 1 2024-03-30T14:57:02.881 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: kBZip2Compression supported: 0 2024-03-30T14:57:02.881 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-03-30T14:57:02.881 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: DMutex implementation: pthread_mutex_t 2024-03-30T14:57:02.881 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: [db/db_impl/db_impl_open.cc:317] Creating manifest 1 2024-03-30T14:57:02.881 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr 2024-03-30T14:57:02.881 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 2024-03-30T14:57:02.881 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr 2024-03-30T14:57:02.881 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-30T14:57:02.881 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr 2024-03-30T14:57:02.881 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-30T14:57:02.882 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.merge_operator: 2024-03-30T14:57:02.882 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.compaction_filter: None 2024-03-30T14:57:02.882 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.compaction_filter_factory: None 2024-03-30T14:57:02.882 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.sst_partitioner_factory: None 2024-03-30T14:57:02.882 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-03-30T14:57:02.882 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.table_factory: BlockBasedTable 2024-03-30T14:57:02.882 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x564b46b34e60) 2024-03-30T14:57:02.882 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr cache_index_and_filter_blocks: 1 2024-03-30T14:57:02.882 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr cache_index_and_filter_blocks_with_high_priority: 0 2024-03-30T14:57:02.882 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-30T14:57:02.882 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr pin_top_level_index_and_filter: 1 2024-03-30T14:57:02.882 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr index_type: 0 2024-03-30T14:57:02.882 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr data_block_index_type: 0 2024-03-30T14:57:02.882 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr index_shortening: 1 2024-03-30T14:57:02.883 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr data_block_hash_table_util_ratio: 0.750000 2024-03-30T14:57:02.883 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr checksum: 4 2024-03-30T14:57:02.883 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr no_block_cache: 0 2024-03-30T14:57:02.883 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr block_cache: 0x564b46b39090 2024-03-30T14:57:02.883 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr block_cache_name: BinnedLRUCache 2024-03-30T14:57:02.883 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr block_cache_options: 2024-03-30T14:57:02.883 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr capacity : 536870912 2024-03-30T14:57:02.883 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr num_shard_bits : 4 2024-03-30T14:57:02.883 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr strict_capacity_limit : 0 2024-03-30T14:57:02.883 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr high_pri_pool_ratio: 0.000 2024-03-30T14:57:02.883 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr block_cache_compressed: (nil) 2024-03-30T14:57:02.883 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr persistent_cache: (nil) 2024-03-30T14:57:02.883 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr block_size: 4096 2024-03-30T14:57:02.883 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr block_size_deviation: 10 2024-03-30T14:57:02.883 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr block_restart_interval: 16 2024-03-30T14:57:02.884 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr index_block_restart_interval: 1 2024-03-30T14:57:02.884 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr metadata_block_size: 4096 2024-03-30T14:57:02.884 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr partition_filters: 0 2024-03-30T14:57:02.884 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr use_delta_encoding: 1 2024-03-30T14:57:02.884 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr filter_policy: bloomfilter 2024-03-30T14:57:02.884 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr whole_key_filtering: 1 2024-03-30T14:57:02.884 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr verify_compression: 0 2024-03-30T14:57:02.884 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr read_amp_bytes_per_bit: 0 2024-03-30T14:57:02.884 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr format_version: 5 2024-03-30T14:57:02.884 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr enable_index_compression: 1 2024-03-30T14:57:02.884 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr block_align: 0 2024-03-30T14:57:02.884 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr max_auto_readahead_size: 262144 2024-03-30T14:57:02.884 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr prepopulate_block_cache: 0 2024-03-30T14:57:02.884 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr initial_auto_readahead_size: 8192 2024-03-30T14:57:02.884 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr num_file_reads_for_auto_readahead: 2 2024-03-30T14:57:02.884 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr 2024-03-30T14:57:02.885 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.write_buffer_size: 33554432 2024-03-30T14:57:02.885 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.max_write_buffer_number: 2 2024-03-30T14:57:02.885 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.compression: NoCompression 2024-03-30T14:57:02.885 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.bottommost_compression: Disabled 2024-03-30T14:57:02.885 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.prefix_extractor: nullptr 2024-03-30T14:57:02.885 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-30T14:57:02.885 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.num_levels: 7 2024-03-30T14:57:02.885 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-30T14:57:02.885 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-30T14:57:02.885 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-30T14:57:02.885 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-30T14:57:02.885 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-30T14:57:02.885 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-30T14:57:02.885 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-30T14:57:02.886 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-30T14:57:02.886 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-30T14:57:02.886 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-30T14:57:02.886 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-30T14:57:02.886 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-30T14:57:02.886 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.compression_opts.window_bits: -14 2024-03-30T14:57:02.886 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.compression_opts.level: 32767 2024-03-30T14:57:02.886 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.compression_opts.strategy: 0 2024-03-30T14:57:02.886 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-30T14:57:02.886 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-30T14:57:02.886 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-30T14:57:02.886 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-30T14:57:02.886 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.compression_opts.enabled: false 2024-03-30T14:57:02.886 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-30T14:57:02.887 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-30T14:57:02.887 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-30T14:57:02.887 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-30T14:57:02.887 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.target_file_size_base: 67108864 2024-03-30T14:57:02.887 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.target_file_size_multiplier: 1 2024-03-30T14:57:02.887 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-30T14:57:02.887 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-30T14:57:02.887 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-30T14:57:02.887 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-30T14:57:02.887 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-30T14:57:02.887 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-30T14:57:02.887 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-30T14:57:02.887 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-30T14:57:02.887 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-30T14:57:02.887 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-30T14:57:02.888 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-30T14:57:02.888 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-30T14:57:02.888 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-30T14:57:02.888 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.arena_block_size: 1048576 2024-03-30T14:57:02.888 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-30T14:57:02.888 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-30T14:57:02.888 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.disable_auto_compactions: 0 2024-03-30T14:57:02.888 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-30T14:57:02.888 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-30T14:57:02.888 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-30T14:57:02.888 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-30T14:57:02.888 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-30T14:57:02.888 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-30T14:57:02.888 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-30T14:57:02.889 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-30T14:57:02.889 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-30T14:57:02.889 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-30T14:57:02.889 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.table_properties_collectors: 2024-03-30T14:57:02.889 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.inplace_update_support: 0 2024-03-30T14:57:02.889 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-03-30T14:57:02.889 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-30T14:57:02.889 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-30T14:57:02.889 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.memtable_huge_page_size: 0 2024-03-30T14:57:02.889 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.bloom_locality: 0 2024-03-30T14:57:02.889 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.max_successive_merges: 0 2024-03-30T14:57:02.889 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-03-30T14:57:02.889 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.paranoid_file_checks: 0 2024-03-30T14:57:02.889 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.force_consistency_checks: 1 2024-03-30T14:57:02.890 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.report_bg_io_stats: 0 2024-03-30T14:57:02.890 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.ttl: 2592000 2024-03-30T14:57:02.890 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-03-30T14:57:02.890 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-30T14:57:02.890 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-30T14:57:02.890 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.enable_blob_files: false 2024-03-30T14:57:02.890 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.min_blob_size: 0 2024-03-30T14:57:02.890 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.blob_file_size: 268435456 2024-03-30T14:57:02.890 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.blob_compression_type: NoCompression 2024-03-30T14:57:02.890 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-03-30T14:57:02.890 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-30T14:57:02.890 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-30T14:57:02.890 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-30T14:57:02.890 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.blob_file_starting_level: 0 2024-03-30T14:57:02.890 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.224+0000 7f66b2054c80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-30T14:57:02.891 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.228+0000 7f66b2054c80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-03-30T14:57:02.891 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr 2024-03-30T14:57:02.891 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.228+0000 7f66b2054c80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-03-30T14:57:02.891 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr 2024-03-30T14:57:02.891 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.228+0000 7f66b2054c80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 745d64d4-7a77-434e-8b82-9b47e96ffa0d 2024-03-30T14:57:02.891 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr 2024-03-30T14:57:02.891 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.228+0000 7f66b2054c80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 5 2024-03-30T14:57:02.891 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr 2024-03-30T14:57:02.891 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.228+0000 7f66b2054c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x564b46c04000 2024-03-30T14:57:02.891 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.228+0000 7f66b2054c80 4 rocksdb: DB pointer 0x564b46bf4000 2024-03-30T14:57:02.891 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.228+0000 7f66a21be700 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-30T14:57:02.891 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.228+0000 7f66a21be700 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-30T14:57:02.891 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr ** DB Stats ** 2024-03-30T14:57:02.891 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr Uptime(secs): 0.0 total, 0.0 interval 2024-03-30T14:57:02.891 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-30T14:57:02.892 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-30T14:57:02.892 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-30T14:57:02.892 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-30T14:57:02.892 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-30T14:57:02.892 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-30T14:57:02.892 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr 2024-03-30T14:57:02.892 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr ** Compaction Stats [default] ** 2024-03-30T14:57:02.892 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-30T14:57:02.892 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-30T14:57:02.892 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-03-30T14:57:02.892 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-03-30T14:57:02.892 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr 2024-03-30T14:57:02.892 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr ** Compaction Stats [default] ** 2024-03-30T14:57:02.892 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-30T14:57:02.893 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-30T14:57:02.893 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr 2024-03-30T14:57:02.893 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-30T14:57:02.893 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr 2024-03-30T14:57:02.893 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr Uptime(secs): 0.0 total, 0.0 interval 2024-03-30T14:57:02.893 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr Flush(GB): cumulative 0.000, interval 0.000 2024-03-30T14:57:02.893 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr AddFile(GB): cumulative 0.000, interval 0.000 2024-03-30T14:57:02.893 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr AddFile(Total Files): cumulative 0, interval 0 2024-03-30T14:57:02.893 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr AddFile(L0 Files): cumulative 0, interval 0 2024-03-30T14:57:02.893 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr AddFile(Keys): cumulative 0, interval 0 2024-03-30T14:57:02.893 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-30T14:57:02.893 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-30T14:57:02.893 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-30T14:57:02.893 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr Block cache BinnedLRUCache@0x564b46b39090#7 capacity: 512.00 MB usage: 0.00 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-03-30T14:57:02.894 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr Block cache entry stats(count,size,portion): Misc(1,0.00 KB,0%) 2024-03-30T14:57:02.894 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr 2024-03-30T14:57:02.894 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr ** File Read Latency Histogram By Level [default] ** 2024-03-30T14:57:02.894 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr 2024-03-30T14:57:02.894 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.228+0000 7f66b2054c80 4 rocksdb: [db/db_impl/db_impl.cc:496] Shutdown: canceling all background work 2024-03-30T14:57:02.894 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.228+0000 7f66b2054c80 4 rocksdb: [db/db_impl/db_impl.cc:704] Shutdown complete 2024-03-30T14:57:02.894 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-30T14:57:02.228+0000 7f66b2054c80 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-a for mon.a 2024-03-30T14:57:02.894 INFO:teuthology.orchestra.run.smithi072.stdout:create mon.a on 2024-03-30T14:57:03.154 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2024-03-30T14:57:03.341 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /etc/systemd/system/ceph.target. 2024-03-30T14:57:03.547 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4.target -> /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4.target. 2024-03-30T14:57:03.548 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4.target -> /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4.target. 2024-03-30T14:57:03.809 INFO:teuthology.orchestra.run.smithi072.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@mon.a 2024-03-30T14:57:03.809 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stderr Failed to reset failed state of unit ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@mon.a.service: Unit ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@mon.a.service not loaded. 2024-03-30T14:57:03.990 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4.target.wants/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@mon.a.service -> /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service. 2024-03-30T14:57:03.998 INFO:teuthology.orchestra.run.smithi072.stdout:firewalld does not appear to be present 2024-03-30T14:57:03.998 INFO:teuthology.orchestra.run.smithi072.stdout:Not possible to enable service . firewalld.service is not available 2024-03-30T14:57:03.999 INFO:teuthology.orchestra.run.smithi072.stdout:Waiting for mon to start... 2024-03-30T14:57:03.999 INFO:teuthology.orchestra.run.smithi072.stdout:Waiting for mon... 2024-03-30T14:57:05.670 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:05 smithi072 bash[21087]: cluster 2024-03-30T14:57:05.353467+0000 mon.a (mon.0) 1 : cluster 1 mon.a is new leader, mons a in quorum (ranks 0) 2024-03-30T14:57:06.372 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout cluster: 2024-03-30T14:57:06.372 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout id: 97f8e564-eea5-11ee-b647-cb9ed24678a4 2024-03-30T14:57:06.372 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-03-30T14:57:06.372 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 2024-03-30T14:57:06.372 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout services: 2024-03-30T14:57:06.373 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.34646s) 2024-03-30T14:57:06.373 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-03-30T14:57:06.373 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-03-30T14:57:06.374 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 2024-03-30T14:57:06.374 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout data: 2024-03-30T14:57:06.374 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-03-30T14:57:06.374 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-03-30T14:57:06.374 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-03-30T14:57:06.374 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout pgs: 2024-03-30T14:57:06.374 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 2024-03-30T14:57:06.376 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.368+0000 7f02d69d2700 1 Processor -- start 2024-03-30T14:57:06.376 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.368+0000 7f02d69d2700 1 -- start start 2024-03-30T14:57:06.376 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.368+0000 7f02d69d2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02d007b6e0 0x7f02d0079b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:06.376 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.368+0000 7f02d69d2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f02d007a110 con 0x7f02d007b6e0 2024-03-30T14:57:06.376 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.368+0000 7f02cffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02d007b6e0 0x7f02d0079b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:57:06.376 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.368+0000 7f02cffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02d007b6e0 0x7f02d0079b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53336/0 (socket says 172.21.15.72:53336) 2024-03-30T14:57:06.377 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.368+0000 7f02cffff700 1 -- 172.21.15.72:0/1871795223 learned_addr learned my addr 172.21.15.72:0/1871795223 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:57:06.377 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.368+0000 7f02cffff700 1 -- 172.21.15.72:0/1871795223 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02d007b6e0 msgr2=0x7f02d0079b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2024-03-30T14:57:06.377 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.368+0000 7f02cffff700 1 -- 172.21.15.72:0/1871795223 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02d007b6e0 msgr2=0x7f02d0079b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-30T14:57:06.377 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.368+0000 7f02cffff700 1 --2- 172.21.15.72:0/1871795223 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02d007b6e0 0x7f02d0079b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-30T14:57:06.377 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.368+0000 7f02cffff700 1 --2- 172.21.15.72:0/1871795223 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02d007b6e0 0x7f02d0079b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-30T14:57:06.377 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.572+0000 7f02cffff700 1 --2- 172.21.15.72:0/1871795223 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02d007b6e0 0x7f02d0079b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:57:06.377 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.572+0000 7f02cffff700 1 -- 172.21.15.72:0/1871795223 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02d007a290 con 0x7f02d007b6e0 2024-03-30T14:57:06.377 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.572+0000 7f02cffff700 1 --2- 172.21.15.72:0/1871795223 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02d007b6e0 0x7f02d0079b40 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f02c8009ae0 tx=0x7f02c8009df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bc2e8e1a3851096 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:57:06.377 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.572+0000 7f02ceffd700 1 -- 172.21.15.72:0/1871795223 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02c8018070 con 0x7f02d007b6e0 2024-03-30T14:57:06.377 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.572+0000 7f02ceffd700 1 -- 172.21.15.72:0/1871795223 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02c8003d80 con 0x7f02d007b6e0 2024-03-30T14:57:06.377 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.572+0000 7f02ceffd700 1 -- 172.21.15.72:0/1871795223 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02c8007a90 con 0x7f02d007b6e0 2024-03-30T14:57:06.379 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.572+0000 7f02d69d2700 1 -- 172.21.15.72:0/1871795223 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02d007b6e0 msgr2=0x7f02d0079b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:57:06.379 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.572+0000 7f02d69d2700 1 --2- 172.21.15.72:0/1871795223 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02d007b6e0 0x7f02d0079b40 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f02c8009ae0 tx=0x7f02c8009df0 comp rx=0 tx=0).stop 2024-03-30T14:57:06.380 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.572+0000 7f02d69d2700 1 -- 172.21.15.72:0/1871795223 shutdown_connections 2024-03-30T14:57:06.380 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.572+0000 7f02d69d2700 1 --2- 172.21.15.72:0/1871795223 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02d007b6e0 0x7f02d0079b40 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:06.380 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.572+0000 7f02d69d2700 1 -- 172.21.15.72:0/1871795223 >> 172.21.15.72:0/1871795223 conn(0x7f02d0101630 msgr2=0x7f02d0103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:57:06.380 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.576+0000 7f02d69d2700 1 -- 172.21.15.72:0/1871795223 shutdown_connections 2024-03-30T14:57:06.380 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.576+0000 7f02d69d2700 1 -- 172.21.15.72:0/1871795223 wait complete. 2024-03-30T14:57:06.380 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.576+0000 7f02d69d2700 1 Processor -- start 2024-03-30T14:57:06.380 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.576+0000 7f02d69d2700 1 -- start start 2024-03-30T14:57:06.380 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.576+0000 7f02d69d2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02d007b6e0 0x7f02d019b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:06.380 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.576+0000 7f02d69d2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f02d007a7c0 con 0x7f02d007b6e0 2024-03-30T14:57:06.380 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.576+0000 7f02cffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02d007b6e0 0x7f02d019b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:57:06.380 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.576+0000 7f02cffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02d007b6e0 0x7f02d019b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53350/0 (socket says 172.21.15.72:53350) 2024-03-30T14:57:06.380 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.576+0000 7f02cffff700 1 -- 172.21.15.72:0/2772880504 learned_addr learned my addr 172.21.15.72:0/2772880504 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:57:06.380 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.576+0000 7f02cffff700 1 -- 172.21.15.72:0/2772880504 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02d019bde0 con 0x7f02d007b6e0 2024-03-30T14:57:06.381 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.576+0000 7f02cffff700 1 --2- 172.21.15.72:0/2772880504 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02d007b6e0 0x7f02d019b8a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f02c8000f80 tx=0x7f02c8004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:57:06.381 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.576+0000 7f02cd7fa700 1 -- 172.21.15.72:0/2772880504 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02c8022020 con 0x7f02d007b6e0 2024-03-30T14:57:06.381 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.576+0000 7f02cd7fa700 1 -- 172.21.15.72:0/2772880504 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02c8019040 con 0x7f02d007b6e0 2024-03-30T14:57:06.381 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.576+0000 7f02d69d2700 1 -- 172.21.15.72:0/2772880504 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02d019c070 con 0x7f02d007b6e0 2024-03-30T14:57:06.383 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.576+0000 7f02cd7fa700 1 -- 172.21.15.72:0/2772880504 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02c8018070 con 0x7f02d007b6e0 2024-03-30T14:57:06.383 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.576+0000 7f02d69d2700 1 -- 172.21.15.72:0/2772880504 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02d019ed60 con 0x7f02d007b6e0 2024-03-30T14:57:06.383 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.576+0000 7f02cd7fa700 1 -- 172.21.15.72:0/2772880504 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f02c8025020 con 0x7f02d007b6e0 2024-03-30T14:57:06.383 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.576+0000 7f02cd7fa700 1 -- 172.21.15.72:0/2772880504 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f02c801e5a0 con 0x7f02d007b6e0 2024-03-30T14:57:06.383 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.580+0000 7f02d69d2700 1 -- 172.21.15.72:0/2772880504 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02d0063870 con 0x7f02d007b6e0 2024-03-30T14:57:06.383 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.580+0000 7f02cd7fa700 1 -- 172.21.15.72:0/2772880504 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f02c802c030 con 0x7f02d007b6e0 2024-03-30T14:57:06.383 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.716+0000 7f02d69d2700 1 -- 172.21.15.72:0/2772880504 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f02d002dbd0 con 0x7f02d007b6e0 2024-03-30T14:57:06.383 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.716+0000 7f02cd7fa700 1 -- 172.21.15.72:0/2772880504 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+316 (secure 0 0 0) 0x7f02c8010070 con 0x7f02d007b6e0 2024-03-30T14:57:06.383 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.720+0000 7f02d69d2700 1 -- 172.21.15.72:0/2772880504 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02d007b6e0 msgr2=0x7f02d019b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:57:06.383 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.720+0000 7f02d69d2700 1 --2- 172.21.15.72:0/2772880504 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02d007b6e0 0x7f02d019b8a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f02c8000f80 tx=0x7f02c8004b40 comp rx=0 tx=0).stop 2024-03-30T14:57:06.383 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.720+0000 7f02d69d2700 1 -- 172.21.15.72:0/2772880504 shutdown_connections 2024-03-30T14:57:06.383 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.720+0000 7f02d69d2700 1 --2- 172.21.15.72:0/2772880504 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02d007b6e0 0x7f02d019b8a0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:06.384 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.720+0000 7f02d69d2700 1 -- 172.21.15.72:0/2772880504 >> 172.21.15.72:0/2772880504 conn(0x7f02d0101630 msgr2=0x7f02d0103920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:57:06.384 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.720+0000 7f02d69d2700 1 -- 172.21.15.72:0/2772880504 shutdown_connections 2024-03-30T14:57:06.384 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:05.720+0000 7f02d69d2700 1 -- 172.21.15.72:0/2772880504 wait complete. 2024-03-30T14:57:06.384 INFO:teuthology.orchestra.run.smithi072.stdout:mon is available 2024-03-30T14:57:06.384 INFO:teuthology.orchestra.run.smithi072.stdout:Assimilating anything we can from ceph.conf... 2024-03-30T14:57:06.670 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:06 smithi072 bash[21087]: cluster 2024-03-30T14:57:05.373362+0000 mon.a (mon.0) 2 : cluster 1 mon.a is new leader, mons a in quorum (ranks 0) 2024-03-30T14:57:06.670 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:06 smithi072 bash[21087]: cluster 2024-03-30T14:57:05.373569+0000 mon.a (mon.0) 3 : cluster 0 monmap epoch 1 2024-03-30T14:57:06.670 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:06 smithi072 bash[21087]: cluster 2024-03-30T14:57:05.373582+0000 mon.a (mon.0) 4 : cluster 0 fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 2024-03-30T14:57:06.670 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:06 smithi072 bash[21087]: cluster 2024-03-30T14:57:05.373596+0000 mon.a (mon.0) 5 : cluster 0 last_changed 2024-03-30T14:57:00.883324+0000 2024-03-30T14:57:06.670 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:06 smithi072 bash[21087]: cluster 2024-03-30T14:57:05.373608+0000 mon.a (mon.0) 6 : cluster 0 created 2024-03-30T14:57:00.883324+0000 2024-03-30T14:57:06.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:06 smithi072 bash[21087]: cluster 2024-03-30T14:57:05.373621+0000 mon.a (mon.0) 7 : cluster 0 min_mon_release 19 (squid) 2024-03-30T14:57:06.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:06 smithi072 bash[21087]: cluster 2024-03-30T14:57:05.373631+0000 mon.a (mon.0) 8 : cluster 0 election_strategy: 1 2024-03-30T14:57:06.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:06 smithi072 bash[21087]: cluster 2024-03-30T14:57:05.373643+0000 mon.a (mon.0) 9 : cluster 0 0: [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] mon.a 2024-03-30T14:57:06.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:06 smithi072 bash[21087]: cluster 2024-03-30T14:57:05.375871+0000 mon.a (mon.0) 10 : cluster 0 fsmap 2024-03-30T14:57:06.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:06 smithi072 bash[21087]: cluster 2024-03-30T14:57:05.377984+0000 mon.a (mon.0) 11 : cluster 0 osdmap e1: 0 total, 0 up, 0 in 2024-03-30T14:57:06.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:06 smithi072 bash[21087]: cluster 2024-03-30T14:57:05.378444+0000 mon.a (mon.0) 12 : cluster 0 mgrmap e1: no daemons active 2024-03-30T14:57:06.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:06 smithi072 bash[21087]: audit 2024-03-30T14:57:05.719746+0000 mon.a (mon.0) 13 : audit 0 from='client.? 172.21.15.72:0/2772880504' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-03-30T14:57:07.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:07 smithi072 bash[21087]: audit 2024-03-30T14:57:07.465953+0000 mon.a (mon.0) 14 : audit 1 from='client.? 172.21.15.72:0/1239211819' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-03-30T14:57:07.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:07 smithi072 bash[21087]: audit 2024-03-30T14:57:07.469980+0000 mon.a (mon.0) 15 : audit 1 from='client.? 172.21.15.72:0/1239211819' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-03-30T14:57:08.089 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 2024-03-30T14:57:08.090 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout [global] 2024-03-30T14:57:08.090 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout fsid = 97f8e564-eea5-11ee-b647-cb9ed24678a4 2024-03-30T14:57:08.090 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.72:3300,v1:172.21.15.72:6789] 2024-03-30T14:57:08.090 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-03-30T14:57:08.090 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-03-30T14:57:08.090 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-03-30T14:57:08.090 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-03-30T14:57:08.090 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 2024-03-30T14:57:08.090 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout [mgr] 2024-03-30T14:57:08.090 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-03-30T14:57:08.090 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 2024-03-30T14:57:08.091 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout [osd] 2024-03-30T14:57:08.091 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-03-30T14:57:08.091 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-03-30T14:57:08.091 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:07.336+0000 7f9edc7b8700 1 Processor -- start 2024-03-30T14:57:08.091 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:07.336+0000 7f9edc7b8700 1 -- start start 2024-03-30T14:57:08.091 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:07.336+0000 7f9edc7b8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ed4108270 0x7f9ed4108690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:08.091 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:07.336+0000 7f9edc7b8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed4108c60 con 0x7f9ed4108270 2024-03-30T14:57:08.091 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:07.336+0000 7f9eda554700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ed4108270 0x7f9ed4108690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:57:08.091 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:07.336+0000 7f9eda554700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ed4108270 0x7f9ed4108690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59324/0 (socket says 172.21.15.72:59324) 2024-03-30T14:57:08.091 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:07.336+0000 7f9eda554700 1 -- 172.21.15.72:0/2807178131 learned_addr learned my addr 172.21.15.72:0/2807178131 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:57:08.091 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:07.336+0000 7f9eda554700 1 -- 172.21.15.72:0/2807178131 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ed4109470 con 0x7f9ed4108270 2024-03-30T14:57:08.091 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:07.336+0000 7f9eda554700 1 --2- 172.21.15.72:0/2807178131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ed4108270 0x7f9ed4108690 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f9ed00098a0 tx=0x7f9ed0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73ce1b5e719703d9 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:57:08.091 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:07.336+0000 7f9ed9552700 1 -- 172.21.15.72:0/2807178131 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ed0004160 con 0x7f9ed4108270 2024-03-30T14:57:08.091 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:07.336+0000 7f9ed9552700 1 -- 172.21.15.72:0/2807178131 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ed0004300 con 0x7f9ed4108270 2024-03-30T14:57:08.091 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:07.336+0000 7f9ed9552700 1 -- 172.21.15.72:0/2807178131 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ed00036a0 con 0x7f9ed4108270 2024-03-30T14:57:08.092 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:07.336+0000 7f9edc7b8700 1 -- 172.21.15.72:0/2807178131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ed4108270 msgr2=0x7f9ed4108690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:57:08.092 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:07.336+0000 7f9edc7b8700 1 --2- 172.21.15.72:0/2807178131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ed4108270 0x7f9ed4108690 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f9ed00098a0 tx=0x7f9ed0009bb0 comp rx=0 tx=0).stop 2024-03-30T14:57:08.092 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:07.336+0000 7f9edc7b8700 1 -- 172.21.15.72:0/2807178131 shutdown_connections 2024-03-30T14:57:08.092 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:07.336+0000 7f9edc7b8700 1 --2- 172.21.15.72:0/2807178131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ed4108270 0x7f9ed4108690 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:08.092 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:07.336+0000 7f9edc7b8700 1 -- 172.21.15.72:0/2807178131 >> 172.21.15.72:0/2807178131 conn(0x7f9ed407b680 msgr2=0x7f9ed4105d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:57:08.092 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:07.336+0000 7f9edc7b8700 1 -- 172.21.15.72:0/2807178131 shutdown_connections 2024-03-30T14:57:08.092 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:07.336+0000 7f9edc7b8700 1 -- 172.21.15.72:0/2807178131 wait complete. 2024-03-30T14:57:08.092 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:07.336+0000 7f9edc7b8700 1 Processor -- start 2024-03-30T14:57:08.092 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:07.336+0000 7f9edc7b8700 1 -- start start 2024-03-30T14:57:08.092 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:07.340+0000 7f9edc7b8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ed4108270 0x7f9ed419b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:08.092 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:07.340+0000 7f9edc7b8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed41099a0 con 0x7f9ed4108270 2024-03-30T14:57:08.092 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:07.340+0000 7f9eda554700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ed4108270 0x7f9ed419b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:57:08.092 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:07.340+0000 7f9eda554700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ed4108270 0x7f9ed419b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59330/0 (socket says 172.21.15.72:59330) 2024-03-30T14:57:08.092 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:07.340+0000 7f9eda554700 1 -- 172.21.15.72:0/1239211819 learned_addr learned my addr 172.21.15.72:0/1239211819 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:57:08.093 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:07.340+0000 7f9eda554700 1 -- 172.21.15.72:0/1239211819 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ed419be50 con 0x7f9ed4108270 2024-03-30T14:57:08.093 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:07.340+0000 7f9eda554700 1 --2- 172.21.15.72:0/1239211819 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ed4108270 0x7f9ed419b910 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0000c00 tx=0x7f9ed0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:57:08.093 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:07.340+0000 7f9ecb7fe700 1 -- 172.21.15.72:0/1239211819 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ed0003db0 con 0x7f9ed4108270 2024-03-30T14:57:08.093 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:07.340+0000 7f9ecb7fe700 1 -- 172.21.15.72:0/1239211819 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ed0011630 con 0x7f9ed4108270 2024-03-30T14:57:08.093 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:07.340+0000 7f9edc7b8700 1 -- 172.21.15.72:0/1239211819 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ed419c0e0 con 0x7f9ed4108270 2024-03-30T14:57:08.093 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:07.340+0000 7f9ecb7fe700 1 -- 172.21.15.72:0/1239211819 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ed0011950 con 0x7f9ed4108270 2024-03-30T14:57:08.093 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:07.340+0000 7f9edc7b8700 1 -- 172.21.15.72:0/1239211819 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ed419ed80 con 0x7f9ed4108270 2024-03-30T14:57:08.093 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:07.340+0000 7f9ecb7fe700 1 -- 172.21.15.72:0/1239211819 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9ed0011af0 con 0x7f9ed4108270 2024-03-30T14:57:08.093 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:07.340+0000 7f9ecb7fe700 1 -- 172.21.15.72:0/1239211819 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9ed001c450 con 0x7f9ed4108270 2024-03-30T14:57:08.093 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:07.340+0000 7f9edc7b8700 1 -- 172.21.15.72:0/1239211819 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ed4063870 con 0x7f9ed4108270 2024-03-30T14:57:08.093 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:07.344+0000 7f9ecb7fe700 1 -- 172.21.15.72:0/1239211819 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f9ed0032020 con 0x7f9ed4108270 2024-03-30T14:57:08.093 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:07.464+0000 7f9edc7b8700 1 -- 172.21.15.72:0/1239211819 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f9ed41943c0 con 0x7f9ed4108270 2024-03-30T14:57:08.093 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:07.468+0000 7f9ecb7fe700 1 -- 172.21.15.72:0/1239211819 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+338 (secure 0 0 0) 0x7f9ed0004260 con 0x7f9ed4108270 2024-03-30T14:57:08.093 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:07.468+0000 7f9edc7b8700 1 -- 172.21.15.72:0/1239211819 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ed4108270 msgr2=0x7f9ed419b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:57:08.094 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:07.468+0000 7f9edc7b8700 1 --2- 172.21.15.72:0/1239211819 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ed4108270 0x7f9ed419b910 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0000c00 tx=0x7f9ed0004750 comp rx=0 tx=0).stop 2024-03-30T14:57:08.094 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:07.468+0000 7f9edc7b8700 1 -- 172.21.15.72:0/1239211819 shutdown_connections 2024-03-30T14:57:08.094 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:07.468+0000 7f9edc7b8700 1 --2- 172.21.15.72:0/1239211819 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ed4108270 0x7f9ed419b910 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:08.094 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:07.468+0000 7f9edc7b8700 1 -- 172.21.15.72:0/1239211819 >> 172.21.15.72:0/1239211819 conn(0x7f9ed407b680 msgr2=0x7f9ed41924d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:57:08.094 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:07.468+0000 7f9edc7b8700 1 -- 172.21.15.72:0/1239211819 shutdown_connections 2024-03-30T14:57:08.094 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:07.468+0000 7f9edc7b8700 1 -- 172.21.15.72:0/1239211819 wait complete. 2024-03-30T14:57:08.094 INFO:teuthology.orchestra.run.smithi072.stdout:Generating new minimal ceph.conf... 2024-03-30T14:57:09.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:09 smithi072 bash[21087]: audit 2024-03-30T14:57:09.091468+0000 mon.a (mon.0) 16 : audit 0 from='client.? 172.21.15.72:0/4292827131' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:57:09.682 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:08.956+0000 7fba8d146700 1 Processor -- start 2024-03-30T14:57:09.682 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:08.956+0000 7fba8d146700 1 -- start start 2024-03-30T14:57:09.682 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:08.956+0000 7fba8d146700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba88106020 0x7fba88106440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:09.682 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:08.956+0000 7fba8d146700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fba88106a10 con 0x7fba88106020 2024-03-30T14:57:09.682 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:08.956+0000 7fba86d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba88106020 0x7fba88106440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:57:09.682 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:08.956+0000 7fba86d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba88106020 0x7fba88106440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59334/0 (socket says 172.21.15.72:59334) 2024-03-30T14:57:09.682 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:08.956+0000 7fba86d9d700 1 -- 172.21.15.72:0/1466120006 learned_addr learned my addr 172.21.15.72:0/1466120006 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:57:09.682 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:08.960+0000 7fba86d9d700 1 -- 172.21.15.72:0/1466120006 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba88107220 con 0x7fba88106020 2024-03-30T14:57:09.682 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:08.960+0000 7fba86d9d700 1 --2- 172.21.15.72:0/1466120006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba88106020 0x7fba88106440 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fba700098a0 tx=0x7fba70009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cc515d5eb269a16 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:57:09.682 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:08.960+0000 7fba85d9b700 1 -- 172.21.15.72:0/1466120006 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba70004160 con 0x7fba88106020 2024-03-30T14:57:09.682 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:08.960+0000 7fba85d9b700 1 -- 172.21.15.72:0/1466120006 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1011+0+0 (secure 0 0 0) 0x7fba70004300 con 0x7fba88106020 2024-03-30T14:57:09.682 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:08.960+0000 7fba85d9b700 1 -- 172.21.15.72:0/1466120006 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba70011940 con 0x7fba88106020 2024-03-30T14:57:09.682 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:08.960+0000 7fba8d146700 1 -- 172.21.15.72:0/1466120006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba88106020 msgr2=0x7fba88106440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:57:09.683 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:08.960+0000 7fba8d146700 1 --2- 172.21.15.72:0/1466120006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba88106020 0x7fba88106440 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fba700098a0 tx=0x7fba70009bb0 comp rx=0 tx=0).stop 2024-03-30T14:57:09.683 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:08.960+0000 7fba8d146700 1 -- 172.21.15.72:0/1466120006 shutdown_connections 2024-03-30T14:57:09.683 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:08.960+0000 7fba8d146700 1 --2- 172.21.15.72:0/1466120006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba88106020 0x7fba88106440 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:09.683 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:08.960+0000 7fba8d146700 1 -- 172.21.15.72:0/1466120006 >> 172.21.15.72:0/1466120006 conn(0x7fba88101600 msgr2=0x7fba88103a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:57:09.683 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:08.960+0000 7fba8d146700 1 -- 172.21.15.72:0/1466120006 shutdown_connections 2024-03-30T14:57:09.683 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:08.960+0000 7fba8d146700 1 -- 172.21.15.72:0/1466120006 wait complete. 2024-03-30T14:57:09.683 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:08.960+0000 7fba8d146700 1 Processor -- start 2024-03-30T14:57:09.683 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:08.960+0000 7fba8d146700 1 -- start start 2024-03-30T14:57:09.683 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:08.960+0000 7fba8d146700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba88106020 0x7fba88199e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:09.683 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:08.960+0000 7fba8d146700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fba8810a450 con 0x7fba88106020 2024-03-30T14:57:09.683 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:08.960+0000 7fba86d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba88106020 0x7fba88199e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:57:09.683 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:08.960+0000 7fba86d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba88106020 0x7fba88199e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59340/0 (socket says 172.21.15.72:59340) 2024-03-30T14:57:09.683 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:08.960+0000 7fba86d9d700 1 -- 172.21.15.72:0/4292827131 learned_addr learned my addr 172.21.15.72:0/4292827131 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:57:09.683 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:08.960+0000 7fba86d9d700 1 -- 172.21.15.72:0/4292827131 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba8819a3d0 con 0x7fba88106020 2024-03-30T14:57:09.684 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:08.960+0000 7fba86d9d700 1 --2- 172.21.15.72:0/4292827131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba88106020 0x7fba88199e90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fba70011910 tx=0x7fba700119f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:57:09.684 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:08.960+0000 7fba7ffff700 1 -- 172.21.15.72:0/4292827131 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba70003b20 con 0x7fba88106020 2024-03-30T14:57:09.684 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:08.960+0000 7fba7ffff700 1 -- 172.21.15.72:0/4292827131 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1011+0+0 (secure 0 0 0) 0x7fba7001a890 con 0x7fba88106020 2024-03-30T14:57:09.684 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:08.960+0000 7fba8d146700 1 -- 172.21.15.72:0/4292827131 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba8819a660 con 0x7fba88106020 2024-03-30T14:57:09.684 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:08.960+0000 7fba7ffff700 1 -- 172.21.15.72:0/4292827131 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba700197f0 con 0x7fba88106020 2024-03-30T14:57:09.684 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:08.960+0000 7fba8d146700 1 -- 172.21.15.72:0/4292827131 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba8819d350 con 0x7fba88106020 2024-03-30T14:57:09.684 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:08.964+0000 7fba7ffff700 1 -- 172.21.15.72:0/4292827131 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fba70022020 con 0x7fba88106020 2024-03-30T14:57:09.684 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:08.964+0000 7fba7ffff700 1 -- 172.21.15.72:0/4292827131 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fba7002c3a0 con 0x7fba88106020 2024-03-30T14:57:09.684 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:08.964+0000 7fba8d146700 1 -- 172.21.15.72:0/4292827131 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba68005150 con 0x7fba88106020 2024-03-30T14:57:09.684 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:08.964+0000 7fba7ffff700 1 -- 172.21.15.72:0/4292827131 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fba7001aa40 con 0x7fba88106020 2024-03-30T14:57:09.684 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:09.088+0000 7fba8d146700 1 -- 172.21.15.72:0/4292827131 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fba68005710 con 0x7fba88106020 2024-03-30T14:57:09.684 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:09.088+0000 7fba7ffff700 1 -- 172.21.15.72:0/4292827131 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7fba7001ad90 con 0x7fba88106020 2024-03-30T14:57:09.684 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:09.088+0000 7fba8d146700 1 -- 172.21.15.72:0/4292827131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba88106020 msgr2=0x7fba88199e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:57:09.684 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:09.092+0000 7fba8d146700 1 --2- 172.21.15.72:0/4292827131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba88106020 0x7fba88199e90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fba70011910 tx=0x7fba700119f0 comp rx=0 tx=0).stop 2024-03-30T14:57:09.684 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:09.092+0000 7fba8d146700 1 -- 172.21.15.72:0/4292827131 shutdown_connections 2024-03-30T14:57:09.685 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:09.092+0000 7fba8d146700 1 --2- 172.21.15.72:0/4292827131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba88106020 0x7fba88199e90 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:09.685 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:09.092+0000 7fba8d146700 1 -- 172.21.15.72:0/4292827131 >> 172.21.15.72:0/4292827131 conn(0x7fba88101600 msgr2=0x7fba881021b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:57:09.685 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:09.092+0000 7fba8d146700 1 -- 172.21.15.72:0/4292827131 shutdown_connections 2024-03-30T14:57:09.685 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:09.092+0000 7fba8d146700 1 -- 172.21.15.72:0/4292827131 wait complete. 2024-03-30T14:57:09.685 INFO:teuthology.orchestra.run.smithi072.stdout:Restarting the monitor... 2024-03-30T14:57:10.038 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:09 smithi072 systemd[1]: Stopping Ceph mon.a for 97f8e564-eea5-11ee-b647-cb9ed24678a4... 2024-03-30T14:57:10.038 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:09 smithi072 bash[21087]: debug 2024-03-30T14:57:09.796+0000 7f4c68871700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-03-30T14:57:10.038 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:09 smithi072 bash[21087]: debug 2024-03-30T14:57:09.796+0000 7f4c68871700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-03-30T14:57:10.711 INFO:teuthology.orchestra.run.smithi072.stdout:Setting public_network to 172.21.0.1/32,172.21.0.0/20,172.21.0.2/32,172.21.15.254/32 in mon config section 2024-03-30T14:57:10.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:10 smithi072 bash[21472]: ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4-mon-a 2024-03-30T14:57:10.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:10 smithi072 bash[21534]: Error response from daemon: No such container: ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4-mon-a 2024-03-30T14:57:10.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:10 smithi072 systemd[1]: ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@mon.a.service: Deactivated successfully. 2024-03-30T14:57:10.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:10 smithi072 systemd[1]: Stopped Ceph mon.a for 97f8e564-eea5-11ee-b647-cb9ed24678a4. 2024-03-30T14:57:10.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:10 smithi072 systemd[1]: Started Ceph mon.a for 97f8e564-eea5-11ee-b647-cb9ed24678a4. 2024-03-30T14:57:12.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.868+0000 7fbe64805c80 0 set uid:gid to 167:167 (ceph:ceph) 2024-03-30T14:57:12.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.868+0000 7fbe64805c80 0 ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev), process ceph-mon, pid 7 2024-03-30T14:57:12.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.868+0000 7fbe64805c80 0 pidfile_write: ignore empty --pid-file 2024-03-30T14:57:12.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 0 load: jerasure load: lrc 2024-03-30T14:57:12.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: RocksDB version: 7.9.2 2024-03-30T14:57:12.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Git sha 0 2024-03-30T14:57:12.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Compile date 2024-03-29 15:06:16 2024-03-30T14:57:12.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: DB SUMMARY 2024-03-30T14:57:12.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: DB Session ID: NG6V47L7G2VMJC9SU3MD 2024-03-30T14:57:12.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: CURRENT file: CURRENT 2024-03-30T14:57:12.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: IDENTITY file: IDENTITY 2024-03-30T14:57:12.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-03-30T14:57:12.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-03-30T14:57:12.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 90953 ; 2024-03-30T14:57:12.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.error_if_exists: 0 2024-03-30T14:57:12.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.create_if_missing: 0 2024-03-30T14:57:12.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.paranoid_checks: 1 2024-03-30T14:57:12.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.flush_verify_memtable_count: 1 2024-03-30T14:57:12.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-30T14:57:12.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-30T14:57:12.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.env: 0x5609a8192c60 2024-03-30T14:57:12.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.fs: PosixFileSystem 2024-03-30T14:57:12.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.info_log: 0x5609a8b45b20 2024-03-30T14:57:12.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.max_file_opening_threads: 16 2024-03-30T14:57:12.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.statistics: (nil) 2024-03-30T14:57:12.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.use_fsync: 0 2024-03-30T14:57:12.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.max_log_file_size: 0 2024-03-30T14:57:12.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-30T14:57:12.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.log_file_time_to_roll: 0 2024-03-30T14:57:12.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.keep_log_file_num: 1000 2024-03-30T14:57:12.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.recycle_log_file_num: 0 2024-03-30T14:57:12.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.allow_fallocate: 1 2024-03-30T14:57:12.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.allow_mmap_reads: 0 2024-03-30T14:57:12.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.allow_mmap_writes: 0 2024-03-30T14:57:12.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.use_direct_reads: 0 2024-03-30T14:57:12.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-30T14:57:12.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.create_missing_column_families: 0 2024-03-30T14:57:12.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.db_log_dir: 2024-03-30T14:57:12.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.wal_dir: 2024-03-30T14:57:12.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.table_cache_numshardbits: 6 2024-03-30T14:57:12.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-03-30T14:57:12.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-03-30T14:57:12.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-30T14:57:12.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-30T14:57:12.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-03-30T14:57:12.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.advise_random_on_open: 1 2024-03-30T14:57:12.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.db_write_buffer_size: 0 2024-03-30T14:57:12.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.write_buffer_manager: 0x5609a8b181e0 2024-03-30T14:57:12.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-30T14:57:12.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-30T14:57:12.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.use_adaptive_mutex: 0 2024-03-30T14:57:12.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.rate_limiter: (nil) 2024-03-30T14:57:12.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-30T14:57:12.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.wal_recovery_mode: 2 2024-03-30T14:57:12.173 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.enable_thread_tracking: 0 2024-03-30T14:57:12.173 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.enable_pipelined_write: 0 2024-03-30T14:57:12.173 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.unordered_write: 0 2024-03-30T14:57:12.173 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-30T14:57:12.174 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-30T14:57:12.174 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-30T14:57:12.174 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-30T14:57:12.174 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.row_cache: None 2024-03-30T14:57:12.174 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.wal_filter: None 2024-03-30T14:57:12.174 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-30T14:57:12.174 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.allow_ingest_behind: 0 2024-03-30T14:57:12.174 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.two_write_queues: 0 2024-03-30T14:57:12.174 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.manual_wal_flush: 0 2024-03-30T14:57:12.174 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.wal_compression: 0 2024-03-30T14:57:12.174 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.atomic_flush: 0 2024-03-30T14:57:12.174 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-30T14:57:12.174 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.persist_stats_to_disk: 0 2024-03-30T14:57:12.175 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-03-30T14:57:12.175 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.log_readahead_size: 0 2024-03-30T14:57:12.175 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-30T14:57:12.175 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.best_efforts_recovery: 0 2024-03-30T14:57:12.175 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-30T14:57:12.175 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-30T14:57:12.175 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.allow_data_in_errors: 0 2024-03-30T14:57:12.175 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.db_host_id: __hostname__ 2024-03-30T14:57:12.175 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.enforce_single_del_contracts: true 2024-03-30T14:57:12.175 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.max_background_jobs: 2 2024-03-30T14:57:12.175 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.max_background_compactions: -1 2024-03-30T14:57:12.175 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.max_subcompactions: 1 2024-03-30T14:57:12.175 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-30T14:57:12.175 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-30T14:57:12.176 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.delayed_write_rate : 16777216 2024-03-30T14:57:12.176 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.max_total_wal_size: 0 2024-03-30T14:57:12.176 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-30T14:57:12.176 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.stats_dump_period_sec: 600 2024-03-30T14:57:12.176 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.stats_persist_period_sec: 600 2024-03-30T14:57:12.176 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-30T14:57:12.176 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.max_open_files: -1 2024-03-30T14:57:12.176 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.bytes_per_sync: 0 2024-03-30T14:57:12.176 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-03-30T14:57:12.176 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-03-30T14:57:12.176 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.compaction_readahead_size: 0 2024-03-30T14:57:12.176 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.max_background_flushes: -1 2024-03-30T14:57:12.176 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Compression algorithms supported: 2024-03-30T14:57:12.176 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-30T14:57:12.176 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: kZSTD supported: 0 2024-03-30T14:57:12.177 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: kXpressCompression supported: 0 2024-03-30T14:57:12.177 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: kLZ4HCCompression supported: 1 2024-03-30T14:57:12.177 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: kZlibCompression supported: 1 2024-03-30T14:57:12.177 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: kSnappyCompression supported: 1 2024-03-30T14:57:12.177 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: kLZ4Compression supported: 1 2024-03-30T14:57:12.177 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: kBZip2Compression supported: 0 2024-03-30T14:57:12.177 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-03-30T14:57:12.177 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: DMutex implementation: pthread_mutex_t 2024-03-30T14:57:12.177 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-03-30T14:57:12.177 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-30T14:57:12.177 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-30T14:57:12.177 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.merge_operator: 2024-03-30T14:57:12.177 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.compaction_filter: None 2024-03-30T14:57:12.177 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.compaction_filter_factory: None 2024-03-30T14:57:12.178 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.sst_partitioner_factory: None 2024-03-30T14:57:12.178 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-03-30T14:57:12.178 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.table_factory: BlockBasedTable 2024-03-30T14:57:12.178 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5609a8b45c40) 2024-03-30T14:57:12.178 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: cache_index_and_filter_blocks: 1 2024-03-30T14:57:12.178 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-30T14:57:12.178 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-30T14:57:12.178 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: pin_top_level_index_and_filter: 1 2024-03-30T14:57:12.178 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: index_type: 0 2024-03-30T14:57:12.178 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: data_block_index_type: 0 2024-03-30T14:57:12.178 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: index_shortening: 1 2024-03-30T14:57:12.178 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: data_block_hash_table_util_ratio: 0.750000 2024-03-30T14:57:12.178 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: checksum: 4 2024-03-30T14:57:12.178 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: no_block_cache: 0 2024-03-30T14:57:12.178 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: block_cache: 0x5609a8b47090 2024-03-30T14:57:12.178 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: block_cache_name: BinnedLRUCache 2024-03-30T14:57:12.179 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: block_cache_options: 2024-03-30T14:57:12.179 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: capacity : 536870912 2024-03-30T14:57:12.179 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: num_shard_bits : 4 2024-03-30T14:57:12.179 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: strict_capacity_limit : 0 2024-03-30T14:57:12.179 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: high_pri_pool_ratio: 0.000 2024-03-30T14:57:12.179 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: block_cache_compressed: (nil) 2024-03-30T14:57:12.179 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: persistent_cache: (nil) 2024-03-30T14:57:12.179 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: block_size: 4096 2024-03-30T14:57:12.179 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: block_size_deviation: 10 2024-03-30T14:57:12.179 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: block_restart_interval: 16 2024-03-30T14:57:12.179 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: index_block_restart_interval: 1 2024-03-30T14:57:12.179 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: metadata_block_size: 4096 2024-03-30T14:57:12.179 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: partition_filters: 0 2024-03-30T14:57:12.179 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: use_delta_encoding: 1 2024-03-30T14:57:12.180 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: filter_policy: bloomfilter 2024-03-30T14:57:12.180 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: whole_key_filtering: 1 2024-03-30T14:57:12.180 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: verify_compression: 0 2024-03-30T14:57:12.180 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: read_amp_bytes_per_bit: 0 2024-03-30T14:57:12.180 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: format_version: 5 2024-03-30T14:57:12.180 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: enable_index_compression: 1 2024-03-30T14:57:12.180 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: block_align: 0 2024-03-30T14:57:12.180 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: max_auto_readahead_size: 262144 2024-03-30T14:57:12.180 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: prepopulate_block_cache: 0 2024-03-30T14:57:12.180 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: initial_auto_readahead_size: 8192 2024-03-30T14:57:12.180 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: num_file_reads_for_auto_readahead: 2 2024-03-30T14:57:12.180 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.write_buffer_size: 33554432 2024-03-30T14:57:12.180 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.max_write_buffer_number: 2 2024-03-30T14:57:12.180 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.compression: NoCompression 2024-03-30T14:57:12.180 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.bottommost_compression: Disabled 2024-03-30T14:57:12.181 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.prefix_extractor: nullptr 2024-03-30T14:57:12.181 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-30T14:57:12.181 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.num_levels: 7 2024-03-30T14:57:12.181 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-30T14:57:12.181 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-30T14:57:12.181 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-30T14:57:12.181 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-30T14:57:12.181 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-30T14:57:12.181 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-30T14:57:12.181 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-30T14:57:12.181 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-30T14:57:12.181 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-30T14:57:12.181 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-30T14:57:12.181 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-30T14:57:12.181 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-30T14:57:12.182 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.compression_opts.window_bits: -14 2024-03-30T14:57:12.182 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.compression_opts.level: 32767 2024-03-30T14:57:12.182 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.compression_opts.strategy: 0 2024-03-30T14:57:12.182 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-30T14:57:12.182 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-30T14:57:12.182 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-30T14:57:12.182 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-30T14:57:12.182 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.compression_opts.enabled: false 2024-03-30T14:57:12.182 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-30T14:57:12.182 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-30T14:57:12.182 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-30T14:57:12.182 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-30T14:57:12.182 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.target_file_size_base: 67108864 2024-03-30T14:57:12.182 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.target_file_size_multiplier: 1 2024-03-30T14:57:12.183 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-30T14:57:12.183 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-30T14:57:12.183 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-30T14:57:12.183 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-30T14:57:12.183 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-30T14:57:12.183 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-30T14:57:12.183 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-30T14:57:12.183 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-30T14:57:12.183 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-30T14:57:12.183 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-30T14:57:12.183 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-30T14:57:12.183 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-30T14:57:12.183 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-30T14:57:12.183 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.arena_block_size: 1048576 2024-03-30T14:57:12.184 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-30T14:57:12.184 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-30T14:57:12.184 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.disable_auto_compactions: 0 2024-03-30T14:57:12.184 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-30T14:57:12.184 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-30T14:57:12.184 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-30T14:57:12.184 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-30T14:57:12.184 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-30T14:57:12.184 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-30T14:57:12.184 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-30T14:57:12.184 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-30T14:57:12.184 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-30T14:57:12.184 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-30T14:57:12.184 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.table_properties_collectors: 2024-03-30T14:57:12.184 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.inplace_update_support: 0 2024-03-30T14:57:12.185 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-03-30T14:57:12.185 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-30T14:57:12.185 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-30T14:57:12.185 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.memtable_huge_page_size: 0 2024-03-30T14:57:12.185 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.bloom_locality: 0 2024-03-30T14:57:12.185 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.max_successive_merges: 0 2024-03-30T14:57:12.185 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-03-30T14:57:12.185 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.paranoid_file_checks: 0 2024-03-30T14:57:12.185 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.force_consistency_checks: 1 2024-03-30T14:57:12.185 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.report_bg_io_stats: 0 2024-03-30T14:57:12.185 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.ttl: 2592000 2024-03-30T14:57:12.185 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-03-30T14:57:12.185 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-30T14:57:12.185 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-30T14:57:12.185 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.enable_blob_files: false 2024-03-30T14:57:12.185 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.min_blob_size: 0 2024-03-30T14:57:12.186 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.blob_file_size: 268435456 2024-03-30T14:57:12.186 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.blob_compression_type: NoCompression 2024-03-30T14:57:12.186 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-03-30T14:57:12.186 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-30T14:57:12.186 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-30T14:57:12.186 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-30T14:57:12.186 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.blob_file_starting_level: 0 2024-03-30T14:57:12.186 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-30T14:57:12.186 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-03-30T14:57:12.186 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-03-30T14:57:12.186 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 745d64d4-7a77-434e-8b82-9b47e96ffa0d 2024-03-30T14:57:12.186 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1711810631880051, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-03-30T14:57:12.186 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.876+0000 7fbe64805c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-03-30T14:57:12.186 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.880+0000 7fbe64805c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1711810631881611, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 87341, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 268, "table_properties": {"data_size": 85499, "index_size": 252, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 10766, "raw_average_key_size": 47, "raw_value_size": 79409, "raw_average_value_size": 349, "num_data_blocks": 11, "num_entries": 227, "num_filter_entries": 227, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1711810631, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "745d64d4-7a77-434e-8b82-9b47e96ffa0d", "db_session_id": "NG6V47L7G2VMJC9SU3MD", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-03-30T14:57:12.187 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.880+0000 7fbe64805c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1711810631881735, "job": 1, "event": "recovery_finished"} 2024-03-30T14:57:12.187 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.880+0000 7fbe64805c80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-03-30T14:57:12.187 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.880+0000 7fbe64805c80 4 rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-30T14:57:12.187 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.880+0000 7fbe64805c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5609a8c3c000 2024-03-30T14:57:12.187 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.880+0000 7fbe64805c80 4 rocksdb: DB pointer 0x5609a8c26000 2024-03-30T14:57:12.187 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.880+0000 7fbe52f67700 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-30T14:57:12.187 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.880+0000 7fbe52f67700 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-30T14:57:12.187 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: ** DB Stats ** 2024-03-30T14:57:12.187 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: Uptime(secs): 0.0 total, 0.0 interval 2024-03-30T14:57:12.187 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-30T14:57:12.187 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-30T14:57:12.187 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-30T14:57:12.187 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-30T14:57:12.187 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-30T14:57:12.187 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-30T14:57:12.188 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: ** Compaction Stats [default] ** 2024-03-30T14:57:12.188 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-30T14:57:12.188 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-30T14:57:12.188 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: L0 2/0 87.13 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 88.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-30T14:57:12.188 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: Sum 2/0 87.13 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 88.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-30T14:57:12.188 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 88.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-30T14:57:12.188 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: ** Compaction Stats [default] ** 2024-03-30T14:57:12.188 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-30T14:57:12.188 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-30T14:57:12.188 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 88.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-30T14:57:12.188 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-30T14:57:12.188 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: Uptime(secs): 0.0 total, 0.0 interval 2024-03-30T14:57:12.188 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: Flush(GB): cumulative 0.000, interval 0.000 2024-03-30T14:57:12.188 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-30T14:57:12.188 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: AddFile(Total Files): cumulative 0, interval 0 2024-03-30T14:57:12.188 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: AddFile(L0 Files): cumulative 0, interval 0 2024-03-30T14:57:12.189 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: AddFile(Keys): cumulative 0, interval 0 2024-03-30T14:57:12.189 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: Cumulative compaction: 0.00 GB write, 16.37 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-30T14:57:12.189 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: Interval compaction: 0.00 GB write, 16.37 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-30T14:57:12.189 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-30T14:57:12.189 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: Block cache BinnedLRUCache@0x5609a8b47090#7 capacity: 512.00 MB usage: 1.20 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-03-30T14:57:12.189 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: Block cache entry stats(count,size,portion): FilterBlock(2,0.77 KB,0.000146031%) IndexBlock(2,0.44 KB,8.34465e-05%) Misc(1,0.00 KB,0%) 2024-03-30T14:57:12.189 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: ** File Read Latency Histogram By Level [default] ** 2024-03-30T14:57:12.189 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.880+0000 7fbe64805c80 0 starting mon.a rank 0 at public addrs [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] at bind addrs [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 2024-03-30T14:57:12.189 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.884+0000 7fbe64805c80 1 mon.a@-1(???) e1 preinit fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 2024-03-30T14:57:12.189 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.884+0000 7fbe64805c80 0 mon.a@-1(???).mds e1 new map 2024-03-30T14:57:12.189 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.884+0000 7fbe64805c80 0 mon.a@-1(???).mds e1 print_map 2024-03-30T14:57:12.189 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: e1 2024-03-30T14:57:12.189 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: enable_multiple, ever_enabled_multiple: 1,1 2024-03-30T14:57:12.189 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-03-30T14:57:12.190 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: legacy client fscid: -1 2024-03-30T14:57:12.190 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: 2024-03-30T14:57:12.190 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: No filesystems configured 2024-03-30T14:57:12.190 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.884+0000 7fbe64805c80 0 mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-03-30T14:57:12.190 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.884+0000 7fbe64805c80 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-30T14:57:12.190 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.884+0000 7fbe64805c80 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-30T14:57:12.190 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.884+0000 7fbe64805c80 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-30T14:57:12.190 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: debug 2024-03-30T14:57:11.884+0000 7fbe64805c80 1 mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-03-30T14:57:12.190 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: cluster 2024-03-30T14:57:11.909706+0000 mon.a (mon.0) 1 : cluster 1 mon.a is new leader, mons a in quorum (ranks 0) 2024-03-30T14:57:12.190 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: cluster 2024-03-30T14:57:11.909838+0000 mon.a (mon.0) 2 : cluster 0 monmap epoch 1 2024-03-30T14:57:12.190 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: cluster 2024-03-30T14:57:11.909859+0000 mon.a (mon.0) 3 : cluster 0 fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 2024-03-30T14:57:12.190 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: cluster 2024-03-30T14:57:11.909879+0000 mon.a (mon.0) 4 : cluster 0 last_changed 2024-03-30T14:57:00.883324+0000 2024-03-30T14:57:12.190 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: cluster 2024-03-30T14:57:11.909897+0000 mon.a (mon.0) 5 : cluster 0 created 2024-03-30T14:57:00.883324+0000 2024-03-30T14:57:12.190 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: cluster 2024-03-30T14:57:11.909924+0000 mon.a (mon.0) 6 : cluster 0 min_mon_release 19 (squid) 2024-03-30T14:57:12.190 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: cluster 2024-03-30T14:57:11.909943+0000 mon.a (mon.0) 7 : cluster 0 election_strategy: 1 2024-03-30T14:57:12.191 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: cluster 2024-03-30T14:57:11.909968+0000 mon.a (mon.0) 8 : cluster 0 0: [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] mon.a 2024-03-30T14:57:12.191 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: cluster 2024-03-30T14:57:11.910624+0000 mon.a (mon.0) 9 : cluster 0 fsmap 2024-03-30T14:57:12.191 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: cluster 2024-03-30T14:57:11.910676+0000 mon.a (mon.0) 10 : cluster 0 osdmap e1: 0 total, 0 up, 0 in 2024-03-30T14:57:12.191 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:11 smithi072 bash[21573]: cluster 2024-03-30T14:57:11.911277+0000 mon.a (mon.0) 11 : cluster 0 mgrmap e1: no daemons active 2024-03-30T14:57:12.902 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:12.024+0000 7fa6ac4b9700 1 Processor -- start 2024-03-30T14:57:12.906 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:12.024+0000 7fa6ac4b9700 1 -- start start 2024-03-30T14:57:12.906 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:12.024+0000 7fa6ac4b9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6a4106b60 0x7fa6a4108f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:12.906 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:12.024+0000 7fa6ac4b9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a4079630 con 0x7fa6a4106b60 2024-03-30T14:57:12.906 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:12.024+0000 7fa6aa255700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6a4106b60 0x7fa6a4108f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:57:12.906 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:12.024+0000 7fa6aa255700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6a4106b60 0x7fa6a4108f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59344/0 (socket says 172.21.15.72:59344) 2024-03-30T14:57:12.906 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:12.024+0000 7fa6aa255700 1 -- 172.21.15.72:0/3543461933 learned_addr learned my addr 172.21.15.72:0/3543461933 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:57:12.906 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:12.024+0000 7fa6aa255700 1 -- 172.21.15.72:0/3543461933 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6a4109490 con 0x7fa6a4106b60 2024-03-30T14:57:12.906 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:12.024+0000 7fa6aa255700 1 --2- 172.21.15.72:0/3543461933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6a4106b60 0x7fa6a4108f50 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa69c009e80 tx=0x7fa69c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9da7baba673e19d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:57:12.910 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:12.024+0000 7fa6a9253700 1 -- 172.21.15.72:0/3543461933 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa69c017070 con 0x7fa6a4106b60 2024-03-30T14:57:12.910 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:12.024+0000 7fa6a9253700 1 -- 172.21.15.72:0/3543461933 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1011+0+0 (secure 0 0 0) 0x7fa69c00b8c0 con 0x7fa6a4106b60 2024-03-30T14:57:12.910 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:12.024+0000 7fa6a9253700 1 -- 172.21.15.72:0/3543461933 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa69c004370 con 0x7fa6a4106b60 2024-03-30T14:57:12.910 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:12.024+0000 7fa6ac4b9700 1 -- 172.21.15.72:0/3543461933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6a4106b60 msgr2=0x7fa6a4108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:57:12.910 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:12.024+0000 7fa6ac4b9700 1 --2- 172.21.15.72:0/3543461933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6a4106b60 0x7fa6a4108f50 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa69c009e80 tx=0x7fa69c00b330 comp rx=0 tx=0).stop 2024-03-30T14:57:12.910 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:12.024+0000 7fa6ac4b9700 1 -- 172.21.15.72:0/3543461933 shutdown_connections 2024-03-30T14:57:12.910 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:12.024+0000 7fa6ac4b9700 1 --2- 172.21.15.72:0/3543461933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6a4106b60 0x7fa6a4108f50 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:12.910 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:12.024+0000 7fa6ac4b9700 1 -- 172.21.15.72:0/3543461933 >> 172.21.15.72:0/3543461933 conn(0x7fa6a41004f0 msgr2=0x7fa6a4102910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:57:12.911 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:12.024+0000 7fa6ac4b9700 1 -- 172.21.15.72:0/3543461933 shutdown_connections 2024-03-30T14:57:12.911 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:12.024+0000 7fa6ac4b9700 1 -- 172.21.15.72:0/3543461933 wait complete. 2024-03-30T14:57:12.911 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:12.024+0000 7fa6ac4b9700 1 Processor -- start 2024-03-30T14:57:12.911 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:12.024+0000 7fa6ac4b9700 1 -- start start 2024-03-30T14:57:12.911 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:12.024+0000 7fa6ac4b9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6a4106b60 0x7fa6a419bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:12.911 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:12.024+0000 7fa6ac4b9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a410a260 con 0x7fa6a4106b60 2024-03-30T14:57:12.911 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:12.024+0000 7fa6aa255700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6a4106b60 0x7fa6a419bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:57:12.911 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:12.024+0000 7fa6aa255700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6a4106b60 0x7fa6a419bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59346/0 (socket says 172.21.15.72:59346) 2024-03-30T14:57:12.911 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:12.024+0000 7fa6aa255700 1 -- 172.21.15.72:0/1080262393 learned_addr learned my addr 172.21.15.72:0/1080262393 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:57:12.911 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:12.028+0000 7fa6aa255700 1 -- 172.21.15.72:0/1080262393 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6a419c4c0 con 0x7fa6a4106b60 2024-03-30T14:57:12.911 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:12.028+0000 7fa6aa255700 1 --2- 172.21.15.72:0/1080262393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6a4106b60 0x7fa6a419bf80 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fa69c004000 tx=0x7fa69c003c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:57:12.911 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:12.028+0000 7fa69b7fe700 1 -- 172.21.15.72:0/1080262393 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa69c021020 con 0x7fa6a4106b60 2024-03-30T14:57:12.911 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:12.028+0000 7fa69b7fe700 1 -- 172.21.15.72:0/1080262393 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1011+0+0 (secure 0 0 0) 0x7fa69c00bde0 con 0x7fa6a4106b60 2024-03-30T14:57:12.911 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:12.028+0000 7fa6ac4b9700 1 -- 172.21.15.72:0/1080262393 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6a419c750 con 0x7fa6a4106b60 2024-03-30T14:57:12.912 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:12.028+0000 7fa69b7fe700 1 -- 172.21.15.72:0/1080262393 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa69c017040 con 0x7fa6a4106b60 2024-03-30T14:57:12.912 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:12.028+0000 7fa6ac4b9700 1 -- 172.21.15.72:0/1080262393 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6a419f440 con 0x7fa6a4106b60 2024-03-30T14:57:12.912 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:12.028+0000 7fa69b7fe700 1 -- 172.21.15.72:0/1080262393 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa69c024020 con 0x7fa6a4106b60 2024-03-30T14:57:12.912 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:12.028+0000 7fa69b7fe700 1 -- 172.21.15.72:0/1080262393 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa69c00f050 con 0x7fa6a4106b60 2024-03-30T14:57:12.912 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:12.028+0000 7fa6ac4b9700 1 -- 172.21.15.72:0/1080262393 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6a4063870 con 0x7fa6a4106b60 2024-03-30T14:57:12.912 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:12.028+0000 7fa69b7fe700 1 -- 172.21.15.72:0/1080262393 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fa69c02b020 con 0x7fa6a4106b60 2024-03-30T14:57:12.912 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:12.152+0000 7fa6ac4b9700 1 -- 172.21.15.72:0/1080262393 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7fa6a419f790 con 0x7fa6a4106b60 2024-03-30T14:57:12.912 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:12.152+0000 7fa69b7fe700 1 -- 172.21.15.72:0/1080262393 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 169+0+0 (secure 0 0 0) 0x7fa69c01dad0 con 0x7fa6a4106b60 2024-03-30T14:57:12.912 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:12.156+0000 7fa6ac4b9700 1 -- 172.21.15.72:0/1080262393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6a4106b60 msgr2=0x7fa6a419bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:57:12.912 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:12.156+0000 7fa6ac4b9700 1 --2- 172.21.15.72:0/1080262393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6a4106b60 0x7fa6a419bf80 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fa69c004000 tx=0x7fa69c003c50 comp rx=0 tx=0).stop 2024-03-30T14:57:12.912 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:12.156+0000 7fa6ac4b9700 1 -- 172.21.15.72:0/1080262393 shutdown_connections 2024-03-30T14:57:12.912 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:12.156+0000 7fa6ac4b9700 1 --2- 172.21.15.72:0/1080262393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6a4106b60 0x7fa6a419bf80 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:12.912 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:12.156+0000 7fa6ac4b9700 1 -- 172.21.15.72:0/1080262393 >> 172.21.15.72:0/1080262393 conn(0x7fa6a41004f0 msgr2=0x7fa6a4100f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:57:12.912 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:12.156+0000 7fa6ac4b9700 1 -- 172.21.15.72:0/1080262393 shutdown_connections 2024-03-30T14:57:12.913 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:12.156+0000 7fa6ac4b9700 1 -- 172.21.15.72:0/1080262393 wait complete. 2024-03-30T14:57:12.913 INFO:teuthology.orchestra.run.smithi072.stdout:Wrote config to /etc/ceph/ceph.conf 2024-03-30T14:57:12.936 INFO:teuthology.orchestra.run.smithi072.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-03-30T14:57:12.937 INFO:teuthology.orchestra.run.smithi072.stdout:Creating mgr... 2024-03-30T14:57:12.937 INFO:teuthology.orchestra.run.smithi072.stdout:Verifying port 0.0.0.0:9283 ... 2024-03-30T14:57:12.937 INFO:teuthology.orchestra.run.smithi072.stdout:Verifying port 0.0.0.0:8765 ... 2024-03-30T14:57:13.245 INFO:teuthology.orchestra.run.smithi072.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@mgr.y 2024-03-30T14:57:13.245 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stderr Failed to reset failed state of unit ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@mgr.y.service: Unit ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@mgr.y.service not loaded. 2024-03-30T14:57:13.355 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:13 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T14:57:13.355 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:13 smithi072 bash[21573]: audit 2024-03-30T14:57:12.156024+0000 mon.a (mon.0) 12 : audit 1 from='client.? 172.21.15.72:0/1080262393' entity='client.admin' 2024-03-30T14:57:13.442 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4.target.wants/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@mgr.y.service -> /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service. 2024-03-30T14:57:13.451 INFO:teuthology.orchestra.run.smithi072.stdout:firewalld does not appear to be present 2024-03-30T14:57:13.451 INFO:teuthology.orchestra.run.smithi072.stdout:Not possible to enable service . firewalld.service is not available 2024-03-30T14:57:13.452 INFO:teuthology.orchestra.run.smithi072.stdout:firewalld does not appear to be present 2024-03-30T14:57:13.452 INFO:teuthology.orchestra.run.smithi072.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-03-30T14:57:13.452 INFO:teuthology.orchestra.run.smithi072.stdout:Waiting for mgr to start... 2024-03-30T14:57:13.452 INFO:teuthology.orchestra.run.smithi072.stdout:Waiting for mgr... 2024-03-30T14:57:13.670 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:13 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T14:57:15.300 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:15 smithi072 bash[21573]: audit 2024-03-30T14:57:15.089024+0000 mon.a (mon.0) 13 : audit 0 from='client.? 172.21.15.72:0/4116668407' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-30T14:57:15.301 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:14 smithi072 bash[21828]: debug 2024-03-30T14:57:14.956+0000 7fd91fdce200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-30T14:57:15.773 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 2024-03-30T14:57:15.774 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout { 2024-03-30T14:57:15.774 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "fsid": "97f8e564-eea5-11ee-b647-cb9ed24678a4", 2024-03-30T14:57:15.774 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "health": { 2024-03-30T14:57:15.774 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-30T14:57:15.774 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-30T14:57:15.774 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-30T14:57:15.774 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-30T14:57:15.774 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-30T14:57:15.774 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-30T14:57:15.774 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 0 2024-03-30T14:57:15.774 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout ], 2024-03-30T14:57:15.774 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-30T14:57:15.774 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "a" 2024-03-30T14:57:15.774 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout ], 2024-03-30T14:57:15.775 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-03-30T14:57:15.775 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-30T14:57:15.775 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-30T14:57:15.775 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-03-30T14:57:15.775 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-30T14:57:15.775 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-30T14:57:15.776 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-30T14:57:15.776 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-30T14:57:15.777 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-30T14:57:15.777 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-30T14:57:15.777 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-30T14:57:15.777 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-30T14:57:15.777 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-30T14:57:15.777 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-30T14:57:15.777 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-30T14:57:15.777 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-30T14:57:15.783 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-30T14:57:15.783 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-30T14:57:15.783 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-30T14:57:15.783 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-30T14:57:15.783 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-30T14:57:15.783 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-30T14:57:15.784 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-30T14:57:15.784 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-30T14:57:15.784 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-30T14:57:15.784 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-30T14:57:15.784 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-30T14:57:15.784 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-30T14:57:15.784 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-30T14:57:15.784 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-30T14:57:15.784 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-30T14:57:15.784 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "available": false, 2024-03-30T14:57:15.784 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-30T14:57:15.784 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-30T14:57:15.784 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-30T14:57:15.784 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-30T14:57:15.784 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "restful" 2024-03-30T14:57:15.785 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout ], 2024-03-30T14:57:15.785 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-30T14:57:15.785 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-30T14:57:15.785 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-30T14:57:15.785 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-30T14:57:15.785 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "modified": "2024-03-30T14:57:05.374783+0000", 2024-03-30T14:57:15.785 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-30T14:57:15.785 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-30T14:57:15.785 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-30T14:57:15.785 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout } 2024-03-30T14:57:15.785 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:14.940+0000 7f2a09e90700 1 Processor -- start 2024-03-30T14:57:15.785 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:14.940+0000 7f2a09e90700 1 -- start start 2024-03-30T14:57:15.786 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:14.940+0000 7f2a09e90700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a04104900 0x7f2a04104d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:15.786 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:14.940+0000 7f2a09e90700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2a04079670 con 0x7f2a04104900 2024-03-30T14:57:15.786 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:14.940+0000 7f2a037fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a04104900 0x7f2a04104d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:57:15.786 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:14.940+0000 7f2a037fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a04104900 0x7f2a04104d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59368/0 (socket says 172.21.15.72:59368) 2024-03-30T14:57:15.786 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:14.940+0000 7f2a037fe700 1 -- 172.21.15.72:0/2967605228 learned_addr learned my addr 172.21.15.72:0/2967605228 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:57:15.787 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:14.940+0000 7f2a037fe700 1 -- 172.21.15.72:0/2967605228 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a04105260 con 0x7f2a04104900 2024-03-30T14:57:15.787 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:14.940+0000 7f2a037fe700 1 --2- 172.21.15.72:0/2967605228 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a04104900 0x7f2a04104d20 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f29f40098a0 tx=0x7f29f4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d444c7680def4649 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:57:15.787 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:14.940+0000 7f2a027fc700 1 -- 172.21.15.72:0/2967605228 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29f4004160 con 0x7f2a04104900 2024-03-30T14:57:15.787 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:14.940+0000 7f2a027fc700 1 -- 172.21.15.72:0/2967605228 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1011+0+0 (secure 0 0 0) 0x7f29f4004300 con 0x7f2a04104900 2024-03-30T14:57:15.787 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:14.940+0000 7f2a027fc700 1 -- 172.21.15.72:0/2967605228 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29f4011940 con 0x7f2a04104900 2024-03-30T14:57:15.787 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:14.940+0000 7f2a09e90700 1 -- 172.21.15.72:0/2967605228 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a04104900 msgr2=0x7f2a04104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:57:15.787 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:14.940+0000 7f2a09e90700 1 --2- 172.21.15.72:0/2967605228 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a04104900 0x7f2a04104d20 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f29f40098a0 tx=0x7f29f4009bb0 comp rx=0 tx=0).stop 2024-03-30T14:57:15.788 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:14.940+0000 7f2a09e90700 1 -- 172.21.15.72:0/2967605228 shutdown_connections 2024-03-30T14:57:15.788 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:14.940+0000 7f2a09e90700 1 --2- 172.21.15.72:0/2967605228 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a04104900 0x7f2a04104d20 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:15.788 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:14.940+0000 7f2a09e90700 1 -- 172.21.15.72:0/2967605228 >> 172.21.15.72:0/2967605228 conn(0x7f2a04100540 msgr2=0x7f2a04102960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:57:15.788 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:14.940+0000 7f2a09e90700 1 -- 172.21.15.72:0/2967605228 shutdown_connections 2024-03-30T14:57:15.788 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:14.940+0000 7f2a09e90700 1 -- 172.21.15.72:0/2967605228 wait complete. 2024-03-30T14:57:15.788 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:14.940+0000 7f2a09e90700 1 Processor -- start 2024-03-30T14:57:15.788 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:14.940+0000 7f2a09e90700 1 -- start start 2024-03-30T14:57:15.788 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:14.940+0000 7f2a09e90700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a04104900 0x7f2a0419bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:15.788 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:14.940+0000 7f2a09e90700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2a04106160 con 0x7f2a04104900 2024-03-30T14:57:15.788 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:14.940+0000 7f2a037fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a04104900 0x7f2a0419bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:57:15.788 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:14.940+0000 7f2a037fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a04104900 0x7f2a0419bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59380/0 (socket says 172.21.15.72:59380) 2024-03-30T14:57:15.788 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:14.940+0000 7f2a037fe700 1 -- 172.21.15.72:0/4116668407 learned_addr learned my addr 172.21.15.72:0/4116668407 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:57:15.788 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:14.940+0000 7f2a037fe700 1 -- 172.21.15.72:0/4116668407 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a0419c500 con 0x7f2a04104900 2024-03-30T14:57:15.788 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:14.940+0000 7f2a037fe700 1 --2- 172.21.15.72:0/4116668407 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a04104900 0x7f2a0419bfc0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f29f4003e40 tx=0x7f29f40119c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:57:15.789 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:14.944+0000 7f2a00ff9700 1 -- 172.21.15.72:0/4116668407 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29f4003b20 con 0x7f2a04104900 2024-03-30T14:57:15.789 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:14.944+0000 7f2a00ff9700 1 -- 172.21.15.72:0/4116668407 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1011+0+0 (secure 0 0 0) 0x7f29f401a890 con 0x7f2a04104900 2024-03-30T14:57:15.793 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:14.944+0000 7f2a09e90700 1 -- 172.21.15.72:0/4116668407 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a0419c790 con 0x7f2a04104900 2024-03-30T14:57:15.793 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:14.944+0000 7f2a00ff9700 1 -- 172.21.15.72:0/4116668407 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29f4024890 con 0x7f2a04104900 2024-03-30T14:57:15.793 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:14.944+0000 7f2a09e90700 1 -- 172.21.15.72:0/4116668407 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a0419f480 con 0x7f2a04104900 2024-03-30T14:57:15.793 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:14.944+0000 7f2a00ff9700 1 -- 172.21.15.72:0/4116668407 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f29f4022020 con 0x7f2a04104900 2024-03-30T14:57:15.794 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:14.944+0000 7f2a00ff9700 1 -- 172.21.15.72:0/4116668407 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f29f40193c0 con 0x7f2a04104900 2024-03-30T14:57:15.794 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:14.944+0000 7f2a09e90700 1 -- 172.21.15.72:0/4116668407 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a04063870 con 0x7f2a04104900 2024-03-30T14:57:15.794 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:14.944+0000 7f2a00ff9700 1 -- 172.21.15.72:0/4116668407 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f29f401aa40 con 0x7f2a04104900 2024-03-30T14:57:15.794 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:15.084+0000 7f2a09e90700 1 -- 172.21.15.72:0/4116668407 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f2a0402dbd0 con 0x7f2a04104900 2024-03-30T14:57:15.794 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:15.088+0000 7f2a00ff9700 1 -- 172.21.15.72:0/4116668407 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f29f401ad90 con 0x7f2a04104900 2024-03-30T14:57:15.794 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:15.088+0000 7f2a09e90700 1 -- 172.21.15.72:0/4116668407 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a04104900 msgr2=0x7f2a0419bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:57:15.794 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:15.088+0000 7f2a09e90700 1 --2- 172.21.15.72:0/4116668407 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a04104900 0x7f2a0419bfc0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f29f4003e40 tx=0x7f29f40119c0 comp rx=0 tx=0).stop 2024-03-30T14:57:15.794 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:15.088+0000 7f2a09e90700 1 -- 172.21.15.72:0/4116668407 shutdown_connections 2024-03-30T14:57:15.794 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:15.088+0000 7f2a09e90700 1 --2- 172.21.15.72:0/4116668407 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a04104900 0x7f2a0419bfc0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:15.794 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:15.088+0000 7f2a09e90700 1 -- 172.21.15.72:0/4116668407 >> 172.21.15.72:0/4116668407 conn(0x7f2a04100540 msgr2=0x7f2a04192cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:57:15.794 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:15.088+0000 7f2a09e90700 1 -- 172.21.15.72:0/4116668407 shutdown_connections 2024-03-30T14:57:15.794 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:15.088+0000 7f2a09e90700 1 -- 172.21.15.72:0/4116668407 wait complete. 2024-03-30T14:57:15.794 INFO:teuthology.orchestra.run.smithi072.stdout:mgr not available, waiting (1/15)... 2024-03-30T14:57:16.870 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:16 smithi072 bash[21828]: debug 2024-03-30T14:57:16.531+0000 7fd91fdce200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-30T14:57:16.870 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:16 smithi072 bash[21828]: debug 2024-03-30T14:57:16.623+0000 7fd91fdce200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-30T14:57:16.870 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:16 smithi072 bash[21828]: debug 2024-03-30T14:57:16.867+0000 7fd91fdce200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-30T14:57:17.920 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:17 smithi072 bash[21828]: debug 2024-03-30T14:57:17.651+0000 7fd91fdce200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-30T14:57:17.920 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:17 smithi072 bash[21828]: debug 2024-03-30T14:57:17.759+0000 7fd91fdce200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-30T14:57:17.920 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:17 smithi072 bash[21828]: debug 2024-03-30T14:57:17.863+0000 7fd91fdce200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-30T14:57:18.638 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:18 smithi072 bash[21828]: debug 2024-03-30T14:57:18.211+0000 7fd91fdce200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-30T14:57:18.638 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:18 smithi072 bash[21828]: debug 2024-03-30T14:57:18.323+0000 7fd91fdce200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-30T14:57:18.638 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:18 smithi072 bash[21828]: debug 2024-03-30T14:57:18.427+0000 7fd91fdce200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-30T14:57:18.920 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:18 smithi072 bash[21828]: debug 2024-03-30T14:57:18.787+0000 7fd91fdce200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-30T14:57:19.291 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:19 smithi072 bash[21573]: audit 2024-03-30T14:57:18.968422+0000 mon.a (mon.0) 14 : audit 0 from='client.? 172.21.15.72:0/1103337436' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-30T14:57:19.291 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:19 smithi072 bash[21828]: debug 2024-03-30T14:57:19.031+0000 7fd91fdce200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-30T14:57:19.569 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 2024-03-30T14:57:19.570 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout { 2024-03-30T14:57:19.570 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "fsid": "97f8e564-eea5-11ee-b647-cb9ed24678a4", 2024-03-30T14:57:19.570 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "health": { 2024-03-30T14:57:19.570 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-30T14:57:19.570 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-30T14:57:19.570 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-30T14:57:19.570 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-30T14:57:19.570 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-30T14:57:19.570 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-30T14:57:19.570 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 0 2024-03-30T14:57:19.570 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout ], 2024-03-30T14:57:19.571 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-30T14:57:19.571 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "a" 2024-03-30T14:57:19.571 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout ], 2024-03-30T14:57:19.571 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-03-30T14:57:19.571 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-30T14:57:19.571 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-30T14:57:19.571 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-03-30T14:57:19.571 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-30T14:57:19.571 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-30T14:57:19.571 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-30T14:57:19.572 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-30T14:57:19.572 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-30T14:57:19.572 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-30T14:57:19.572 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-30T14:57:19.581 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-30T14:57:19.581 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-30T14:57:19.581 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-30T14:57:19.581 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-30T14:57:19.582 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-30T14:57:19.582 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-30T14:57:19.582 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-30T14:57:19.582 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-30T14:57:19.582 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-30T14:57:19.582 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-30T14:57:19.582 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-30T14:57:19.582 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-30T14:57:19.582 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-30T14:57:19.582 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-30T14:57:19.582 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-30T14:57:19.582 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-30T14:57:19.582 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-30T14:57:19.582 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-30T14:57:19.583 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-30T14:57:19.583 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-30T14:57:19.583 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "available": false, 2024-03-30T14:57:19.583 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-30T14:57:19.583 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-30T14:57:19.583 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-30T14:57:19.583 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-30T14:57:19.583 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "restful" 2024-03-30T14:57:19.583 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout ], 2024-03-30T14:57:19.583 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-30T14:57:19.583 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-30T14:57:19.583 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-30T14:57:19.583 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-30T14:57:19.583 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "modified": "2024-03-30T14:57:05.374783+0000", 2024-03-30T14:57:19.584 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-30T14:57:19.584 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-30T14:57:19.584 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-30T14:57:19.584 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout } 2024-03-30T14:57:19.584 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:18.819+0000 7f6f28332700 1 Processor -- start 2024-03-30T14:57:19.584 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:18.819+0000 7f6f28332700 1 -- start start 2024-03-30T14:57:19.584 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:18.819+0000 7f6f28332700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f20104f30 0x7f6f20105350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:19.584 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:18.819+0000 7f6f28332700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6f20105890 con 0x7f6f20104f30 2024-03-30T14:57:19.584 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:18.819+0000 7f6f260ce700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f20104f30 0x7f6f20105350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:57:19.584 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:18.819+0000 7f6f260ce700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f20104f30 0x7f6f20105350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51174/0 (socket says 172.21.15.72:51174) 2024-03-30T14:57:19.584 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:18.819+0000 7f6f260ce700 1 -- 172.21.15.72:0/4221504493 learned_addr learned my addr 172.21.15.72:0/4221504493 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:57:19.584 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:18.819+0000 7f6f260ce700 1 -- 172.21.15.72:0/4221504493 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f20106090 con 0x7f6f20104f30 2024-03-30T14:57:19.584 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:18.819+0000 7f6f260ce700 1 --2- 172.21.15.72:0/4221504493 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f20104f30 0x7f6f20105350 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c0098a0 tx=0x7f6f1c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e77b1dcb69d97ee7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:57:19.584 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:18.819+0000 7f6f250cc700 1 -- 172.21.15.72:0/4221504493 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f1c004160 con 0x7f6f20104f30 2024-03-30T14:57:19.585 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:18.819+0000 7f6f250cc700 1 -- 172.21.15.72:0/4221504493 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1011+0+0 (secure 0 0 0) 0x7f6f1c004300 con 0x7f6f20104f30 2024-03-30T14:57:19.585 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:18.819+0000 7f6f250cc700 1 -- 172.21.15.72:0/4221504493 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f1c011940 con 0x7f6f20104f30 2024-03-30T14:57:19.585 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:18.823+0000 7f6f28332700 1 -- 172.21.15.72:0/4221504493 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f20104f30 msgr2=0x7f6f20105350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:57:19.585 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:18.823+0000 7f6f28332700 1 --2- 172.21.15.72:0/4221504493 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f20104f30 0x7f6f20105350 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c0098a0 tx=0x7f6f1c009bb0 comp rx=0 tx=0).stop 2024-03-30T14:57:19.585 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:18.823+0000 7f6f28332700 1 -- 172.21.15.72:0/4221504493 shutdown_connections 2024-03-30T14:57:19.585 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:18.823+0000 7f6f28332700 1 --2- 172.21.15.72:0/4221504493 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f20104f30 0x7f6f20105350 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:19.585 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:18.823+0000 7f6f28332700 1 -- 172.21.15.72:0/4221504493 >> 172.21.15.72:0/4221504493 conn(0x7f6f201004f0 msgr2=0x7f6f20102910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:57:19.585 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:18.823+0000 7f6f28332700 1 -- 172.21.15.72:0/4221504493 shutdown_connections 2024-03-30T14:57:19.585 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:18.823+0000 7f6f28332700 1 -- 172.21.15.72:0/4221504493 wait complete. 2024-03-30T14:57:19.585 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:18.823+0000 7f6f28332700 1 Processor -- start 2024-03-30T14:57:19.585 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:18.823+0000 7f6f28332700 1 -- start start 2024-03-30T14:57:19.585 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:18.823+0000 7f6f28332700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f20104f30 0x7f6f20078a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:19.585 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:18.823+0000 7f6f28332700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6f20109350 con 0x7f6f20104f30 2024-03-30T14:57:19.585 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:18.823+0000 7f6f260ce700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f20104f30 0x7f6f20078a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:57:19.586 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:18.823+0000 7f6f260ce700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f20104f30 0x7f6f20078a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51178/0 (socket says 172.21.15.72:51178) 2024-03-30T14:57:19.586 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:18.823+0000 7f6f260ce700 1 -- 172.21.15.72:0/1103337436 learned_addr learned my addr 172.21.15.72:0/1103337436 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:57:19.586 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:18.823+0000 7f6f260ce700 1 -- 172.21.15.72:0/1103337436 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f2019cb20 con 0x7f6f20104f30 2024-03-30T14:57:19.586 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:18.823+0000 7f6f260ce700 1 --2- 172.21.15.72:0/1103337436 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f20104f30 0x7f6f20078a80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c009870 tx=0x7f6f1c0119c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:57:19.586 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:18.823+0000 7f6f177fe700 1 -- 172.21.15.72:0/1103337436 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f1c01a430 con 0x7f6f20104f30 2024-03-30T14:57:19.586 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:18.823+0000 7f6f177fe700 1 -- 172.21.15.72:0/1103337436 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1011+0+0 (secure 0 0 0) 0x7f6f1c01aa30 con 0x7f6f20104f30 2024-03-30T14:57:19.586 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:18.823+0000 7f6f177fe700 1 -- 172.21.15.72:0/1103337436 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f1c0248d0 con 0x7f6f20104f30 2024-03-30T14:57:19.586 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:18.823+0000 7f6f28332700 1 -- 172.21.15.72:0/1103337436 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f2019ccf0 con 0x7f6f20104f30 2024-03-30T14:57:19.587 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:18.823+0000 7f6f28332700 1 -- 172.21.15.72:0/1103337436 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f2019d110 con 0x7f6f20104f30 2024-03-30T14:57:19.587 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:18.823+0000 7f6f177fe700 1 -- 172.21.15.72:0/1103337436 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6f1c022020 con 0x7f6f20104f30 2024-03-30T14:57:19.587 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:18.823+0000 7f6f177fe700 1 -- 172.21.15.72:0/1103337436 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6f1c02ddd0 con 0x7f6f20104f30 2024-03-30T14:57:19.587 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:18.823+0000 7f6f28332700 1 -- 172.21.15.72:0/1103337436 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f20063870 con 0x7f6f20104f30 2024-03-30T14:57:19.587 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:18.827+0000 7f6f177fe700 1 -- 172.21.15.72:0/1103337436 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f6f1c004300 con 0x7f6f20104f30 2024-03-30T14:57:19.587 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:18.963+0000 7f6f28332700 1 -- 172.21.15.72:0/1103337436 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f6f2019d6a0 con 0x7f6f20104f30 2024-03-30T14:57:19.587 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:18.963+0000 7f6f177fe700 1 -- 172.21.15.72:0/1103337436 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f6f1c01abe0 con 0x7f6f20104f30 2024-03-30T14:57:19.587 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:18.967+0000 7f6f28332700 1 -- 172.21.15.72:0/1103337436 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f20104f30 msgr2=0x7f6f20078a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:57:19.587 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:18.967+0000 7f6f28332700 1 --2- 172.21.15.72:0/1103337436 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f20104f30 0x7f6f20078a80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c009870 tx=0x7f6f1c0119c0 comp rx=0 tx=0).stop 2024-03-30T14:57:19.587 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:18.967+0000 7f6f28332700 1 -- 172.21.15.72:0/1103337436 shutdown_connections 2024-03-30T14:57:19.587 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:18.967+0000 7f6f28332700 1 --2- 172.21.15.72:0/1103337436 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f20104f30 0x7f6f20078a80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:19.587 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:18.967+0000 7f6f28332700 1 -- 172.21.15.72:0/1103337436 >> 172.21.15.72:0/1103337436 conn(0x7f6f201004f0 msgr2=0x7f6f20100f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:57:19.587 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:18.967+0000 7f6f28332700 1 -- 172.21.15.72:0/1103337436 shutdown_connections 2024-03-30T14:57:19.587 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:18.967+0000 7f6f28332700 1 -- 172.21.15.72:0/1103337436 wait complete. 2024-03-30T14:57:19.587 INFO:teuthology.orchestra.run.smithi072.stdout:mgr not available, waiting (2/15)... 2024-03-30T14:57:19.670 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:19 smithi072 bash[21828]: debug 2024-03-30T14:57:19.287+0000 7fd91fdce200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-30T14:57:19.671 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:19 smithi072 bash[21828]: debug 2024-03-30T14:57:19.399+0000 7fd91fdce200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-30T14:57:20.076 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:19 smithi072 bash[21828]: debug 2024-03-30T14:57:19.671+0000 7fd91fdce200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-30T14:57:20.420 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:20 smithi072 bash[21828]: debug 2024-03-30T14:57:20.075+0000 7fd91fdce200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-30T14:57:20.420 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:20 smithi072 bash[21828]: debug 2024-03-30T14:57:20.307+0000 7fd91fdce200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-30T14:57:20.920 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:20 smithi072 bash[21828]: debug 2024-03-30T14:57:20.423+0000 7fd91fdce200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-30T14:57:20.920 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:20 smithi072 bash[21828]: debug 2024-03-30T14:57:20.663+0000 7fd91fdce200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-30T14:57:21.920 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:21 smithi072 bash[21828]: debug 2024-03-30T14:57:21.651+0000 7fd91fdce200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-30T14:57:21.920 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:21 smithi072 bash[21828]: debug 2024-03-30T14:57:21.763+0000 7fd91fdce200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-30T14:57:22.327 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:22 smithi072 bash[21828]: debug 2024-03-30T14:57:22.051+0000 7fd91fdce200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-30T14:57:22.328 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:22 smithi072 bash[21828]: debug 2024-03-30T14:57:22.163+0000 7fd91fdce200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-30T14:57:22.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:22 smithi072 bash[21573]: audit 2024-03-30T14:57:22.661223+0000 mon.a (mon.0) 15 : audit 0 from='client.? 172.21.15.72:0/362976909' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-30T14:57:22.921 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:22 smithi072 bash[21828]: debug 2024-03-30T14:57:22.627+0000 7fd91fdce200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-30T14:57:22.921 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:22 smithi072 bash[21828]: debug 2024-03-30T14:57:22.751+0000 7fd91fdce200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-30T14:57:23.214 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 2024-03-30T14:57:23.215 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout { 2024-03-30T14:57:23.215 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "fsid": "97f8e564-eea5-11ee-b647-cb9ed24678a4", 2024-03-30T14:57:23.215 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "health": { 2024-03-30T14:57:23.215 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-30T14:57:23.215 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-30T14:57:23.215 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-30T14:57:23.215 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-30T14:57:23.215 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-30T14:57:23.215 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-30T14:57:23.215 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 0 2024-03-30T14:57:23.217 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout ], 2024-03-30T14:57:23.217 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-30T14:57:23.217 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "a" 2024-03-30T14:57:23.217 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout ], 2024-03-30T14:57:23.217 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-03-30T14:57:23.217 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-30T14:57:23.217 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-30T14:57:23.217 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-03-30T14:57:23.218 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-30T14:57:23.218 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-30T14:57:23.218 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-30T14:57:23.218 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-30T14:57:23.218 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-30T14:57:23.218 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-30T14:57:23.218 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-30T14:57:23.225 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-30T14:57:23.225 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-30T14:57:23.225 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-30T14:57:23.225 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-30T14:57:23.225 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-30T14:57:23.225 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-30T14:57:23.225 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-30T14:57:23.225 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-30T14:57:23.225 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-30T14:57:23.225 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-30T14:57:23.226 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-30T14:57:23.226 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-30T14:57:23.226 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-30T14:57:23.226 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-30T14:57:23.226 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-30T14:57:23.226 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-30T14:57:23.226 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-30T14:57:23.226 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-30T14:57:23.226 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-30T14:57:23.226 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-30T14:57:23.227 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "available": false, 2024-03-30T14:57:23.227 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-30T14:57:23.227 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-30T14:57:23.227 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-30T14:57:23.227 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-30T14:57:23.227 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "restful" 2024-03-30T14:57:23.227 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout ], 2024-03-30T14:57:23.227 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-30T14:57:23.227 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-30T14:57:23.227 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-30T14:57:23.227 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-30T14:57:23.228 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "modified": "2024-03-30T14:57:05.374783+0000", 2024-03-30T14:57:23.228 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-30T14:57:23.228 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-30T14:57:23.228 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-30T14:57:23.228 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout } 2024-03-30T14:57:23.228 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:22.523+0000 7f8d839c1700 1 Processor -- start 2024-03-30T14:57:23.228 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:22.523+0000 7f8d839c1700 1 -- start start 2024-03-30T14:57:23.228 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:22.523+0000 7f8d839c1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d7c104910 0x7f8d7c104d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:23.228 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:22.523+0000 7f8d839c1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7c078e00 con 0x7f8d7c104910 2024-03-30T14:57:23.228 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:22.523+0000 7f8d8175d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d7c104910 0x7f8d7c104d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:57:23.228 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:22.523+0000 7f8d8175d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d7c104910 0x7f8d7c104d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51180/0 (socket says 172.21.15.72:51180) 2024-03-30T14:57:23.228 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:22.523+0000 7f8d8175d700 1 -- 172.21.15.72:0/3452361615 learned_addr learned my addr 172.21.15.72:0/3452361615 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:57:23.228 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:22.523+0000 7f8d8175d700 1 -- 172.21.15.72:0/3452361615 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d7c105270 con 0x7f8d7c104910 2024-03-30T14:57:23.228 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:22.523+0000 7f8d8175d700 1 --2- 172.21.15.72:0/3452361615 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d7c104910 0x7f8d7c104d30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8d780098a0 tx=0x7f8d78009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad20ed4764f2ebf2 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:57:23.228 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:22.523+0000 7f8d73fff700 1 -- 172.21.15.72:0/3452361615 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d78004160 con 0x7f8d7c104910 2024-03-30T14:57:23.229 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:22.523+0000 7f8d73fff700 1 -- 172.21.15.72:0/3452361615 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1011+0+0 (secure 0 0 0) 0x7f8d78004300 con 0x7f8d7c104910 2024-03-30T14:57:23.229 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:22.523+0000 7f8d73fff700 1 -- 172.21.15.72:0/3452361615 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d78011940 con 0x7f8d7c104910 2024-03-30T14:57:23.229 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:22.523+0000 7f8d839c1700 1 -- 172.21.15.72:0/3452361615 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d7c104910 msgr2=0x7f8d7c104d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:57:23.229 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:22.523+0000 7f8d839c1700 1 --2- 172.21.15.72:0/3452361615 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d7c104910 0x7f8d7c104d30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8d780098a0 tx=0x7f8d78009bb0 comp rx=0 tx=0).stop 2024-03-30T14:57:23.229 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:22.523+0000 7f8d839c1700 1 -- 172.21.15.72:0/3452361615 shutdown_connections 2024-03-30T14:57:23.229 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:22.523+0000 7f8d839c1700 1 --2- 172.21.15.72:0/3452361615 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d7c104910 0x7f8d7c104d30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:23.229 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:22.523+0000 7f8d839c1700 1 -- 172.21.15.72:0/3452361615 >> 172.21.15.72:0/3452361615 conn(0x7f8d7c1004f0 msgr2=0x7f8d7c102910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:57:23.229 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:22.523+0000 7f8d839c1700 1 -- 172.21.15.72:0/3452361615 shutdown_connections 2024-03-30T14:57:23.230 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:22.523+0000 7f8d839c1700 1 -- 172.21.15.72:0/3452361615 wait complete. 2024-03-30T14:57:23.230 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:22.523+0000 7f8d839c1700 1 Processor -- start 2024-03-30T14:57:23.230 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:22.523+0000 7f8d839c1700 1 -- start start 2024-03-30T14:57:23.230 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:22.523+0000 7f8d839c1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d7c104910 0x7f8d7c19c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:23.230 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:22.523+0000 7f8d839c1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7c106170 con 0x7f8d7c104910 2024-03-30T14:57:23.230 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:22.523+0000 7f8d8175d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d7c104910 0x7f8d7c19c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:57:23.230 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:22.523+0000 7f8d8175d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d7c104910 0x7f8d7c19c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51192/0 (socket says 172.21.15.72:51192) 2024-03-30T14:57:23.230 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:22.523+0000 7f8d8175d700 1 -- 172.21.15.72:0/362976909 learned_addr learned my addr 172.21.15.72:0/362976909 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:57:23.230 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:22.527+0000 7f8d8175d700 1 -- 172.21.15.72:0/362976909 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d7c19c550 con 0x7f8d7c104910 2024-03-30T14:57:23.230 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:22.527+0000 7f8d8175d700 1 --2- 172.21.15.72:0/362976909 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d7c104910 0x7f8d7c19c010 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8d78009870 tx=0x7f8d780119c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:57:23.231 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:22.527+0000 7f8d727fc700 1 -- 172.21.15.72:0/362976909 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d7801a430 con 0x7f8d7c104910 2024-03-30T14:57:23.231 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:22.527+0000 7f8d839c1700 1 -- 172.21.15.72:0/362976909 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d7c19c7e0 con 0x7f8d7c104910 2024-03-30T14:57:23.231 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:22.527+0000 7f8d727fc700 1 -- 172.21.15.72:0/362976909 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1011+0+0 (secure 0 0 0) 0x7f8d7801aa30 con 0x7f8d7c104910 2024-03-30T14:57:23.231 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:22.527+0000 7f8d839c1700 1 -- 172.21.15.72:0/362976909 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d7c19f4d0 con 0x7f8d7c104910 2024-03-30T14:57:23.231 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:22.527+0000 7f8d727fc700 1 -- 172.21.15.72:0/362976909 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d780248d0 con 0x7f8d7c104910 2024-03-30T14:57:23.231 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:22.527+0000 7f8d727fc700 1 -- 172.21.15.72:0/362976909 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8d78022020 con 0x7f8d7c104910 2024-03-30T14:57:23.231 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:22.527+0000 7f8d727fc700 1 -- 172.21.15.72:0/362976909 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8d780193c0 con 0x7f8d7c104910 2024-03-30T14:57:23.231 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:22.527+0000 7f8d839c1700 1 -- 172.21.15.72:0/362976909 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d7c063870 con 0x7f8d7c104910 2024-03-30T14:57:23.231 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:22.527+0000 7f8d727fc700 1 -- 172.21.15.72:0/362976909 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f8d78004300 con 0x7f8d7c104910 2024-03-30T14:57:23.231 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:22.655+0000 7f8d839c1700 1 -- 172.21.15.72:0/362976909 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f8d7c02db30 con 0x7f8d7c104910 2024-03-30T14:57:23.232 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:22.659+0000 7f8d727fc700 1 -- 172.21.15.72:0/362976909 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1240 (secure 0 0 0) 0x7f8d7801abe0 con 0x7f8d7c104910 2024-03-30T14:57:23.233 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:22.659+0000 7f8d839c1700 1 -- 172.21.15.72:0/362976909 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d7c104910 msgr2=0x7f8d7c19c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:57:23.233 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:22.659+0000 7f8d839c1700 1 --2- 172.21.15.72:0/362976909 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d7c104910 0x7f8d7c19c010 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8d78009870 tx=0x7f8d780119c0 comp rx=0 tx=0).stop 2024-03-30T14:57:23.233 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:22.659+0000 7f8d839c1700 1 -- 172.21.15.72:0/362976909 shutdown_connections 2024-03-30T14:57:23.233 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:22.659+0000 7f8d839c1700 1 --2- 172.21.15.72:0/362976909 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d7c104910 0x7f8d7c19c010 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:23.233 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:22.659+0000 7f8d839c1700 1 -- 172.21.15.72:0/362976909 >> 172.21.15.72:0/362976909 conn(0x7f8d7c1004f0 msgr2=0x7f8d7c192cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:57:23.233 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:22.659+0000 7f8d839c1700 1 -- 172.21.15.72:0/362976909 shutdown_connections 2024-03-30T14:57:23.233 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:22.659+0000 7f8d839c1700 1 -- 172.21.15.72:0/362976909 wait complete. 2024-03-30T14:57:23.233 INFO:teuthology.orchestra.run.smithi072.stdout:mgr not available, waiting (3/15)... 2024-03-30T14:57:24.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:23 smithi072 bash[21573]: cluster 2024-03-30T14:57:22.755209+0000 mon.a (mon.0) 16 : cluster 1 Activating manager daemon y 2024-03-30T14:57:24.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:23 smithi072 bash[21573]: cluster 2024-03-30T14:57:22.758355+0000 mon.a (mon.0) 17 : cluster 0 mgrmap e2: y(active, starting, since 0.00327831s) 2024-03-30T14:57:24.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:23 smithi072 bash[21573]: audit 2024-03-30T14:57:22.759490+0000 mon.a (mon.0) 18 : audit 0 from='mgr.14100 172.21.15.72:0/1373939604' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-30T14:57:24.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:23 smithi072 bash[21573]: audit 2024-03-30T14:57:22.759608+0000 mon.a (mon.0) 19 : audit 0 from='mgr.14100 172.21.15.72:0/1373939604' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-30T14:57:24.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:23 smithi072 bash[21573]: audit 2024-03-30T14:57:22.759717+0000 mon.a (mon.0) 20 : audit 0 from='mgr.14100 172.21.15.72:0/1373939604' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-30T14:57:24.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:23 smithi072 bash[21573]: audit 2024-03-30T14:57:22.759824+0000 mon.a (mon.0) 21 : audit 0 from='mgr.14100 172.21.15.72:0/1373939604' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T14:57:24.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:23 smithi072 bash[21573]: audit 2024-03-30T14:57:22.760338+0000 mon.a (mon.0) 22 : audit 0 from='mgr.14100 172.21.15.72:0/1373939604' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-30T14:57:24.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:23 smithi072 bash[21573]: cluster 2024-03-30T14:57:22.782851+0000 mon.a (mon.0) 23 : cluster 1 Manager daemon y is now available 2024-03-30T14:57:24.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:23 smithi072 bash[21573]: audit 2024-03-30T14:57:22.795653+0000 mon.a (mon.0) 24 : audit 1 from='mgr.14100 172.21.15.72:0/1373939604' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T14:57:24.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:23 smithi072 bash[21573]: audit 2024-03-30T14:57:22.798134+0000 mon.a (mon.0) 25 : audit 1 from='mgr.14100 172.21.15.72:0/1373939604' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T14:57:24.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:23 smithi072 bash[21573]: audit 2024-03-30T14:57:22.804015+0000 mon.a (mon.0) 26 : audit 1 from='mgr.14100 172.21.15.72:0/1373939604' entity='mgr.y' 2024-03-30T14:57:24.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:23 smithi072 bash[21573]: audit 2024-03-30T14:57:22.810097+0000 mon.a (mon.0) 27 : audit 1 from='mgr.14100 172.21.15.72:0/1373939604' entity='mgr.y' 2024-03-30T14:57:24.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:23 smithi072 bash[21573]: audit 2024-03-30T14:57:22.815135+0000 mon.a (mon.0) 28 : audit 1 from='mgr.14100 172.21.15.72:0/1373939604' entity='mgr.y' 2024-03-30T14:57:25.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:24 smithi072 bash[21573]: cluster 2024-03-30T14:57:23.768533+0000 mon.a (mon.0) 29 : cluster 0 mgrmap e3: y(active, since 1.01343s) 2024-03-30T14:57:27.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:26 smithi072 bash[21573]: cluster 2024-03-30T14:57:25.767922+0000 mon.a (mon.0) 30 : cluster 0 mgrmap e4: y(active, since 3s) 2024-03-30T14:57:27.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:26 smithi072 bash[21573]: audit 2024-03-30T14:57:26.670137+0000 mon.a (mon.0) 31 : audit 0 from='client.? 172.21.15.72:0/1263940103' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-30T14:57:27.291 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 2024-03-30T14:57:27.291 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout { 2024-03-30T14:57:27.292 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "fsid": "97f8e564-eea5-11ee-b647-cb9ed24678a4", 2024-03-30T14:57:27.292 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "health": { 2024-03-30T14:57:27.292 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-30T14:57:27.292 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-30T14:57:27.292 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-30T14:57:27.292 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-30T14:57:27.292 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-30T14:57:27.292 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-30T14:57:27.292 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 0 2024-03-30T14:57:27.292 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout ], 2024-03-30T14:57:27.292 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-30T14:57:27.292 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "a" 2024-03-30T14:57:27.292 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout ], 2024-03-30T14:57:27.293 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "quorum_age": 14, 2024-03-30T14:57:27.293 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-30T14:57:27.293 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-30T14:57:27.293 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-03-30T14:57:27.293 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-30T14:57:27.293 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-30T14:57:27.293 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-30T14:57:27.293 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-30T14:57:27.293 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-30T14:57:27.293 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-30T14:57:27.293 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-30T14:57:27.293 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-30T14:57:27.293 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-30T14:57:27.293 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-30T14:57:27.293 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-30T14:57:27.294 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-30T14:57:27.294 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-30T14:57:27.294 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-30T14:57:27.294 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-30T14:57:27.294 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-30T14:57:27.294 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-30T14:57:27.294 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-30T14:57:27.294 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-30T14:57:27.294 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-30T14:57:27.294 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-30T14:57:27.294 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-30T14:57:27.294 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-30T14:57:27.294 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-30T14:57:27.295 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-30T14:57:27.295 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-30T14:57:27.295 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-30T14:57:27.295 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-30T14:57:27.295 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-30T14:57:27.295 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-30T14:57:27.295 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-30T14:57:27.295 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-30T14:57:27.295 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "restful" 2024-03-30T14:57:27.295 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout ], 2024-03-30T14:57:27.295 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-30T14:57:27.295 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-30T14:57:27.295 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-30T14:57:27.296 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-30T14:57:27.296 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "modified": "2024-03-30T14:57:05.374783+0000", 2024-03-30T14:57:27.296 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-30T14:57:27.296 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-30T14:57:27.296 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-30T14:57:27.296 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout } 2024-03-30T14:57:27.296 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.147+0000 7f7ac4854700 1 Processor -- start 2024-03-30T14:57:27.296 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.147+0000 7f7ac4854700 1 -- start start 2024-03-30T14:57:27.296 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.147+0000 7f7ac4854700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ac010c950 0x7f7ac010cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:27.296 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.147+0000 7f7ac4854700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac010d360 con 0x7f7ac010c950 2024-03-30T14:57:27.296 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.147+0000 7f7abe59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ac010c950 0x7f7ac010cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:57:27.296 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.147+0000 7f7abe59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ac010c950 0x7f7ac010cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51264/0 (socket says 172.21.15.72:51264) 2024-03-30T14:57:27.296 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.147+0000 7f7abe59c700 1 -- 172.21.15.72:0/698813287 learned_addr learned my addr 172.21.15.72:0/698813287 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:57:27.296 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.147+0000 7f7abe59c700 1 -- 172.21.15.72:0/698813287 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ac010d840 con 0x7f7ac010c950 2024-03-30T14:57:27.297 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.147+0000 7f7abe59c700 1 --2- 172.21.15.72:0/698813287 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ac010c950 0x7f7ac010cd70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7ab00098a0 tx=0x7f7ab0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2009cb59c5e43888 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:57:27.297 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.147+0000 7f7abd59a700 1 -- 172.21.15.72:0/698813287 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ab0004160 con 0x7f7ac010c950 2024-03-30T14:57:27.297 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.151+0000 7f7abd59a700 1 -- 172.21.15.72:0/698813287 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1011+0+0 (secure 0 0 0) 0x7f7ab0004300 con 0x7f7ac010c950 2024-03-30T14:57:27.297 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.151+0000 7f7abd59a700 1 -- 172.21.15.72:0/698813287 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ab0011940 con 0x7f7ac010c950 2024-03-30T14:57:27.297 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.151+0000 7f7ac4854700 1 -- 172.21.15.72:0/698813287 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ac010c950 msgr2=0x7f7ac010cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:57:27.297 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.151+0000 7f7ac4854700 1 --2- 172.21.15.72:0/698813287 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ac010c950 0x7f7ac010cd70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7ab00098a0 tx=0x7f7ab0009bb0 comp rx=0 tx=0).stop 2024-03-30T14:57:27.297 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.151+0000 7f7ac4854700 1 -- 172.21.15.72:0/698813287 shutdown_connections 2024-03-30T14:57:27.297 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.151+0000 7f7ac4854700 1 --2- 172.21.15.72:0/698813287 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ac010c950 0x7f7ac010cd70 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:27.297 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.151+0000 7f7ac4854700 1 -- 172.21.15.72:0/698813287 >> 172.21.15.72:0/698813287 conn(0x7f7ac007b610 msgr2=0x7f7ac007da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:57:27.297 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.151+0000 7f7ac4854700 1 -- 172.21.15.72:0/698813287 shutdown_connections 2024-03-30T14:57:27.297 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.151+0000 7f7ac4854700 1 -- 172.21.15.72:0/698813287 wait complete. 2024-03-30T14:57:27.297 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.151+0000 7f7ac4854700 1 Processor -- start 2024-03-30T14:57:27.297 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.151+0000 7f7ac4854700 1 -- start start 2024-03-30T14:57:27.297 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.151+0000 7f7ac4854700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ac010c950 0x7f7ac01a0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:27.298 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.151+0000 7f7ac4854700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac0110a70 con 0x7f7ac010c950 2024-03-30T14:57:27.298 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.151+0000 7f7abe59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ac010c950 0x7f7ac01a0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:57:27.298 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.151+0000 7f7abe59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ac010c950 0x7f7ac01a0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51272/0 (socket says 172.21.15.72:51272) 2024-03-30T14:57:27.298 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.151+0000 7f7abe59c700 1 -- 172.21.15.72:0/1263940103 learned_addr learned my addr 172.21.15.72:0/1263940103 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:57:27.298 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.151+0000 7f7abe59c700 1 -- 172.21.15.72:0/1263940103 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ac01a09a0 con 0x7f7ac010c950 2024-03-30T14:57:27.298 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.151+0000 7f7abe59c700 1 --2- 172.21.15.72:0/1263940103 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ac010c950 0x7f7ac01a0460 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0006ba0 tx=0x7f7ab00119c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:57:27.298 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.151+0000 7f7ab77fe700 1 -- 172.21.15.72:0/1263940103 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ab0003930 con 0x7f7ac010c950 2024-03-30T14:57:27.298 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.151+0000 7f7ab77fe700 1 -- 172.21.15.72:0/1263940103 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1011+0+0 (secure 0 0 0) 0x7f7ab0003ad0 con 0x7f7ac010c950 2024-03-30T14:57:27.298 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.151+0000 7f7ac4854700 1 -- 172.21.15.72:0/1263940103 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ac01a0c30 con 0x7f7ac010c950 2024-03-30T14:57:27.298 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.151+0000 7f7ab77fe700 1 -- 172.21.15.72:0/1263940103 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ab0019750 con 0x7f7ac010c950 2024-03-30T14:57:27.298 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.151+0000 7f7ac4854700 1 -- 172.21.15.72:0/1263940103 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ac01a3920 con 0x7f7ac010c950 2024-03-30T14:57:27.299 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.151+0000 7f7ab77fe700 1 -- 172.21.15.72:0/1263940103 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) ==== 46105+0+0 (secure 0 0 0) 0x7f7ab00199c0 con 0x7f7ac010c950 2024-03-30T14:57:27.299 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.155+0000 7f7ab77fe700 1 --2- 172.21.15.72:0/1263940103 >> [v2:172.21.15.72:6800/1939732211,v1:172.21.15.72:6801/1939732211] conn(0x7f7aac038db0 0x7f7aac03b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:27.299 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.155+0000 7f7ab77fe700 1 -- 172.21.15.72:0/1263940103 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7ab004d4f0 con 0x7f7ac010c950 2024-03-30T14:57:27.299 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.155+0000 7f7abdd9b700 1 --2- 172.21.15.72:0/1263940103 >> [v2:172.21.15.72:6800/1939732211,v1:172.21.15.72:6801/1939732211] conn(0x7f7aac038db0 0x7f7aac03b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:57:27.299 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.155+0000 7f7ac4854700 1 -- 172.21.15.72:0/1263940103 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ac0110bf0 con 0x7f7ac010c950 2024-03-30T14:57:27.299 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.155+0000 7f7abdd9b700 1 --2- 172.21.15.72:0/1263940103 >> [v2:172.21.15.72:6800/1939732211,v1:172.21.15.72:6801/1939732211] conn(0x7f7aac038db0 0x7f7aac03b270 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8006fd0 tx=0x7f7aa8006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:57:27.299 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.159+0000 7f7ab77fe700 1 -- 172.21.15.72:0/1263940103 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f7ab001abe0 con 0x7f7ac010c950 2024-03-30T14:57:27.299 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.667+0000 7f7ac4854700 1 -- 172.21.15.72:0/1263940103 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f7ac01a3c30 con 0x7f7ac010c950 2024-03-30T14:57:27.299 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.667+0000 7f7ab77fe700 1 -- 172.21.15.72:0/1263940103 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f7ab0032020 con 0x7f7ac010c950 2024-03-30T14:57:27.299 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.671+0000 7f7ac4854700 1 -- 172.21.15.72:0/1263940103 >> [v2:172.21.15.72:6800/1939732211,v1:172.21.15.72:6801/1939732211] conn(0x7f7aac038db0 msgr2=0x7f7aac03b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:57:27.299 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.671+0000 7f7ac4854700 1 --2- 172.21.15.72:0/1263940103 >> [v2:172.21.15.72:6800/1939732211,v1:172.21.15.72:6801/1939732211] conn(0x7f7aac038db0 0x7f7aac03b270 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8006fd0 tx=0x7f7aa8006e40 comp rx=0 tx=0).stop 2024-03-30T14:57:27.299 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.671+0000 7f7ac4854700 1 -- 172.21.15.72:0/1263940103 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ac010c950 msgr2=0x7f7ac01a0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:57:27.299 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.671+0000 7f7ac4854700 1 --2- 172.21.15.72:0/1263940103 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ac010c950 0x7f7ac01a0460 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0006ba0 tx=0x7f7ab00119c0 comp rx=0 tx=0).stop 2024-03-30T14:57:27.300 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.671+0000 7f7ac4854700 1 -- 172.21.15.72:0/1263940103 shutdown_connections 2024-03-30T14:57:27.300 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.671+0000 7f7ac4854700 1 --2- 172.21.15.72:0/1263940103 >> [v2:172.21.15.72:6800/1939732211,v1:172.21.15.72:6801/1939732211] conn(0x7f7aac038db0 0x7f7aac03b270 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:27.300 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.671+0000 7f7ac4854700 1 --2- 172.21.15.72:0/1263940103 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ac010c950 0x7f7ac01a0460 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:27.300 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.671+0000 7f7ac4854700 1 -- 172.21.15.72:0/1263940103 >> 172.21.15.72:0/1263940103 conn(0x7f7ac007b610 msgr2=0x7f7ac007c190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:57:27.300 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.671+0000 7f7ac4854700 1 -- 172.21.15.72:0/1263940103 shutdown_connections 2024-03-30T14:57:27.300 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:26.671+0000 7f7ac4854700 1 -- 172.21.15.72:0/1263940103 wait complete. 2024-03-30T14:57:27.300 INFO:teuthology.orchestra.run.smithi072.stdout:mgr is available 2024-03-30T14:57:28.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:28 smithi072 bash[21573]: audit 2024-03-30T14:57:28.538019+0000 mon.a (mon.0) 32 : audit 1 from='client.? 172.21.15.72:0/2585732034' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-03-30T14:57:29.153 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 2024-03-30T14:57:29.153 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout [global] 2024-03-30T14:57:29.153 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout fsid = 97f8e564-eea5-11ee-b647-cb9ed24678a4 2024-03-30T14:57:29.153 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-03-30T14:57:29.153 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-03-30T14:57:29.153 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-03-30T14:57:29.153 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-03-30T14:57:29.153 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 2024-03-30T14:57:29.153 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout [mgr] 2024-03-30T14:57:29.154 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-03-30T14:57:29.154 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 2024-03-30T14:57:29.154 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout [osd] 2024-03-30T14:57:29.154 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-03-30T14:57:29.154 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-03-30T14:57:29.154 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.167+0000 7f7b79008700 1 Processor -- start 2024-03-30T14:57:29.154 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.167+0000 7f7b79008700 1 -- start start 2024-03-30T14:57:29.154 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.167+0000 7f7b79008700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b7407b740 0x7f7b74079ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:29.154 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.167+0000 7f7b79008700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7b7407a170 con 0x7f7b7407b740 2024-03-30T14:57:29.154 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.167+0000 7f7b72d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b7407b740 0x7f7b74079ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:57:29.154 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.167+0000 7f7b72d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b7407b740 0x7f7b74079ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58852/0 (socket says 172.21.15.72:58852) 2024-03-30T14:57:29.154 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.167+0000 7f7b72d9d700 1 -- 172.21.15.72:0/3573093352 learned_addr learned my addr 172.21.15.72:0/3573093352 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:57:29.154 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.167+0000 7f7b72d9d700 1 -- 172.21.15.72:0/3573093352 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b7407a2f0 con 0x7f7b7407b740 2024-03-30T14:57:29.155 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.167+0000 7f7b72d9d700 1 --2- 172.21.15.72:0/3573093352 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b7407b740 0x7f7b74079ba0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7b64009e80 tx=0x7f7b6400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25978177e50c3ce6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:57:29.155 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.167+0000 7f7b71d9b700 1 -- 172.21.15.72:0/3573093352 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b64017070 con 0x7f7b7407b740 2024-03-30T14:57:29.155 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.167+0000 7f7b71d9b700 1 -- 172.21.15.72:0/3573093352 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1011+0+0 (secure 0 0 0) 0x7f7b6400b8c0 con 0x7f7b7407b740 2024-03-30T14:57:29.155 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.167+0000 7f7b71d9b700 1 -- 172.21.15.72:0/3573093352 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b64004370 con 0x7f7b7407b740 2024-03-30T14:57:29.155 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.171+0000 7f7b79008700 1 -- 172.21.15.72:0/3573093352 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b7407b740 msgr2=0x7f7b74079ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:57:29.155 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.171+0000 7f7b79008700 1 --2- 172.21.15.72:0/3573093352 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b7407b740 0x7f7b74079ba0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7b64009e80 tx=0x7f7b6400b330 comp rx=0 tx=0).stop 2024-03-30T14:57:29.155 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.171+0000 7f7b79008700 1 -- 172.21.15.72:0/3573093352 shutdown_connections 2024-03-30T14:57:29.155 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.171+0000 7f7b79008700 1 --2- 172.21.15.72:0/3573093352 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b7407b740 0x7f7b74079ba0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:29.155 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.171+0000 7f7b79008700 1 -- 172.21.15.72:0/3573093352 >> 172.21.15.72:0/3573093352 conn(0x7f7b74101600 msgr2=0x7f7b74103a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:57:29.155 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.171+0000 7f7b79008700 1 -- 172.21.15.72:0/3573093352 shutdown_connections 2024-03-30T14:57:29.155 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.171+0000 7f7b79008700 1 -- 172.21.15.72:0/3573093352 wait complete. 2024-03-30T14:57:29.155 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.171+0000 7f7b79008700 1 Processor -- start 2024-03-30T14:57:29.155 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.171+0000 7f7b79008700 1 -- start start 2024-03-30T14:57:29.155 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.171+0000 7f7b79008700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b7407b740 0x7f7b741a03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:29.156 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.171+0000 7f7b79008700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7b74108090 con 0x7f7b7407b740 2024-03-30T14:57:29.156 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.171+0000 7f7b72d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b7407b740 0x7f7b741a03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:57:29.156 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.171+0000 7f7b72d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b7407b740 0x7f7b741a03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58868/0 (socket says 172.21.15.72:58868) 2024-03-30T14:57:29.156 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.171+0000 7f7b72d9d700 1 -- 172.21.15.72:0/2585732034 learned_addr learned my addr 172.21.15.72:0/2585732034 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:57:29.156 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.171+0000 7f7b72d9d700 1 -- 172.21.15.72:0/2585732034 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b741a0930 con 0x7f7b7407b740 2024-03-30T14:57:29.156 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.171+0000 7f7b72d9d700 1 --2- 172.21.15.72:0/2585732034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b7407b740 0x7f7b741a03f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7b64004000 tx=0x7f7b64003c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:57:29.156 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.171+0000 7f7b6bfff700 1 -- 172.21.15.72:0/2585732034 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b64020020 con 0x7f7b7407b740 2024-03-30T14:57:29.156 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.171+0000 7f7b6bfff700 1 -- 172.21.15.72:0/2585732034 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1011+0+0 (secure 0 0 0) 0x7f7b64012890 con 0x7f7b7407b740 2024-03-30T14:57:29.156 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.171+0000 7f7b79008700 1 -- 172.21.15.72:0/2585732034 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b741a0bc0 con 0x7f7b7407b740 2024-03-30T14:57:29.156 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.171+0000 7f7b6bfff700 1 -- 172.21.15.72:0/2585732034 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b64017040 con 0x7f7b7407b740 2024-03-30T14:57:29.156 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.171+0000 7f7b79008700 1 -- 172.21.15.72:0/2585732034 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b741a38b0 con 0x7f7b7407b740 2024-03-30T14:57:29.156 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.171+0000 7f7b6bfff700 1 -- 172.21.15.72:0/2585732034 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) ==== 46105+0+0 (secure 0 0 0) 0x7f7b64023020 con 0x7f7b7407b740 2024-03-30T14:57:29.156 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.171+0000 7f7b6bfff700 1 --2- 172.21.15.72:0/2585732034 >> [v2:172.21.15.72:6800/1939732211,v1:172.21.15.72:6801/1939732211] conn(0x7f7b60038aa0 0x7f7b6003af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:29.156 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.171+0000 7f7b6bfff700 1 -- 172.21.15.72:0/2585732034 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7b6400f050 con 0x7f7b7407b740 2024-03-30T14:57:29.157 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.171+0000 7f7b7259c700 1 --2- 172.21.15.72:0/2585732034 >> [v2:172.21.15.72:6800/1939732211,v1:172.21.15.72:6801/1939732211] conn(0x7f7b60038aa0 0x7f7b6003af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:57:29.157 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.171+0000 7f7b7259c700 1 --2- 172.21.15.72:0/2585732034 >> [v2:172.21.15.72:6800/1939732211,v1:172.21.15.72:6801/1939732211] conn(0x7f7b60038aa0 0x7f7b6003af60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c006fd0 tx=0x7f7b5c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:57:29.157 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.171+0000 7f7b79008700 1 -- 172.21.15.72:0/2585732034 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b74063870 con 0x7f7b7407b740 2024-03-30T14:57:29.157 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.179+0000 7f7b6bfff700 1 -- 172.21.15.72:0/2585732034 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f7b6401ab50 con 0x7f7b7407b740 2024-03-30T14:57:29.157 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.535+0000 7f7b79008700 1 -- 172.21.15.72:0/2585732034 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f7b7402d180 con 0x7f7b7407b740 2024-03-30T14:57:29.157 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.535+0000 7f7b6bfff700 1 -- 172.21.15.72:0/2585732034 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+282 (secure 0 0 0) 0x7f7b640171e0 con 0x7f7b7407b740 2024-03-30T14:57:29.157 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.539+0000 7f7b79008700 1 -- 172.21.15.72:0/2585732034 >> [v2:172.21.15.72:6800/1939732211,v1:172.21.15.72:6801/1939732211] conn(0x7f7b60038aa0 msgr2=0x7f7b6003af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:57:29.157 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.539+0000 7f7b79008700 1 --2- 172.21.15.72:0/2585732034 >> [v2:172.21.15.72:6800/1939732211,v1:172.21.15.72:6801/1939732211] conn(0x7f7b60038aa0 0x7f7b6003af60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c006fd0 tx=0x7f7b5c006e40 comp rx=0 tx=0).stop 2024-03-30T14:57:29.157 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.539+0000 7f7b79008700 1 -- 172.21.15.72:0/2585732034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b7407b740 msgr2=0x7f7b741a03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:57:29.157 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.539+0000 7f7b79008700 1 --2- 172.21.15.72:0/2585732034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b7407b740 0x7f7b741a03f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7b64004000 tx=0x7f7b64003c50 comp rx=0 tx=0).stop 2024-03-30T14:57:29.158 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.539+0000 7f7b79008700 1 -- 172.21.15.72:0/2585732034 shutdown_connections 2024-03-30T14:57:29.158 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.539+0000 7f7b79008700 1 --2- 172.21.15.72:0/2585732034 >> [v2:172.21.15.72:6800/1939732211,v1:172.21.15.72:6801/1939732211] conn(0x7f7b60038aa0 0x7f7b6003af60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:29.158 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.539+0000 7f7b79008700 1 --2- 172.21.15.72:0/2585732034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b7407b740 0x7f7b741a03f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:29.158 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.539+0000 7f7b79008700 1 -- 172.21.15.72:0/2585732034 >> 172.21.15.72:0/2585732034 conn(0x7f7b74101600 msgr2=0x7f7b741972f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:57:29.158 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.539+0000 7f7b79008700 1 -- 172.21.15.72:0/2585732034 shutdown_connections 2024-03-30T14:57:29.158 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:28.539+0000 7f7b79008700 1 -- 172.21.15.72:0/2585732034 wait complete. 2024-03-30T14:57:29.158 INFO:teuthology.orchestra.run.smithi072.stdout:Enabling cephadm module... 2024-03-30T14:57:30.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:30 smithi072 bash[21573]: audit 2024-03-30T14:57:30.493717+0000 mon.a (mon.0) 33 : audit 1 from='client.? 172.21.15.72:0/2791954559' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-03-30T14:57:30.921 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:30 smithi072 bash[21828]: ignoring --setuser ceph since I am not root 2024-03-30T14:57:30.921 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:30 smithi072 bash[21828]: ignoring --setgroup ceph since I am not root 2024-03-30T14:57:30.921 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:30 smithi072 bash[21828]: debug 2024-03-30T14:57:30.722+0000 7f3f2ae91200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-30T14:57:31.186 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.014+0000 7f9a6e23c700 1 Processor -- start 2024-03-30T14:57:31.186 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.014+0000 7f9a6e23c700 1 -- start start 2024-03-30T14:57:31.186 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.018+0000 7f9a6e23c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a68106000 0x7f9a68106420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:31.186 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.018+0000 7f9a6e23c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9a681069f0 con 0x7f9a68106000 2024-03-30T14:57:31.186 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.018+0000 7f9a677fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a68106000 0x7f9a68106420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:57:31.186 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.018+0000 7f9a677fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a68106000 0x7f9a68106420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58876/0 (socket says 172.21.15.72:58876) 2024-03-30T14:57:31.186 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.018+0000 7f9a677fe700 1 -- 172.21.15.72:0/2061219041 learned_addr learned my addr 172.21.15.72:0/2061219041 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:57:31.187 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.018+0000 7f9a677fe700 1 -- 172.21.15.72:0/2061219041 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a68107200 con 0x7f9a68106000 2024-03-30T14:57:31.187 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.018+0000 7f9a677fe700 1 --2- 172.21.15.72:0/2061219041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a68106000 0x7f9a68106420 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9a580098a0 tx=0x7f9a58009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d4e6585f69e40a1 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:57:31.187 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.018+0000 7f9a667fc700 1 -- 172.21.15.72:0/2061219041 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a58004160 con 0x7f9a68106000 2024-03-30T14:57:31.187 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.018+0000 7f9a667fc700 1 -- 172.21.15.72:0/2061219041 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1011+0+0 (secure 0 0 0) 0x7f9a58004300 con 0x7f9a68106000 2024-03-30T14:57:31.187 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.018+0000 7f9a667fc700 1 -- 172.21.15.72:0/2061219041 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a58011940 con 0x7f9a68106000 2024-03-30T14:57:31.187 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.018+0000 7f9a6e23c700 1 -- 172.21.15.72:0/2061219041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a68106000 msgr2=0x7f9a68106420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:57:31.187 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.018+0000 7f9a6e23c700 1 --2- 172.21.15.72:0/2061219041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a68106000 0x7f9a68106420 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9a580098a0 tx=0x7f9a58009bb0 comp rx=0 tx=0).stop 2024-03-30T14:57:31.187 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.018+0000 7f9a6e23c700 1 -- 172.21.15.72:0/2061219041 shutdown_connections 2024-03-30T14:57:31.187 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.018+0000 7f9a6e23c700 1 --2- 172.21.15.72:0/2061219041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a68106000 0x7f9a68106420 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:31.187 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.018+0000 7f9a6e23c700 1 -- 172.21.15.72:0/2061219041 >> 172.21.15.72:0/2061219041 conn(0x7f9a68101600 msgr2=0x7f9a68103a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:57:31.187 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.018+0000 7f9a6e23c700 1 -- 172.21.15.72:0/2061219041 shutdown_connections 2024-03-30T14:57:31.187 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.018+0000 7f9a6e23c700 1 -- 172.21.15.72:0/2061219041 wait complete. 2024-03-30T14:57:31.187 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.018+0000 7f9a6e23c700 1 Processor -- start 2024-03-30T14:57:31.188 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.018+0000 7f9a6e23c700 1 -- start start 2024-03-30T14:57:31.188 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.018+0000 7f9a6e23c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a68106000 0x7f9a68199e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:31.188 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.018+0000 7f9a6e23c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9a6810a430 con 0x7f9a68106000 2024-03-30T14:57:31.188 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.018+0000 7f9a677fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a68106000 0x7f9a68199e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:57:31.188 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.018+0000 7f9a677fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a68106000 0x7f9a68199e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58878/0 (socket says 172.21.15.72:58878) 2024-03-30T14:57:31.188 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.018+0000 7f9a677fe700 1 -- 172.21.15.72:0/2791954559 learned_addr learned my addr 172.21.15.72:0/2791954559 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:57:31.188 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.018+0000 7f9a677fe700 1 -- 172.21.15.72:0/2791954559 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a6819a390 con 0x7f9a68106000 2024-03-30T14:57:31.188 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.018+0000 7f9a677fe700 1 --2- 172.21.15.72:0/2791954559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a68106000 0x7f9a68199e50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9a58003e40 tx=0x7f9a580119c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:57:31.188 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.018+0000 7f9a64ff9700 1 -- 172.21.15.72:0/2791954559 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a5801a430 con 0x7f9a68106000 2024-03-30T14:57:31.188 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.018+0000 7f9a64ff9700 1 -- 172.21.15.72:0/2791954559 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1011+0+0 (secure 0 0 0) 0x7f9a5801aa30 con 0x7f9a68106000 2024-03-30T14:57:31.188 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.018+0000 7f9a6e23c700 1 -- 172.21.15.72:0/2791954559 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a6819a620 con 0x7f9a68106000 2024-03-30T14:57:31.188 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.022+0000 7f9a64ff9700 1 -- 172.21.15.72:0/2791954559 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a58024960 con 0x7f9a68106000 2024-03-30T14:57:31.189 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.022+0000 7f9a6e23c700 1 -- 172.21.15.72:0/2791954559 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a6819d310 con 0x7f9a68106000 2024-03-30T14:57:31.189 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.022+0000 7f9a64ff9700 1 -- 172.21.15.72:0/2791954559 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) ==== 46105+0+0 (secure 0 0 0) 0x7f9a58022020 con 0x7f9a68106000 2024-03-30T14:57:31.189 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.022+0000 7f9a64ff9700 1 --2- 172.21.15.72:0/2791954559 >> [v2:172.21.15.72:6800/1939732211,v1:172.21.15.72:6801/1939732211] conn(0x7f9a50038db0 0x7f9a5003b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:31.189 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.022+0000 7f9a64ff9700 1 -- 172.21.15.72:0/2791954559 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9a5804cd10 con 0x7f9a68106000 2024-03-30T14:57:31.189 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.022+0000 7f9a66ffd700 1 --2- 172.21.15.72:0/2791954559 >> [v2:172.21.15.72:6800/1939732211,v1:172.21.15.72:6801/1939732211] conn(0x7f9a50038db0 0x7f9a5003b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:57:31.189 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.022+0000 7f9a6e23c700 1 -- 172.21.15.72:0/2791954559 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a68063870 con 0x7f9a68106000 2024-03-30T14:57:31.189 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.022+0000 7f9a66ffd700 1 --2- 172.21.15.72:0/2791954559 >> [v2:172.21.15.72:6800/1939732211,v1:172.21.15.72:6801/1939732211] conn(0x7f9a50038db0 0x7f9a5003b270 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c006fd0 tx=0x7f9a5c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:57:31.189 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.026+0000 7f9a64ff9700 1 -- 172.21.15.72:0/2791954559 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f9a5800f2e0 con 0x7f9a68106000 2024-03-30T14:57:31.189 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.490+0000 7f9a6e23c700 1 -- 172.21.15.72:0/2791954559 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f9a6819d660 con 0x7f9a68106000 2024-03-30T14:57:31.189 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.542+0000 7f9a64ff9700 1 -- 172.21.15.72:0/2791954559 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f9a58004300 con 0x7f9a68106000 2024-03-30T14:57:31.189 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.546+0000 7f9a64ff9700 1 -- 172.21.15.72:0/2791954559 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mgrmap(e 5) ==== 46116+0+0 (secure 0 0 0) 0x7f9a5802d3f0 con 0x7f9a68106000 2024-03-30T14:57:31.189 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.546+0000 7f9a6e23c700 1 -- 172.21.15.72:0/2791954559 >> [v2:172.21.15.72:6800/1939732211,v1:172.21.15.72:6801/1939732211] conn(0x7f9a50038db0 msgr2=0x7f9a5003b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:57:31.189 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.546+0000 7f9a6e23c700 1 --2- 172.21.15.72:0/2791954559 >> [v2:172.21.15.72:6800/1939732211,v1:172.21.15.72:6801/1939732211] conn(0x7f9a50038db0 0x7f9a5003b270 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c006fd0 tx=0x7f9a5c006e40 comp rx=0 tx=0).stop 2024-03-30T14:57:31.189 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.546+0000 7f9a6e23c700 1 -- 172.21.15.72:0/2791954559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a68106000 msgr2=0x7f9a68199e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:57:31.190 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.546+0000 7f9a6e23c700 1 --2- 172.21.15.72:0/2791954559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a68106000 0x7f9a68199e50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9a58003e40 tx=0x7f9a580119c0 comp rx=0 tx=0).stop 2024-03-30T14:57:31.190 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.546+0000 7f9a6e23c700 1 -- 172.21.15.72:0/2791954559 shutdown_connections 2024-03-30T14:57:31.190 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.546+0000 7f9a6e23c700 1 --2- 172.21.15.72:0/2791954559 >> [v2:172.21.15.72:6800/1939732211,v1:172.21.15.72:6801/1939732211] conn(0x7f9a50038db0 0x7f9a5003b270 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:31.190 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.546+0000 7f9a6e23c700 1 --2- 172.21.15.72:0/2791954559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a68106000 0x7f9a68199e50 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:31.190 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.546+0000 7f9a6e23c700 1 -- 172.21.15.72:0/2791954559 >> 172.21.15.72:0/2791954559 conn(0x7f9a68101600 msgr2=0x7f9a68102140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:57:31.190 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.546+0000 7f9a6e23c700 1 -- 172.21.15.72:0/2791954559 shutdown_connections 2024-03-30T14:57:31.190 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:30.546+0000 7f9a6e23c700 1 -- 172.21.15.72:0/2791954559 wait complete. 2024-03-30T14:57:31.836 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:31 smithi072 bash[21573]: audit 2024-03-30T14:57:30.545485+0000 mon.a (mon.0) 34 : audit 1 from='client.? 172.21.15.72:0/2791954559' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-03-30T14:57:31.836 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:31 smithi072 bash[21573]: cluster 2024-03-30T14:57:30.549595+0000 mon.a (mon.0) 35 : cluster 0 mgrmap e5: y(active, since 7s) 2024-03-30T14:57:32.650 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:32 smithi072 bash[21573]: audit 2024-03-30T14:57:32.504605+0000 mon.a (mon.0) 36 : audit 0 from='client.? 172.21.15.72:0/680259113' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-03-30T14:57:32.650 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:32 smithi072 bash[21828]: debug 2024-03-30T14:57:32.298+0000 7f3f2ae91200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-30T14:57:32.650 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:32 smithi072 bash[21828]: debug 2024-03-30T14:57:32.394+0000 7f3f2ae91200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-30T14:57:32.921 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:32 smithi072 bash[21828]: debug 2024-03-30T14:57:32.646+0000 7f3f2ae91200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-30T14:57:33.106 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout { 2024-03-30T14:57:33.112 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-03-30T14:57:33.112 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-30T14:57:33.112 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "active_name": "y", 2024-03-30T14:57:33.112 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-03-30T14:57:33.112 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout } 2024-03-30T14:57:33.112 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.026+0000 7f75fdf31700 1 Processor -- start 2024-03-30T14:57:33.112 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.026+0000 7f75fdf31700 1 -- start start 2024-03-30T14:57:33.112 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.026+0000 7f75fdf31700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75f807ae90 0x7f75f80792f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:33.112 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.026+0000 7f75fdf31700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f75f80798c0 con 0x7f75f807ae90 2024-03-30T14:57:33.112 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.026+0000 7f75f77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75f807ae90 0x7f75f80792f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:57:33.112 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.026+0000 7f75f77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75f807ae90 0x7f75f80792f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58898/0 (socket says 172.21.15.72:58898) 2024-03-30T14:57:33.112 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.026+0000 7f75f77fe700 1 -- 172.21.15.72:0/2121162249 learned_addr learned my addr 172.21.15.72:0/2121162249 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:57:33.112 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.026+0000 7f75f77fe700 1 -- 172.21.15.72:0/2121162249 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75f8079a40 con 0x7f75f807ae90 2024-03-30T14:57:33.113 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.026+0000 7f75f77fe700 1 --2- 172.21.15.72:0/2121162249 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75f807ae90 0x7f75f80792f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f75e80098a0 tx=0x7f75e8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24b5e2b0af948179 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:57:33.113 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.026+0000 7f75f6ffd700 1 -- 172.21.15.72:0/2121162249 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75e8004160 con 0x7f75f807ae90 2024-03-30T14:57:33.113 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.026+0000 7f75f6ffd700 1 -- 172.21.15.72:0/2121162249 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1011+0+0 (secure 0 0 0) 0x7f75e8004300 con 0x7f75f807ae90 2024-03-30T14:57:33.113 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.026+0000 7f75f6ffd700 1 -- 172.21.15.72:0/2121162249 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75e8011940 con 0x7f75f807ae90 2024-03-30T14:57:33.113 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.026+0000 7f75fdf31700 1 -- 172.21.15.72:0/2121162249 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75f807ae90 msgr2=0x7f75f80792f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:57:33.113 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.026+0000 7f75fdf31700 1 --2- 172.21.15.72:0/2121162249 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75f807ae90 0x7f75f80792f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f75e80098a0 tx=0x7f75e8009bb0 comp rx=0 tx=0).stop 2024-03-30T14:57:33.113 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.026+0000 7f75fdf31700 1 -- 172.21.15.72:0/2121162249 shutdown_connections 2024-03-30T14:57:33.113 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.026+0000 7f75fdf31700 1 --2- 172.21.15.72:0/2121162249 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75f807ae90 0x7f75f80792f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:33.113 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.026+0000 7f75fdf31700 1 -- 172.21.15.72:0/2121162249 >> 172.21.15.72:0/2121162249 conn(0x7f75f8101680 msgr2=0x7f75f8103aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:57:33.113 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.026+0000 7f75fdf31700 1 -- 172.21.15.72:0/2121162249 shutdown_connections 2024-03-30T14:57:33.114 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.026+0000 7f75fdf31700 1 -- 172.21.15.72:0/2121162249 wait complete. 2024-03-30T14:57:33.114 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.026+0000 7f75fdf31700 1 Processor -- start 2024-03-30T14:57:33.114 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.030+0000 7f75fdf31700 1 -- start start 2024-03-30T14:57:33.114 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.030+0000 7f75fdf31700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75f807ae90 0x7f75f819bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:33.114 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.030+0000 7f75fdf31700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f75f810c4a0 con 0x7f75f807ae90 2024-03-30T14:57:33.114 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.030+0000 7f75f77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75f807ae90 0x7f75f819bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:57:33.114 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.030+0000 7f75f77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75f807ae90 0x7f75f819bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58914/0 (socket says 172.21.15.72:58914) 2024-03-30T14:57:33.114 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.030+0000 7f75f77fe700 1 -- 172.21.15.72:0/680259113 learned_addr learned my addr 172.21.15.72:0/680259113 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:57:33.114 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.030+0000 7f75f77fe700 1 -- 172.21.15.72:0/680259113 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75f819c530 con 0x7f75f807ae90 2024-03-30T14:57:33.114 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.030+0000 7f75f77fe700 1 --2- 172.21.15.72:0/680259113 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75f807ae90 0x7f75f819bff0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f75e8009fb0 tx=0x7f75e80119c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:57:33.114 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.030+0000 7f75f57fa700 1 -- 172.21.15.72:0/680259113 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75e801a430 con 0x7f75f807ae90 2024-03-30T14:57:33.114 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.030+0000 7f75f57fa700 1 -- 172.21.15.72:0/680259113 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1011+0+0 (secure 0 0 0) 0x7f75e801aa30 con 0x7f75f807ae90 2024-03-30T14:57:33.114 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.030+0000 7f75fdf31700 1 -- 172.21.15.72:0/680259113 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75f819c7c0 con 0x7f75f807ae90 2024-03-30T14:57:33.114 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.030+0000 7f75f57fa700 1 -- 172.21.15.72:0/680259113 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75e8024860 con 0x7f75f807ae90 2024-03-30T14:57:33.115 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.030+0000 7f75fdf31700 1 -- 172.21.15.72:0/680259113 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75f819f4b0 con 0x7f75f807ae90 2024-03-30T14:57:33.115 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.030+0000 7f75f57fa700 1 -- 172.21.15.72:0/680259113 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 46116+0+0 (secure 0 0 0) 0x7f75e8022020 con 0x7f75f807ae90 2024-03-30T14:57:33.115 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.030+0000 7f75f57fa700 1 --2- 172.21.15.72:0/680259113 >> [v2:172.21.15.72:6800/1939732211,v1:172.21.15.72:6801/1939732211] conn(0x7f75e4038e50 0x7f75e403b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:33.115 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.030+0000 7f75f57fa700 1 -- 172.21.15.72:0/680259113 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f75e804cea0 con 0x7f75f807ae90 2024-03-30T14:57:33.115 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.030+0000 7f75eeffd700 1 -- 172.21.15.72:0/680259113 >> [v2:172.21.15.72:6800/1939732211,v1:172.21.15.72:6801/1939732211] conn(0x7f75e4038e50 msgr2=0x7f75e403b310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/1939732211 2024-03-30T14:57:33.115 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.030+0000 7f75eeffd700 1 --2- 172.21.15.72:0/680259113 >> [v2:172.21.15.72:6800/1939732211,v1:172.21.15.72:6801/1939732211] conn(0x7f75e4038e50 0x7f75e403b310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-30T14:57:33.115 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.030+0000 7f75fdf31700 1 -- 172.21.15.72:0/680259113 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75d8005150 con 0x7f75f807ae90 2024-03-30T14:57:33.115 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.034+0000 7f75f57fa700 1 -- 172.21.15.72:0/680259113 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f75e800b3e0 con 0x7f75f807ae90 2024-03-30T14:57:33.115 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.234+0000 7f75eeffd700 1 -- 172.21.15.72:0/680259113 >> [v2:172.21.15.72:6800/1939732211,v1:172.21.15.72:6801/1939732211] conn(0x7f75e4038e50 msgr2=0x7f75e403b310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/1939732211 2024-03-30T14:57:33.115 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.234+0000 7f75eeffd700 1 --2- 172.21.15.72:0/680259113 >> [v2:172.21.15.72:6800/1939732211,v1:172.21.15.72:6801/1939732211] conn(0x7f75e4038e50 0x7f75e403b310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-30T14:57:33.115 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.498+0000 7f75fdf31700 1 -- 172.21.15.72:0/680259113 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f75d8005c50 con 0x7f75f807ae90 2024-03-30T14:57:33.115 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.498+0000 7f75f57fa700 1 -- 172.21.15.72:0/680259113 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f75e8019de0 con 0x7f75f807ae90 2024-03-30T14:57:33.115 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.502+0000 7f75fdf31700 1 -- 172.21.15.72:0/680259113 >> [v2:172.21.15.72:6800/1939732211,v1:172.21.15.72:6801/1939732211] conn(0x7f75e4038e50 msgr2=0x7f75e403b310 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-30T14:57:33.115 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.502+0000 7f75fdf31700 1 --2- 172.21.15.72:0/680259113 >> [v2:172.21.15.72:6800/1939732211,v1:172.21.15.72:6801/1939732211] conn(0x7f75e4038e50 0x7f75e403b310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:33.115 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.502+0000 7f75fdf31700 1 -- 172.21.15.72:0/680259113 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75f807ae90 msgr2=0x7f75f819bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:57:33.116 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.502+0000 7f75fdf31700 1 --2- 172.21.15.72:0/680259113 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75f807ae90 0x7f75f819bff0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f75e8009fb0 tx=0x7f75e80119c0 comp rx=0 tx=0).stop 2024-03-30T14:57:33.116 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.502+0000 7f75fdf31700 1 -- 172.21.15.72:0/680259113 shutdown_connections 2024-03-30T14:57:33.116 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.502+0000 7f75fdf31700 1 --2- 172.21.15.72:0/680259113 >> [v2:172.21.15.72:6800/1939732211,v1:172.21.15.72:6801/1939732211] conn(0x7f75e4038e50 0x7f75e403b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:33.116 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.502+0000 7f75fdf31700 1 --2- 172.21.15.72:0/680259113 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75f807ae90 0x7f75f819bff0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:33.116 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.502+0000 7f75fdf31700 1 -- 172.21.15.72:0/680259113 >> 172.21.15.72:0/680259113 conn(0x7f75f8101680 msgr2=0x7f75f8102140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:57:33.116 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.502+0000 7f75fdf31700 1 -- 172.21.15.72:0/680259113 shutdown_connections 2024-03-30T14:57:33.116 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:32.502+0000 7f75fdf31700 1 -- 172.21.15.72:0/680259113 wait complete. 2024-03-30T14:57:33.116 INFO:teuthology.orchestra.run.smithi072.stdout:Waiting for the mgr to restart... 2024-03-30T14:57:33.116 INFO:teuthology.orchestra.run.smithi072.stdout:Waiting for mgr epoch 5... 2024-03-30T14:57:33.744 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:33 smithi072 bash[21828]: debug 2024-03-30T14:57:33.438+0000 7f3f2ae91200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-30T14:57:33.744 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:33 smithi072 bash[21828]: debug 2024-03-30T14:57:33.550+0000 7f3f2ae91200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-30T14:57:33.744 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:33 smithi072 bash[21828]: debug 2024-03-30T14:57:33.654+0000 7f3f2ae91200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-30T14:57:34.420 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:34 smithi072 bash[21828]: debug 2024-03-30T14:57:34.010+0000 7f3f2ae91200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-30T14:57:34.421 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:34 smithi072 bash[21828]: debug 2024-03-30T14:57:34.122+0000 7f3f2ae91200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-30T14:57:34.421 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:34 smithi072 bash[21828]: debug 2024-03-30T14:57:34.226+0000 7f3f2ae91200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-30T14:57:34.920 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:34 smithi072 bash[21828]: debug 2024-03-30T14:57:34.574+0000 7f3f2ae91200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-30T14:57:34.921 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:34 smithi072 bash[21828]: debug 2024-03-30T14:57:34.810+0000 7f3f2ae91200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-30T14:57:35.421 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:35 smithi072 bash[21828]: debug 2024-03-30T14:57:35.066+0000 7f3f2ae91200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-30T14:57:35.421 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:35 smithi072 bash[21828]: debug 2024-03-30T14:57:35.182+0000 7f3f2ae91200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-30T14:57:35.863 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:35 smithi072 bash[21828]: debug 2024-03-30T14:57:35.454+0000 7f3f2ae91200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-30T14:57:36.171 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:35 smithi072 bash[21828]: debug 2024-03-30T14:57:35.858+0000 7f3f2ae91200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-30T14:57:36.171 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:36 smithi072 bash[21828]: debug 2024-03-30T14:57:36.094+0000 7f3f2ae91200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-30T14:57:36.671 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:36 smithi072 bash[21828]: debug 2024-03-30T14:57:36.210+0000 7f3f2ae91200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-30T14:57:36.671 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:36 smithi072 bash[21828]: debug 2024-03-30T14:57:36.454+0000 7f3f2ae91200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-30T14:57:37.881 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:37 smithi072 bash[21828]: debug 2024-03-30T14:57:37.474+0000 7f3f2ae91200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-30T14:57:37.882 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:37 smithi072 bash[21828]: debug 2024-03-30T14:57:37.586+0000 7f3f2ae91200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-30T14:57:38.171 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:37 smithi072 bash[21828]: debug 2024-03-30T14:57:37.878+0000 7f3f2ae91200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-30T14:57:38.171 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:37 smithi072 bash[21828]: debug 2024-03-30T14:57:37.990+0000 7f3f2ae91200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-30T14:57:38.639 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:38 smithi072 bash[21828]: debug 2024-03-30T14:57:38.438+0000 7f3f2ae91200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-30T14:57:38.639 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:38 smithi072 bash[21828]: debug 2024-03-30T14:57:38.558+0000 7f3f2ae91200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-30T14:57:38.639 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:38 smithi072 bash[21573]: cluster 2024-03-30T14:57:38.582781+0000 mon.a (mon.0) 37 : cluster 1 Active manager daemon y restarted 2024-03-30T14:57:38.639 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:38 smithi072 bash[21573]: cluster 2024-03-30T14:57:38.583574+0000 mon.a (mon.0) 38 : cluster 1 Activating manager daemon y 2024-03-30T14:57:38.639 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:38 smithi072 bash[21573]: cluster 2024-03-30T14:57:38.592095+0000 mon.a (mon.0) 39 : cluster 0 osdmap e2: 0 total, 0 up, 0 in 2024-03-30T14:57:38.639 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:38 smithi072 bash[21573]: cluster 2024-03-30T14:57:38.592371+0000 mon.a (mon.0) 40 : cluster 0 mgrmap e6: y(active, starting, since 0.00914792s) 2024-03-30T14:57:38.639 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:38 smithi072 bash[21573]: audit 2024-03-30T14:57:38.593865+0000 mon.a (mon.0) 41 : audit 0 from='mgr.14120 172.21.15.72:0/2951874849' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T14:57:38.640 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:38 smithi072 bash[21573]: audit 2024-03-30T14:57:38.595670+0000 mon.a (mon.0) 42 : audit 0 from='mgr.14120 172.21.15.72:0/2951874849' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-30T14:57:38.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:38 smithi072 bash[21573]: audit 2024-03-30T14:57:38.596573+0000 mon.a (mon.0) 43 : audit 0 from='mgr.14120 172.21.15.72:0/2951874849' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-30T14:57:38.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:38 smithi072 bash[21573]: audit 2024-03-30T14:57:38.596774+0000 mon.a (mon.0) 44 : audit 0 from='mgr.14120 172.21.15.72:0/2951874849' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-30T14:57:38.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:38 smithi072 bash[21573]: audit 2024-03-30T14:57:38.596917+0000 mon.a (mon.0) 45 : audit 0 from='mgr.14120 172.21.15.72:0/2951874849' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-30T14:57:38.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:38 smithi072 bash[21573]: cluster 2024-03-30T14:57:38.623152+0000 mon.a (mon.0) 46 : cluster 1 Manager daemon y is now available 2024-03-30T14:57:39.926 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:39 smithi072 bash[21573]: cephadm 2024-03-30T14:57:38.644274+0000 mgr.y (mgr.14120) 1 : cephadm 1 Found migration_current of "None". Setting to last migration. 2024-03-30T14:57:39.927 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:39 smithi072 bash[21573]: audit 2024-03-30T14:57:38.650097+0000 mon.a (mon.0) 47 : audit 1 from='mgr.14120 172.21.15.72:0/2951874849' entity='mgr.y' 2024-03-30T14:57:39.927 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:39 smithi072 bash[21573]: audit 2024-03-30T14:57:38.657162+0000 mon.a (mon.0) 48 : audit 1 from='mgr.14120 172.21.15.72:0/2951874849' entity='mgr.y' 2024-03-30T14:57:39.927 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:39 smithi072 bash[21573]: audit 2024-03-30T14:57:38.661735+0000 mon.a (mon.0) 49 : audit 0 from='mgr.14120 172.21.15.72:0/2951874849' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:57:39.927 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:39 smithi072 bash[21573]: audit 2024-03-30T14:57:38.665261+0000 mon.a (mon.0) 50 : audit 0 from='mgr.14120 172.21.15.72:0/2951874849' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:57:39.927 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:39 smithi072 bash[21573]: audit 2024-03-30T14:57:38.675194+0000 mon.a (mon.0) 51 : audit 1 from='mgr.14120 172.21.15.72:0/2951874849' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T14:57:39.927 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:39 smithi072 bash[21573]: audit 2024-03-30T14:57:38.677915+0000 mon.a (mon.0) 52 : audit 1 from='mgr.14120 172.21.15.72:0/2951874849' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T14:57:39.927 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:39 smithi072 bash[21573]: audit 2024-03-30T14:57:38.997836+0000 mon.a (mon.0) 53 : audit 1 from='mgr.14120 172.21.15.72:0/2951874849' entity='mgr.y' 2024-03-30T14:57:39.927 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:39 smithi072 bash[21573]: audit 2024-03-30T14:57:39.003916+0000 mon.a (mon.0) 54 : audit 1 from='mgr.14120 172.21.15.72:0/2951874849' entity='mgr.y' 2024-03-30T14:57:39.927 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:39 smithi072 bash[21573]: cephadm 2024-03-30T14:57:39.208645+0000 mgr.y (mgr.14120) 2 : cephadm 1 [30/Mar/2024:14:57:39] ENGINE Bus STARTING 2024-03-30T14:57:39.927 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:39 smithi072 bash[21573]: cephadm 2024-03-30T14:57:39.325561+0000 mgr.y (mgr.14120) 3 : cephadm 1 [30/Mar/2024:14:57:39] ENGINE Serving on https://172.21.15.72:7150 2024-03-30T14:57:39.927 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:39 smithi072 bash[21573]: cephadm 2024-03-30T14:57:39.426607+0000 mgr.y (mgr.14120) 4 : cephadm 1 [30/Mar/2024:14:57:39] ENGINE Serving on http://172.21.15.72:8765 2024-03-30T14:57:39.927 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:39 smithi072 bash[21573]: cephadm 2024-03-30T14:57:39.426749+0000 mgr.y (mgr.14120) 5 : cephadm 1 [30/Mar/2024:14:57:39] ENGINE Bus STARTED 2024-03-30T14:57:39.927 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:39 smithi072 bash[21573]: audit 2024-03-30T14:57:39.434819+0000 mon.a (mon.0) 55 : audit 0 from='mgr.14120 172.21.15.72:0/2951874849' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:57:39.928 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:39 smithi072 bash[21573]: audit 2024-03-30T14:57:39.595657+0000 mgr.y (mgr.14120) 6 : audit 0 from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-03-30T14:57:39.928 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:39 smithi072 bash[21573]: cluster 2024-03-30T14:57:39.597180+0000 mon.a (mon.0) 56 : cluster 0 mgrmap e7: y(active, since 1.01394s) 2024-03-30T14:57:40.323 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout { 2024-03-30T14:57:40.323 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-03-30T14:57:40.323 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "initialized": true 2024-03-30T14:57:40.323 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout } 2024-03-30T14:57:40.323 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:33.934+0000 7fb418853700 1 Processor -- start 2024-03-30T14:57:40.323 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:33.934+0000 7fb418853700 1 -- start start 2024-03-30T14:57:40.323 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:33.934+0000 7fb418853700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb414105ff0 0x7fb414106410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:40.323 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:33.934+0000 7fb418853700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fb4141069e0 con 0x7fb414105ff0 2024-03-30T14:57:40.323 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:33.934+0000 7fb41259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb414105ff0 0x7fb414106410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:57:40.323 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:33.934+0000 7fb41259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb414105ff0 0x7fb414106410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58918/0 (socket says 172.21.15.72:58918) 2024-03-30T14:57:40.324 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:33.934+0000 7fb41259c700 1 -- 172.21.15.72:0/438130508 learned_addr learned my addr 172.21.15.72:0/438130508 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:57:40.324 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:33.934+0000 7fb41259c700 1 -- 172.21.15.72:0/438130508 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4141071f0 con 0x7fb414105ff0 2024-03-30T14:57:40.324 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:33.934+0000 7fb41259c700 1 --2- 172.21.15.72:0/438130508 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb414105ff0 0x7fb414106410 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb4080098a0 tx=0x7fb408009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=346f434b17998dc3 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:57:40.324 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:33.934+0000 7fb41159a700 1 -- 172.21.15.72:0/438130508 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb408004160 con 0x7fb414105ff0 2024-03-30T14:57:40.324 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:33.934+0000 7fb41159a700 1 -- 172.21.15.72:0/438130508 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1011+0+0 (secure 0 0 0) 0x7fb408004300 con 0x7fb414105ff0 2024-03-30T14:57:40.324 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:33.934+0000 7fb41159a700 1 -- 172.21.15.72:0/438130508 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb408011940 con 0x7fb414105ff0 2024-03-30T14:57:40.324 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:33.934+0000 7fb418853700 1 -- 172.21.15.72:0/438130508 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb414105ff0 msgr2=0x7fb414106410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:57:40.324 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:33.934+0000 7fb418853700 1 --2- 172.21.15.72:0/438130508 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb414105ff0 0x7fb414106410 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb4080098a0 tx=0x7fb408009bb0 comp rx=0 tx=0).stop 2024-03-30T14:57:40.324 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:33.934+0000 7fb418853700 1 -- 172.21.15.72:0/438130508 shutdown_connections 2024-03-30T14:57:40.324 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:33.934+0000 7fb418853700 1 --2- 172.21.15.72:0/438130508 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb414105ff0 0x7fb414106410 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:40.324 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:33.934+0000 7fb418853700 1 -- 172.21.15.72:0/438130508 >> 172.21.15.72:0/438130508 conn(0x7fb4141015d0 msgr2=0x7fb4141039f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:57:40.324 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:33.934+0000 7fb418853700 1 -- 172.21.15.72:0/438130508 shutdown_connections 2024-03-30T14:57:40.324 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:33.934+0000 7fb418853700 1 -- 172.21.15.72:0/438130508 wait complete. 2024-03-30T14:57:40.324 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:33.934+0000 7fb418853700 1 Processor -- start 2024-03-30T14:57:40.325 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:33.934+0000 7fb418853700 1 -- start start 2024-03-30T14:57:40.325 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:33.934+0000 7fb418853700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb414105ff0 0x7fb414199e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:40.325 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:33.934+0000 7fb418853700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fb41410a420 con 0x7fb414105ff0 2024-03-30T14:57:40.325 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:33.934+0000 7fb41259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb414105ff0 0x7fb414199e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:57:40.325 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:33.934+0000 7fb41259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb414105ff0 0x7fb414199e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58934/0 (socket says 172.21.15.72:58934) 2024-03-30T14:57:40.325 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:33.934+0000 7fb41259c700 1 -- 172.21.15.72:0/660599972 learned_addr learned my addr 172.21.15.72:0/660599972 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:57:40.325 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:33.938+0000 7fb41259c700 1 -- 172.21.15.72:0/660599972 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb41419a380 con 0x7fb414105ff0 2024-03-30T14:57:40.325 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:33.938+0000 7fb41259c700 1 --2- 172.21.15.72:0/660599972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb414105ff0 0x7fb414199e40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb408003e40 tx=0x7fb4080119c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:57:40.325 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:33.938+0000 7fb4037fe700 1 -- 172.21.15.72:0/660599972 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb40801a430 con 0x7fb414105ff0 2024-03-30T14:57:40.325 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:33.938+0000 7fb4037fe700 1 -- 172.21.15.72:0/660599972 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1011+0+0 (secure 0 0 0) 0x7fb40801aa30 con 0x7fb414105ff0 2024-03-30T14:57:40.325 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:33.938+0000 7fb4037fe700 1 -- 172.21.15.72:0/660599972 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb408024960 con 0x7fb414105ff0 2024-03-30T14:57:40.325 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:33.938+0000 7fb418853700 1 -- 172.21.15.72:0/660599972 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb41419a610 con 0x7fb414105ff0 2024-03-30T14:57:40.325 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:33.938+0000 7fb418853700 1 -- 172.21.15.72:0/660599972 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb41419d300 con 0x7fb414105ff0 2024-03-30T14:57:40.325 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:33.938+0000 7fb4037fe700 1 -- 172.21.15.72:0/660599972 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 46116+0+0 (secure 0 0 0) 0x7fb408022020 con 0x7fb414105ff0 2024-03-30T14:57:40.326 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:33.938+0000 7fb4037fe700 1 --2- 172.21.15.72:0/660599972 >> [v2:172.21.15.72:6800/1939732211,v1:172.21.15.72:6801/1939732211] conn(0x7fb3fc038e00 0x7fb3fc03b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:40.326 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:33.938+0000 7fb4037fe700 1 -- 172.21.15.72:0/660599972 --> [v2:172.21.15.72:6800/1939732211,v1:172.21.15.72:6801/1939732211] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fb3fc03b9d0 con 0x7fb3fc038e00 2024-03-30T14:57:40.326 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:33.938+0000 7fb4037fe700 1 -- 172.21.15.72:0/660599972 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb40804cf00 con 0x7fb414105ff0 2024-03-30T14:57:40.326 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:33.938+0000 7fb411d9b700 1 -- 172.21.15.72:0/660599972 >> [v2:172.21.15.72:6800/1939732211,v1:172.21.15.72:6801/1939732211] conn(0x7fb3fc038e00 msgr2=0x7fb3fc03b2c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/1939732211 2024-03-30T14:57:40.326 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:33.938+0000 7fb411d9b700 1 --2- 172.21.15.72:0/660599972 >> [v2:172.21.15.72:6800/1939732211,v1:172.21.15.72:6801/1939732211] conn(0x7fb3fc038e00 0x7fb3fc03b2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-30T14:57:40.326 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:34.142+0000 7fb411d9b700 1 -- 172.21.15.72:0/660599972 >> [v2:172.21.15.72:6800/1939732211,v1:172.21.15.72:6801/1939732211] conn(0x7fb3fc038e00 msgr2=0x7fb3fc03b2c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/1939732211 2024-03-30T14:57:40.326 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:34.142+0000 7fb411d9b700 1 --2- 172.21.15.72:0/660599972 >> [v2:172.21.15.72:6800/1939732211,v1:172.21.15.72:6801/1939732211] conn(0x7fb3fc038e00 0x7fb3fc03b2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-30T14:57:40.326 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:34.546+0000 7fb411d9b700 1 -- 172.21.15.72:0/660599972 >> [v2:172.21.15.72:6800/1939732211,v1:172.21.15.72:6801/1939732211] conn(0x7fb3fc038e00 msgr2=0x7fb3fc03b2c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/1939732211 2024-03-30T14:57:40.326 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:34.546+0000 7fb411d9b700 1 --2- 172.21.15.72:0/660599972 >> [v2:172.21.15.72:6800/1939732211,v1:172.21.15.72:6801/1939732211] conn(0x7fb3fc038e00 0x7fb3fc03b2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-30T14:57:40.326 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:35.350+0000 7fb411d9b700 1 -- 172.21.15.72:0/660599972 >> [v2:172.21.15.72:6800/1939732211,v1:172.21.15.72:6801/1939732211] conn(0x7fb3fc038e00 msgr2=0x7fb3fc03b2c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/1939732211 2024-03-30T14:57:40.326 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:35.350+0000 7fb411d9b700 1 --2- 172.21.15.72:0/660599972 >> [v2:172.21.15.72:6800/1939732211,v1:172.21.15.72:6801/1939732211] conn(0x7fb3fc038e00 0x7fb3fc03b2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-30T14:57:40.327 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:36.954+0000 7fb411d9b700 1 -- 172.21.15.72:0/660599972 >> [v2:172.21.15.72:6800/1939732211,v1:172.21.15.72:6801/1939732211] conn(0x7fb3fc038e00 msgr2=0x7fb3fc03b2c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/1939732211 2024-03-30T14:57:40.327 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:36.954+0000 7fb411d9b700 1 --2- 172.21.15.72:0/660599972 >> [v2:172.21.15.72:6800/1939732211,v1:172.21.15.72:6801/1939732211] conn(0x7fb3fc038e00 0x7fb3fc03b2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-03-30T14:57:40.327 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:38.586+0000 7fb4037fe700 1 -- 172.21.15.72:0/660599972 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mgrmap(e 6) ==== 45883+0+0 (secure 0 0 0) 0x7fb40802d3f0 con 0x7fb414105ff0 2024-03-30T14:57:40.327 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:38.586+0000 7fb4037fe700 1 -- 172.21.15.72:0/660599972 >> [v2:172.21.15.72:6800/1939732211,v1:172.21.15.72:6801/1939732211] conn(0x7fb3fc038e00 msgr2=0x7fb3fc03b2c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-30T14:57:40.327 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:38.586+0000 7fb4037fe700 1 --2- 172.21.15.72:0/660599972 >> [v2:172.21.15.72:6800/1939732211,v1:172.21.15.72:6801/1939732211] conn(0x7fb3fc038e00 0x7fb3fc03b2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:40.327 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:39.586+0000 7fb4037fe700 1 -- 172.21.15.72:0/660599972 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 7) ==== 46010+0+0 (secure 0 0 0) 0x7fb40804eb50 con 0x7fb414105ff0 2024-03-30T14:57:40.327 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:39.586+0000 7fb4037fe700 1 --2- 172.21.15.72:0/660599972 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7fb3fc03c730 0x7fb3fc03eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:40.327 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:39.586+0000 7fb4037fe700 1 -- 172.21.15.72:0/660599972 --> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fb408010ec0 con 0x7fb3fc03c730 2024-03-30T14:57:40.327 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:39.590+0000 7fb411d9b700 1 --2- 172.21.15.72:0/660599972 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7fb3fc03c730 0x7fb3fc03eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:57:40.327 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:39.590+0000 7fb411d9b700 1 --2- 172.21.15.72:0/660599972 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7fb3fc03c730 0x7fb3fc03eb20 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb404003a10 tx=0x7fb4040092b0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:57:40.327 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:39.590+0000 7fb4037fe700 1 -- 172.21.15.72:0/660599972 <== mgr.14120 v2:172.21.15.72:6800/3069476432 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7774 (secure 0 0 0) 0x7fb408010ec0 con 0x7fb3fc03c730 2024-03-30T14:57:40.328 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:39.606+0000 7fb418853700 1 -- 172.21.15.72:0/660599972 --> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fb414063870 con 0x7fb3fc03c730 2024-03-30T14:57:40.328 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:39.606+0000 7fb4037fe700 1 -- 172.21.15.72:0/660599972 <== mgr.14120 v2:172.21.15.72:6800/3069476432 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7fb414063870 con 0x7fb3fc03c730 2024-03-30T14:57:40.328 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:39.606+0000 7fb418853700 1 -- 172.21.15.72:0/660599972 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7fb3fc03c730 msgr2=0x7fb3fc03eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:57:40.328 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:39.606+0000 7fb418853700 1 --2- 172.21.15.72:0/660599972 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7fb3fc03c730 0x7fb3fc03eb20 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb404003a10 tx=0x7fb4040092b0 comp rx=0 tx=0).stop 2024-03-30T14:57:40.328 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:39.606+0000 7fb418853700 1 -- 172.21.15.72:0/660599972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb414105ff0 msgr2=0x7fb414199e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:57:40.328 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:39.606+0000 7fb418853700 1 --2- 172.21.15.72:0/660599972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb414105ff0 0x7fb414199e40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb408003e40 tx=0x7fb4080119c0 comp rx=0 tx=0).stop 2024-03-30T14:57:40.328 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:39.606+0000 7fb418853700 1 -- 172.21.15.72:0/660599972 shutdown_connections 2024-03-30T14:57:40.328 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:39.606+0000 7fb418853700 1 --2- 172.21.15.72:0/660599972 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7fb3fc03c730 0x7fb3fc03eb20 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:40.328 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:39.606+0000 7fb418853700 1 --2- 172.21.15.72:0/660599972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb414105ff0 0x7fb414199e40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:40.328 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:39.606+0000 7fb418853700 1 --2- 172.21.15.72:0/660599972 >> [v2:172.21.15.72:6800/1939732211,v1:172.21.15.72:6801/1939732211] conn(0x7fb3fc038e00 0x7fb3fc03b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:40.328 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:39.606+0000 7fb418853700 1 -- 172.21.15.72:0/660599972 >> 172.21.15.72:0/660599972 conn(0x7fb4141015d0 msgr2=0x7fb4141020e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:57:40.328 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:39.606+0000 7fb418853700 1 -- 172.21.15.72:0/660599972 shutdown_connections 2024-03-30T14:57:40.329 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:39.606+0000 7fb418853700 1 -- 172.21.15.72:0/660599972 wait complete. 2024-03-30T14:57:40.329 INFO:teuthology.orchestra.run.smithi072.stdout:mgr epoch 5 is available 2024-03-30T14:57:40.329 INFO:teuthology.orchestra.run.smithi072.stdout:Setting orchestrator backend to cephadm... 2024-03-30T14:57:40.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:40 smithi072 bash[21573]: audit 2024-03-30T14:57:39.609571+0000 mgr.y (mgr.14120) 7 : audit 0 from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-03-30T14:57:41.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:41 smithi072 bash[21573]: cluster 2024-03-30T14:57:40.658752+0000 mon.a (mon.0) 57 : cluster 0 mgrmap e8: y(active, since 2s) 2024-03-30T14:57:41.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:41 smithi072 bash[21573]: audit 2024-03-30T14:57:41.580689+0000 mgr.y (mgr.14120) 8 : audit 0 from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:57:41.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:41 smithi072 bash[21573]: audit 2024-03-30T14:57:41.586750+0000 mon.a (mon.0) 58 : audit 1 from='mgr.14120 172.21.15.72:0/2951874849' entity='mgr.y' 2024-03-30T14:57:41.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:41 smithi072 bash[21573]: audit 2024-03-30T14:57:41.606824+0000 mon.a (mon.0) 59 : audit 0 from='mgr.14120 172.21.15.72:0/2951874849' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:57:42.206 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.166+0000 7f96bac9e700 1 Processor -- start 2024-03-30T14:57:42.206 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.170+0000 7f96bac9e700 1 -- start start 2024-03-30T14:57:42.206 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.170+0000 7f96bac9e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96b4106b60 0x7f96b4108f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:42.206 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.170+0000 7f96bac9e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f96b40796b0 con 0x7f96b4106b60 2024-03-30T14:57:42.206 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.170+0000 7f96b8a3a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96b4106b60 0x7f96b4108f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:57:42.206 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.170+0000 7f96b8a3a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96b4106b60 0x7f96b4108f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45528/0 (socket says 172.21.15.72:45528) 2024-03-30T14:57:42.206 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.170+0000 7f96b8a3a700 1 -- 172.21.15.72:0/953689644 learned_addr learned my addr 172.21.15.72:0/953689644 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:57:42.206 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.170+0000 7f96b8a3a700 1 -- 172.21.15.72:0/953689644 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96b4109490 con 0x7f96b4106b60 2024-03-30T14:57:42.207 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.170+0000 7f96b8a3a700 1 --2- 172.21.15.72:0/953689644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96b4106b60 0x7f96b4108f50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f96a80098a0 tx=0x7f96a8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2afdf31660cd7767 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:57:42.207 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.170+0000 7f96b37fe700 1 -- 172.21.15.72:0/953689644 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96a8004160 con 0x7f96b4106b60 2024-03-30T14:57:42.207 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.170+0000 7f96b37fe700 1 -- 172.21.15.72:0/953689644 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1011+0+0 (secure 0 0 0) 0x7f96a8004300 con 0x7f96b4106b60 2024-03-30T14:57:42.207 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.170+0000 7f96b37fe700 1 -- 172.21.15.72:0/953689644 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96a8011940 con 0x7f96b4106b60 2024-03-30T14:57:42.207 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.170+0000 7f96bac9e700 1 -- 172.21.15.72:0/953689644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96b4106b60 msgr2=0x7f96b4108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:57:42.207 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.170+0000 7f96bac9e700 1 --2- 172.21.15.72:0/953689644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96b4106b60 0x7f96b4108f50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f96a80098a0 tx=0x7f96a8009bb0 comp rx=0 tx=0).stop 2024-03-30T14:57:42.207 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.170+0000 7f96bac9e700 1 -- 172.21.15.72:0/953689644 shutdown_connections 2024-03-30T14:57:42.207 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.170+0000 7f96bac9e700 1 --2- 172.21.15.72:0/953689644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96b4106b60 0x7f96b4108f50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:42.207 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.170+0000 7f96bac9e700 1 -- 172.21.15.72:0/953689644 >> 172.21.15.72:0/953689644 conn(0x7f96b41005d0 msgr2=0x7f96b41029f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:57:42.208 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.170+0000 7f96bac9e700 1 -- 172.21.15.72:0/953689644 shutdown_connections 2024-03-30T14:57:42.208 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.170+0000 7f96bac9e700 1 -- 172.21.15.72:0/953689644 wait complete. 2024-03-30T14:57:42.208 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.170+0000 7f96bac9e700 1 Processor -- start 2024-03-30T14:57:42.208 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.170+0000 7f96bac9e700 1 -- start start 2024-03-30T14:57:42.208 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.170+0000 7f96bac9e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96b4106b60 0x7f96b41063e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:42.208 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.170+0000 7f96bac9e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f96b410a260 con 0x7f96b4106b60 2024-03-30T14:57:42.208 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.170+0000 7f96b8a3a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96b4106b60 0x7f96b41063e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:57:42.208 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.170+0000 7f96b8a3a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96b4106b60 0x7f96b41063e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45534/0 (socket says 172.21.15.72:45534) 2024-03-30T14:57:42.208 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.170+0000 7f96b8a3a700 1 -- 172.21.15.72:0/2470061532 learned_addr learned my addr 172.21.15.72:0/2470061532 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:57:42.208 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.170+0000 7f96b8a3a700 1 -- 172.21.15.72:0/2470061532 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96b4106920 con 0x7f96b4106b60 2024-03-30T14:57:42.209 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.174+0000 7f96b8a3a700 1 --2- 172.21.15.72:0/2470061532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96b4106b60 0x7f96b41063e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f96a8009870 tx=0x7f96a80119c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:57:42.209 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.174+0000 7f96b1ffb700 1 -- 172.21.15.72:0/2470061532 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96a801a430 con 0x7f96b4106b60 2024-03-30T14:57:42.209 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.174+0000 7f96b1ffb700 1 -- 172.21.15.72:0/2470061532 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1011+0+0 (secure 0 0 0) 0x7f96a801aa30 con 0x7f96b4106b60 2024-03-30T14:57:42.209 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.174+0000 7f96b1ffb700 1 -- 172.21.15.72:0/2470061532 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96a80248d0 con 0x7f96b4106b60 2024-03-30T14:57:42.209 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.174+0000 7f96bac9e700 1 -- 172.21.15.72:0/2470061532 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96b4104b10 con 0x7f96b4106b60 2024-03-30T14:57:42.209 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.174+0000 7f96bac9e700 1 -- 172.21.15.72:0/2470061532 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96b4105050 con 0x7f96b4106b60 2024-03-30T14:57:42.209 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.174+0000 7f96b1ffb700 1 -- 172.21.15.72:0/2470061532 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) ==== 46116+0+0 (secure 0 0 0) 0x7f96a8022020 con 0x7f96b4106b60 2024-03-30T14:57:42.209 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.174+0000 7f96bac9e700 1 -- 172.21.15.72:0/2470061532 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96b4063870 con 0x7f96b4106b60 2024-03-30T14:57:42.209 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.174+0000 7f96b1ffb700 1 --2- 172.21.15.72:0/2470061532 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f96a4038db0 0x7f96a403b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:42.210 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.174+0000 7f96b1ffb700 1 -- 172.21.15.72:0/2470061532 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f96a804d160 con 0x7f96b4106b60 2024-03-30T14:57:42.210 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.174+0000 7f96b3fff700 1 --2- 172.21.15.72:0/2470061532 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f96a4038db0 0x7f96a403b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:57:42.210 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.174+0000 7f96b3fff700 1 --2- 172.21.15.72:0/2470061532 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f96a4038db0 0x7f96a403b270 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f96a0006fd0 tx=0x7f96a0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:57:42.210 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.178+0000 7f96b1ffb700 1 -- 172.21.15.72:0/2470061532 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f96a800b3e0 con 0x7f96b4106b60 2024-03-30T14:57:42.210 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.574+0000 7f96bac9e700 1 -- 172.21.15.72:0/2470061532 --> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f96b4105840 con 0x7f96a4038db0 2024-03-30T14:57:42.210 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.582+0000 7f96b1ffb700 1 -- 172.21.15.72:0/2470061532 <== mgr.14120 v2:172.21.15.72:6800/3069476432 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f96b4105840 con 0x7f96a4038db0 2024-03-30T14:57:42.210 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.586+0000 7f96bac9e700 1 -- 172.21.15.72:0/2470061532 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f96a4038db0 msgr2=0x7f96a403b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:57:42.210 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.586+0000 7f96bac9e700 1 --2- 172.21.15.72:0/2470061532 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f96a4038db0 0x7f96a403b270 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f96a0006fd0 tx=0x7f96a0006e40 comp rx=0 tx=0).stop 2024-03-30T14:57:42.210 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.586+0000 7f96bac9e700 1 -- 172.21.15.72:0/2470061532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96b4106b60 msgr2=0x7f96b41063e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:57:42.210 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.586+0000 7f96bac9e700 1 --2- 172.21.15.72:0/2470061532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96b4106b60 0x7f96b41063e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f96a8009870 tx=0x7f96a80119c0 comp rx=0 tx=0).stop 2024-03-30T14:57:42.210 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.586+0000 7f96bac9e700 1 -- 172.21.15.72:0/2470061532 shutdown_connections 2024-03-30T14:57:42.210 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.586+0000 7f96bac9e700 1 --2- 172.21.15.72:0/2470061532 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f96a4038db0 0x7f96a403b270 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:42.210 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.586+0000 7f96bac9e700 1 --2- 172.21.15.72:0/2470061532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96b4106b60 0x7f96b41063e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:42.210 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.586+0000 7f96bac9e700 1 -- 172.21.15.72:0/2470061532 >> 172.21.15.72:0/2470061532 conn(0x7f96b41005d0 msgr2=0x7f96b41010c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:57:42.211 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.586+0000 7f96bac9e700 1 -- 172.21.15.72:0/2470061532 shutdown_connections 2024-03-30T14:57:42.211 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:41.586+0000 7f96bac9e700 1 -- 172.21.15.72:0/2470061532 wait complete. 2024-03-30T14:57:43.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:43 smithi072 bash[21573]: audit 2024-03-30T14:57:43.468733+0000 mgr.y (mgr.14120) 9 : audit 0 from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:57:44.068 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout value unchanged 2024-03-30T14:57:44.068 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.082+0000 7fbeaa188700 1 Processor -- start 2024-03-30T14:57:44.068 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.082+0000 7fbeaa188700 1 -- start start 2024-03-30T14:57:44.069 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.082+0000 7fbeaa188700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbea410c950 0x7fbea410cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:44.069 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.082+0000 7fbeaa188700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fbea410d360 con 0x7fbea410c950 2024-03-30T14:57:44.069 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.082+0000 7fbea37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbea410c950 0x7fbea410cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:57:44.069 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.082+0000 7fbea37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbea410c950 0x7fbea410cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45538/0 (socket says 172.21.15.72:45538) 2024-03-30T14:57:44.069 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.082+0000 7fbea37fe700 1 -- 172.21.15.72:0/1435466108 learned_addr learned my addr 172.21.15.72:0/1435466108 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:57:44.070 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.082+0000 7fbea37fe700 1 -- 172.21.15.72:0/1435466108 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbea410d840 con 0x7fbea410c950 2024-03-30T14:57:44.070 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.082+0000 7fbea37fe700 1 --2- 172.21.15.72:0/1435466108 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbea410c950 0x7fbea410cd70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbe940098a0 tx=0x7fbe94009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67401f77a8a4f132 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:57:44.070 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.082+0000 7fbea27fc700 1 -- 172.21.15.72:0/1435466108 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe94004160 con 0x7fbea410c950 2024-03-30T14:57:44.070 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.082+0000 7fbea27fc700 1 -- 172.21.15.72:0/1435466108 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1011+0+0 (secure 0 0 0) 0x7fbe94004300 con 0x7fbea410c950 2024-03-30T14:57:44.070 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.082+0000 7fbea27fc700 1 -- 172.21.15.72:0/1435466108 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe94011940 con 0x7fbea410c950 2024-03-30T14:57:44.070 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.082+0000 7fbeaa188700 1 -- 172.21.15.72:0/1435466108 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbea410c950 msgr2=0x7fbea410cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:57:44.070 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.082+0000 7fbeaa188700 1 --2- 172.21.15.72:0/1435466108 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbea410c950 0x7fbea410cd70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbe940098a0 tx=0x7fbe94009bb0 comp rx=0 tx=0).stop 2024-03-30T14:57:44.070 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.082+0000 7fbeaa188700 1 -- 172.21.15.72:0/1435466108 shutdown_connections 2024-03-30T14:57:44.070 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.082+0000 7fbeaa188700 1 --2- 172.21.15.72:0/1435466108 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbea410c950 0x7fbea410cd70 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:44.070 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.082+0000 7fbeaa188700 1 -- 172.21.15.72:0/1435466108 >> 172.21.15.72:0/1435466108 conn(0x7fbea407b610 msgr2=0x7fbea407da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:57:44.070 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.082+0000 7fbeaa188700 1 -- 172.21.15.72:0/1435466108 shutdown_connections 2024-03-30T14:57:44.070 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.082+0000 7fbeaa188700 1 -- 172.21.15.72:0/1435466108 wait complete. 2024-03-30T14:57:44.070 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.086+0000 7fbeaa188700 1 Processor -- start 2024-03-30T14:57:44.071 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.086+0000 7fbeaa188700 1 -- start start 2024-03-30T14:57:44.071 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.086+0000 7fbeaa188700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbea410c950 0x7fbea41a0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:44.071 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.086+0000 7fbeaa188700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fbea4110a70 con 0x7fbea410c950 2024-03-30T14:57:44.071 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.086+0000 7fbea37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbea410c950 0x7fbea41a0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:57:44.071 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.086+0000 7fbea37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbea410c950 0x7fbea41a0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45552/0 (socket says 172.21.15.72:45552) 2024-03-30T14:57:44.071 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.086+0000 7fbea37fe700 1 -- 172.21.15.72:0/642564099 learned_addr learned my addr 172.21.15.72:0/642564099 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:57:44.071 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.086+0000 7fbea37fe700 1 -- 172.21.15.72:0/642564099 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbea41a09d0 con 0x7fbea410c950 2024-03-30T14:57:44.071 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.086+0000 7fbea37fe700 1 --2- 172.21.15.72:0/642564099 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbea410c950 0x7fbea41a0490 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbe94011910 tx=0x7fbe940119f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:57:44.071 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.086+0000 7fbea0ff9700 1 -- 172.21.15.72:0/642564099 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe94003b20 con 0x7fbea410c950 2024-03-30T14:57:44.072 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.086+0000 7fbea0ff9700 1 -- 172.21.15.72:0/642564099 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1011+0+0 (secure 0 0 0) 0x7fbe9401a890 con 0x7fbea410c950 2024-03-30T14:57:44.072 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.086+0000 7fbea0ff9700 1 -- 172.21.15.72:0/642564099 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe940197f0 con 0x7fbea410c950 2024-03-30T14:57:44.072 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.086+0000 7fbeaa188700 1 -- 172.21.15.72:0/642564099 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbea41a0c60 con 0x7fbea410c950 2024-03-30T14:57:44.072 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.086+0000 7fbeaa188700 1 -- 172.21.15.72:0/642564099 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbea41a3950 con 0x7fbea410c950 2024-03-30T14:57:44.072 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.086+0000 7fbea0ff9700 1 -- 172.21.15.72:0/642564099 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) ==== 46116+0+0 (secure 0 0 0) 0x7fbe94022020 con 0x7fbea410c950 2024-03-30T14:57:44.072 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.086+0000 7fbeaa188700 1 -- 172.21.15.72:0/642564099 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbea4110bf0 con 0x7fbea410c950 2024-03-30T14:57:44.072 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.086+0000 7fbea0ff9700 1 --2- 172.21.15.72:0/642564099 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7fbe90038e50 0x7fbe9003b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:44.072 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.086+0000 7fbea0ff9700 1 -- 172.21.15.72:0/642564099 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fbe9404cf40 con 0x7fbea410c950 2024-03-30T14:57:44.072 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.086+0000 7fbea2ffd700 1 --2- 172.21.15.72:0/642564099 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7fbe90038e50 0x7fbe9003b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:57:44.073 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.086+0000 7fbea2ffd700 1 --2- 172.21.15.72:0/642564099 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7fbe90038e50 0x7fbe9003b310 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c006fd0 tx=0x7fbe8c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:57:44.073 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.094+0000 7fbea0ff9700 1 -- 172.21.15.72:0/642564099 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fbe9401aa40 con 0x7fbea410c950 2024-03-30T14:57:44.073 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.462+0000 7fbeaa188700 1 -- 172.21.15.72:0/642564099 --> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7fbea407c8a0 con 0x7fbe90038e50 2024-03-30T14:57:44.073 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.466+0000 7fbea0ff9700 1 -- 172.21.15.72:0/642564099 <== mgr.14120 v2:172.21.15.72:6800/3069476432 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7fbea407c8a0 con 0x7fbe90038e50 2024-03-30T14:57:44.073 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.466+0000 7fbeaa188700 1 -- 172.21.15.72:0/642564099 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7fbe90038e50 msgr2=0x7fbe9003b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:57:44.073 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.466+0000 7fbeaa188700 1 --2- 172.21.15.72:0/642564099 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7fbe90038e50 0x7fbe9003b310 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c006fd0 tx=0x7fbe8c006e40 comp rx=0 tx=0).stop 2024-03-30T14:57:44.073 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.466+0000 7fbeaa188700 1 -- 172.21.15.72:0/642564099 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbea410c950 msgr2=0x7fbea41a0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:57:44.073 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.466+0000 7fbeaa188700 1 --2- 172.21.15.72:0/642564099 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbea410c950 0x7fbea41a0490 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbe94011910 tx=0x7fbe940119f0 comp rx=0 tx=0).stop 2024-03-30T14:57:44.073 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.466+0000 7fbeaa188700 1 -- 172.21.15.72:0/642564099 shutdown_connections 2024-03-30T14:57:44.073 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.466+0000 7fbeaa188700 1 --2- 172.21.15.72:0/642564099 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7fbe90038e50 0x7fbe9003b310 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:44.073 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.466+0000 7fbeaa188700 1 --2- 172.21.15.72:0/642564099 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbea410c950 0x7fbea41a0490 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:44.073 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.466+0000 7fbeaa188700 1 -- 172.21.15.72:0/642564099 >> 172.21.15.72:0/642564099 conn(0x7fbea407b610 msgr2=0x7fbea407c190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:57:44.073 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.466+0000 7fbeaa188700 1 -- 172.21.15.72:0/642564099 shutdown_connections 2024-03-30T14:57:44.073 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:43.466+0000 7fbeaa188700 1 -- 172.21.15.72:0/642564099 wait complete. 2024-03-30T14:57:44.074 INFO:teuthology.orchestra.run.smithi072.stdout:Generating ssh key... 2024-03-30T14:57:45.671 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:45 smithi072 bash[21828]: Generating public/private rsa key pair. 2024-03-30T14:57:45.672 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:45 smithi072 bash[21828]: Your identification has been saved in /tmp/tmp6kpxnv7n/key. 2024-03-30T14:57:45.672 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:45 smithi072 bash[21828]: Your public key has been saved in /tmp/tmp6kpxnv7n/key.pub. 2024-03-30T14:57:45.672 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:45 smithi072 bash[21828]: The key fingerprint is: 2024-03-30T14:57:45.672 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:45 smithi072 bash[21828]: SHA256:dEhtODWfxkv7qsSttgiaxdxQAxBVShaca2/8EML1h2k ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4 2024-03-30T14:57:45.672 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:45 smithi072 bash[21828]: The key's randomart image is: 2024-03-30T14:57:45.672 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:45 smithi072 bash[21828]: +---[RSA 3072]----+ 2024-03-30T14:57:45.672 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:45 smithi072 bash[21828]: | o=*+o+o | 2024-03-30T14:57:45.672 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:45 smithi072 bash[21828]: | oo++.o+ . | 2024-03-30T14:57:45.672 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:45 smithi072 bash[21828]: | ..o=+.o* | 2024-03-30T14:57:45.672 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:45 smithi072 bash[21828]: | =o.oEo.o | 2024-03-30T14:57:45.672 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:45 smithi072 bash[21828]: | ..+So .o | 2024-03-30T14:57:45.672 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:45 smithi072 bash[21828]: | o o=. . . | 2024-03-30T14:57:45.672 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:45 smithi072 bash[21828]: | =..oo . . | 2024-03-30T14:57:45.672 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:45 smithi072 bash[21828]: | + . oo. . | 2024-03-30T14:57:45.672 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:45 smithi072 bash[21828]: | o ..+o. | 2024-03-30T14:57:45.673 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:57:45 smithi072 bash[21828]: +----[SHA256]-----+ 2024-03-30T14:57:46.045 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:44.894+0000 7f8c1a9d2700 1 Processor -- start 2024-03-30T14:57:46.045 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:44.894+0000 7f8c1a9d2700 1 -- start start 2024-03-30T14:57:46.045 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:44.894+0000 7f8c1a9d2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c1407b700 0x7f8c14079b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:46.046 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:44.894+0000 7f8c1a9d2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1407a130 con 0x7f8c1407b700 2024-03-30T14:57:46.046 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:44.894+0000 7f8c13fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c1407b700 0x7f8c14079b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:57:46.046 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:44.894+0000 7f8c13fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c1407b700 0x7f8c14079b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45558/0 (socket says 172.21.15.72:45558) 2024-03-30T14:57:46.046 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:44.894+0000 7f8c13fff700 1 -- 172.21.15.72:0/3555088890 learned_addr learned my addr 172.21.15.72:0/3555088890 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:57:46.046 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:44.894+0000 7f8c13fff700 1 -- 172.21.15.72:0/3555088890 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c1407a2b0 con 0x7f8c1407b700 2024-03-30T14:57:46.046 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:44.894+0000 7f8c13fff700 1 --2- 172.21.15.72:0/3555088890 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c1407b700 0x7f8c14079b60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8c040098a0 tx=0x7f8c04009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81c131b35e494761 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:57:46.046 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:44.894+0000 7f8c137fe700 1 -- 172.21.15.72:0/3555088890 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c04004160 con 0x7f8c1407b700 2024-03-30T14:57:46.046 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:44.894+0000 7f8c137fe700 1 -- 172.21.15.72:0/3555088890 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1011+0+0 (secure 0 0 0) 0x7f8c04004300 con 0x7f8c1407b700 2024-03-30T14:57:46.046 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:44.894+0000 7f8c137fe700 1 -- 172.21.15.72:0/3555088890 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c04011940 con 0x7f8c1407b700 2024-03-30T14:57:46.046 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:44.894+0000 7f8c1a9d2700 1 -- 172.21.15.72:0/3555088890 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c1407b700 msgr2=0x7f8c14079b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:57:46.046 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:44.894+0000 7f8c1a9d2700 1 --2- 172.21.15.72:0/3555088890 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c1407b700 0x7f8c14079b60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8c040098a0 tx=0x7f8c04009bb0 comp rx=0 tx=0).stop 2024-03-30T14:57:46.046 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:44.894+0000 7f8c1a9d2700 1 -- 172.21.15.72:0/3555088890 shutdown_connections 2024-03-30T14:57:46.047 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:44.894+0000 7f8c1a9d2700 1 --2- 172.21.15.72:0/3555088890 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c1407b700 0x7f8c14079b60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:46.047 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:44.894+0000 7f8c1a9d2700 1 -- 172.21.15.72:0/3555088890 >> 172.21.15.72:0/3555088890 conn(0x7f8c14101680 msgr2=0x7f8c14103aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:57:46.047 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:44.894+0000 7f8c1a9d2700 1 -- 172.21.15.72:0/3555088890 shutdown_connections 2024-03-30T14:57:46.047 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:44.894+0000 7f8c1a9d2700 1 -- 172.21.15.72:0/3555088890 wait complete. 2024-03-30T14:57:46.047 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:44.894+0000 7f8c1a9d2700 1 Processor -- start 2024-03-30T14:57:46.047 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:44.894+0000 7f8c1a9d2700 1 -- start start 2024-03-30T14:57:46.047 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:44.894+0000 7f8c1a9d2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c1407b700 0x7f8c1419c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:46.047 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:44.894+0000 7f8c1a9d2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1410c490 con 0x7f8c1407b700 2024-03-30T14:57:46.047 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:44.894+0000 7f8c13fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c1407b700 0x7f8c1419c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:57:46.047 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:44.894+0000 7f8c13fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c1407b700 0x7f8c1419c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45572/0 (socket says 172.21.15.72:45572) 2024-03-30T14:57:46.047 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:44.894+0000 7f8c13fff700 1 -- 172.21.15.72:0/3397230086 learned_addr learned my addr 172.21.15.72:0/3397230086 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:57:46.048 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:44.894+0000 7f8c13fff700 1 -- 172.21.15.72:0/3397230086 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c1419c580 con 0x7f8c1407b700 2024-03-30T14:57:46.048 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:44.894+0000 7f8c13fff700 1 --2- 172.21.15.72:0/3397230086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c1407b700 0x7f8c1419c040 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8c04003e40 tx=0x7f8c040119c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:57:46.048 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:44.898+0000 7f8c11ffb700 1 -- 172.21.15.72:0/3397230086 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c0401a430 con 0x7f8c1407b700 2024-03-30T14:57:46.048 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:44.898+0000 7f8c11ffb700 1 -- 172.21.15.72:0/3397230086 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1011+0+0 (secure 0 0 0) 0x7f8c0401aa30 con 0x7f8c1407b700 2024-03-30T14:57:46.048 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:44.898+0000 7f8c11ffb700 1 -- 172.21.15.72:0/3397230086 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c04024960 con 0x7f8c1407b700 2024-03-30T14:57:46.048 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:44.898+0000 7f8c1a9d2700 1 -- 172.21.15.72:0/3397230086 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c1419c810 con 0x7f8c1407b700 2024-03-30T14:57:46.048 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:44.898+0000 7f8c1a9d2700 1 -- 172.21.15.72:0/3397230086 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c1419f500 con 0x7f8c1407b700 2024-03-30T14:57:46.048 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:44.898+0000 7f8c11ffb700 1 -- 172.21.15.72:0/3397230086 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) ==== 46116+0+0 (secure 0 0 0) 0x7f8c04022020 con 0x7f8c1407b700 2024-03-30T14:57:46.048 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:44.898+0000 7f8c11ffb700 1 --2- 172.21.15.72:0/3397230086 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f8c00038e00 0x7f8c0003b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:46.048 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:44.898+0000 7f8c11ffb700 1 -- 172.21.15.72:0/3397230086 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f8c0404d450 con 0x7f8c1407b700 2024-03-30T14:57:46.048 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:44.898+0000 7f8c1a9d2700 1 -- 172.21.15.72:0/3397230086 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c14063870 con 0x7f8c1407b700 2024-03-30T14:57:46.049 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:44.898+0000 7f8c0bfff700 1 --2- 172.21.15.72:0/3397230086 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f8c00038e00 0x7f8c0003b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:57:46.049 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:44.898+0000 7f8c0bfff700 1 --2- 172.21.15.72:0/3397230086 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f8c00038e00 0x7f8c0003b2c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc006fd0 tx=0x7f8bfc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:57:46.049 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:44.902+0000 7f8c11ffb700 1 -- 172.21.15.72:0/3397230086 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f8c040172b0 con 0x7f8c1407b700 2024-03-30T14:57:46.049 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:45.258+0000 7f8c1a9d2700 1 -- 172.21.15.72:0/3397230086 --> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f8c141028f0 con 0x7f8c00038e00 2024-03-30T14:57:46.049 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:45.390+0000 7f8c11ffb700 1 -- 172.21.15.72:0/3397230086 <== mgr.14120 v2:172.21.15.72:6800/3069476432 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8c141028f0 con 0x7f8c00038e00 2024-03-30T14:57:46.049 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:45.394+0000 7f8c1a9d2700 1 -- 172.21.15.72:0/3397230086 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f8c00038e00 msgr2=0x7f8c0003b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:57:46.049 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:45.394+0000 7f8c1a9d2700 1 --2- 172.21.15.72:0/3397230086 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f8c00038e00 0x7f8c0003b2c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc006fd0 tx=0x7f8bfc006e40 comp rx=0 tx=0).stop 2024-03-30T14:57:46.049 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:45.394+0000 7f8c1a9d2700 1 -- 172.21.15.72:0/3397230086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c1407b700 msgr2=0x7f8c1419c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:57:46.049 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:45.394+0000 7f8c1a9d2700 1 --2- 172.21.15.72:0/3397230086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c1407b700 0x7f8c1419c040 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8c04003e40 tx=0x7f8c040119c0 comp rx=0 tx=0).stop 2024-03-30T14:57:46.049 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:45.394+0000 7f8c1a9d2700 1 -- 172.21.15.72:0/3397230086 shutdown_connections 2024-03-30T14:57:46.049 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:45.394+0000 7f8c1a9d2700 1 --2- 172.21.15.72:0/3397230086 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f8c00038e00 0x7f8c0003b2c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:46.049 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:45.394+0000 7f8c1a9d2700 1 --2- 172.21.15.72:0/3397230086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c1407b700 0x7f8c1419c040 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:46.050 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:45.394+0000 7f8c1a9d2700 1 -- 172.21.15.72:0/3397230086 >> 172.21.15.72:0/3397230086 conn(0x7f8c14101680 msgr2=0x7f8c141021e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:57:46.050 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:45.394+0000 7f8c1a9d2700 1 -- 172.21.15.72:0/3397230086 shutdown_connections 2024-03-30T14:57:46.050 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:45.394+0000 7f8c1a9d2700 1 -- 172.21.15.72:0/3397230086 wait complete. 2024-03-30T14:57:46.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:46 smithi072 bash[21573]: audit 2024-03-30T14:57:45.263602+0000 mgr.y (mgr.14120) 10 : audit 0 from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:57:46.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:46 smithi072 bash[21573]: cephadm 2024-03-30T14:57:45.263984+0000 mgr.y (mgr.14120) 11 : cephadm 1 Generating ssh key... 2024-03-30T14:57:46.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:46 smithi072 bash[21573]: audit 2024-03-30T14:57:45.388760+0000 mon.a (mon.0) 60 : audit 1 from='mgr.14120 172.21.15.72:0/2951874849' entity='mgr.y' 2024-03-30T14:57:46.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:46 smithi072 bash[21573]: audit 2024-03-30T14:57:45.392161+0000 mon.a (mon.0) 61 : audit 1 from='mgr.14120 172.21.15.72:0/2951874849' entity='mgr.y' 2024-03-30T14:57:47.866 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCokfnju9ScWuxkJgvWSLn23+ei28gsTS7CHCTBpMpajLs0WhSOyS2G7bIpofTx5MKudKk2NYbKzwTYsUxNn+YVDTdJOyBLCizifN1rHKq9+WS30aaU+wc1DJO4QqhRopvsxVmPbEoJCVO4tucYBFYHV22nkuVHkyIN2J+IY0Z0wBs1nwFzo8fhk/JLlGlVcygWpTjJp6rCTkaG5fjFQjrjQuBotuYPl5TccDTmUyIWzoLJxIKJE5y1bCkj0Fy4Imoh9aTkM7soTsFaggsO4X3kjsk29kX3REkEyw+5fbWzW3Gk8siQAU9S/jVucW29Sz5VCem5EER/GqLl7yd+1ehOj+CyGRKwACBFn2ath3e2gw0gItyakAIXmLaZEFUdNDLKtxHY5oGTY3MECvabByftMi77SdXa53/GoPLFWwvTYZwRtZSS3fp2b0jPR0fuDHs1Cd7CCbnrGtWBVRitsOgGu7cBKOuI/flN9NWz7Qw/8YP2UeKzYSNp3QSXEYt4vec= ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4 2024-03-30T14:57:47.866 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:46.878+0000 7f12741af700 1 Processor -- start 2024-03-30T14:57:47.866 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:46.878+0000 7f12741af700 1 -- start start 2024-03-30T14:57:47.867 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:46.878+0000 7f12741af700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f126c10c950 0x7f126c10cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:47.867 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:46.878+0000 7f12741af700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f126c10d360 con 0x7f126c10c950 2024-03-30T14:57:47.867 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:46.882+0000 7f1271f4b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f126c10c950 0x7f126c10cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:57:47.867 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:46.882+0000 7f1271f4b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f126c10c950 0x7f126c10cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45576/0 (socket says 172.21.15.72:45576) 2024-03-30T14:57:47.867 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:46.882+0000 7f1271f4b700 1 -- 172.21.15.72:0/376075040 learned_addr learned my addr 172.21.15.72:0/376075040 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:57:47.867 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:46.882+0000 7f1271f4b700 1 -- 172.21.15.72:0/376075040 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f126c10d840 con 0x7f126c10c950 2024-03-30T14:57:47.867 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:46.882+0000 7f1271f4b700 1 --2- 172.21.15.72:0/376075040 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f126c10c950 0x7f126c10cd70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f125c0098a0 tx=0x7f125c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7190a5e558b62193 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:57:47.867 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:46.882+0000 7f1270f49700 1 -- 172.21.15.72:0/376075040 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f125c004160 con 0x7f126c10c950 2024-03-30T14:57:47.867 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:46.882+0000 7f1270f49700 1 -- 172.21.15.72:0/376075040 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1011+0+0 (secure 0 0 0) 0x7f125c004300 con 0x7f126c10c950 2024-03-30T14:57:47.867 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:46.882+0000 7f1270f49700 1 -- 172.21.15.72:0/376075040 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f125c011940 con 0x7f126c10c950 2024-03-30T14:57:47.867 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:46.882+0000 7f12741af700 1 -- 172.21.15.72:0/376075040 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f126c10c950 msgr2=0x7f126c10cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:57:47.867 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:46.882+0000 7f12741af700 1 --2- 172.21.15.72:0/376075040 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f126c10c950 0x7f126c10cd70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f125c0098a0 tx=0x7f125c009bb0 comp rx=0 tx=0).stop 2024-03-30T14:57:47.867 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:46.882+0000 7f12741af700 1 -- 172.21.15.72:0/376075040 shutdown_connections 2024-03-30T14:57:47.868 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:46.882+0000 7f12741af700 1 --2- 172.21.15.72:0/376075040 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f126c10c950 0x7f126c10cd70 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:47.868 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:46.882+0000 7f12741af700 1 -- 172.21.15.72:0/376075040 >> 172.21.15.72:0/376075040 conn(0x7f126c07b610 msgr2=0x7f126c07da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:57:47.868 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:46.882+0000 7f12741af700 1 -- 172.21.15.72:0/376075040 shutdown_connections 2024-03-30T14:57:47.868 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:46.882+0000 7f12741af700 1 -- 172.21.15.72:0/376075040 wait complete. 2024-03-30T14:57:47.868 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:46.882+0000 7f12741af700 1 Processor -- start 2024-03-30T14:57:47.869 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:46.882+0000 7f12741af700 1 -- start start 2024-03-30T14:57:47.869 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:46.882+0000 7f12741af700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f126c10c950 0x7f126c1a0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:47.869 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:46.882+0000 7f12741af700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f126c110a70 con 0x7f126c10c950 2024-03-30T14:57:47.869 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:46.882+0000 7f1271f4b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f126c10c950 0x7f126c1a0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:57:47.869 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:46.882+0000 7f1271f4b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f126c10c950 0x7f126c1a0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45578/0 (socket says 172.21.15.72:45578) 2024-03-30T14:57:47.869 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:46.882+0000 7f1271f4b700 1 -- 172.21.15.72:0/2604160625 learned_addr learned my addr 172.21.15.72:0/2604160625 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:57:47.869 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:46.882+0000 7f1271f4b700 1 -- 172.21.15.72:0/2604160625 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f126c1a09d0 con 0x7f126c10c950 2024-03-30T14:57:47.869 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:46.882+0000 7f1271f4b700 1 --2- 172.21.15.72:0/2604160625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f126c10c950 0x7f126c1a0490 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f125c006ba0 tx=0x7f125c0119c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:57:47.870 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:46.882+0000 7f1262ffd700 1 -- 172.21.15.72:0/2604160625 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f125c003930 con 0x7f126c10c950 2024-03-30T14:57:47.870 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:46.882+0000 7f1262ffd700 1 -- 172.21.15.72:0/2604160625 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1011+0+0 (secure 0 0 0) 0x7f125c003ad0 con 0x7f126c10c950 2024-03-30T14:57:47.870 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:46.882+0000 7f12741af700 1 -- 172.21.15.72:0/2604160625 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f126c1a0c60 con 0x7f126c10c950 2024-03-30T14:57:47.870 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:46.882+0000 7f1262ffd700 1 -- 172.21.15.72:0/2604160625 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f125c019750 con 0x7f126c10c950 2024-03-30T14:57:47.870 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:46.882+0000 7f12741af700 1 -- 172.21.15.72:0/2604160625 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f126c1a3950 con 0x7f126c10c950 2024-03-30T14:57:47.870 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:46.886+0000 7f1262ffd700 1 -- 172.21.15.72:0/2604160625 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) ==== 46116+0+0 (secure 0 0 0) 0x7f125c0199c0 con 0x7f126c10c950 2024-03-30T14:57:47.870 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:46.886+0000 7f12741af700 1 -- 172.21.15.72:0/2604160625 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f126c110bf0 con 0x7f126c10c950 2024-03-30T14:57:47.870 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:46.886+0000 7f1262ffd700 1 --2- 172.21.15.72:0/2604160625 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f1258038e00 0x7f125803b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:47.870 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:46.886+0000 7f1262ffd700 1 -- 172.21.15.72:0/2604160625 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f125c04d4f0 con 0x7f126c10c950 2024-03-30T14:57:47.870 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:46.886+0000 7f127174a700 1 --2- 172.21.15.72:0/2604160625 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f1258038e00 0x7f125803b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:57:47.871 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:46.886+0000 7f127174a700 1 --2- 172.21.15.72:0/2604160625 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f1258038e00 0x7f125803b2c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1268006fd0 tx=0x7f1268006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:57:47.871 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:46.890+0000 7f1262ffd700 1 -- 172.21.15.72:0/2604160625 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f125c0172b0 con 0x7f126c10c950 2024-03-30T14:57:47.871 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:47.242+0000 7f12741af700 1 -- 172.21.15.72:0/2604160625 --> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f126c07c8a0 con 0x7f1258038e00 2024-03-30T14:57:47.871 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:47.246+0000 7f1262ffd700 1 -- 172.21.15.72:0/2604160625 <== mgr.14120 v2:172.21.15.72:6800/3069476432 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f126c07c8a0 con 0x7f1258038e00 2024-03-30T14:57:47.871 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:47.246+0000 7f12741af700 1 -- 172.21.15.72:0/2604160625 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f1258038e00 msgr2=0x7f125803b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:57:47.871 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:47.246+0000 7f12741af700 1 --2- 172.21.15.72:0/2604160625 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f1258038e00 0x7f125803b2c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1268006fd0 tx=0x7f1268006e40 comp rx=0 tx=0).stop 2024-03-30T14:57:47.871 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:47.246+0000 7f12741af700 1 -- 172.21.15.72:0/2604160625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f126c10c950 msgr2=0x7f126c1a0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:57:47.871 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:47.246+0000 7f12741af700 1 --2- 172.21.15.72:0/2604160625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f126c10c950 0x7f126c1a0490 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f125c006ba0 tx=0x7f125c0119c0 comp rx=0 tx=0).stop 2024-03-30T14:57:47.871 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:47.246+0000 7f12741af700 1 -- 172.21.15.72:0/2604160625 shutdown_connections 2024-03-30T14:57:47.871 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:47.246+0000 7f12741af700 1 --2- 172.21.15.72:0/2604160625 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f1258038e00 0x7f125803b2c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:47.871 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:47.246+0000 7f12741af700 1 --2- 172.21.15.72:0/2604160625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f126c10c950 0x7f126c1a0490 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:47.871 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:47.246+0000 7f12741af700 1 -- 172.21.15.72:0/2604160625 >> 172.21.15.72:0/2604160625 conn(0x7f126c07b610 msgr2=0x7f126c07c190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:57:47.872 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:47.246+0000 7f12741af700 1 -- 172.21.15.72:0/2604160625 shutdown_connections 2024-03-30T14:57:47.872 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:47.246+0000 7f12741af700 1 -- 172.21.15.72:0/2604160625 wait complete. 2024-03-30T14:57:47.872 INFO:teuthology.orchestra.run.smithi072.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-03-30T14:57:47.873 INFO:teuthology.orchestra.run.smithi072.stdout:Adding key to root@localhost authorized_keys... 2024-03-30T14:57:47.873 INFO:teuthology.orchestra.run.smithi072.stdout:Adding host smithi072... 2024-03-30T14:57:47.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:47 smithi072 bash[21573]: audit 2024-03-30T14:57:47.248736+0000 mgr.y (mgr.14120) 12 : audit 0 from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:57:49.782 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:49 smithi072 bash[21573]: audit 2024-03-30T14:57:49.147292+0000 mgr.y (mgr.14120) 13 : audit 0 from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi072", "addr": "172.21.15.72", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:57:50.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:50 smithi072 bash[21573]: cephadm 2024-03-30T14:57:49.764857+0000 mgr.y (mgr.14120) 14 : cephadm 1 Deploying cephadm binary to smithi072 2024-03-30T14:57:55.397 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout Added host 'smithi072' with addr '172.21.15.72' 2024-03-30T14:57:55.397 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:48.766+0000 7f3356d5d700 1 Processor -- start 2024-03-30T14:57:55.397 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:48.766+0000 7f3356d5d700 1 -- start start 2024-03-30T14:57:55.397 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:48.766+0000 7f3356d5d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f335007b6c0 0x7f3350079b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:55.397 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:48.766+0000 7f3356d5d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f335007a0f0 con 0x7f335007b6c0 2024-03-30T14:57:55.397 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:48.766+0000 7f3354af9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f335007b6c0 0x7f3350079b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:57:55.397 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:48.766+0000 7f3354af9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f335007b6c0 0x7f3350079b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50068/0 (socket says 172.21.15.72:50068) 2024-03-30T14:57:55.397 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:48.766+0000 7f3354af9700 1 -- 172.21.15.72:0/3071392579 learned_addr learned my addr 172.21.15.72:0/3071392579 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:57:55.397 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:48.766+0000 7f3354af9700 1 -- 172.21.15.72:0/3071392579 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f335007a270 con 0x7f335007b6c0 2024-03-30T14:57:55.398 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:48.766+0000 7f3354af9700 1 --2- 172.21.15.72:0/3071392579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f335007b6c0 0x7f3350079b20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f33480098a0 tx=0x7f3348009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4677f854c2c254ce server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:57:55.398 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:48.766+0000 7f334f7fe700 1 -- 172.21.15.72:0/3071392579 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3348004160 con 0x7f335007b6c0 2024-03-30T14:57:55.398 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:48.766+0000 7f334f7fe700 1 -- 172.21.15.72:0/3071392579 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1011+0+0 (secure 0 0 0) 0x7f3348004300 con 0x7f335007b6c0 2024-03-30T14:57:55.398 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:48.766+0000 7f334f7fe700 1 -- 172.21.15.72:0/3071392579 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3348011940 con 0x7f335007b6c0 2024-03-30T14:57:55.398 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:48.766+0000 7f3356d5d700 1 -- 172.21.15.72:0/3071392579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f335007b6c0 msgr2=0x7f3350079b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:57:55.398 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:48.766+0000 7f3356d5d700 1 --2- 172.21.15.72:0/3071392579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f335007b6c0 0x7f3350079b20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f33480098a0 tx=0x7f3348009bb0 comp rx=0 tx=0).stop 2024-03-30T14:57:55.398 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:48.766+0000 7f3356d5d700 1 -- 172.21.15.72:0/3071392579 shutdown_connections 2024-03-30T14:57:55.398 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:48.766+0000 7f3356d5d700 1 --2- 172.21.15.72:0/3071392579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f335007b6c0 0x7f3350079b20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:55.398 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:48.766+0000 7f3356d5d700 1 -- 172.21.15.72:0/3071392579 >> 172.21.15.72:0/3071392579 conn(0x7f3350101630 msgr2=0x7f3350103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:57:55.398 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:48.766+0000 7f3356d5d700 1 -- 172.21.15.72:0/3071392579 shutdown_connections 2024-03-30T14:57:55.398 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:48.766+0000 7f3356d5d700 1 -- 172.21.15.72:0/3071392579 wait complete. 2024-03-30T14:57:55.398 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:48.766+0000 7f3356d5d700 1 Processor -- start 2024-03-30T14:57:55.398 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:48.766+0000 7f3356d5d700 1 -- start start 2024-03-30T14:57:55.398 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:48.766+0000 7f3356d5d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f335007b6c0 0x7f335019c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:55.399 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:48.766+0000 7f3356d5d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f335010c460 con 0x7f335007b6c0 2024-03-30T14:57:55.399 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:48.766+0000 7f3354af9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f335007b6c0 0x7f335019c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:57:55.399 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:48.766+0000 7f3354af9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f335007b6c0 0x7f335019c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50084/0 (socket says 172.21.15.72:50084) 2024-03-30T14:57:55.399 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:48.766+0000 7f3354af9700 1 -- 172.21.15.72:0/2095757378 learned_addr learned my addr 172.21.15.72:0/2095757378 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:57:55.399 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:48.770+0000 7f3354af9700 1 -- 172.21.15.72:0/2095757378 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f335019c570 con 0x7f335007b6c0 2024-03-30T14:57:55.399 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:48.770+0000 7f3354af9700 1 --2- 172.21.15.72:0/2095757378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f335007b6c0 0x7f335019c030 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3348009870 tx=0x7f33480119c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:57:55.399 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:48.770+0000 7f334dffb700 1 -- 172.21.15.72:0/2095757378 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f334801a430 con 0x7f335007b6c0 2024-03-30T14:57:55.399 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:48.770+0000 7f334dffb700 1 -- 172.21.15.72:0/2095757378 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1011+0+0 (secure 0 0 0) 0x7f334801aa30 con 0x7f335007b6c0 2024-03-30T14:57:55.399 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:48.770+0000 7f334dffb700 1 -- 172.21.15.72:0/2095757378 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33480248d0 con 0x7f335007b6c0 2024-03-30T14:57:55.399 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:48.770+0000 7f3356d5d700 1 -- 172.21.15.72:0/2095757378 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f335019c800 con 0x7f335007b6c0 2024-03-30T14:57:55.399 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:48.770+0000 7f3356d5d700 1 -- 172.21.15.72:0/2095757378 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f335019f4f0 con 0x7f335007b6c0 2024-03-30T14:57:55.399 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:48.770+0000 7f334dffb700 1 -- 172.21.15.72:0/2095757378 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) ==== 46116+0+0 (secure 0 0 0) 0x7f3348022020 con 0x7f335007b6c0 2024-03-30T14:57:55.399 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:48.770+0000 7f3356d5d700 1 -- 172.21.15.72:0/2095757378 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3350063870 con 0x7f335007b6c0 2024-03-30T14:57:55.400 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:48.770+0000 7f334dffb700 1 --2- 172.21.15.72:0/2095757378 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f333c038e00 0x7f333c03b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:55.400 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:48.770+0000 7f334dffb700 1 -- 172.21.15.72:0/2095757378 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f334804d160 con 0x7f335007b6c0 2024-03-30T14:57:55.400 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:48.770+0000 7f334ffff700 1 --2- 172.21.15.72:0/2095757378 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f333c038e00 0x7f333c03b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:57:55.400 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:48.770+0000 7f334ffff700 1 --2- 172.21.15.72:0/2095757378 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f333c038e00 0x7f333c03b2c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3338006fd0 tx=0x7f3338006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:57:55.400 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:48.774+0000 7f334dffb700 1 -- 172.21.15.72:0/2095757378 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f334804cab0 con 0x7f335007b6c0 2024-03-30T14:57:55.400 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:49.142+0000 7f3356d5d700 1 -- 172.21.15.72:0/2095757378 --> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi072", "addr": "172.21.15.72", "target": ["mon-mgr", ""]}) -- 0x7f3350102850 con 0x7f333c038e00 2024-03-30T14:57:55.400 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:54.521+0000 7f334dffb700 1 -- 172.21.15.72:0/2095757378 <== mgr.14120 v2:172.21.15.72:6800/3069476432 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f3350102850 con 0x7f333c038e00 2024-03-30T14:57:55.400 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:54.521+0000 7f3356d5d700 1 -- 172.21.15.72:0/2095757378 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f333c038e00 msgr2=0x7f333c03b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:57:55.400 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:54.521+0000 7f3356d5d700 1 --2- 172.21.15.72:0/2095757378 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f333c038e00 0x7f333c03b2c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3338006fd0 tx=0x7f3338006e40 comp rx=0 tx=0).stop 2024-03-30T14:57:55.400 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:54.521+0000 7f3356d5d700 1 -- 172.21.15.72:0/2095757378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f335007b6c0 msgr2=0x7f335019c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:57:55.400 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:54.521+0000 7f3356d5d700 1 --2- 172.21.15.72:0/2095757378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f335007b6c0 0x7f335019c030 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3348009870 tx=0x7f33480119c0 comp rx=0 tx=0).stop 2024-03-30T14:57:55.400 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:54.521+0000 7f3356d5d700 1 -- 172.21.15.72:0/2095757378 shutdown_connections 2024-03-30T14:57:55.400 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:54.521+0000 7f3356d5d700 1 --2- 172.21.15.72:0/2095757378 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f333c038e00 0x7f333c03b2c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:55.401 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:54.521+0000 7f3356d5d700 1 --2- 172.21.15.72:0/2095757378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f335007b6c0 0x7f335019c030 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:55.401 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:54.521+0000 7f3356d5d700 1 -- 172.21.15.72:0/2095757378 >> 172.21.15.72:0/2095757378 conn(0x7f3350101630 msgr2=0x7f3350102140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:57:55.401 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:54.521+0000 7f3356d5d700 1 -- 172.21.15.72:0/2095757378 shutdown_connections 2024-03-30T14:57:55.401 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:54.521+0000 7f3356d5d700 1 -- 172.21.15.72:0/2095757378 wait complete. 2024-03-30T14:57:55.401 INFO:teuthology.orchestra.run.smithi072.stdout:Deploying unmanaged mon service... 2024-03-30T14:57:55.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:55 smithi072 bash[21573]: audit 2024-03-30T14:57:54.524474+0000 mon.a (mon.0) 62 : audit 1 from='mgr.14120 172.21.15.72:0/2951874849' entity='mgr.y' 2024-03-30T14:57:55.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:55 smithi072 bash[21573]: cephadm 2024-03-30T14:57:54.524929+0000 mgr.y (mgr.14120) 15 : cephadm 1 Added host smithi072 2024-03-30T14:57:55.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:55 smithi072 bash[21573]: audit 2024-03-30T14:57:54.572762+0000 mon.a (mon.0) 63 : audit 0 from='mgr.14120 172.21.15.72:0/2951874849' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:57:58.385 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-03-30T14:57:58.386 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:56.961+0000 7f1ffb3a5700 1 Processor -- start 2024-03-30T14:57:58.386 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:56.961+0000 7f1ffb3a5700 1 -- start start 2024-03-30T14:57:58.386 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:56.961+0000 7f1ffb3a5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ff4104890 0x7f1ff4104cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:58.386 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:56.961+0000 7f1ffb3a5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff4078e80 con 0x7f1ff4104890 2024-03-30T14:57:58.386 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:56.961+0000 7f1ff9141700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ff4104890 0x7f1ff4104cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:57:58.386 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:56.961+0000 7f1ff9141700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ff4104890 0x7f1ff4104cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33766/0 (socket says 172.21.15.72:33766) 2024-03-30T14:57:58.386 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:56.961+0000 7f1ff9141700 1 -- 172.21.15.72:0/3827889782 learned_addr learned my addr 172.21.15.72:0/3827889782 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:57:58.386 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:56.965+0000 7f1ff9141700 1 -- 172.21.15.72:0/3827889782 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ff41051f0 con 0x7f1ff4104890 2024-03-30T14:57:58.386 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:56.965+0000 7f1ff9141700 1 --2- 172.21.15.72:0/3827889782 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ff4104890 0x7f1ff4104cb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1fe80098a0 tx=0x7f1fe8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ed6d516d926cc1f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:57:58.386 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:56.965+0000 7f1fe7fff700 1 -- 172.21.15.72:0/3827889782 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fe8004160 con 0x7f1ff4104890 2024-03-30T14:57:58.386 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:56.965+0000 7f1fe7fff700 1 -- 172.21.15.72:0/3827889782 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1011+0+0 (secure 0 0 0) 0x7f1fe8004300 con 0x7f1ff4104890 2024-03-30T14:57:58.386 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:56.965+0000 7f1fe7fff700 1 -- 172.21.15.72:0/3827889782 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fe8011940 con 0x7f1ff4104890 2024-03-30T14:57:58.387 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:56.965+0000 7f1ffb3a5700 1 -- 172.21.15.72:0/3827889782 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ff4104890 msgr2=0x7f1ff4104cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:57:58.387 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:56.965+0000 7f1ffb3a5700 1 --2- 172.21.15.72:0/3827889782 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ff4104890 0x7f1ff4104cb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1fe80098a0 tx=0x7f1fe8009bb0 comp rx=0 tx=0).stop 2024-03-30T14:57:58.387 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:56.965+0000 7f1ffb3a5700 1 -- 172.21.15.72:0/3827889782 shutdown_connections 2024-03-30T14:57:58.387 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:56.965+0000 7f1ffb3a5700 1 --2- 172.21.15.72:0/3827889782 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ff4104890 0x7f1ff4104cb0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:58.387 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:56.965+0000 7f1ffb3a5700 1 -- 172.21.15.72:0/3827889782 >> 172.21.15.72:0/3827889782 conn(0x7f1ff41004f0 msgr2=0x7f1ff4102910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:57:58.387 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:56.965+0000 7f1ffb3a5700 1 -- 172.21.15.72:0/3827889782 shutdown_connections 2024-03-30T14:57:58.387 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:56.965+0000 7f1ffb3a5700 1 -- 172.21.15.72:0/3827889782 wait complete. 2024-03-30T14:57:58.388 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:56.965+0000 7f1ffb3a5700 1 Processor -- start 2024-03-30T14:57:58.388 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:56.965+0000 7f1ffb3a5700 1 -- start start 2024-03-30T14:57:58.388 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:56.965+0000 7f1ffb3a5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ff4104890 0x7f1ff419c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:58.388 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:56.965+0000 7f1ffb3a5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff41060f0 con 0x7f1ff4104890 2024-03-30T14:57:58.388 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:56.965+0000 7f1ff9141700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ff4104890 0x7f1ff419c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:57:58.388 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:56.965+0000 7f1ff9141700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ff4104890 0x7f1ff419c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33772/0 (socket says 172.21.15.72:33772) 2024-03-30T14:57:58.388 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:56.965+0000 7f1ff9141700 1 -- 172.21.15.72:0/22211269 learned_addr learned my addr 172.21.15.72:0/22211269 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:57:58.388 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:56.965+0000 7f1ff9141700 1 -- 172.21.15.72:0/22211269 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ff419c580 con 0x7f1ff4104890 2024-03-30T14:57:58.389 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:56.965+0000 7f1ff9141700 1 --2- 172.21.15.72:0/22211269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ff4104890 0x7f1ff419c040 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1fe8003e40 tx=0x7f1fe80119e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:57:58.389 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:56.965+0000 7f1fe67fc700 1 -- 172.21.15.72:0/22211269 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fe8003aa0 con 0x7f1ff4104890 2024-03-30T14:57:58.389 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:56.965+0000 7f1fe67fc700 1 -- 172.21.15.72:0/22211269 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1011+0+0 (secure 0 0 0) 0x7f1fe801a890 con 0x7f1ff4104890 2024-03-30T14:57:58.389 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:56.965+0000 7f1ffb3a5700 1 -- 172.21.15.72:0/22211269 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ff419c810 con 0x7f1ff4104890 2024-03-30T14:57:58.389 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:56.969+0000 7f1fe67fc700 1 -- 172.21.15.72:0/22211269 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fe80247e0 con 0x7f1ff4104890 2024-03-30T14:57:58.389 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:56.969+0000 7f1ffb3a5700 1 -- 172.21.15.72:0/22211269 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ff419f500 con 0x7f1ff4104890 2024-03-30T14:57:58.389 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:56.969+0000 7f1fe67fc700 1 -- 172.21.15.72:0/22211269 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) ==== 46116+0+0 (secure 0 0 0) 0x7f1fe8022020 con 0x7f1ff4104890 2024-03-30T14:57:58.389 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:56.969+0000 7f1fe67fc700 1 --2- 172.21.15.72:0/22211269 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f1fe0038aa0 0x7f1fe003af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:57:58.389 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:56.969+0000 7f1fe67fc700 1 -- 172.21.15.72:0/22211269 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f1fe804e800 con 0x7f1ff4104890 2024-03-30T14:57:58.389 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:56.969+0000 7f1ff8940700 1 --2- 172.21.15.72:0/22211269 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f1fe0038aa0 0x7f1fe003af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:57:58.389 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:56.969+0000 7f1ff8940700 1 --2- 172.21.15.72:0/22211269 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f1fe0038aa0 0x7f1fe003af60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0006fd0 tx=0x7f1ff0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:57:58.389 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:56.969+0000 7f1ffb3a5700 1 -- 172.21.15.72:0/22211269 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ff4063870 con 0x7f1ff4104890 2024-03-30T14:57:58.389 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:56.973+0000 7f1fe67fc700 1 -- 172.21.15.72:0/22211269 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f1fe80212c0 con 0x7f1ff4104890 2024-03-30T14:57:58.390 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:57.365+0000 7f1ffb3a5700 1 -- 172.21.15.72:0/22211269 --> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f1ff4062680 con 0x7f1fe0038aa0 2024-03-30T14:57:58.390 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:57.373+0000 7f1fe67fc700 1 -- 172.21.15.72:0/22211269 <== mgr.14120 v2:172.21.15.72:6800/3069476432 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f1ff4062680 con 0x7f1fe0038aa0 2024-03-30T14:57:58.390 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:57.373+0000 7f1ffb3a5700 1 -- 172.21.15.72:0/22211269 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f1fe0038aa0 msgr2=0x7f1fe003af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:57:58.390 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:57.373+0000 7f1ffb3a5700 1 --2- 172.21.15.72:0/22211269 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f1fe0038aa0 0x7f1fe003af60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0006fd0 tx=0x7f1ff0006e40 comp rx=0 tx=0).stop 2024-03-30T14:57:58.390 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:57.373+0000 7f1ffb3a5700 1 -- 172.21.15.72:0/22211269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ff4104890 msgr2=0x7f1ff419c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:57:58.390 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:57.373+0000 7f1ffb3a5700 1 --2- 172.21.15.72:0/22211269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ff4104890 0x7f1ff419c040 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1fe8003e40 tx=0x7f1fe80119e0 comp rx=0 tx=0).stop 2024-03-30T14:57:58.390 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:57.373+0000 7f1ffb3a5700 1 -- 172.21.15.72:0/22211269 shutdown_connections 2024-03-30T14:57:58.390 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:57.373+0000 7f1ffb3a5700 1 --2- 172.21.15.72:0/22211269 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f1fe0038aa0 0x7f1fe003af60 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:58.390 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:57.373+0000 7f1ffb3a5700 1 --2- 172.21.15.72:0/22211269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ff4104890 0x7f1ff419c040 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:57:58.390 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:57.373+0000 7f1ffb3a5700 1 -- 172.21.15.72:0/22211269 >> 172.21.15.72:0/22211269 conn(0x7f1ff41004f0 msgr2=0x7f1ff4192c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:57:58.390 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:57.377+0000 7f1ffb3a5700 1 -- 172.21.15.72:0/22211269 shutdown_connections 2024-03-30T14:57:58.390 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:57.377+0000 7f1ffb3a5700 1 -- 172.21.15.72:0/22211269 wait complete. 2024-03-30T14:57:58.390 INFO:teuthology.orchestra.run.smithi072.stdout:Deploying unmanaged mgr service... 2024-03-30T14:57:58.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:58 smithi072 bash[21573]: audit 2024-03-30T14:57:57.370298+0000 mgr.y (mgr.14120) 16 : audit 0 from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:57:58.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:58 smithi072 bash[21573]: cephadm 2024-03-30T14:57:57.373573+0000 mgr.y (mgr.14120) 17 : cephadm 1 Saving service mon spec with placement count:5 2024-03-30T14:57:58.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:58 smithi072 bash[21573]: audit 2024-03-30T14:57:57.377439+0000 mon.a (mon.0) 64 : audit 1 from='mgr.14120 172.21.15.72:0/2951874849' entity='mgr.y' 2024-03-30T14:57:58.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:58 smithi072 bash[21573]: audit 2024-03-30T14:57:58.100162+0000 mon.a (mon.0) 65 : audit 1 from='mgr.14120 172.21.15.72:0/2951874849' entity='mgr.y' 2024-03-30T14:57:59.913 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:59 smithi072 bash[21573]: cluster 2024-03-30T14:57:58.598104+0000 mgr.y (mgr.14120) 18 : cluster 0 pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:57:59.913 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:57:59 smithi072 bash[21573]: audit 2024-03-30T14:57:58.638645+0000 mon.a (mon.0) 66 : audit 1 from='mgr.14120 172.21.15.72:0/2951874849' entity='mgr.y' 2024-03-30T14:58:00.345 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-03-30T14:58:00.345 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.269+0000 7f69f8fc9700 1 Processor -- start 2024-03-30T14:58:00.345 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.269+0000 7f69f8fc9700 1 -- start start 2024-03-30T14:58:00.345 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.273+0000 7f69f8fc9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69f407b700 0x7f69f4079b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:58:00.345 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.273+0000 7f69f8fc9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f69f407a130 con 0x7f69f407b700 2024-03-30T14:58:00.345 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.273+0000 7f69f259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69f407b700 0x7f69f4079b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:58:00.345 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.273+0000 7f69f259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69f407b700 0x7f69f4079b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33774/0 (socket says 172.21.15.72:33774) 2024-03-30T14:58:00.345 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.273+0000 7f69f259c700 1 -- 172.21.15.72:0/1289237056 learned_addr learned my addr 172.21.15.72:0/1289237056 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:58:00.346 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.273+0000 7f69f259c700 1 -- 172.21.15.72:0/1289237056 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f407a2b0 con 0x7f69f407b700 2024-03-30T14:58:00.346 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.273+0000 7f69f259c700 1 --2- 172.21.15.72:0/1289237056 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69f407b700 0x7f69f4079b60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f69e80098a0 tx=0x7f69e8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b859a94c2b8fdfe7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:58:00.346 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.273+0000 7f69f159a700 1 -- 172.21.15.72:0/1289237056 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69e8004160 con 0x7f69f407b700 2024-03-30T14:58:00.346 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.273+0000 7f69f159a700 1 -- 172.21.15.72:0/1289237056 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f69e8004300 con 0x7f69f407b700 2024-03-30T14:58:00.346 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.273+0000 7f69f159a700 1 -- 172.21.15.72:0/1289237056 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69e80118f0 con 0x7f69f407b700 2024-03-30T14:58:00.346 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.273+0000 7f69f8fc9700 1 -- 172.21.15.72:0/1289237056 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69f407b700 msgr2=0x7f69f4079b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:58:00.346 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.273+0000 7f69f8fc9700 1 --2- 172.21.15.72:0/1289237056 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69f407b700 0x7f69f4079b60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f69e80098a0 tx=0x7f69e8009bb0 comp rx=0 tx=0).stop 2024-03-30T14:58:00.346 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.273+0000 7f69f8fc9700 1 -- 172.21.15.72:0/1289237056 shutdown_connections 2024-03-30T14:58:00.346 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.273+0000 7f69f8fc9700 1 --2- 172.21.15.72:0/1289237056 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69f407b700 0x7f69f4079b60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:58:00.346 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.273+0000 7f69f8fc9700 1 -- 172.21.15.72:0/1289237056 >> 172.21.15.72:0/1289237056 conn(0x7f69f4101630 msgr2=0x7f69f4103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:58:00.346 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.273+0000 7f69f8fc9700 1 -- 172.21.15.72:0/1289237056 shutdown_connections 2024-03-30T14:58:00.346 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.273+0000 7f69f8fc9700 1 -- 172.21.15.72:0/1289237056 wait complete. 2024-03-30T14:58:00.346 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.273+0000 7f69f8fc9700 1 Processor -- start 2024-03-30T14:58:00.347 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.273+0000 7f69f8fc9700 1 -- start start 2024-03-30T14:58:00.347 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.273+0000 7f69f8fc9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69f407b700 0x7f69f419c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:58:00.347 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.273+0000 7f69f8fc9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f69f410c530 con 0x7f69f407b700 2024-03-30T14:58:00.347 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.273+0000 7f69f259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69f407b700 0x7f69f419c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:58:00.347 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.273+0000 7f69f259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69f407b700 0x7f69f419c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33786/0 (socket says 172.21.15.72:33786) 2024-03-30T14:58:00.347 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.273+0000 7f69f259c700 1 -- 172.21.15.72:0/3657185148 learned_addr learned my addr 172.21.15.72:0/3657185148 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:58:00.347 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.273+0000 7f69f259c700 1 -- 172.21.15.72:0/3657185148 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f419c550 con 0x7f69f407b700 2024-03-30T14:58:00.347 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.273+0000 7f69f259c700 1 --2- 172.21.15.72:0/3657185148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69f407b700 0x7f69f419c010 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f69e8003f60 tx=0x7f69e80119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:58:00.347 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.273+0000 7f69e37fe700 1 -- 172.21.15.72:0/3657185148 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69e8003a40 con 0x7f69f407b700 2024-03-30T14:58:00.347 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.273+0000 7f69e37fe700 1 -- 172.21.15.72:0/3657185148 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f69e80248b0 con 0x7f69f407b700 2024-03-30T14:58:00.347 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.273+0000 7f69f8fc9700 1 -- 172.21.15.72:0/3657185148 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69f419c7e0 con 0x7f69f407b700 2024-03-30T14:58:00.347 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.277+0000 7f69e37fe700 1 -- 172.21.15.72:0/3657185148 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69e801a780 con 0x7f69f407b700 2024-03-30T14:58:00.347 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.277+0000 7f69f8fc9700 1 -- 172.21.15.72:0/3657185148 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69f419f4d0 con 0x7f69f407b700 2024-03-30T14:58:00.347 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.277+0000 7f69e37fe700 1 -- 172.21.15.72:0/3657185148 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) ==== 46116+0+0 (secure 0 0 0) 0x7f69e8024430 con 0x7f69f407b700 2024-03-30T14:58:00.347 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.277+0000 7f69e37fe700 1 --2- 172.21.15.72:0/3657185148 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f69dc038db0 0x7f69dc03b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:58:00.348 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.277+0000 7f69e37fe700 1 -- 172.21.15.72:0/3657185148 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f69e804d1e0 con 0x7f69f407b700 2024-03-30T14:58:00.348 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.277+0000 7f69f1d9b700 1 --2- 172.21.15.72:0/3657185148 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f69dc038db0 0x7f69dc03b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:58:00.348 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.277+0000 7f69f8fc9700 1 -- 172.21.15.72:0/3657185148 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69f4063870 con 0x7f69f407b700 2024-03-30T14:58:00.348 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.277+0000 7f69f1d9b700 1 --2- 172.21.15.72:0/3657185148 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f69dc038db0 0x7f69dc03b270 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f69e4006fd0 tx=0x7f69e4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:58:00.348 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.281+0000 7f69e37fe700 1 -- 172.21.15.72:0/3657185148 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f69e804cec0 con 0x7f69f407b700 2024-03-30T14:58:00.348 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.669+0000 7f69f8fc9700 1 -- 172.21.15.72:0/3657185148 --> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f69f4102830 con 0x7f69dc038db0 2024-03-30T14:58:00.348 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.677+0000 7f69e37fe700 1 -- 172.21.15.72:0/3657185148 <== mgr.14120 v2:172.21.15.72:6800/3069476432 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f69f4102830 con 0x7f69dc038db0 2024-03-30T14:58:00.348 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.681+0000 7f69f8fc9700 1 -- 172.21.15.72:0/3657185148 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f69dc038db0 msgr2=0x7f69dc03b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:58:00.348 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.681+0000 7f69f8fc9700 1 --2- 172.21.15.72:0/3657185148 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f69dc038db0 0x7f69dc03b270 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f69e4006fd0 tx=0x7f69e4006e40 comp rx=0 tx=0).stop 2024-03-30T14:58:00.348 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.681+0000 7f69f8fc9700 1 -- 172.21.15.72:0/3657185148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69f407b700 msgr2=0x7f69f419c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:58:00.348 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.681+0000 7f69f8fc9700 1 --2- 172.21.15.72:0/3657185148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69f407b700 0x7f69f419c010 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f69e8003f60 tx=0x7f69e80119b0 comp rx=0 tx=0).stop 2024-03-30T14:58:00.348 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.681+0000 7f69f8fc9700 1 -- 172.21.15.72:0/3657185148 shutdown_connections 2024-03-30T14:58:00.348 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.681+0000 7f69f8fc9700 1 --2- 172.21.15.72:0/3657185148 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f69dc038db0 0x7f69dc03b270 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:58:00.348 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.681+0000 7f69f8fc9700 1 --2- 172.21.15.72:0/3657185148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69f407b700 0x7f69f419c010 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:58:00.349 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.681+0000 7f69f8fc9700 1 -- 172.21.15.72:0/3657185148 >> 172.21.15.72:0/3657185148 conn(0x7f69f4101630 msgr2=0x7f69f4102120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:58:00.349 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.681+0000 7f69f8fc9700 1 -- 172.21.15.72:0/3657185148 shutdown_connections 2024-03-30T14:58:00.349 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:57:59.681+0000 7f69f8fc9700 1 -- 172.21.15.72:0/3657185148 wait complete. 2024-03-30T14:58:01.016 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:00 smithi072 bash[21573]: audit 2024-03-30T14:57:59.677154+0000 mgr.y (mgr.14120) 19 : audit 0 from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:58:01.017 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:00 smithi072 bash[21573]: cephadm 2024-03-30T14:57:59.679685+0000 mgr.y (mgr.14120) 20 : cephadm 1 Saving service mgr spec with placement count:2 2024-03-30T14:58:01.017 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:00 smithi072 bash[21573]: audit 2024-03-30T14:57:59.682861+0000 mon.a (mon.0) 67 : audit 1 from='mgr.14120 172.21.15.72:0/2951874849' entity='mgr.y' 2024-03-30T14:58:01.017 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:00 smithi072 bash[21573]: cluster 2024-03-30T14:58:00.598556+0000 mgr.y (mgr.14120) 21 : cluster 0 pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:58:02.232 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.225+0000 7f7ad1ba7700 1 Processor -- start 2024-03-30T14:58:02.232 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.225+0000 7f7ad1ba7700 1 -- start start 2024-03-30T14:58:02.232 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.229+0000 7f7ad1ba7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7acc07b720 0x7f7acc079b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:58:02.232 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.229+0000 7f7ad1ba7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7acc07a150 con 0x7f7acc07b720 2024-03-30T14:58:02.232 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.229+0000 7f7acb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7acc07b720 0x7f7acc079b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:58:02.232 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.229+0000 7f7acb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7acc07b720 0x7f7acc079b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33798/0 (socket says 172.21.15.72:33798) 2024-03-30T14:58:02.233 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.229+0000 7f7acb7fe700 1 -- 172.21.15.72:0/3809121784 learned_addr learned my addr 172.21.15.72:0/3809121784 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:58:02.233 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.229+0000 7f7acb7fe700 1 -- 172.21.15.72:0/3809121784 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7acc07a2d0 con 0x7f7acc07b720 2024-03-30T14:58:02.233 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.229+0000 7f7acb7fe700 1 --2- 172.21.15.72:0/3809121784 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7acc07b720 0x7f7acc079b80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7abc009e80 tx=0x7f7abc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94eac0cb2c86419f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:58:02.233 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.229+0000 7f7aca7fc700 1 -- 172.21.15.72:0/3809121784 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7abc017070 con 0x7f7acc07b720 2024-03-30T14:58:02.233 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.229+0000 7f7aca7fc700 1 -- 172.21.15.72:0/3809121784 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f7abc00b8c0 con 0x7f7acc07b720 2024-03-30T14:58:02.233 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.229+0000 7f7aca7fc700 1 -- 172.21.15.72:0/3809121784 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7abc004370 con 0x7f7acc07b720 2024-03-30T14:58:02.233 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.229+0000 7f7ad1ba7700 1 -- 172.21.15.72:0/3809121784 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7acc07b720 msgr2=0x7f7acc079b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:58:02.233 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.229+0000 7f7ad1ba7700 1 --2- 172.21.15.72:0/3809121784 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7acc07b720 0x7f7acc079b80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7abc009e80 tx=0x7f7abc00b330 comp rx=0 tx=0).stop 2024-03-30T14:58:02.233 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.229+0000 7f7ad1ba7700 1 -- 172.21.15.72:0/3809121784 shutdown_connections 2024-03-30T14:58:02.233 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.229+0000 7f7ad1ba7700 1 --2- 172.21.15.72:0/3809121784 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7acc07b720 0x7f7acc079b80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:58:02.233 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.229+0000 7f7ad1ba7700 1 -- 172.21.15.72:0/3809121784 >> 172.21.15.72:0/3809121784 conn(0x7f7acc1015d0 msgr2=0x7f7acc1039f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:58:02.233 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.229+0000 7f7ad1ba7700 1 -- 172.21.15.72:0/3809121784 shutdown_connections 2024-03-30T14:58:02.233 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.229+0000 7f7ad1ba7700 1 -- 172.21.15.72:0/3809121784 wait complete. 2024-03-30T14:58:02.234 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.229+0000 7f7ad1ba7700 1 Processor -- start 2024-03-30T14:58:02.234 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.229+0000 7f7ad1ba7700 1 -- start start 2024-03-30T14:58:02.234 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.229+0000 7f7ad1ba7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7acc07b720 0x7f7acc19bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:58:02.234 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.229+0000 7f7ad1ba7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7acc10c510 con 0x7f7acc07b720 2024-03-30T14:58:02.234 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.229+0000 7f7acb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7acc07b720 0x7f7acc19bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:58:02.234 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.229+0000 7f7acb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7acc07b720 0x7f7acc19bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33810/0 (socket says 172.21.15.72:33810) 2024-03-30T14:58:02.234 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.229+0000 7f7acb7fe700 1 -- 172.21.15.72:0/646317961 learned_addr learned my addr 172.21.15.72:0/646317961 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:58:02.234 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.229+0000 7f7acb7fe700 1 -- 172.21.15.72:0/646317961 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7acc19c500 con 0x7f7acc07b720 2024-03-30T14:58:02.234 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.229+0000 7f7acb7fe700 1 --2- 172.21.15.72:0/646317961 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7acc07b720 0x7f7acc19bfc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7abc00bfa0 tx=0x7f7abc003c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:58:02.234 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.229+0000 7f7ac8ff9700 1 -- 172.21.15.72:0/646317961 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7abc021020 con 0x7f7acc07b720 2024-03-30T14:58:02.234 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.229+0000 7f7ac8ff9700 1 -- 172.21.15.72:0/646317961 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f7abc00ba70 con 0x7f7acc07b720 2024-03-30T14:58:02.234 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.229+0000 7f7ac8ff9700 1 -- 172.21.15.72:0/646317961 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7abc017040 con 0x7f7acc07b720 2024-03-30T14:58:02.234 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.229+0000 7f7ad1ba7700 1 -- 172.21.15.72:0/646317961 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7acc19c790 con 0x7f7acc07b720 2024-03-30T14:58:02.235 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.229+0000 7f7ad1ba7700 1 -- 172.21.15.72:0/646317961 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7acc19f480 con 0x7f7acc07b720 2024-03-30T14:58:02.235 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.233+0000 7f7ac8ff9700 1 -- 172.21.15.72:0/646317961 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) ==== 46116+0+0 (secure 0 0 0) 0x7f7abc024020 con 0x7f7acc07b720 2024-03-30T14:58:02.235 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.233+0000 7f7ac8ff9700 1 --2- 172.21.15.72:0/646317961 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f7ab4038e50 0x7f7ab403b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:58:02.235 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.233+0000 7f7ac8ff9700 1 -- 172.21.15.72:0/646317961 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f7abc00f050 con 0x7f7acc07b720 2024-03-30T14:58:02.235 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.233+0000 7f7ad1ba7700 1 -- 172.21.15.72:0/646317961 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7acc063870 con 0x7f7acc07b720 2024-03-30T14:58:02.235 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.233+0000 7f7acaffd700 1 --2- 172.21.15.72:0/646317961 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f7ab4038e50 0x7f7ab403b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:58:02.235 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.233+0000 7f7acaffd700 1 --2- 172.21.15.72:0/646317961 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f7ab4038e50 0x7f7ab403b310 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0006fd0 tx=0x7f7ac0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:58:02.235 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.237+0000 7f7ac8ff9700 1 -- 172.21.15.72:0/646317961 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f7abc02b020 con 0x7f7acc07b720 2024-03-30T14:58:02.235 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.597+0000 7f7ad1ba7700 1 -- 172.21.15.72:0/646317961 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f7acc19f820 con 0x7f7acc07b720 2024-03-30T14:58:02.235 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.601+0000 7f7ac8ff9700 1 -- 172.21.15.72:0/646317961 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f7abc018280 con 0x7f7acc07b720 2024-03-30T14:58:02.235 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.605+0000 7f7ad1ba7700 1 -- 172.21.15.72:0/646317961 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f7ab4038e50 msgr2=0x7f7ab403b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:58:02.235 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.605+0000 7f7ad1ba7700 1 --2- 172.21.15.72:0/646317961 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f7ab4038e50 0x7f7ab403b310 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0006fd0 tx=0x7f7ac0006e40 comp rx=0 tx=0).stop 2024-03-30T14:58:02.235 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.605+0000 7f7ad1ba7700 1 -- 172.21.15.72:0/646317961 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7acc07b720 msgr2=0x7f7acc19bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:58:02.235 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.605+0000 7f7ad1ba7700 1 --2- 172.21.15.72:0/646317961 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7acc07b720 0x7f7acc19bfc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7abc00bfa0 tx=0x7f7abc003c50 comp rx=0 tx=0).stop 2024-03-30T14:58:02.236 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.605+0000 7f7ad1ba7700 1 -- 172.21.15.72:0/646317961 shutdown_connections 2024-03-30T14:58:02.236 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.605+0000 7f7ad1ba7700 1 --2- 172.21.15.72:0/646317961 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f7ab4038e50 0x7f7ab403b310 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:58:02.236 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.605+0000 7f7ad1ba7700 1 --2- 172.21.15.72:0/646317961 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7acc07b720 0x7f7acc19bfc0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:58:02.236 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.605+0000 7f7ad1ba7700 1 -- 172.21.15.72:0/646317961 >> 172.21.15.72:0/646317961 conn(0x7f7acc1015d0 msgr2=0x7f7acc102130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:58:02.236 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.605+0000 7f7ad1ba7700 1 -- 172.21.15.72:0/646317961 shutdown_connections 2024-03-30T14:58:02.236 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:01.605+0000 7f7ad1ba7700 1 -- 172.21.15.72:0/646317961 wait complete. 2024-03-30T14:58:02.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:02 smithi072 bash[21573]: audit 2024-03-30T14:58:01.606684+0000 mon.a (mon.0) 68 : audit 1 from='client.? 172.21.15.72:0/646317961' entity='client.admin' 2024-03-30T14:58:02.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:02 smithi072 bash[21573]: cluster 2024-03-30T14:58:02.599034+0000 mgr.y (mgr.14120) 22 : cluster 0 pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:58:04.102 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.141+0000 7fb5ce79f700 1 Processor -- start 2024-03-30T14:58:04.103 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.141+0000 7fb5ce79f700 1 -- start start 2024-03-30T14:58:04.103 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.141+0000 7fb5ce79f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5c8106020 0x7fb5c8106440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:58:04.103 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.141+0000 7fb5ce79f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c8106a10 con 0x7fb5c8106020 2024-03-30T14:58:04.103 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.141+0000 7fb5c7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5c8106020 0x7fb5c8106440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:58:04.103 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.141+0000 7fb5c7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5c8106020 0x7fb5c8106440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33820/0 (socket says 172.21.15.72:33820) 2024-03-30T14:58:04.103 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.141+0000 7fb5c7fff700 1 -- 172.21.15.72:0/3148385802 learned_addr learned my addr 172.21.15.72:0/3148385802 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:58:04.104 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.141+0000 7fb5c7fff700 1 -- 172.21.15.72:0/3148385802 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5c8107220 con 0x7fb5c8106020 2024-03-30T14:58:04.104 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.141+0000 7fb5c7fff700 1 --2- 172.21.15.72:0/3148385802 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5c8106020 0x7fb5c8106440 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb5b8009e80 tx=0x7fb5b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=634bb69df257101f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:58:04.104 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.141+0000 7fb5c6ffd700 1 -- 172.21.15.72:0/3148385802 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5b8017070 con 0x7fb5c8106020 2024-03-30T14:58:04.104 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.141+0000 7fb5c6ffd700 1 -- 172.21.15.72:0/3148385802 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7fb5b800b8c0 con 0x7fb5c8106020 2024-03-30T14:58:04.104 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.141+0000 7fb5c6ffd700 1 -- 172.21.15.72:0/3148385802 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5b8004370 con 0x7fb5c8106020 2024-03-30T14:58:04.104 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.145+0000 7fb5ce79f700 1 -- 172.21.15.72:0/3148385802 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5c8106020 msgr2=0x7fb5c8106440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:58:04.104 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.145+0000 7fb5ce79f700 1 --2- 172.21.15.72:0/3148385802 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5c8106020 0x7fb5c8106440 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb5b8009e80 tx=0x7fb5b800b330 comp rx=0 tx=0).stop 2024-03-30T14:58:04.104 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.145+0000 7fb5ce79f700 1 -- 172.21.15.72:0/3148385802 shutdown_connections 2024-03-30T14:58:04.104 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.145+0000 7fb5ce79f700 1 --2- 172.21.15.72:0/3148385802 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5c8106020 0x7fb5c8106440 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:58:04.104 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.145+0000 7fb5ce79f700 1 -- 172.21.15.72:0/3148385802 >> 172.21.15.72:0/3148385802 conn(0x7fb5c8101600 msgr2=0x7fb5c8103a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:58:04.104 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.145+0000 7fb5ce79f700 1 -- 172.21.15.72:0/3148385802 shutdown_connections 2024-03-30T14:58:04.104 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.145+0000 7fb5ce79f700 1 -- 172.21.15.72:0/3148385802 wait complete. 2024-03-30T14:58:04.104 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.145+0000 7fb5ce79f700 1 Processor -- start 2024-03-30T14:58:04.104 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.145+0000 7fb5ce79f700 1 -- start start 2024-03-30T14:58:04.105 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.145+0000 7fb5ce79f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5c8106020 0x7fb5c8199eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:58:04.105 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.145+0000 7fb5ce79f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c810a450 con 0x7fb5c8106020 2024-03-30T14:58:04.105 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.145+0000 7fb5c7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5c8106020 0x7fb5c8199eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:58:04.105 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.145+0000 7fb5c7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5c8106020 0x7fb5c8199eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33824/0 (socket says 172.21.15.72:33824) 2024-03-30T14:58:04.105 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.145+0000 7fb5c7fff700 1 -- 172.21.15.72:0/1725003700 learned_addr learned my addr 172.21.15.72:0/1725003700 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:58:04.105 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.145+0000 7fb5c7fff700 1 -- 172.21.15.72:0/1725003700 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5c819a3f0 con 0x7fb5c8106020 2024-03-30T14:58:04.105 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.145+0000 7fb5c7fff700 1 --2- 172.21.15.72:0/1725003700 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5c8106020 0x7fb5c8199eb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb5b8009e50 tx=0x7fb5b80044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:58:04.105 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.145+0000 7fb5c57fa700 1 -- 172.21.15.72:0/1725003700 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5b8021020 con 0x7fb5c8106020 2024-03-30T14:58:04.105 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.145+0000 7fb5c57fa700 1 -- 172.21.15.72:0/1725003700 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7fb5b8003b50 con 0x7fb5c8106020 2024-03-30T14:58:04.105 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.145+0000 7fb5c57fa700 1 -- 172.21.15.72:0/1725003700 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5b8017040 con 0x7fb5c8106020 2024-03-30T14:58:04.105 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.145+0000 7fb5ce79f700 1 -- 172.21.15.72:0/1725003700 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5c819a680 con 0x7fb5c8106020 2024-03-30T14:58:04.105 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.145+0000 7fb5ce79f700 1 -- 172.21.15.72:0/1725003700 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5c819d370 con 0x7fb5c8106020 2024-03-30T14:58:04.105 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.145+0000 7fb5c57fa700 1 -- 172.21.15.72:0/1725003700 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) ==== 46116+0+0 (secure 0 0 0) 0x7fb5b8024020 con 0x7fb5c8106020 2024-03-30T14:58:04.105 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.145+0000 7fb5ce79f700 1 -- 172.21.15.72:0/1725003700 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5c8063870 con 0x7fb5c8106020 2024-03-30T14:58:04.106 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.145+0000 7fb5c57fa700 1 --2- 172.21.15.72:0/1725003700 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7fb5b4038e00 0x7fb5b403b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:58:04.106 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.145+0000 7fb5c57fa700 1 -- 172.21.15.72:0/1725003700 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb5b800f050 con 0x7fb5c8106020 2024-03-30T14:58:04.106 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.145+0000 7fb5c77fe700 1 --2- 172.21.15.72:0/1725003700 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7fb5b4038e00 0x7fb5b403b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:58:04.106 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.145+0000 7fb5c77fe700 1 --2- 172.21.15.72:0/1725003700 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7fb5b4038e00 0x7fb5b403b2c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0006fd0 tx=0x7fb5b0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:58:04.106 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.153+0000 7fb5c57fa700 1 -- 172.21.15.72:0/1725003700 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fb5b802b020 con 0x7fb5c8106020 2024-03-30T14:58:04.106 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.501+0000 7fb5ce79f700 1 -- 172.21.15.72:0/1725003700 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7fb5c819d780 con 0x7fb5c8106020 2024-03-30T14:58:04.106 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.509+0000 7fb5c57fa700 1 -- 172.21.15.72:0/1725003700 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7fb5b804cba0 con 0x7fb5c8106020 2024-03-30T14:58:04.106 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.509+0000 7fb5ce79f700 1 -- 172.21.15.72:0/1725003700 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7fb5b4038e00 msgr2=0x7fb5b403b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:58:04.106 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.509+0000 7fb5ce79f700 1 --2- 172.21.15.72:0/1725003700 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7fb5b4038e00 0x7fb5b403b2c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0006fd0 tx=0x7fb5b0006e40 comp rx=0 tx=0).stop 2024-03-30T14:58:04.106 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.509+0000 7fb5ce79f700 1 -- 172.21.15.72:0/1725003700 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5c8106020 msgr2=0x7fb5c8199eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:58:04.106 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.509+0000 7fb5ce79f700 1 --2- 172.21.15.72:0/1725003700 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5c8106020 0x7fb5c8199eb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb5b8009e50 tx=0x7fb5b80044c0 comp rx=0 tx=0).stop 2024-03-30T14:58:04.106 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.509+0000 7fb5ce79f700 1 -- 172.21.15.72:0/1725003700 shutdown_connections 2024-03-30T14:58:04.106 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.509+0000 7fb5ce79f700 1 --2- 172.21.15.72:0/1725003700 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7fb5b4038e00 0x7fb5b403b2c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:58:04.106 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.509+0000 7fb5ce79f700 1 --2- 172.21.15.72:0/1725003700 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5c8106020 0x7fb5c8199eb0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:58:04.107 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.509+0000 7fb5ce79f700 1 -- 172.21.15.72:0/1725003700 >> 172.21.15.72:0/1725003700 conn(0x7fb5c8101600 msgr2=0x7fb5c81020f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:58:04.107 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.509+0000 7fb5ce79f700 1 -- 172.21.15.72:0/1725003700 shutdown_connections 2024-03-30T14:58:04.107 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:03.509+0000 7fb5ce79f700 1 -- 172.21.15.72:0/1725003700 wait complete. 2024-03-30T14:58:04.107 INFO:teuthology.orchestra.run.smithi072.stdout:Enabling the dashboard module... 2024-03-30T14:58:04.765 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:04 smithi072 bash[21573]: audit 2024-03-30T14:58:03.513075+0000 mon.a (mon.0) 69 : audit 1 from='client.? 172.21.15.72:0/1725003700' entity='client.admin' 2024-03-30T14:58:05.933 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:05 smithi072 bash[21573]: cluster 2024-03-30T14:58:04.599442+0000 mgr.y (mgr.14120) 23 : cluster 0 pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:58:05.933 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:05 smithi072 bash[21573]: audit 2024-03-30T14:58:05.450748+0000 mon.a (mon.0) 70 : audit 1 from='client.? 172.21.15.72:0/188694323' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-03-30T14:58:05.933 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:58:05 smithi072 bash[21828]: ignoring --setuser ceph since I am not root 2024-03-30T14:58:05.933 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:58:05 smithi072 bash[21828]: ignoring --setgroup ceph since I am not root 2024-03-30T14:58:05.933 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:58:05 smithi072 bash[21828]: debug 2024-03-30T14:58:05.709+0000 7f68268b5200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-30T14:58:06.272 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:04.969+0000 7f1716bfd700 1 Processor -- start 2024-03-30T14:58:06.272 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:04.969+0000 7f1716bfd700 1 -- start start 2024-03-30T14:58:06.272 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:04.969+0000 7f1716bfd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1710108220 0x7f1710108640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:58:06.272 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:04.969+0000 7f1716bfd700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1710108c10 con 0x7f1710108220 2024-03-30T14:58:06.272 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:04.973+0000 7f1714999700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1710108220 0x7f1710108640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:58:06.272 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:04.973+0000 7f1714999700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1710108220 0x7f1710108640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33836/0 (socket says 172.21.15.72:33836) 2024-03-30T14:58:06.272 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:04.973+0000 7f1714999700 1 -- 172.21.15.72:0/3036947834 learned_addr learned my addr 172.21.15.72:0/3036947834 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:58:06.273 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:04.973+0000 7f1714999700 1 -- 172.21.15.72:0/3036947834 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1710109420 con 0x7f1710108220 2024-03-30T14:58:06.273 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:04.973+0000 7f1714999700 1 --2- 172.21.15.72:0/3036947834 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1710108220 0x7f1710108640 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f17000098a0 tx=0x7f1700009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f80ce625cd83c98f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:58:06.273 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:04.973+0000 7f170f7fe700 1 -- 172.21.15.72:0/3036947834 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1700004160 con 0x7f1710108220 2024-03-30T14:58:06.273 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:04.973+0000 7f170f7fe700 1 -- 172.21.15.72:0/3036947834 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f1700004300 con 0x7f1710108220 2024-03-30T14:58:06.273 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:04.973+0000 7f170f7fe700 1 -- 172.21.15.72:0/3036947834 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17000118f0 con 0x7f1710108220 2024-03-30T14:58:06.273 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:04.973+0000 7f1716bfd700 1 -- 172.21.15.72:0/3036947834 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1710108220 msgr2=0x7f1710108640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:58:06.273 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:04.973+0000 7f1716bfd700 1 --2- 172.21.15.72:0/3036947834 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1710108220 0x7f1710108640 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f17000098a0 tx=0x7f1700009bb0 comp rx=0 tx=0).stop 2024-03-30T14:58:06.273 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:04.973+0000 7f1716bfd700 1 -- 172.21.15.72:0/3036947834 shutdown_connections 2024-03-30T14:58:06.273 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:04.973+0000 7f1716bfd700 1 --2- 172.21.15.72:0/3036947834 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1710108220 0x7f1710108640 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:58:06.273 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:04.973+0000 7f1716bfd700 1 -- 172.21.15.72:0/3036947834 >> 172.21.15.72:0/3036947834 conn(0x7f171007b610 msgr2=0x7f1710105d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:58:06.273 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:04.973+0000 7f1716bfd700 1 -- 172.21.15.72:0/3036947834 shutdown_connections 2024-03-30T14:58:06.273 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:04.973+0000 7f1716bfd700 1 -- 172.21.15.72:0/3036947834 wait complete. 2024-03-30T14:58:06.273 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:04.973+0000 7f1716bfd700 1 Processor -- start 2024-03-30T14:58:06.273 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:04.973+0000 7f1716bfd700 1 -- start start 2024-03-30T14:58:06.274 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:04.973+0000 7f1716bfd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1710108220 0x7f171019c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:58:06.274 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:04.973+0000 7f1716bfd700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f171010c650 con 0x7f1710108220 2024-03-30T14:58:06.274 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:04.973+0000 7f1714999700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1710108220 0x7f171019c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:58:06.274 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:04.973+0000 7f1714999700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1710108220 0x7f171019c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33848/0 (socket says 172.21.15.72:33848) 2024-03-30T14:58:06.274 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:04.973+0000 7f1714999700 1 -- 172.21.15.72:0/188694323 learned_addr learned my addr 172.21.15.72:0/188694323 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:58:06.274 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:04.973+0000 7f1714999700 1 -- 172.21.15.72:0/188694323 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f171019c5b0 con 0x7f1710108220 2024-03-30T14:58:06.274 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:04.973+0000 7f1714999700 1 --2- 172.21.15.72:0/188694323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1710108220 0x7f171019c070 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1700009fb0 tx=0x7f1700011a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:58:06.274 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:04.973+0000 7f170dffb700 1 -- 172.21.15.72:0/188694323 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f170001a430 con 0x7f1710108220 2024-03-30T14:58:06.274 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:04.973+0000 7f170dffb700 1 -- 172.21.15.72:0/188694323 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f170001aa50 con 0x7f1710108220 2024-03-30T14:58:06.274 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:04.973+0000 7f170dffb700 1 -- 172.21.15.72:0/188694323 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1700019800 con 0x7f1710108220 2024-03-30T14:58:06.274 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:04.973+0000 7f1716bfd700 1 -- 172.21.15.72:0/188694323 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f171019c840 con 0x7f1710108220 2024-03-30T14:58:06.275 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:04.973+0000 7f1716bfd700 1 -- 172.21.15.72:0/188694323 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f171019f530 con 0x7f1710108220 2024-03-30T14:58:06.275 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:04.977+0000 7f170dffb700 1 -- 172.21.15.72:0/188694323 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) ==== 46116+0+0 (secure 0 0 0) 0x7f1700022020 con 0x7f1710108220 2024-03-30T14:58:06.275 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:04.977+0000 7f1716bfd700 1 -- 172.21.15.72:0/188694323 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1710063870 con 0x7f1710108220 2024-03-30T14:58:06.275 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:04.977+0000 7f170dffb700 1 --2- 172.21.15.72:0/188694323 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f16f8038db0 0x7f16f803b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:58:06.275 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:04.977+0000 7f170dffb700 1 -- 172.21.15.72:0/188694323 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f170004cef0 con 0x7f1710108220 2024-03-30T14:58:06.275 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:04.977+0000 7f170ffff700 1 --2- 172.21.15.72:0/188694323 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f16f8038db0 0x7f16f803b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:58:06.275 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:04.977+0000 7f170ffff700 1 --2- 172.21.15.72:0/188694323 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f16f8038db0 0x7f16f803b270 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1704006fd0 tx=0x7f1704006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:58:06.275 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:04.981+0000 7f170dffb700 1 -- 172.21.15.72:0/188694323 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f170002b350 con 0x7f1710108220 2024-03-30T14:58:06.275 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:05.445+0000 7f1716bfd700 1 -- 172.21.15.72:0/188694323 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f171019f910 con 0x7f1710108220 2024-03-30T14:58:06.275 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:05.513+0000 7f170dffb700 1 -- 172.21.15.72:0/188694323 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f17000172b0 con 0x7f1710108220 2024-03-30T14:58:06.275 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:05.517+0000 7f170dffb700 1 -- 172.21.15.72:0/188694323 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mgrmap(e 9) ==== 46129+0+0 (secure 0 0 0) 0x7f170001a5d0 con 0x7f1710108220 2024-03-30T14:58:06.275 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:05.517+0000 7f1716bfd700 1 -- 172.21.15.72:0/188694323 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f16f8038db0 msgr2=0x7f16f803b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:58:06.275 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:05.517+0000 7f1716bfd700 1 --2- 172.21.15.72:0/188694323 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f16f8038db0 0x7f16f803b270 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1704006fd0 tx=0x7f1704006e40 comp rx=0 tx=0).stop 2024-03-30T14:58:06.275 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:05.517+0000 7f1716bfd700 1 -- 172.21.15.72:0/188694323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1710108220 msgr2=0x7f171019c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:58:06.276 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:05.517+0000 7f1716bfd700 1 --2- 172.21.15.72:0/188694323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1710108220 0x7f171019c070 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1700009fb0 tx=0x7f1700011a20 comp rx=0 tx=0).stop 2024-03-30T14:58:06.276 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:05.517+0000 7f1716bfd700 1 -- 172.21.15.72:0/188694323 shutdown_connections 2024-03-30T14:58:06.276 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:05.517+0000 7f1716bfd700 1 --2- 172.21.15.72:0/188694323 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f16f8038db0 0x7f16f803b270 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:58:06.276 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:05.517+0000 7f1716bfd700 1 --2- 172.21.15.72:0/188694323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1710108220 0x7f171019c070 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:58:06.276 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:05.517+0000 7f1716bfd700 1 -- 172.21.15.72:0/188694323 >> 172.21.15.72:0/188694323 conn(0x7f171007b610 msgr2=0x7f17101054f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:58:06.276 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:05.517+0000 7f1716bfd700 1 -- 172.21.15.72:0/188694323 shutdown_connections 2024-03-30T14:58:06.276 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:05.517+0000 7f1716bfd700 1 -- 172.21.15.72:0/188694323 wait complete. 2024-03-30T14:58:06.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:06 smithi072 bash[21573]: audit 2024-03-30T14:58:05.517357+0000 mon.a (mon.0) 71 : audit 1 from='client.? 172.21.15.72:0/188694323' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-03-30T14:58:06.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:06 smithi072 bash[21573]: cluster 2024-03-30T14:58:05.522803+0000 mon.a (mon.0) 72 : cluster 0 mgrmap e9: y(active, since 26s) 2024-03-30T14:58:07.610 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:58:07 smithi072 bash[21828]: debug 2024-03-30T14:58:07.293+0000 7f68268b5200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-30T14:58:07.611 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:58:07 smithi072 bash[21828]: debug 2024-03-30T14:58:07.389+0000 7f68268b5200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-30T14:58:07.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:07 smithi072 bash[21573]: audit 2024-03-30T14:58:07.596787+0000 mon.a (mon.0) 73 : audit 0 from='client.? 172.21.15.72:0/1486303708' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-03-30T14:58:07.921 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:58:07 smithi072 bash[21828]: debug 2024-03-30T14:58:07.645+0000 7f68268b5200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-30T14:58:08.294 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout { 2024-03-30T14:58:08.294 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-03-30T14:58:08.294 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-30T14:58:08.295 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "active_name": "y", 2024-03-30T14:58:08.295 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-03-30T14:58:08.295 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout } 2024-03-30T14:58:08.295 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.121+0000 7f45134ba700 1 Processor -- start 2024-03-30T14:58:08.295 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.121+0000 7f45134ba700 1 -- start start 2024-03-30T14:58:08.295 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.121+0000 7f45134ba700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f450c07b6e0 0x7f450c079b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:58:08.295 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.121+0000 7f45134ba700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f450c07a110 con 0x7f450c07b6e0 2024-03-30T14:58:08.295 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.121+0000 7f4511256700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f450c07b6e0 0x7f450c079b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:58:08.295 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.121+0000 7f4511256700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f450c07b6e0 0x7f450c079b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59298/0 (socket says 172.21.15.72:59298) 2024-03-30T14:58:08.295 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.121+0000 7f4511256700 1 -- 172.21.15.72:0/3442616827 learned_addr learned my addr 172.21.15.72:0/3442616827 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:58:08.295 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.121+0000 7f4511256700 1 -- 172.21.15.72:0/3442616827 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f450c07a290 con 0x7f450c07b6e0 2024-03-30T14:58:08.295 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.121+0000 7f4511256700 1 --2- 172.21.15.72:0/3442616827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f450c07b6e0 0x7f450c079b40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f44fc0098a0 tx=0x7f44fc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2914b74d7a027b6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:58:08.296 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.121+0000 7f4503fff700 1 -- 172.21.15.72:0/3442616827 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44fc004160 con 0x7f450c07b6e0 2024-03-30T14:58:08.296 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.121+0000 7f4503fff700 1 -- 172.21.15.72:0/3442616827 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f44fc004300 con 0x7f450c07b6e0 2024-03-30T14:58:08.296 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.121+0000 7f4503fff700 1 -- 172.21.15.72:0/3442616827 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44fc0118f0 con 0x7f450c07b6e0 2024-03-30T14:58:08.296 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.121+0000 7f45134ba700 1 -- 172.21.15.72:0/3442616827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f450c07b6e0 msgr2=0x7f450c079b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:58:08.296 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.121+0000 7f45134ba700 1 --2- 172.21.15.72:0/3442616827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f450c07b6e0 0x7f450c079b40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f44fc0098a0 tx=0x7f44fc009bb0 comp rx=0 tx=0).stop 2024-03-30T14:58:08.296 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.121+0000 7f45134ba700 1 -- 172.21.15.72:0/3442616827 shutdown_connections 2024-03-30T14:58:08.296 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.121+0000 7f45134ba700 1 --2- 172.21.15.72:0/3442616827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f450c07b6e0 0x7f450c079b40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:58:08.296 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.121+0000 7f45134ba700 1 -- 172.21.15.72:0/3442616827 >> 172.21.15.72:0/3442616827 conn(0x7f450c1015f0 msgr2=0x7f450c103a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:58:08.296 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.121+0000 7f45134ba700 1 -- 172.21.15.72:0/3442616827 shutdown_connections 2024-03-30T14:58:08.296 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.121+0000 7f45134ba700 1 -- 172.21.15.72:0/3442616827 wait complete. 2024-03-30T14:58:08.296 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.121+0000 7f45134ba700 1 Processor -- start 2024-03-30T14:58:08.297 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.121+0000 7f45134ba700 1 -- start start 2024-03-30T14:58:08.297 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.125+0000 7f45134ba700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f450c07b6e0 0x7f450c19bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:58:08.297 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.125+0000 7f45134ba700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f450c10c530 con 0x7f450c07b6e0 2024-03-30T14:58:08.297 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.125+0000 7f4511256700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f450c07b6e0 0x7f450c19bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:58:08.297 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.125+0000 7f4511256700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f450c07b6e0 0x7f450c19bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59304/0 (socket says 172.21.15.72:59304) 2024-03-30T14:58:08.297 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.125+0000 7f4511256700 1 -- 172.21.15.72:0/1486303708 learned_addr learned my addr 172.21.15.72:0/1486303708 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:58:08.297 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.125+0000 7f4511256700 1 -- 172.21.15.72:0/1486303708 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f450c19c4e0 con 0x7f450c07b6e0 2024-03-30T14:58:08.297 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.125+0000 7f4511256700 1 --2- 172.21.15.72:0/1486303708 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f450c07b6e0 0x7f450c19bfa0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f44fc003f60 tx=0x7f44fc0119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:58:08.297 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.125+0000 7f45027fc700 1 -- 172.21.15.72:0/1486303708 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44fc003a40 con 0x7f450c07b6e0 2024-03-30T14:58:08.297 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.125+0000 7f45027fc700 1 -- 172.21.15.72:0/1486303708 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f44fc0248b0 con 0x7f450c07b6e0 2024-03-30T14:58:08.297 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.125+0000 7f45134ba700 1 -- 172.21.15.72:0/1486303708 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f450c19c770 con 0x7f450c07b6e0 2024-03-30T14:58:08.297 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.125+0000 7f45027fc700 1 -- 172.21.15.72:0/1486303708 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44fc01a750 con 0x7f450c07b6e0 2024-03-30T14:58:08.298 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.125+0000 7f45134ba700 1 -- 172.21.15.72:0/1486303708 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f450c19f460 con 0x7f450c07b6e0 2024-03-30T14:58:08.298 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.125+0000 7f45027fc700 1 -- 172.21.15.72:0/1486303708 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) ==== 46129+0+0 (secure 0 0 0) 0x7f44fc01aa00 con 0x7f450c07b6e0 2024-03-30T14:58:08.298 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.125+0000 7f45027fc700 1 --2- 172.21.15.72:0/1486303708 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f44f8038e60 0x7f44f803b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:58:08.298 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.125+0000 7f45027fc700 1 -- 172.21.15.72:0/1486303708 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f44fc04d250 con 0x7f450c07b6e0 2024-03-30T14:58:08.298 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.125+0000 7f4510a55700 1 -- 172.21.15.72:0/1486303708 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f44f8038e60 msgr2=0x7f44f803b320 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/3069476432 2024-03-30T14:58:08.298 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.125+0000 7f4510a55700 1 --2- 172.21.15.72:0/1486303708 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f44f8038e60 0x7f44f803b320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-30T14:58:08.298 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.125+0000 7f45134ba700 1 -- 172.21.15.72:0/1486303708 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f450c063870 con 0x7f450c07b6e0 2024-03-30T14:58:08.298 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.129+0000 7f45027fc700 1 -- 172.21.15.72:0/1486303708 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f44fc019c70 con 0x7f450c07b6e0 2024-03-30T14:58:08.298 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.329+0000 7f4510a55700 1 -- 172.21.15.72:0/1486303708 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f44f8038e60 msgr2=0x7f44f803b320 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/3069476432 2024-03-30T14:58:08.298 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.329+0000 7f4510a55700 1 --2- 172.21.15.72:0/1486303708 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f44f8038e60 0x7f44f803b320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-30T14:58:08.298 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.589+0000 7f45134ba700 1 -- 172.21.15.72:0/1486303708 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f450c19f630 con 0x7f450c07b6e0 2024-03-30T14:58:08.299 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.589+0000 7f45027fc700 1 -- 172.21.15.72:0/1486303708 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f44fc024d40 con 0x7f450c07b6e0 2024-03-30T14:58:08.299 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.593+0000 7f45134ba700 1 -- 172.21.15.72:0/1486303708 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f44f8038e60 msgr2=0x7f44f803b320 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-30T14:58:08.299 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.593+0000 7f45134ba700 1 --2- 172.21.15.72:0/1486303708 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f44f8038e60 0x7f44f803b320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:58:08.299 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.593+0000 7f45134ba700 1 -- 172.21.15.72:0/1486303708 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f450c07b6e0 msgr2=0x7f450c19bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:58:08.299 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.593+0000 7f45134ba700 1 --2- 172.21.15.72:0/1486303708 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f450c07b6e0 0x7f450c19bfa0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f44fc003f60 tx=0x7f44fc0119b0 comp rx=0 tx=0).stop 2024-03-30T14:58:08.299 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.593+0000 7f45134ba700 1 -- 172.21.15.72:0/1486303708 shutdown_connections 2024-03-30T14:58:08.299 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.593+0000 7f45134ba700 1 --2- 172.21.15.72:0/1486303708 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f44f8038e60 0x7f44f803b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:58:08.299 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.593+0000 7f45134ba700 1 --2- 172.21.15.72:0/1486303708 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f450c07b6e0 0x7f450c19bfa0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:58:08.299 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.593+0000 7f45134ba700 1 -- 172.21.15.72:0/1486303708 >> 172.21.15.72:0/1486303708 conn(0x7f450c1015f0 msgr2=0x7f450c1021a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:58:08.299 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.593+0000 7f45134ba700 1 -- 172.21.15.72:0/1486303708 shutdown_connections 2024-03-30T14:58:08.299 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:07.593+0000 7f45134ba700 1 -- 172.21.15.72:0/1486303708 wait complete. 2024-03-30T14:58:08.299 INFO:teuthology.orchestra.run.smithi072.stdout:Waiting for the mgr to restart... 2024-03-30T14:58:08.300 INFO:teuthology.orchestra.run.smithi072.stdout:Waiting for mgr epoch 9... 2024-03-30T14:58:08.660 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:58:08 smithi072 bash[21828]: debug 2024-03-30T14:58:08.441+0000 7f68268b5200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-30T14:58:08.660 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:58:08 smithi072 bash[21828]: debug 2024-03-30T14:58:08.549+0000 7f68268b5200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-30T14:58:09.243 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:58:08 smithi072 bash[21828]: debug 2024-03-30T14:58:08.653+0000 7f68268b5200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-30T14:58:09.244 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:58:09 smithi072 bash[21828]: debug 2024-03-30T14:58:09.017+0000 7f68268b5200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-30T14:58:09.244 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:58:09 smithi072 bash[21828]: debug 2024-03-30T14:58:09.133+0000 7f68268b5200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-30T14:58:09.921 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:58:09 smithi072 bash[21828]: debug 2024-03-30T14:58:09.237+0000 7f68268b5200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-30T14:58:09.921 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:58:09 smithi072 bash[21828]: debug 2024-03-30T14:58:09.593+0000 7f68268b5200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-30T14:58:09.921 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:58:09 smithi072 bash[21828]: debug 2024-03-30T14:58:09.833+0000 7f68268b5200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-30T14:58:10.421 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:58:10 smithi072 bash[21828]: debug 2024-03-30T14:58:10.093+0000 7f68268b5200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-30T14:58:10.421 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:58:10 smithi072 bash[21828]: debug 2024-03-30T14:58:10.205+0000 7f68268b5200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-30T14:58:10.900 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:58:10 smithi072 bash[21828]: debug 2024-03-30T14:58:10.477+0000 7f68268b5200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-30T14:58:11.171 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:58:10 smithi072 bash[21828]: debug 2024-03-30T14:58:10.893+0000 7f68268b5200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-30T14:58:11.171 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:58:11 smithi072 bash[21828]: debug 2024-03-30T14:58:11.133+0000 7f68268b5200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-30T14:58:11.671 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:58:11 smithi072 bash[21828]: debug 2024-03-30T14:58:11.253+0000 7f68268b5200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-30T14:58:11.671 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:58:11 smithi072 bash[21828]: debug 2024-03-30T14:58:11.497+0000 7f68268b5200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-30T14:58:12.906 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:58:12 smithi072 bash[21828]: debug 2024-03-30T14:58:12.493+0000 7f68268b5200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-30T14:58:12.906 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:58:12 smithi072 bash[21828]: debug 2024-03-30T14:58:12.609+0000 7f68268b5200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-30T14:58:12.906 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:58:12 smithi072 bash[21828]: debug 2024-03-30T14:58:12.901+0000 7f68268b5200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-30T14:58:13.171 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:58:13 smithi072 bash[21828]: debug 2024-03-30T14:58:13.013+0000 7f68268b5200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-30T14:58:13.727 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:58:13 smithi072 bash[21828]: debug 2024-03-30T14:58:13.461+0000 7f68268b5200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-30T14:58:13.728 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:58:13 smithi072 bash[21828]: debug 2024-03-30T14:58:13.585+0000 7f68268b5200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-30T14:58:13.728 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:13 smithi072 bash[21573]: cluster 2024-03-30T14:58:13.611458+0000 mon.a (mon.0) 74 : cluster 1 Active manager daemon y restarted 2024-03-30T14:58:13.728 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:13 smithi072 bash[21573]: cluster 2024-03-30T14:58:13.611922+0000 mon.a (mon.0) 75 : cluster 1 Activating manager daemon y 2024-03-30T14:58:13.728 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:13 smithi072 bash[21573]: cluster 2024-03-30T14:58:13.619297+0000 mon.a (mon.0) 76 : cluster 0 osdmap e3: 0 total, 0 up, 0 in 2024-03-30T14:58:13.728 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:13 smithi072 bash[21573]: cluster 2024-03-30T14:58:13.619525+0000 mon.a (mon.0) 77 : cluster 0 mgrmap e10: y(active, starting, since 0.00779688s) 2024-03-30T14:58:13.728 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:13 smithi072 bash[21573]: audit 2024-03-30T14:58:13.621357+0000 mon.a (mon.0) 78 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T14:58:13.728 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:13 smithi072 bash[21573]: audit 2024-03-30T14:58:13.622953+0000 mon.a (mon.0) 79 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-30T14:58:13.728 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:13 smithi072 bash[21573]: audit 2024-03-30T14:58:13.624121+0000 mon.a (mon.0) 80 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-30T14:58:13.728 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:13 smithi072 bash[21573]: audit 2024-03-30T14:58:13.624286+0000 mon.a (mon.0) 81 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-30T14:58:13.729 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:13 smithi072 bash[21573]: audit 2024-03-30T14:58:13.624487+0000 mon.a (mon.0) 82 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-30T14:58:13.729 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:13 smithi072 bash[21573]: cluster 2024-03-30T14:58:13.651446+0000 mon.a (mon.0) 83 : cluster 1 Manager daemon y is now available 2024-03-30T14:58:14.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:14 smithi072 bash[21573]: audit 2024-03-30T14:58:13.682693+0000 mon.a (mon.0) 84 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:58:14.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:14 smithi072 bash[21573]: audit 2024-03-30T14:58:13.701045+0000 mon.a (mon.0) 85 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T14:58:14.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:14 smithi072 bash[21573]: audit 2024-03-30T14:58:13.704381+0000 mon.a (mon.0) 86 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T14:58:14.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:14 smithi072 bash[21573]: cephadm 2024-03-30T14:58:14.518549+0000 mgr.y (mgr.14152) 1 : cephadm 1 [30/Mar/2024:14:58:14] ENGINE Bus STARTING 2024-03-30T14:58:14.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:14 smithi072 bash[21573]: cluster 2024-03-30T14:58:14.624415+0000 mon.a (mon.0) 87 : cluster 0 mgrmap e11: y(active, since 1.01268s) 2024-03-30T14:58:15.392 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout { 2024-03-30T14:58:15.392 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-03-30T14:58:15.392 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "initialized": true 2024-03-30T14:58:15.392 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout } 2024-03-30T14:58:15.392 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:09.157+0000 7f1c0d62c700 1 Processor -- start 2024-03-30T14:58:15.392 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:09.157+0000 7f1c0d62c700 1 -- start start 2024-03-30T14:58:15.392 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:09.157+0000 7f1c0d62c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c08105fd0 0x7f1c081063f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:58:15.392 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:09.157+0000 7f1c0d62c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1c081069c0 con 0x7f1c08105fd0 2024-03-30T14:58:15.392 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:09.157+0000 7f1c06ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c08105fd0 0x7f1c081063f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:58:15.393 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:09.157+0000 7f1c06ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c08105fd0 0x7f1c081063f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59316/0 (socket says 172.21.15.72:59316) 2024-03-30T14:58:15.393 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:09.157+0000 7f1c06ffd700 1 -- 172.21.15.72:0/4201010351 learned_addr learned my addr 172.21.15.72:0/4201010351 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:58:15.393 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:09.157+0000 7f1c06ffd700 1 -- 172.21.15.72:0/4201010351 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c081071d0 con 0x7f1c08105fd0 2024-03-30T14:58:15.393 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:09.157+0000 7f1c06ffd700 1 --2- 172.21.15.72:0/4201010351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c08105fd0 0x7f1c081063f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc0098a0 tx=0x7f1bfc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3743e808b95e6997 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:58:15.393 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:09.157+0000 7f1c05ffb700 1 -- 172.21.15.72:0/4201010351 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bfc004160 con 0x7f1c08105fd0 2024-03-30T14:58:15.393 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:09.157+0000 7f1c05ffb700 1 -- 172.21.15.72:0/4201010351 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f1bfc004300 con 0x7f1c08105fd0 2024-03-30T14:58:15.393 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:09.157+0000 7f1c05ffb700 1 -- 172.21.15.72:0/4201010351 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bfc0118f0 con 0x7f1c08105fd0 2024-03-30T14:58:15.393 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:09.157+0000 7f1c0d62c700 1 -- 172.21.15.72:0/4201010351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c08105fd0 msgr2=0x7f1c081063f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:58:15.393 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:09.157+0000 7f1c0d62c700 1 --2- 172.21.15.72:0/4201010351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c08105fd0 0x7f1c081063f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc0098a0 tx=0x7f1bfc009bb0 comp rx=0 tx=0).stop 2024-03-30T14:58:15.393 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:09.157+0000 7f1c0d62c700 1 -- 172.21.15.72:0/4201010351 shutdown_connections 2024-03-30T14:58:15.393 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:09.157+0000 7f1c0d62c700 1 --2- 172.21.15.72:0/4201010351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c08105fd0 0x7f1c081063f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:58:15.393 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:09.157+0000 7f1c0d62c700 1 -- 172.21.15.72:0/4201010351 >> 172.21.15.72:0/4201010351 conn(0x7f1c081015f0 msgr2=0x7f1c08103a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:58:15.393 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:09.157+0000 7f1c0d62c700 1 -- 172.21.15.72:0/4201010351 shutdown_connections 2024-03-30T14:58:15.394 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:09.157+0000 7f1c0d62c700 1 -- 172.21.15.72:0/4201010351 wait complete. 2024-03-30T14:58:15.394 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:09.161+0000 7f1c0d62c700 1 Processor -- start 2024-03-30T14:58:15.394 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:09.161+0000 7f1c0d62c700 1 -- start start 2024-03-30T14:58:15.394 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:09.161+0000 7f1c0d62c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c08105fd0 0x7f1c0807b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:58:15.394 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:09.161+0000 7f1c0d62c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1c0810a400 con 0x7f1c08105fd0 2024-03-30T14:58:15.394 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:09.161+0000 7f1c06ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c08105fd0 0x7f1c0807b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:58:15.394 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:09.161+0000 7f1c06ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c08105fd0 0x7f1c0807b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59324/0 (socket says 172.21.15.72:59324) 2024-03-30T14:58:15.394 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:09.161+0000 7f1c06ffd700 1 -- 172.21.15.72:0/3173862282 learned_addr learned my addr 172.21.15.72:0/3173862282 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:58:15.394 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:09.161+0000 7f1c06ffd700 1 -- 172.21.15.72:0/3173862282 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c0807b910 con 0x7f1c08105fd0 2024-03-30T14:58:15.394 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:09.161+0000 7f1c06ffd700 1 --2- 172.21.15.72:0/3173862282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c08105fd0 0x7f1c0807b3d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc003f60 tx=0x7f1bfc011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:58:15.394 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:09.161+0000 7f1beffff700 1 -- 172.21.15.72:0/3173862282 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bfc0038b0 con 0x7f1c08105fd0 2024-03-30T14:58:15.394 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:09.161+0000 7f1beffff700 1 -- 172.21.15.72:0/3173862282 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f1bfc003a50 con 0x7f1c08105fd0 2024-03-30T14:58:15.394 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:09.161+0000 7f1c0d62c700 1 -- 172.21.15.72:0/3173862282 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c08079b00 con 0x7f1c08105fd0 2024-03-30T14:58:15.395 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:09.161+0000 7f1beffff700 1 -- 172.21.15.72:0/3173862282 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bfc024410 con 0x7f1c08105fd0 2024-03-30T14:58:15.395 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:09.161+0000 7f1c0d62c700 1 -- 172.21.15.72:0/3173862282 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c0807a040 con 0x7f1c08105fd0 2024-03-30T14:58:15.395 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:09.161+0000 7f1beffff700 1 -- 172.21.15.72:0/3173862282 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) ==== 46129+0+0 (secure 0 0 0) 0x7f1bfc022020 con 0x7f1c08105fd0 2024-03-30T14:58:15.395 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:09.161+0000 7f1beffff700 1 --2- 172.21.15.72:0/3173862282 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f1bf0038e50 0x7f1bf003b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:58:15.395 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:09.161+0000 7f1beffff700 1 -- 172.21.15.72:0/3173862282 --> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f1bf003ba20 con 0x7f1bf0038e50 2024-03-30T14:58:15.395 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:09.161+0000 7f1beffff700 1 -- 172.21.15.72:0/3173862282 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f1bfc04cca0 con 0x7f1c08105fd0 2024-03-30T14:58:15.395 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:09.161+0000 7f1c067fc700 1 -- 172.21.15.72:0/3173862282 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f1bf0038e50 msgr2=0x7f1bf003b310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/3069476432 2024-03-30T14:58:15.395 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:09.161+0000 7f1c067fc700 1 --2- 172.21.15.72:0/3173862282 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f1bf0038e50 0x7f1bf003b310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-30T14:58:15.395 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:09.365+0000 7f1c067fc700 1 -- 172.21.15.72:0/3173862282 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f1bf0038e50 msgr2=0x7f1bf003b310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/3069476432 2024-03-30T14:58:15.395 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:09.365+0000 7f1c067fc700 1 --2- 172.21.15.72:0/3173862282 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f1bf0038e50 0x7f1bf003b310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-30T14:58:15.395 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:09.769+0000 7f1c067fc700 1 -- 172.21.15.72:0/3173862282 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f1bf0038e50 msgr2=0x7f1bf003b310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/3069476432 2024-03-30T14:58:15.395 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:09.769+0000 7f1c067fc700 1 --2- 172.21.15.72:0/3173862282 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f1bf0038e50 0x7f1bf003b310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-30T14:58:15.395 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:10.573+0000 7f1c067fc700 1 -- 172.21.15.72:0/3173862282 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f1bf0038e50 msgr2=0x7f1bf003b310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/3069476432 2024-03-30T14:58:15.395 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:10.573+0000 7f1c067fc700 1 --2- 172.21.15.72:0/3173862282 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f1bf0038e50 0x7f1bf003b310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-30T14:58:15.395 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:12.177+0000 7f1c067fc700 1 -- 172.21.15.72:0/3173862282 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f1bf0038e50 msgr2=0x7f1bf003b310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/3069476432 2024-03-30T14:58:15.396 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:12.177+0000 7f1c067fc700 1 --2- 172.21.15.72:0/3173862282 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f1bf0038e50 0x7f1bf003b310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-03-30T14:58:15.396 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:13.609+0000 7f1beffff700 1 -- 172.21.15.72:0/3173862282 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mgrmap(e 10) ==== 45896+0+0 (secure 0 0 0) 0x7f1bfc01a430 con 0x7f1c08105fd0 2024-03-30T14:58:15.396 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:13.613+0000 7f1beffff700 1 -- 172.21.15.72:0/3173862282 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f1bf0038e50 msgr2=0x7f1bf003b310 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-30T14:58:15.396 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:13.613+0000 7f1beffff700 1 --2- 172.21.15.72:0/3173862282 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f1bf0038e50 0x7f1bf003b310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:58:15.396 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:14.613+0000 7f1beffff700 1 -- 172.21.15.72:0/3173862282 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 11) ==== 46023+0+0 (secure 0 0 0) 0x7f1bfc00bb10 con 0x7f1c08105fd0 2024-03-30T14:58:15.396 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:14.613+0000 7f1beffff700 1 --2- 172.21.15.72:0/3173862282 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f1bf003c910 0x7f1bf003ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:58:15.396 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:14.613+0000 7f1beffff700 1 -- 172.21.15.72:0/3173862282 --> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f1bf003ba20 con 0x7f1bf003c910 2024-03-30T14:58:15.396 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:14.613+0000 7f1c067fc700 1 --2- 172.21.15.72:0/3173862282 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f1bf003c910 0x7f1bf003ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:58:15.396 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:14.617+0000 7f1c067fc700 1 --2- 172.21.15.72:0/3173862282 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f1bf003c910 0x7f1bf003ed00 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8003a10 tx=0x7f1bf80092b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:58:15.396 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:14.617+0000 7f1beffff700 1 -- 172.21.15.72:0/3173862282 <== mgr.14152 v2:172.21.15.72:6800/2777002311 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7774 (secure 0 0 0) 0x7f1bf003ba20 con 0x7f1bf003c910 2024-03-30T14:58:15.396 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:14.629+0000 7f1c0d62c700 1 -- 172.21.15.72:0/3173862282 --> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f1c08063870 con 0x7f1bf003c910 2024-03-30T14:58:15.396 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:14.629+0000 7f1beffff700 1 -- 172.21.15.72:0/3173862282 <== mgr.14152 v2:172.21.15.72:6800/2777002311 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f1c08063870 con 0x7f1bf003c910 2024-03-30T14:58:15.396 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:14.629+0000 7f1c0d62c700 1 -- 172.21.15.72:0/3173862282 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f1bf003c910 msgr2=0x7f1bf003ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:58:15.396 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:14.629+0000 7f1c0d62c700 1 --2- 172.21.15.72:0/3173862282 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f1bf003c910 0x7f1bf003ed00 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8003a10 tx=0x7f1bf80092b0 comp rx=0 tx=0).stop 2024-03-30T14:58:15.397 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:14.629+0000 7f1c0d62c700 1 -- 172.21.15.72:0/3173862282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c08105fd0 msgr2=0x7f1c0807b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:58:15.397 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:14.629+0000 7f1c0d62c700 1 --2- 172.21.15.72:0/3173862282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c08105fd0 0x7f1c0807b3d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc003f60 tx=0x7f1bfc011ef0 comp rx=0 tx=0).stop 2024-03-30T14:58:15.397 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:14.629+0000 7f1c0d62c700 1 -- 172.21.15.72:0/3173862282 shutdown_connections 2024-03-30T14:58:15.397 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:14.629+0000 7f1c0d62c700 1 --2- 172.21.15.72:0/3173862282 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f1bf003c910 0x7f1bf003ed00 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:58:15.397 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:14.629+0000 7f1c0d62c700 1 --2- 172.21.15.72:0/3173862282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c08105fd0 0x7f1c0807b3d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:58:15.397 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:14.629+0000 7f1c0d62c700 1 --2- 172.21.15.72:0/3173862282 >> [v2:172.21.15.72:6800/3069476432,v1:172.21.15.72:6801/3069476432] conn(0x7f1bf0038e50 0x7f1bf003b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:58:15.397 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:14.629+0000 7f1c0d62c700 1 -- 172.21.15.72:0/3173862282 >> 172.21.15.72:0/3173862282 conn(0x7f1c081015f0 msgr2=0x7f1c08102130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:58:15.397 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:14.629+0000 7f1c0d62c700 1 -- 172.21.15.72:0/3173862282 shutdown_connections 2024-03-30T14:58:15.397 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:14.629+0000 7f1c0d62c700 1 -- 172.21.15.72:0/3173862282 wait complete. 2024-03-30T14:58:15.397 INFO:teuthology.orchestra.run.smithi072.stdout:mgr epoch 9 is available 2024-03-30T14:58:15.397 INFO:teuthology.orchestra.run.smithi072.stdout:Generating a dashboard self-signed certificate... 2024-03-30T14:58:16.097 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:15 smithi072 bash[21573]: cephadm 2024-03-30T14:58:14.620826+0000 mgr.y (mgr.14152) 2 : cephadm 1 [30/Mar/2024:14:58:14] ENGINE Serving on http://172.21.15.72:8765 2024-03-30T14:58:16.097 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:15 smithi072 bash[21573]: audit 2024-03-30T14:58:14.622217+0000 mgr.y (mgr.14152) 3 : audit 0 from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-03-30T14:58:16.098 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:15 smithi072 bash[21573]: audit 2024-03-30T14:58:14.635140+0000 mgr.y (mgr.14152) 4 : audit 0 from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-03-30T14:58:16.098 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:15 smithi072 bash[21573]: cephadm 2024-03-30T14:58:14.739292+0000 mgr.y (mgr.14152) 5 : cephadm 1 [30/Mar/2024:14:58:14] ENGINE Serving on https://172.21.15.72:7150 2024-03-30T14:58:16.098 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:15 smithi072 bash[21573]: cephadm 2024-03-30T14:58:14.739390+0000 mgr.y (mgr.14152) 6 : cephadm 1 [30/Mar/2024:14:58:14] ENGINE Bus STARTED 2024-03-30T14:58:16.993 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:16 smithi072 bash[21573]: cluster 2024-03-30T14:58:15.673304+0000 mon.a (mon.0) 88 : cluster 0 mgrmap e12: y(active, since 2s) 2024-03-30T14:58:17.470 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-03-30T14:58:17.470 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.277+0000 7f38f0752700 1 Processor -- start 2024-03-30T14:58:17.470 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.277+0000 7f38f0752700 1 -- start start 2024-03-30T14:58:17.470 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.277+0000 7f38f0752700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38e8104930 0x7f38e8104d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:58:17.470 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.277+0000 7f38f0752700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f38e8079670 con 0x7f38e8104930 2024-03-30T14:58:17.470 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.277+0000 7f38ee4ee700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38e8104930 0x7f38e8104d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:58:17.470 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.277+0000 7f38ee4ee700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38e8104930 0x7f38e8104d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59396/0 (socket says 172.21.15.72:59396) 2024-03-30T14:58:17.470 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.277+0000 7f38ee4ee700 1 -- 172.21.15.72:0/1171119799 learned_addr learned my addr 172.21.15.72:0/1171119799 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:58:17.470 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.277+0000 7f38ee4ee700 1 -- 172.21.15.72:0/1171119799 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38e8105290 con 0x7f38e8104930 2024-03-30T14:58:17.470 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.277+0000 7f38ee4ee700 1 --2- 172.21.15.72:0/1171119799 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38e8104930 0x7f38e8104d50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f38e40098a0 tx=0x7f38e4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f8a6bee933ff919 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:58:17.471 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.277+0000 7f38ed4ec700 1 -- 172.21.15.72:0/1171119799 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38e4004160 con 0x7f38e8104930 2024-03-30T14:58:17.471 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.277+0000 7f38ed4ec700 1 -- 172.21.15.72:0/1171119799 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f38e4004300 con 0x7f38e8104930 2024-03-30T14:58:17.471 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.277+0000 7f38ed4ec700 1 -- 172.21.15.72:0/1171119799 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38e40118f0 con 0x7f38e8104930 2024-03-30T14:58:17.471 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.277+0000 7f38f0752700 1 -- 172.21.15.72:0/1171119799 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38e8104930 msgr2=0x7f38e8104d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:58:17.473 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.277+0000 7f38f0752700 1 --2- 172.21.15.72:0/1171119799 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38e8104930 0x7f38e8104d50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f38e40098a0 tx=0x7f38e4009bb0 comp rx=0 tx=0).stop 2024-03-30T14:58:17.473 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.277+0000 7f38f0752700 1 -- 172.21.15.72:0/1171119799 shutdown_connections 2024-03-30T14:58:17.473 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.277+0000 7f38f0752700 1 --2- 172.21.15.72:0/1171119799 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38e8104930 0x7f38e8104d50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:58:17.474 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.277+0000 7f38f0752700 1 -- 172.21.15.72:0/1171119799 >> 172.21.15.72:0/1171119799 conn(0x7f38e8100530 msgr2=0x7f38e8102950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:58:17.474 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.277+0000 7f38f0752700 1 -- 172.21.15.72:0/1171119799 shutdown_connections 2024-03-30T14:58:17.474 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.277+0000 7f38f0752700 1 -- 172.21.15.72:0/1171119799 wait complete. 2024-03-30T14:58:17.474 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.281+0000 7f38f0752700 1 Processor -- start 2024-03-30T14:58:17.474 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.281+0000 7f38f0752700 1 -- start start 2024-03-30T14:58:17.475 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.281+0000 7f38f0752700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38e8104930 0x7f38e819c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:58:17.475 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.281+0000 7f38f0752700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f38e8106240 con 0x7f38e8104930 2024-03-30T14:58:17.475 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.281+0000 7f38ee4ee700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38e8104930 0x7f38e819c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:58:17.475 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.281+0000 7f38ee4ee700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38e8104930 0x7f38e819c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59410/0 (socket says 172.21.15.72:59410) 2024-03-30T14:58:17.475 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.281+0000 7f38ee4ee700 1 -- 172.21.15.72:0/1686980661 learned_addr learned my addr 172.21.15.72:0/1686980661 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:58:17.475 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.281+0000 7f38ee4ee700 1 -- 172.21.15.72:0/1686980661 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38e819c570 con 0x7f38e8104930 2024-03-30T14:58:17.475 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.281+0000 7f38ee4ee700 1 --2- 172.21.15.72:0/1686980661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38e8104930 0x7f38e819c030 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f38e4011970 tx=0x7f38e4011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:58:17.475 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.281+0000 7f38df7fe700 1 -- 172.21.15.72:0/1686980661 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38e401a430 con 0x7f38e8104930 2024-03-30T14:58:17.475 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.281+0000 7f38df7fe700 1 -- 172.21.15.72:0/1686980661 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f38e401aa50 con 0x7f38e8104930 2024-03-30T14:58:17.475 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.281+0000 7f38df7fe700 1 -- 172.21.15.72:0/1686980661 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38e4019910 con 0x7f38e8104930 2024-03-30T14:58:17.475 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.281+0000 7f38f0752700 1 -- 172.21.15.72:0/1686980661 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38e819c800 con 0x7f38e8104930 2024-03-30T14:58:17.475 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.281+0000 7f38f0752700 1 -- 172.21.15.72:0/1686980661 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38e819f4f0 con 0x7f38e8104930 2024-03-30T14:58:17.476 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.281+0000 7f38df7fe700 1 -- 172.21.15.72:0/1686980661 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 12) ==== 46129+0+0 (secure 0 0 0) 0x7f38e4022020 con 0x7f38e8104930 2024-03-30T14:58:17.476 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.281+0000 7f38f0752700 1 -- 172.21.15.72:0/1686980661 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38e8063870 con 0x7f38e8104930 2024-03-30T14:58:17.476 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.281+0000 7f38df7fe700 1 --2- 172.21.15.72:0/1686980661 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f38d4038e60 0x7f38d403b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:58:17.476 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.281+0000 7f38df7fe700 1 -- 172.21.15.72:0/1686980661 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f38e404d5b0 con 0x7f38e8104930 2024-03-30T14:58:17.476 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.281+0000 7f38edced700 1 --2- 172.21.15.72:0/1686980661 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f38d4038e60 0x7f38d403b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:58:17.476 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.285+0000 7f38edced700 1 --2- 172.21.15.72:0/1686980661 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f38d4038e60 0x7f38d403b320 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f38d8006fd0 tx=0x7f38d8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:58:17.476 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.289+0000 7f38df7fe700 1 -- 172.21.15.72:0/1686980661 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f38e4016df0 con 0x7f38e8104930 2024-03-30T14:58:17.476 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.649+0000 7f38f0752700 1 -- 172.21.15.72:0/1686980661 --> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f38e802dc40 con 0x7f38d4038e60 2024-03-30T14:58:17.476 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.797+0000 7f38df7fe700 1 -- 172.21.15.72:0/1686980661 <== mgr.14152 v2:172.21.15.72:6800/2777002311 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f38e802dc40 con 0x7f38d4038e60 2024-03-30T14:58:17.476 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.801+0000 7f38f0752700 1 -- 172.21.15.72:0/1686980661 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f38d4038e60 msgr2=0x7f38d403b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:58:17.476 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.801+0000 7f38f0752700 1 --2- 172.21.15.72:0/1686980661 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f38d4038e60 0x7f38d403b320 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f38d8006fd0 tx=0x7f38d8006e40 comp rx=0 tx=0).stop 2024-03-30T14:58:17.476 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.801+0000 7f38f0752700 1 -- 172.21.15.72:0/1686980661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38e8104930 msgr2=0x7f38e819c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:58:17.477 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.801+0000 7f38f0752700 1 --2- 172.21.15.72:0/1686980661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38e8104930 0x7f38e819c030 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f38e4011970 tx=0x7f38e4011a50 comp rx=0 tx=0).stop 2024-03-30T14:58:17.477 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.801+0000 7f38f0752700 1 -- 172.21.15.72:0/1686980661 shutdown_connections 2024-03-30T14:58:17.477 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.801+0000 7f38f0752700 1 --2- 172.21.15.72:0/1686980661 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f38d4038e60 0x7f38d403b320 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:58:17.477 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.801+0000 7f38f0752700 1 --2- 172.21.15.72:0/1686980661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38e8104930 0x7f38e819c030 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:58:17.477 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.801+0000 7f38f0752700 1 -- 172.21.15.72:0/1686980661 >> 172.21.15.72:0/1686980661 conn(0x7f38e8100530 msgr2=0x7f38e8190300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:58:17.477 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.801+0000 7f38f0752700 1 -- 172.21.15.72:0/1686980661 shutdown_connections 2024-03-30T14:58:17.477 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:16.801+0000 7f38f0752700 1 -- 172.21.15.72:0/1686980661 wait complete. 2024-03-30T14:58:17.477 INFO:teuthology.orchestra.run.smithi072.stdout:Creating initial admin user... 2024-03-30T14:58:18.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:17 smithi072 bash[21573]: audit 2024-03-30T14:58:16.656361+0000 mgr.y (mgr.14152) 7 : audit 0 from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:58:18.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:17 smithi072 bash[21573]: audit 2024-03-30T14:58:16.797335+0000 mon.a (mon.0) 89 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:58:18.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:17 smithi072 bash[21573]: audit 2024-03-30T14:58:16.802797+0000 mon.a (mon.0) 90 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:58:19.799 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$7/qcdCiYBTaSHEA0HkXNJuAtScdEuEfKm0/U7RpWrD4NSAENf5ReK", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1711810699, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-03-30T14:58:19.799 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:18.437+0000 7fd11b18c700 1 Processor -- start 2024-03-30T14:58:19.799 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:18.437+0000 7fd11b18c700 1 -- start start 2024-03-30T14:58:19.799 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:18.441+0000 7fd11b18c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd114106020 0x7fd114106440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:58:19.799 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:18.441+0000 7fd11b18c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd114106a10 con 0x7fd114106020 2024-03-30T14:58:19.799 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:18.441+0000 7fd118f28700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd114106020 0x7fd114106440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:58:19.799 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:18.441+0000 7fd118f28700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd114106020 0x7fd114106440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55298/0 (socket says 172.21.15.72:55298) 2024-03-30T14:58:19.799 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:18.441+0000 7fd118f28700 1 -- 172.21.15.72:0/211717448 learned_addr learned my addr 172.21.15.72:0/211717448 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:58:19.800 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:18.441+0000 7fd118f28700 1 -- 172.21.15.72:0/211717448 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd114107220 con 0x7fd114106020 2024-03-30T14:58:19.800 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:18.441+0000 7fd118f28700 1 --2- 172.21.15.72:0/211717448 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd114106020 0x7fd114106440 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc0098a0 tx=0x7fd0fc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c44e4f7cd19c20 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:58:19.800 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:18.441+0000 7fd1137fe700 1 -- 172.21.15.72:0/211717448 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0fc004160 con 0x7fd114106020 2024-03-30T14:58:19.800 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:18.441+0000 7fd1137fe700 1 -- 172.21.15.72:0/211717448 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7fd0fc004300 con 0x7fd114106020 2024-03-30T14:58:19.800 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:18.441+0000 7fd1137fe700 1 -- 172.21.15.72:0/211717448 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0fc0118f0 con 0x7fd114106020 2024-03-30T14:58:19.800 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:18.441+0000 7fd11b18c700 1 -- 172.21.15.72:0/211717448 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd114106020 msgr2=0x7fd114106440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:58:19.800 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:18.441+0000 7fd11b18c700 1 --2- 172.21.15.72:0/211717448 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd114106020 0x7fd114106440 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc0098a0 tx=0x7fd0fc009bb0 comp rx=0 tx=0).stop 2024-03-30T14:58:19.800 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:18.441+0000 7fd11b18c700 1 -- 172.21.15.72:0/211717448 shutdown_connections 2024-03-30T14:58:19.800 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:18.441+0000 7fd11b18c700 1 --2- 172.21.15.72:0/211717448 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd114106020 0x7fd114106440 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:58:19.800 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:18.441+0000 7fd11b18c700 1 -- 172.21.15.72:0/211717448 >> 172.21.15.72:0/211717448 conn(0x7fd114101600 msgr2=0x7fd114103a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:58:19.800 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:18.441+0000 7fd11b18c700 1 -- 172.21.15.72:0/211717448 shutdown_connections 2024-03-30T14:58:19.800 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:18.441+0000 7fd11b18c700 1 -- 172.21.15.72:0/211717448 wait complete. 2024-03-30T14:58:19.800 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:18.441+0000 7fd11b18c700 1 Processor -- start 2024-03-30T14:58:19.800 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:18.441+0000 7fd11b18c700 1 -- start start 2024-03-30T14:58:19.800 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:18.441+0000 7fd11b18c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd114106020 0x7fd114199e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:58:19.801 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:18.441+0000 7fd11b18c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd11410a450 con 0x7fd114106020 2024-03-30T14:58:19.801 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:18.441+0000 7fd118f28700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd114106020 0x7fd114199e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:58:19.801 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:18.441+0000 7fd118f28700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd114106020 0x7fd114199e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55314/0 (socket says 172.21.15.72:55314) 2024-03-30T14:58:19.801 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:18.441+0000 7fd118f28700 1 -- 172.21.15.72:0/3572701716 learned_addr learned my addr 172.21.15.72:0/3572701716 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:58:19.801 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:18.441+0000 7fd118f28700 1 -- 172.21.15.72:0/3572701716 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd11419a3d0 con 0x7fd114106020 2024-03-30T14:58:19.801 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:18.441+0000 7fd118f28700 1 --2- 172.21.15.72:0/3572701716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd114106020 0x7fd114199e90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc009870 tx=0x7fd0fc011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:58:19.801 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:18.441+0000 7fd111ffb700 1 -- 172.21.15.72:0/3572701716 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0fc0038b0 con 0x7fd114106020 2024-03-30T14:58:19.801 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:18.441+0000 7fd111ffb700 1 -- 172.21.15.72:0/3572701716 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7fd0fc003a50 con 0x7fd114106020 2024-03-30T14:58:19.801 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:18.441+0000 7fd111ffb700 1 -- 172.21.15.72:0/3572701716 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0fc024410 con 0x7fd114106020 2024-03-30T14:58:19.801 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:18.441+0000 7fd11b18c700 1 -- 172.21.15.72:0/3572701716 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd11419a660 con 0x7fd114106020 2024-03-30T14:58:19.801 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:18.441+0000 7fd11b18c700 1 -- 172.21.15.72:0/3572701716 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd11419d350 con 0x7fd114106020 2024-03-30T14:58:19.801 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:18.445+0000 7fd111ffb700 1 -- 172.21.15.72:0/3572701716 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 12) ==== 46129+0+0 (secure 0 0 0) 0x7fd0fc022020 con 0x7fd114106020 2024-03-30T14:58:19.801 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:18.445+0000 7fd11b18c700 1 -- 172.21.15.72:0/3572701716 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd114063870 con 0x7fd114106020 2024-03-30T14:58:19.801 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:18.445+0000 7fd111ffb700 1 --2- 172.21.15.72:0/3572701716 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fd100038eb0 0x7fd10003b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:58:19.801 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:18.445+0000 7fd111ffb700 1 -- 172.21.15.72:0/3572701716 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd0fc04cee0 con 0x7fd114106020 2024-03-30T14:58:19.802 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:18.445+0000 7fd113fff700 1 --2- 172.21.15.72:0/3572701716 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fd100038eb0 0x7fd10003b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:58:19.802 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:18.445+0000 7fd113fff700 1 --2- 172.21.15.72:0/3572701716 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fd100038eb0 0x7fd10003b370 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd10400ad30 tx=0x7fd1040093f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:58:19.802 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:18.449+0000 7fd111ffb700 1 -- 172.21.15.72:0/3572701716 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fd0fc017ca0 con 0x7fd114106020 2024-03-30T14:58:19.802 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:18.837+0000 7fd11b18c700 1 -- 172.21.15.72:0/3572701716 --> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7fd1141028a0 con 0x7fd100038eb0 2024-03-30T14:58:19.802 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:19.081+0000 7fd111ffb700 1 -- 172.21.15.72:0/3572701716 <== mgr.14152 v2:172.21.15.72:6800/2777002311 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7fd1141028a0 con 0x7fd100038eb0 2024-03-30T14:58:19.802 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:19.085+0000 7fd11b18c700 1 -- 172.21.15.72:0/3572701716 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fd100038eb0 msgr2=0x7fd10003b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:58:19.802 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:19.085+0000 7fd11b18c700 1 --2- 172.21.15.72:0/3572701716 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fd100038eb0 0x7fd10003b370 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd10400ad30 tx=0x7fd1040093f0 comp rx=0 tx=0).stop 2024-03-30T14:58:19.802 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:19.085+0000 7fd11b18c700 1 -- 172.21.15.72:0/3572701716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd114106020 msgr2=0x7fd114199e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:58:19.802 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:19.085+0000 7fd11b18c700 1 --2- 172.21.15.72:0/3572701716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd114106020 0x7fd114199e90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc009870 tx=0x7fd0fc011ef0 comp rx=0 tx=0).stop 2024-03-30T14:58:19.802 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:19.085+0000 7fd11b18c700 1 -- 172.21.15.72:0/3572701716 shutdown_connections 2024-03-30T14:58:19.802 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:19.085+0000 7fd11b18c700 1 --2- 172.21.15.72:0/3572701716 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fd100038eb0 0x7fd10003b370 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:58:19.802 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:19.085+0000 7fd11b18c700 1 --2- 172.21.15.72:0/3572701716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd114106020 0x7fd114199e90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:58:19.802 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:19.085+0000 7fd11b18c700 1 -- 172.21.15.72:0/3572701716 >> 172.21.15.72:0/3572701716 conn(0x7fd114101600 msgr2=0x7fd114102190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:58:19.802 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:19.085+0000 7fd11b18c700 1 -- 172.21.15.72:0/3572701716 shutdown_connections 2024-03-30T14:58:19.803 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:19.085+0000 7fd11b18c700 1 -- 172.21.15.72:0/3572701716 wait complete. 2024-03-30T14:58:19.803 INFO:teuthology.orchestra.run.smithi072.stdout:Fetching dashboard port number... 2024-03-30T14:58:20.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:20 smithi072 bash[21573]: audit 2024-03-30T14:58:18.843005+0000 mgr.y (mgr.14152) 8 : audit 0 from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:58:20.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:20 smithi072 bash[21573]: audit 2024-03-30T14:58:19.086147+0000 mon.a (mon.0) 91 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:58:21.242 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:21 smithi072 bash[21573]: cluster 2024-03-30T14:58:20.093335+0000 mon.a (mon.0) 92 : cluster 0 mgrmap e13: y(active, since 6s) 2024-03-30T14:58:21.243 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:21 smithi072 bash[21573]: audit 2024-03-30T14:58:20.580626+0000 mon.a (mon.0) 93 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:58:21.243 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:21 smithi072 bash[21573]: audit 2024-03-30T14:58:21.035973+0000 mon.a (mon.0) 94 : audit 0 from='client.? 172.21.15.72:0/1476240165' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-03-30T14:58:21.734 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 8443 2024-03-30T14:58:21.735 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:20.661+0000 7fceeb57d700 1 Processor -- start 2024-03-30T14:58:21.735 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:20.661+0000 7fceeb57d700 1 -- start start 2024-03-30T14:58:21.735 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:20.661+0000 7fceeb57d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcee4104900 0x7fcee4104d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:58:21.735 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:20.661+0000 7fceeb57d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fcee4079670 con 0x7fcee4104900 2024-03-30T14:58:21.735 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:20.661+0000 7fcee9319700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcee4104900 0x7fcee4104d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:58:21.735 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:20.661+0000 7fcee9319700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcee4104900 0x7fcee4104d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55316/0 (socket says 172.21.15.72:55316) 2024-03-30T14:58:21.735 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:20.661+0000 7fcee9319700 1 -- 172.21.15.72:0/2272551349 learned_addr learned my addr 172.21.15.72:0/2272551349 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:58:21.735 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:20.661+0000 7fcee9319700 1 -- 172.21.15.72:0/2272551349 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcee4105260 con 0x7fcee4104900 2024-03-30T14:58:21.735 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:20.661+0000 7fcee9319700 1 --2- 172.21.15.72:0/2272551349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcee4104900 0x7fcee4104d20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcee00098a0 tx=0x7fcee0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddd7f29f219734a7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:58:21.735 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:20.661+0000 7fcedbfff700 1 -- 172.21.15.72:0/2272551349 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcee0004160 con 0x7fcee4104900 2024-03-30T14:58:21.735 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:20.661+0000 7fcedbfff700 1 -- 172.21.15.72:0/2272551349 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7fcee0004300 con 0x7fcee4104900 2024-03-30T14:58:21.735 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:20.661+0000 7fcedbfff700 1 -- 172.21.15.72:0/2272551349 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcee00118f0 con 0x7fcee4104900 2024-03-30T14:58:21.735 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:20.661+0000 7fceeb57d700 1 -- 172.21.15.72:0/2272551349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcee4104900 msgr2=0x7fcee4104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:58:21.735 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:20.661+0000 7fceeb57d700 1 --2- 172.21.15.72:0/2272551349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcee4104900 0x7fcee4104d20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcee00098a0 tx=0x7fcee0009bb0 comp rx=0 tx=0).stop 2024-03-30T14:58:21.736 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:20.661+0000 7fceeb57d700 1 -- 172.21.15.72:0/2272551349 shutdown_connections 2024-03-30T14:58:21.736 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:20.661+0000 7fceeb57d700 1 --2- 172.21.15.72:0/2272551349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcee4104900 0x7fcee4104d20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:58:21.736 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:20.661+0000 7fceeb57d700 1 -- 172.21.15.72:0/2272551349 >> 172.21.15.72:0/2272551349 conn(0x7fcee41004a0 msgr2=0x7fcee41028e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:58:21.736 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:20.661+0000 7fceeb57d700 1 -- 172.21.15.72:0/2272551349 shutdown_connections 2024-03-30T14:58:21.736 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:20.661+0000 7fceeb57d700 1 -- 172.21.15.72:0/2272551349 wait complete. 2024-03-30T14:58:21.736 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:20.661+0000 7fceeb57d700 1 Processor -- start 2024-03-30T14:58:21.736 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:20.661+0000 7fceeb57d700 1 -- start start 2024-03-30T14:58:21.736 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:20.661+0000 7fceeb57d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcee4104900 0x7fcee419bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:58:21.736 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:20.661+0000 7fceeb57d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fcee4106210 con 0x7fcee4104900 2024-03-30T14:58:21.736 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:20.661+0000 7fcee9319700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcee4104900 0x7fcee419bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:58:21.736 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:20.661+0000 7fcee9319700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcee4104900 0x7fcee419bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55328/0 (socket says 172.21.15.72:55328) 2024-03-30T14:58:21.736 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:20.661+0000 7fcee9319700 1 -- 172.21.15.72:0/1476240165 learned_addr learned my addr 172.21.15.72:0/1476240165 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:58:21.736 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:20.661+0000 7fcee9319700 1 -- 172.21.15.72:0/1476240165 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcee419c4b0 con 0x7fcee4104900 2024-03-30T14:58:21.736 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:20.665+0000 7fcee9319700 1 --2- 172.21.15.72:0/1476240165 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcee4104900 0x7fcee419bf70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcee0003f60 tx=0x7fcee0011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:58:21.736 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:20.665+0000 7fceda7fc700 1 -- 172.21.15.72:0/1476240165 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcee00038b0 con 0x7fcee4104900 2024-03-30T14:58:21.737 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:20.665+0000 7fceda7fc700 1 -- 172.21.15.72:0/1476240165 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7fcee0003a50 con 0x7fcee4104900 2024-03-30T14:58:21.737 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:20.665+0000 7fceeb57d700 1 -- 172.21.15.72:0/1476240165 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcee419c740 con 0x7fcee4104900 2024-03-30T14:58:21.737 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:20.665+0000 7fceda7fc700 1 -- 172.21.15.72:0/1476240165 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcee0024410 con 0x7fcee4104900 2024-03-30T14:58:21.737 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:20.665+0000 7fceeb57d700 1 -- 172.21.15.72:0/1476240165 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcee419f430 con 0x7fcee4104900 2024-03-30T14:58:21.737 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:20.665+0000 7fceda7fc700 1 -- 172.21.15.72:0/1476240165 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) ==== 46172+0+0 (secure 0 0 0) 0x7fcee0022020 con 0x7fcee4104900 2024-03-30T14:58:21.737 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:20.665+0000 7fcecffff700 1 -- 172.21.15.72:0/1476240165 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcec4005120 con 0x7fcee4104900 2024-03-30T14:58:21.737 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:20.665+0000 7fceda7fc700 1 --2- 172.21.15.72:0/1476240165 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fced0038f50 0x7fced003b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:58:21.737 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:20.665+0000 7fceda7fc700 1 -- 172.21.15.72:0/1476240165 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fcee004d310 con 0x7fcee4104900 2024-03-30T14:58:21.737 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:20.665+0000 7fcee8b18700 1 --2- 172.21.15.72:0/1476240165 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fced0038f50 0x7fced003b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:58:21.737 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:20.665+0000 7fcee8b18700 1 --2- 172.21.15.72:0/1476240165 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fced0038f50 0x7fced003b410 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fced4006fd0 tx=0x7fced4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:58:21.737 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:20.669+0000 7fceda7fc700 1 -- 172.21.15.72:0/1476240165 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fcee0019c70 con 0x7fcee4104900 2024-03-30T14:58:21.737 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:21.029+0000 7fcecffff700 1 -- 172.21.15.72:0/1476240165 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7fcec4005410 con 0x7fcee4104900 2024-03-30T14:58:21.737 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:21.029+0000 7fceda7fc700 1 -- 172.21.15.72:0/1476240165 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7fcee002d910 con 0x7fcee4104900 2024-03-30T14:58:21.737 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:21.033+0000 7fcecffff700 1 -- 172.21.15.72:0/1476240165 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fced0038f50 msgr2=0x7fced003b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:58:21.738 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:21.033+0000 7fcecffff700 1 --2- 172.21.15.72:0/1476240165 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fced0038f50 0x7fced003b410 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fced4006fd0 tx=0x7fced4006e40 comp rx=0 tx=0).stop 2024-03-30T14:58:21.738 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:21.033+0000 7fcecffff700 1 -- 172.21.15.72:0/1476240165 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcee4104900 msgr2=0x7fcee419bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:58:21.738 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:21.033+0000 7fcecffff700 1 --2- 172.21.15.72:0/1476240165 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcee4104900 0x7fcee419bf70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcee0003f60 tx=0x7fcee0011ef0 comp rx=0 tx=0).stop 2024-03-30T14:58:21.738 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:21.033+0000 7fcecffff700 1 -- 172.21.15.72:0/1476240165 shutdown_connections 2024-03-30T14:58:21.738 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:21.033+0000 7fcecffff700 1 --2- 172.21.15.72:0/1476240165 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fced0038f50 0x7fced003b410 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:58:21.738 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:21.033+0000 7fcecffff700 1 --2- 172.21.15.72:0/1476240165 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcee4104900 0x7fcee419bf70 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:58:21.738 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:21.033+0000 7fcecffff700 1 -- 172.21.15.72:0/1476240165 >> 172.21.15.72:0/1476240165 conn(0x7fcee41004a0 msgr2=0x7fcee4190270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:58:21.738 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:21.033+0000 7fcecffff700 1 -- 172.21.15.72:0/1476240165 shutdown_connections 2024-03-30T14:58:21.738 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:21.033+0000 7fcecffff700 1 -- 172.21.15.72:0/1476240165 wait complete. 2024-03-30T14:58:21.738 INFO:teuthology.orchestra.run.smithi072.stdout:firewalld does not appear to be present 2024-03-30T14:58:21.738 INFO:teuthology.orchestra.run.smithi072.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-03-30T14:58:21.739 INFO:teuthology.orchestra.run.smithi072.stdout:Ceph Dashboard is now available at: 2024-03-30T14:58:21.739 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-30T14:58:21.739 INFO:teuthology.orchestra.run.smithi072.stdout: URL: https://smithi072.front.sepia.ceph.com:8443/ 2024-03-30T14:58:21.739 INFO:teuthology.orchestra.run.smithi072.stdout: User: admin 2024-03-30T14:58:21.739 INFO:teuthology.orchestra.run.smithi072.stdout: Password: uu6xc7ahdv 2024-03-30T14:58:21.739 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-30T14:58:21.739 INFO:teuthology.orchestra.run.smithi072.stdout:Saving cluster configuration to /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/config directory 2024-03-30T14:58:21.739 INFO:teuthology.orchestra.run.smithi072.stdout:Enabling autotune for osd_memory_target 2024-03-30T14:58:22.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:22 smithi072 bash[21573]: audit 2024-03-30T14:58:21.566479+0000 mon.a (mon.0) 95 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:58:23.741 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:22.689+0000 7fcb947c9700 1 Processor -- start 2024-03-30T14:58:23.741 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:22.689+0000 7fcb947c9700 1 -- start start 2024-03-30T14:58:23.741 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:22.689+0000 7fcb947c9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb8c108200 0x7fcb8c108620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:58:23.741 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:22.689+0000 7fcb947c9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8c108bf0 con 0x7fcb8c108200 2024-03-30T14:58:23.741 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:22.689+0000 7fcb92565700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb8c108200 0x7fcb8c108620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:58:23.741 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:22.689+0000 7fcb92565700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb8c108200 0x7fcb8c108620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55332/0 (socket says 172.21.15.72:55332) 2024-03-30T14:58:23.741 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:22.689+0000 7fcb92565700 1 -- 172.21.15.72:0/3626436220 learned_addr learned my addr 172.21.15.72:0/3626436220 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:58:23.741 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:22.689+0000 7fcb92565700 1 -- 172.21.15.72:0/3626436220 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb8c109400 con 0x7fcb8c108200 2024-03-30T14:58:23.741 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:22.689+0000 7fcb92565700 1 --2- 172.21.15.72:0/3626436220 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb8c108200 0x7fcb8c108620 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c0098a0 tx=0x7fcb7c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=942395110794f90 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:58:23.742 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:22.689+0000 7fcb91563700 1 -- 172.21.15.72:0/3626436220 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb7c004160 con 0x7fcb8c108200 2024-03-30T14:58:23.742 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:22.689+0000 7fcb91563700 1 -- 172.21.15.72:0/3626436220 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7fcb7c004300 con 0x7fcb8c108200 2024-03-30T14:58:23.742 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:22.689+0000 7fcb91563700 1 -- 172.21.15.72:0/3626436220 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb7c0118f0 con 0x7fcb8c108200 2024-03-30T14:58:23.742 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:22.689+0000 7fcb947c9700 1 -- 172.21.15.72:0/3626436220 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb8c108200 msgr2=0x7fcb8c108620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:58:23.742 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:22.689+0000 7fcb947c9700 1 --2- 172.21.15.72:0/3626436220 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb8c108200 0x7fcb8c108620 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c0098a0 tx=0x7fcb7c009bb0 comp rx=0 tx=0).stop 2024-03-30T14:58:23.742 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:22.689+0000 7fcb947c9700 1 -- 172.21.15.72:0/3626436220 shutdown_connections 2024-03-30T14:58:23.742 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:22.689+0000 7fcb947c9700 1 --2- 172.21.15.72:0/3626436220 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb8c108200 0x7fcb8c108620 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:58:23.742 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:22.689+0000 7fcb947c9700 1 -- 172.21.15.72:0/3626436220 >> 172.21.15.72:0/3626436220 conn(0x7fcb8c07b610 msgr2=0x7fcb8c105d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:58:23.743 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:22.689+0000 7fcb947c9700 1 -- 172.21.15.72:0/3626436220 shutdown_connections 2024-03-30T14:58:23.743 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:22.689+0000 7fcb947c9700 1 -- 172.21.15.72:0/3626436220 wait complete. 2024-03-30T14:58:23.743 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:22.689+0000 7fcb947c9700 1 Processor -- start 2024-03-30T14:58:23.743 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:22.689+0000 7fcb947c9700 1 -- start start 2024-03-30T14:58:23.743 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:22.689+0000 7fcb947c9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb8c108200 0x7fcb8c19bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:58:23.743 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:22.689+0000 7fcb947c9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8c10c630 con 0x7fcb8c108200 2024-03-30T14:58:23.743 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:22.693+0000 7fcb92565700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb8c108200 0x7fcb8c19bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:58:23.743 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:22.693+0000 7fcb92565700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb8c108200 0x7fcb8c19bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55344/0 (socket says 172.21.15.72:55344) 2024-03-30T14:58:23.743 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:22.693+0000 7fcb92565700 1 -- 172.21.15.72:0/2455864758 learned_addr learned my addr 172.21.15.72:0/2455864758 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:58:23.743 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:22.693+0000 7fcb92565700 1 -- 172.21.15.72:0/2455864758 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb8c19c520 con 0x7fcb8c108200 2024-03-30T14:58:23.743 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:22.693+0000 7fcb92565700 1 --2- 172.21.15.72:0/2455864758 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb8c108200 0x7fcb8c19bfe0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c003f60 tx=0x7fcb7c0119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:58:23.743 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:22.693+0000 7fcb8b7fe700 1 -- 172.21.15.72:0/2455864758 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb7c003a40 con 0x7fcb8c108200 2024-03-30T14:58:23.743 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:22.693+0000 7fcb947c9700 1 -- 172.21.15.72:0/2455864758 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb8c19c7b0 con 0x7fcb8c108200 2024-03-30T14:58:23.744 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:22.693+0000 7fcb8b7fe700 1 -- 172.21.15.72:0/2455864758 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7fcb7c0248b0 con 0x7fcb8c108200 2024-03-30T14:58:23.744 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:22.693+0000 7fcb8b7fe700 1 -- 172.21.15.72:0/2455864758 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb7c01a670 con 0x7fcb8c108200 2024-03-30T14:58:23.744 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:22.693+0000 7fcb947c9700 1 -- 172.21.15.72:0/2455864758 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb8c19f4a0 con 0x7fcb8c108200 2024-03-30T14:58:23.744 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:22.693+0000 7fcb8b7fe700 1 -- 172.21.15.72:0/2455864758 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) ==== 46172+0+0 (secure 0 0 0) 0x7fcb7c024430 con 0x7fcb8c108200 2024-03-30T14:58:23.744 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:22.693+0000 7fcb947c9700 1 -- 172.21.15.72:0/2455864758 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb8c063870 con 0x7fcb8c108200 2024-03-30T14:58:23.744 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:22.693+0000 7fcb8b7fe700 1 --2- 172.21.15.72:0/2455864758 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fcb74038f00 0x7fcb7403b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:58:23.744 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:22.693+0000 7fcb8b7fe700 1 -- 172.21.15.72:0/2455864758 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fcb7c04d630 con 0x7fcb8c108200 2024-03-30T14:58:23.744 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:22.693+0000 7fcb91d64700 1 --2- 172.21.15.72:0/2455864758 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fcb74038f00 0x7fcb7403b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:58:23.744 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:22.693+0000 7fcb91d64700 1 --2- 172.21.15.72:0/2455864758 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fcb74038f00 0x7fcb7403b3c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcb8000ad30 tx=0x7fcb800093f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:58:23.744 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:22.697+0000 7fcb8b7fe700 1 -- 172.21.15.72:0/2455864758 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fcb7c00f2e0 con 0x7fcb8c108200 2024-03-30T14:58:23.744 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:23.065+0000 7fcb947c9700 1 -- 172.21.15.72:0/2455864758 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) -- 0x7fcb8c19f8f0 con 0x7fcb8c108200 2024-03-30T14:58:23.744 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:23.065+0000 7fcb8b7fe700 1 -- 172.21.15.72:0/2455864758 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) ==== 127+0+0 (secure 0 0 0) 0x7fcb7c00bcc0 con 0x7fcb8c108200 2024-03-30T14:58:23.744 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:23.065+0000 7fcb947c9700 1 -- 172.21.15.72:0/2455864758 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fcb74038f00 msgr2=0x7fcb7403b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:58:23.744 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:23.065+0000 7fcb947c9700 1 --2- 172.21.15.72:0/2455864758 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fcb74038f00 0x7fcb7403b3c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcb8000ad30 tx=0x7fcb800093f0 comp rx=0 tx=0).stop 2024-03-30T14:58:23.744 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:23.065+0000 7fcb947c9700 1 -- 172.21.15.72:0/2455864758 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb8c108200 msgr2=0x7fcb8c19bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:58:23.745 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:23.065+0000 7fcb947c9700 1 --2- 172.21.15.72:0/2455864758 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb8c108200 0x7fcb8c19bfe0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c003f60 tx=0x7fcb7c0119b0 comp rx=0 tx=0).stop 2024-03-30T14:58:23.745 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:23.065+0000 7fcb947c9700 1 -- 172.21.15.72:0/2455864758 shutdown_connections 2024-03-30T14:58:23.745 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:23.065+0000 7fcb947c9700 1 --2- 172.21.15.72:0/2455864758 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fcb74038f00 0x7fcb7403b3c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:58:23.745 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:23.065+0000 7fcb947c9700 1 --2- 172.21.15.72:0/2455864758 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb8c108200 0x7fcb8c19bfe0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:58:23.745 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:23.069+0000 7fcb947c9700 1 -- 172.21.15.72:0/2455864758 >> 172.21.15.72:0/2455864758 conn(0x7fcb8c07b610 msgr2=0x7fcb8c105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:58:23.745 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:23.069+0000 7fcb947c9700 1 -- 172.21.15.72:0/2455864758 shutdown_connections 2024-03-30T14:58:23.745 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:23.069+0000 7fcb947c9700 1 -- 172.21.15.72:0/2455864758 wait complete. 2024-03-30T14:58:25.816 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:24.601+0000 7fc5305b9700 1 Processor -- start 2024-03-30T14:58:25.816 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:24.601+0000 7fc5305b9700 1 -- start start 2024-03-30T14:58:25.816 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:24.601+0000 7fc5305b9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc528108200 0x7fc528108620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:58:25.816 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:24.601+0000 7fc5305b9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc528108bf0 con 0x7fc528108200 2024-03-30T14:58:25.816 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:24.601+0000 7fc52e355700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc528108200 0x7fc528108620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:58:25.816 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:24.601+0000 7fc52e355700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc528108200 0x7fc528108620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55348/0 (socket says 172.21.15.72:55348) 2024-03-30T14:58:25.817 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:24.601+0000 7fc52e355700 1 -- 172.21.15.72:0/1941528468 learned_addr learned my addr 172.21.15.72:0/1941528468 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:58:25.817 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:24.601+0000 7fc52e355700 1 -- 172.21.15.72:0/1941528468 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc528109400 con 0x7fc528108200 2024-03-30T14:58:25.817 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:24.605+0000 7fc52e355700 1 --2- 172.21.15.72:0/1941528468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc528108200 0x7fc528108620 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc5240098a0 tx=0x7fc524009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7331337bf993143f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:58:25.817 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:24.605+0000 7fc52d353700 1 -- 172.21.15.72:0/1941528468 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc524004160 con 0x7fc528108200 2024-03-30T14:58:25.817 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:24.605+0000 7fc52d353700 1 -- 172.21.15.72:0/1941528468 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7fc524004300 con 0x7fc528108200 2024-03-30T14:58:25.817 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:24.605+0000 7fc52d353700 1 -- 172.21.15.72:0/1941528468 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5240118f0 con 0x7fc528108200 2024-03-30T14:58:25.817 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:24.605+0000 7fc5305b9700 1 -- 172.21.15.72:0/1941528468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc528108200 msgr2=0x7fc528108620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:58:25.821 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:24.605+0000 7fc5305b9700 1 --2- 172.21.15.72:0/1941528468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc528108200 0x7fc528108620 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc5240098a0 tx=0x7fc524009bb0 comp rx=0 tx=0).stop 2024-03-30T14:58:25.822 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:24.605+0000 7fc5305b9700 1 -- 172.21.15.72:0/1941528468 shutdown_connections 2024-03-30T14:58:25.822 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:24.605+0000 7fc5305b9700 1 --2- 172.21.15.72:0/1941528468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc528108200 0x7fc528108620 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:58:25.822 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:24.605+0000 7fc5305b9700 1 -- 172.21.15.72:0/1941528468 >> 172.21.15.72:0/1941528468 conn(0x7fc52807b5e0 msgr2=0x7fc528105d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:58:25.822 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:24.605+0000 7fc5305b9700 1 -- 172.21.15.72:0/1941528468 shutdown_connections 2024-03-30T14:58:25.822 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:24.605+0000 7fc5305b9700 1 -- 172.21.15.72:0/1941528468 wait complete. 2024-03-30T14:58:25.822 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:24.605+0000 7fc5305b9700 1 Processor -- start 2024-03-30T14:58:25.822 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:24.605+0000 7fc5305b9700 1 -- start start 2024-03-30T14:58:25.822 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:24.605+0000 7fc5305b9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc528108200 0x7fc52819bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:58:25.822 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:24.605+0000 7fc5305b9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc52810c630 con 0x7fc528108200 2024-03-30T14:58:25.822 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:24.605+0000 7fc52e355700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc528108200 0x7fc52819bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:58:25.822 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:24.605+0000 7fc52e355700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc528108200 0x7fc52819bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55350/0 (socket says 172.21.15.72:55350) 2024-03-30T14:58:25.822 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:24.605+0000 7fc52e355700 1 -- 172.21.15.72:0/220672450 learned_addr learned my addr 172.21.15.72:0/220672450 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:58:25.822 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:24.605+0000 7fc52e355700 1 -- 172.21.15.72:0/220672450 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc52819c510 con 0x7fc528108200 2024-03-30T14:58:25.823 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:24.605+0000 7fc52e355700 1 --2- 172.21.15.72:0/220672450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc528108200 0x7fc52819bfd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc524003f60 tx=0x7fc524011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:58:25.823 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:24.605+0000 7fc51f7fe700 1 -- 172.21.15.72:0/220672450 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5240038b0 con 0x7fc528108200 2024-03-30T14:58:25.823 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:24.605+0000 7fc51f7fe700 1 -- 172.21.15.72:0/220672450 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7fc524003a50 con 0x7fc528108200 2024-03-30T14:58:25.823 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:24.605+0000 7fc51f7fe700 1 -- 172.21.15.72:0/220672450 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc524024410 con 0x7fc528108200 2024-03-30T14:58:25.823 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:24.605+0000 7fc5305b9700 1 -- 172.21.15.72:0/220672450 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc52819c7a0 con 0x7fc528108200 2024-03-30T14:58:25.823 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:24.605+0000 7fc5305b9700 1 -- 172.21.15.72:0/220672450 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc52819f490 con 0x7fc528108200 2024-03-30T14:58:25.823 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:24.605+0000 7fc51f7fe700 1 -- 172.21.15.72:0/220672450 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) ==== 46172+0+0 (secure 0 0 0) 0x7fc524022020 con 0x7fc528108200 2024-03-30T14:58:25.823 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:24.609+0000 7fc5305b9700 1 -- 172.21.15.72:0/220672450 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc528063870 con 0x7fc528108200 2024-03-30T14:58:25.823 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:24.609+0000 7fc51f7fe700 1 --2- 172.21.15.72:0/220672450 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fc514038f50 0x7fc51403b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:58:25.823 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:24.609+0000 7fc51f7fe700 1 -- 172.21.15.72:0/220672450 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc52404ce00 con 0x7fc528108200 2024-03-30T14:58:25.823 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:24.609+0000 7fc52db54700 1 --2- 172.21.15.72:0/220672450 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fc514038f50 0x7fc51403b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:58:25.823 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:24.609+0000 7fc52db54700 1 --2- 172.21.15.72:0/220672450 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fc514038f50 0x7fc51403b410 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc518006fd0 tx=0x7fc518006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:58:25.823 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:24.613+0000 7fc51f7fe700 1 -- 172.21.15.72:0/220672450 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fc52401a950 con 0x7fc528108200 2024-03-30T14:58:25.823 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:25.181+0000 7fc5305b9700 1 -- 172.21.15.72:0/220672450 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7fc52819f870 con 0x7fc528108200 2024-03-30T14:58:25.824 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:25.189+0000 7fc51f7fe700 1 -- 172.21.15.72:0/220672450 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v26)=0 set mgr/dashboard/cluster/status v26) ==== 153+0+0 (secure 0 0 0) 0x7fc52402ad60 con 0x7fc528108200 2024-03-30T14:58:25.824 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:25.189+0000 7fc5305b9700 1 -- 172.21.15.72:0/220672450 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fc514038f50 msgr2=0x7fc51403b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:58:25.824 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:25.189+0000 7fc5305b9700 1 --2- 172.21.15.72:0/220672450 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fc514038f50 0x7fc51403b410 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc518006fd0 tx=0x7fc518006e40 comp rx=0 tx=0).stop 2024-03-30T14:58:25.824 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:25.189+0000 7fc5305b9700 1 -- 172.21.15.72:0/220672450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc528108200 msgr2=0x7fc52819bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:58:25.824 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:25.189+0000 7fc5305b9700 1 --2- 172.21.15.72:0/220672450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc528108200 0x7fc52819bfd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc524003f60 tx=0x7fc524011ef0 comp rx=0 tx=0).stop 2024-03-30T14:58:25.824 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:25.189+0000 7fc5305b9700 1 -- 172.21.15.72:0/220672450 shutdown_connections 2024-03-30T14:58:25.824 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:25.189+0000 7fc5305b9700 1 --2- 172.21.15.72:0/220672450 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fc514038f50 0x7fc51403b410 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:58:25.824 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:25.189+0000 7fc5305b9700 1 --2- 172.21.15.72:0/220672450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc528108200 0x7fc52819bfd0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:58:25.824 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:25.189+0000 7fc5305b9700 1 -- 172.21.15.72:0/220672450 >> 172.21.15.72:0/220672450 conn(0x7fc52807b5e0 msgr2=0x7fc528105460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:58:25.824 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:25.189+0000 7fc5305b9700 1 -- 172.21.15.72:0/220672450 shutdown_connections 2024-03-30T14:58:25.824 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-30T14:58:25.189+0000 7fc5305b9700 1 -- 172.21.15.72:0/220672450 wait complete. 2024-03-30T14:58:25.824 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-03-30T14:58:25.824 INFO:teuthology.orchestra.run.smithi072.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-03-30T14:58:25.824 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-30T14:58:25.825 INFO:teuthology.orchestra.run.smithi072.stdout: sudo /usr/sbin/cephadm shell --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-03-30T14:58:25.825 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-30T14:58:25.825 INFO:teuthology.orchestra.run.smithi072.stdout:Or, if you are only running a single cluster on this host: 2024-03-30T14:58:25.825 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-30T14:58:25.825 INFO:teuthology.orchestra.run.smithi072.stdout: sudo /usr/sbin/cephadm shell 2024-03-30T14:58:25.825 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-30T14:58:25.825 INFO:teuthology.orchestra.run.smithi072.stdout:Please consider enabling telemetry to help improve Ceph: 2024-03-30T14:58:25.825 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-30T14:58:25.825 INFO:teuthology.orchestra.run.smithi072.stdout: ceph telemetry on 2024-03-30T14:58:25.825 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-30T14:58:25.825 INFO:teuthology.orchestra.run.smithi072.stdout:For more information see: 2024-03-30T14:58:25.825 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-30T14:58:25.825 INFO:teuthology.orchestra.run.smithi072.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-03-30T14:58:25.825 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-30T14:58:25.825 INFO:teuthology.orchestra.run.smithi072.stdout:Bootstrap complete. 2024-03-30T14:58:25.878 INFO:tasks.cephadm:Fetching config... 2024-03-30T14:58:25.878 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-30T14:58:25.878 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-03-30T14:58:25.884 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-03-30T14:58:25.884 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-30T14:58:25.884 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-03-30T14:58:25.933 INFO:tasks.cephadm:Fetching mon keyring... 2024-03-30T14:58:25.933 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-30T14:58:25.933 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.a/keyring of=/dev/stdout 2024-03-30T14:58:25.988 INFO:tasks.cephadm:Fetching pub ssh key... 2024-03-30T14:58:25.988 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-30T14:58:25.989 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-03-30T14:58:26.036 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-03-30T14:58:26.037 DEBUG:teuthology.orchestra.run.smithi072:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCokfnju9ScWuxkJgvWSLn23+ei28gsTS7CHCTBpMpajLs0WhSOyS2G7bIpofTx5MKudKk2NYbKzwTYsUxNn+YVDTdJOyBLCizifN1rHKq9+WS30aaU+wc1DJO4QqhRopvsxVmPbEoJCVO4tucYBFYHV22nkuVHkyIN2J+IY0Z0wBs1nwFzo8fhk/JLlGlVcygWpTjJp6rCTkaG5fjFQjrjQuBotuYPl5TccDTmUyIWzoLJxIKJE5y1bCkj0Fy4Imoh9aTkM7soTsFaggsO4X3kjsk29kX3REkEyw+5fbWzW3Gk8siQAU9S/jVucW29Sz5VCem5EER/GqLl7yd+1ehOj+CyGRKwACBFn2ath3e2gw0gItyakAIXmLaZEFUdNDLKtxHY5oGTY3MECvabByftMi77SdXa53/GoPLFWwvTYZwRtZSS3fp2b0jPR0fuDHs1Cd7CCbnrGtWBVRitsOgGu7cBKOuI/flN9NWz7Qw/8YP2UeKzYSNp3QSXEYt4vec= ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-03-30T14:58:26.102 INFO:teuthology.orchestra.run.smithi072.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCokfnju9ScWuxkJgvWSLn23+ei28gsTS7CHCTBpMpajLs0WhSOyS2G7bIpofTx5MKudKk2NYbKzwTYsUxNn+YVDTdJOyBLCizifN1rHKq9+WS30aaU+wc1DJO4QqhRopvsxVmPbEoJCVO4tucYBFYHV22nkuVHkyIN2J+IY0Z0wBs1nwFzo8fhk/JLlGlVcygWpTjJp6rCTkaG5fjFQjrjQuBotuYPl5TccDTmUyIWzoLJxIKJE5y1bCkj0Fy4Imoh9aTkM7soTsFaggsO4X3kjsk29kX3REkEyw+5fbWzW3Gk8siQAU9S/jVucW29Sz5VCem5EER/GqLl7yd+1ehOj+CyGRKwACBFn2ath3e2gw0gItyakAIXmLaZEFUdNDLKtxHY5oGTY3MECvabByftMi77SdXa53/GoPLFWwvTYZwRtZSS3fp2b0jPR0fuDHs1Cd7CCbnrGtWBVRitsOgGu7cBKOuI/flN9NWz7Qw/8YP2UeKzYSNp3QSXEYt4vec= ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4 2024-03-30T14:58:26.111 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCokfnju9ScWuxkJgvWSLn23+ei28gsTS7CHCTBpMpajLs0WhSOyS2G7bIpofTx5MKudKk2NYbKzwTYsUxNn+YVDTdJOyBLCizifN1rHKq9+WS30aaU+wc1DJO4QqhRopvsxVmPbEoJCVO4tucYBFYHV22nkuVHkyIN2J+IY0Z0wBs1nwFzo8fhk/JLlGlVcygWpTjJp6rCTkaG5fjFQjrjQuBotuYPl5TccDTmUyIWzoLJxIKJE5y1bCkj0Fy4Imoh9aTkM7soTsFaggsO4X3kjsk29kX3REkEyw+5fbWzW3Gk8siQAU9S/jVucW29Sz5VCem5EER/GqLl7yd+1ehOj+CyGRKwACBFn2ath3e2gw0gItyakAIXmLaZEFUdNDLKtxHY5oGTY3MECvabByftMi77SdXa53/GoPLFWwvTYZwRtZSS3fp2b0jPR0fuDHs1Cd7CCbnrGtWBVRitsOgGu7cBKOuI/flN9NWz7Qw/8YP2UeKzYSNp3QSXEYt4vec= ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-03-30T14:58:26.135 INFO:teuthology.orchestra.run.smithi172.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCokfnju9ScWuxkJgvWSLn23+ei28gsTS7CHCTBpMpajLs0WhSOyS2G7bIpofTx5MKudKk2NYbKzwTYsUxNn+YVDTdJOyBLCizifN1rHKq9+WS30aaU+wc1DJO4QqhRopvsxVmPbEoJCVO4tucYBFYHV22nkuVHkyIN2J+IY0Z0wBs1nwFzo8fhk/JLlGlVcygWpTjJp6rCTkaG5fjFQjrjQuBotuYPl5TccDTmUyIWzoLJxIKJE5y1bCkj0Fy4Imoh9aTkM7soTsFaggsO4X3kjsk29kX3REkEyw+5fbWzW3Gk8siQAU9S/jVucW29Sz5VCem5EER/GqLl7yd+1ehOj+CyGRKwACBFn2ath3e2gw0gItyakAIXmLaZEFUdNDLKtxHY5oGTY3MECvabByftMi77SdXa53/GoPLFWwvTYZwRtZSS3fp2b0jPR0fuDHs1Cd7CCbnrGtWBVRitsOgGu7cBKOuI/flN9NWz7Qw/8YP2UeKzYSNp3QSXEYt4vec= ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4 2024-03-30T14:58:26.144 DEBUG:teuthology.orchestra.run.smithi072:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-03-30T14:58:26.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:26 smithi072 bash[21573]: audit 2024-03-30T14:58:25.193275+0000 mon.a (mon.0) 96 : audit 1 from='client.? 172.21.15.72:0/220672450' entity='client.admin' 2024-03-30T14:58:31.101 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T14:58:32.125 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:31 smithi072 bash[21573]: audit 2024-03-30T14:58:30.758926+0000 mon.a (mon.0) 97 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:58:32.125 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:31 smithi072 bash[21573]: audit 2024-03-30T14:58:30.765555+0000 mon.a (mon.0) 98 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:58:32.125 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:31 smithi072 bash[21573]: audit 2024-03-30T14:58:30.767372+0000 mon.a (mon.0) 99 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi072", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:58:32.125 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:31 smithi072 bash[21573]: audit 2024-03-30T14:58:30.774042+0000 mon.a (mon.0) 100 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:58:32.126 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:31 smithi072 bash[21573]: audit 2024-03-30T14:58:30.809033+0000 mon.a (mon.0) 101 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:58:32.126 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:31 smithi072 bash[21573]: audit 2024-03-30T14:58:30.817090+0000 mon.a (mon.0) 102 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:58:33.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:33.548+0000 7f41e636e700 1 -- 172.21.15.72:0/297026958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e0103e60 msgr2=0x7f41e0104280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:58:33.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:33.548+0000 7f41e636e700 1 --2- 172.21.15.72:0/297026958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e0103e60 0x7f41e0104280 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f41d4009910 tx=0x7f41d4009c20 comp rx=0 tx=0).stop 2024-03-30T14:58:33.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:33.548+0000 7f41e636e700 1 -- 172.21.15.72:0/297026958 shutdown_connections 2024-03-30T14:58:33.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:33.548+0000 7f41e636e700 1 --2- 172.21.15.72:0/297026958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e0103e60 0x7f41e0104280 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:58:33.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:33.548+0000 7f41e636e700 1 -- 172.21.15.72:0/297026958 >> 172.21.15.72:0/297026958 conn(0x7f41e00ff410 msgr2=0x7f41e0101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:58:33.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:33.548+0000 7f41e636e700 1 -- 172.21.15.72:0/297026958 shutdown_connections 2024-03-30T14:58:33.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:33.548+0000 7f41e636e700 1 -- 172.21.15.72:0/297026958 wait complete. 2024-03-30T14:58:33.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:33.548+0000 7f41e636e700 1 Processor -- start 2024-03-30T14:58:33.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:33.548+0000 7f41e636e700 1 -- start start 2024-03-30T14:58:33.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:33.548+0000 7f41e636e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e0103e60 0x7f41e0198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:58:33.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:33.548+0000 7f41e636e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f41e0109310 con 0x7f41e0103e60 2024-03-30T14:58:33.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:33.548+0000 7f41dffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e0103e60 0x7f41e0198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:58:33.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:33.548+0000 7f41dffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e0103e60 0x7f41e0198b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50274/0 (socket says 172.21.15.72:50274) 2024-03-30T14:58:33.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:33.548+0000 7f41dffff700 1 -- 172.21.15.72:0/2122877918 learned_addr learned my addr 172.21.15.72:0/2122877918 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:58:33.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:33.548+0000 7f41dffff700 1 -- 172.21.15.72:0/2122877918 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e0199050 con 0x7f41e0103e60 2024-03-30T14:58:33.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:33.548+0000 7f41dffff700 1 --2- 172.21.15.72:0/2122877918 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e0103e60 0x7f41e0198b10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f41d4005740 tx=0x7f41d4004f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:58:33.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:33.548+0000 7f41dd7fa700 1 -- 172.21.15.72:0/2122877918 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41d4027070 con 0x7f41e0103e60 2024-03-30T14:58:33.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:33.548+0000 7f41dd7fa700 1 -- 172.21.15.72:0/2122877918 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f41d400bde0 con 0x7f41e0103e60 2024-03-30T14:58:33.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:33.548+0000 7f41e636e700 1 -- 172.21.15.72:0/2122877918 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41e01992e0 con 0x7f41e0103e60 2024-03-30T14:58:33.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:33.548+0000 7f41dd7fa700 1 -- 172.21.15.72:0/2122877918 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41d400fe30 con 0x7f41e0103e60 2024-03-30T14:58:33.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:33.548+0000 7f41e636e700 1 -- 172.21.15.72:0/2122877918 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41e019bfd0 con 0x7f41e0103e60 2024-03-30T14:58:33.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:33.548+0000 7f41dd7fa700 1 -- 172.21.15.72:0/2122877918 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) ==== 46172+0+0 (secure 0 0 0) 0x7f41d402a070 con 0x7f41e0103e60 2024-03-30T14:58:33.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:33.548+0000 7f41dd7fa700 1 --2- 172.21.15.72:0/2122877918 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f41c8038ea0 0x7f41c803b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:58:33.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:33.552+0000 7f41dd7fa700 1 -- 172.21.15.72:0/2122877918 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f41d404d050 con 0x7f41e0103e60 2024-03-30T14:58:33.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:33.552+0000 7f41e636e700 1 -- 172.21.15.72:0/2122877918 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41e0109a90 con 0x7f41e0103e60 2024-03-30T14:58:33.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:33.552+0000 7f41df7fe700 1 --2- 172.21.15.72:0/2122877918 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f41c8038ea0 0x7f41c803b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:58:33.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:33.552+0000 7f41df7fe700 1 --2- 172.21.15.72:0/2122877918 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f41c8038ea0 0x7f41c803b360 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f41d0006fd0 tx=0x7f41d0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:58:33.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:33.556+0000 7f41dd7fa700 1 -- 172.21.15.72:0/2122877918 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f41d4031070 con 0x7f41e0103e60 2024-03-30T14:58:33.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:33.752+0000 7f41e636e700 1 -- 172.21.15.72:0/2122877918 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f41e002db30 con 0x7f41e0103e60 2024-03-30T14:58:33.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:33.760+0000 7f41dd7fa700 1 -- 172.21.15.72:0/2122877918 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f41d4013070 con 0x7f41e0103e60 2024-03-30T14:58:33.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:33.760+0000 7f41e636e700 1 -- 172.21.15.72:0/2122877918 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f41c8038ea0 msgr2=0x7f41c803b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:58:33.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:33.760+0000 7f41e636e700 1 --2- 172.21.15.72:0/2122877918 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f41c8038ea0 0x7f41c803b360 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f41d0006fd0 tx=0x7f41d0006e40 comp rx=0 tx=0).stop 2024-03-30T14:58:33.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:33.760+0000 7f41e636e700 1 -- 172.21.15.72:0/2122877918 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e0103e60 msgr2=0x7f41e0198b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:58:33.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:33.760+0000 7f41e636e700 1 --2- 172.21.15.72:0/2122877918 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e0103e60 0x7f41e0198b10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f41d4005740 tx=0x7f41d4004f60 comp rx=0 tx=0).stop 2024-03-30T14:58:33.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:33.760+0000 7f41e636e700 1 -- 172.21.15.72:0/2122877918 shutdown_connections 2024-03-30T14:58:33.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:33.760+0000 7f41e636e700 1 --2- 172.21.15.72:0/2122877918 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f41c8038ea0 0x7f41c803b360 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:58:33.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:33.760+0000 7f41e636e700 1 --2- 172.21.15.72:0/2122877918 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e0103e60 0x7f41e0198b10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:58:33.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:33.760+0000 7f41e636e700 1 -- 172.21.15.72:0/2122877918 >> 172.21.15.72:0/2122877918 conn(0x7f41e00ff410 msgr2=0x7f41e00ffee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:58:33.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:33.760+0000 7f41e636e700 1 -- 172.21.15.72:0/2122877918 shutdown_connections 2024-03-30T14:58:33.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:33.760+0000 7f41e636e700 1 -- 172.21.15.72:0/2122877918 wait complete. 2024-03-30T14:58:34.378 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-03-30T14:58:34.378 DEBUG:teuthology.orchestra.run.smithi072:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-03-30T14:58:35.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:34 smithi072 bash[21573]: cluster 2024-03-30T14:58:33.625840+0000 mgr.y (mgr.14152) 9 : cluster 0 pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:58:35.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:34 smithi072 bash[21573]: audit 2024-03-30T14:58:33.761375+0000 mon.a (mon.0) 103 : audit 1 from='client.? 172.21.15.72:0/2122877918' entity='client.admin' 2024-03-30T14:58:35.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:34 smithi072 bash[21573]: audit 2024-03-30T14:58:33.821920+0000 mon.a (mon.0) 104 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:58:35.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:34 smithi072 bash[21573]: audit 2024-03-30T14:58:33.825626+0000 mon.a (mon.0) 105 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:58:37.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:36 smithi072 bash[21573]: cluster 2024-03-30T14:58:35.626212+0000 mgr.y (mgr.14152) 10 : cluster 0 pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:58:39.078 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T14:58:39.099 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:38 smithi072 bash[21573]: cluster 2024-03-30T14:58:37.626637+0000 mgr.y (mgr.14152) 11 : cluster 0 pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:58:41.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:40 smithi072 bash[21573]: cluster 2024-03-30T14:58:39.627177+0000 mgr.y (mgr.14152) 12 : cluster 0 pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:58:41.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:41.676+0000 7f323e6c0700 1 -- 172.21.15.72:0/411661524 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3238101c90 msgr2=0x7f32381020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:58:41.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:41.676+0000 7f323e6c0700 1 --2- 172.21.15.72:0/411661524 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3238101c90 0x7f32381020b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3228009910 tx=0x7f3228009c20 comp rx=0 tx=0).stop 2024-03-30T14:58:41.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:41.676+0000 7f323e6c0700 1 -- 172.21.15.72:0/411661524 shutdown_connections 2024-03-30T14:58:41.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:41.676+0000 7f323e6c0700 1 --2- 172.21.15.72:0/411661524 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3238101c90 0x7f32381020b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:58:41.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:41.676+0000 7f323e6c0700 1 -- 172.21.15.72:0/411661524 >> 172.21.15.72:0/411661524 conn(0x7f32380fd230 msgr2=0x7f32380ff670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:58:41.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:41.676+0000 7f323e6c0700 1 -- 172.21.15.72:0/411661524 shutdown_connections 2024-03-30T14:58:41.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:41.676+0000 7f323e6c0700 1 -- 172.21.15.72:0/411661524 wait complete. 2024-03-30T14:58:41.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:41.676+0000 7f323e6c0700 1 Processor -- start 2024-03-30T14:58:41.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:41.676+0000 7f323e6c0700 1 -- start start 2024-03-30T14:58:41.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:41.676+0000 7f323e6c0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3238101c90 0x7f3238196940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:58:41.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:41.676+0000 7f323e6c0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f3238107190 con 0x7f3238101c90 2024-03-30T14:58:41.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:41.676+0000 7f3237fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3238101c90 0x7f3238196940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:58:41.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:41.676+0000 7f3237fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3238101c90 0x7f3238196940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58932/0 (socket says 172.21.15.72:58932) 2024-03-30T14:58:41.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:41.676+0000 7f3237fff700 1 -- 172.21.15.72:0/4077736219 learned_addr learned my addr 172.21.15.72:0/4077736219 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:58:41.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:41.676+0000 7f3237fff700 1 -- 172.21.15.72:0/4077736219 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3238196e80 con 0x7f3238101c90 2024-03-30T14:58:41.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:41.676+0000 7f3237fff700 1 --2- 172.21.15.72:0/4077736219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3238101c90 0x7f3238196940 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3228005950 tx=0x7f32280057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:58:41.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:41.676+0000 7f32357fa700 1 -- 172.21.15.72:0/4077736219 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3228027070 con 0x7f3238101c90 2024-03-30T14:58:41.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:41.676+0000 7f32357fa700 1 -- 172.21.15.72:0/4077736219 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f322800f460 con 0x7f3238101c90 2024-03-30T14:58:41.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:41.676+0000 7f323e6c0700 1 -- 172.21.15.72:0/4077736219 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3238197110 con 0x7f3238101c90 2024-03-30T14:58:41.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:41.676+0000 7f32357fa700 1 -- 172.21.15.72:0/4077736219 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3228017440 con 0x7f3238101c90 2024-03-30T14:58:41.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:41.676+0000 7f323e6c0700 1 -- 172.21.15.72:0/4077736219 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3238199e00 con 0x7f3238101c90 2024-03-30T14:58:41.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:41.676+0000 7f32357fa700 1 -- 172.21.15.72:0/4077736219 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) ==== 46172+0+0 (secure 0 0 0) 0x7f322802a070 con 0x7f3238101c90 2024-03-30T14:58:41.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:41.676+0000 7f323e6c0700 1 -- 172.21.15.72:0/4077736219 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3238107910 con 0x7f3238101c90 2024-03-30T14:58:41.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:41.676+0000 7f32357fa700 1 --2- 172.21.15.72:0/4077736219 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f3220038f00 0x7f322003b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:58:41.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:41.676+0000 7f32357fa700 1 -- 172.21.15.72:0/4077736219 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f322804d0c0 con 0x7f3238101c90 2024-03-30T14:58:41.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:41.676+0000 7f32377fe700 1 --2- 172.21.15.72:0/4077736219 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f3220038f00 0x7f322003b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:58:41.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:41.676+0000 7f32377fe700 1 --2- 172.21.15.72:0/4077736219 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f3220038f00 0x7f322003b3c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f322c006fd0 tx=0x7f322c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:58:41.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:41.684+0000 7f32357fa700 1 -- 172.21.15.72:0/4077736219 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f3228013070 con 0x7f3238101c90 2024-03-30T14:58:41.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:41.892+0000 7f323e6c0700 1 -- 172.21.15.72:0/4077736219 --> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f3238062680 con 0x7f3220038f00 2024-03-30T14:58:41.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:41.896+0000 7f32357fa700 1 -- 172.21.15.72:0/4077736219 <== mgr.14152 v2:172.21.15.72:6800/2777002311 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3238062680 con 0x7f3220038f00 2024-03-30T14:58:41.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:41.896+0000 7f323e6c0700 1 -- 172.21.15.72:0/4077736219 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f3220038f00 msgr2=0x7f322003b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:58:41.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:41.896+0000 7f323e6c0700 1 --2- 172.21.15.72:0/4077736219 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f3220038f00 0x7f322003b3c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f322c006fd0 tx=0x7f322c006e40 comp rx=0 tx=0).stop 2024-03-30T14:58:41.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:41.896+0000 7f323e6c0700 1 -- 172.21.15.72:0/4077736219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3238101c90 msgr2=0x7f3238196940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:58:41.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:41.896+0000 7f323e6c0700 1 --2- 172.21.15.72:0/4077736219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3238101c90 0x7f3238196940 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3228005950 tx=0x7f32280057c0 comp rx=0 tx=0).stop 2024-03-30T14:58:41.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:41.900+0000 7f323e6c0700 1 -- 172.21.15.72:0/4077736219 shutdown_connections 2024-03-30T14:58:41.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:41.900+0000 7f323e6c0700 1 --2- 172.21.15.72:0/4077736219 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f3220038f00 0x7f322003b3c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:58:41.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:41.900+0000 7f323e6c0700 1 --2- 172.21.15.72:0/4077736219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3238101c90 0x7f3238196940 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:58:41.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:41.900+0000 7f323e6c0700 1 -- 172.21.15.72:0/4077736219 >> 172.21.15.72:0/4077736219 conn(0x7f32380fd230 msgr2=0x7f32380fdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:58:41.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:41.900+0000 7f323e6c0700 1 -- 172.21.15.72:0/4077736219 shutdown_connections 2024-03-30T14:58:41.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:41.900+0000 7f323e6c0700 1 -- 172.21.15.72:0/4077736219 wait complete. 2024-03-30T14:58:42.596 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi172 2024-03-30T14:58:42.597 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-03-30T14:58:42.597 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/etc/ceph/ceph.conf 2024-03-30T14:58:42.603 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-03-30T14:58:42.604 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-30T14:58:42.649 INFO:tasks.cephadm:Adding host smithi172 to orchestrator... 2024-03-30T14:58:42.649 DEBUG:teuthology.orchestra.run.smithi072:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph orch host add smithi172 2024-03-30T14:58:43.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:42 smithi072 bash[21573]: cluster 2024-03-30T14:58:41.627586+0000 mgr.y (mgr.14152) 13 : cluster 0 pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:58:43.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:42 smithi072 bash[21573]: audit 2024-03-30T14:58:41.894932+0000 mgr.y (mgr.14152) 14 : audit 0 from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:58:43.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:42 smithi072 bash[21573]: audit 2024-03-30T14:58:41.897995+0000 mon.a (mon.0) 106 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:58:43.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:42 smithi072 bash[21573]: audit 2024-03-30T14:58:41.925661+0000 mon.a (mon.0) 107 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:58:43.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:42 smithi072 bash[21573]: audit 2024-03-30T14:58:41.927325+0000 mon.a (mon.0) 108 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:58:43.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:42 smithi072 bash[21573]: audit 2024-03-30T14:58:41.928010+0000 mon.a (mon.0) 109 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:58:43.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:42 smithi072 bash[21573]: cephadm 2024-03-30T14:58:41.929063+0000 mgr.y (mgr.14152) 15 : cephadm 1 Updating smithi072:/etc/ceph/ceph.conf 2024-03-30T14:58:43.173 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:42 smithi072 bash[21573]: cephadm 2024-03-30T14:58:42.043614+0000 mgr.y (mgr.14152) 16 : cephadm 1 Updating smithi072:/var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T14:58:43.173 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:42 smithi072 bash[21573]: cephadm 2024-03-30T14:58:42.208269+0000 mgr.y (mgr.14152) 17 : cephadm 1 Updating smithi072:/etc/ceph/ceph.client.admin.keyring 2024-03-30T14:58:43.173 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:42 smithi072 bash[21573]: cephadm 2024-03-30T14:58:42.373563+0000 mgr.y (mgr.14152) 18 : cephadm 1 Updating smithi072:/var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T14:58:43.173 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:42 smithi072 bash[21573]: audit 2024-03-30T14:58:42.542642+0000 mon.a (mon.0) 110 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:58:43.173 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:42 smithi072 bash[21573]: audit 2024-03-30T14:58:42.546822+0000 mon.a (mon.0) 111 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:58:43.173 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:42 smithi072 bash[21573]: audit 2024-03-30T14:58:42.552512+0000 mon.a (mon.0) 112 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:58:45.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:44 smithi072 bash[21573]: cluster 2024-03-30T14:58:43.628001+0000 mgr.y (mgr.14152) 19 : cluster 0 pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:58:47.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:46 smithi072 bash[21573]: cluster 2024-03-30T14:58:45.628371+0000 mgr.y (mgr.14152) 20 : cluster 0 pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:58:47.355 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T14:58:49.174 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:48 smithi072 bash[21573]: cluster 2024-03-30T14:58:47.628786+0000 mgr.y (mgr.14152) 21 : cluster 0 pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:58:49.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:49.884+0000 7fc3c2415700 1 -- 172.21.15.72:0/1756866821 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3bc106be0 msgr2=0x7fc3bc106fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:58:49.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:49.884+0000 7fc3c2415700 1 --2- 172.21.15.72:0/1756866821 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3bc106be0 0x7fc3bc106fc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac009910 tx=0x7fc3ac009c20 comp rx=0 tx=0).stop 2024-03-30T14:58:49.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:49.884+0000 7fc3c2415700 1 -- 172.21.15.72:0/1756866821 shutdown_connections 2024-03-30T14:58:49.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:49.884+0000 7fc3c2415700 1 --2- 172.21.15.72:0/1756866821 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3bc106be0 0x7fc3bc106fc0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:58:49.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:49.884+0000 7fc3c2415700 1 -- 172.21.15.72:0/1756866821 >> 172.21.15.72:0/1756866821 conn(0x7fc3bc077780 msgr2=0x7fc3bc0fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:58:49.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:49.884+0000 7fc3c2415700 1 -- 172.21.15.72:0/1756866821 shutdown_connections 2024-03-30T14:58:49.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:49.884+0000 7fc3c2415700 1 -- 172.21.15.72:0/1756866821 wait complete. 2024-03-30T14:58:49.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:49.884+0000 7fc3c2415700 1 Processor -- start 2024-03-30T14:58:49.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:49.884+0000 7fc3c2415700 1 -- start start 2024-03-30T14:58:49.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:49.884+0000 7fc3c2415700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3bc106be0 0x7fc3bc196d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:58:49.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:49.884+0000 7fc3c2415700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc3bc10a610 con 0x7fc3bc106be0 2024-03-30T14:58:49.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:49.884+0000 7fc3bbfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3bc106be0 0x7fc3bc196d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:58:49.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:49.884+0000 7fc3bbfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3bc106be0 0x7fc3bc196d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50296/0 (socket says 172.21.15.72:50296) 2024-03-30T14:58:49.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:49.884+0000 7fc3bbfff700 1 -- 172.21.15.72:0/3917564492 learned_addr learned my addr 172.21.15.72:0/3917564492 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:58:49.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:49.888+0000 7fc3bbfff700 1 -- 172.21.15.72:0/3917564492 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3bc1972c0 con 0x7fc3bc106be0 2024-03-30T14:58:49.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:49.888+0000 7fc3bbfff700 1 --2- 172.21.15.72:0/3917564492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3bc106be0 0x7fc3bc196d80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac00f690 tx=0x7fc3ac00f770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:58:49.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:49.888+0000 7fc3b97fa700 1 -- 172.21.15.72:0/3917564492 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3ac027070 con 0x7fc3bc106be0 2024-03-30T14:58:49.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:49.888+0000 7fc3b97fa700 1 -- 172.21.15.72:0/3917564492 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7fc3ac00fb90 con 0x7fc3bc106be0 2024-03-30T14:58:49.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:49.888+0000 7fc3c2415700 1 -- 172.21.15.72:0/3917564492 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3bc197550 con 0x7fc3bc106be0 2024-03-30T14:58:49.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:49.888+0000 7fc3b97fa700 1 -- 172.21.15.72:0/3917564492 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3ac017440 con 0x7fc3bc106be0 2024-03-30T14:58:49.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:49.888+0000 7fc3c2415700 1 -- 172.21.15.72:0/3917564492 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3bc1979b0 con 0x7fc3bc106be0 2024-03-30T14:58:49.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:49.888+0000 7fc3b97fa700 1 -- 172.21.15.72:0/3917564492 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) ==== 46172+0+0 (secure 0 0 0) 0x7fc3ac02a070 con 0x7fc3bc106be0 2024-03-30T14:58:49.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:49.888+0000 7fc3c2415700 1 -- 172.21.15.72:0/3917564492 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3bc1021e0 con 0x7fc3bc106be0 2024-03-30T14:58:49.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:49.888+0000 7fc3b97fa700 1 --2- 172.21.15.72:0/3917564492 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fc3a8038f00 0x7fc3a803b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:58:49.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:49.888+0000 7fc3b97fa700 1 -- 172.21.15.72:0/3917564492 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc3ac01e030 con 0x7fc3bc106be0 2024-03-30T14:58:49.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:49.888+0000 7fc3bb7fe700 1 --2- 172.21.15.72:0/3917564492 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fc3a8038f00 0x7fc3a803b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:58:49.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:49.888+0000 7fc3bb7fe700 1 --2- 172.21.15.72:0/3917564492 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fc3a8038f00 0x7fc3a803b3c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc3a400ad30 tx=0x7fc3a40093f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:58:49.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:49.892+0000 7fc3b97fa700 1 -- 172.21.15.72:0/3917564492 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fc3ac013070 con 0x7fc3bc106be0 2024-03-30T14:58:50.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:50.108+0000 7fc3c2415700 1 -- 172.21.15.72:0/3917564492 --> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi172", "target": ["mon-mgr", ""]}) -- 0x7fc3bc198090 con 0x7fc3a8038f00 2024-03-30T14:58:51.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:50 smithi072 bash[21573]: cluster 2024-03-30T14:58:49.629149+0000 mgr.y (mgr.14152) 22 : cluster 0 pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:58:51.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:50 smithi072 bash[21573]: audit 2024-03-30T14:58:50.112380+0000 mgr.y (mgr.14152) 23 : audit 0 from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi172", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:58:52.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:51 smithi072 bash[21573]: cephadm 2024-03-30T14:58:50.770895+0000 mgr.y (mgr.14152) 24 : cephadm 1 Deploying cephadm binary to smithi172 2024-03-30T14:58:53.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:52 smithi072 bash[21573]: cluster 2024-03-30T14:58:51.629514+0000 mgr.y (mgr.14152) 25 : cluster 0 pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:58:55.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:54 smithi072 bash[21573]: cluster 2024-03-30T14:58:53.629762+0000 mgr.y (mgr.14152) 26 : cluster 0 pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:58:55.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:55.928+0000 7fc3b97fa700 1 -- 172.21.15.72:0/3917564492 <== mgr.14152 v2:172.21.15.72:6800/2777002311 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fc3bc198090 con 0x7fc3a8038f00 2024-03-30T14:58:55.930 INFO:teuthology.orchestra.run.smithi072.stdout:Added host 'smithi172' with addr '172.21.15.172' 2024-03-30T14:58:55.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:55.932+0000 7fc3c2415700 1 -- 172.21.15.72:0/3917564492 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fc3a8038f00 msgr2=0x7fc3a803b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:58:55.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:55.932+0000 7fc3c2415700 1 --2- 172.21.15.72:0/3917564492 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fc3a8038f00 0x7fc3a803b3c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc3a400ad30 tx=0x7fc3a40093f0 comp rx=0 tx=0).stop 2024-03-30T14:58:55.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:55.932+0000 7fc3c2415700 1 -- 172.21.15.72:0/3917564492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3bc106be0 msgr2=0x7fc3bc196d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:58:55.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:55.932+0000 7fc3c2415700 1 --2- 172.21.15.72:0/3917564492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3bc106be0 0x7fc3bc196d80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac00f690 tx=0x7fc3ac00f770 comp rx=0 tx=0).stop 2024-03-30T14:58:55.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:55.932+0000 7fc3c2415700 1 -- 172.21.15.72:0/3917564492 shutdown_connections 2024-03-30T14:58:55.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:55.932+0000 7fc3c2415700 1 --2- 172.21.15.72:0/3917564492 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fc3a8038f00 0x7fc3a803b3c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:58:55.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:55.932+0000 7fc3c2415700 1 --2- 172.21.15.72:0/3917564492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3bc106be0 0x7fc3bc196d80 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:58:55.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:55.932+0000 7fc3c2415700 1 -- 172.21.15.72:0/3917564492 >> 172.21.15.72:0/3917564492 conn(0x7fc3bc077780 msgr2=0x7fc3bc069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:58:55.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:55.932+0000 7fc3c2415700 1 -- 172.21.15.72:0/3917564492 shutdown_connections 2024-03-30T14:58:55.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:58:55.932+0000 7fc3c2415700 1 -- 172.21.15.72:0/3917564492 wait complete. 2024-03-30T14:58:56.667 DEBUG:teuthology.orchestra.run.smithi072:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph orch host ls --format=json 2024-03-30T14:58:57.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:56 smithi072 bash[21573]: cluster 2024-03-30T14:58:55.630162+0000 mgr.y (mgr.14152) 27 : cluster 0 pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:58:57.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:56 smithi072 bash[21573]: audit 2024-03-30T14:58:55.928919+0000 mon.a (mon.0) 113 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:58:57.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:56 smithi072 bash[21573]: cephadm 2024-03-30T14:58:55.929806+0000 mgr.y (mgr.14152) 28 : cephadm 1 Added host smithi172 2024-03-30T14:58:57.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:56 smithi072 bash[21573]: audit 2024-03-30T14:58:55.953615+0000 mon.a (mon.0) 114 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:58:57.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:56 smithi072 bash[21573]: audit 2024-03-30T14:58:56.378514+0000 mon.a (mon.0) 115 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:58:59.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:58 smithi072 bash[21573]: cluster 2024-03-30T14:58:57.630571+0000 mgr.y (mgr.14152) 29 : cluster 0 pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:58:59.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:58:58 smithi072 bash[21573]: audit 2024-03-30T14:58:57.854749+0000 mon.a (mon.0) 116 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:00.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:00 smithi072 bash[21573]: audit 2024-03-30T14:58:59.340200+0000 mon.a (mon.0) 117 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:01.370 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T14:59:01.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:01 smithi072 bash[21573]: cluster 2024-03-30T14:58:59.630981+0000 mgr.y (mgr.14152) 30 : cluster 0 pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:03.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:03 smithi072 bash[21573]: cluster 2024-03-30T14:59:01.631403+0000 mgr.y (mgr.14152) 31 : cluster 0 pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:03.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:03.976+0000 7f4633351700 1 -- 172.21.15.72:0/1431759313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f462c1040a0 msgr2=0x7f462c104480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:59:03.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:03.976+0000 7f4633351700 1 --2- 172.21.15.72:0/1431759313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f462c1040a0 0x7f462c104480 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4628009910 tx=0x7f4628009c20 comp rx=0 tx=0).stop 2024-03-30T14:59:03.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:03.976+0000 7f4633351700 1 -- 172.21.15.72:0/1431759313 shutdown_connections 2024-03-30T14:59:03.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:03.976+0000 7f4633351700 1 --2- 172.21.15.72:0/1431759313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f462c1040a0 0x7f462c104480 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:59:03.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:03.976+0000 7f4633351700 1 -- 172.21.15.72:0/1431759313 >> 172.21.15.72:0/1431759313 conn(0x7f462c0ff950 msgr2=0x7f462c101d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:59:03.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:03.976+0000 7f4633351700 1 -- 172.21.15.72:0/1431759313 shutdown_connections 2024-03-30T14:59:03.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:03.976+0000 7f4633351700 1 -- 172.21.15.72:0/1431759313 wait complete. 2024-03-30T14:59:03.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:03.976+0000 7f4633351700 1 Processor -- start 2024-03-30T14:59:03.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:03.976+0000 7f4633351700 1 -- start start 2024-03-30T14:59:03.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:03.976+0000 7f4633351700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f462c1040a0 0x7f462c198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:59:03.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:03.976+0000 7f4633351700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f462c10d8e0 con 0x7f462c1040a0 2024-03-30T14:59:03.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:03.976+0000 7f46310ed700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f462c1040a0 0x7f462c198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:59:03.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:03.976+0000 7f46310ed700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f462c1040a0 0x7f462c198eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59848/0 (socket says 172.21.15.72:59848) 2024-03-30T14:59:03.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:03.976+0000 7f46310ed700 1 -- 172.21.15.72:0/1012479477 learned_addr learned my addr 172.21.15.72:0/1012479477 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:59:03.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:03.976+0000 7f46310ed700 1 -- 172.21.15.72:0/1012479477 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f462c1993f0 con 0x7f462c1040a0 2024-03-30T14:59:03.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:03.976+0000 7f46310ed700 1 --2- 172.21.15.72:0/1012479477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f462c1040a0 0x7f462c198eb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4628006010 tx=0x7f462800f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:59:03.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:03.976+0000 7f46227fc700 1 -- 172.21.15.72:0/1012479477 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4628027070 con 0x7f462c1040a0 2024-03-30T14:59:03.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:03.976+0000 7f46227fc700 1 -- 172.21.15.72:0/1012479477 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f4628022470 con 0x7f462c1040a0 2024-03-30T14:59:03.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:03.976+0000 7f46227fc700 1 -- 172.21.15.72:0/1012479477 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4628017440 con 0x7f462c1040a0 2024-03-30T14:59:03.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:03.976+0000 7f4633351700 1 -- 172.21.15.72:0/1012479477 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f462c1996e0 con 0x7f462c1040a0 2024-03-30T14:59:03.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:03.976+0000 7f4633351700 1 -- 172.21.15.72:0/1012479477 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f462c19d730 con 0x7f462c1040a0 2024-03-30T14:59:03.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:03.976+0000 7f4633351700 1 -- 172.21.15.72:0/1012479477 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f462c105580 con 0x7f462c1040a0 2024-03-30T14:59:03.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:03.976+0000 7f46227fc700 1 -- 172.21.15.72:0/1012479477 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) ==== 46172+0+0 (secure 0 0 0) 0x7f462802a070 con 0x7f462c1040a0 2024-03-30T14:59:03.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:03.976+0000 7f46227fc700 1 --2- 172.21.15.72:0/1012479477 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f4618038ea0 0x7f461803b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:59:03.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:03.976+0000 7f46227fc700 1 -- 172.21.15.72:0/1012479477 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f462801e030 con 0x7f462c1040a0 2024-03-30T14:59:03.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:03.976+0000 7f46308ec700 1 --2- 172.21.15.72:0/1012479477 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f4618038ea0 0x7f461803b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:59:03.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:03.976+0000 7f46308ec700 1 --2- 172.21.15.72:0/1012479477 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f4618038ea0 0x7f461803b360 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f461c006fd0 tx=0x7f461c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:59:03.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:03.984+0000 7f46227fc700 1 -- 172.21.15.72:0/1012479477 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f4628013070 con 0x7f462c1040a0 2024-03-30T14:59:04.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:04.188+0000 7f4633351700 1 -- 172.21.15.72:0/1012479477 --> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f462c063870 con 0x7f4618038ea0 2024-03-30T14:59:04.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:04.192+0000 7f46227fc700 1 -- 172.21.15.72:0/1012479477 <== mgr.14152 v2:172.21.15.72:6800/2777002311 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+160 (secure 0 0 0) 0x7f462c063870 con 0x7f4618038ea0 2024-03-30T14:59:04.193 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-30T14:59:04.193 INFO:teuthology.orchestra.run.smithi072.stdout:[{"addr": "172.21.15.72", "hostname": "smithi072", "labels": [], "status": ""}, {"addr": "172.21.15.172", "hostname": "smithi172", "labels": [], "status": ""}] 2024-03-30T14:59:04.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:04.192+0000 7f4633351700 1 -- 172.21.15.72:0/1012479477 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f4618038ea0 msgr2=0x7f461803b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:59:04.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:04.192+0000 7f4633351700 1 --2- 172.21.15.72:0/1012479477 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f4618038ea0 0x7f461803b360 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f461c006fd0 tx=0x7f461c006e40 comp rx=0 tx=0).stop 2024-03-30T14:59:04.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:04.192+0000 7f4633351700 1 -- 172.21.15.72:0/1012479477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f462c1040a0 msgr2=0x7f462c198eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:59:04.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:04.192+0000 7f4633351700 1 --2- 172.21.15.72:0/1012479477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f462c1040a0 0x7f462c198eb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4628006010 tx=0x7f462800f740 comp rx=0 tx=0).stop 2024-03-30T14:59:04.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:04.192+0000 7f4633351700 1 -- 172.21.15.72:0/1012479477 shutdown_connections 2024-03-30T14:59:04.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:04.192+0000 7f4633351700 1 --2- 172.21.15.72:0/1012479477 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f4618038ea0 0x7f461803b360 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:59:04.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:04.192+0000 7f4633351700 1 --2- 172.21.15.72:0/1012479477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f462c1040a0 0x7f462c198eb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:59:04.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:04.192+0000 7f4633351700 1 -- 172.21.15.72:0/1012479477 >> 172.21.15.72:0/1012479477 conn(0x7f462c0ff950 msgr2=0x7f462c10bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:59:04.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:04.192+0000 7f4633351700 1 -- 172.21.15.72:0/1012479477 shutdown_connections 2024-03-30T14:59:04.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:04.192+0000 7f4633351700 1 -- 172.21.15.72:0/1012479477 wait complete. 2024-03-30T14:59:04.885 INFO:tasks.cephadm:Setting crush tunables to default 2024-03-30T14:59:04.886 DEBUG:teuthology.orchestra.run.smithi072:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph osd crush tunables default 2024-03-30T14:59:05.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:05 smithi072 bash[21573]: cluster 2024-03-30T14:59:03.631811+0000 mgr.y (mgr.14152) 32 : cluster 0 pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:05.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:05 smithi072 bash[21573]: audit 2024-03-30T14:59:04.193203+0000 mgr.y (mgr.14152) 33 : audit 0 from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T14:59:05.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:05 smithi072 bash[21573]: audit 2024-03-30T14:59:04.678120+0000 mon.a (mon.0) 118 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:05.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:05 smithi072 bash[21573]: audit 2024-03-30T14:59:04.685073+0000 mon.a (mon.0) 119 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:05.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:05 smithi072 bash[21573]: audit 2024-03-30T14:59:04.693601+0000 mon.a (mon.0) 120 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:05.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:05 smithi072 bash[21573]: audit 2024-03-30T14:59:04.699039+0000 mon.a (mon.0) 121 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:05.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:05 smithi072 bash[21573]: audit 2024-03-30T14:59:04.700546+0000 mon.a (mon.0) 122 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi172", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:59:05.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:05 smithi072 bash[21573]: audit 2024-03-30T14:59:04.702489+0000 mon.a (mon.0) 123 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:59:05.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:05 smithi072 bash[21573]: audit 2024-03-30T14:59:04.704215+0000 mon.a (mon.0) 124 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:59:06.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:06 smithi072 bash[21573]: cephadm 2024-03-30T14:59:04.707011+0000 mgr.y (mgr.14152) 34 : cephadm 1 Updating smithi172:/etc/ceph/ceph.conf 2024-03-30T14:59:06.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:06 smithi072 bash[21573]: cephadm 2024-03-30T14:59:04.922526+0000 mgr.y (mgr.14152) 35 : cephadm 1 Updating smithi172:/var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T14:59:06.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:06 smithi072 bash[21573]: cephadm 2024-03-30T14:59:05.086873+0000 mgr.y (mgr.14152) 36 : cephadm 1 Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-03-30T14:59:06.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:06 smithi072 bash[21573]: cephadm 2024-03-30T14:59:05.201278+0000 mgr.y (mgr.14152) 37 : cephadm 1 Updating smithi172:/var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T14:59:06.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:06 smithi072 bash[21573]: audit 2024-03-30T14:59:05.371266+0000 mon.a (mon.0) 125 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:06.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:06 smithi072 bash[21573]: audit 2024-03-30T14:59:05.376921+0000 mon.a (mon.0) 126 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:06.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:06 smithi072 bash[21573]: audit 2024-03-30T14:59:05.382720+0000 mon.a (mon.0) 127 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:07.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:07 smithi072 bash[21573]: cluster 2024-03-30T14:59:05.632199+0000 mgr.y (mgr.14152) 38 : cluster 0 pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:09.599 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T14:59:09.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:09 smithi072 bash[21573]: cluster 2024-03-30T14:59:07.632617+0000 mgr.y (mgr.14152) 39 : cluster 0 pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:11.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:11 smithi072 bash[21573]: cluster 2024-03-30T14:59:09.633051+0000 mgr.y (mgr.14152) 40 : cluster 0 pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:12.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:12.211+0000 7f8a9df25700 1 -- 172.21.15.72:0/3362855327 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a98104090 msgr2=0x7f8a98104470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:59:12.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:12.211+0000 7f8a9df25700 1 --2- 172.21.15.72:0/3362855327 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a98104090 0x7f8a98104470 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8a88009910 tx=0x7f8a88009c20 comp rx=0 tx=0).stop 2024-03-30T14:59:12.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:12.211+0000 7f8a9df25700 1 -- 172.21.15.72:0/3362855327 shutdown_connections 2024-03-30T14:59:12.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:12.211+0000 7f8a9df25700 1 --2- 172.21.15.72:0/3362855327 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a98104090 0x7f8a98104470 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:59:12.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:12.211+0000 7f8a9df25700 1 -- 172.21.15.72:0/3362855327 >> 172.21.15.72:0/3362855327 conn(0x7f8a980ff920 msgr2=0x7f8a98101d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:59:12.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:12.211+0000 7f8a9df25700 1 -- 172.21.15.72:0/3362855327 shutdown_connections 2024-03-30T14:59:12.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:12.211+0000 7f8a9df25700 1 -- 172.21.15.72:0/3362855327 wait complete. 2024-03-30T14:59:12.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:12.211+0000 7f8a9df25700 1 Processor -- start 2024-03-30T14:59:12.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:12.211+0000 7f8a9df25700 1 -- start start 2024-03-30T14:59:12.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:12.211+0000 7f8a9df25700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a98104090 0x7f8a98198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:59:12.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:12.211+0000 7f8a9df25700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9810d8d0 con 0x7f8a98104090 2024-03-30T14:59:12.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:12.211+0000 7f8a977fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a98104090 0x7f8a98198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:59:12.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:12.211+0000 7f8a977fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a98104090 0x7f8a98198e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45654/0 (socket says 172.21.15.72:45654) 2024-03-30T14:59:12.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:12.211+0000 7f8a977fe700 1 -- 172.21.15.72:0/3310260739 learned_addr learned my addr 172.21.15.72:0/3310260739 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:59:12.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:12.211+0000 7f8a977fe700 1 -- 172.21.15.72:0/3310260739 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a981993a0 con 0x7f8a98104090 2024-03-30T14:59:12.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:12.211+0000 7f8a977fe700 1 --2- 172.21.15.72:0/3310260739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a98104090 0x7f8a98198e60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8a88006010 tx=0x7f8a8800f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:59:12.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:12.211+0000 7f8a94ff9700 1 -- 172.21.15.72:0/3310260739 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a88027070 con 0x7f8a98104090 2024-03-30T14:59:12.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:12.211+0000 7f8a94ff9700 1 -- 172.21.15.72:0/3310260739 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f8a88022470 con 0x7f8a98104090 2024-03-30T14:59:12.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:12.211+0000 7f8a94ff9700 1 -- 172.21.15.72:0/3310260739 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a88017440 con 0x7f8a98104090 2024-03-30T14:59:12.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:12.211+0000 7f8a9df25700 1 -- 172.21.15.72:0/3310260739 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a98199690 con 0x7f8a98104090 2024-03-30T14:59:12.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:12.211+0000 7f8a9df25700 1 -- 172.21.15.72:0/3310260739 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a9819d730 con 0x7f8a98104090 2024-03-30T14:59:12.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:12.215+0000 7f8a94ff9700 1 -- 172.21.15.72:0/3310260739 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) ==== 46172+0+0 (secure 0 0 0) 0x7f8a8802a070 con 0x7f8a98104090 2024-03-30T14:59:12.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:12.215+0000 7f8a9df25700 1 -- 172.21.15.72:0/3310260739 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a98105570 con 0x7f8a98104090 2024-03-30T14:59:12.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:12.215+0000 7f8a94ff9700 1 --2- 172.21.15.72:0/3310260739 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f8a80038f00 0x7f8a8003b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:59:12.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:12.215+0000 7f8a94ff9700 1 -- 172.21.15.72:0/3310260739 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f8a8801e030 con 0x7f8a98104090 2024-03-30T14:59:12.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:12.215+0000 7f8a96ffd700 1 --2- 172.21.15.72:0/3310260739 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f8a80038f00 0x7f8a8003b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:59:12.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:12.215+0000 7f8a96ffd700 1 --2- 172.21.15.72:0/3310260739 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f8a80038f00 0x7f8a8003b3c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c006fd0 tx=0x7f8a8c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:59:12.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:12.219+0000 7f8a94ff9700 1 -- 172.21.15.72:0/3310260739 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f8a88013070 con 0x7f8a98104090 2024-03-30T14:59:12.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:12.431+0000 7f8a9df25700 1 -- 172.21.15.72:0/3310260739 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f8a98063870 con 0x7f8a98104090 2024-03-30T14:59:13.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:13.391+0000 7f8a94ff9700 1 -- 172.21.15.72:0/3310260739 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f8a8802bcb0 con 0x7f8a98104090 2024-03-30T14:59:13.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:13.395+0000 7f8a9df25700 1 -- 172.21.15.72:0/3310260739 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f8a80038f00 msgr2=0x7f8a8003b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:59:13.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:13.395+0000 7f8a9df25700 1 --2- 172.21.15.72:0/3310260739 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f8a80038f00 0x7f8a8003b3c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c006fd0 tx=0x7f8a8c006e40 comp rx=0 tx=0).stop 2024-03-30T14:59:13.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:13.395+0000 7f8a9df25700 1 -- 172.21.15.72:0/3310260739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a98104090 msgr2=0x7f8a98198e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:59:13.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:13.395+0000 7f8a9df25700 1 --2- 172.21.15.72:0/3310260739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a98104090 0x7f8a98198e60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8a88006010 tx=0x7f8a8800f740 comp rx=0 tx=0).stop 2024-03-30T14:59:13.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:13.395+0000 7f8a9df25700 1 -- 172.21.15.72:0/3310260739 shutdown_connections 2024-03-30T14:59:13.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:13.395+0000 7f8a9df25700 1 --2- 172.21.15.72:0/3310260739 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f8a80038f00 0x7f8a8003b3c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:59:13.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:13.395+0000 7f8a9df25700 1 --2- 172.21.15.72:0/3310260739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a98104090 0x7f8a98198e60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:59:13.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:13.395+0000 7f8a9df25700 1 -- 172.21.15.72:0/3310260739 >> 172.21.15.72:0/3310260739 conn(0x7f8a980ff920 msgr2=0x7f8a9810bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:59:13.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:13.395+0000 7f8a9df25700 1 -- 172.21.15.72:0/3310260739 shutdown_connections 2024-03-30T14:59:13.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:13.395+0000 7f8a9df25700 1 -- 172.21.15.72:0/3310260739 wait complete. 2024-03-30T14:59:13.402 INFO:teuthology.orchestra.run.smithi072.stderr:adjusted tunables profile to default 2024-03-30T14:59:13.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:13 smithi072 bash[21573]: cluster 2024-03-30T14:59:11.633420+0000 mgr.y (mgr.14152) 41 : cluster 0 pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:13.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:13 smithi072 bash[21573]: audit 2024-03-30T14:59:12.437076+0000 mon.a (mon.0) 128 : audit 1 from='client.? 172.21.15.72:0/3310260739' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-03-30T14:59:14.073 INFO:tasks.cephadm:Adding mon.a on smithi072 2024-03-30T14:59:14.073 INFO:tasks.cephadm:Adding mon.c on smithi072 2024-03-30T14:59:14.074 INFO:tasks.cephadm:Adding mon.b on smithi172 2024-03-30T14:59:14.074 DEBUG:teuthology.orchestra.run.smithi172:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph orch apply mon '3;smithi072:172.21.15.72=a;smithi072:[v2:172.21.15.72:3301,v1:172.21.15.72:6790]=c;smithi172:172.21.15.172=b' 2024-03-30T14:59:14.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:14 smithi072 bash[21573]: audit 2024-03-30T14:59:13.396191+0000 mon.a (mon.0) 129 : audit 1 from='client.? 172.21.15.72:0/3310260739' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-03-30T14:59:14.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:14 smithi072 bash[21573]: cluster 2024-03-30T14:59:13.401840+0000 mon.a (mon.0) 130 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-03-30T14:59:15.286 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T14:59:15.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:15 smithi072 bash[21573]: cluster 2024-03-30T14:59:13.633828+0000 mgr.y (mgr.14152) 42 : cluster 0 pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:17.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:17.404+0000 7f14de3d5700 1 -- 172.21.15.172:0/1693346019 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14d8101e80 msgr2=0x7f14d8102260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:59:17.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:17.404+0000 7f14de3d5700 1 --2- 172.21.15.172:0/1693346019 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14d8101e80 0x7f14d8102260 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f14c8009910 tx=0x7f14c8009c20 comp rx=0 tx=0).stop 2024-03-30T14:59:17.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:17.404+0000 7f14de3d5700 1 -- 172.21.15.172:0/1693346019 shutdown_connections 2024-03-30T14:59:17.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:17.404+0000 7f14de3d5700 1 --2- 172.21.15.172:0/1693346019 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14d8101e80 0x7f14d8102260 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:59:17.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:17.404+0000 7f14de3d5700 1 -- 172.21.15.172:0/1693346019 >> 172.21.15.172:0/1693346019 conn(0x7f14d80fd750 msgr2=0x7f14d80ffb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:59:17.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:17.404+0000 7f14de3d5700 1 -- 172.21.15.172:0/1693346019 shutdown_connections 2024-03-30T14:59:17.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:17.404+0000 7f14de3d5700 1 -- 172.21.15.172:0/1693346019 wait complete. 2024-03-30T14:59:17.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:17.404+0000 7f14de3d5700 1 Processor -- start 2024-03-30T14:59:17.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:17.404+0000 7f14de3d5700 1 -- start start 2024-03-30T14:59:17.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:17.404+0000 7f14de3d5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14d8101e80 0x7f14d819c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:59:17.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:17.404+0000 7f14de3d5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f14d810b6c0 con 0x7f14d8101e80 2024-03-30T14:59:17.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:17.404+0000 7f14d7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14d8101e80 0x7f14d819c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:59:17.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:17.404+0000 7f14d7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14d8101e80 0x7f14d819c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.172:36152/0 (socket says 172.21.15.172:36152) 2024-03-30T14:59:17.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:17.404+0000 7f14d7fff700 1 -- 172.21.15.172:0/1493998688 learned_addr learned my addr 172.21.15.172:0/1493998688 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-03-30T14:59:17.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:17.404+0000 7f14d7fff700 1 -- 172.21.15.172:0/1493998688 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14d819ce50 con 0x7f14d8101e80 2024-03-30T14:59:17.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:17.404+0000 7f14d7fff700 1 --2- 172.21.15.172:0/1493998688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14d8101e80 0x7f14d819c910 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f14c8006010 tx=0x7f14c800f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:59:17.410 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:17.408+0000 7f14d57fa700 1 -- 172.21.15.172:0/1493998688 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14c8027070 con 0x7f14d8101e80 2024-03-30T14:59:17.410 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:17.408+0000 7f14d57fa700 1 -- 172.21.15.172:0/1493998688 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f14c8022470 con 0x7f14d8101e80 2024-03-30T14:59:17.411 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:17.408+0000 7f14de3d5700 1 -- 172.21.15.172:0/1493998688 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14d819d140 con 0x7f14d8101e80 2024-03-30T14:59:17.411 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:17.408+0000 7f14d57fa700 1 -- 172.21.15.172:0/1493998688 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14c8017440 con 0x7f14d8101e80 2024-03-30T14:59:17.411 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:17.408+0000 7f14de3d5700 1 -- 172.21.15.172:0/1493998688 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14d8196ad0 con 0x7f14d8101e80 2024-03-30T14:59:17.411 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:17.408+0000 7f14de3d5700 1 -- 172.21.15.172:0/1493998688 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14d8103360 con 0x7f14d8101e80 2024-03-30T14:59:17.411 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:17.408+0000 7f14d57fa700 1 -- 172.21.15.172:0/1493998688 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) ==== 46172+0+0 (secure 0 0 0) 0x7f14c802a070 con 0x7f14d8101e80 2024-03-30T14:59:17.412 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:17.408+0000 7f14d57fa700 1 --2- 172.21.15.172:0/1493998688 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f14c0038f50 0x7f14c003b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:59:17.412 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:17.408+0000 7f14d57fa700 1 -- 172.21.15.172:0/1493998688 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f14c801e030 con 0x7f14d8101e80 2024-03-30T14:59:17.412 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:17.408+0000 7f14d77fe700 1 --2- 172.21.15.172:0/1493998688 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f14c0038f50 0x7f14c003b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:59:17.413 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:17.412+0000 7f14d77fe700 1 --2- 172.21.15.172:0/1493998688 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f14c0038f50 0x7f14c003b410 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f14cc006fd0 tx=0x7f14cc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:59:17.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:17.424+0000 7f14d57fa700 1 -- 172.21.15.172:0/1493998688 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f14c8013070 con 0x7f14d8101e80 2024-03-30T14:59:17.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:17.644+0000 7f14de3d5700 1 -- 172.21.15.172:0/1493998688 --> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi072:172.21.15.72=a;smithi072:[v2:172.21.15.72:3301,v1:172.21.15.72:6790]=c;smithi172:172.21.15.172=b", "target": ["mon-mgr", ""]}) -- 0x7f14d8197f90 con 0x7f14c0038f50 2024-03-30T14:59:17.662 INFO:teuthology.orchestra.run.smithi172.stdout:Scheduled mon update... 2024-03-30T14:59:17.663 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:17.660+0000 7f14d57fa700 1 -- 172.21.15.172:0/1493998688 <== mgr.14152 v2:172.21.15.72:6800/2777002311 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f14d8197f90 con 0x7f14c0038f50 2024-03-30T14:59:17.663 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:17.660+0000 7f14de3d5700 1 -- 172.21.15.172:0/1493998688 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f14c0038f50 msgr2=0x7f14c003b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:59:17.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:17.660+0000 7f14de3d5700 1 --2- 172.21.15.172:0/1493998688 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f14c0038f50 0x7f14c003b410 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f14cc006fd0 tx=0x7f14cc006e40 comp rx=0 tx=0).stop 2024-03-30T14:59:17.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:17.660+0000 7f14de3d5700 1 -- 172.21.15.172:0/1493998688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14d8101e80 msgr2=0x7f14d819c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:59:17.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:17.660+0000 7f14de3d5700 1 --2- 172.21.15.172:0/1493998688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14d8101e80 0x7f14d819c910 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f14c8006010 tx=0x7f14c800f740 comp rx=0 tx=0).stop 2024-03-30T14:59:17.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:17.660+0000 7f14de3d5700 1 -- 172.21.15.172:0/1493998688 shutdown_connections 2024-03-30T14:59:17.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:17.660+0000 7f14de3d5700 1 --2- 172.21.15.172:0/1493998688 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f14c0038f50 0x7f14c003b410 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:59:17.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:17.660+0000 7f14de3d5700 1 --2- 172.21.15.172:0/1493998688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14d8101e80 0x7f14d819c910 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:59:17.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:17.660+0000 7f14de3d5700 1 -- 172.21.15.172:0/1493998688 >> 172.21.15.172:0/1493998688 conn(0x7f14d80fd750 msgr2=0x7f14d8109af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:59:17.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:17.660+0000 7f14de3d5700 1 -- 172.21.15.172:0/1493998688 shutdown_connections 2024-03-30T14:59:17.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:17.660+0000 7f14de3d5700 1 -- 172.21.15.172:0/1493998688 wait complete. 2024-03-30T14:59:17.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:17 smithi072 bash[21573]: cluster 2024-03-30T14:59:15.634259+0000 mgr.y (mgr.14152) 43 : cluster 0 pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:18.277 DEBUG:teuthology.orchestra.run.smithi072:mon.c> sudo journalctl -f -n 0 -u ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@mon.c.service 2024-03-30T14:59:18.280 DEBUG:teuthology.orchestra.run.smithi172:mon.b> sudo journalctl -f -n 0 -u ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@mon.b.service 2024-03-30T14:59:18.282 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-03-30T14:59:18.282 DEBUG:teuthology.orchestra.run.smithi172:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph mon dump -f json 2024-03-30T14:59:18.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:18 smithi072 bash[21573]: cluster 2024-03-30T14:59:17.634641+0000 mgr.y (mgr.14152) 44 : cluster 0 pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:18.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:18 smithi072 bash[21573]: audit 2024-03-30T14:59:17.648502+0000 mgr.y (mgr.14152) 45 : audit 0 from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi072:172.21.15.72=a;smithi072:[v2:172.21.15.72:3301,v1:172.21.15.72:6790]=c;smithi172:172.21.15.172=b", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:59:18.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:18 smithi072 bash[21573]: cephadm 2024-03-30T14:59:17.654181+0000 mgr.y (mgr.14152) 46 : cephadm 1 Saving service mon spec with placement smithi072:172.21.15.72=a;smithi072:[v2:172.21.15.72:3301,v1:172.21.15.72:6790]=c;smithi172:172.21.15.172=b;count:3 2024-03-30T14:59:18.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:18 smithi072 bash[21573]: audit 2024-03-30T14:59:17.660126+0000 mon.a (mon.0) 131 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:18.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:18 smithi072 bash[21573]: audit 2024-03-30T14:59:17.695785+0000 mon.a (mon.0) 132 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:59:18.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:18 smithi072 bash[21573]: audit 2024-03-30T14:59:17.699759+0000 mon.a (mon.0) 133 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:59:18.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:18 smithi072 bash[21573]: audit 2024-03-30T14:59:17.701864+0000 mon.a (mon.0) 134 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:59:18.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:18 smithi072 bash[21573]: audit 2024-03-30T14:59:17.710527+0000 mon.a (mon.0) 135 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:18.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:18 smithi072 bash[21573]: audit 2024-03-30T14:59:17.714730+0000 mon.a (mon.0) 136 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T14:59:18.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:18 smithi072 bash[21573]: audit 2024-03-30T14:59:17.716534+0000 mon.a (mon.0) 137 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:59:18.923 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:18 smithi072 bash[21573]: cephadm 2024-03-30T14:59:17.718590+0000 mgr.y (mgr.14152) 47 : cephadm 1 Deploying daemon mon.b on smithi172 2024-03-30T14:59:19.522 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T14:59:20.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:20 smithi072 bash[21573]: cluster 2024-03-30T14:59:19.634979+0000 mgr.y (mgr.14152) 48 : cluster 0 pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:22.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:22.740+0000 7f30794f4700 1 -- 172.21.15.172:0/4282659352 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3074102e70 msgr2=0x7f3074103250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:59:22.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:22.740+0000 7f30794f4700 1 --2- 172.21.15.172:0/4282659352 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3074102e70 0x7f3074103250 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f306c009910 tx=0x7f306c009c20 comp rx=0 tx=0).stop 2024-03-30T14:59:22.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:22.740+0000 7f30794f4700 1 -- 172.21.15.172:0/4282659352 shutdown_connections 2024-03-30T14:59:22.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:22.740+0000 7f30794f4700 1 --2- 172.21.15.172:0/4282659352 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3074102e70 0x7f3074103250 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:59:22.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:22.740+0000 7f30794f4700 1 -- 172.21.15.172:0/4282659352 >> 172.21.15.172:0/4282659352 conn(0x7f30740fc680 msgr2=0x7f30740feaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:59:22.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:22.740+0000 7f30794f4700 1 -- 172.21.15.172:0/4282659352 shutdown_connections 2024-03-30T14:59:22.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:22.740+0000 7f30794f4700 1 -- 172.21.15.172:0/4282659352 wait complete. 2024-03-30T14:59:22.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:22.740+0000 7f30794f4700 1 Processor -- start 2024-03-30T14:59:22.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:22.740+0000 7f30794f4700 1 -- start start 2024-03-30T14:59:22.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:22.740+0000 7f30794f4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3074102e70 0x7f3074100ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:59:22.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:22.740+0000 7f30794f4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f307410b750 con 0x7f3074102e70 2024-03-30T14:59:22.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:22.740+0000 7f3072ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3074102e70 0x7f3074100ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:59:22.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:22.740+0000 7f3072ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3074102e70 0x7f3074100ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.172:39278/0 (socket says 172.21.15.172:39278) 2024-03-30T14:59:22.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:22.740+0000 7f3072ffd700 1 -- 172.21.15.172:0/923089544 learned_addr learned my addr 172.21.15.172:0/923089544 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-03-30T14:59:22.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:22.740+0000 7f3072ffd700 1 -- 172.21.15.172:0/923089544 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30741029c0 con 0x7f3074102e70 2024-03-30T14:59:22.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:22.740+0000 7f3072ffd700 1 --2- 172.21.15.172:0/923089544 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3074102e70 0x7f3074100ad0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f306c006010 tx=0x7f306c00f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:59:22.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:22.744+0000 7f306bfff700 1 -- 172.21.15.172:0/923089544 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f306c027070 con 0x7f3074102e70 2024-03-30T14:59:22.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:22.744+0000 7f30794f4700 1 -- 172.21.15.172:0/923089544 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3074101010 con 0x7f3074102e70 2024-03-30T14:59:22.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:22.744+0000 7f30794f4700 1 -- 172.21.15.172:0/923089544 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30741014d0 con 0x7f3074102e70 2024-03-30T14:59:22.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:22.744+0000 7f306bfff700 1 -- 172.21.15.172:0/923089544 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f306c022470 con 0x7f3074102e70 2024-03-30T14:59:22.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:22.744+0000 7f306bfff700 1 -- 172.21.15.172:0/923089544 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f306c017440 con 0x7f3074102e70 2024-03-30T14:59:22.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:22.744+0000 7f30794f4700 1 -- 172.21.15.172:0/923089544 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3054005120 con 0x7f3074102e70 2024-03-30T14:59:22.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:22.744+0000 7f306bfff700 1 -- 172.21.15.172:0/923089544 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) ==== 46172+0+0 (secure 0 0 0) 0x7f306c02a070 con 0x7f3074102e70 2024-03-30T14:59:22.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:22.744+0000 7f306bfff700 1 --2- 172.21.15.172:0/923089544 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f3060038ea0 0x7f306003b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:59:22.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:22.744+0000 7f306bfff700 1 -- 172.21.15.172:0/923089544 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f306c01e030 con 0x7f3074102e70 2024-03-30T14:59:22.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:22.744+0000 7f30727fc700 1 --2- 172.21.15.172:0/923089544 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f3060038ea0 0x7f306003b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:59:22.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:22.744+0000 7f30727fc700 1 --2- 172.21.15.172:0/923089544 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f3060038ea0 0x7f306003b360 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f305c006fd0 tx=0x7f305c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:59:22.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:22.756+0000 7f306bfff700 1 -- 172.21.15.172:0/923089544 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f306c013070 con 0x7f3074102e70 2024-03-30T14:59:22.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:22 smithi072 bash[21573]: cluster 2024-03-30T14:59:21.635364+0000 mgr.y (mgr.14152) 49 : cluster 0 pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:23.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:23.056+0000 7f30794f4700 1 -- 172.21.15.172:0/923089544 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f30540056e0 con 0x7f3074102e70 2024-03-30T14:59:23.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:23.060+0000 7f306bfff700 1 -- 172.21.15.172:0/923089544 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f306c031030 con 0x7f3074102e70 2024-03-30T14:59:23.061 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-30T14:59:23.061 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"97f8e564-eea5-11ee-b647-cb9ed24678a4","modified":"2024-03-30T14:57:00.883324Z","created":"2024-03-30T14:57:00.883324Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3300","nonce":0},{"type":"v1","addr":"172.21.15.72:6789","nonce":0}]},"addr":"172.21.15.72:6789/0","public_addr":"172.21.15.72:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-30T14:59:23.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:23.060+0000 7f30794f4700 1 -- 172.21.15.172:0/923089544 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f3060038ea0 msgr2=0x7f306003b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:59:23.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:23.060+0000 7f30794f4700 1 --2- 172.21.15.172:0/923089544 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f3060038ea0 0x7f306003b360 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f305c006fd0 tx=0x7f305c006e40 comp rx=0 tx=0).stop 2024-03-30T14:59:23.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:23.060+0000 7f30794f4700 1 -- 172.21.15.172:0/923089544 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3074102e70 msgr2=0x7f3074100ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:59:23.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:23.060+0000 7f30794f4700 1 --2- 172.21.15.172:0/923089544 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3074102e70 0x7f3074100ad0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f306c006010 tx=0x7f306c00f740 comp rx=0 tx=0).stop 2024-03-30T14:59:23.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:23.060+0000 7f30794f4700 1 -- 172.21.15.172:0/923089544 shutdown_connections 2024-03-30T14:59:23.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:23.060+0000 7f30794f4700 1 --2- 172.21.15.172:0/923089544 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f3060038ea0 0x7f306003b360 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:59:23.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:23.060+0000 7f30794f4700 1 --2- 172.21.15.172:0/923089544 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3074102e70 0x7f3074100ad0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:59:23.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:23.060+0000 7f30794f4700 1 -- 172.21.15.172:0/923089544 >> 172.21.15.172:0/923089544 conn(0x7f30740fc680 msgr2=0x7f30741064c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:59:23.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:23.060+0000 7f30794f4700 1 -- 172.21.15.172:0/923089544 shutdown_connections 2024-03-30T14:59:23.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:23.060+0000 7f30794f4700 1 -- 172.21.15.172:0/923089544 wait complete. 2024-03-30T14:59:23.065 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-03-30T14:59:23.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:23 smithi172 systemd[1]: Started Ceph mon.b for 97f8e564-eea5-11ee-b647-cb9ed24678a4. 2024-03-30T14:59:23.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:23 smithi072 bash[21573]: audit 2024-03-30T14:59:23.061337+0000 mon.a (mon.0) 138 : audit 0 from='client.? 172.21.15.172:0/923089544' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-30T14:59:23.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:23 smithi072 bash[21573]: audit 2024-03-30T14:59:23.175198+0000 mon.a (mon.0) 139 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:23.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:23 smithi072 bash[21573]: audit 2024-03-30T14:59:23.181666+0000 mon.a (mon.0) 140 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:23.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:23 smithi072 bash[21573]: audit 2024-03-30T14:59:23.204157+0000 mon.a (mon.0) 141 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:23.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:23 smithi072 bash[21573]: audit 2024-03-30T14:59:23.205659+0000 mon.a (mon.0) 142 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T14:59:23.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:23 smithi072 bash[21573]: audit 2024-03-30T14:59:23.207393+0000 mon.a (mon.0) 143 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:59:23.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:23 smithi072 bash[21573]: cephadm 2024-03-30T14:59:23.209320+0000 mgr.y (mgr.14152) 50 : cephadm 1 Deploying daemon mon.c on smithi072 2024-03-30T14:59:23.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:23 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T14:59:24.361 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.320+0000 7f17acf6dc80 0 set uid:gid to 167:167 (ceph:ceph) 2024-03-30T14:59:24.361 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.320+0000 7f17acf6dc80 0 ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev), process ceph-mon, pid 7 2024-03-30T14:59:24.361 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.320+0000 7f17acf6dc80 0 pidfile_write: ignore empty --pid-file 2024-03-30T14:59:24.361 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 0 load: jerasure load: lrc 2024-03-30T14:59:24.361 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: RocksDB version: 7.9.2 2024-03-30T14:59:24.362 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Git sha 0 2024-03-30T14:59:24.362 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Compile date 2024-03-29 15:06:16 2024-03-30T14:59:24.362 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: DB SUMMARY 2024-03-30T14:59:24.362 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: DB Session ID: KJSE4JGSR93YC481D7T3 2024-03-30T14:59:24.362 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: CURRENT file: CURRENT 2024-03-30T14:59:24.362 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: IDENTITY file: IDENTITY 2024-03-30T14:59:24.362 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-03-30T14:59:24.362 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-03-30T14:59:24.362 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 511 ; 2024-03-30T14:59:24.362 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.error_if_exists: 0 2024-03-30T14:59:24.362 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.create_if_missing: 0 2024-03-30T14:59:24.362 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.paranoid_checks: 1 2024-03-30T14:59:24.362 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.flush_verify_memtable_count: 1 2024-03-30T14:59:24.363 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-30T14:59:24.363 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-30T14:59:24.363 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.env: 0x55f852183c60 2024-03-30T14:59:24.363 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.fs: PosixFileSystem 2024-03-30T14:59:24.363 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.info_log: 0x55f85301fb20 2024-03-30T14:59:24.363 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.max_file_opening_threads: 16 2024-03-30T14:59:24.363 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.statistics: (nil) 2024-03-30T14:59:24.363 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.use_fsync: 0 2024-03-30T14:59:24.363 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.max_log_file_size: 0 2024-03-30T14:59:24.363 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-30T14:59:24.363 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.log_file_time_to_roll: 0 2024-03-30T14:59:24.363 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.keep_log_file_num: 1000 2024-03-30T14:59:24.363 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.recycle_log_file_num: 0 2024-03-30T14:59:24.363 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.allow_fallocate: 1 2024-03-30T14:59:24.363 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.allow_mmap_reads: 0 2024-03-30T14:59:24.364 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.allow_mmap_writes: 0 2024-03-30T14:59:24.364 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.use_direct_reads: 0 2024-03-30T14:59:24.364 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-30T14:59:24.364 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.create_missing_column_families: 0 2024-03-30T14:59:24.364 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.db_log_dir: 2024-03-30T14:59:24.364 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.wal_dir: 2024-03-30T14:59:24.364 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.table_cache_numshardbits: 6 2024-03-30T14:59:24.364 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-03-30T14:59:24.364 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-03-30T14:59:24.364 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-30T14:59:24.364 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-30T14:59:24.364 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-03-30T14:59:24.364 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.advise_random_on_open: 1 2024-03-30T14:59:24.369 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.db_write_buffer_size: 0 2024-03-30T14:59:24.369 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.write_buffer_manager: 0x55f852ff21e0 2024-03-30T14:59:24.369 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-30T14:59:24.369 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-30T14:59:24.369 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.use_adaptive_mutex: 0 2024-03-30T14:59:24.369 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.rate_limiter: (nil) 2024-03-30T14:59:24.369 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-30T14:59:24.369 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.wal_recovery_mode: 2 2024-03-30T14:59:24.369 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.enable_thread_tracking: 0 2024-03-30T14:59:24.369 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.enable_pipelined_write: 0 2024-03-30T14:59:24.369 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.unordered_write: 0 2024-03-30T14:59:24.369 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-30T14:59:24.370 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-30T14:59:24.370 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-30T14:59:24.370 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-30T14:59:24.370 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.row_cache: None 2024-03-30T14:59:24.370 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.wal_filter: None 2024-03-30T14:59:24.370 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-30T14:59:24.370 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.allow_ingest_behind: 0 2024-03-30T14:59:24.370 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.two_write_queues: 0 2024-03-30T14:59:24.370 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.manual_wal_flush: 0 2024-03-30T14:59:24.371 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.wal_compression: 0 2024-03-30T14:59:24.371 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.atomic_flush: 0 2024-03-30T14:59:24.371 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-30T14:59:24.371 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.persist_stats_to_disk: 0 2024-03-30T14:59:24.371 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-03-30T14:59:24.371 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.log_readahead_size: 0 2024-03-30T14:59:24.371 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-30T14:59:24.371 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.best_efforts_recovery: 0 2024-03-30T14:59:24.371 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-30T14:59:24.371 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-30T14:59:24.371 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.allow_data_in_errors: 0 2024-03-30T14:59:24.371 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.db_host_id: __hostname__ 2024-03-30T14:59:24.372 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.enforce_single_del_contracts: true 2024-03-30T14:59:24.372 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.max_background_jobs: 2 2024-03-30T14:59:24.372 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.max_background_compactions: -1 2024-03-30T14:59:24.372 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.max_subcompactions: 1 2024-03-30T14:59:24.372 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-30T14:59:24.372 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-30T14:59:24.372 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.delayed_write_rate : 16777216 2024-03-30T14:59:24.372 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.max_total_wal_size: 0 2024-03-30T14:59:24.372 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-30T14:59:24.372 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.stats_dump_period_sec: 600 2024-03-30T14:59:24.372 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.stats_persist_period_sec: 600 2024-03-30T14:59:24.372 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-30T14:59:24.372 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.max_open_files: -1 2024-03-30T14:59:24.372 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.bytes_per_sync: 0 2024-03-30T14:59:24.373 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-03-30T14:59:24.373 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-03-30T14:59:24.373 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.compaction_readahead_size: 0 2024-03-30T14:59:24.373 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.max_background_flushes: -1 2024-03-30T14:59:24.373 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Compression algorithms supported: 2024-03-30T14:59:24.373 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-30T14:59:24.373 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: kZSTD supported: 0 2024-03-30T14:59:24.373 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: kXpressCompression supported: 0 2024-03-30T14:59:24.373 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: kLZ4HCCompression supported: 1 2024-03-30T14:59:24.373 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: kZlibCompression supported: 1 2024-03-30T14:59:24.373 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: kSnappyCompression supported: 1 2024-03-30T14:59:24.373 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: kLZ4Compression supported: 1 2024-03-30T14:59:24.373 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: kBZip2Compression supported: 0 2024-03-30T14:59:24.373 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-03-30T14:59:24.373 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: DMutex implementation: pthread_mutex_t 2024-03-30T14:59:24.374 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-03-30T14:59:24.374 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-30T14:59:24.374 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-30T14:59:24.374 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.merge_operator: 2024-03-30T14:59:24.374 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.compaction_filter: None 2024-03-30T14:59:24.374 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.compaction_filter_factory: None 2024-03-30T14:59:24.374 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.sst_partitioner_factory: None 2024-03-30T14:59:24.374 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-03-30T14:59:24.374 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.table_factory: BlockBasedTable 2024-03-30T14:59:24.374 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55f85301fc40) 2024-03-30T14:59:24.374 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: cache_index_and_filter_blocks: 1 2024-03-30T14:59:24.374 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-30T14:59:24.374 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-30T14:59:24.375 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: pin_top_level_index_and_filter: 1 2024-03-30T14:59:24.375 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: index_type: 0 2024-03-30T14:59:24.375 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: data_block_index_type: 0 2024-03-30T14:59:24.375 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: index_shortening: 1 2024-03-30T14:59:24.375 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: data_block_hash_table_util_ratio: 0.750000 2024-03-30T14:59:24.375 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: checksum: 4 2024-03-30T14:59:24.375 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: no_block_cache: 0 2024-03-30T14:59:24.375 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: block_cache: 0x55f853021090 2024-03-30T14:59:24.375 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: block_cache_name: BinnedLRUCache 2024-03-30T14:59:24.375 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: block_cache_options: 2024-03-30T14:59:24.375 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: capacity : 536870912 2024-03-30T14:59:24.375 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: num_shard_bits : 4 2024-03-30T14:59:24.375 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: strict_capacity_limit : 0 2024-03-30T14:59:24.375 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: high_pri_pool_ratio: 0.000 2024-03-30T14:59:24.376 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: block_cache_compressed: (nil) 2024-03-30T14:59:24.376 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: persistent_cache: (nil) 2024-03-30T14:59:24.376 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: block_size: 4096 2024-03-30T14:59:24.376 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: block_size_deviation: 10 2024-03-30T14:59:24.376 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: block_restart_interval: 16 2024-03-30T14:59:24.376 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: index_block_restart_interval: 1 2024-03-30T14:59:24.376 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: metadata_block_size: 4096 2024-03-30T14:59:24.376 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: partition_filters: 0 2024-03-30T14:59:24.376 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: use_delta_encoding: 1 2024-03-30T14:59:24.376 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: filter_policy: bloomfilter 2024-03-30T14:59:24.376 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: whole_key_filtering: 1 2024-03-30T14:59:24.376 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: verify_compression: 0 2024-03-30T14:59:24.376 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: read_amp_bytes_per_bit: 0 2024-03-30T14:59:24.376 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: format_version: 5 2024-03-30T14:59:24.376 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: enable_index_compression: 1 2024-03-30T14:59:24.377 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: block_align: 0 2024-03-30T14:59:24.377 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: max_auto_readahead_size: 262144 2024-03-30T14:59:24.377 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: prepopulate_block_cache: 0 2024-03-30T14:59:24.377 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: initial_auto_readahead_size: 8192 2024-03-30T14:59:24.377 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: num_file_reads_for_auto_readahead: 2 2024-03-30T14:59:24.377 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.write_buffer_size: 33554432 2024-03-30T14:59:24.377 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.max_write_buffer_number: 2 2024-03-30T14:59:24.377 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.compression: NoCompression 2024-03-30T14:59:24.377 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.bottommost_compression: Disabled 2024-03-30T14:59:24.377 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.prefix_extractor: nullptr 2024-03-30T14:59:24.377 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-30T14:59:24.377 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.num_levels: 7 2024-03-30T14:59:24.377 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-30T14:59:24.377 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-30T14:59:24.378 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-30T14:59:24.378 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-30T14:59:24.378 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-30T14:59:24.378 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-30T14:59:24.378 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-30T14:59:24.378 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-30T14:59:24.378 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-30T14:59:24.378 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-30T14:59:24.378 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-30T14:59:24.378 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-30T14:59:24.378 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.compression_opts.window_bits: -14 2024-03-30T14:59:24.378 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.compression_opts.level: 32767 2024-03-30T14:59:24.378 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.compression_opts.strategy: 0 2024-03-30T14:59:24.378 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-30T14:59:24.378 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-30T14:59:24.379 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-30T14:59:24.379 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-30T14:59:24.379 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.compression_opts.enabled: false 2024-03-30T14:59:24.379 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-30T14:59:24.380 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-30T14:59:24.380 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-30T14:59:24.380 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-30T14:59:24.380 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.target_file_size_base: 67108864 2024-03-30T14:59:24.381 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.target_file_size_multiplier: 1 2024-03-30T14:59:24.381 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-30T14:59:24.381 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-30T14:59:24.381 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-30T14:59:24.381 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-30T14:59:24.381 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-30T14:59:24.381 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-30T14:59:24.381 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-30T14:59:24.381 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-30T14:59:24.381 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-30T14:59:24.381 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-30T14:59:24.381 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-30T14:59:24.381 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-30T14:59:24.381 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-30T14:59:24.382 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.arena_block_size: 1048576 2024-03-30T14:59:24.382 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-30T14:59:24.382 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-30T14:59:24.382 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.disable_auto_compactions: 0 2024-03-30T14:59:24.382 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-30T14:59:24.382 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-30T14:59:24.382 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-30T14:59:24.382 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-30T14:59:24.382 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-30T14:59:24.382 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-30T14:59:24.382 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-30T14:59:24.382 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-30T14:59:24.382 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-30T14:59:24.382 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-30T14:59:24.383 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.table_properties_collectors: 2024-03-30T14:59:24.383 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.inplace_update_support: 0 2024-03-30T14:59:24.383 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-03-30T14:59:24.383 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-30T14:59:24.383 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-30T14:59:24.383 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.memtable_huge_page_size: 0 2024-03-30T14:59:24.383 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.bloom_locality: 0 2024-03-30T14:59:24.383 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.max_successive_merges: 0 2024-03-30T14:59:24.383 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-03-30T14:59:24.383 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.paranoid_file_checks: 0 2024-03-30T14:59:24.383 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.force_consistency_checks: 1 2024-03-30T14:59:24.383 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.report_bg_io_stats: 0 2024-03-30T14:59:24.383 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.ttl: 2592000 2024-03-30T14:59:24.383 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-03-30T14:59:24.383 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-30T14:59:24.384 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-30T14:59:24.384 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.enable_blob_files: false 2024-03-30T14:59:24.384 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.min_blob_size: 0 2024-03-30T14:59:24.384 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.blob_file_size: 268435456 2024-03-30T14:59:24.384 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.blob_compression_type: NoCompression 2024-03-30T14:59:24.384 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-03-30T14:59:24.384 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-30T14:59:24.384 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-30T14:59:24.384 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-30T14:59:24.384 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.blob_file_starting_level: 0 2024-03-30T14:59:24.384 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-30T14:59:24.384 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-03-30T14:59:24.384 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.324+0000 7f17acf6dc80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-03-30T14:59:24.385 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.328+0000 7f17acf6dc80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 035c7549-6542-445e-8e2e-1f3066d80b81 2024-03-30T14:59:24.385 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.328+0000 7f17acf6dc80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1711810764329609, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-03-30T14:59:24.385 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.328+0000 7f17acf6dc80 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-03-30T14:59:24.385 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.328+0000 7f17acf6dc80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1711810764330231, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1711810764, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "035c7549-6542-445e-8e2e-1f3066d80b81", "db_session_id": "KJSE4JGSR93YC481D7T3", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-03-30T14:59:24.385 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.328+0000 7f17acf6dc80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1711810764330354, "job": 1, "event": "recovery_finished"} 2024-03-30T14:59:24.385 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.328+0000 7f17acf6dc80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-03-30T14:59:24.385 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.328+0000 7f17acf6dc80 4 rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-30T14:59:24.385 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.328+0000 7f17acf6dc80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55f853116000 2024-03-30T14:59:24.385 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.328+0000 7f17acf6dc80 4 rocksdb: DB pointer 0x55f853100000 2024-03-30T14:59:24.385 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.328+0000 7f179b6cf700 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-30T14:59:24.385 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.328+0000 7f179b6cf700 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-30T14:59:24.385 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: ** DB Stats ** 2024-03-30T14:59:24.385 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: Uptime(secs): 0.0 total, 0.0 interval 2024-03-30T14:59:24.385 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-30T14:59:24.385 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-30T14:59:24.386 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-30T14:59:24.386 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-30T14:59:24.386 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-30T14:59:24.386 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-30T14:59:24.386 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: ** Compaction Stats [default] ** 2024-03-30T14:59:24.388 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-30T14:59:24.388 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-30T14:59:24.388 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-30T14:59:24.388 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-30T14:59:24.390 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-30T14:59:24.390 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: ** Compaction Stats [default] ** 2024-03-30T14:59:24.390 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-30T14:59:24.390 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-30T14:59:24.390 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-30T14:59:24.390 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-30T14:59:24.390 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: Uptime(secs): 0.0 total, 0.0 interval 2024-03-30T14:59:24.390 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: Flush(GB): cumulative 0.000, interval 0.000 2024-03-30T14:59:24.390 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-30T14:59:24.390 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: AddFile(Total Files): cumulative 0, interval 0 2024-03-30T14:59:24.390 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: AddFile(L0 Files): cumulative 0, interval 0 2024-03-30T14:59:24.390 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: AddFile(Keys): cumulative 0, interval 0 2024-03-30T14:59:24.390 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: Cumulative compaction: 0.00 GB write, 0.37 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-30T14:59:24.391 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: Interval compaction: 0.00 GB write, 0.37 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-30T14:59:24.391 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-30T14:59:24.391 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: Block cache BinnedLRUCache@0x55f853021090#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.5e-05 secs_since: 0 2024-03-30T14:59:24.391 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-03-30T14:59:24.391 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: ** File Read Latency Histogram By Level [default] ** 2024-03-30T14:59:24.391 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.328+0000 7f17acf6dc80 0 mon.b does not exist in monmap, will attempt to join an existing cluster 2024-03-30T14:59:24.391 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.328+0000 7f17acf6dc80 0 using public_addr v2:172.21.15.172:0/0 -> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-03-30T14:59:24.391 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.332+0000 7f17acf6dc80 0 starting mon.b rank -1 at public addrs [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] at bind addrs [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 2024-03-30T14:59:24.391 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.332+0000 7f17acf6dc80 1 mon.b@-1(???) e0 preinit fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 2024-03-30T14:59:24.391 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.356+0000 7f179e6d5700 0 mon.b@-1(synchronizing).mds e1 new map 2024-03-30T14:59:24.391 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.356+0000 7f179e6d5700 0 mon.b@-1(synchronizing).mds e1 print_map 2024-03-30T14:59:24.391 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: e1 2024-03-30T14:59:24.391 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: enable_multiple, ever_enabled_multiple: 1,1 2024-03-30T14:59:24.391 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-03-30T14:59:24.392 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: legacy client fscid: -1 2024-03-30T14:59:24.392 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: 2024-03-30T14:59:24.392 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: No filesystems configured 2024-03-30T14:59:24.392 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.356+0000 7f179e6d5700 1 mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-03-30T14:59:24.392 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.356+0000 7f179e6d5700 1 mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-03-30T14:59:24.392 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.356+0000 7f179e6d5700 1 mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-03-30T14:59:24.392 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.356+0000 7f179e6d5700 1 mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-03-30T14:59:24.392 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.356+0000 7f179e6d5700 1 mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-03-30T14:59:24.392 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.356+0000 7f179e6d5700 1 mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-03-30T14:59:24.392 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.356+0000 7f179e6d5700 0 mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-03-30T14:59:24.392 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.356+0000 7f179e6d5700 0 mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-30T14:59:24.392 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.356+0000 7f179e6d5700 0 mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-30T14:59:24.392 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.356+0000 7f179e6d5700 0 mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-30T14:59:24.393 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: cluster 2024-03-30T14:58:45.628371+0000 mgr.y (mgr.14152) 20 : cluster 0 pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:24.393 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: cluster 2024-03-30T14:58:47.628786+0000 mgr.y (mgr.14152) 21 : cluster 0 pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:24.393 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: cluster 2024-03-30T14:58:49.629149+0000 mgr.y (mgr.14152) 22 : cluster 0 pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:24.393 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: audit 2024-03-30T14:58:50.112380+0000 mgr.y (mgr.14152) 23 : audit 0 from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi172", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:59:24.393 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: cephadm 2024-03-30T14:58:50.770895+0000 mgr.y (mgr.14152) 24 : cephadm 1 Deploying cephadm binary to smithi172 2024-03-30T14:59:24.393 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: cluster 2024-03-30T14:58:51.629514+0000 mgr.y (mgr.14152) 25 : cluster 0 pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:24.393 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: cluster 2024-03-30T14:58:53.629762+0000 mgr.y (mgr.14152) 26 : cluster 0 pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:24.393 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: cluster 2024-03-30T14:58:55.630162+0000 mgr.y (mgr.14152) 27 : cluster 0 pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:24.393 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: audit 2024-03-30T14:58:55.928919+0000 mon.a (mon.0) 113 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:24.393 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: cephadm 2024-03-30T14:58:55.929806+0000 mgr.y (mgr.14152) 28 : cephadm 1 Added host smithi172 2024-03-30T14:59:24.394 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: audit 2024-03-30T14:58:55.953615+0000 mon.a (mon.0) 114 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:59:24.394 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: audit 2024-03-30T14:58:56.378514+0000 mon.a (mon.0) 115 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:24.394 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: cluster 2024-03-30T14:58:57.630571+0000 mgr.y (mgr.14152) 29 : cluster 0 pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:24.394 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: audit 2024-03-30T14:58:57.854749+0000 mon.a (mon.0) 116 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:24.394 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: audit 2024-03-30T14:58:59.340200+0000 mon.a (mon.0) 117 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:24.394 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: cluster 2024-03-30T14:58:59.630981+0000 mgr.y (mgr.14152) 30 : cluster 0 pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:24.394 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: cluster 2024-03-30T14:59:01.631403+0000 mgr.y (mgr.14152) 31 : cluster 0 pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:24.394 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: cluster 2024-03-30T14:59:03.631811+0000 mgr.y (mgr.14152) 32 : cluster 0 pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:24.394 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: audit 2024-03-30T14:59:04.193203+0000 mgr.y (mgr.14152) 33 : audit 0 from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T14:59:24.394 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: audit 2024-03-30T14:59:04.678120+0000 mon.a (mon.0) 118 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:24.394 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: audit 2024-03-30T14:59:04.685073+0000 mon.a (mon.0) 119 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:24.394 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: audit 2024-03-30T14:59:04.693601+0000 mon.a (mon.0) 120 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:24.394 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: audit 2024-03-30T14:59:04.699039+0000 mon.a (mon.0) 121 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:24.394 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: audit 2024-03-30T14:59:04.700546+0000 mon.a (mon.0) 122 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi172", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:59:24.394 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: audit 2024-03-30T14:59:04.702489+0000 mon.a (mon.0) 123 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:59:24.395 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: audit 2024-03-30T14:59:04.704215+0000 mon.a (mon.0) 124 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:59:24.395 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: cephadm 2024-03-30T14:59:04.707011+0000 mgr.y (mgr.14152) 34 : cephadm 1 Updating smithi172:/etc/ceph/ceph.conf 2024-03-30T14:59:24.395 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: cephadm 2024-03-30T14:59:04.922526+0000 mgr.y (mgr.14152) 35 : cephadm 1 Updating smithi172:/var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T14:59:24.395 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: cephadm 2024-03-30T14:59:05.086873+0000 mgr.y (mgr.14152) 36 : cephadm 1 Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-03-30T14:59:24.395 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: cephadm 2024-03-30T14:59:05.201278+0000 mgr.y (mgr.14152) 37 : cephadm 1 Updating smithi172:/var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T14:59:24.395 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: audit 2024-03-30T14:59:05.371266+0000 mon.a (mon.0) 125 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:24.395 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: audit 2024-03-30T14:59:05.376921+0000 mon.a (mon.0) 126 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:24.395 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: audit 2024-03-30T14:59:05.382720+0000 mon.a (mon.0) 127 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:24.395 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: cluster 2024-03-30T14:59:05.632199+0000 mgr.y (mgr.14152) 38 : cluster 0 pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:24.395 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: cluster 2024-03-30T14:59:07.632617+0000 mgr.y (mgr.14152) 39 : cluster 0 pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:24.395 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: cluster 2024-03-30T14:59:09.633051+0000 mgr.y (mgr.14152) 40 : cluster 0 pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:24.395 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: cluster 2024-03-30T14:59:11.633420+0000 mgr.y (mgr.14152) 41 : cluster 0 pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:24.395 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: audit 2024-03-30T14:59:12.437076+0000 mon.a (mon.0) 128 : audit 1 from='client.? 172.21.15.72:0/3310260739' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-03-30T14:59:24.395 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: audit 2024-03-30T14:59:13.396191+0000 mon.a (mon.0) 129 : audit 1 from='client.? 172.21.15.72:0/3310260739' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-03-30T14:59:24.395 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: cluster 2024-03-30T14:59:13.401840+0000 mon.a (mon.0) 130 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-03-30T14:59:24.396 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: cluster 2024-03-30T14:59:13.633828+0000 mgr.y (mgr.14152) 42 : cluster 0 pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:24.396 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: cluster 2024-03-30T14:59:15.634259+0000 mgr.y (mgr.14152) 43 : cluster 0 pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:24.396 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: cluster 2024-03-30T14:59:17.634641+0000 mgr.y (mgr.14152) 44 : cluster 0 pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:24.396 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: audit 2024-03-30T14:59:17.648502+0000 mgr.y (mgr.14152) 45 : audit 0 from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi072:172.21.15.72=a;smithi072:[v2:172.21.15.72:3301,v1:172.21.15.72:6790]=c;smithi172:172.21.15.172=b", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:59:24.396 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: cephadm 2024-03-30T14:59:17.654181+0000 mgr.y (mgr.14152) 46 : cephadm 1 Saving service mon spec with placement smithi072:172.21.15.72=a;smithi072:[v2:172.21.15.72:3301,v1:172.21.15.72:6790]=c;smithi172:172.21.15.172=b;count:3 2024-03-30T14:59:24.396 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: audit 2024-03-30T14:59:17.660126+0000 mon.a (mon.0) 131 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:24.396 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: audit 2024-03-30T14:59:17.695785+0000 mon.a (mon.0) 132 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:59:24.396 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: audit 2024-03-30T14:59:17.699759+0000 mon.a (mon.0) 133 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:59:24.396 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: audit 2024-03-30T14:59:17.701864+0000 mon.a (mon.0) 134 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:59:24.396 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: audit 2024-03-30T14:59:17.710527+0000 mon.a (mon.0) 135 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:24.396 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: audit 2024-03-30T14:59:17.714730+0000 mon.a (mon.0) 136 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T14:59:24.396 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: audit 2024-03-30T14:59:17.716534+0000 mon.a (mon.0) 137 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:59:24.396 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: cephadm 2024-03-30T14:59:17.718590+0000 mgr.y (mgr.14152) 47 : cephadm 1 Deploying daemon mon.b on smithi172 2024-03-30T14:59:24.396 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: cluster 2024-03-30T14:59:19.634979+0000 mgr.y (mgr.14152) 48 : cluster 0 pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:24.396 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: cluster 2024-03-30T14:59:21.635364+0000 mgr.y (mgr.14152) 49 : cluster 0 pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:24.397 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: audit 2024-03-30T14:59:23.061337+0000 mon.a (mon.0) 138 : audit 0 from='client.? 172.21.15.172:0/923089544' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-30T14:59:24.397 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: audit 2024-03-30T14:59:23.175198+0000 mon.a (mon.0) 139 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:24.397 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: audit 2024-03-30T14:59:23.181666+0000 mon.a (mon.0) 140 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:24.397 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: audit 2024-03-30T14:59:23.204157+0000 mon.a (mon.0) 141 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:24.397 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: audit 2024-03-30T14:59:23.205659+0000 mon.a (mon.0) 142 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T14:59:24.397 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: audit 2024-03-30T14:59:23.207393+0000 mon.a (mon.0) 143 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:59:24.397 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: cephadm 2024-03-30T14:59:23.209320+0000 mgr.y (mgr.14152) 50 : cephadm 1 Deploying daemon mon.c on smithi072 2024-03-30T14:59:24.397 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:24 smithi172 bash[23680]: debug 2024-03-30T14:59:24.356+0000 7f179e6d5700 1 mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-03-30T14:59:25.104 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-03-30T14:59:25.104 DEBUG:teuthology.orchestra.run.smithi172:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph mon dump -f json 2024-03-30T14:59:27.004 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:26 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T14:59:27.004 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:59:26 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T14:59:27.005 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:26 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T14:59:27.005 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:26 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T14:59:27.005 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:26 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T14:59:27.259 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:27 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T14:59:27.259 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:59:27 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T14:59:27.260 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:27 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T14:59:27.260 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:27 smithi072 systemd[1]: Started Ceph mon.c for 97f8e564-eea5-11ee-b647-cb9ed24678a4. 2024-03-30T14:59:28.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.171+0000 7ff05a8ecc80 0 set uid:gid to 167:167 (ceph:ceph) 2024-03-30T14:59:28.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.171+0000 7ff05a8ecc80 0 ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev), process ceph-mon, pid 7 2024-03-30T14:59:28.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.175+0000 7ff05a8ecc80 0 pidfile_write: ignore empty --pid-file 2024-03-30T14:59:28.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 0 load: jerasure load: lrc 2024-03-30T14:59:28.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: RocksDB version: 7.9.2 2024-03-30T14:59:28.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Git sha 0 2024-03-30T14:59:28.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Compile date 2024-03-29 15:06:16 2024-03-30T14:59:28.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: DB SUMMARY 2024-03-30T14:59:28.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: DB Session ID: DGUYJ8SLLHCT2GZY5WAP 2024-03-30T14:59:28.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: CURRENT file: CURRENT 2024-03-30T14:59:28.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: IDENTITY file: IDENTITY 2024-03-30T14:59:28.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-03-30T14:59:28.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-03-30T14:59:28.424 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-03-30T14:59:28.424 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.error_if_exists: 0 2024-03-30T14:59:28.424 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.create_if_missing: 0 2024-03-30T14:59:28.424 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.paranoid_checks: 1 2024-03-30T14:59:28.424 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.flush_verify_memtable_count: 1 2024-03-30T14:59:28.424 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-30T14:59:28.424 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-30T14:59:28.424 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.env: 0x5561b4f5dc60 2024-03-30T14:59:28.424 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.fs: PosixFileSystem 2024-03-30T14:59:28.424 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.info_log: 0x5561b64b7b20 2024-03-30T14:59:28.424 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.max_file_opening_threads: 16 2024-03-30T14:59:28.424 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.statistics: (nil) 2024-03-30T14:59:28.424 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.use_fsync: 0 2024-03-30T14:59:28.424 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.max_log_file_size: 0 2024-03-30T14:59:28.425 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-30T14:59:28.425 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.log_file_time_to_roll: 0 2024-03-30T14:59:28.425 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.keep_log_file_num: 1000 2024-03-30T14:59:28.425 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.recycle_log_file_num: 0 2024-03-30T14:59:28.425 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.allow_fallocate: 1 2024-03-30T14:59:28.425 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.allow_mmap_reads: 0 2024-03-30T14:59:28.426 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.allow_mmap_writes: 0 2024-03-30T14:59:28.426 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.use_direct_reads: 0 2024-03-30T14:59:28.426 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-30T14:59:28.426 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.create_missing_column_families: 0 2024-03-30T14:59:28.426 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.db_log_dir: 2024-03-30T14:59:28.426 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.wal_dir: 2024-03-30T14:59:28.426 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.table_cache_numshardbits: 6 2024-03-30T14:59:28.426 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-03-30T14:59:28.426 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-03-30T14:59:28.426 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-30T14:59:28.426 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-30T14:59:28.426 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-03-30T14:59:28.426 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.advise_random_on_open: 1 2024-03-30T14:59:28.426 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.db_write_buffer_size: 0 2024-03-30T14:59:28.427 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.write_buffer_manager: 0x5561b648a1e0 2024-03-30T14:59:28.427 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-30T14:59:28.427 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-30T14:59:28.427 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.use_adaptive_mutex: 0 2024-03-30T14:59:28.427 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.rate_limiter: (nil) 2024-03-30T14:59:28.427 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-30T14:59:28.427 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.wal_recovery_mode: 2 2024-03-30T14:59:28.427 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.enable_thread_tracking: 0 2024-03-30T14:59:28.427 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.enable_pipelined_write: 0 2024-03-30T14:59:28.427 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.unordered_write: 0 2024-03-30T14:59:28.427 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-30T14:59:28.427 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-30T14:59:28.428 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-30T14:59:28.428 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-30T14:59:28.428 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.row_cache: None 2024-03-30T14:59:28.428 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.wal_filter: None 2024-03-30T14:59:28.428 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-30T14:59:28.428 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.allow_ingest_behind: 0 2024-03-30T14:59:28.428 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.two_write_queues: 0 2024-03-30T14:59:28.428 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.manual_wal_flush: 0 2024-03-30T14:59:28.428 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.wal_compression: 0 2024-03-30T14:59:28.428 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.atomic_flush: 0 2024-03-30T14:59:28.428 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-30T14:59:28.428 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.persist_stats_to_disk: 0 2024-03-30T14:59:28.428 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-03-30T14:59:28.429 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.log_readahead_size: 0 2024-03-30T14:59:28.429 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-30T14:59:28.429 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.best_efforts_recovery: 0 2024-03-30T14:59:28.429 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-30T14:59:28.429 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-30T14:59:28.429 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.allow_data_in_errors: 0 2024-03-30T14:59:28.429 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.db_host_id: __hostname__ 2024-03-30T14:59:28.429 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.enforce_single_del_contracts: true 2024-03-30T14:59:28.429 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.max_background_jobs: 2 2024-03-30T14:59:28.429 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.max_background_compactions: -1 2024-03-30T14:59:28.429 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.max_subcompactions: 1 2024-03-30T14:59:28.429 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-30T14:59:28.429 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-30T14:59:28.429 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.delayed_write_rate : 16777216 2024-03-30T14:59:28.430 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.max_total_wal_size: 0 2024-03-30T14:59:28.430 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-30T14:59:28.430 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.stats_dump_period_sec: 600 2024-03-30T14:59:28.430 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.stats_persist_period_sec: 600 2024-03-30T14:59:28.430 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-30T14:59:28.430 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.max_open_files: -1 2024-03-30T14:59:28.430 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.bytes_per_sync: 0 2024-03-30T14:59:28.430 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-03-30T14:59:28.430 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-03-30T14:59:28.430 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.compaction_readahead_size: 0 2024-03-30T14:59:28.430 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.max_background_flushes: -1 2024-03-30T14:59:28.430 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Compression algorithms supported: 2024-03-30T14:59:28.430 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-30T14:59:28.431 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: kZSTD supported: 0 2024-03-30T14:59:28.431 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: kXpressCompression supported: 0 2024-03-30T14:59:28.431 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: kLZ4HCCompression supported: 1 2024-03-30T14:59:28.431 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: kZlibCompression supported: 1 2024-03-30T14:59:28.431 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: kSnappyCompression supported: 1 2024-03-30T14:59:28.431 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: kLZ4Compression supported: 1 2024-03-30T14:59:28.431 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: kBZip2Compression supported: 0 2024-03-30T14:59:28.431 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-03-30T14:59:28.431 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: DMutex implementation: pthread_mutex_t 2024-03-30T14:59:28.431 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-03-30T14:59:28.431 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-30T14:59:28.433 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-30T14:59:28.433 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.merge_operator: 2024-03-30T14:59:28.433 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.compaction_filter: None 2024-03-30T14:59:28.433 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.compaction_filter_factory: None 2024-03-30T14:59:28.434 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.sst_partitioner_factory: None 2024-03-30T14:59:28.434 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-03-30T14:59:28.434 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.table_factory: BlockBasedTable 2024-03-30T14:59:28.434 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5561b64b7c40) 2024-03-30T14:59:28.434 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: cache_index_and_filter_blocks: 1 2024-03-30T14:59:28.434 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-30T14:59:28.434 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-30T14:59:28.434 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: pin_top_level_index_and_filter: 1 2024-03-30T14:59:28.434 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: index_type: 0 2024-03-30T14:59:28.434 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: data_block_index_type: 0 2024-03-30T14:59:28.434 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: index_shortening: 1 2024-03-30T14:59:28.434 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: data_block_hash_table_util_ratio: 0.750000 2024-03-30T14:59:28.434 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: checksum: 4 2024-03-30T14:59:28.435 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: no_block_cache: 0 2024-03-30T14:59:28.435 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: block_cache: 0x5561b64b9090 2024-03-30T14:59:28.435 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: block_cache_name: BinnedLRUCache 2024-03-30T14:59:28.435 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: block_cache_options: 2024-03-30T14:59:28.435 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: capacity : 536870912 2024-03-30T14:59:28.435 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: num_shard_bits : 4 2024-03-30T14:59:28.435 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: strict_capacity_limit : 0 2024-03-30T14:59:28.435 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: high_pri_pool_ratio: 0.000 2024-03-30T14:59:28.435 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: block_cache_compressed: (nil) 2024-03-30T14:59:28.435 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: persistent_cache: (nil) 2024-03-30T14:59:28.435 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: block_size: 4096 2024-03-30T14:59:28.435 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: block_size_deviation: 10 2024-03-30T14:59:28.435 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: block_restart_interval: 16 2024-03-30T14:59:28.436 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: index_block_restart_interval: 1 2024-03-30T14:59:28.436 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: metadata_block_size: 4096 2024-03-30T14:59:28.436 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: partition_filters: 0 2024-03-30T14:59:28.436 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: use_delta_encoding: 1 2024-03-30T14:59:28.436 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: filter_policy: bloomfilter 2024-03-30T14:59:28.436 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: whole_key_filtering: 1 2024-03-30T14:59:28.436 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: verify_compression: 0 2024-03-30T14:59:28.436 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: read_amp_bytes_per_bit: 0 2024-03-30T14:59:28.436 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: format_version: 5 2024-03-30T14:59:28.436 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: enable_index_compression: 1 2024-03-30T14:59:28.436 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: block_align: 0 2024-03-30T14:59:28.436 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: max_auto_readahead_size: 262144 2024-03-30T14:59:28.436 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: prepopulate_block_cache: 0 2024-03-30T14:59:28.436 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: initial_auto_readahead_size: 8192 2024-03-30T14:59:28.437 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: num_file_reads_for_auto_readahead: 2 2024-03-30T14:59:28.437 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.write_buffer_size: 33554432 2024-03-30T14:59:28.437 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.max_write_buffer_number: 2 2024-03-30T14:59:28.437 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.compression: NoCompression 2024-03-30T14:59:28.437 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.bottommost_compression: Disabled 2024-03-30T14:59:28.437 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.prefix_extractor: nullptr 2024-03-30T14:59:28.437 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-30T14:59:28.437 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.num_levels: 7 2024-03-30T14:59:28.437 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-30T14:59:28.437 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-30T14:59:28.437 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-30T14:59:28.437 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-30T14:59:28.437 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-30T14:59:28.437 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-30T14:59:28.437 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-30T14:59:28.438 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-30T14:59:28.438 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-30T14:59:28.438 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-30T14:59:28.438 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-30T14:59:28.438 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-30T14:59:28.438 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.compression_opts.window_bits: -14 2024-03-30T14:59:28.438 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.compression_opts.level: 32767 2024-03-30T14:59:28.438 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.compression_opts.strategy: 0 2024-03-30T14:59:28.438 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-30T14:59:28.438 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-30T14:59:28.438 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-30T14:59:28.438 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-30T14:59:28.438 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.compression_opts.enabled: false 2024-03-30T14:59:28.438 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-30T14:59:28.439 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-30T14:59:28.439 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-30T14:59:28.439 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-30T14:59:28.439 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.target_file_size_base: 67108864 2024-03-30T14:59:28.439 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.target_file_size_multiplier: 1 2024-03-30T14:59:28.439 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-30T14:59:28.439 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-30T14:59:28.439 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-30T14:59:28.439 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-30T14:59:28.439 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-30T14:59:28.439 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-30T14:59:28.439 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-30T14:59:28.439 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-30T14:59:28.440 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-30T14:59:28.440 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-30T14:59:28.440 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-30T14:59:28.440 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-30T14:59:28.440 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-30T14:59:28.440 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.arena_block_size: 1048576 2024-03-30T14:59:28.440 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-30T14:59:28.440 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-30T14:59:28.440 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.disable_auto_compactions: 0 2024-03-30T14:59:28.440 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-30T14:59:28.440 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-30T14:59:28.441 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-30T14:59:28.441 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-30T14:59:28.441 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-30T14:59:28.441 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-30T14:59:28.441 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-30T14:59:28.441 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-30T14:59:28.441 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-30T14:59:28.441 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-30T14:59:28.441 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.table_properties_collectors: 2024-03-30T14:59:28.441 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.inplace_update_support: 0 2024-03-30T14:59:28.442 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-03-30T14:59:28.442 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-30T14:59:28.442 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-30T14:59:28.442 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.memtable_huge_page_size: 0 2024-03-30T14:59:28.442 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.bloom_locality: 0 2024-03-30T14:59:28.442 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.max_successive_merges: 0 2024-03-30T14:59:28.442 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-03-30T14:59:28.442 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.paranoid_file_checks: 0 2024-03-30T14:59:28.442 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.force_consistency_checks: 1 2024-03-30T14:59:28.442 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.report_bg_io_stats: 0 2024-03-30T14:59:28.442 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.ttl: 2592000 2024-03-30T14:59:28.442 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-03-30T14:59:28.442 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-30T14:59:28.443 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-30T14:59:28.443 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.enable_blob_files: false 2024-03-30T14:59:28.443 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.min_blob_size: 0 2024-03-30T14:59:28.443 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.blob_file_size: 268435456 2024-03-30T14:59:28.443 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.blob_compression_type: NoCompression 2024-03-30T14:59:28.443 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-03-30T14:59:28.443 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-30T14:59:28.443 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-30T14:59:28.443 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-30T14:59:28.443 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.blob_file_starting_level: 0 2024-03-30T14:59:28.443 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-30T14:59:28.443 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-03-30T14:59:28.443 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-03-30T14:59:28.443 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: a0b3e214-c10f-4d04-bf11-c768d54e7154 2024-03-30T14:59:28.444 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1711810768183845, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-03-30T14:59:28.444 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-03-30T14:59:28.444 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1711810768184303, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1711810768, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a0b3e214-c10f-4d04-bf11-c768d54e7154", "db_session_id": "DGUYJ8SLLHCT2GZY5WAP", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-03-30T14:59:28.444 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1711810768184405, "job": 1, "event": "recovery_finished"} 2024-03-30T14:59:28.444 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.179+0000 7ff05a8ecc80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-03-30T14:59:28.444 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.183+0000 7ff05a8ecc80 4 rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-30T14:59:28.444 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.183+0000 7ff05a8ecc80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5561b65ae000 2024-03-30T14:59:28.444 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.183+0000 7ff05a8ecc80 4 rocksdb: DB pointer 0x5561b6598000 2024-03-30T14:59:28.444 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.183+0000 7ff04904e700 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-30T14:59:28.444 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.183+0000 7ff04904e700 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-30T14:59:28.444 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: ** DB Stats ** 2024-03-30T14:59:28.444 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: Uptime(secs): 0.0 total, 0.0 interval 2024-03-30T14:59:28.444 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-30T14:59:28.444 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-30T14:59:28.444 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-30T14:59:28.445 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-30T14:59:28.445 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-30T14:59:28.445 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-30T14:59:28.445 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: ** Compaction Stats [default] ** 2024-03-30T14:59:28.445 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-30T14:59:28.445 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-30T14:59:28.445 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.6 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-03-30T14:59:28.445 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.6 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-03-30T14:59:28.445 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.6 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-03-30T14:59:28.445 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: ** Compaction Stats [default] ** 2024-03-30T14:59:28.445 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-30T14:59:28.445 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-30T14:59:28.445 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.6 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-03-30T14:59:28.446 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-30T14:59:28.446 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: Uptime(secs): 0.0 total, 0.0 interval 2024-03-30T14:59:28.446 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: Flush(GB): cumulative 0.000, interval 0.000 2024-03-30T14:59:28.446 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-30T14:59:28.446 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: AddFile(Total Files): cumulative 0, interval 0 2024-03-30T14:59:28.446 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: AddFile(L0 Files): cumulative 0, interval 0 2024-03-30T14:59:28.446 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: AddFile(Keys): cumulative 0, interval 0 2024-03-30T14:59:28.446 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: Cumulative compaction: 0.00 GB write, 0.50 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-30T14:59:28.446 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: Interval compaction: 0.00 GB write, 0.50 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-30T14:59:28.446 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-30T14:59:28.446 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: Block cache BinnedLRUCache@0x5561b64b9090#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.4e-05 secs_since: 0 2024-03-30T14:59:28.446 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-03-30T14:59:28.446 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: ** File Read Latency Histogram By Level [default] ** 2024-03-30T14:59:28.447 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.183+0000 7ff05a8ecc80 0 mon.c does not exist in monmap, will attempt to join an existing cluster 2024-03-30T14:59:28.447 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.183+0000 7ff05a8ecc80 0 using public_addrv [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] 2024-03-30T14:59:28.447 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.183+0000 7ff05a8ecc80 0 starting mon.c rank -1 at public addrs [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] at bind addrs [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 2024-03-30T14:59:28.447 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.183+0000 7ff05a8ecc80 1 mon.c@-1(???) e0 preinit fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 2024-03-30T14:59:28.447 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.199+0000 7ff04c054700 0 mon.c@-1(synchronizing).mds e1 new map 2024-03-30T14:59:28.447 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.199+0000 7ff04c054700 0 mon.c@-1(synchronizing).mds e1 print_map 2024-03-30T14:59:28.447 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: e1 2024-03-30T14:59:28.447 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: enable_multiple, ever_enabled_multiple: 1,1 2024-03-30T14:59:28.447 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-03-30T14:59:28.447 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: legacy client fscid: -1 2024-03-30T14:59:28.447 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: 2024-03-30T14:59:28.447 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: No filesystems configured 2024-03-30T14:59:28.448 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.199+0000 7ff04c054700 1 mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-03-30T14:59:28.448 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.199+0000 7ff04c054700 1 mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-03-30T14:59:28.448 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.199+0000 7ff04c054700 1 mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-03-30T14:59:28.448 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.199+0000 7ff04c054700 1 mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-03-30T14:59:28.448 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.199+0000 7ff04c054700 1 mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-03-30T14:59:28.448 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.199+0000 7ff04c054700 1 mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-03-30T14:59:28.448 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.199+0000 7ff04c054700 0 mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-03-30T14:59:28.448 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.199+0000 7ff04c054700 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-30T14:59:28.448 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.199+0000 7ff04c054700 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-30T14:59:28.448 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.199+0000 7ff04c054700 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-30T14:59:28.448 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: cluster 2024-03-30T14:58:45.628371+0000 mgr.y (mgr.14152) 20 : cluster 0 pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:28.448 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: cluster 2024-03-30T14:58:47.628786+0000 mgr.y (mgr.14152) 21 : cluster 0 pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:28.448 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: cluster 2024-03-30T14:58:49.629149+0000 mgr.y (mgr.14152) 22 : cluster 0 pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:28.448 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: audit 2024-03-30T14:58:50.112380+0000 mgr.y (mgr.14152) 23 : audit 0 from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi172", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:59:28.449 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: cephadm 2024-03-30T14:58:50.770895+0000 mgr.y (mgr.14152) 24 : cephadm 1 Deploying cephadm binary to smithi172 2024-03-30T14:59:28.449 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: cluster 2024-03-30T14:58:51.629514+0000 mgr.y (mgr.14152) 25 : cluster 0 pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:28.449 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: cluster 2024-03-30T14:58:53.629762+0000 mgr.y (mgr.14152) 26 : cluster 0 pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:28.449 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: cluster 2024-03-30T14:58:55.630162+0000 mgr.y (mgr.14152) 27 : cluster 0 pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:28.449 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: audit 2024-03-30T14:58:55.928919+0000 mon.a (mon.0) 113 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:28.449 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: cephadm 2024-03-30T14:58:55.929806+0000 mgr.y (mgr.14152) 28 : cephadm 1 Added host smithi172 2024-03-30T14:59:28.449 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: audit 2024-03-30T14:58:55.953615+0000 mon.a (mon.0) 114 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:59:28.449 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: audit 2024-03-30T14:58:56.378514+0000 mon.a (mon.0) 115 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:28.449 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: cluster 2024-03-30T14:58:57.630571+0000 mgr.y (mgr.14152) 29 : cluster 0 pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:28.449 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: audit 2024-03-30T14:58:57.854749+0000 mon.a (mon.0) 116 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:28.449 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: audit 2024-03-30T14:58:59.340200+0000 mon.a (mon.0) 117 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:28.450 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: cluster 2024-03-30T14:58:59.630981+0000 mgr.y (mgr.14152) 30 : cluster 0 pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:28.450 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: cluster 2024-03-30T14:59:01.631403+0000 mgr.y (mgr.14152) 31 : cluster 0 pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:28.450 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: cluster 2024-03-30T14:59:03.631811+0000 mgr.y (mgr.14152) 32 : cluster 0 pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:28.450 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: audit 2024-03-30T14:59:04.193203+0000 mgr.y (mgr.14152) 33 : audit 0 from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T14:59:28.450 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: audit 2024-03-30T14:59:04.678120+0000 mon.a (mon.0) 118 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:28.450 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: audit 2024-03-30T14:59:04.685073+0000 mon.a (mon.0) 119 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:28.450 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: audit 2024-03-30T14:59:04.693601+0000 mon.a (mon.0) 120 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:28.450 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: audit 2024-03-30T14:59:04.699039+0000 mon.a (mon.0) 121 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:28.450 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: audit 2024-03-30T14:59:04.700546+0000 mon.a (mon.0) 122 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi172", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:59:28.450 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: audit 2024-03-30T14:59:04.702489+0000 mon.a (mon.0) 123 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:59:28.450 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: audit 2024-03-30T14:59:04.704215+0000 mon.a (mon.0) 124 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:59:28.450 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: cephadm 2024-03-30T14:59:04.707011+0000 mgr.y (mgr.14152) 34 : cephadm 1 Updating smithi172:/etc/ceph/ceph.conf 2024-03-30T14:59:28.450 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: cephadm 2024-03-30T14:59:04.922526+0000 mgr.y (mgr.14152) 35 : cephadm 1 Updating smithi172:/var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T14:59:28.450 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: cephadm 2024-03-30T14:59:05.086873+0000 mgr.y (mgr.14152) 36 : cephadm 1 Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-03-30T14:59:28.451 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: cephadm 2024-03-30T14:59:05.201278+0000 mgr.y (mgr.14152) 37 : cephadm 1 Updating smithi172:/var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T14:59:28.451 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: audit 2024-03-30T14:59:05.371266+0000 mon.a (mon.0) 125 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:28.451 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: audit 2024-03-30T14:59:05.376921+0000 mon.a (mon.0) 126 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:28.451 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: audit 2024-03-30T14:59:05.382720+0000 mon.a (mon.0) 127 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:28.451 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: cluster 2024-03-30T14:59:05.632199+0000 mgr.y (mgr.14152) 38 : cluster 0 pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:28.451 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: cluster 2024-03-30T14:59:07.632617+0000 mgr.y (mgr.14152) 39 : cluster 0 pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:28.451 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: cluster 2024-03-30T14:59:09.633051+0000 mgr.y (mgr.14152) 40 : cluster 0 pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:28.451 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: cluster 2024-03-30T14:59:11.633420+0000 mgr.y (mgr.14152) 41 : cluster 0 pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:28.451 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: audit 2024-03-30T14:59:12.437076+0000 mon.a (mon.0) 128 : audit 1 from='client.? 172.21.15.72:0/3310260739' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-03-30T14:59:28.451 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: audit 2024-03-30T14:59:13.396191+0000 mon.a (mon.0) 129 : audit 1 from='client.? 172.21.15.72:0/3310260739' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-03-30T14:59:28.452 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: cluster 2024-03-30T14:59:13.401840+0000 mon.a (mon.0) 130 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-03-30T14:59:28.452 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: cluster 2024-03-30T14:59:13.633828+0000 mgr.y (mgr.14152) 42 : cluster 0 pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:28.452 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: cluster 2024-03-30T14:59:15.634259+0000 mgr.y (mgr.14152) 43 : cluster 0 pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:28.452 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: cluster 2024-03-30T14:59:17.634641+0000 mgr.y (mgr.14152) 44 : cluster 0 pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:28.452 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: audit 2024-03-30T14:59:17.648502+0000 mgr.y (mgr.14152) 45 : audit 0 from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi072:172.21.15.72=a;smithi072:[v2:172.21.15.72:3301,v1:172.21.15.72:6790]=c;smithi172:172.21.15.172=b", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:59:28.452 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: cephadm 2024-03-30T14:59:17.654181+0000 mgr.y (mgr.14152) 46 : cephadm 1 Saving service mon spec with placement smithi072:172.21.15.72=a;smithi072:[v2:172.21.15.72:3301,v1:172.21.15.72:6790]=c;smithi172:172.21.15.172=b;count:3 2024-03-30T14:59:28.452 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: audit 2024-03-30T14:59:17.660126+0000 mon.a (mon.0) 131 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:28.452 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: audit 2024-03-30T14:59:17.695785+0000 mon.a (mon.0) 132 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:59:28.452 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: audit 2024-03-30T14:59:17.699759+0000 mon.a (mon.0) 133 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:59:28.452 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: audit 2024-03-30T14:59:17.701864+0000 mon.a (mon.0) 134 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:59:28.452 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: audit 2024-03-30T14:59:17.710527+0000 mon.a (mon.0) 135 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:28.452 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: audit 2024-03-30T14:59:17.714730+0000 mon.a (mon.0) 136 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T14:59:28.452 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: audit 2024-03-30T14:59:17.716534+0000 mon.a (mon.0) 137 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:59:28.452 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: cephadm 2024-03-30T14:59:17.718590+0000 mgr.y (mgr.14152) 47 : cephadm 1 Deploying daemon mon.b on smithi172 2024-03-30T14:59:28.452 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: cluster 2024-03-30T14:59:19.634979+0000 mgr.y (mgr.14152) 48 : cluster 0 pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:28.453 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: cluster 2024-03-30T14:59:21.635364+0000 mgr.y (mgr.14152) 49 : cluster 0 pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:28.453 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: audit 2024-03-30T14:59:23.061337+0000 mon.a (mon.0) 138 : audit 0 from='client.? 172.21.15.172:0/923089544' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-30T14:59:28.453 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: audit 2024-03-30T14:59:23.175198+0000 mon.a (mon.0) 139 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:28.453 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: audit 2024-03-30T14:59:23.181666+0000 mon.a (mon.0) 140 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:28.453 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: audit 2024-03-30T14:59:23.204157+0000 mon.a (mon.0) 141 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:28.453 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: audit 2024-03-30T14:59:23.205659+0000 mon.a (mon.0) 142 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T14:59:28.453 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: audit 2024-03-30T14:59:23.207393+0000 mon.a (mon.0) 143 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:59:28.453 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: cephadm 2024-03-30T14:59:23.209320+0000 mgr.y (mgr.14152) 50 : cephadm 1 Deploying daemon mon.c on smithi072 2024-03-30T14:59:28.453 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:28 smithi072 bash[28946]: debug 2024-03-30T14:59:28.199+0000 7ff04c054700 1 mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-03-30T14:59:28.806 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.b/config 2024-03-30T14:59:29.747 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:29 smithi172 bash[23680]: cluster 2024-03-30T14:59:23.635693+0000 mgr.y (mgr.14152) 51 : cluster 0 pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:29.747 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:29 smithi172 bash[23680]: audit 2024-03-30T14:59:24.370130+0000 mon.a (mon.0) 145 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T14:59:29.747 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:29 smithi172 bash[23680]: audit 2024-03-30T14:59:24.370642+0000 mon.a (mon.0) 146 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T14:59:29.747 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:29 smithi172 bash[23680]: cluster 2024-03-30T14:59:24.370945+0000 mon.a (mon.0) 147 : cluster 1 mon.a calling monitor election 2024-03-30T14:59:29.747 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:29 smithi172 bash[23680]: audit 2024-03-30T14:59:25.364445+0000 mon.a (mon.0) 148 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T14:59:29.747 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:29 smithi172 bash[23680]: cluster 2024-03-30T14:59:25.636055+0000 mgr.y (mgr.14152) 52 : cluster 0 pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:29.747 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:29 smithi172 bash[23680]: audit 2024-03-30T14:59:26.364607+0000 mon.a (mon.0) 149 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T14:59:29.747 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:29 smithi172 bash[23680]: cluster 2024-03-30T14:59:26.366372+0000 mon.b (mon.1) 1 : cluster 1 mon.b calling monitor election 2024-03-30T14:59:29.747 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:29 smithi172 bash[23680]: audit 2024-03-30T14:59:27.364591+0000 mon.a (mon.0) 150 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T14:59:29.747 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:29 smithi172 bash[23680]: cluster 2024-03-30T14:59:27.636447+0000 mgr.y (mgr.14152) 53 : cluster 0 pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:29.747 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:29 smithi172 bash[23680]: audit 2024-03-30T14:59:28.206991+0000 mon.a (mon.0) 151 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T14:59:29.748 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:29 smithi172 bash[23680]: audit 2024-03-30T14:59:28.364836+0000 mon.a (mon.0) 152 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T14:59:29.748 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:29 smithi172 bash[23680]: audit 2024-03-30T14:59:29.207762+0000 mon.a (mon.0) 153 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T14:59:29.748 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:29 smithi172 bash[23680]: audit 2024-03-30T14:59:29.365180+0000 mon.a (mon.0) 154 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T14:59:29.748 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:29 smithi172 bash[23680]: cluster 2024-03-30T14:59:29.411506+0000 mon.a (mon.0) 155 : cluster 1 mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-03-30T14:59:29.748 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:29 smithi172 bash[23680]: cluster 2024-03-30T14:59:29.418486+0000 mon.a (mon.0) 156 : cluster 0 monmap epoch 2 2024-03-30T14:59:29.748 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:29 smithi172 bash[23680]: cluster 2024-03-30T14:59:29.418524+0000 mon.a (mon.0) 157 : cluster 0 fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 2024-03-30T14:59:29.748 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:29 smithi172 bash[23680]: cluster 2024-03-30T14:59:29.418549+0000 mon.a (mon.0) 158 : cluster 0 last_changed 2024-03-30T14:59:24.364291+0000 2024-03-30T14:59:29.748 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:29 smithi172 bash[23680]: cluster 2024-03-30T14:59:29.418570+0000 mon.a (mon.0) 159 : cluster 0 created 2024-03-30T14:57:00.883324+0000 2024-03-30T14:59:29.748 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:29 smithi172 bash[23680]: cluster 2024-03-30T14:59:29.418594+0000 mon.a (mon.0) 160 : cluster 0 min_mon_release 19 (squid) 2024-03-30T14:59:29.748 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:29 smithi172 bash[23680]: cluster 2024-03-30T14:59:29.418615+0000 mon.a (mon.0) 161 : cluster 0 election_strategy: 1 2024-03-30T14:59:29.748 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:29 smithi172 bash[23680]: cluster 2024-03-30T14:59:29.418636+0000 mon.a (mon.0) 162 : cluster 0 0: [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] mon.a 2024-03-30T14:59:29.748 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:29 smithi172 bash[23680]: cluster 2024-03-30T14:59:29.418658+0000 mon.a (mon.0) 163 : cluster 0 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-30T14:59:29.748 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:29 smithi172 bash[23680]: cluster 2024-03-30T14:59:29.437881+0000 mon.a (mon.0) 164 : cluster 0 fsmap 2024-03-30T14:59:29.748 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:29 smithi172 bash[23680]: cluster 2024-03-30T14:59:29.437935+0000 mon.a (mon.0) 165 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-03-30T14:59:29.748 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:29 smithi172 bash[23680]: cluster 2024-03-30T14:59:29.438232+0000 mon.a (mon.0) 166 : cluster 0 mgrmap e13: y(active, since 75s) 2024-03-30T14:59:29.749 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:29 smithi172 bash[23680]: cluster 2024-03-30T14:59:29.438487+0000 mon.a (mon.0) 167 : cluster 1 overall HEALTH_OK 2024-03-30T14:59:29.749 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:29 smithi172 bash[23680]: audit 2024-03-30T14:59:29.445258+0000 mon.a (mon.0) 168 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:29.749 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:29 smithi172 bash[23680]: audit 2024-03-30T14:59:29.452869+0000 mon.a (mon.0) 169 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:29.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:29 smithi072 bash[21573]: cluster 2024-03-30T14:59:23.635693+0000 mgr.y (mgr.14152) 51 : cluster 0 pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:29.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:29 smithi072 bash[21573]: audit 2024-03-30T14:59:24.370130+0000 mon.a (mon.0) 145 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T14:59:29.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:29 smithi072 bash[21573]: audit 2024-03-30T14:59:24.370642+0000 mon.a (mon.0) 146 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T14:59:29.923 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:29 smithi072 bash[21573]: cluster 2024-03-30T14:59:24.370945+0000 mon.a (mon.0) 147 : cluster 1 mon.a calling monitor election 2024-03-30T14:59:29.923 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:29 smithi072 bash[21573]: audit 2024-03-30T14:59:25.364445+0000 mon.a (mon.0) 148 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T14:59:29.923 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:29 smithi072 bash[21573]: cluster 2024-03-30T14:59:25.636055+0000 mgr.y (mgr.14152) 52 : cluster 0 pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:29.923 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:29 smithi072 bash[21573]: audit 2024-03-30T14:59:26.364607+0000 mon.a (mon.0) 149 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T14:59:29.923 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:29 smithi072 bash[21573]: cluster 2024-03-30T14:59:26.366372+0000 mon.b (mon.1) 1 : cluster 1 mon.b calling monitor election 2024-03-30T14:59:29.923 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:29 smithi072 bash[21573]: audit 2024-03-30T14:59:27.364591+0000 mon.a (mon.0) 150 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T14:59:29.923 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:29 smithi072 bash[21573]: cluster 2024-03-30T14:59:27.636447+0000 mgr.y (mgr.14152) 53 : cluster 0 pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:29.923 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:29 smithi072 bash[21573]: audit 2024-03-30T14:59:28.206991+0000 mon.a (mon.0) 151 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T14:59:29.923 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:29 smithi072 bash[21573]: audit 2024-03-30T14:59:28.364836+0000 mon.a (mon.0) 152 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T14:59:29.923 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:29 smithi072 bash[21573]: audit 2024-03-30T14:59:29.207762+0000 mon.a (mon.0) 153 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T14:59:29.923 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:29 smithi072 bash[21573]: audit 2024-03-30T14:59:29.365180+0000 mon.a (mon.0) 154 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T14:59:29.923 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:29 smithi072 bash[21573]: cluster 2024-03-30T14:59:29.411506+0000 mon.a (mon.0) 155 : cluster 1 mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-03-30T14:59:29.923 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:29 smithi072 bash[21573]: cluster 2024-03-30T14:59:29.418486+0000 mon.a (mon.0) 156 : cluster 0 monmap epoch 2 2024-03-30T14:59:29.923 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:29 smithi072 bash[21573]: cluster 2024-03-30T14:59:29.418524+0000 mon.a (mon.0) 157 : cluster 0 fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 2024-03-30T14:59:29.924 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:29 smithi072 bash[21573]: cluster 2024-03-30T14:59:29.418549+0000 mon.a (mon.0) 158 : cluster 0 last_changed 2024-03-30T14:59:24.364291+0000 2024-03-30T14:59:29.924 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:29 smithi072 bash[21573]: cluster 2024-03-30T14:59:29.418570+0000 mon.a (mon.0) 159 : cluster 0 created 2024-03-30T14:57:00.883324+0000 2024-03-30T14:59:29.924 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:29 smithi072 bash[21573]: cluster 2024-03-30T14:59:29.418594+0000 mon.a (mon.0) 160 : cluster 0 min_mon_release 19 (squid) 2024-03-30T14:59:29.924 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:29 smithi072 bash[21573]: cluster 2024-03-30T14:59:29.418615+0000 mon.a (mon.0) 161 : cluster 0 election_strategy: 1 2024-03-30T14:59:29.924 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:29 smithi072 bash[21573]: cluster 2024-03-30T14:59:29.418636+0000 mon.a (mon.0) 162 : cluster 0 0: [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] mon.a 2024-03-30T14:59:29.924 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:29 smithi072 bash[21573]: cluster 2024-03-30T14:59:29.418658+0000 mon.a (mon.0) 163 : cluster 0 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-30T14:59:29.924 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:29 smithi072 bash[21573]: cluster 2024-03-30T14:59:29.437881+0000 mon.a (mon.0) 164 : cluster 0 fsmap 2024-03-30T14:59:29.924 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:29 smithi072 bash[21573]: cluster 2024-03-30T14:59:29.437935+0000 mon.a (mon.0) 165 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-03-30T14:59:29.924 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:29 smithi072 bash[21573]: cluster 2024-03-30T14:59:29.438232+0000 mon.a (mon.0) 166 : cluster 0 mgrmap e13: y(active, since 75s) 2024-03-30T14:59:29.924 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:29 smithi072 bash[21573]: cluster 2024-03-30T14:59:29.438487+0000 mon.a (mon.0) 167 : cluster 1 overall HEALTH_OK 2024-03-30T14:59:29.924 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:29 smithi072 bash[21573]: audit 2024-03-30T14:59:29.445258+0000 mon.a (mon.0) 168 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:29.924 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:29 smithi072 bash[21573]: audit 2024-03-30T14:59:29.452869+0000 mon.a (mon.0) 169 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:30.671 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 14:59:30 smithi072 bash[21828]: debug 2024-03-30T14:59:30.363+0000 7f67e501c700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-03-30T14:59:35.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.532+0000 7f45f4140700 1 -- 172.21.15.172:0/3829771443 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45d40035c0 msgr2=0x7f45d4005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:59:35.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.532+0000 7f45f4140700 1 --2- 172.21.15.172:0/3829771443 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45d40035c0 0x7f45d4005a50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f45ec074510 tx=0x7f45dc009e80 comp rx=0 tx=0).stop 2024-03-30T14:59:35.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.536+0000 7f45f4140700 1 -- 172.21.15.172:0/3829771443 shutdown_connections 2024-03-30T14:59:35.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.536+0000 7f45f4140700 1 --2- 172.21.15.172:0/3829771443 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45d40035c0 0x7f45d4005a50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:59:35.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.536+0000 7f45f4140700 1 -- 172.21.15.172:0/3829771443 >> 172.21.15.172:0/3829771443 conn(0x7f45ec0fd830 msgr2=0x7f45ec0ffc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:59:35.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.536+0000 7f45f4140700 1 -- 172.21.15.172:0/3829771443 shutdown_connections 2024-03-30T14:59:35.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.536+0000 7f45f4140700 1 -- 172.21.15.172:0/3829771443 wait complete. 2024-03-30T14:59:35.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.536+0000 7f45f4140700 1 Processor -- start 2024-03-30T14:59:35.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.536+0000 7f45f4140700 1 -- start start 2024-03-30T14:59:35.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.536+0000 7f45f4140700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f45d40035c0 0x7f45ec199140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:59:35.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.536+0000 7f45f4140700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45ec199680 0x7f45ec19da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:59:35.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.536+0000 7f45f4140700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45ec19df50 0x7f45ec19e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:59:35.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.536+0000 7f45f4140700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f45ec10b450 con 0x7f45ec199680 2024-03-30T14:59:35.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.536+0000 7f45f4140700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f45ec10b2d0 con 0x7f45ec19df50 2024-03-30T14:59:35.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.536+0000 7f45f4140700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f45ec10b5d0 con 0x7f45d40035c0 2024-03-30T14:59:35.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.536+0000 7f45f26dd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45ec19df50 0x7f45ec19e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:59:35.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.536+0000 7f45f26dd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45ec19df50 0x7f45ec19e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33066/0 (socket says 172.21.15.172:33066) 2024-03-30T14:59:35.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.536+0000 7f45f26dd700 1 -- 172.21.15.172:0/1884967186 learned_addr learned my addr 172.21.15.172:0/1884967186 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-03-30T14:59:35.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.536+0000 7f45f16db700 1 --2- 172.21.15.172:0/1884967186 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45ec199680 0x7f45ec19da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:59:35.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.536+0000 7f45f1edc700 1 --2- 172.21.15.172:0/1884967186 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f45d40035c0 0x7f45ec199140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:59:35.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.536+0000 7f45f26dd700 1 -- 172.21.15.172:0/1884967186 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45ec19df50 msgr2=0x7f45ec19e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-03-30T14:59:35.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.536+0000 7f45f26dd700 1 -- 172.21.15.172:0/1884967186 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45ec19df50 msgr2=0x7f45ec19e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-30T14:59:35.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.536+0000 7f45f26dd700 1 --2- 172.21.15.172:0/1884967186 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45ec19df50 0x7f45ec19e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-30T14:59:35.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.536+0000 7f45f26dd700 1 --2- 172.21.15.172:0/1884967186 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45ec19df50 0x7f45ec19e400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-30T14:59:35.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.536+0000 7f45f1edc700 1 -- 172.21.15.172:0/1884967186 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f45d40035c0 msgr2=0x7f45ec199140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-03-30T14:59:35.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.536+0000 7f45f1edc700 1 -- 172.21.15.172:0/1884967186 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f45d40035c0 msgr2=0x7f45ec199140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-30T14:59:35.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.536+0000 7f45f1edc700 1 --2- 172.21.15.172:0/1884967186 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f45d40035c0 0x7f45ec199140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-30T14:59:35.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.536+0000 7f45f1edc700 1 --2- 172.21.15.172:0/1884967186 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f45d40035c0 0x7f45ec199140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-30T14:59:35.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.536+0000 7f45f16db700 1 -- 172.21.15.172:0/1884967186 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f45d40035c0 msgr2=0x7f45ec199140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-30T14:59:35.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.536+0000 7f45f16db700 1 --2- 172.21.15.172:0/1884967186 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f45d40035c0 0x7f45ec199140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:59:35.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.536+0000 7f45f16db700 1 -- 172.21.15.172:0/1884967186 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45ec19df50 msgr2=0x7f45ec19e400 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-30T14:59:35.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.536+0000 7f45f16db700 1 --2- 172.21.15.172:0/1884967186 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45ec19df50 0x7f45ec19e400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:59:35.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.536+0000 7f45f16db700 1 -- 172.21.15.172:0/1884967186 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45ec1a5cc0 con 0x7f45ec199680 2024-03-30T14:59:35.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.536+0000 7f45f16db700 1 --2- 172.21.15.172:0/1884967186 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45ec199680 0x7f45ec19da10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f45e000b550 tx=0x7f45e000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:59:35.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.536+0000 7f45eaffd700 1 -- 172.21.15.172:0/1884967186 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e0004230 con 0x7f45ec199680 2024-03-30T14:59:35.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.536+0000 7f45eaffd700 1 -- 172.21.15.172:0/1884967186 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f45e00043d0 con 0x7f45ec199680 2024-03-30T14:59:35.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.536+0000 7f45eaffd700 1 -- 172.21.15.172:0/1884967186 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e0011a40 con 0x7f45ec199680 2024-03-30T14:59:35.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.536+0000 7f45f4140700 1 -- 172.21.15.172:0/1884967186 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45ec1a5ef0 con 0x7f45ec199680 2024-03-30T14:59:35.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.540+0000 7f45f4140700 1 -- 172.21.15.172:0/1884967186 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45ec1a6380 con 0x7f45ec199680 2024-03-30T14:59:35.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.540+0000 7f45f4140700 1 -- 172.21.15.172:0/1884967186 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45ec063870 con 0x7f45ec199680 2024-03-30T14:59:35.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.540+0000 7f45eaffd700 1 -- 172.21.15.172:0/1884967186 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) ==== 46172+0+0 (secure 0 0 0) 0x7f45e00036a0 con 0x7f45ec199680 2024-03-30T14:59:35.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.540+0000 7f45eaffd700 1 --2- 172.21.15.172:0/1884967186 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f45d8039330 0x7f45d803b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:59:35.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.540+0000 7f45eaffd700 1 -- 172.21.15.172:0/1884967186 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f45e004bb40 con 0x7f45ec199680 2024-03-30T14:59:35.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.540+0000 7f45f1edc700 1 --2- 172.21.15.172:0/1884967186 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f45d8039330 0x7f45d803b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:59:35.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.540+0000 7f45f1edc700 1 --2- 172.21.15.172:0/1884967186 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f45d8039330 0x7f45d803b7f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f45dc009a30 tx=0x7f45dc00b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:59:35.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.556+0000 7f45eaffd700 1 -- 172.21.15.172:0/1884967186 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f45e0010380 con 0x7f45ec199680 2024-03-30T14:59:35.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:35 smithi072 bash[21573]: cluster 2024-03-30T14:59:29.636797+0000 mgr.y (mgr.14152) 54 : cluster 0 pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:35.673 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:35 smithi072 bash[21573]: audit 2024-03-30T14:59:30.215617+0000 mon.a (mon.0) 174 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T14:59:35.673 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:35 smithi072 bash[21573]: cluster 2024-03-30T14:59:30.215865+0000 mon.b (mon.1) 2 : cluster 1 mon.b calling monitor election 2024-03-30T14:59:35.673 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:35 smithi072 bash[21573]: cluster 2024-03-30T14:59:30.216237+0000 mon.a (mon.0) 175 : cluster 1 mon.a calling monitor election 2024-03-30T14:59:35.673 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:35 smithi072 bash[21573]: audit 2024-03-30T14:59:30.218136+0000 mon.a (mon.0) 176 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T14:59:35.673 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:35 smithi072 bash[21573]: audit 2024-03-30T14:59:30.218519+0000 mon.a (mon.0) 177 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T14:59:35.673 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:35 smithi072 bash[21573]: audit 2024-03-30T14:59:31.208436+0000 mon.a (mon.0) 178 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T14:59:35.673 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:35 smithi072 bash[21573]: cluster 2024-03-30T14:59:31.637185+0000 mgr.y (mgr.14152) 55 : cluster 0 pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:35.673 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:35 smithi072 bash[21573]: audit 2024-03-30T14:59:32.208463+0000 mon.a (mon.0) 179 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T14:59:35.673 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:35 smithi072 bash[21573]: audit 2024-03-30T14:59:33.208831+0000 mon.a (mon.0) 180 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T14:59:35.673 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:35 smithi072 bash[21573]: cluster 2024-03-30T14:59:33.637567+0000 mgr.y (mgr.14152) 56 : cluster 0 pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:35.673 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:35 smithi072 bash[21573]: audit 2024-03-30T14:59:34.208841+0000 mon.a (mon.0) 181 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T14:59:35.673 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:35 smithi072 bash[21573]: audit 2024-03-30T14:59:35.208922+0000 mon.a (mon.0) 182 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T14:59:35.673 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:35 smithi072 bash[21573]: cluster 2024-03-30T14:59:35.218211+0000 mon.a (mon.0) 183 : cluster 1 mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-03-30T14:59:35.674 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:35 smithi072 bash[21573]: cluster 2024-03-30T14:59:35.224269+0000 mon.a (mon.0) 184 : cluster 0 monmap epoch 3 2024-03-30T14:59:35.674 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:35 smithi072 bash[21573]: cluster 2024-03-30T14:59:35.224347+0000 mon.a (mon.0) 185 : cluster 0 fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 2024-03-30T14:59:35.674 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:35 smithi072 bash[21573]: cluster 2024-03-30T14:59:35.224394+0000 mon.a (mon.0) 186 : cluster 0 last_changed 2024-03-30T14:59:30.208710+0000 2024-03-30T14:59:35.674 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:35 smithi072 bash[21573]: cluster 2024-03-30T14:59:35.224435+0000 mon.a (mon.0) 187 : cluster 0 created 2024-03-30T14:57:00.883324+0000 2024-03-30T14:59:35.674 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:35 smithi072 bash[21573]: cluster 2024-03-30T14:59:35.224477+0000 mon.a (mon.0) 188 : cluster 0 min_mon_release 19 (squid) 2024-03-30T14:59:35.674 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:35 smithi072 bash[21573]: cluster 2024-03-30T14:59:35.224520+0000 mon.a (mon.0) 189 : cluster 0 election_strategy: 1 2024-03-30T14:59:35.674 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:35 smithi072 bash[21573]: cluster 2024-03-30T14:59:35.224560+0000 mon.a (mon.0) 190 : cluster 0 0: [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] mon.a 2024-03-30T14:59:35.674 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:35 smithi072 bash[21573]: cluster 2024-03-30T14:59:35.224603+0000 mon.a (mon.0) 191 : cluster 0 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-30T14:59:35.674 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:35 smithi072 bash[21573]: cluster 2024-03-30T14:59:35.224644+0000 mon.a (mon.0) 192 : cluster 0 2: [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] mon.c 2024-03-30T14:59:35.674 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:35 smithi072 bash[21573]: cluster 2024-03-30T14:59:35.241912+0000 mon.a (mon.0) 193 : cluster 0 fsmap 2024-03-30T14:59:35.674 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:35 smithi072 bash[21573]: cluster 2024-03-30T14:59:35.241997+0000 mon.a (mon.0) 194 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-03-30T14:59:35.674 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:35 smithi072 bash[21573]: cluster 2024-03-30T14:59:35.242327+0000 mon.a (mon.0) 195 : cluster 0 mgrmap e13: y(active, since 81s) 2024-03-30T14:59:35.674 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:35 smithi072 bash[21573]: cluster 2024-03-30T14:59:35.242735+0000 mon.a (mon.0) 196 : cluster 3 Health check failed: 1/3 mons down, quorum a,b (MON_DOWN) 2024-03-30T14:59:35.674 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:35 smithi072 bash[21573]: cluster 2024-03-30T14:59:35.251311+0000 mon.a (mon.0) 197 : cluster 3 Health detail: HEALTH_WARN 1/3 mons down, quorum a,b 2024-03-30T14:59:35.674 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:35 smithi072 bash[21573]: cluster 2024-03-30T14:59:35.251374+0000 mon.a (mon.0) 198 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b 2024-03-30T14:59:35.675 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:35 smithi072 bash[21573]: cluster 2024-03-30T14:59:35.251426+0000 mon.a (mon.0) 199 : cluster 3 mon.c (rank 2) addr [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] is down (out of quorum) 2024-03-30T14:59:35.675 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:35 smithi072 bash[21573]: audit 2024-03-30T14:59:35.257671+0000 mon.a (mon.0) 200 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:35.675 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:35 smithi072 bash[21573]: audit 2024-03-30T14:59:35.263150+0000 mon.a (mon.0) 201 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:35.675 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:35 smithi072 bash[21573]: audit 2024-03-30T14:59:35.270127+0000 mon.a (mon.0) 202 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:35.675 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:35 smithi072 bash[21573]: audit 2024-03-30T14:59:35.276037+0000 mon.a (mon.0) 203 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:35.675 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:35 smithi072 bash[21573]: audit 2024-03-30T14:59:35.283593+0000 mon.a (mon.0) 204 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:35.722 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:35 smithi172 bash[23680]: cluster 2024-03-30T14:59:29.636797+0000 mgr.y (mgr.14152) 54 : cluster 0 pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:35.722 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:35 smithi172 bash[23680]: audit 2024-03-30T14:59:30.215617+0000 mon.a (mon.0) 174 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T14:59:35.722 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:35 smithi172 bash[23680]: cluster 2024-03-30T14:59:30.215865+0000 mon.b (mon.1) 2 : cluster 1 mon.b calling monitor election 2024-03-30T14:59:35.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:35 smithi172 bash[23680]: cluster 2024-03-30T14:59:30.216237+0000 mon.a (mon.0) 175 : cluster 1 mon.a calling monitor election 2024-03-30T14:59:35.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:35 smithi172 bash[23680]: audit 2024-03-30T14:59:30.218136+0000 mon.a (mon.0) 176 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T14:59:35.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:35 smithi172 bash[23680]: audit 2024-03-30T14:59:30.218519+0000 mon.a (mon.0) 177 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T14:59:35.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:35 smithi172 bash[23680]: audit 2024-03-30T14:59:31.208436+0000 mon.a (mon.0) 178 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T14:59:35.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:35 smithi172 bash[23680]: cluster 2024-03-30T14:59:31.637185+0000 mgr.y (mgr.14152) 55 : cluster 0 pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:35.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:35 smithi172 bash[23680]: audit 2024-03-30T14:59:32.208463+0000 mon.a (mon.0) 179 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T14:59:35.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:35 smithi172 bash[23680]: audit 2024-03-30T14:59:33.208831+0000 mon.a (mon.0) 180 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T14:59:35.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:35 smithi172 bash[23680]: cluster 2024-03-30T14:59:33.637567+0000 mgr.y (mgr.14152) 56 : cluster 0 pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:35.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:35 smithi172 bash[23680]: audit 2024-03-30T14:59:34.208841+0000 mon.a (mon.0) 181 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T14:59:35.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:35 smithi172 bash[23680]: audit 2024-03-30T14:59:35.208922+0000 mon.a (mon.0) 182 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T14:59:35.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:35 smithi172 bash[23680]: cluster 2024-03-30T14:59:35.218211+0000 mon.a (mon.0) 183 : cluster 1 mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-03-30T14:59:35.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:35 smithi172 bash[23680]: cluster 2024-03-30T14:59:35.224269+0000 mon.a (mon.0) 184 : cluster 0 monmap epoch 3 2024-03-30T14:59:35.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:35 smithi172 bash[23680]: cluster 2024-03-30T14:59:35.224347+0000 mon.a (mon.0) 185 : cluster 0 fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 2024-03-30T14:59:35.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:35 smithi172 bash[23680]: cluster 2024-03-30T14:59:35.224394+0000 mon.a (mon.0) 186 : cluster 0 last_changed 2024-03-30T14:59:30.208710+0000 2024-03-30T14:59:35.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:35 smithi172 bash[23680]: cluster 2024-03-30T14:59:35.224435+0000 mon.a (mon.0) 187 : cluster 0 created 2024-03-30T14:57:00.883324+0000 2024-03-30T14:59:35.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:35 smithi172 bash[23680]: cluster 2024-03-30T14:59:35.224477+0000 mon.a (mon.0) 188 : cluster 0 min_mon_release 19 (squid) 2024-03-30T14:59:35.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:35 smithi172 bash[23680]: cluster 2024-03-30T14:59:35.224520+0000 mon.a (mon.0) 189 : cluster 0 election_strategy: 1 2024-03-30T14:59:35.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:35 smithi172 bash[23680]: cluster 2024-03-30T14:59:35.224560+0000 mon.a (mon.0) 190 : cluster 0 0: [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] mon.a 2024-03-30T14:59:35.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:35 smithi172 bash[23680]: cluster 2024-03-30T14:59:35.224603+0000 mon.a (mon.0) 191 : cluster 0 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-30T14:59:35.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:35 smithi172 bash[23680]: cluster 2024-03-30T14:59:35.224644+0000 mon.a (mon.0) 192 : cluster 0 2: [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] mon.c 2024-03-30T14:59:35.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:35 smithi172 bash[23680]: cluster 2024-03-30T14:59:35.241912+0000 mon.a (mon.0) 193 : cluster 0 fsmap 2024-03-30T14:59:35.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:35 smithi172 bash[23680]: cluster 2024-03-30T14:59:35.241997+0000 mon.a (mon.0) 194 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-03-30T14:59:35.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:35 smithi172 bash[23680]: cluster 2024-03-30T14:59:35.242327+0000 mon.a (mon.0) 195 : cluster 0 mgrmap e13: y(active, since 81s) 2024-03-30T14:59:35.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:35 smithi172 bash[23680]: cluster 2024-03-30T14:59:35.242735+0000 mon.a (mon.0) 196 : cluster 3 Health check failed: 1/3 mons down, quorum a,b (MON_DOWN) 2024-03-30T14:59:35.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:35 smithi172 bash[23680]: cluster 2024-03-30T14:59:35.251311+0000 mon.a (mon.0) 197 : cluster 3 Health detail: HEALTH_WARN 1/3 mons down, quorum a,b 2024-03-30T14:59:35.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:35 smithi172 bash[23680]: cluster 2024-03-30T14:59:35.251374+0000 mon.a (mon.0) 198 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b 2024-03-30T14:59:35.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:35 smithi172 bash[23680]: cluster 2024-03-30T14:59:35.251426+0000 mon.a (mon.0) 199 : cluster 3 mon.c (rank 2) addr [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] is down (out of quorum) 2024-03-30T14:59:35.724 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:35 smithi172 bash[23680]: audit 2024-03-30T14:59:35.257671+0000 mon.a (mon.0) 200 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:35.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:35 smithi172 bash[23680]: audit 2024-03-30T14:59:35.263150+0000 mon.a (mon.0) 201 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:35.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:35 smithi172 bash[23680]: audit 2024-03-30T14:59:35.270127+0000 mon.a (mon.0) 202 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:35.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:35 smithi172 bash[23680]: audit 2024-03-30T14:59:35.276037+0000 mon.a (mon.0) 203 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:35.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:35 smithi172 bash[23680]: audit 2024-03-30T14:59:35.283593+0000 mon.a (mon.0) 204 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:35.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.852+0000 7f45f4140700 1 -- 172.21.15.172:0/1884967186 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f45ec1a66a0 con 0x7f45ec199680 2024-03-30T14:59:35.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.852+0000 7f45eaffd700 1 -- 172.21.15.172:0/1884967186 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1279 (secure 0 0 0) 0x7f45e001f200 con 0x7f45ec199680 2024-03-30T14:59:35.856 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-30T14:59:35.857 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":3,"fsid":"97f8e564-eea5-11ee-b647-cb9ed24678a4","modified":"2024-03-30T14:59:30.208710Z","created":"2024-03-30T14:57:00.883324Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3300","nonce":0},{"type":"v1","addr":"172.21.15.72:6789","nonce":0}]},"addr":"172.21.15.72:6789/0","public_addr":"172.21.15.72:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:3300","nonce":0},{"type":"v1","addr":"172.21.15.172:6789","nonce":0}]},"addr":"172.21.15.172:6789/0","public_addr":"172.21.15.172:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3301","nonce":0},{"type":"v1","addr":"172.21.15.72:6790","nonce":0}]},"addr":"172.21.15.72:6790/0","public_addr":"172.21.15.72:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-03-30T14:59:35.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.856+0000 7f45f4140700 1 -- 172.21.15.172:0/1884967186 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f45d8039330 msgr2=0x7f45d803b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:59:35.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.856+0000 7f45f4140700 1 --2- 172.21.15.172:0/1884967186 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f45d8039330 0x7f45d803b7f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f45dc009a30 tx=0x7f45dc00b040 comp rx=0 tx=0).stop 2024-03-30T14:59:35.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.856+0000 7f45f4140700 1 -- 172.21.15.172:0/1884967186 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45ec199680 msgr2=0x7f45ec19da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:59:35.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.856+0000 7f45f4140700 1 --2- 172.21.15.172:0/1884967186 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45ec199680 0x7f45ec19da10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f45e000b550 tx=0x7f45e000b910 comp rx=0 tx=0).stop 2024-03-30T14:59:35.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.856+0000 7f45f4140700 1 -- 172.21.15.172:0/1884967186 shutdown_connections 2024-03-30T14:59:35.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.856+0000 7f45f4140700 1 --2- 172.21.15.172:0/1884967186 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f45d8039330 0x7f45d803b7f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:59:35.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.856+0000 7f45f4140700 1 --2- 172.21.15.172:0/1884967186 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45ec19df50 0x7f45ec19e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:59:35.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.856+0000 7f45f4140700 1 --2- 172.21.15.172:0/1884967186 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f45d40035c0 0x7f45ec199140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:59:35.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.856+0000 7f45f4140700 1 --2- 172.21.15.172:0/1884967186 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45ec199680 0x7f45ec19da10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:59:35.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.856+0000 7f45f4140700 1 -- 172.21.15.172:0/1884967186 >> 172.21.15.172:0/1884967186 conn(0x7f45ec0fd830 msgr2=0x7f45ec1089c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:59:35.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.856+0000 7f45f4140700 1 -- 172.21.15.172:0/1884967186 shutdown_connections 2024-03-30T14:59:35.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:35.856+0000 7f45f4140700 1 -- 172.21.15.172:0/1884967186 wait complete. 2024-03-30T14:59:35.860 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 3 2024-03-30T14:59:36.561 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-03-30T14:59:36.561 DEBUG:teuthology.orchestra.run.smithi072:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph config generate-minimal-conf 2024-03-30T14:59:36.571 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:36 smithi072 bash[21573]: audit 2024-03-30T14:59:35.856407+0000 mon.a (mon.0) 205 : audit 0 from='client.? 172.21.15.172:0/1884967186' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-30T14:59:36.571 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:36 smithi072 bash[21573]: audit 2024-03-30T14:59:35.959876+0000 mon.a (mon.0) 206 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:59:36.571 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:36 smithi072 bash[21573]: audit 2024-03-30T14:59:35.962039+0000 mon.a (mon.0) 207 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:59:36.571 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:36 smithi072 bash[21573]: audit 2024-03-30T14:59:36.208482+0000 mon.a (mon.0) 208 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T14:59:36.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:36 smithi172 bash[23680]: audit 2024-03-30T14:59:35.856407+0000 mon.a (mon.0) 205 : audit 0 from='client.? 172.21.15.172:0/1884967186' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-30T14:59:36.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:36 smithi172 bash[23680]: audit 2024-03-30T14:59:35.959876+0000 mon.a (mon.0) 206 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:59:36.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:36 smithi172 bash[23680]: audit 2024-03-30T14:59:35.962039+0000 mon.a (mon.0) 207 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:59:36.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:36 smithi172 bash[23680]: audit 2024-03-30T14:59:36.208482+0000 mon.a (mon.0) 208 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T14:59:37.510 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:23.635693+0000 mgr.y (mgr.14152) 51 : cluster 0 pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:37.511 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: audit 2024-03-30T14:59:24.370130+0000 mon.a (mon.0) 145 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T14:59:37.511 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: audit 2024-03-30T14:59:24.370642+0000 mon.a (mon.0) 146 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T14:59:37.511 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:24.370945+0000 mon.a (mon.0) 147 : cluster 1 mon.a calling monitor election 2024-03-30T14:59:37.511 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: audit 2024-03-30T14:59:25.364445+0000 mon.a (mon.0) 148 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T14:59:37.511 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:25.636055+0000 mgr.y (mgr.14152) 52 : cluster 0 pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:37.511 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: audit 2024-03-30T14:59:26.364607+0000 mon.a (mon.0) 149 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T14:59:37.511 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:26.366372+0000 mon.b (mon.1) 1 : cluster 1 mon.b calling monitor election 2024-03-30T14:59:37.511 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: audit 2024-03-30T14:59:27.364591+0000 mon.a (mon.0) 150 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T14:59:37.511 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:27.636447+0000 mgr.y (mgr.14152) 53 : cluster 0 pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:37.511 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: audit 2024-03-30T14:59:28.206991+0000 mon.a (mon.0) 151 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T14:59:37.511 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: audit 2024-03-30T14:59:28.364836+0000 mon.a (mon.0) 152 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T14:59:37.511 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: audit 2024-03-30T14:59:29.207762+0000 mon.a (mon.0) 153 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T14:59:37.512 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: audit 2024-03-30T14:59:29.365180+0000 mon.a (mon.0) 154 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T14:59:37.512 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:29.411506+0000 mon.a (mon.0) 155 : cluster 1 mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-03-30T14:59:37.512 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:29.418486+0000 mon.a (mon.0) 156 : cluster 0 monmap epoch 2 2024-03-30T14:59:37.512 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:29.418524+0000 mon.a (mon.0) 157 : cluster 0 fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 2024-03-30T14:59:37.512 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:29.418549+0000 mon.a (mon.0) 158 : cluster 0 last_changed 2024-03-30T14:59:24.364291+0000 2024-03-30T14:59:37.512 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:29.418570+0000 mon.a (mon.0) 159 : cluster 0 created 2024-03-30T14:57:00.883324+0000 2024-03-30T14:59:37.512 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:29.418594+0000 mon.a (mon.0) 160 : cluster 0 min_mon_release 19 (squid) 2024-03-30T14:59:37.512 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:29.418615+0000 mon.a (mon.0) 161 : cluster 0 election_strategy: 1 2024-03-30T14:59:37.512 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:29.418636+0000 mon.a (mon.0) 162 : cluster 0 0: [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] mon.a 2024-03-30T14:59:37.512 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:29.418658+0000 mon.a (mon.0) 163 : cluster 0 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-30T14:59:37.513 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:29.437881+0000 mon.a (mon.0) 164 : cluster 0 fsmap 2024-03-30T14:59:37.513 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:29.437935+0000 mon.a (mon.0) 165 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-03-30T14:59:37.513 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:29.438232+0000 mon.a (mon.0) 166 : cluster 0 mgrmap e13: y(active, since 75s) 2024-03-30T14:59:37.513 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:29.438487+0000 mon.a (mon.0) 167 : cluster 1 overall HEALTH_OK 2024-03-30T14:59:37.513 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: audit 2024-03-30T14:59:29.445258+0000 mon.a (mon.0) 168 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:37.513 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: audit 2024-03-30T14:59:29.452869+0000 mon.a (mon.0) 169 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:37.513 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:29.636797+0000 mgr.y (mgr.14152) 54 : cluster 0 pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:37.513 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: audit 2024-03-30T14:59:30.215617+0000 mon.a (mon.0) 174 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T14:59:37.513 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:30.215865+0000 mon.b (mon.1) 2 : cluster 1 mon.b calling monitor election 2024-03-30T14:59:37.514 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:30.216237+0000 mon.a (mon.0) 175 : cluster 1 mon.a calling monitor election 2024-03-30T14:59:37.514 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: audit 2024-03-30T14:59:30.218136+0000 mon.a (mon.0) 176 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T14:59:37.514 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: audit 2024-03-30T14:59:30.218519+0000 mon.a (mon.0) 177 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T14:59:37.514 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: audit 2024-03-30T14:59:31.208436+0000 mon.a (mon.0) 178 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T14:59:37.514 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:31.637185+0000 mgr.y (mgr.14152) 55 : cluster 0 pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:37.514 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: audit 2024-03-30T14:59:32.208463+0000 mon.a (mon.0) 179 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T14:59:37.514 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: audit 2024-03-30T14:59:33.208831+0000 mon.a (mon.0) 180 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T14:59:37.514 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:33.637567+0000 mgr.y (mgr.14152) 56 : cluster 0 pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:37.514 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: audit 2024-03-30T14:59:34.208841+0000 mon.a (mon.0) 181 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T14:59:37.514 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: audit 2024-03-30T14:59:35.208922+0000 mon.a (mon.0) 182 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T14:59:37.514 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:35.218211+0000 mon.a (mon.0) 183 : cluster 1 mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-03-30T14:59:37.514 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:35.224269+0000 mon.a (mon.0) 184 : cluster 0 monmap epoch 3 2024-03-30T14:59:37.515 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:35.224347+0000 mon.a (mon.0) 185 : cluster 0 fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 2024-03-30T14:59:37.515 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:35.224394+0000 mon.a (mon.0) 186 : cluster 0 last_changed 2024-03-30T14:59:30.208710+0000 2024-03-30T14:59:37.515 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:35.224435+0000 mon.a (mon.0) 187 : cluster 0 created 2024-03-30T14:57:00.883324+0000 2024-03-30T14:59:37.515 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:35.224477+0000 mon.a (mon.0) 188 : cluster 0 min_mon_release 19 (squid) 2024-03-30T14:59:37.515 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:35.224520+0000 mon.a (mon.0) 189 : cluster 0 election_strategy: 1 2024-03-30T14:59:37.515 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:35.224560+0000 mon.a (mon.0) 190 : cluster 0 0: [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] mon.a 2024-03-30T14:59:37.515 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:35.224603+0000 mon.a (mon.0) 191 : cluster 0 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-30T14:59:37.515 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:35.224644+0000 mon.a (mon.0) 192 : cluster 0 2: [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] mon.c 2024-03-30T14:59:37.515 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:35.241912+0000 mon.a (mon.0) 193 : cluster 0 fsmap 2024-03-30T14:59:37.515 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:35.241997+0000 mon.a (mon.0) 194 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-03-30T14:59:37.515 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:35.242327+0000 mon.a (mon.0) 195 : cluster 0 mgrmap e13: y(active, since 81s) 2024-03-30T14:59:37.515 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:35.242735+0000 mon.a (mon.0) 196 : cluster 3 Health check failed: 1/3 mons down, quorum a,b (MON_DOWN) 2024-03-30T14:59:37.515 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:35.251311+0000 mon.a (mon.0) 197 : cluster 3 Health detail: HEALTH_WARN 1/3 mons down, quorum a,b 2024-03-30T14:59:37.515 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:35.251374+0000 mon.a (mon.0) 198 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b 2024-03-30T14:59:37.516 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:35.251426+0000 mon.a (mon.0) 199 : cluster 3 mon.c (rank 2) addr [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] is down (out of quorum) 2024-03-30T14:59:37.516 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: audit 2024-03-30T14:59:35.257671+0000 mon.a (mon.0) 200 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:37.516 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: audit 2024-03-30T14:59:35.263150+0000 mon.a (mon.0) 201 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:37.516 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: audit 2024-03-30T14:59:35.270127+0000 mon.a (mon.0) 202 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:37.516 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: audit 2024-03-30T14:59:35.276037+0000 mon.a (mon.0) 203 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:37.516 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: audit 2024-03-30T14:59:35.283593+0000 mon.a (mon.0) 204 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:37.516 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: audit 2024-03-30T14:59:35.856407+0000 mon.a (mon.0) 205 : audit 0 from='client.? 172.21.15.172:0/1884967186' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-30T14:59:37.516 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: audit 2024-03-30T14:59:35.959876+0000 mon.a (mon.0) 206 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:59:37.516 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: audit 2024-03-30T14:59:35.962039+0000 mon.a (mon.0) 207 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:59:37.516 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: audit 2024-03-30T14:59:36.208482+0000 mon.a (mon.0) 208 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T14:59:37.516 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:32.210865+0000 mon.c (mon.2) 1 : cluster 1 mon.c calling monitor election 2024-03-30T14:59:37.516 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:37.243542+0000 mon.c (mon.2) 2 : cluster 1 mon.c calling monitor election 2024-03-30T14:59:37.517 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:37 smithi172 bash[23680]: cluster 2024-03-30T14:59:32.210865+0000 mon.c (mon.2) 1 : cluster 1 mon.c calling monitor election 2024-03-30T14:59:37.517 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:37 smithi172 bash[23680]: cluster 2024-03-30T14:59:37.243542+0000 mon.c (mon.2) 2 : cluster 1 mon.c calling monitor election 2024-03-30T14:59:37.517 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:37 smithi172 bash[23680]: cluster 2024-03-30T14:59:37.244283+0000 mon.b (mon.1) 3 : cluster 1 mon.b calling monitor election 2024-03-30T14:59:37.517 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:37 smithi172 bash[23680]: cluster 2024-03-30T14:59:37.244510+0000 mon.a (mon.0) 222 : cluster 1 mon.a calling monitor election 2024-03-30T14:59:37.517 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:37 smithi172 bash[23680]: cluster 2024-03-30T14:59:37.268005+0000 mon.a (mon.0) 223 : cluster 1 mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-03-30T14:59:37.517 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:37 smithi172 bash[23680]: cluster 2024-03-30T14:59:37.275707+0000 mon.a (mon.0) 224 : cluster 0 monmap epoch 3 2024-03-30T14:59:37.517 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:37 smithi172 bash[23680]: cluster 2024-03-30T14:59:37.275738+0000 mon.a (mon.0) 225 : cluster 0 fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 2024-03-30T14:59:37.517 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:37 smithi172 bash[23680]: cluster 2024-03-30T14:59:37.275757+0000 mon.a (mon.0) 226 : cluster 0 last_changed 2024-03-30T14:59:30.208710+0000 2024-03-30T14:59:37.517 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:37 smithi172 bash[23680]: cluster 2024-03-30T14:59:37.275774+0000 mon.a (mon.0) 227 : cluster 0 created 2024-03-30T14:57:00.883324+0000 2024-03-30T14:59:37.517 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:37 smithi172 bash[23680]: cluster 2024-03-30T14:59:37.275793+0000 mon.a (mon.0) 228 : cluster 0 min_mon_release 19 (squid) 2024-03-30T14:59:37.517 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:37 smithi172 bash[23680]: cluster 2024-03-30T14:59:37.275813+0000 mon.a (mon.0) 229 : cluster 0 election_strategy: 1 2024-03-30T14:59:37.517 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:37 smithi172 bash[23680]: cluster 2024-03-30T14:59:37.275856+0000 mon.a (mon.0) 230 : cluster 0 0: [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] mon.a 2024-03-30T14:59:37.517 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:37 smithi172 bash[23680]: cluster 2024-03-30T14:59:37.275885+0000 mon.a (mon.0) 231 : cluster 0 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-30T14:59:37.518 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:37 smithi172 bash[23680]: cluster 2024-03-30T14:59:37.275903+0000 mon.a (mon.0) 232 : cluster 0 2: [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] mon.c 2024-03-30T14:59:37.518 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:37 smithi172 bash[23680]: cluster 2024-03-30T14:59:37.276759+0000 mon.a (mon.0) 233 : cluster 0 fsmap 2024-03-30T14:59:37.518 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:37 smithi172 bash[23680]: cluster 2024-03-30T14:59:37.276812+0000 mon.a (mon.0) 234 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-03-30T14:59:37.518 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:37 smithi172 bash[23680]: cluster 2024-03-30T14:59:37.277105+0000 mon.a (mon.0) 235 : cluster 0 mgrmap e13: y(active, since 83s) 2024-03-30T14:59:37.518 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:37 smithi172 bash[23680]: cluster 2024-03-30T14:59:37.277362+0000 mon.a (mon.0) 236 : cluster 1 Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,b) 2024-03-30T14:59:37.518 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:37 smithi172 bash[23680]: cluster 2024-03-30T14:59:37.277399+0000 mon.a (mon.0) 237 : cluster 1 Cluster is now healthy 2024-03-30T14:59:37.518 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:37 smithi172 bash[23680]: cluster 2024-03-30T14:59:37.283068+0000 mon.a (mon.0) 238 : cluster 1 overall HEALTH_OK 2024-03-30T14:59:37.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:37.244283+0000 mon.b (mon.1) 3 : cluster 1 mon.b calling monitor election 2024-03-30T14:59:37.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:37.244510+0000 mon.a (mon.0) 222 : cluster 1 mon.a calling monitor election 2024-03-30T14:59:37.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:37.268005+0000 mon.a (mon.0) 223 : cluster 1 mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-03-30T14:59:37.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:37.275707+0000 mon.a (mon.0) 224 : cluster 0 monmap epoch 3 2024-03-30T14:59:37.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:37.275738+0000 mon.a (mon.0) 225 : cluster 0 fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 2024-03-30T14:59:37.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:37.275757+0000 mon.a (mon.0) 226 : cluster 0 last_changed 2024-03-30T14:59:30.208710+0000 2024-03-30T14:59:37.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:37.275774+0000 mon.a (mon.0) 227 : cluster 0 created 2024-03-30T14:57:00.883324+0000 2024-03-30T14:59:37.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:37.275793+0000 mon.a (mon.0) 228 : cluster 0 min_mon_release 19 (squid) 2024-03-30T14:59:37.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:37.275813+0000 mon.a (mon.0) 229 : cluster 0 election_strategy: 1 2024-03-30T14:59:37.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:37.275856+0000 mon.a (mon.0) 230 : cluster 0 0: [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] mon.a 2024-03-30T14:59:37.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:37.275885+0000 mon.a (mon.0) 231 : cluster 0 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-30T14:59:37.924 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:37.275903+0000 mon.a (mon.0) 232 : cluster 0 2: [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] mon.c 2024-03-30T14:59:37.924 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:37.276759+0000 mon.a (mon.0) 233 : cluster 0 fsmap 2024-03-30T14:59:37.924 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:37.276812+0000 mon.a (mon.0) 234 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-03-30T14:59:37.924 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:37.277105+0000 mon.a (mon.0) 235 : cluster 0 mgrmap e13: y(active, since 83s) 2024-03-30T14:59:37.924 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:37.277362+0000 mon.a (mon.0) 236 : cluster 1 Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,b) 2024-03-30T14:59:37.924 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:37.277399+0000 mon.a (mon.0) 237 : cluster 1 Cluster is now healthy 2024-03-30T14:59:37.924 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[28946]: cluster 2024-03-30T14:59:37.283068+0000 mon.a (mon.0) 238 : cluster 1 overall HEALTH_OK 2024-03-30T14:59:37.924 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[21573]: cluster 2024-03-30T14:59:32.210865+0000 mon.c (mon.2) 1 : cluster 1 mon.c calling monitor election 2024-03-30T14:59:37.924 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[21573]: cluster 2024-03-30T14:59:37.243542+0000 mon.c (mon.2) 2 : cluster 1 mon.c calling monitor election 2024-03-30T14:59:37.924 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[21573]: cluster 2024-03-30T14:59:37.244283+0000 mon.b (mon.1) 3 : cluster 1 mon.b calling monitor election 2024-03-30T14:59:37.924 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[21573]: cluster 2024-03-30T14:59:37.244510+0000 mon.a (mon.0) 222 : cluster 1 mon.a calling monitor election 2024-03-30T14:59:37.924 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[21573]: cluster 2024-03-30T14:59:37.268005+0000 mon.a (mon.0) 223 : cluster 1 mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-03-30T14:59:37.925 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[21573]: cluster 2024-03-30T14:59:37.275707+0000 mon.a (mon.0) 224 : cluster 0 monmap epoch 3 2024-03-30T14:59:37.925 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[21573]: cluster 2024-03-30T14:59:37.275738+0000 mon.a (mon.0) 225 : cluster 0 fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 2024-03-30T14:59:37.925 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[21573]: cluster 2024-03-30T14:59:37.275757+0000 mon.a (mon.0) 226 : cluster 0 last_changed 2024-03-30T14:59:30.208710+0000 2024-03-30T14:59:37.925 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[21573]: cluster 2024-03-30T14:59:37.275774+0000 mon.a (mon.0) 227 : cluster 0 created 2024-03-30T14:57:00.883324+0000 2024-03-30T14:59:37.925 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[21573]: cluster 2024-03-30T14:59:37.275793+0000 mon.a (mon.0) 228 : cluster 0 min_mon_release 19 (squid) 2024-03-30T14:59:37.925 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[21573]: cluster 2024-03-30T14:59:37.275813+0000 mon.a (mon.0) 229 : cluster 0 election_strategy: 1 2024-03-30T14:59:37.925 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[21573]: cluster 2024-03-30T14:59:37.275856+0000 mon.a (mon.0) 230 : cluster 0 0: [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] mon.a 2024-03-30T14:59:37.925 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[21573]: cluster 2024-03-30T14:59:37.275885+0000 mon.a (mon.0) 231 : cluster 0 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-30T14:59:37.925 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[21573]: cluster 2024-03-30T14:59:37.275903+0000 mon.a (mon.0) 232 : cluster 0 2: [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] mon.c 2024-03-30T14:59:37.925 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[21573]: cluster 2024-03-30T14:59:37.276759+0000 mon.a (mon.0) 233 : cluster 0 fsmap 2024-03-30T14:59:37.925 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[21573]: cluster 2024-03-30T14:59:37.276812+0000 mon.a (mon.0) 234 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-03-30T14:59:37.925 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[21573]: cluster 2024-03-30T14:59:37.277105+0000 mon.a (mon.0) 235 : cluster 0 mgrmap e13: y(active, since 83s) 2024-03-30T14:59:37.925 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[21573]: cluster 2024-03-30T14:59:37.277362+0000 mon.a (mon.0) 236 : cluster 1 Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,b) 2024-03-30T14:59:37.925 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[21573]: cluster 2024-03-30T14:59:37.277399+0000 mon.a (mon.0) 237 : cluster 1 Cluster is now healthy 2024-03-30T14:59:37.925 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:37 smithi072 bash[21573]: cluster 2024-03-30T14:59:37.283068+0000 mon.a (mon.0) 238 : cluster 1 overall HEALTH_OK 2024-03-30T14:59:39.471 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:39 smithi172 bash[23680]: cluster 2024-03-30T14:59:37.638389+0000 mgr.y (mgr.14152) 64 : cluster 0 pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:39.472 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:39 smithi172 bash[23680]: audit 2024-03-30T14:59:38.208403+0000 mon.a (mon.0) 239 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T14:59:39.472 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:39 smithi172 bash[23680]: audit 2024-03-30T14:59:38.839854+0000 mon.a (mon.0) 240 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:39.472 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:39 smithi172 bash[23680]: audit 2024-03-30T14:59:38.846930+0000 mon.a (mon.0) 241 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:39.472 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:39 smithi172 bash[23680]: audit 2024-03-30T14:59:38.886262+0000 mon.a (mon.0) 242 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T14:59:39.472 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:39 smithi172 bash[23680]: audit 2024-03-30T14:59:38.888092+0000 mon.a (mon.0) 243 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T14:59:39.472 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:39 smithi172 bash[23680]: audit 2024-03-30T14:59:38.889694+0000 mon.a (mon.0) 244 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:59:39.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:39 smithi072 bash[21573]: cluster 2024-03-30T14:59:37.638389+0000 mgr.y (mgr.14152) 64 : cluster 0 pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:39.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:39 smithi072 bash[21573]: audit 2024-03-30T14:59:38.208403+0000 mon.a (mon.0) 239 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T14:59:39.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:39 smithi072 bash[21573]: audit 2024-03-30T14:59:38.839854+0000 mon.a (mon.0) 240 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:39.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:39 smithi072 bash[21573]: audit 2024-03-30T14:59:38.846930+0000 mon.a (mon.0) 241 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:39.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:39 smithi072 bash[21573]: audit 2024-03-30T14:59:38.886262+0000 mon.a (mon.0) 242 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T14:59:39.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:39 smithi072 bash[21573]: audit 2024-03-30T14:59:38.888092+0000 mon.a (mon.0) 243 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T14:59:39.673 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:39 smithi072 bash[21573]: audit 2024-03-30T14:59:38.889694+0000 mon.a (mon.0) 244 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:59:39.673 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:39 smithi072 bash[28946]: cluster 2024-03-30T14:59:37.638389+0000 mgr.y (mgr.14152) 64 : cluster 0 pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:39.673 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:39 smithi072 bash[28946]: audit 2024-03-30T14:59:38.208403+0000 mon.a (mon.0) 239 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T14:59:39.673 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:39 smithi072 bash[28946]: audit 2024-03-30T14:59:38.839854+0000 mon.a (mon.0) 240 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:39.673 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:39 smithi072 bash[28946]: audit 2024-03-30T14:59:38.846930+0000 mon.a (mon.0) 241 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:39.673 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:39 smithi072 bash[28946]: audit 2024-03-30T14:59:38.886262+0000 mon.a (mon.0) 242 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T14:59:39.673 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:39 smithi072 bash[28946]: audit 2024-03-30T14:59:38.888092+0000 mon.a (mon.0) 243 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T14:59:39.673 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:39 smithi072 bash[28946]: audit 2024-03-30T14:59:38.889694+0000 mon.a (mon.0) 244 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:59:40.358 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:40 smithi072 bash[21573]: cephadm 2024-03-30T14:59:38.885537+0000 mgr.y (mgr.14152) 65 : cephadm 1 Reconfiguring mon.c (monmap changed)... 2024-03-30T14:59:40.358 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:40 smithi072 bash[21573]: cephadm 2024-03-30T14:59:38.891710+0000 mgr.y (mgr.14152) 66 : cephadm 1 Reconfiguring daemon mon.c on smithi072 2024-03-30T14:59:40.359 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:40 smithi072 bash[28946]: cephadm 2024-03-30T14:59:38.885537+0000 mgr.y (mgr.14152) 65 : cephadm 1 Reconfiguring mon.c (monmap changed)... 2024-03-30T14:59:40.359 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:40 smithi072 bash[28946]: cephadm 2024-03-30T14:59:38.891710+0000 mgr.y (mgr.14152) 66 : cephadm 1 Reconfiguring daemon mon.c on smithi072 2024-03-30T14:59:40.471 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:40 smithi172 bash[23680]: cephadm 2024-03-30T14:59:38.885537+0000 mgr.y (mgr.14152) 65 : cephadm 1 Reconfiguring mon.c (monmap changed)... 2024-03-30T14:59:40.471 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:40 smithi172 bash[23680]: cephadm 2024-03-30T14:59:38.891710+0000 mgr.y (mgr.14152) 66 : cephadm 1 Reconfiguring daemon mon.c on smithi072 2024-03-30T14:59:41.320 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T14:59:41.471 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:41 smithi172 bash[23680]: cluster 2024-03-30T14:59:39.638795+0000 mgr.y (mgr.14152) 67 : cluster 0 pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:41.472 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:41 smithi172 bash[23680]: audit 2024-03-30T14:59:40.866028+0000 mon.a (mon.0) 245 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:41.472 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:41 smithi172 bash[23680]: audit 2024-03-30T14:59:40.873053+0000 mon.a (mon.0) 246 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:41.472 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:41 smithi172 bash[23680]: audit 2024-03-30T14:59:40.911268+0000 mon.a (mon.0) 247 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T14:59:41.472 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:41 smithi172 bash[23680]: audit 2024-03-30T14:59:40.912776+0000 mon.a (mon.0) 248 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T14:59:41.472 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:41 smithi172 bash[23680]: audit 2024-03-30T14:59:40.914188+0000 mon.a (mon.0) 249 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:59:41.673 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:41 smithi072 bash[21573]: cluster 2024-03-30T14:59:39.638795+0000 mgr.y (mgr.14152) 67 : cluster 0 pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:41.673 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:41 smithi072 bash[21573]: audit 2024-03-30T14:59:40.866028+0000 mon.a (mon.0) 245 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:41.673 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:41 smithi072 bash[21573]: audit 2024-03-30T14:59:40.873053+0000 mon.a (mon.0) 246 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:41.673 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:41 smithi072 bash[21573]: audit 2024-03-30T14:59:40.911268+0000 mon.a (mon.0) 247 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T14:59:41.673 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:41 smithi072 bash[21573]: audit 2024-03-30T14:59:40.912776+0000 mon.a (mon.0) 248 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T14:59:41.673 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:41 smithi072 bash[21573]: audit 2024-03-30T14:59:40.914188+0000 mon.a (mon.0) 249 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:59:41.673 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:41 smithi072 bash[28946]: cluster 2024-03-30T14:59:39.638795+0000 mgr.y (mgr.14152) 67 : cluster 0 pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:41.673 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:41 smithi072 bash[28946]: audit 2024-03-30T14:59:40.866028+0000 mon.a (mon.0) 245 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:41.673 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:41 smithi072 bash[28946]: audit 2024-03-30T14:59:40.873053+0000 mon.a (mon.0) 246 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:41.674 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:41 smithi072 bash[28946]: audit 2024-03-30T14:59:40.911268+0000 mon.a (mon.0) 247 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T14:59:41.674 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:41 smithi072 bash[28946]: audit 2024-03-30T14:59:40.912776+0000 mon.a (mon.0) 248 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T14:59:41.674 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:41 smithi072 bash[28946]: audit 2024-03-30T14:59:40.914188+0000 mon.a (mon.0) 249 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:59:42.414 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:42 smithi172 bash[23680]: cephadm 2024-03-30T14:59:40.910681+0000 mgr.y (mgr.14152) 68 : cephadm 1 Reconfiguring mon.b (monmap changed)... 2024-03-30T14:59:42.414 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:42 smithi172 bash[23680]: cephadm 2024-03-30T14:59:40.916119+0000 mgr.y (mgr.14152) 69 : cephadm 1 Reconfiguring daemon mon.b on smithi172 2024-03-30T14:59:42.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:42 smithi072 bash[28946]: cephadm 2024-03-30T14:59:40.910681+0000 mgr.y (mgr.14152) 68 : cephadm 1 Reconfiguring mon.b (monmap changed)... 2024-03-30T14:59:42.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:42 smithi072 bash[28946]: cephadm 2024-03-30T14:59:40.916119+0000 mgr.y (mgr.14152) 69 : cephadm 1 Reconfiguring daemon mon.b on smithi172 2024-03-30T14:59:42.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:42 smithi072 bash[21573]: cephadm 2024-03-30T14:59:40.910681+0000 mgr.y (mgr.14152) 68 : cephadm 1 Reconfiguring mon.b (monmap changed)... 2024-03-30T14:59:42.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:42 smithi072 bash[21573]: cephadm 2024-03-30T14:59:40.916119+0000 mgr.y (mgr.14152) 69 : cephadm 1 Reconfiguring daemon mon.b on smithi172 2024-03-30T14:59:43.471 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:43 smithi172 bash[23680]: cluster 2024-03-30T14:59:41.639310+0000 mgr.y (mgr.14152) 70 : cluster 0 pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:43.472 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:43 smithi172 bash[23680]: audit 2024-03-30T14:59:42.844443+0000 mon.a (mon.0) 250 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:43.472 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:43 smithi172 bash[23680]: audit 2024-03-30T14:59:42.854424+0000 mon.a (mon.0) 251 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:43.472 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:43 smithi172 bash[23680]: audit 2024-03-30T14:59:42.887056+0000 mon.a (mon.0) 252 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:59:43.472 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:43 smithi172 bash[23680]: audit 2024-03-30T14:59:42.890119+0000 mon.a (mon.0) 253 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:59:43.472 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:43 smithi172 bash[23680]: audit 2024-03-30T14:59:42.891440+0000 mon.a (mon.0) 254 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:59:43.472 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:43 smithi172 bash[23680]: audit 2024-03-30T14:59:42.898420+0000 mon.a (mon.0) 255 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:43.655 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:43 smithi072 bash[21573]: cluster 2024-03-30T14:59:41.639310+0000 mgr.y (mgr.14152) 70 : cluster 0 pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:43.655 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:43 smithi072 bash[21573]: audit 2024-03-30T14:59:42.844443+0000 mon.a (mon.0) 250 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:43.655 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:43 smithi072 bash[21573]: audit 2024-03-30T14:59:42.854424+0000 mon.a (mon.0) 251 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:43.655 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:43 smithi072 bash[21573]: audit 2024-03-30T14:59:42.887056+0000 mon.a (mon.0) 252 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:59:43.655 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:43 smithi072 bash[21573]: audit 2024-03-30T14:59:42.890119+0000 mon.a (mon.0) 253 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:59:43.655 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:43 smithi072 bash[21573]: audit 2024-03-30T14:59:42.891440+0000 mon.a (mon.0) 254 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:59:43.656 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:43 smithi072 bash[21573]: audit 2024-03-30T14:59:42.898420+0000 mon.a (mon.0) 255 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:43.656 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:43 smithi072 bash[28946]: cluster 2024-03-30T14:59:41.639310+0000 mgr.y (mgr.14152) 70 : cluster 0 pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:43.656 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:43 smithi072 bash[28946]: audit 2024-03-30T14:59:42.844443+0000 mon.a (mon.0) 250 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:43.656 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:43 smithi072 bash[28946]: audit 2024-03-30T14:59:42.854424+0000 mon.a (mon.0) 251 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:43.656 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:43 smithi072 bash[28946]: audit 2024-03-30T14:59:42.887056+0000 mon.a (mon.0) 252 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:59:43.656 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:43 smithi072 bash[28946]: audit 2024-03-30T14:59:42.890119+0000 mon.a (mon.0) 253 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:59:43.656 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:43 smithi072 bash[28946]: audit 2024-03-30T14:59:42.891440+0000 mon.a (mon.0) 254 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:59:43.656 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:43 smithi072 bash[28946]: audit 2024-03-30T14:59:42.898420+0000 mon.a (mon.0) 255 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:43.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:43.823+0000 7fa03e2f6700 1 -- 172.21.15.72:0/3148955696 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa038102520 msgr2=0x7fa038102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:59:43.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:43.823+0000 7fa03e2f6700 1 --2- 172.21.15.72:0/3148955696 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa038102520 0x7fa038102900 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa0280099c0 tx=0x7fa028009cd0 comp rx=0 tx=0).stop 2024-03-30T14:59:43.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:43.823+0000 7fa03e2f6700 1 -- 172.21.15.72:0/3148955696 shutdown_connections 2024-03-30T14:59:43.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:43.823+0000 7fa03e2f6700 1 --2- 172.21.15.72:0/3148955696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0381075a0 0x7fa03810f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:59:43.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:43.823+0000 7fa03e2f6700 1 --2- 172.21.15.72:0/3148955696 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa038102520 0x7fa038102900 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:59:43.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:43.823+0000 7fa03e2f6700 1 --2- 172.21.15.72:0/3148955696 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa038102ed0 0x7fa038106ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:59:43.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:43.823+0000 7fa03e2f6700 1 -- 172.21.15.72:0/3148955696 >> 172.21.15.72:0/3148955696 conn(0x7fa038079360 msgr2=0x7fa038079770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:59:43.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:43.823+0000 7fa03e2f6700 1 -- 172.21.15.72:0/3148955696 shutdown_connections 2024-03-30T14:59:43.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:43.823+0000 7fa03e2f6700 1 -- 172.21.15.72:0/3148955696 wait complete. 2024-03-30T14:59:43.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:43.823+0000 7fa03e2f6700 1 Processor -- start 2024-03-30T14:59:43.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:43.823+0000 7fa03e2f6700 1 -- start start 2024-03-30T14:59:43.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:43.823+0000 7fa03e2f6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa038102520 0x7fa038197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:59:43.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:43.823+0000 7fa03e2f6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa038102ed0 0x7fa0381984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:59:43.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:43.823+0000 7fa03e2f6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa0381075a0 0x7fa03819c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:59:43.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:43.823+0000 7fa03e2f6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa038111a00 con 0x7fa038102ed0 2024-03-30T14:59:43.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:43.823+0000 7fa03e2f6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa038111880 con 0x7fa038102520 2024-03-30T14:59:43.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:43.823+0000 7fa03e2f6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fa038111b80 con 0x7fa0381075a0 2024-03-30T14:59:43.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:43.823+0000 7fa03c893700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa0381075a0 0x7fa03819c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:59:43.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:43.823+0000 7fa0377fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa038102ed0 0x7fa0381984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:59:43.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:43.823+0000 7fa03c893700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa0381075a0 0x7fa03819c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:47382/0 (socket says 172.21.15.72:47382) 2024-03-30T14:59:43.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:43.823+0000 7fa03c893700 1 -- 172.21.15.72:0/3742536712 learned_addr learned my addr 172.21.15.72:0/3742536712 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T14:59:43.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:43.823+0000 7fa037fff700 1 --2- 172.21.15.72:0/3742536712 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa038102520 0x7fa038197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:59:43.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:43.827+0000 7fa03c893700 1 -- 172.21.15.72:0/3742536712 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa038102520 msgr2=0x7fa038197f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:59:43.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:43.827+0000 7fa03c893700 1 --2- 172.21.15.72:0/3742536712 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa038102520 0x7fa038197f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:59:43.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:43.827+0000 7fa03c893700 1 -- 172.21.15.72:0/3742536712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa038102ed0 msgr2=0x7fa0381984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:59:43.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:43.827+0000 7fa03c893700 1 --2- 172.21.15.72:0/3742536712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa038102ed0 0x7fa0381984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:59:43.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:43.827+0000 7fa03c893700 1 -- 172.21.15.72:0/3742536712 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa03819cf90 con 0x7fa0381075a0 2024-03-30T14:59:43.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:43.827+0000 7fa037fff700 1 --2- 172.21.15.72:0/3742536712 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa038102520 0x7fa038197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T14:59:43.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:43.827+0000 7fa0377fe700 1 --2- 172.21.15.72:0/3742536712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa038102ed0 0x7fa0381984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T14:59:43.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:43.827+0000 7fa03c893700 1 --2- 172.21.15.72:0/3742536712 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa0381075a0 0x7fa03819c850 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa030007d70 tx=0x7fa03000a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:59:43.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:43.827+0000 7fa0357fa700 1 -- 172.21.15.72:0/3742536712 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa030016020 con 0x7fa0381075a0 2024-03-30T14:59:43.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:43.827+0000 7fa03e2f6700 1 -- 172.21.15.72:0/3742536712 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa03819d280 con 0x7fa0381075a0 2024-03-30T14:59:43.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:43.827+0000 7fa0357fa700 1 -- 172.21.15.72:0/3742536712 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7fa03000ad40 con 0x7fa0381075a0 2024-03-30T14:59:43.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:43.827+0000 7fa0357fa700 1 -- 172.21.15.72:0/3742536712 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0300115e0 con 0x7fa0381075a0 2024-03-30T14:59:43.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:43.827+0000 7fa03e2f6700 1 -- 172.21.15.72:0/3742536712 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa038074470 con 0x7fa0381075a0 2024-03-30T14:59:43.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:43.827+0000 7fa0357fa700 1 -- 172.21.15.72:0/3742536712 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 13) ==== 46172+0+0 (secure 0 0 0) 0x7fa030019020 con 0x7fa0381075a0 2024-03-30T14:59:43.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:43.827+0000 7fa03e2f6700 1 -- 172.21.15.72:0/3742536712 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa03804ff00 con 0x7fa0381075a0 2024-03-30T14:59:43.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:43.827+0000 7fa0357fa700 1 --2- 172.21.15.72:0/3742536712 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fa0200390e0 0x7fa02003b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:59:43.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:43.827+0000 7fa0357fa700 1 -- 172.21.15.72:0/3742536712 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa03004c0f0 con 0x7fa0381075a0 2024-03-30T14:59:43.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:43.827+0000 7fa037fff700 1 --2- 172.21.15.72:0/3742536712 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fa0200390e0 0x7fa02003b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:59:43.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:43.827+0000 7fa037fff700 1 --2- 172.21.15.72:0/3742536712 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fa0200390e0 0x7fa02003b5a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa028003860 tx=0x7fa028005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:59:43.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:43.831+0000 7fa0357fa700 1 -- 172.21.15.72:0/3742536712 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fa030020020 con 0x7fa0381075a0 2024-03-30T14:59:44.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:44.039+0000 7fa03e2f6700 1 -- 172.21.15.72:0/3742536712 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fa038074790 con 0x7fa0381075a0 2024-03-30T14:59:44.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:44.039+0000 7fa0357fa700 1 -- 172.21.15.72:0/3742536712 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+273 (secure 0 0 0) 0x7fa030018520 con 0x7fa0381075a0 2024-03-30T14:59:44.043 INFO:teuthology.orchestra.run.smithi072.stdout:# minimal ceph.conf for 97f8e564-eea5-11ee-b647-cb9ed24678a4 2024-03-30T14:59:44.043 INFO:teuthology.orchestra.run.smithi072.stdout:[global] 2024-03-30T14:59:44.043 INFO:teuthology.orchestra.run.smithi072.stdout: fsid = 97f8e564-eea5-11ee-b647-cb9ed24678a4 2024-03-30T14:59:44.043 INFO:teuthology.orchestra.run.smithi072.stdout: mon_host = [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] 2024-03-30T14:59:44.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:44.043+0000 7fa03e2f6700 1 -- 172.21.15.72:0/3742536712 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fa0200390e0 msgr2=0x7fa02003b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:59:44.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:44.043+0000 7fa03e2f6700 1 --2- 172.21.15.72:0/3742536712 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fa0200390e0 0x7fa02003b5a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa028003860 tx=0x7fa028005fd0 comp rx=0 tx=0).stop 2024-03-30T14:59:44.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:44.043+0000 7fa03e2f6700 1 -- 172.21.15.72:0/3742536712 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa0381075a0 msgr2=0x7fa03819c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:59:44.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:44.043+0000 7fa03e2f6700 1 --2- 172.21.15.72:0/3742536712 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa0381075a0 0x7fa03819c850 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa030007d70 tx=0x7fa03000a340 comp rx=0 tx=0).stop 2024-03-30T14:59:44.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:44.043+0000 7fa03e2f6700 1 -- 172.21.15.72:0/3742536712 shutdown_connections 2024-03-30T14:59:44.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:44.043+0000 7fa03e2f6700 1 --2- 172.21.15.72:0/3742536712 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fa0200390e0 0x7fa02003b5a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:59:44.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:44.043+0000 7fa03e2f6700 1 --2- 172.21.15.72:0/3742536712 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa0381075a0 0x7fa03819c850 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:59:44.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:44.043+0000 7fa03e2f6700 1 --2- 172.21.15.72:0/3742536712 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa038102520 0x7fa038197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:59:44.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:44.043+0000 7fa03e2f6700 1 --2- 172.21.15.72:0/3742536712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa038102ed0 0x7fa0381984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:59:44.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:44.043+0000 7fa03e2f6700 1 -- 172.21.15.72:0/3742536712 >> 172.21.15.72:0/3742536712 conn(0x7fa038079360 msgr2=0x7fa038100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:59:44.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:44.043+0000 7fa03e2f6700 1 -- 172.21.15.72:0/3742536712 shutdown_connections 2024-03-30T14:59:44.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T14:59:44.043+0000 7fa03e2f6700 1 -- 172.21.15.72:0/3742536712 wait complete. 2024-03-30T14:59:44.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:44 smithi072 bash[28946]: audit 2024-03-30T14:59:44.043206+0000 mon.c (mon.2) 3 : audit 0 from='client.? 172.21.15.72:0/3742536712' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:59:44.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:44 smithi072 bash[21573]: audit 2024-03-30T14:59:44.043206+0000 mon.c (mon.2) 3 : audit 0 from='client.? 172.21.15.72:0/3742536712' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:59:44.471 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:44 smithi172 bash[23680]: audit 2024-03-30T14:59:44.043206+0000 mon.c (mon.2) 3 : audit 0 from='client.? 172.21.15.72:0/3742536712' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:59:44.764 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-03-30T14:59:44.764 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-30T14:59:44.764 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/ceph/ceph.conf 2024-03-30T14:59:44.822 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-30T14:59:44.822 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-30T14:59:44.876 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-03-30T14:59:44.876 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.conf 2024-03-30T14:59:44.891 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-03-30T14:59:44.891 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-30T14:59:44.945 INFO:tasks.cephadm:Adding mgr.y on smithi072 2024-03-30T14:59:44.945 INFO:tasks.cephadm:Adding mgr.x on smithi172 2024-03-30T14:59:44.945 DEBUG:teuthology.orchestra.run.smithi172:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph orch apply mgr '2;smithi072=y;smithi172=x' 2024-03-30T14:59:45.471 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:45 smithi172 bash[23680]: cluster 2024-03-30T14:59:43.639708+0000 mgr.y (mgr.14152) 71 : cluster 0 pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:45.673 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:45 smithi072 bash[21573]: cluster 2024-03-30T14:59:43.639708+0000 mgr.y (mgr.14152) 71 : cluster 0 pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:45.673 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:45 smithi072 bash[28946]: cluster 2024-03-30T14:59:43.639708+0000 mgr.y (mgr.14152) 71 : cluster 0 pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:47.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:47 smithi072 bash[21573]: cluster 2024-03-30T14:59:45.640102+0000 mgr.y (mgr.14152) 72 : cluster 0 pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:47.672 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:47 smithi072 bash[28946]: cluster 2024-03-30T14:59:45.640102+0000 mgr.y (mgr.14152) 72 : cluster 0 pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:47.734 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:47 smithi172 bash[23680]: cluster 2024-03-30T14:59:45.640102+0000 mgr.y (mgr.14152) 72 : cluster 0 pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:48.685 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.b/config 2024-03-30T14:59:49.490 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:49 smithi172 bash[23680]: cluster 2024-03-30T14:59:47.640519+0000 mgr.y (mgr.14152) 73 : cluster 0 pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:49.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:49 smithi072 bash[21573]: cluster 2024-03-30T14:59:47.640519+0000 mgr.y (mgr.14152) 73 : cluster 0 pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:49.672 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:49 smithi072 bash[28946]: cluster 2024-03-30T14:59:47.640519+0000 mgr.y (mgr.14152) 73 : cluster 0 pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:50.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:50.983+0000 7f70b9cb3700 1 -- 172.21.15.172:0/1585236050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70b41088e0 msgr2=0x7f70b4108d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:59:50.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:50.983+0000 7f70b9cb3700 1 --2- 172.21.15.172:0/1585236050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70b41088e0 0x7f70b4108d00 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f70a40099c0 tx=0x7f70a4009cd0 comp rx=0 tx=0).stop 2024-03-30T14:59:50.987 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:50.983+0000 7f70b9cb3700 1 -- 172.21.15.172:0/1585236050 shutdown_connections 2024-03-30T14:59:50.987 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:50.983+0000 7f70b9cb3700 1 --2- 172.21.15.172:0/1585236050 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70b410a480 0x7f70b4110d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:59:50.987 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:50.983+0000 7f70b9cb3700 1 --2- 172.21.15.172:0/1585236050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70b41088e0 0x7f70b4108d00 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:59:50.987 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:50.983+0000 7f70b9cb3700 1 --2- 172.21.15.172:0/1585236050 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70b4109ae0 0x7f70b4109f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:59:50.987 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:50.983+0000 7f70b9cb3700 1 -- 172.21.15.172:0/1585236050 >> 172.21.15.172:0/1585236050 conn(0x7f70b40778d0 msgr2=0x7f70b4079cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:59:50.987 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:50.983+0000 7f70b9cb3700 1 -- 172.21.15.172:0/1585236050 shutdown_connections 2024-03-30T14:59:50.987 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:50.983+0000 7f70b9cb3700 1 -- 172.21.15.172:0/1585236050 wait complete. 2024-03-30T14:59:50.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:50.983+0000 7f70b9cb3700 1 Processor -- start 2024-03-30T14:59:50.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:50.983+0000 7f70b9cb3700 1 -- start start 2024-03-30T14:59:50.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:50.983+0000 7f70b9cb3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70b41088e0 0x7f70b419e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:59:50.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:50.983+0000 7f70b9cb3700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70b4109ae0 0x7f70b419e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:59:50.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:50.983+0000 7f70b9cb3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70b410a480 0x7f70b41a5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:59:50.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:50.983+0000 7f70b9cb3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f70b4113940 con 0x7f70b41088e0 2024-03-30T14:59:50.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:50.983+0000 7f70b9cb3700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f70b41137c0 con 0x7f70b4109ae0 2024-03-30T14:59:50.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:50.983+0000 7f70b9cb3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f70b4113ac0 con 0x7f70b410a480 2024-03-30T14:59:50.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:50.983+0000 7f70b2ffd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70b4109ae0 0x7f70b419e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:59:50.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:50.983+0000 7f70b2ffd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70b4109ae0 0x7f70b419e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49942/0 (socket says 172.21.15.172:49942) 2024-03-30T14:59:50.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:50.983+0000 7f70b2ffd700 1 -- 172.21.15.172:0/3874535439 learned_addr learned my addr 172.21.15.172:0/3874535439 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-03-30T14:59:50.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:50.983+0000 7f70b3fff700 1 --2- 172.21.15.172:0/3874535439 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70b410a480 0x7f70b41a5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:59:50.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:50.983+0000 7f70b37fe700 1 --2- 172.21.15.172:0/3874535439 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70b41088e0 0x7f70b419e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:59:50.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:50.983+0000 7f70b2ffd700 1 -- 172.21.15.172:0/3874535439 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70b410a480 msgr2=0x7f70b41a5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:59:50.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:50.983+0000 7f70b2ffd700 1 --2- 172.21.15.172:0/3874535439 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70b410a480 0x7f70b41a5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:59:50.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:50.983+0000 7f70b2ffd700 1 -- 172.21.15.172:0/3874535439 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70b41088e0 msgr2=0x7f70b419e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:59:50.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:50.983+0000 7f70b2ffd700 1 --2- 172.21.15.172:0/3874535439 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70b41088e0 0x7f70b419e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:59:50.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:50.983+0000 7f70b2ffd700 1 -- 172.21.15.172:0/3874535439 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70b41a5cd0 con 0x7f70b4109ae0 2024-03-30T14:59:50.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:50.983+0000 7f70b37fe700 1 --2- 172.21.15.172:0/3874535439 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70b41088e0 0x7f70b419e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T14:59:50.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:50.983+0000 7f70b2ffd700 1 --2- 172.21.15.172:0/3874535439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70b4109ae0 0x7f70b419e5b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f70a800c970 tx=0x7f70a800cc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:59:50.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:50.983+0000 7f70b0ff9700 1 -- 172.21.15.172:0/3874535439 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a8007aa0 con 0x7f70b4109ae0 2024-03-30T14:59:50.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:50.983+0000 7f70b0ff9700 1 -- 172.21.15.172:0/3874535439 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f70a8004cb0 con 0x7f70b4109ae0 2024-03-30T14:59:50.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:50.983+0000 7f70b9cb3700 1 -- 172.21.15.172:0/3874535439 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70b41a5fc0 con 0x7f70b4109ae0 2024-03-30T14:59:50.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:50.983+0000 7f70b0ff9700 1 -- 172.21.15.172:0/3874535439 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a8005470 con 0x7f70b4109ae0 2024-03-30T14:59:50.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:50.983+0000 7f70b9cb3700 1 -- 172.21.15.172:0/3874535439 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70b41a6420 con 0x7f70b4109ae0 2024-03-30T14:59:50.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:50.987+0000 7f70b0ff9700 1 -- 172.21.15.172:0/3874535439 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 13) ==== 46172+0+0 (secure 0 0 0) 0x7f70a800f450 con 0x7f70b4109ae0 2024-03-30T14:59:50.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:50.987+0000 7f70b0ff9700 1 --2- 172.21.15.172:0/3874535439 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f709c0390e0 0x7f709c03b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T14:59:50.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:50.987+0000 7f70b0ff9700 1 -- 172.21.15.172:0/3874535439 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f70a804bd20 con 0x7f70b4109ae0 2024-03-30T14:59:50.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:50.987+0000 7f70b9cb3700 1 -- 172.21.15.172:0/3874535439 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70b404ff00 con 0x7f70b4109ae0 2024-03-30T14:59:50.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:50.987+0000 7f70b37fe700 1 --2- 172.21.15.172:0/3874535439 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f709c0390e0 0x7f709c03b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T14:59:50.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:50.987+0000 7f70b37fe700 1 --2- 172.21.15.172:0/3874535439 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f709c0390e0 0x7f709c03b5a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f70a4000c00 tx=0x7f70a4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T14:59:50.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:50.991+0000 7f70b0ff9700 1 -- 172.21.15.172:0/3874535439 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f70a8012190 con 0x7f70b4109ae0 2024-03-30T14:59:51.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:51.203+0000 7f70b9cb3700 1 -- 172.21.15.172:0/3874535439 --> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi072=y;smithi172=x", "target": ["mon-mgr", ""]}) -- 0x7f70b4062680 con 0x7f709c0390e0 2024-03-30T14:59:51.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:51.215+0000 7f70b0ff9700 1 -- 172.21.15.172:0/3874535439 <== mgr.14152 v2:172.21.15.72:6800/2777002311 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f70b4062680 con 0x7f709c0390e0 2024-03-30T14:59:51.220 INFO:teuthology.orchestra.run.smithi172.stdout:Scheduled mgr update... 2024-03-30T14:59:51.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:51.219+0000 7f70b9cb3700 1 -- 172.21.15.172:0/3874535439 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f709c0390e0 msgr2=0x7f709c03b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:59:51.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:51.219+0000 7f70b9cb3700 1 --2- 172.21.15.172:0/3874535439 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f709c0390e0 0x7f709c03b5a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f70a4000c00 tx=0x7f70a4005fb0 comp rx=0 tx=0).stop 2024-03-30T14:59:51.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:51.219+0000 7f70b9cb3700 1 -- 172.21.15.172:0/3874535439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70b4109ae0 msgr2=0x7f70b419e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T14:59:51.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:51.219+0000 7f70b9cb3700 1 --2- 172.21.15.172:0/3874535439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70b4109ae0 0x7f70b419e5b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f70a800c970 tx=0x7f70a800cc80 comp rx=0 tx=0).stop 2024-03-30T14:59:51.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:51.219+0000 7f70b9cb3700 1 -- 172.21.15.172:0/3874535439 shutdown_connections 2024-03-30T14:59:51.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:51.219+0000 7f70b9cb3700 1 --2- 172.21.15.172:0/3874535439 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f709c0390e0 0x7f709c03b5a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:59:51.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:51.219+0000 7f70b9cb3700 1 --2- 172.21.15.172:0/3874535439 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70b410a480 0x7f70b41a5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:59:51.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:51.219+0000 7f70b9cb3700 1 --2- 172.21.15.172:0/3874535439 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70b41088e0 0x7f70b419e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:59:51.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:51.219+0000 7f70b9cb3700 1 --2- 172.21.15.172:0/3874535439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70b4109ae0 0x7f70b419e5b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T14:59:51.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:51.219+0000 7f70b9cb3700 1 -- 172.21.15.172:0/3874535439 >> 172.21.15.172:0/3874535439 conn(0x7f70b40778d0 msgr2=0x7f70b40793d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T14:59:51.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:51.219+0000 7f70b9cb3700 1 -- 172.21.15.172:0/3874535439 shutdown_connections 2024-03-30T14:59:51.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T14:59:51.219+0000 7f70b9cb3700 1 -- 172.21.15.172:0/3874535439 wait complete. 2024-03-30T14:59:51.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:51 smithi072 bash[21573]: cluster 2024-03-30T14:59:49.640928+0000 mgr.y (mgr.14152) 74 : cluster 0 pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:51.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:51 smithi072 bash[21573]: audit 2024-03-30T14:59:51.219017+0000 mon.a (mon.0) 256 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:51.673 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:51 smithi072 bash[28946]: cluster 2024-03-30T14:59:49.640928+0000 mgr.y (mgr.14152) 74 : cluster 0 pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:51.673 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:51 smithi072 bash[28946]: audit 2024-03-30T14:59:51.219017+0000 mon.a (mon.0) 256 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:51.688 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:51 smithi172 bash[23680]: cluster 2024-03-30T14:59:49.640928+0000 mgr.y (mgr.14152) 74 : cluster 0 pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:51.688 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:51 smithi172 bash[23680]: audit 2024-03-30T14:59:51.219017+0000 mon.a (mon.0) 256 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:52.024 DEBUG:teuthology.orchestra.run.smithi172:mgr.x> sudo journalctl -f -n 0 -u ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@mgr.x.service 2024-03-30T14:59:52.027 INFO:tasks.cephadm:Deploying OSDs... 2024-03-30T14:59:52.027 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-30T14:59:52.027 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/scratch_devs of=/dev/stdout 2024-03-30T14:59:52.033 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-30T14:59:52.034 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_1 2024-03-30T14:59:52.081 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-30T14:59:52.081 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T14:59:52.081 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 878 Links: 1 2024-03-30T14:59:52.082 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T14:59:52.082 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-03-30 14:50:32.282568010 +0000 2024-03-30T14:59:52.082 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-03-30 14:50:32.062569972 +0000 2024-03-30T14:59:52.082 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-03-30 14:50:32.062569972 +0000 2024-03-30T14:59:52.082 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2024-03-30T14:59:52.082 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-30T14:59:52.138 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-03-30T14:59:52.138 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-03-30T14:59:52.138 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000442416 s, 1.2 MB/s 2024-03-30T14:59:52.139 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-30T14:59:52.187 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_2 2024-03-30T14:59:52.233 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-30T14:59:52.234 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T14:59:52.234 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 897 Links: 1 2024-03-30T14:59:52.234 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T14:59:52.234 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-03-30 14:50:32.782563549 +0000 2024-03-30T14:59:52.234 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-03-30 14:50:32.522565868 +0000 2024-03-30T14:59:52.234 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-03-30 14:50:32.522565868 +0000 2024-03-30T14:59:52.234 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2024-03-30T14:59:52.234 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-30T14:59:52.287 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-03-30T14:59:52.287 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-03-30T14:59:52.287 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000317405 s, 1.6 MB/s 2024-03-30T14:59:52.288 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-30T14:59:52.338 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_3 2024-03-30T14:59:52.385 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-30T14:59:52.385 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T14:59:52.386 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 912 Links: 1 2024-03-30T14:59:52.386 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T14:59:52.386 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-03-30 14:50:33.286559054 +0000 2024-03-30T14:59:52.386 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-03-30 14:50:33.014561480 +0000 2024-03-30T14:59:52.386 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-03-30 14:50:33.014561480 +0000 2024-03-30T14:59:52.386 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2024-03-30T14:59:52.386 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-30T14:59:52.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:52 smithi072 bash[21573]: audit 2024-03-30T14:59:51.208623+0000 mgr.y (mgr.14152) 75 : audit 0 from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi072=y;smithi172=x", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:59:52.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:52 smithi072 bash[21573]: cephadm 2024-03-30T14:59:51.212140+0000 mgr.y (mgr.14152) 76 : cephadm 1 Saving service mgr spec with placement smithi072=y;smithi172=x;count:2 2024-03-30T14:59:52.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:52 smithi072 bash[21573]: audit 2024-03-30T14:59:51.251694+0000 mon.a (mon.0) 257 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:59:52.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:52 smithi072 bash[21573]: audit 2024-03-30T14:59:51.255341+0000 mon.a (mon.0) 258 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:59:52.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:52 smithi072 bash[21573]: audit 2024-03-30T14:59:51.257350+0000 mon.a (mon.0) 259 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:59:52.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:52 smithi072 bash[21573]: audit 2024-03-30T14:59:51.266769+0000 mon.a (mon.0) 260 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:52.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:52 smithi072 bash[21573]: audit 2024-03-30T14:59:51.270226+0000 mon.a (mon.0) 261 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T14:59:52.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:52 smithi072 bash[21573]: audit 2024-03-30T14:59:51.272903+0000 mon.a (mon.0) 262 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-30T14:59:52.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:52 smithi072 bash[21573]: audit 2024-03-30T14:59:51.277942+0000 mon.a (mon.0) 263 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T14:59:52.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:52 smithi072 bash[21573]: audit 2024-03-30T14:59:51.279868+0000 mon.a (mon.0) 264 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:59:52.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:52 smithi072 bash[21573]: cephadm 2024-03-30T14:59:51.281897+0000 mgr.y (mgr.14152) 77 : cephadm 1 Deploying daemon mgr.x on smithi172 2024-03-30T14:59:52.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:52 smithi072 bash[28946]: audit 2024-03-30T14:59:51.208623+0000 mgr.y (mgr.14152) 75 : audit 0 from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi072=y;smithi172=x", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:59:52.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:52 smithi072 bash[28946]: cephadm 2024-03-30T14:59:51.212140+0000 mgr.y (mgr.14152) 76 : cephadm 1 Saving service mgr spec with placement smithi072=y;smithi172=x;count:2 2024-03-30T14:59:52.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:52 smithi072 bash[28946]: audit 2024-03-30T14:59:51.251694+0000 mon.a (mon.0) 257 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:59:52.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:52 smithi072 bash[28946]: audit 2024-03-30T14:59:51.255341+0000 mon.a (mon.0) 258 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:59:52.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:52 smithi072 bash[28946]: audit 2024-03-30T14:59:51.257350+0000 mon.a (mon.0) 259 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:59:52.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:52 smithi072 bash[28946]: audit 2024-03-30T14:59:51.266769+0000 mon.a (mon.0) 260 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:52.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:52 smithi072 bash[28946]: audit 2024-03-30T14:59:51.270226+0000 mon.a (mon.0) 261 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T14:59:52.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:52 smithi072 bash[28946]: audit 2024-03-30T14:59:51.272903+0000 mon.a (mon.0) 262 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-30T14:59:52.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:52 smithi072 bash[28946]: audit 2024-03-30T14:59:51.277942+0000 mon.a (mon.0) 263 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T14:59:52.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:52 smithi072 bash[28946]: audit 2024-03-30T14:59:51.279868+0000 mon.a (mon.0) 264 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:59:52.424 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:52 smithi072 bash[28946]: cephadm 2024-03-30T14:59:51.281897+0000 mgr.y (mgr.14152) 77 : cephadm 1 Deploying daemon mgr.x on smithi172 2024-03-30T14:59:52.435 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-03-30T14:59:52.435 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-03-30T14:59:52.435 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000379223 s, 1.4 MB/s 2024-03-30T14:59:52.437 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-30T14:59:52.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:52 smithi172 bash[23680]: audit 2024-03-30T14:59:51.208623+0000 mgr.y (mgr.14152) 75 : audit 0 from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi072=y;smithi172=x", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:59:52.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:52 smithi172 bash[23680]: cephadm 2024-03-30T14:59:51.212140+0000 mgr.y (mgr.14152) 76 : cephadm 1 Saving service mgr spec with placement smithi072=y;smithi172=x;count:2 2024-03-30T14:59:52.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:52 smithi172 bash[23680]: audit 2024-03-30T14:59:51.251694+0000 mon.a (mon.0) 257 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:59:52.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:52 smithi172 bash[23680]: audit 2024-03-30T14:59:51.255341+0000 mon.a (mon.0) 258 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:59:52.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:52 smithi172 bash[23680]: audit 2024-03-30T14:59:51.257350+0000 mon.a (mon.0) 259 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:59:52.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:52 smithi172 bash[23680]: audit 2024-03-30T14:59:51.266769+0000 mon.a (mon.0) 260 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:52.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:52 smithi172 bash[23680]: audit 2024-03-30T14:59:51.270226+0000 mon.a (mon.0) 261 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T14:59:52.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:52 smithi172 bash[23680]: audit 2024-03-30T14:59:51.272903+0000 mon.a (mon.0) 262 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-30T14:59:52.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:52 smithi172 bash[23680]: audit 2024-03-30T14:59:51.277942+0000 mon.a (mon.0) 263 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T14:59:52.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:52 smithi172 bash[23680]: audit 2024-03-30T14:59:51.279868+0000 mon.a (mon.0) 264 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:59:52.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:52 smithi172 bash[23680]: cephadm 2024-03-30T14:59:51.281897+0000 mgr.y (mgr.14152) 77 : cephadm 1 Deploying daemon mgr.x on smithi172 2024-03-30T14:59:52.487 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_4 2024-03-30T14:59:52.533 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-30T14:59:52.533 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T14:59:52.533 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 929 Links: 1 2024-03-30T14:59:52.533 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T14:59:52.533 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-03-30 14:50:33.746554949 +0000 2024-03-30T14:59:52.533 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-03-30 14:50:33.506557091 +0000 2024-03-30T14:59:52.533 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-03-30 14:50:33.506557091 +0000 2024-03-30T14:59:52.534 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2024-03-30T14:59:52.534 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-30T14:59:52.590 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-03-30T14:59:52.590 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-03-30T14:59:52.591 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000362994 s, 1.4 MB/s 2024-03-30T14:59:52.591 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-30T14:59:52.638 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-03-30T14:59:52.639 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/scratch_devs of=/dev/stdout 2024-03-30T14:59:52.644 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-30T14:59:52.644 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_1 2024-03-30T14:59:52.694 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-30T14:59:52.694 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T14:59:52.694 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 876 Links: 1 2024-03-30T14:59:52.694 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T14:59:52.694 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-03-30 14:50:30.093269284 +0000 2024-03-30T14:59:52.694 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-03-30 14:50:29.817271746 +0000 2024-03-30T14:59:52.694 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-03-30 14:50:29.817271746 +0000 2024-03-30T14:59:52.694 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: - 2024-03-30T14:59:52.694 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-30T14:59:52.748 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-03-30T14:59:52.748 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-03-30T14:59:52.748 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000445292 s, 1.1 MB/s 2024-03-30T14:59:52.749 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-30T14:59:52.799 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_2 2024-03-30T14:59:52.845 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-30T14:59:52.845 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T14:59:52.845 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 887 Links: 1 2024-03-30T14:59:52.845 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T14:59:52.845 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-03-30 14:50:30.577264967 +0000 2024-03-30T14:59:52.846 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-03-30 14:50:30.317267286 +0000 2024-03-30T14:59:52.846 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-03-30 14:50:30.317267286 +0000 2024-03-30T14:59:52.846 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: - 2024-03-30T14:59:52.846 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-30T14:59:52.900 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-03-30T14:59:52.900 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-03-30T14:59:52.900 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000418012 s, 1.2 MB/s 2024-03-30T14:59:52.901 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-30T14:59:52.951 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_3 2024-03-30T14:59:52.997 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-30T14:59:52.998 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T14:59:52.998 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 909 Links: 1 2024-03-30T14:59:52.998 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T14:59:52.998 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-03-30 14:50:30.797263004 +0000 2024-03-30T14:59:52.998 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-03-30 14:50:30.793263040 +0000 2024-03-30T14:59:52.998 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-03-30 14:50:30.793263040 +0000 2024-03-30T14:59:52.998 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: - 2024-03-30T14:59:52.998 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-30T14:59:53.052 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-03-30T14:59:53.052 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-03-30T14:59:53.053 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000417486 s, 1.2 MB/s 2024-03-30T14:59:53.053 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-30T14:59:53.103 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_4 2024-03-30T14:59:53.149 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-30T14:59:53.150 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T14:59:53.150 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 928 Links: 1 2024-03-30T14:59:53.150 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T14:59:53.150 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-03-30 14:50:31.573256081 +0000 2024-03-30T14:59:53.150 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-03-30 14:50:31.301258507 +0000 2024-03-30T14:59:53.150 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-03-30 14:50:31.301258507 +0000 2024-03-30T14:59:53.150 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: - 2024-03-30T14:59:53.150 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-30T14:59:53.204 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-03-30T14:59:53.204 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-03-30T14:59:53.204 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.00038808 s, 1.3 MB/s 2024-03-30T14:59:53.206 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-30T14:59:53.260 INFO:tasks.cephadm:Deploying osd.0 on smithi072 with /dev/vg_nvme/lv_4... 2024-03-30T14:59:53.260 DEBUG:teuthology.orchestra.run.smithi072:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-03-30T14:59:53.312 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:53 smithi172 bash[23680]: cluster 2024-03-30T14:59:51.641368+0000 mgr.y (mgr.14152) 78 : cluster 0 pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:53.527 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:53 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T14:59:53.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:53 smithi072 bash[21573]: cluster 2024-03-30T14:59:51.641368+0000 mgr.y (mgr.14152) 78 : cluster 0 pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:53.672 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:53 smithi072 bash[28946]: cluster 2024-03-30T14:59:51.641368+0000 mgr.y (mgr.14152) 78 : cluster 0 pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:53.821 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:53 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T14:59:53.822 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 14:59:53 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T14:59:53.822 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 14:59:53 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T14:59:53.822 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 14:59:53 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T14:59:53.822 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 14:59:53 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T14:59:53.822 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 14:59:53 smithi172 systemd[1]: Started Ceph mgr.x for 97f8e564-eea5-11ee-b647-cb9ed24678a4. 2024-03-30T14:59:54.971 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 14:59:54 smithi172 bash[24582]: debug 2024-03-30T14:59:54.691+0000 7faea9312700 1 -- 172.21.15.172:0/2732696995 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a9b43545a0 con 0x55a9b50d4c00 2024-03-30T14:59:54.971 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 14:59:54 smithi172 bash[24582]: debug 2024-03-30T14:59:54.835+0000 7faeb351a200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-30T14:59:54.972 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:54 smithi172 bash[23680]: cluster 2024-03-30T14:59:53.641742+0000 mgr.y (mgr.14152) 79 : cluster 0 pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:54.972 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:54 smithi172 bash[23680]: audit 2024-03-30T14:59:53.828231+0000 mon.a (mon.0) 265 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:54.972 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:54 smithi172 bash[23680]: audit 2024-03-30T14:59:53.837784+0000 mon.a (mon.0) 266 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:54.972 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:54 smithi172 bash[23680]: audit 2024-03-30T14:59:53.860730+0000 mon.a (mon.0) 267 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:54.972 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:54 smithi172 bash[23680]: audit 2024-03-30T14:59:53.869792+0000 mon.a (mon.0) 268 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:54.972 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:54 smithi172 bash[23680]: audit 2024-03-30T14:59:53.938817+0000 mon.a (mon.0) 269 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:59:55.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:54 smithi072 bash[21573]: cluster 2024-03-30T14:59:53.641742+0000 mgr.y (mgr.14152) 79 : cluster 0 pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:55.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:54 smithi072 bash[21573]: audit 2024-03-30T14:59:53.828231+0000 mon.a (mon.0) 265 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:55.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:54 smithi072 bash[21573]: audit 2024-03-30T14:59:53.837784+0000 mon.a (mon.0) 266 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:55.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:54 smithi072 bash[21573]: audit 2024-03-30T14:59:53.860730+0000 mon.a (mon.0) 267 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:55.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:54 smithi072 bash[21573]: audit 2024-03-30T14:59:53.869792+0000 mon.a (mon.0) 268 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:55.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:54 smithi072 bash[21573]: audit 2024-03-30T14:59:53.938817+0000 mon.a (mon.0) 269 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:59:55.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:54 smithi072 bash[28946]: cluster 2024-03-30T14:59:53.641742+0000 mgr.y (mgr.14152) 79 : cluster 0 pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:55.173 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:54 smithi072 bash[28946]: audit 2024-03-30T14:59:53.828231+0000 mon.a (mon.0) 265 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:55.173 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:54 smithi072 bash[28946]: audit 2024-03-30T14:59:53.837784+0000 mon.a (mon.0) 266 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:55.173 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:54 smithi072 bash[28946]: audit 2024-03-30T14:59:53.860730+0000 mon.a (mon.0) 267 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:55.173 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:54 smithi072 bash[28946]: audit 2024-03-30T14:59:53.869792+0000 mon.a (mon.0) 268 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:55.173 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:54 smithi072 bash[28946]: audit 2024-03-30T14:59:53.938817+0000 mon.a (mon.0) 269 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:59:56.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:56 smithi072 bash[21573]: audit 2024-03-30T14:59:55.266963+0000 mon.a (mon.0) 270 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:56.672 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:56 smithi072 bash[28946]: audit 2024-03-30T14:59:55.266963+0000 mon.a (mon.0) 270 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:56.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:56 smithi172 bash[23680]: audit 2024-03-30T14:59:55.266963+0000 mon.a (mon.0) 270 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:56.721 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 14:59:56 smithi172 bash[24582]: debug 2024-03-30T14:59:56.391+0000 7faeb351a200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-30T14:59:56.722 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 14:59:56 smithi172 bash[24582]: debug 2024-03-30T14:59:56.487+0000 7faeb351a200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-30T14:59:57.222 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 14:59:56 smithi172 bash[24582]: debug 2024-03-30T14:59:56.731+0000 7faeb351a200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-30T14:59:57.528 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:57 smithi172 bash[23680]: cluster 2024-03-30T14:59:55.642197+0000 mgr.y (mgr.14152) 80 : cluster 0 pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:57.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:57 smithi072 bash[21573]: cluster 2024-03-30T14:59:55.642197+0000 mgr.y (mgr.14152) 80 : cluster 0 pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:57.672 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:57 smithi072 bash[28946]: cluster 2024-03-30T14:59:55.642197+0000 mgr.y (mgr.14152) 80 : cluster 0 pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:57.971 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 14:59:57 smithi172 bash[24582]: debug 2024-03-30T14:59:57.523+0000 7faeb351a200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-30T14:59:57.972 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 14:59:57 smithi172 bash[24582]: debug 2024-03-30T14:59:57.631+0000 7faeb351a200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-30T14:59:57.972 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 14:59:57 smithi172 bash[24582]: debug 2024-03-30T14:59:57.731+0000 7faeb351a200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-30T14:59:57.981 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T14:59:58.471 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 14:59:58 smithi172 bash[24582]: debug 2024-03-30T14:59:58.083+0000 7faeb351a200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-30T14:59:58.472 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 14:59:58 smithi172 bash[24582]: debug 2024-03-30T14:59:58.195+0000 7faeb351a200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-30T14:59:58.472 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 14:59:58 smithi172 bash[24582]: debug 2024-03-30T14:59:58.295+0000 7faeb351a200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-30T14:59:58.971 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 14:59:58 smithi172 bash[24582]: debug 2024-03-30T14:59:58.643+0000 7faeb351a200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-30T14:59:58.971 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 14:59:58 smithi172 bash[24582]: debug 2024-03-30T14:59:58.879+0000 7faeb351a200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-30T14:59:59.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:59 smithi072 bash[21573]: cluster 2024-03-30T14:59:57.642630+0000 mgr.y (mgr.14152) 81 : cluster 0 pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:59.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:59 smithi072 bash[21573]: audit 2024-03-30T14:59:59.180564+0000 mon.a (mon.0) 271 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:59.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 14:59:59 smithi072 bash[21573]: audit 2024-03-30T14:59:59.189940+0000 mon.a (mon.0) 272 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:59.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:59 smithi072 bash[28946]: cluster 2024-03-30T14:59:57.642630+0000 mgr.y (mgr.14152) 81 : cluster 0 pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:59.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:59 smithi072 bash[28946]: audit 2024-03-30T14:59:59.180564+0000 mon.a (mon.0) 271 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:59.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 14:59:59 smithi072 bash[28946]: audit 2024-03-30T14:59:59.189940+0000 mon.a (mon.0) 272 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:59.471 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:59 smithi172 bash[23680]: cluster 2024-03-30T14:59:57.642630+0000 mgr.y (mgr.14152) 81 : cluster 0 pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T14:59:59.472 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:59 smithi172 bash[23680]: audit 2024-03-30T14:59:59.180564+0000 mon.a (mon.0) 271 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:59.472 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 14:59:59 smithi172 bash[23680]: audit 2024-03-30T14:59:59.189940+0000 mon.a (mon.0) 272 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T14:59:59.472 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 14:59:59 smithi172 bash[24582]: debug 2024-03-30T14:59:59.167+0000 7faeb351a200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-30T14:59:59.472 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 14:59:59 smithi172 bash[24582]: debug 2024-03-30T14:59:59.279+0000 7faeb351a200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-30T14:59:59.971 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 14:59:59 smithi172 bash[24582]: debug 2024-03-30T14:59:59.559+0000 7faeb351a200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-30T15:00:00.284 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 14:59:59 smithi172 bash[24582]: debug 2024-03-30T14:59:59.975+0000 7faeb351a200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-30T15:00:00.284 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:00:00 smithi172 bash[24582]: debug 2024-03-30T15:00:00.215+0000 7faeb351a200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-30T15:00:00.578 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:00:00 smithi172 bash[24582]: debug 2024-03-30T15:00:00.331+0000 7faeb351a200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-30T15:00:00.579 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:00 smithi172 bash[23680]: audit 2024-03-30T14:59:59.874645+0000 mon.a (mon.0) 273 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:00:00.579 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:00 smithi172 bash[23680]: audit 2024-03-30T14:59:59.876438+0000 mon.a (mon.0) 274 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:00:00.579 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:00 smithi172 bash[23680]: audit 2024-03-30T14:59:59.887579+0000 mon.a (mon.0) 275 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:00:00.579 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:00 smithi172 bash[23680]: audit 2024-03-30T14:59:59.957192+0000 mon.a (mon.0) 276 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T15:00:00.579 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:00 smithi172 bash[23680]: audit 2024-03-30T14:59:59.958513+0000 mon.a (mon.0) 277 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T15:00:00.579 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:00 smithi172 bash[23680]: audit 2024-03-30T14:59:59.959675+0000 mon.a (mon.0) 278 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:00:00.579 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:00 smithi172 bash[23680]: cluster 2024-03-30T15:00:00.000187+0000 mon.a (mon.0) 279 : cluster 1 overall HEALTH_OK 2024-03-30T15:00:00.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:00 smithi072 bash[28946]: audit 2024-03-30T14:59:59.874645+0000 mon.a (mon.0) 273 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:00:00.672 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:00 smithi072 bash[28946]: audit 2024-03-30T14:59:59.876438+0000 mon.a (mon.0) 274 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:00:00.672 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:00 smithi072 bash[28946]: audit 2024-03-30T14:59:59.887579+0000 mon.a (mon.0) 275 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:00:00.672 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:00 smithi072 bash[28946]: audit 2024-03-30T14:59:59.957192+0000 mon.a (mon.0) 276 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T15:00:00.672 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:00 smithi072 bash[28946]: audit 2024-03-30T14:59:59.958513+0000 mon.a (mon.0) 277 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T15:00:00.672 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:00 smithi072 bash[28946]: audit 2024-03-30T14:59:59.959675+0000 mon.a (mon.0) 278 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:00:00.672 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:00 smithi072 bash[28946]: cluster 2024-03-30T15:00:00.000187+0000 mon.a (mon.0) 279 : cluster 1 overall HEALTH_OK 2024-03-30T15:00:00.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:00 smithi072 bash[21573]: audit 2024-03-30T14:59:59.874645+0000 mon.a (mon.0) 273 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:00:00.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:00 smithi072 bash[21573]: audit 2024-03-30T14:59:59.876438+0000 mon.a (mon.0) 274 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:00:00.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:00 smithi072 bash[21573]: audit 2024-03-30T14:59:59.887579+0000 mon.a (mon.0) 275 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:00:00.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:00 smithi072 bash[21573]: audit 2024-03-30T14:59:59.957192+0000 mon.a (mon.0) 276 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T15:00:00.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:00 smithi072 bash[21573]: audit 2024-03-30T14:59:59.958513+0000 mon.a (mon.0) 277 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T15:00:00.673 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:00 smithi072 bash[21573]: audit 2024-03-30T14:59:59.959675+0000 mon.a (mon.0) 278 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:00:00.673 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:00 smithi072 bash[21573]: cluster 2024-03-30T15:00:00.000187+0000 mon.a (mon.0) 279 : cluster 1 overall HEALTH_OK 2024-03-30T15:00:00.971 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:00:00 smithi172 bash[24582]: debug 2024-03-30T15:00:00.575+0000 7faeb351a200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-30T15:00:01.413 INFO:teuthology.orchestra.run.smithi072.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-03-30T15:00:01.413 INFO:teuthology.orchestra.run.smithi072.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-03-30T15:00:01.413 INFO:teuthology.orchestra.run.smithi072.stderr: stderr: 10+0 records in 2024-03-30T15:00:01.413 INFO:teuthology.orchestra.run.smithi072.stderr:10+0 records out 2024-03-30T15:00:01.413 INFO:teuthology.orchestra.run.smithi072.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0141012 s, 744 MB/s 2024-03-30T15:00:01.413 INFO:teuthology.orchestra.run.smithi072.stderr:--> Zapping successful for: 2024-03-30T15:00:01.540 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:01 smithi072 bash[28946]: cluster 2024-03-30T14:59:59.642996+0000 mgr.y (mgr.14152) 82 : cluster 0 pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:01.541 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:01 smithi072 bash[28946]: cephadm 2024-03-30T14:59:59.956473+0000 mgr.y (mgr.14152) 83 : cephadm 1 Reconfiguring mgr.y (unknown last config time)... 2024-03-30T15:00:01.541 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:01 smithi072 bash[28946]: cephadm 2024-03-30T14:59:59.960908+0000 mgr.y (mgr.14152) 84 : cephadm 1 Reconfiguring daemon mgr.y on smithi072 2024-03-30T15:00:01.541 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:01 smithi072 bash[21573]: cluster 2024-03-30T14:59:59.642996+0000 mgr.y (mgr.14152) 82 : cluster 0 pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:01.541 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:01 smithi072 bash[21573]: cephadm 2024-03-30T14:59:59.956473+0000 mgr.y (mgr.14152) 83 : cephadm 1 Reconfiguring mgr.y (unknown last config time)... 2024-03-30T15:00:01.541 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:01 smithi072 bash[21573]: cephadm 2024-03-30T14:59:59.960908+0000 mgr.y (mgr.14152) 84 : cephadm 1 Reconfiguring daemon mgr.y on smithi072 2024-03-30T15:00:01.574 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:01 smithi172 bash[23680]: cluster 2024-03-30T14:59:59.642996+0000 mgr.y (mgr.14152) 82 : cluster 0 pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:01.575 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:01 smithi172 bash[23680]: cephadm 2024-03-30T14:59:59.956473+0000 mgr.y (mgr.14152) 83 : cephadm 1 Reconfiguring mgr.y (unknown last config time)... 2024-03-30T15:00:01.575 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:01 smithi172 bash[23680]: cephadm 2024-03-30T14:59:59.960908+0000 mgr.y (mgr.14152) 84 : cephadm 1 Reconfiguring daemon mgr.y on smithi072 2024-03-30T15:00:01.971 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:00:01 smithi172 bash[24582]: debug 2024-03-30T15:00:01.571+0000 7faeb351a200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-30T15:00:01.971 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:00:01 smithi172 bash[24582]: debug 2024-03-30T15:00:01.683+0000 7faeb351a200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-30T15:00:02.389 DEBUG:teuthology.orchestra.run.smithi072:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi072:vg_nvme/lv_4 2024-03-30T15:00:02.471 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:00:01 smithi172 bash[24582]: debug 2024-03-30T15:00:01.971+0000 7faeb351a200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-30T15:00:02.471 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:00:02 smithi172 bash[24582]: debug 2024-03-30T15:00:02.083+0000 7faeb351a200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-30T15:00:02.971 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:00:02 smithi172 bash[24582]: debug 2024-03-30T15:00:02.531+0000 7faeb351a200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-30T15:00:02.971 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:00:02 smithi172 bash[24582]: debug 2024-03-30T15:00:02.651+0000 7faeb351a200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-30T15:00:03.722 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:03 smithi172 bash[23680]: cluster 2024-03-30T15:00:01.643283+0000 mgr.y (mgr.14152) 85 : cluster 0 pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:03.722 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:03 smithi172 bash[23680]: audit 2024-03-30T15:00:02.455979+0000 mon.a (mon.0) 280 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:00:03.722 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:03 smithi172 bash[23680]: audit 2024-03-30T15:00:02.462924+0000 mon.a (mon.0) 281 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:00:03.722 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:03 smithi172 bash[23680]: audit 2024-03-30T15:00:02.482225+0000 mon.a (mon.0) 282 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:00:03.722 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:03 smithi172 bash[23680]: audit 2024-03-30T15:00:02.484729+0000 mon.a (mon.0) 283 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:00:03.722 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:03 smithi172 bash[23680]: audit 2024-03-30T15:00:02.486072+0000 mon.a (mon.0) 284 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:00:03.722 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:03 smithi172 bash[23680]: audit 2024-03-30T15:00:02.492130+0000 mon.a (mon.0) 285 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:00:03.722 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:03 smithi172 bash[23680]: cluster 2024-03-30T15:00:02.677192+0000 mon.a (mon.0) 286 : cluster 0 Standby manager daemon x started 2024-03-30T15:00:03.722 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:03 smithi172 bash[23680]: audit 2024-03-30T15:00:02.677955+0000 mon.b (mon.1) 4 : audit 0 from='mgr.? 172.21.15.172:0/2745963610' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T15:00:03.722 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:03 smithi172 bash[23680]: audit 2024-03-30T15:00:02.679018+0000 mon.b (mon.1) 5 : audit 0 from='mgr.? 172.21.15.172:0/2745963610' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T15:00:03.722 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:03 smithi172 bash[23680]: audit 2024-03-30T15:00:02.680528+0000 mon.b (mon.1) 6 : audit 0 from='mgr.? 172.21.15.172:0/2745963610' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T15:00:03.722 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:03 smithi172 bash[23680]: audit 2024-03-30T15:00:02.681082+0000 mon.b (mon.1) 7 : audit 0 from='mgr.? 172.21.15.172:0/2745963610' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T15:00:03.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:03 smithi072 bash[21573]: cluster 2024-03-30T15:00:01.643283+0000 mgr.y (mgr.14152) 85 : cluster 0 pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:03.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:03 smithi072 bash[21573]: audit 2024-03-30T15:00:02.455979+0000 mon.a (mon.0) 280 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:00:03.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:03 smithi072 bash[21573]: audit 2024-03-30T15:00:02.462924+0000 mon.a (mon.0) 281 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:00:03.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:03 smithi072 bash[21573]: audit 2024-03-30T15:00:02.482225+0000 mon.a (mon.0) 282 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:00:03.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:03 smithi072 bash[21573]: audit 2024-03-30T15:00:02.484729+0000 mon.a (mon.0) 283 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:00:03.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:03 smithi072 bash[21573]: audit 2024-03-30T15:00:02.486072+0000 mon.a (mon.0) 284 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:00:03.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:03 smithi072 bash[21573]: audit 2024-03-30T15:00:02.492130+0000 mon.a (mon.0) 285 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:00:03.923 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:03 smithi072 bash[21573]: cluster 2024-03-30T15:00:02.677192+0000 mon.a (mon.0) 286 : cluster 0 Standby manager daemon x started 2024-03-30T15:00:03.923 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:03 smithi072 bash[21573]: audit 2024-03-30T15:00:02.677955+0000 mon.b (mon.1) 4 : audit 0 from='mgr.? 172.21.15.172:0/2745963610' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T15:00:03.923 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:03 smithi072 bash[21573]: audit 2024-03-30T15:00:02.679018+0000 mon.b (mon.1) 5 : audit 0 from='mgr.? 172.21.15.172:0/2745963610' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T15:00:03.923 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:03 smithi072 bash[21573]: audit 2024-03-30T15:00:02.680528+0000 mon.b (mon.1) 6 : audit 0 from='mgr.? 172.21.15.172:0/2745963610' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T15:00:03.923 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:03 smithi072 bash[21573]: audit 2024-03-30T15:00:02.681082+0000 mon.b (mon.1) 7 : audit 0 from='mgr.? 172.21.15.172:0/2745963610' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T15:00:03.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:03 smithi072 bash[28946]: cluster 2024-03-30T15:00:01.643283+0000 mgr.y (mgr.14152) 85 : cluster 0 pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:03.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:03 smithi072 bash[28946]: audit 2024-03-30T15:00:02.455979+0000 mon.a (mon.0) 280 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:00:03.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:03 smithi072 bash[28946]: audit 2024-03-30T15:00:02.462924+0000 mon.a (mon.0) 281 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:00:03.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:03 smithi072 bash[28946]: audit 2024-03-30T15:00:02.482225+0000 mon.a (mon.0) 282 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:00:03.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:03 smithi072 bash[28946]: audit 2024-03-30T15:00:02.484729+0000 mon.a (mon.0) 283 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:00:03.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:03 smithi072 bash[28946]: audit 2024-03-30T15:00:02.486072+0000 mon.a (mon.0) 284 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:00:03.924 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:03 smithi072 bash[28946]: audit 2024-03-30T15:00:02.492130+0000 mon.a (mon.0) 285 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:00:03.924 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:03 smithi072 bash[28946]: cluster 2024-03-30T15:00:02.677192+0000 mon.a (mon.0) 286 : cluster 0 Standby manager daemon x started 2024-03-30T15:00:03.924 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:03 smithi072 bash[28946]: audit 2024-03-30T15:00:02.677955+0000 mon.b (mon.1) 4 : audit 0 from='mgr.? 172.21.15.172:0/2745963610' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T15:00:03.924 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:03 smithi072 bash[28946]: audit 2024-03-30T15:00:02.679018+0000 mon.b (mon.1) 5 : audit 0 from='mgr.? 172.21.15.172:0/2745963610' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T15:00:03.924 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:03 smithi072 bash[28946]: audit 2024-03-30T15:00:02.680528+0000 mon.b (mon.1) 6 : audit 0 from='mgr.? 172.21.15.172:0/2745963610' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T15:00:03.924 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:03 smithi072 bash[28946]: audit 2024-03-30T15:00:02.681082+0000 mon.b (mon.1) 7 : audit 0 from='mgr.? 172.21.15.172:0/2745963610' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T15:00:04.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:04 smithi072 bash[21573]: cluster 2024-03-30T15:00:03.505737+0000 mon.a (mon.0) 287 : cluster 0 mgrmap e14: y(active, since 109s), standbys: x 2024-03-30T15:00:04.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:04 smithi072 bash[21573]: audit 2024-03-30T15:00:03.506014+0000 mon.a (mon.0) 288 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-30T15:00:04.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:04 smithi072 bash[28946]: cluster 2024-03-30T15:00:03.505737+0000 mon.a (mon.0) 287 : cluster 0 mgrmap e14: y(active, since 109s), standbys: x 2024-03-30T15:00:04.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:04 smithi072 bash[28946]: audit 2024-03-30T15:00:03.506014+0000 mon.a (mon.0) 288 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-30T15:00:04.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:04 smithi172 bash[23680]: cluster 2024-03-30T15:00:03.505737+0000 mon.a (mon.0) 287 : cluster 0 mgrmap e14: y(active, since 109s), standbys: x 2024-03-30T15:00:04.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:04 smithi172 bash[23680]: audit 2024-03-30T15:00:03.506014+0000 mon.a (mon.0) 288 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-30T15:00:05.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:05 smithi072 bash[21573]: cluster 2024-03-30T15:00:03.643601+0000 mgr.y (mgr.14152) 86 : cluster 0 pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:05.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:05 smithi072 bash[28946]: cluster 2024-03-30T15:00:03.643601+0000 mgr.y (mgr.14152) 86 : cluster 0 pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:05.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:05 smithi172 bash[23680]: cluster 2024-03-30T15:00:03.643601+0000 mgr.y (mgr.14152) 86 : cluster 0 pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:07.116 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T15:00:07.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:07 smithi072 bash[21573]: cluster 2024-03-30T15:00:05.643974+0000 mgr.y (mgr.14152) 87 : cluster 0 pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:07.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:07 smithi072 bash[28946]: cluster 2024-03-30T15:00:05.643974+0000 mgr.y (mgr.14152) 87 : cluster 0 pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:07.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:07 smithi172 bash[23680]: cluster 2024-03-30T15:00:05.643974+0000 mgr.y (mgr.14152) 87 : cluster 0 pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:09.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:09.718+0000 7fd6d9194700 1 -- 172.21.15.72:0/844425270 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6d4102d70 msgr2=0x7fd6d4109620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:00:09.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:09.718+0000 7fd6d9194700 1 --2- 172.21.15.72:0/844425270 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6d4102d70 0x7fd6d4109620 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc00b0a0 tx=0x7fd6cc00b3b0 comp rx=0 tx=0).stop 2024-03-30T15:00:09.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:09.718+0000 7fd6d9194700 1 -- 172.21.15.72:0/844425270 shutdown_connections 2024-03-30T15:00:09.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:09.718+0000 7fd6d9194700 1 --2- 172.21.15.72:0/844425270 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6d4102d70 0x7fd6d4109620 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:00:09.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:09.718+0000 7fd6d9194700 1 --2- 172.21.15.72:0/844425270 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6d41011d0 0x7fd6d41015f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:00:09.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:09.718+0000 7fd6d9194700 1 --2- 172.21.15.72:0/844425270 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6d41023d0 0x7fd6d4102830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:00:09.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:09.718+0000 7fd6d9194700 1 -- 172.21.15.72:0/844425270 >> 172.21.15.72:0/844425270 conn(0x7fd6d40fc790 msgr2=0x7fd6d40febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:00:09.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:09.718+0000 7fd6d9194700 1 -- 172.21.15.72:0/844425270 shutdown_connections 2024-03-30T15:00:09.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:09.718+0000 7fd6d9194700 1 -- 172.21.15.72:0/844425270 wait complete. 2024-03-30T15:00:09.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:09.718+0000 7fd6d9194700 1 Processor -- start 2024-03-30T15:00:09.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:09.718+0000 7fd6d9194700 1 -- start start 2024-03-30T15:00:09.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:09.718+0000 7fd6d9194700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6d41011d0 0x7fd6d4197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:00:09.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:09.718+0000 7fd6d9194700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6d41023d0 0x7fd6d4197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:00:09.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:09.718+0000 7fd6d9194700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6d4102d70 0x7fd6d419eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:00:09.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:09.718+0000 7fd6d9194700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d410c310 con 0x7fd6d41023d0 2024-03-30T15:00:09.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:09.718+0000 7fd6d9194700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d410c190 con 0x7fd6d41011d0 2024-03-30T15:00:09.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:09.718+0000 7fd6d9194700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fd6d410c490 con 0x7fd6d4102d70 2024-03-30T15:00:09.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:09.718+0000 7fd6d359e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6d4102d70 0x7fd6d419eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:00:09.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:09.718+0000 7fd6d259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6d41023d0 0x7fd6d4197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:00:09.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:09.718+0000 7fd6d359e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6d4102d70 0x7fd6d419eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44276/0 (socket says 172.21.15.72:44276) 2024-03-30T15:00:09.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:09.718+0000 7fd6d359e700 1 -- 172.21.15.72:0/3595630654 learned_addr learned my addr 172.21.15.72:0/3595630654 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T15:00:09.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:09.718+0000 7fd6d2d9d700 1 --2- 172.21.15.72:0/3595630654 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6d41011d0 0x7fd6d4197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:00:09.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:09.722+0000 7fd6d359e700 1 -- 172.21.15.72:0/3595630654 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6d41011d0 msgr2=0x7fd6d4197a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:00:09.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:09.722+0000 7fd6d359e700 1 --2- 172.21.15.72:0/3595630654 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6d41011d0 0x7fd6d4197a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:00:09.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:09.722+0000 7fd6d359e700 1 -- 172.21.15.72:0/3595630654 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6d41023d0 msgr2=0x7fd6d4197fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:00:09.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:09.722+0000 7fd6d359e700 1 --2- 172.21.15.72:0/3595630654 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6d41023d0 0x7fd6d4197fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:00:09.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:09.722+0000 7fd6d359e700 1 -- 172.21.15.72:0/3595630654 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6d419f690 con 0x7fd6d4102d70 2024-03-30T15:00:09.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:09.722+0000 7fd6d259c700 1 --2- 172.21.15.72:0/3595630654 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6d41023d0 0x7fd6d4197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T15:00:09.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:09.722+0000 7fd6d359e700 1 --2- 172.21.15.72:0/3595630654 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6d4102d70 0x7fd6d419eff0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc00b070 tx=0x7fd6cc004c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:00:09.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:09.722+0000 7fd6bbfff700 1 -- 172.21.15.72:0/3595630654 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc01f030 con 0x7fd6d4102d70 2024-03-30T15:00:09.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:09.722+0000 7fd6bbfff700 1 -- 172.21.15.72:0/3595630654 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7fd6cc003a00 con 0x7fd6d4102d70 2024-03-30T15:00:09.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:09.722+0000 7fd6d9194700 1 -- 172.21.15.72:0/3595630654 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6d419f920 con 0x7fd6d4102d70 2024-03-30T15:00:09.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:09.722+0000 7fd6bbfff700 1 -- 172.21.15.72:0/3595630654 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc004510 con 0x7fd6d4102d70 2024-03-30T15:00:09.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:09.722+0000 7fd6d9194700 1 -- 172.21.15.72:0/3595630654 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6d419fd70 con 0x7fd6d4102d70 2024-03-30T15:00:09.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:09.722+0000 7fd6d9194700 1 -- 172.21.15.72:0/3595630654 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6d404ff00 con 0x7fd6d4102d70 2024-03-30T15:00:09.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:09.722+0000 7fd6bbfff700 1 -- 172.21.15.72:0/3595630654 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 14) ==== 91718+0+0 (secure 0 0 0) 0x7fd6cc0046b0 con 0x7fd6d4102d70 2024-03-30T15:00:09.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:09.722+0000 7fd6bbfff700 1 --2- 172.21.15.72:0/3595630654 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fd6bc06dac0 0x7fd6bc06ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:00:09.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:09.722+0000 7fd6bbfff700 1 -- 172.21.15.72:0/3595630654 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd6cc00f020 con 0x7fd6d4102d70 2024-03-30T15:00:09.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:09.722+0000 7fd6d2d9d700 1 --2- 172.21.15.72:0/3595630654 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fd6bc06dac0 0x7fd6bc06ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:00:09.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:09.722+0000 7fd6d2d9d700 1 --2- 172.21.15.72:0/3595630654 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fd6bc06dac0 0x7fd6bc06ff80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4009680 tx=0x7fd6c4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:00:09.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:09.726+0000 7fd6bbfff700 1 -- 172.21.15.72:0/3595630654 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fd6cc029020 con 0x7fd6d4102d70 2024-03-30T15:00:09.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:09 smithi072 bash[21573]: cluster 2024-03-30T15:00:07.644389+0000 mgr.y (mgr.14152) 88 : cluster 0 pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:09.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:09 smithi072 bash[28946]: cluster 2024-03-30T15:00:07.644389+0000 mgr.y (mgr.14152) 88 : cluster 0 pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:09.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:09.950+0000 7fd6d9194700 1 -- 172.21.15.72:0/3595630654 --> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fd6d41a0090 con 0x7fd6bc06dac0 2024-03-30T15:00:09.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:09 smithi172 bash[23680]: cluster 2024-03-30T15:00:07.644389+0000 mgr.y (mgr.14152) 88 : cluster 0 pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:10.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:10 smithi072 bash[21573]: audit 2024-03-30T15:00:09.963369+0000 mon.a (mon.0) 289 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T15:00:10.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:10 smithi072 bash[21573]: audit 2024-03-30T15:00:09.967784+0000 mon.a (mon.0) 290 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T15:00:10.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:10 smithi072 bash[21573]: audit 2024-03-30T15:00:09.968957+0000 mon.a (mon.0) 291 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:00:10.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:10 smithi072 bash[28946]: audit 2024-03-30T15:00:09.963369+0000 mon.a (mon.0) 289 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T15:00:10.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:10 smithi072 bash[28946]: audit 2024-03-30T15:00:09.967784+0000 mon.a (mon.0) 290 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T15:00:10.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:10 smithi072 bash[28946]: audit 2024-03-30T15:00:09.968957+0000 mon.a (mon.0) 291 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:00:10.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:10 smithi172 bash[23680]: audit 2024-03-30T15:00:09.963369+0000 mon.a (mon.0) 289 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T15:00:10.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:10 smithi172 bash[23680]: audit 2024-03-30T15:00:09.967784+0000 mon.a (mon.0) 290 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T15:00:10.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:10 smithi172 bash[23680]: audit 2024-03-30T15:00:09.968957+0000 mon.a (mon.0) 291 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:00:11.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:11 smithi072 bash[21573]: cluster 2024-03-30T15:00:09.644707+0000 mgr.y (mgr.14152) 89 : cluster 0 pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:11.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:11 smithi072 bash[21573]: audit 2024-03-30T15:00:09.955634+0000 mgr.y (mgr.14152) 90 : audit 0 from='client.24113 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T15:00:11.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:11 smithi072 bash[28946]: cluster 2024-03-30T15:00:09.644707+0000 mgr.y (mgr.14152) 89 : cluster 0 pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:11.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:11 smithi072 bash[28946]: audit 2024-03-30T15:00:09.955634+0000 mgr.y (mgr.14152) 90 : audit 0 from='client.24113 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T15:00:11.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:11 smithi172 bash[23680]: cluster 2024-03-30T15:00:09.644707+0000 mgr.y (mgr.14152) 89 : cluster 0 pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:11.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:11 smithi172 bash[23680]: audit 2024-03-30T15:00:09.955634+0000 mgr.y (mgr.14152) 90 : audit 0 from='client.24113 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T15:00:13.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:13 smithi072 bash[21573]: cluster 2024-03-30T15:00:11.645117+0000 mgr.y (mgr.14152) 91 : cluster 0 pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:13.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:13 smithi072 bash[28946]: cluster 2024-03-30T15:00:11.645117+0000 mgr.y (mgr.14152) 91 : cluster 0 pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:13.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:13 smithi172 bash[23680]: cluster 2024-03-30T15:00:11.645117+0000 mgr.y (mgr.14152) 91 : cluster 0 pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:15.801 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:15 smithi072 bash[21573]: cluster 2024-03-30T15:00:13.645484+0000 mgr.y (mgr.14152) 92 : cluster 0 pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:15.802 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:15 smithi072 bash[28946]: cluster 2024-03-30T15:00:13.645484+0000 mgr.y (mgr.14152) 92 : cluster 0 pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:15.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:15 smithi172 bash[23680]: cluster 2024-03-30T15:00:13.645484+0000 mgr.y (mgr.14152) 92 : cluster 0 pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:17.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:17 smithi072 bash[21573]: cluster 2024-03-30T15:00:15.645938+0000 mgr.y (mgr.14152) 93 : cluster 0 pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:17.672 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:17 smithi072 bash[28946]: cluster 2024-03-30T15:00:15.645938+0000 mgr.y (mgr.14152) 93 : cluster 0 pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:17.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:17 smithi172 bash[23680]: cluster 2024-03-30T15:00:15.645938+0000 mgr.y (mgr.14152) 93 : cluster 0 pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:18.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:18 smithi072 bash[21573]: audit 2024-03-30T15:00:18.252970+0000 mon.c (mon.2) 4 : audit 1 from='client.? 172.21.15.72:0/364186049' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e65f2e8f-f022-4766-9e3f-58124e5372ee"}]: dispatch 2024-03-30T15:00:18.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:18 smithi072 bash[21573]: audit 2024-03-30T15:00:18.253828+0000 mon.a (mon.0) 292 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e65f2e8f-f022-4766-9e3f-58124e5372ee"}]: dispatch 2024-03-30T15:00:18.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:18 smithi072 bash[21573]: audit 2024-03-30T15:00:18.256616+0000 mon.a (mon.0) 293 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e65f2e8f-f022-4766-9e3f-58124e5372ee"}]': finished 2024-03-30T15:00:18.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:18 smithi072 bash[21573]: cluster 2024-03-30T15:00:18.259967+0000 mon.a (mon.0) 294 : cluster 0 osdmap e5: 1 total, 0 up, 1 in 2024-03-30T15:00:18.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:18 smithi072 bash[21573]: audit 2024-03-30T15:00:18.260216+0000 mon.a (mon.0) 295 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T15:00:18.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:18 smithi072 bash[28946]: audit 2024-03-30T15:00:18.252970+0000 mon.c (mon.2) 4 : audit 1 from='client.? 172.21.15.72:0/364186049' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e65f2e8f-f022-4766-9e3f-58124e5372ee"}]: dispatch 2024-03-30T15:00:18.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:18 smithi072 bash[28946]: audit 2024-03-30T15:00:18.253828+0000 mon.a (mon.0) 292 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e65f2e8f-f022-4766-9e3f-58124e5372ee"}]: dispatch 2024-03-30T15:00:18.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:18 smithi072 bash[28946]: audit 2024-03-30T15:00:18.256616+0000 mon.a (mon.0) 293 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e65f2e8f-f022-4766-9e3f-58124e5372ee"}]': finished 2024-03-30T15:00:18.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:18 smithi072 bash[28946]: cluster 2024-03-30T15:00:18.259967+0000 mon.a (mon.0) 294 : cluster 0 osdmap e5: 1 total, 0 up, 1 in 2024-03-30T15:00:18.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:18 smithi072 bash[28946]: audit 2024-03-30T15:00:18.260216+0000 mon.a (mon.0) 295 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T15:00:18.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:18 smithi172 bash[23680]: audit 2024-03-30T15:00:18.252970+0000 mon.c (mon.2) 4 : audit 1 from='client.? 172.21.15.72:0/364186049' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e65f2e8f-f022-4766-9e3f-58124e5372ee"}]: dispatch 2024-03-30T15:00:18.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:18 smithi172 bash[23680]: audit 2024-03-30T15:00:18.253828+0000 mon.a (mon.0) 292 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e65f2e8f-f022-4766-9e3f-58124e5372ee"}]: dispatch 2024-03-30T15:00:18.975 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:18 smithi172 bash[23680]: audit 2024-03-30T15:00:18.256616+0000 mon.a (mon.0) 293 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e65f2e8f-f022-4766-9e3f-58124e5372ee"}]': finished 2024-03-30T15:00:18.975 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:18 smithi172 bash[23680]: cluster 2024-03-30T15:00:18.259967+0000 mon.a (mon.0) 294 : cluster 0 osdmap e5: 1 total, 0 up, 1 in 2024-03-30T15:00:18.975 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:18 smithi172 bash[23680]: audit 2024-03-30T15:00:18.260216+0000 mon.a (mon.0) 295 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T15:00:19.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:19 smithi072 bash[21573]: cluster 2024-03-30T15:00:17.646183+0000 mgr.y (mgr.14152) 94 : cluster 0 pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:19.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:19 smithi072 bash[21573]: audit 2024-03-30T15:00:18.983976+0000 mon.c (mon.2) 5 : audit 0 from='client.? 172.21.15.72:0/3210708081' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T15:00:19.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:19 smithi072 bash[28946]: cluster 2024-03-30T15:00:17.646183+0000 mgr.y (mgr.14152) 94 : cluster 0 pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:19.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:19 smithi072 bash[28946]: audit 2024-03-30T15:00:18.983976+0000 mon.c (mon.2) 5 : audit 0 from='client.? 172.21.15.72:0/3210708081' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T15:00:19.972 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:19 smithi172 bash[23680]: cluster 2024-03-30T15:00:17.646183+0000 mgr.y (mgr.14152) 94 : cluster 0 pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:19.973 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:19 smithi172 bash[23680]: audit 2024-03-30T15:00:18.983976+0000 mon.c (mon.2) 5 : audit 0 from='client.? 172.21.15.72:0/3210708081' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T15:00:21.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:21 smithi072 bash[21573]: cluster 2024-03-30T15:00:19.646531+0000 mgr.y (mgr.14152) 95 : cluster 0 pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:21.970 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:21 smithi072 bash[28946]: cluster 2024-03-30T15:00:19.646531+0000 mgr.y (mgr.14152) 95 : cluster 0 pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:21.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:21 smithi172 bash[23680]: cluster 2024-03-30T15:00:19.646531+0000 mgr.y (mgr.14152) 95 : cluster 0 pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:23.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:23 smithi072 bash[21573]: cluster 2024-03-30T15:00:21.646925+0000 mgr.y (mgr.14152) 96 : cluster 0 pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:23.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:23 smithi072 bash[28946]: cluster 2024-03-30T15:00:21.646925+0000 mgr.y (mgr.14152) 96 : cluster 0 pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:23.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:23 smithi172 bash[23680]: cluster 2024-03-30T15:00:21.646925+0000 mgr.y (mgr.14152) 96 : cluster 0 pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:25.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:25 smithi072 bash[21573]: cluster 2024-03-30T15:00:23.647349+0000 mgr.y (mgr.14152) 97 : cluster 0 pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:25.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:25 smithi072 bash[28946]: cluster 2024-03-30T15:00:23.647349+0000 mgr.y (mgr.14152) 97 : cluster 0 pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:25.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:25 smithi172 bash[23680]: cluster 2024-03-30T15:00:23.647349+0000 mgr.y (mgr.14152) 97 : cluster 0 pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:27.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:27 smithi072 bash[21573]: cluster 2024-03-30T15:00:25.647757+0000 mgr.y (mgr.14152) 98 : cluster 0 pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:27.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:27 smithi072 bash[28946]: cluster 2024-03-30T15:00:25.647757+0000 mgr.y (mgr.14152) 98 : cluster 0 pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:27.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:27 smithi172 bash[23680]: cluster 2024-03-30T15:00:25.647757+0000 mgr.y (mgr.14152) 98 : cluster 0 pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:29.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:29 smithi072 bash[28946]: cluster 2024-03-30T15:00:27.648224+0000 mgr.y (mgr.14152) 99 : cluster 0 pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:29.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:29 smithi072 bash[21573]: cluster 2024-03-30T15:00:27.648224+0000 mgr.y (mgr.14152) 99 : cluster 0 pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:29.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:29 smithi172 bash[23680]: cluster 2024-03-30T15:00:27.648224+0000 mgr.y (mgr.14152) 99 : cluster 0 pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:31.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:31 smithi072 bash[28946]: cluster 2024-03-30T15:00:29.648527+0000 mgr.y (mgr.14152) 100 : cluster 0 pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:31.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:31 smithi072 bash[28946]: audit 2024-03-30T15:00:30.769609+0000 mon.a (mon.0) 296 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-30T15:00:31.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:31 smithi072 bash[28946]: audit 2024-03-30T15:00:30.771147+0000 mon.a (mon.0) 297 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:00:31.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:31 smithi072 bash[21573]: cluster 2024-03-30T15:00:29.648527+0000 mgr.y (mgr.14152) 100 : cluster 0 pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:31.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:31 smithi072 bash[21573]: audit 2024-03-30T15:00:30.769609+0000 mon.a (mon.0) 296 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-30T15:00:31.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:31 smithi072 bash[21573]: audit 2024-03-30T15:00:30.771147+0000 mon.a (mon.0) 297 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:00:31.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:31 smithi172 bash[23680]: cluster 2024-03-30T15:00:29.648527+0000 mgr.y (mgr.14152) 100 : cluster 0 pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:31.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:31 smithi172 bash[23680]: audit 2024-03-30T15:00:30.769609+0000 mon.a (mon.0) 296 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-30T15:00:31.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:31 smithi172 bash[23680]: audit 2024-03-30T15:00:30.771147+0000 mon.a (mon.0) 297 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:00:32.898 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:32 smithi072 bash[21573]: cephadm 2024-03-30T15:00:30.772649+0000 mgr.y (mgr.14152) 101 : cephadm 1 Deploying daemon osd.0 on smithi072 2024-03-30T15:00:32.898 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:32 smithi072 bash[28946]: cephadm 2024-03-30T15:00:30.772649+0000 mgr.y (mgr.14152) 101 : cephadm 1 Deploying daemon osd.0 on smithi072 2024-03-30T15:00:32.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:32 smithi172 bash[23680]: cephadm 2024-03-30T15:00:30.772649+0000 mgr.y (mgr.14152) 101 : cephadm 1 Deploying daemon osd.0 on smithi072 2024-03-30T15:00:33.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:33 smithi072 bash[28946]: cluster 2024-03-30T15:00:31.648936+0000 mgr.y (mgr.14152) 102 : cluster 0 pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:33.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:33 smithi072 bash[21573]: cluster 2024-03-30T15:00:31.648936+0000 mgr.y (mgr.14152) 102 : cluster 0 pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:33.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:33 smithi172 bash[23680]: cluster 2024-03-30T15:00:31.648936+0000 mgr.y (mgr.14152) 102 : cluster 0 pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:35.035 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:00:34 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:00:35.035 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:34 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:00:35.036 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:34 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:00:35.315 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:00:35 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:00:35.315 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:35 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:00:35.315 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:35 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:00:35.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:35 smithi072 bash[21573]: cluster 2024-03-30T15:00:33.649266+0000 mgr.y (mgr.14152) 103 : cluster 0 pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:35.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:35 smithi072 bash[21573]: audit 2024-03-30T15:00:35.310228+0000 mon.a (mon.0) 298 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:00:35.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:35 smithi072 bash[21573]: audit 2024-03-30T15:00:35.315316+0000 mon.a (mon.0) 299 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:00:35.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:35 smithi072 bash[21573]: audit 2024-03-30T15:00:35.353791+0000 mon.a (mon.0) 300 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:00:35.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:35 smithi072 bash[28946]: cluster 2024-03-30T15:00:33.649266+0000 mgr.y (mgr.14152) 103 : cluster 0 pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:35.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:35 smithi072 bash[28946]: audit 2024-03-30T15:00:35.310228+0000 mon.a (mon.0) 298 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:00:35.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:35 smithi072 bash[28946]: audit 2024-03-30T15:00:35.315316+0000 mon.a (mon.0) 299 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:00:35.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:35 smithi072 bash[28946]: audit 2024-03-30T15:00:35.353791+0000 mon.a (mon.0) 300 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:00:35.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:35 smithi172 bash[23680]: cluster 2024-03-30T15:00:33.649266+0000 mgr.y (mgr.14152) 103 : cluster 0 pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:35.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:35 smithi172 bash[23680]: audit 2024-03-30T15:00:35.310228+0000 mon.a (mon.0) 298 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:00:35.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:35 smithi172 bash[23680]: audit 2024-03-30T15:00:35.315316+0000 mon.a (mon.0) 299 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:00:35.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:35 smithi172 bash[23680]: audit 2024-03-30T15:00:35.353791+0000 mon.a (mon.0) 300 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:00:37.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:37 smithi072 bash[21573]: cluster 2024-03-30T15:00:35.649527+0000 mgr.y (mgr.14152) 104 : cluster 0 pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:37.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:37 smithi072 bash[28946]: cluster 2024-03-30T15:00:35.649527+0000 mgr.y (mgr.14152) 104 : cluster 0 pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:37.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:37 smithi172 bash[23680]: cluster 2024-03-30T15:00:35.649527+0000 mgr.y (mgr.14152) 104 : cluster 0 pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:39.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:39 smithi072 bash[21573]: cluster 2024-03-30T15:00:37.649862+0000 mgr.y (mgr.14152) 105 : cluster 0 pgmap v67: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:39.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:39 smithi072 bash[28946]: cluster 2024-03-30T15:00:37.649862+0000 mgr.y (mgr.14152) 105 : cluster 0 pgmap v67: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:39.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:39 smithi172 bash[23680]: cluster 2024-03-30T15:00:37.649862+0000 mgr.y (mgr.14152) 105 : cluster 0 pgmap v67: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:41.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:41 smithi072 bash[21573]: cluster 2024-03-30T15:00:39.650324+0000 mgr.y (mgr.14152) 106 : cluster 0 pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:41.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:41 smithi072 bash[21573]: audit 2024-03-30T15:00:40.638772+0000 mon.a (mon.0) 301 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:00:41.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:41 smithi072 bash[21573]: audit 2024-03-30T15:00:40.644022+0000 mon.a (mon.0) 302 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:00:41.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:41 smithi072 bash[21573]: audit 2024-03-30T15:00:41.264724+0000 mon.a (mon.0) 303 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:00:41.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:41 smithi072 bash[21573]: audit 2024-03-30T15:00:41.265450+0000 mon.a (mon.0) 304 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:00:41.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:41 smithi072 bash[21573]: audit 2024-03-30T15:00:41.270222+0000 mon.a (mon.0) 305 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:00:41.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:41 smithi072 bash[28946]: cluster 2024-03-30T15:00:39.650324+0000 mgr.y (mgr.14152) 106 : cluster 0 pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:41.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:41 smithi072 bash[28946]: audit 2024-03-30T15:00:40.638772+0000 mon.a (mon.0) 301 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:00:41.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:41 smithi072 bash[28946]: audit 2024-03-30T15:00:40.644022+0000 mon.a (mon.0) 302 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:00:41.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:41 smithi072 bash[28946]: audit 2024-03-30T15:00:41.264724+0000 mon.a (mon.0) 303 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:00:41.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:41 smithi072 bash[28946]: audit 2024-03-30T15:00:41.265450+0000 mon.a (mon.0) 304 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:00:41.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:41 smithi072 bash[28946]: audit 2024-03-30T15:00:41.270222+0000 mon.a (mon.0) 305 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:00:41.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:41 smithi172 bash[23680]: cluster 2024-03-30T15:00:39.650324+0000 mgr.y (mgr.14152) 106 : cluster 0 pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:41.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:41 smithi172 bash[23680]: audit 2024-03-30T15:00:40.638772+0000 mon.a (mon.0) 301 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:00:41.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:41 smithi172 bash[23680]: audit 2024-03-30T15:00:40.644022+0000 mon.a (mon.0) 302 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:00:41.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:41 smithi172 bash[23680]: audit 2024-03-30T15:00:41.264724+0000 mon.a (mon.0) 303 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:00:41.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:41 smithi172 bash[23680]: audit 2024-03-30T15:00:41.265450+0000 mon.a (mon.0) 304 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:00:41.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:41 smithi172 bash[23680]: audit 2024-03-30T15:00:41.270222+0000 mon.a (mon.0) 305 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:00:42.865 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:42 smithi072 bash[21573]: audit 2024-03-30T15:00:41.838597+0000 mon.c (mon.2) 6 : audit 1 from='osd.0 [v2:172.21.15.72:6802/1463362008,v1:172.21.15.72:6803/1463362008]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-30T15:00:42.865 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:42 smithi072 bash[21573]: audit 2024-03-30T15:00:41.838994+0000 mon.a (mon.0) 306 : audit 1 from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-30T15:00:42.866 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:42 smithi072 bash[28946]: audit 2024-03-30T15:00:41.838597+0000 mon.c (mon.2) 6 : audit 1 from='osd.0 [v2:172.21.15.72:6802/1463362008,v1:172.21.15.72:6803/1463362008]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-30T15:00:42.866 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:42 smithi072 bash[28946]: audit 2024-03-30T15:00:41.838994+0000 mon.a (mon.0) 306 : audit 1 from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-30T15:00:42.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:42 smithi172 bash[23680]: audit 2024-03-30T15:00:41.838597+0000 mon.c (mon.2) 6 : audit 1 from='osd.0 [v2:172.21.15.72:6802/1463362008,v1:172.21.15.72:6803/1463362008]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-30T15:00:42.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:42 smithi172 bash[23680]: audit 2024-03-30T15:00:41.838994+0000 mon.a (mon.0) 306 : audit 1 from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-30T15:00:43.677 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:43 smithi072 bash[21573]: cluster 2024-03-30T15:00:41.650748+0000 mgr.y (mgr.14152) 107 : cluster 0 pgmap v69: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:43.677 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:43 smithi072 bash[21573]: audit 2024-03-30T15:00:42.606419+0000 mon.a (mon.0) 307 : audit 1 from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-30T15:00:43.677 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:43 smithi072 bash[21573]: cluster 2024-03-30T15:00:42.611306+0000 mon.a (mon.0) 308 : cluster 0 osdmap e6: 1 total, 0 up, 1 in 2024-03-30T15:00:43.677 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:43 smithi072 bash[21573]: audit 2024-03-30T15:00:42.611752+0000 mon.a (mon.0) 309 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T15:00:43.677 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:43 smithi072 bash[21573]: audit 2024-03-30T15:00:42.611914+0000 mon.c (mon.2) 7 : audit 1 from='osd.0 [v2:172.21.15.72:6802/1463362008,v1:172.21.15.72:6803/1463362008]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-03-30T15:00:43.677 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:43 smithi072 bash[21573]: audit 2024-03-30T15:00:42.612778+0000 mon.a (mon.0) 310 : audit 1 from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-03-30T15:00:43.677 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:43 smithi072 bash[28946]: cluster 2024-03-30T15:00:41.650748+0000 mgr.y (mgr.14152) 107 : cluster 0 pgmap v69: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:43.678 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:43 smithi072 bash[28946]: audit 2024-03-30T15:00:42.606419+0000 mon.a (mon.0) 307 : audit 1 from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-30T15:00:43.678 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:43 smithi072 bash[28946]: cluster 2024-03-30T15:00:42.611306+0000 mon.a (mon.0) 308 : cluster 0 osdmap e6: 1 total, 0 up, 1 in 2024-03-30T15:00:43.678 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:43 smithi072 bash[28946]: audit 2024-03-30T15:00:42.611752+0000 mon.a (mon.0) 309 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T15:00:43.678 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:43 smithi072 bash[28946]: audit 2024-03-30T15:00:42.611914+0000 mon.c (mon.2) 7 : audit 1 from='osd.0 [v2:172.21.15.72:6802/1463362008,v1:172.21.15.72:6803/1463362008]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-03-30T15:00:43.678 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:43 smithi072 bash[28946]: audit 2024-03-30T15:00:42.612778+0000 mon.a (mon.0) 310 : audit 1 from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-03-30T15:00:43.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:43 smithi172 bash[23680]: cluster 2024-03-30T15:00:41.650748+0000 mgr.y (mgr.14152) 107 : cluster 0 pgmap v69: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:43.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:43 smithi172 bash[23680]: audit 2024-03-30T15:00:42.606419+0000 mon.a (mon.0) 307 : audit 1 from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-30T15:00:43.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:43 smithi172 bash[23680]: cluster 2024-03-30T15:00:42.611306+0000 mon.a (mon.0) 308 : cluster 0 osdmap e6: 1 total, 0 up, 1 in 2024-03-30T15:00:43.972 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:43 smithi172 bash[23680]: audit 2024-03-30T15:00:42.611752+0000 mon.a (mon.0) 309 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T15:00:43.972 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:43 smithi172 bash[23680]: audit 2024-03-30T15:00:42.611914+0000 mon.c (mon.2) 7 : audit 1 from='osd.0 [v2:172.21.15.72:6802/1463362008,v1:172.21.15.72:6803/1463362008]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-03-30T15:00:43.972 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:43 smithi172 bash[23680]: audit 2024-03-30T15:00:42.612778+0000 mon.a (mon.0) 310 : audit 1 from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-03-30T15:00:44.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:44.318+0000 7fd6bbfff700 1 -- 172.21.15.72:0/3595630654 <== mgr.14152 v2:172.21.15.72:6800/2777002311 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd6d41a0090 con 0x7fd6bc06dac0 2024-03-30T15:00:44.321 INFO:teuthology.orchestra.run.smithi072.stdout:Created osd(s) 0 on host 'smithi072' 2024-03-30T15:00:44.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:44.318+0000 7fd6d9194700 1 -- 172.21.15.72:0/3595630654 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fd6bc06dac0 msgr2=0x7fd6bc06ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:00:44.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:44.318+0000 7fd6d9194700 1 --2- 172.21.15.72:0/3595630654 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fd6bc06dac0 0x7fd6bc06ff80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4009680 tx=0x7fd6c4009260 comp rx=0 tx=0).stop 2024-03-30T15:00:44.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:44.318+0000 7fd6d9194700 1 -- 172.21.15.72:0/3595630654 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6d4102d70 msgr2=0x7fd6d419eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:00:44.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:44.318+0000 7fd6d9194700 1 --2- 172.21.15.72:0/3595630654 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6d4102d70 0x7fd6d419eff0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc00b070 tx=0x7fd6cc004c80 comp rx=0 tx=0).stop 2024-03-30T15:00:44.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:44.322+0000 7fd6d9194700 1 -- 172.21.15.72:0/3595630654 shutdown_connections 2024-03-30T15:00:44.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:44.322+0000 7fd6d9194700 1 --2- 172.21.15.72:0/3595630654 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fd6bc06dac0 0x7fd6bc06ff80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:00:44.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:44.322+0000 7fd6d9194700 1 --2- 172.21.15.72:0/3595630654 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6d4102d70 0x7fd6d419eff0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:00:44.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:44.322+0000 7fd6d9194700 1 --2- 172.21.15.72:0/3595630654 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6d41011d0 0x7fd6d4197a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:00:44.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:44.322+0000 7fd6d9194700 1 --2- 172.21.15.72:0/3595630654 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6d41023d0 0x7fd6d4197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:00:44.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:44.322+0000 7fd6d9194700 1 -- 172.21.15.72:0/3595630654 >> 172.21.15.72:0/3595630654 conn(0x7fd6d40fc790 msgr2=0x7fd6d40fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:00:44.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:44.322+0000 7fd6d9194700 1 -- 172.21.15.72:0/3595630654 shutdown_connections 2024-03-30T15:00:44.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:00:44.322+0000 7fd6d9194700 1 -- 172.21.15.72:0/3595630654 wait complete. 2024-03-30T15:00:44.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:44 smithi072 bash[21573]: audit 2024-03-30T15:00:43.608560+0000 mon.a (mon.0) 311 : audit 1 from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]': finished 2024-03-30T15:00:44.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:44 smithi072 bash[21573]: cluster 2024-03-30T15:00:43.613385+0000 mon.a (mon.0) 312 : cluster 0 osdmap e7: 1 total, 0 up, 1 in 2024-03-30T15:00:44.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:44 smithi072 bash[21573]: audit 2024-03-30T15:00:43.614247+0000 mon.a (mon.0) 313 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T15:00:44.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:44 smithi072 bash[21573]: audit 2024-03-30T15:00:43.624227+0000 mon.a (mon.0) 314 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T15:00:44.923 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:44 smithi072 bash[21573]: cluster 2024-03-30T15:00:43.651061+0000 mgr.y (mgr.14152) 108 : cluster 0 pgmap v72: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:44.923 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:44 smithi072 bash[21573]: audit 2024-03-30T15:00:44.129320+0000 mon.a (mon.0) 315 : audit 1 from='osd.0 ' entity='osd.0' 2024-03-30T15:00:44.923 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:44 smithi072 bash[21573]: audit 2024-03-30T15:00:44.262814+0000 mon.a (mon.0) 316 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:00:44.923 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:44 smithi072 bash[21573]: audit 2024-03-30T15:00:44.272406+0000 mon.a (mon.0) 317 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:00:44.923 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:44 smithi072 bash[21573]: audit 2024-03-30T15:00:44.290693+0000 mon.a (mon.0) 318 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:00:44.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:44 smithi072 bash[28946]: audit 2024-03-30T15:00:43.608560+0000 mon.a (mon.0) 311 : audit 1 from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]': finished 2024-03-30T15:00:44.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:44 smithi072 bash[28946]: cluster 2024-03-30T15:00:43.613385+0000 mon.a (mon.0) 312 : cluster 0 osdmap e7: 1 total, 0 up, 1 in 2024-03-30T15:00:44.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:44 smithi072 bash[28946]: audit 2024-03-30T15:00:43.614247+0000 mon.a (mon.0) 313 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T15:00:44.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:44 smithi072 bash[28946]: audit 2024-03-30T15:00:43.624227+0000 mon.a (mon.0) 314 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T15:00:44.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:44 smithi072 bash[28946]: cluster 2024-03-30T15:00:43.651061+0000 mgr.y (mgr.14152) 108 : cluster 0 pgmap v72: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:44.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:44 smithi072 bash[28946]: audit 2024-03-30T15:00:44.129320+0000 mon.a (mon.0) 315 : audit 1 from='osd.0 ' entity='osd.0' 2024-03-30T15:00:44.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:44 smithi072 bash[28946]: audit 2024-03-30T15:00:44.262814+0000 mon.a (mon.0) 316 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:00:44.924 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:44 smithi072 bash[28946]: audit 2024-03-30T15:00:44.272406+0000 mon.a (mon.0) 317 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:00:44.924 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:44 smithi072 bash[28946]: audit 2024-03-30T15:00:44.290693+0000 mon.a (mon.0) 318 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:00:44.932 DEBUG:teuthology.orchestra.run.smithi072:osd.0> sudo journalctl -f -n 0 -u ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@osd.0.service 2024-03-30T15:00:44.934 INFO:tasks.cephadm:Deploying osd.1 on smithi072 with /dev/vg_nvme/lv_3... 2024-03-30T15:00:44.935 DEBUG:teuthology.orchestra.run.smithi072:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-03-30T15:00:44.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:44 smithi172 bash[23680]: audit 2024-03-30T15:00:43.608560+0000 mon.a (mon.0) 311 : audit 1 from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]': finished 2024-03-30T15:00:44.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:44 smithi172 bash[23680]: cluster 2024-03-30T15:00:43.613385+0000 mon.a (mon.0) 312 : cluster 0 osdmap e7: 1 total, 0 up, 1 in 2024-03-30T15:00:44.972 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:44 smithi172 bash[23680]: audit 2024-03-30T15:00:43.614247+0000 mon.a (mon.0) 313 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T15:00:44.972 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:44 smithi172 bash[23680]: audit 2024-03-30T15:00:43.624227+0000 mon.a (mon.0) 314 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T15:00:44.972 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:44 smithi172 bash[23680]: cluster 2024-03-30T15:00:43.651061+0000 mgr.y (mgr.14152) 108 : cluster 0 pgmap v72: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T15:00:44.972 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:44 smithi172 bash[23680]: audit 2024-03-30T15:00:44.129320+0000 mon.a (mon.0) 315 : audit 1 from='osd.0 ' entity='osd.0' 2024-03-30T15:00:44.972 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:44 smithi172 bash[23680]: audit 2024-03-30T15:00:44.262814+0000 mon.a (mon.0) 316 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:00:44.972 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:44 smithi172 bash[23680]: audit 2024-03-30T15:00:44.272406+0000 mon.a (mon.0) 317 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:00:44.972 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:44 smithi172 bash[23680]: audit 2024-03-30T15:00:44.290693+0000 mon.a (mon.0) 318 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:00:45.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:45 smithi072 bash[21573]: cluster 2024-03-30T15:00:42.799189+0000 osd.0 (osd.0) 1 : cluster 0 purged_snaps scrub starts 2024-03-30T15:00:45.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:45 smithi072 bash[21573]: cluster 2024-03-30T15:00:42.799270+0000 osd.0 (osd.0) 2 : cluster 0 purged_snaps scrub ok 2024-03-30T15:00:45.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:45 smithi072 bash[21573]: audit 2024-03-30T15:00:44.623144+0000 mon.a (mon.0) 319 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T15:00:45.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:45 smithi072 bash[21573]: cluster 2024-03-30T15:00:45.134524+0000 mon.a (mon.0) 320 : cluster 1 osd.0 [v2:172.21.15.72:6802/1463362008,v1:172.21.15.72:6803/1463362008] boot 2024-03-30T15:00:45.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:45 smithi072 bash[21573]: cluster 2024-03-30T15:00:45.134619+0000 mon.a (mon.0) 321 : cluster 0 osdmap e8: 1 total, 1 up, 1 in 2024-03-30T15:00:45.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:45 smithi072 bash[21573]: audit 2024-03-30T15:00:45.134782+0000 mon.a (mon.0) 322 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T15:00:45.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:45 smithi072 bash[28946]: cluster 2024-03-30T15:00:42.799189+0000 osd.0 (osd.0) 1 : cluster 0 purged_snaps scrub starts 2024-03-30T15:00:45.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:45 smithi072 bash[28946]: cluster 2024-03-30T15:00:42.799270+0000 osd.0 (osd.0) 2 : cluster 0 purged_snaps scrub ok 2024-03-30T15:00:45.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:45 smithi072 bash[28946]: audit 2024-03-30T15:00:44.623144+0000 mon.a (mon.0) 319 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T15:00:45.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:45 smithi072 bash[28946]: cluster 2024-03-30T15:00:45.134524+0000 mon.a (mon.0) 320 : cluster 1 osd.0 [v2:172.21.15.72:6802/1463362008,v1:172.21.15.72:6803/1463362008] boot 2024-03-30T15:00:45.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:45 smithi072 bash[28946]: cluster 2024-03-30T15:00:45.134619+0000 mon.a (mon.0) 321 : cluster 0 osdmap e8: 1 total, 1 up, 1 in 2024-03-30T15:00:45.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:45 smithi072 bash[28946]: audit 2024-03-30T15:00:45.134782+0000 mon.a (mon.0) 322 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T15:00:45.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:45 smithi172 bash[23680]: cluster 2024-03-30T15:00:42.799189+0000 osd.0 (osd.0) 1 : cluster 0 purged_snaps scrub starts 2024-03-30T15:00:45.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:45 smithi172 bash[23680]: cluster 2024-03-30T15:00:42.799270+0000 osd.0 (osd.0) 2 : cluster 0 purged_snaps scrub ok 2024-03-30T15:00:45.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:45 smithi172 bash[23680]: audit 2024-03-30T15:00:44.623144+0000 mon.a (mon.0) 319 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T15:00:45.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:45 smithi172 bash[23680]: cluster 2024-03-30T15:00:45.134524+0000 mon.a (mon.0) 320 : cluster 1 osd.0 [v2:172.21.15.72:6802/1463362008,v1:172.21.15.72:6803/1463362008] boot 2024-03-30T15:00:45.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:45 smithi172 bash[23680]: cluster 2024-03-30T15:00:45.134619+0000 mon.a (mon.0) 321 : cluster 0 osdmap e8: 1 total, 1 up, 1 in 2024-03-30T15:00:45.972 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:45 smithi172 bash[23680]: audit 2024-03-30T15:00:45.134782+0000 mon.a (mon.0) 322 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T15:00:46.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:46 smithi072 bash[21573]: cluster 2024-03-30T15:00:45.651514+0000 mgr.y (mgr.14152) 109 : cluster 0 pgmap v74: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:00:46.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:46 smithi072 bash[28946]: cluster 2024-03-30T15:00:45.651514+0000 mgr.y (mgr.14152) 109 : cluster 0 pgmap v74: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:00:46.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:46 smithi172 bash[23680]: cluster 2024-03-30T15:00:45.651514+0000 mgr.y (mgr.14152) 109 : cluster 0 pgmap v74: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:00:47.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:47 smithi072 bash[21573]: cluster 2024-03-30T15:00:46.643379+0000 mon.a (mon.0) 323 : cluster 0 osdmap e9: 1 total, 1 up, 1 in 2024-03-30T15:00:47.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:47 smithi072 bash[28946]: cluster 2024-03-30T15:00:46.643379+0000 mon.a (mon.0) 323 : cluster 0 osdmap e9: 1 total, 1 up, 1 in 2024-03-30T15:00:47.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:47 smithi172 bash[23680]: cluster 2024-03-30T15:00:46.643379+0000 mon.a (mon.0) 323 : cluster 0 osdmap e9: 1 total, 1 up, 1 in 2024-03-30T15:00:48.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:48 smithi072 bash[21573]: cluster 2024-03-30T15:00:47.651908+0000 mgr.y (mgr.14152) 110 : cluster 0 pgmap v76: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:00:48.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:48 smithi072 bash[28946]: cluster 2024-03-30T15:00:47.651908+0000 mgr.y (mgr.14152) 110 : cluster 0 pgmap v76: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:00:48.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:48 smithi172 bash[23680]: cluster 2024-03-30T15:00:47.651908+0000 mgr.y (mgr.14152) 110 : cluster 0 pgmap v76: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:00:49.251 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T15:00:50.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:50 smithi172 bash[23680]: cluster 2024-03-30T15:00:49.652361+0000 mgr.y (mgr.14152) 111 : cluster 0 pgmap v77: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:00:51.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:50 smithi072 bash[21573]: cluster 2024-03-30T15:00:49.652361+0000 mgr.y (mgr.14152) 111 : cluster 0 pgmap v77: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:00:51.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:50 smithi072 bash[28946]: cluster 2024-03-30T15:00:49.652361+0000 mgr.y (mgr.14152) 111 : cluster 0 pgmap v77: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:00:52.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:52 smithi172 bash[23680]: cluster 2024-03-30T15:00:51.652781+0000 mgr.y (mgr.14152) 112 : cluster 0 pgmap v78: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:00:53.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:52 smithi072 bash[21573]: cluster 2024-03-30T15:00:51.652781+0000 mgr.y (mgr.14152) 112 : cluster 0 pgmap v78: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:00:53.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:52 smithi072 bash[28946]: cluster 2024-03-30T15:00:51.652781+0000 mgr.y (mgr.14152) 112 : cluster 0 pgmap v78: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:00:53.398 INFO:teuthology.orchestra.run.smithi072.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-03-30T15:00:53.399 INFO:teuthology.orchestra.run.smithi072.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-03-30T15:00:53.399 INFO:teuthology.orchestra.run.smithi072.stderr: stderr: 10+0 records in 2024-03-30T15:00:53.399 INFO:teuthology.orchestra.run.smithi072.stderr:10+0 records out 2024-03-30T15:00:53.399 INFO:teuthology.orchestra.run.smithi072.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0140897 s, 744 MB/s 2024-03-30T15:00:53.399 INFO:teuthology.orchestra.run.smithi072.stderr:--> Zapping successful for: 2024-03-30T15:00:54.253 DEBUG:teuthology.orchestra.run.smithi072:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi072:vg_nvme/lv_3 2024-03-30T15:00:54.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:54 smithi172 bash[23680]: cluster 2024-03-30T15:00:53.653124+0000 mgr.y (mgr.14152) 113 : cluster 0 pgmap v79: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:00:54.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:54 smithi172 bash[23680]: audit 2024-03-30T15:00:54.691199+0000 mon.a (mon.0) 324 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:00:54.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:54 smithi172 bash[23680]: audit 2024-03-30T15:00:54.700205+0000 mon.a (mon.0) 325 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:00:54.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:54 smithi172 bash[23680]: audit 2024-03-30T15:00:54.702549+0000 mon.a (mon.0) 326 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:00:54.972 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:54 smithi172 bash[23680]: audit 2024-03-30T15:00:54.710685+0000 mon.a (mon.0) 327 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:00:55.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:54 smithi072 bash[21573]: cluster 2024-03-30T15:00:53.653124+0000 mgr.y (mgr.14152) 113 : cluster 0 pgmap v79: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:00:55.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:54 smithi072 bash[21573]: audit 2024-03-30T15:00:54.691199+0000 mon.a (mon.0) 324 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:00:55.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:54 smithi072 bash[21573]: audit 2024-03-30T15:00:54.700205+0000 mon.a (mon.0) 325 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:00:55.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:54 smithi072 bash[21573]: audit 2024-03-30T15:00:54.702549+0000 mon.a (mon.0) 326 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:00:55.173 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:54 smithi072 bash[21573]: audit 2024-03-30T15:00:54.710685+0000 mon.a (mon.0) 327 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:00:55.173 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:54 smithi072 bash[28946]: cluster 2024-03-30T15:00:53.653124+0000 mgr.y (mgr.14152) 113 : cluster 0 pgmap v79: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:00:55.174 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:54 smithi072 bash[28946]: audit 2024-03-30T15:00:54.691199+0000 mon.a (mon.0) 324 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:00:55.174 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:54 smithi072 bash[28946]: audit 2024-03-30T15:00:54.700205+0000 mon.a (mon.0) 325 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:00:55.174 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:54 smithi072 bash[28946]: audit 2024-03-30T15:00:54.702549+0000 mon.a (mon.0) 326 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:00:55.174 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:54 smithi072 bash[28946]: audit 2024-03-30T15:00:54.710685+0000 mon.a (mon.0) 327 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:00:55.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:55 smithi172 bash[23680]: cephadm 2024-03-30T15:00:54.682413+0000 mgr.y (mgr.14152) 114 : cephadm 1 Detected new or changed devices on smithi072 2024-03-30T15:00:55.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:55 smithi172 bash[23680]: cephadm 2024-03-30T15:00:54.704035+0000 mgr.y (mgr.14152) 115 : cephadm 1 Adjusting osd_memory_target on smithi072 to 16241M 2024-03-30T15:00:55.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:55 smithi172 bash[23680]: audit 2024-03-30T15:00:54.721856+0000 mon.a (mon.0) 328 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:00:55.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:55 smithi172 bash[23680]: audit 2024-03-30T15:00:54.723726+0000 mon.a (mon.0) 329 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:00:55.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:55 smithi172 bash[23680]: audit 2024-03-30T15:00:54.733447+0000 mon.a (mon.0) 330 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:00:56.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:55 smithi072 bash[21573]: cephadm 2024-03-30T15:00:54.682413+0000 mgr.y (mgr.14152) 114 : cephadm 1 Detected new or changed devices on smithi072 2024-03-30T15:00:56.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:55 smithi072 bash[21573]: cephadm 2024-03-30T15:00:54.704035+0000 mgr.y (mgr.14152) 115 : cephadm 1 Adjusting osd_memory_target on smithi072 to 16241M 2024-03-30T15:00:56.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:55 smithi072 bash[21573]: audit 2024-03-30T15:00:54.721856+0000 mon.a (mon.0) 328 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:00:56.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:55 smithi072 bash[21573]: audit 2024-03-30T15:00:54.723726+0000 mon.a (mon.0) 329 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:00:56.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:55 smithi072 bash[21573]: audit 2024-03-30T15:00:54.733447+0000 mon.a (mon.0) 330 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:00:56.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:55 smithi072 bash[28946]: cephadm 2024-03-30T15:00:54.682413+0000 mgr.y (mgr.14152) 114 : cephadm 1 Detected new or changed devices on smithi072 2024-03-30T15:00:56.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:55 smithi072 bash[28946]: cephadm 2024-03-30T15:00:54.704035+0000 mgr.y (mgr.14152) 115 : cephadm 1 Adjusting osd_memory_target on smithi072 to 16241M 2024-03-30T15:00:56.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:55 smithi072 bash[28946]: audit 2024-03-30T15:00:54.721856+0000 mon.a (mon.0) 328 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:00:56.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:55 smithi072 bash[28946]: audit 2024-03-30T15:00:54.723726+0000 mon.a (mon.0) 329 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:00:56.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:55 smithi072 bash[28946]: audit 2024-03-30T15:00:54.733447+0000 mon.a (mon.0) 330 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:00:57.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:56 smithi072 bash[21573]: cluster 2024-03-30T15:00:55.653535+0000 mgr.y (mgr.14152) 116 : cluster 0 pgmap v80: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:00:57.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:56 smithi072 bash[28946]: cluster 2024-03-30T15:00:55.653535+0000 mgr.y (mgr.14152) 116 : cluster 0 pgmap v80: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:00:57.221 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:56 smithi172 bash[23680]: cluster 2024-03-30T15:00:55.653535+0000 mgr.y (mgr.14152) 116 : cluster 0 pgmap v80: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:00:58.986 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T15:00:59.007 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:00:58 smithi072 bash[21573]: cluster 2024-03-30T15:00:57.654044+0000 mgr.y (mgr.14152) 117 : cluster 0 pgmap v81: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:00:59.007 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:00:58 smithi072 bash[28946]: cluster 2024-03-30T15:00:57.654044+0000 mgr.y (mgr.14152) 117 : cluster 0 pgmap v81: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:00:59.221 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:00:58 smithi172 bash[23680]: cluster 2024-03-30T15:00:57.654044+0000 mgr.y (mgr.14152) 117 : cluster 0 pgmap v81: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:01.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:00 smithi072 bash[28946]: cluster 2024-03-30T15:00:59.654516+0000 mgr.y (mgr.14152) 118 : cluster 0 pgmap v82: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:01.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:00 smithi072 bash[21573]: cluster 2024-03-30T15:00:59.654516+0000 mgr.y (mgr.14152) 118 : cluster 0 pgmap v82: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:01.223 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:00 smithi172 bash[23680]: cluster 2024-03-30T15:00:59.654516+0000 mgr.y (mgr.14152) 118 : cluster 0 pgmap v82: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:01.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:01.617+0000 7fc1bc331700 1 -- 172.21.15.72:0/3967682241 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1b4102e10 msgr2=0x7fc1b4105200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:01:01.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:01.617+0000 7fc1bc331700 1 --2- 172.21.15.72:0/3967682241 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1b4102e10 0x7fc1b4105200 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac00b0a0 tx=0x7fc1ac00b3b0 comp rx=0 tx=0).stop 2024-03-30T15:01:01.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:01.617+0000 7fc1bc331700 1 -- 172.21.15.72:0/3967682241 shutdown_connections 2024-03-30T15:01:01.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:01.617+0000 7fc1bc331700 1 --2- 172.21.15.72:0/3967682241 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1b4108070 0x7fc1b410a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:01:01.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:01.617+0000 7fc1bc331700 1 --2- 172.21.15.72:0/3967682241 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1b4102e10 0x7fc1b4105200 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:01:01.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:01.617+0000 7fc1bc331700 1 --2- 172.21.15.72:0/3967682241 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc1b4105740 0x7fc1b4107b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:01:01.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:01.617+0000 7fc1bc331700 1 -- 172.21.15.72:0/3967682241 >> 172.21.15.72:0/3967682241 conn(0x7fc1b40fc760 msgr2=0x7fc1b40feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:01:01.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:01.617+0000 7fc1bc331700 1 -- 172.21.15.72:0/3967682241 shutdown_connections 2024-03-30T15:01:01.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:01.617+0000 7fc1bc331700 1 -- 172.21.15.72:0/3967682241 wait complete. 2024-03-30T15:01:01.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:01.617+0000 7fc1bc331700 1 Processor -- start 2024-03-30T15:01:01.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:01.617+0000 7fc1bc331700 1 -- start start 2024-03-30T15:01:01.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:01.617+0000 7fc1bc331700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc1b4102e10 0x7fc1b4102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:01:01.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:01.617+0000 7fc1bc331700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1b4105740 0x7fc1b4100dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:01:01.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:01.617+0000 7fc1bc331700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1b4108070 0x7fc1b4101300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:01:01.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:01.617+0000 7fc1bc331700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b410d330 con 0x7fc1b4105740 2024-03-30T15:01:01.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:01.617+0000 7fc1bc331700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b410d1b0 con 0x7fc1b4108070 2024-03-30T15:01:01.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:01.617+0000 7fc1bc331700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fc1b410d4b0 con 0x7fc1b4102e10 2024-03-30T15:01:01.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:01.617+0000 7fc1ba0cd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc1b4102e10 0x7fc1b4102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:01:01.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:01.617+0000 7fc1b98cc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1b4105740 0x7fc1b4100dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:01:01.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:01.617+0000 7fc1ba0cd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc1b4102e10 0x7fc1b4102770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:59904/0 (socket says 172.21.15.72:59904) 2024-03-30T15:01:01.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:01.617+0000 7fc1b98cc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1b4105740 0x7fc1b4100dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58340/0 (socket says 172.21.15.72:58340) 2024-03-30T15:01:01.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:01.617+0000 7fc1ba0cd700 1 -- 172.21.15.72:0/3220886099 learned_addr learned my addr 172.21.15.72:0/3220886099 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T15:01:01.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:01.621+0000 7fc1ba8ce700 1 --2- 172.21.15.72:0/3220886099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1b4108070 0x7fc1b4101300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:01:01.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:01.621+0000 7fc1ba0cd700 1 -- 172.21.15.72:0/3220886099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1b4108070 msgr2=0x7fc1b4101300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:01:01.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:01.621+0000 7fc1ba0cd700 1 --2- 172.21.15.72:0/3220886099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1b4108070 0x7fc1b4101300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:01:01.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:01.621+0000 7fc1ba0cd700 1 -- 172.21.15.72:0/3220886099 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1b4105740 msgr2=0x7fc1b4100dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:01:01.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:01.621+0000 7fc1ba0cd700 1 --2- 172.21.15.72:0/3220886099 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1b4105740 0x7fc1b4100dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:01:01.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:01.621+0000 7fc1ba0cd700 1 -- 172.21.15.72:0/3220886099 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1b4101bb0 con 0x7fc1b4102e10 2024-03-30T15:01:01.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:01.621+0000 7fc1b98cc700 1 --2- 172.21.15.72:0/3220886099 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1b4105740 0x7fc1b4100dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T15:01:01.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:01.621+0000 7fc1ba8ce700 1 --2- 172.21.15.72:0/3220886099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1b4108070 0x7fc1b4101300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T15:01:01.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:01.621+0000 7fc1ba0cd700 1 --2- 172.21.15.72:0/3220886099 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc1b4102e10 0x7fc1b4102770 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac004d00 tx=0x7fc1ac004d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:01:01.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:01.621+0000 7fc1ab7fe700 1 -- 172.21.15.72:0/3220886099 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac021070 con 0x7fc1b4102e10 2024-03-30T15:01:01.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:01.621+0000 7fc1ab7fe700 1 -- 172.21.15.72:0/3220886099 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7fc1ac007b80 con 0x7fc1b4102e10 2024-03-30T15:01:01.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:01.621+0000 7fc1ab7fe700 1 -- 172.21.15.72:0/3220886099 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac01b690 con 0x7fc1b4102e10 2024-03-30T15:01:01.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:01.621+0000 7fc1bc331700 1 -- 172.21.15.72:0/3220886099 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1b41a1b10 con 0x7fc1b4102e10 2024-03-30T15:01:01.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:01.621+0000 7fc1bc331700 1 -- 172.21.15.72:0/3220886099 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1b41a1f10 con 0x7fc1b4102e10 2024-03-30T15:01:01.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:01.621+0000 7fc1bc331700 1 -- 172.21.15.72:0/3220886099 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1b404ff00 con 0x7fc1b4102e10 2024-03-30T15:01:01.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:01.621+0000 7fc1ab7fe700 1 -- 172.21.15.72:0/3220886099 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 14) ==== 91718+0+0 (secure 0 0 0) 0x7fc1ac024070 con 0x7fc1b4102e10 2024-03-30T15:01:01.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:01.621+0000 7fc1ab7fe700 1 --2- 172.21.15.72:0/3220886099 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fc1a006dac0 0x7fc1a006ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:01:01.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:01.621+0000 7fc1ab7fe700 1 -- 172.21.15.72:0/3220886099 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1767+0+0 (secure 0 0 0) 0x7fc1ac00f020 con 0x7fc1b4102e10 2024-03-30T15:01:01.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:01.621+0000 7fc1b98cc700 1 --2- 172.21.15.72:0/3220886099 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fc1a006dac0 0x7fc1a006ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:01:01.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:01.621+0000 7fc1b98cc700 1 --2- 172.21.15.72:0/3220886099 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fc1a006dac0 0x7fc1a006ff80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4009680 tx=0x7fc1a4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:01:01.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:01.629+0000 7fc1ab7fe700 1 -- 172.21.15.72:0/3220886099 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fc1ac05c150 con 0x7fc1b4102e10 2024-03-30T15:01:01.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:01.845+0000 7fc1bc331700 1 -- 172.21.15.72:0/3220886099 --> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fc1b4062680 con 0x7fc1a006dac0 2024-03-30T15:01:03.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:02 smithi072 bash[21573]: cluster 2024-03-30T15:01:01.654835+0000 mgr.y (mgr.14152) 119 : cluster 0 pgmap v83: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:03.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:02 smithi072 bash[21573]: audit 2024-03-30T15:01:01.851946+0000 mgr.y (mgr.14152) 120 : audit 0 from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T15:01:03.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:02 smithi072 bash[21573]: audit 2024-03-30T15:01:01.856054+0000 mon.a (mon.0) 331 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T15:01:03.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:02 smithi072 bash[21573]: audit 2024-03-30T15:01:01.861567+0000 mon.a (mon.0) 332 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T15:01:03.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:02 smithi072 bash[21573]: audit 2024-03-30T15:01:01.862556+0000 mon.a (mon.0) 333 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:01:03.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:02 smithi072 bash[28946]: cluster 2024-03-30T15:01:01.654835+0000 mgr.y (mgr.14152) 119 : cluster 0 pgmap v83: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:03.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:02 smithi072 bash[28946]: audit 2024-03-30T15:01:01.851946+0000 mgr.y (mgr.14152) 120 : audit 0 from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T15:01:03.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:02 smithi072 bash[28946]: audit 2024-03-30T15:01:01.856054+0000 mon.a (mon.0) 331 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T15:01:03.173 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:02 smithi072 bash[28946]: audit 2024-03-30T15:01:01.861567+0000 mon.a (mon.0) 332 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T15:01:03.173 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:02 smithi072 bash[28946]: audit 2024-03-30T15:01:01.862556+0000 mon.a (mon.0) 333 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:01:03.221 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:02 smithi172 bash[23680]: cluster 2024-03-30T15:01:01.654835+0000 mgr.y (mgr.14152) 119 : cluster 0 pgmap v83: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:03.221 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:02 smithi172 bash[23680]: audit 2024-03-30T15:01:01.851946+0000 mgr.y (mgr.14152) 120 : audit 0 from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T15:01:03.221 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:02 smithi172 bash[23680]: audit 2024-03-30T15:01:01.856054+0000 mon.a (mon.0) 331 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T15:01:03.221 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:02 smithi172 bash[23680]: audit 2024-03-30T15:01:01.861567+0000 mon.a (mon.0) 332 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T15:01:03.221 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:02 smithi172 bash[23680]: audit 2024-03-30T15:01:01.862556+0000 mon.a (mon.0) 333 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:01:05.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:04 smithi072 bash[21573]: cluster 2024-03-30T15:01:03.655275+0000 mgr.y (mgr.14152) 121 : cluster 0 pgmap v84: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:05.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:04 smithi072 bash[28946]: cluster 2024-03-30T15:01:03.655275+0000 mgr.y (mgr.14152) 121 : cluster 0 pgmap v84: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:05.221 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:04 smithi172 bash[23680]: cluster 2024-03-30T15:01:03.655275+0000 mgr.y (mgr.14152) 121 : cluster 0 pgmap v84: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:07.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:06 smithi072 bash[21573]: cluster 2024-03-30T15:01:05.655760+0000 mgr.y (mgr.14152) 122 : cluster 0 pgmap v85: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:07.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:06 smithi072 bash[28946]: cluster 2024-03-30T15:01:05.655760+0000 mgr.y (mgr.14152) 122 : cluster 0 pgmap v85: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:07.221 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:06 smithi172 bash[23680]: cluster 2024-03-30T15:01:05.655760+0000 mgr.y (mgr.14152) 122 : cluster 0 pgmap v85: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:08.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:08 smithi072 bash[28946]: cluster 2024-03-30T15:01:07.656230+0000 mgr.y (mgr.14152) 123 : cluster 0 pgmap v86: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:08.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:08 smithi072 bash[21573]: cluster 2024-03-30T15:01:07.656230+0000 mgr.y (mgr.14152) 123 : cluster 0 pgmap v86: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:09.221 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:08 smithi172 bash[23680]: cluster 2024-03-30T15:01:07.656230+0000 mgr.y (mgr.14152) 123 : cluster 0 pgmap v86: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:11.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:10 smithi072 bash[28946]: cluster 2024-03-30T15:01:09.656699+0000 mgr.y (mgr.14152) 124 : cluster 0 pgmap v87: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:11.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:10 smithi072 bash[28946]: audit 2024-03-30T15:01:10.167696+0000 mon.a (mon.0) 334 : audit 1 from='client.? 172.21.15.72:0/575274621' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "276c5ca1-6c16-44aa-aaa2-c0859408d86c"}]: dispatch 2024-03-30T15:01:11.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:10 smithi072 bash[28946]: audit 2024-03-30T15:01:10.170329+0000 mon.a (mon.0) 335 : audit 1 from='client.? 172.21.15.72:0/575274621' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "276c5ca1-6c16-44aa-aaa2-c0859408d86c"}]': finished 2024-03-30T15:01:11.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:10 smithi072 bash[28946]: cluster 2024-03-30T15:01:10.173477+0000 mon.a (mon.0) 336 : cluster 0 osdmap e10: 2 total, 1 up, 2 in 2024-03-30T15:01:11.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:10 smithi072 bash[28946]: audit 2024-03-30T15:01:10.173858+0000 mon.a (mon.0) 337 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T15:01:11.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:10 smithi072 bash[21573]: cluster 2024-03-30T15:01:09.656699+0000 mgr.y (mgr.14152) 124 : cluster 0 pgmap v87: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:11.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:10 smithi072 bash[21573]: audit 2024-03-30T15:01:10.167696+0000 mon.a (mon.0) 334 : audit 1 from='client.? 172.21.15.72:0/575274621' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "276c5ca1-6c16-44aa-aaa2-c0859408d86c"}]: dispatch 2024-03-30T15:01:11.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:10 smithi072 bash[21573]: audit 2024-03-30T15:01:10.170329+0000 mon.a (mon.0) 335 : audit 1 from='client.? 172.21.15.72:0/575274621' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "276c5ca1-6c16-44aa-aaa2-c0859408d86c"}]': finished 2024-03-30T15:01:11.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:10 smithi072 bash[21573]: cluster 2024-03-30T15:01:10.173477+0000 mon.a (mon.0) 336 : cluster 0 osdmap e10: 2 total, 1 up, 2 in 2024-03-30T15:01:11.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:10 smithi072 bash[21573]: audit 2024-03-30T15:01:10.173858+0000 mon.a (mon.0) 337 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T15:01:11.221 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:10 smithi172 bash[23680]: cluster 2024-03-30T15:01:09.656699+0000 mgr.y (mgr.14152) 124 : cluster 0 pgmap v87: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:11.221 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:10 smithi172 bash[23680]: audit 2024-03-30T15:01:10.167696+0000 mon.a (mon.0) 334 : audit 1 from='client.? 172.21.15.72:0/575274621' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "276c5ca1-6c16-44aa-aaa2-c0859408d86c"}]: dispatch 2024-03-30T15:01:11.221 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:10 smithi172 bash[23680]: audit 2024-03-30T15:01:10.170329+0000 mon.a (mon.0) 335 : audit 1 from='client.? 172.21.15.72:0/575274621' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "276c5ca1-6c16-44aa-aaa2-c0859408d86c"}]': finished 2024-03-30T15:01:11.221 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:10 smithi172 bash[23680]: cluster 2024-03-30T15:01:10.173477+0000 mon.a (mon.0) 336 : cluster 0 osdmap e10: 2 total, 1 up, 2 in 2024-03-30T15:01:11.221 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:10 smithi172 bash[23680]: audit 2024-03-30T15:01:10.173858+0000 mon.a (mon.0) 337 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T15:01:12.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:11 smithi072 bash[21573]: audit 2024-03-30T15:01:10.907217+0000 mon.c (mon.2) 8 : audit 0 from='client.? 172.21.15.72:0/4246114389' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T15:01:12.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:11 smithi072 bash[28946]: audit 2024-03-30T15:01:10.907217+0000 mon.c (mon.2) 8 : audit 0 from='client.? 172.21.15.72:0/4246114389' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T15:01:12.221 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:11 smithi172 bash[23680]: audit 2024-03-30T15:01:10.907217+0000 mon.c (mon.2) 8 : audit 0 from='client.? 172.21.15.72:0/4246114389' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T15:01:13.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:12 smithi072 bash[21573]: cluster 2024-03-30T15:01:11.657190+0000 mgr.y (mgr.14152) 125 : cluster 0 pgmap v89: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:13.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:12 smithi072 bash[28946]: cluster 2024-03-30T15:01:11.657190+0000 mgr.y (mgr.14152) 125 : cluster 0 pgmap v89: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:13.221 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:12 smithi172 bash[23680]: cluster 2024-03-30T15:01:11.657190+0000 mgr.y (mgr.14152) 125 : cluster 0 pgmap v89: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:15.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:14 smithi072 bash[21573]: cluster 2024-03-30T15:01:13.657626+0000 mgr.y (mgr.14152) 126 : cluster 0 pgmap v90: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:15.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:14 smithi072 bash[28946]: cluster 2024-03-30T15:01:13.657626+0000 mgr.y (mgr.14152) 126 : cluster 0 pgmap v90: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:15.221 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:14 smithi172 bash[23680]: cluster 2024-03-30T15:01:13.657626+0000 mgr.y (mgr.14152) 126 : cluster 0 pgmap v90: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:17.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:16 smithi072 bash[21573]: cluster 2024-03-30T15:01:15.658077+0000 mgr.y (mgr.14152) 127 : cluster 0 pgmap v91: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:17.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:16 smithi072 bash[28946]: cluster 2024-03-30T15:01:15.658077+0000 mgr.y (mgr.14152) 127 : cluster 0 pgmap v91: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:17.221 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:16 smithi172 bash[23680]: cluster 2024-03-30T15:01:15.658077+0000 mgr.y (mgr.14152) 127 : cluster 0 pgmap v91: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:19.146 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:18 smithi072 bash[21573]: cluster 2024-03-30T15:01:17.658479+0000 mgr.y (mgr.14152) 128 : cluster 0 pgmap v92: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:19.146 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:18 smithi072 bash[28946]: cluster 2024-03-30T15:01:17.658479+0000 mgr.y (mgr.14152) 128 : cluster 0 pgmap v92: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:19.221 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:18 smithi172 bash[23680]: cluster 2024-03-30T15:01:17.658479+0000 mgr.y (mgr.14152) 128 : cluster 0 pgmap v92: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:21.051 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:20 smithi072 bash[21573]: cluster 2024-03-30T15:01:19.658865+0000 mgr.y (mgr.14152) 129 : cluster 0 pgmap v93: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:21.051 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:20 smithi072 bash[28946]: cluster 2024-03-30T15:01:19.658865+0000 mgr.y (mgr.14152) 129 : cluster 0 pgmap v93: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:21.221 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:20 smithi172 bash[23680]: cluster 2024-03-30T15:01:19.658865+0000 mgr.y (mgr.14152) 129 : cluster 0 pgmap v93: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:23.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:22 smithi072 bash[21573]: cluster 2024-03-30T15:01:21.659322+0000 mgr.y (mgr.14152) 130 : cluster 0 pgmap v94: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:23.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:22 smithi072 bash[28946]: cluster 2024-03-30T15:01:21.659322+0000 mgr.y (mgr.14152) 130 : cluster 0 pgmap v94: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:23.221 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:22 smithi172 bash[23680]: cluster 2024-03-30T15:01:21.659322+0000 mgr.y (mgr.14152) 130 : cluster 0 pgmap v94: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:24.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:23 smithi072 bash[28946]: audit 2024-03-30T15:01:22.932975+0000 mon.a (mon.0) 338 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-30T15:01:24.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:23 smithi072 bash[28946]: audit 2024-03-30T15:01:22.934605+0000 mon.a (mon.0) 339 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:01:24.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:23 smithi072 bash[28946]: cephadm 2024-03-30T15:01:22.936037+0000 mgr.y (mgr.14152) 131 : cephadm 1 Deploying daemon osd.1 on smithi072 2024-03-30T15:01:24.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:23 smithi072 bash[21573]: audit 2024-03-30T15:01:22.932975+0000 mon.a (mon.0) 338 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-30T15:01:24.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:23 smithi072 bash[21573]: audit 2024-03-30T15:01:22.934605+0000 mon.a (mon.0) 339 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:01:24.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:23 smithi072 bash[21573]: cephadm 2024-03-30T15:01:22.936037+0000 mgr.y (mgr.14152) 131 : cephadm 1 Deploying daemon osd.1 on smithi072 2024-03-30T15:01:24.221 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:23 smithi172 bash[23680]: audit 2024-03-30T15:01:22.932975+0000 mon.a (mon.0) 338 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-30T15:01:24.221 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:23 smithi172 bash[23680]: audit 2024-03-30T15:01:22.934605+0000 mon.a (mon.0) 339 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:01:24.221 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:23 smithi172 bash[23680]: cephadm 2024-03-30T15:01:22.936037+0000 mgr.y (mgr.14152) 131 : cephadm 1 Deploying daemon osd.1 on smithi072 2024-03-30T15:01:24.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:24 smithi072 bash[28946]: cluster 2024-03-30T15:01:23.659776+0000 mgr.y (mgr.14152) 132 : cluster 0 pgmap v95: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:24.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:24 smithi072 bash[21573]: cluster 2024-03-30T15:01:23.659776+0000 mgr.y (mgr.14152) 132 : cluster 0 pgmap v95: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:25.221 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:24 smithi172 bash[23680]: cluster 2024-03-30T15:01:23.659776+0000 mgr.y (mgr.14152) 132 : cluster 0 pgmap v95: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:27.092 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:26 smithi072 bash[21573]: cluster 2024-03-30T15:01:25.660239+0000 mgr.y (mgr.14152) 133 : cluster 0 pgmap v96: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:27.093 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:26 smithi072 bash[28946]: cluster 2024-03-30T15:01:25.660239+0000 mgr.y (mgr.14152) 133 : cluster 0 pgmap v96: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:27.221 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:26 smithi172 bash[23680]: cluster 2024-03-30T15:01:25.660239+0000 mgr.y (mgr.14152) 133 : cluster 0 pgmap v96: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:27.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:27 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:01:27.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:27 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:01:27.422 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 30 15:01:27 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:01:27.422 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 30 15:01:27 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:01:27.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:27 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:01:27.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:27 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:01:27.423 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:01:27 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:01:27.423 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:01:27 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:01:28.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:28 smithi072 bash[21573]: audit 2024-03-30T15:01:27.465144+0000 mon.a (mon.0) 340 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:01:28.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:28 smithi072 bash[21573]: audit 2024-03-30T15:01:27.469968+0000 mon.a (mon.0) 341 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:01:28.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:28 smithi072 bash[21573]: audit 2024-03-30T15:01:27.494763+0000 mon.a (mon.0) 342 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:01:28.672 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:28 smithi072 bash[28946]: audit 2024-03-30T15:01:27.465144+0000 mon.a (mon.0) 340 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:01:28.672 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:28 smithi072 bash[28946]: audit 2024-03-30T15:01:27.469968+0000 mon.a (mon.0) 341 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:01:28.672 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:28 smithi072 bash[28946]: audit 2024-03-30T15:01:27.494763+0000 mon.a (mon.0) 342 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:01:28.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:28 smithi172 bash[23680]: audit 2024-03-30T15:01:27.465144+0000 mon.a (mon.0) 340 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:01:28.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:28 smithi172 bash[23680]: audit 2024-03-30T15:01:27.469968+0000 mon.a (mon.0) 341 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:01:28.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:28 smithi172 bash[23680]: audit 2024-03-30T15:01:27.494763+0000 mon.a (mon.0) 342 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:01:29.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:29 smithi072 bash[21573]: cluster 2024-03-30T15:01:27.660590+0000 mgr.y (mgr.14152) 134 : cluster 0 pgmap v97: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:29.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:29 smithi072 bash[28946]: cluster 2024-03-30T15:01:27.660590+0000 mgr.y (mgr.14152) 134 : cluster 0 pgmap v97: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:29.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:29 smithi172 bash[23680]: cluster 2024-03-30T15:01:27.660590+0000 mgr.y (mgr.14152) 134 : cluster 0 pgmap v97: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:31.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:31 smithi072 bash[21573]: cluster 2024-03-30T15:01:29.660828+0000 mgr.y (mgr.14152) 135 : cluster 0 pgmap v98: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:31.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:31 smithi072 bash[28946]: cluster 2024-03-30T15:01:29.660828+0000 mgr.y (mgr.14152) 135 : cluster 0 pgmap v98: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:31.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:31 smithi172 bash[23680]: cluster 2024-03-30T15:01:29.660828+0000 mgr.y (mgr.14152) 135 : cluster 0 pgmap v98: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:33.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:33 smithi072 bash[21573]: cluster 2024-03-30T15:01:31.661267+0000 mgr.y (mgr.14152) 136 : cluster 0 pgmap v99: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:33.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:33 smithi072 bash[21573]: audit 2024-03-30T15:01:32.788366+0000 mon.a (mon.0) 343 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:01:33.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:33 smithi072 bash[21573]: audit 2024-03-30T15:01:32.799411+0000 mon.a (mon.0) 344 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:01:33.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:33 smithi072 bash[21573]: audit 2024-03-30T15:01:32.801161+0000 mon.a (mon.0) 345 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:01:33.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:33 smithi072 bash[21573]: audit 2024-03-30T15:01:32.802325+0000 mon.a (mon.0) 346 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:01:33.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:33 smithi072 bash[21573]: audit 2024-03-30T15:01:32.812401+0000 mon.a (mon.0) 347 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:01:33.672 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:33 smithi072 bash[28946]: cluster 2024-03-30T15:01:31.661267+0000 mgr.y (mgr.14152) 136 : cluster 0 pgmap v99: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:33.672 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:33 smithi072 bash[28946]: audit 2024-03-30T15:01:32.788366+0000 mon.a (mon.0) 343 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:01:33.672 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:33 smithi072 bash[28946]: audit 2024-03-30T15:01:32.799411+0000 mon.a (mon.0) 344 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:01:33.672 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:33 smithi072 bash[28946]: audit 2024-03-30T15:01:32.801161+0000 mon.a (mon.0) 345 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:01:33.672 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:33 smithi072 bash[28946]: audit 2024-03-30T15:01:32.802325+0000 mon.a (mon.0) 346 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:01:33.672 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:33 smithi072 bash[28946]: audit 2024-03-30T15:01:32.812401+0000 mon.a (mon.0) 347 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:01:33.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:33 smithi172 bash[23680]: cluster 2024-03-30T15:01:31.661267+0000 mgr.y (mgr.14152) 136 : cluster 0 pgmap v99: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:33.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:33 smithi172 bash[23680]: audit 2024-03-30T15:01:32.788366+0000 mon.a (mon.0) 343 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:01:33.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:33 smithi172 bash[23680]: audit 2024-03-30T15:01:32.799411+0000 mon.a (mon.0) 344 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:01:33.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:33 smithi172 bash[23680]: audit 2024-03-30T15:01:32.801161+0000 mon.a (mon.0) 345 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:01:33.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:33 smithi172 bash[23680]: audit 2024-03-30T15:01:32.802325+0000 mon.a (mon.0) 346 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:01:33.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:33 smithi172 bash[23680]: audit 2024-03-30T15:01:32.812401+0000 mon.a (mon.0) 347 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:01:34.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:34 smithi072 bash[21573]: audit 2024-03-30T15:01:33.981389+0000 mon.a (mon.0) 348 : audit 1 from='osd.1 [v2:172.21.15.72:6810/2191896250,v1:172.21.15.72:6811/2191896250]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-30T15:01:34.672 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:34 smithi072 bash[28946]: audit 2024-03-30T15:01:33.981389+0000 mon.a (mon.0) 348 : audit 1 from='osd.1 [v2:172.21.15.72:6810/2191896250,v1:172.21.15.72:6811/2191896250]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-30T15:01:34.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:34 smithi172 bash[23680]: audit 2024-03-30T15:01:33.981389+0000 mon.a (mon.0) 348 : audit 1 from='osd.1 [v2:172.21.15.72:6810/2191896250,v1:172.21.15.72:6811/2191896250]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-30T15:01:35.861 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:35 smithi072 bash[28946]: cluster 2024-03-30T15:01:33.661800+0000 mgr.y (mgr.14152) 137 : cluster 0 pgmap v100: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:35.861 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:35 smithi072 bash[28946]: audit 2024-03-30T15:01:34.492712+0000 mon.a (mon.0) 349 : audit 1 from='osd.1 [v2:172.21.15.72:6810/2191896250,v1:172.21.15.72:6811/2191896250]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-30T15:01:35.861 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:35 smithi072 bash[28946]: cluster 2024-03-30T15:01:34.497355+0000 mon.a (mon.0) 350 : cluster 0 osdmap e11: 2 total, 1 up, 2 in 2024-03-30T15:01:35.861 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:35 smithi072 bash[28946]: audit 2024-03-30T15:01:34.497789+0000 mon.a (mon.0) 351 : audit 1 from='osd.1 [v2:172.21.15.72:6810/2191896250,v1:172.21.15.72:6811/2191896250]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-03-30T15:01:35.861 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:35 smithi072 bash[28946]: audit 2024-03-30T15:01:34.498116+0000 mon.a (mon.0) 352 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T15:01:35.861 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:35 smithi072 bash[21573]: cluster 2024-03-30T15:01:33.661800+0000 mgr.y (mgr.14152) 137 : cluster 0 pgmap v100: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:35.861 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:35 smithi072 bash[21573]: audit 2024-03-30T15:01:34.492712+0000 mon.a (mon.0) 349 : audit 1 from='osd.1 [v2:172.21.15.72:6810/2191896250,v1:172.21.15.72:6811/2191896250]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-30T15:01:35.861 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:35 smithi072 bash[21573]: cluster 2024-03-30T15:01:34.497355+0000 mon.a (mon.0) 350 : cluster 0 osdmap e11: 2 total, 1 up, 2 in 2024-03-30T15:01:35.862 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:35 smithi072 bash[21573]: audit 2024-03-30T15:01:34.497789+0000 mon.a (mon.0) 351 : audit 1 from='osd.1 [v2:172.21.15.72:6810/2191896250,v1:172.21.15.72:6811/2191896250]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-03-30T15:01:35.862 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:35 smithi072 bash[21573]: audit 2024-03-30T15:01:34.498116+0000 mon.a (mon.0) 352 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T15:01:35.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:35 smithi172 bash[23680]: cluster 2024-03-30T15:01:33.661800+0000 mgr.y (mgr.14152) 137 : cluster 0 pgmap v100: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:35.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:35 smithi172 bash[23680]: audit 2024-03-30T15:01:34.492712+0000 mon.a (mon.0) 349 : audit 1 from='osd.1 [v2:172.21.15.72:6810/2191896250,v1:172.21.15.72:6811/2191896250]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-30T15:01:35.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:35 smithi172 bash[23680]: cluster 2024-03-30T15:01:34.497355+0000 mon.a (mon.0) 350 : cluster 0 osdmap e11: 2 total, 1 up, 2 in 2024-03-30T15:01:35.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:35 smithi172 bash[23680]: audit 2024-03-30T15:01:34.497789+0000 mon.a (mon.0) 351 : audit 1 from='osd.1 [v2:172.21.15.72:6810/2191896250,v1:172.21.15.72:6811/2191896250]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-03-30T15:01:35.972 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:35 smithi172 bash[23680]: audit 2024-03-30T15:01:34.498116+0000 mon.a (mon.0) 352 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T15:01:36.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:36.409+0000 7fc1ab7fe700 1 -- 172.21.15.72:0/3220886099 <== mgr.14152 v2:172.21.15.72:6800/2777002311 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc1b4062680 con 0x7fc1a006dac0 2024-03-30T15:01:36.413 INFO:teuthology.orchestra.run.smithi072.stdout:Created osd(s) 1 on host 'smithi072' 2024-03-30T15:01:36.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:36.413+0000 7fc1bc331700 1 -- 172.21.15.72:0/3220886099 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fc1a006dac0 msgr2=0x7fc1a006ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:01:36.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:36.413+0000 7fc1bc331700 1 --2- 172.21.15.72:0/3220886099 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fc1a006dac0 0x7fc1a006ff80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4009680 tx=0x7fc1a4009260 comp rx=0 tx=0).stop 2024-03-30T15:01:36.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:36.413+0000 7fc1bc331700 1 -- 172.21.15.72:0/3220886099 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc1b4102e10 msgr2=0x7fc1b4102770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:01:36.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:36.413+0000 7fc1bc331700 1 --2- 172.21.15.72:0/3220886099 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc1b4102e10 0x7fc1b4102770 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac004d00 tx=0x7fc1ac004d30 comp rx=0 tx=0).stop 2024-03-30T15:01:36.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:36.413+0000 7fc1bc331700 1 -- 172.21.15.72:0/3220886099 shutdown_connections 2024-03-30T15:01:36.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:36.413+0000 7fc1bc331700 1 --2- 172.21.15.72:0/3220886099 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fc1a006dac0 0x7fc1a006ff80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:01:36.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:36.413+0000 7fc1bc331700 1 --2- 172.21.15.72:0/3220886099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1b4108070 0x7fc1b4101300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:01:36.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:36.413+0000 7fc1bc331700 1 --2- 172.21.15.72:0/3220886099 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc1b4102e10 0x7fc1b4102770 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:01:36.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:36.413+0000 7fc1bc331700 1 --2- 172.21.15.72:0/3220886099 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1b4105740 0x7fc1b4100dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:01:36.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:36.413+0000 7fc1bc331700 1 -- 172.21.15.72:0/3220886099 >> 172.21.15.72:0/3220886099 conn(0x7fc1b40fc760 msgr2=0x7fc1b4103a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:01:36.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:36.413+0000 7fc1bc331700 1 -- 172.21.15.72:0/3220886099 shutdown_connections 2024-03-30T15:01:36.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:36.413+0000 7fc1bc331700 1 -- 172.21.15.72:0/3220886099 wait complete. 2024-03-30T15:01:36.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:36 smithi072 bash[28946]: audit 2024-03-30T15:01:35.494389+0000 mon.a (mon.0) 353 : audit 1 from='osd.1 [v2:172.21.15.72:6810/2191896250,v1:172.21.15.72:6811/2191896250]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]': finished 2024-03-30T15:01:36.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:36 smithi072 bash[28946]: cluster 2024-03-30T15:01:35.497479+0000 mon.a (mon.0) 354 : cluster 0 osdmap e12: 2 total, 1 up, 2 in 2024-03-30T15:01:36.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:36 smithi072 bash[28946]: audit 2024-03-30T15:01:35.498425+0000 mon.a (mon.0) 355 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T15:01:36.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:36 smithi072 bash[28946]: audit 2024-03-30T15:01:35.504802+0000 mon.a (mon.0) 356 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T15:01:36.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:36 smithi072 bash[28946]: audit 2024-03-30T15:01:36.369804+0000 mon.a (mon.0) 357 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:01:36.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:36 smithi072 bash[28946]: audit 2024-03-30T15:01:36.377038+0000 mon.a (mon.0) 358 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:01:36.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:36 smithi072 bash[28946]: audit 2024-03-30T15:01:36.403761+0000 mon.a (mon.0) 359 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:01:36.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:36 smithi072 bash[21573]: audit 2024-03-30T15:01:35.494389+0000 mon.a (mon.0) 353 : audit 1 from='osd.1 [v2:172.21.15.72:6810/2191896250,v1:172.21.15.72:6811/2191896250]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]': finished 2024-03-30T15:01:36.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:36 smithi072 bash[21573]: cluster 2024-03-30T15:01:35.497479+0000 mon.a (mon.0) 354 : cluster 0 osdmap e12: 2 total, 1 up, 2 in 2024-03-30T15:01:36.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:36 smithi072 bash[21573]: audit 2024-03-30T15:01:35.498425+0000 mon.a (mon.0) 355 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T15:01:36.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:36 smithi072 bash[21573]: audit 2024-03-30T15:01:35.504802+0000 mon.a (mon.0) 356 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T15:01:36.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:36 smithi072 bash[21573]: audit 2024-03-30T15:01:36.369804+0000 mon.a (mon.0) 357 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:01:36.923 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:36 smithi072 bash[21573]: audit 2024-03-30T15:01:36.377038+0000 mon.a (mon.0) 358 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:01:36.923 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:36 smithi072 bash[21573]: audit 2024-03-30T15:01:36.403761+0000 mon.a (mon.0) 359 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:01:36.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:36 smithi172 bash[23680]: audit 2024-03-30T15:01:35.494389+0000 mon.a (mon.0) 353 : audit 1 from='osd.1 [v2:172.21.15.72:6810/2191896250,v1:172.21.15.72:6811/2191896250]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]': finished 2024-03-30T15:01:36.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:36 smithi172 bash[23680]: cluster 2024-03-30T15:01:35.497479+0000 mon.a (mon.0) 354 : cluster 0 osdmap e12: 2 total, 1 up, 2 in 2024-03-30T15:01:36.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:36 smithi172 bash[23680]: audit 2024-03-30T15:01:35.498425+0000 mon.a (mon.0) 355 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T15:01:36.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:36 smithi172 bash[23680]: audit 2024-03-30T15:01:35.504802+0000 mon.a (mon.0) 356 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T15:01:36.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:36 smithi172 bash[23680]: audit 2024-03-30T15:01:36.369804+0000 mon.a (mon.0) 357 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:01:36.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:36 smithi172 bash[23680]: audit 2024-03-30T15:01:36.377038+0000 mon.a (mon.0) 358 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:01:36.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:36 smithi172 bash[23680]: audit 2024-03-30T15:01:36.403761+0000 mon.a (mon.0) 359 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:01:37.098 DEBUG:teuthology.orchestra.run.smithi072:osd.1> sudo journalctl -f -n 0 -u ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@osd.1.service 2024-03-30T15:01:37.101 INFO:tasks.cephadm:Deploying osd.2 on smithi072 with /dev/vg_nvme/lv_2... 2024-03-30T15:01:37.101 DEBUG:teuthology.orchestra.run.smithi072:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-03-30T15:01:37.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:37 smithi072 bash[21573]: cluster 2024-03-30T15:01:35.027109+0000 osd.1 (osd.1) 1 : cluster 0 purged_snaps scrub starts 2024-03-30T15:01:37.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:37 smithi072 bash[21573]: cluster 2024-03-30T15:01:35.027232+0000 osd.1 (osd.1) 2 : cluster 0 purged_snaps scrub ok 2024-03-30T15:01:37.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:37 smithi072 bash[21573]: cluster 2024-03-30T15:01:35.662172+0000 mgr.y (mgr.14152) 138 : cluster 0 pgmap v103: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:37.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:37 smithi072 bash[21573]: cluster 2024-03-30T15:01:36.504343+0000 mon.a (mon.0) 360 : cluster 1 osd.1 [v2:172.21.15.72:6810/2191896250,v1:172.21.15.72:6811/2191896250] boot 2024-03-30T15:01:37.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:37 smithi072 bash[21573]: cluster 2024-03-30T15:01:36.504375+0000 mon.a (mon.0) 361 : cluster 0 osdmap e13: 2 total, 2 up, 2 in 2024-03-30T15:01:37.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:37 smithi072 bash[21573]: audit 2024-03-30T15:01:36.504703+0000 mon.a (mon.0) 362 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T15:01:37.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:37 smithi072 bash[28946]: cluster 2024-03-30T15:01:35.027109+0000 osd.1 (osd.1) 1 : cluster 0 purged_snaps scrub starts 2024-03-30T15:01:37.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:37 smithi072 bash[28946]: cluster 2024-03-30T15:01:35.027232+0000 osd.1 (osd.1) 2 : cluster 0 purged_snaps scrub ok 2024-03-30T15:01:37.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:37 smithi072 bash[28946]: cluster 2024-03-30T15:01:35.662172+0000 mgr.y (mgr.14152) 138 : cluster 0 pgmap v103: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:37.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:37 smithi072 bash[28946]: cluster 2024-03-30T15:01:36.504343+0000 mon.a (mon.0) 360 : cluster 1 osd.1 [v2:172.21.15.72:6810/2191896250,v1:172.21.15.72:6811/2191896250] boot 2024-03-30T15:01:37.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:37 smithi072 bash[28946]: cluster 2024-03-30T15:01:36.504375+0000 mon.a (mon.0) 361 : cluster 0 osdmap e13: 2 total, 2 up, 2 in 2024-03-30T15:01:37.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:37 smithi072 bash[28946]: audit 2024-03-30T15:01:36.504703+0000 mon.a (mon.0) 362 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T15:01:37.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:37 smithi172 bash[23680]: cluster 2024-03-30T15:01:35.027109+0000 osd.1 (osd.1) 1 : cluster 0 purged_snaps scrub starts 2024-03-30T15:01:37.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:37 smithi172 bash[23680]: cluster 2024-03-30T15:01:35.027232+0000 osd.1 (osd.1) 2 : cluster 0 purged_snaps scrub ok 2024-03-30T15:01:37.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:37 smithi172 bash[23680]: cluster 2024-03-30T15:01:35.662172+0000 mgr.y (mgr.14152) 138 : cluster 0 pgmap v103: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-30T15:01:37.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:37 smithi172 bash[23680]: cluster 2024-03-30T15:01:36.504343+0000 mon.a (mon.0) 360 : cluster 1 osd.1 [v2:172.21.15.72:6810/2191896250,v1:172.21.15.72:6811/2191896250] boot 2024-03-30T15:01:37.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:37 smithi172 bash[23680]: cluster 2024-03-30T15:01:36.504375+0000 mon.a (mon.0) 361 : cluster 0 osdmap e13: 2 total, 2 up, 2 in 2024-03-30T15:01:37.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:37 smithi172 bash[23680]: audit 2024-03-30T15:01:36.504703+0000 mon.a (mon.0) 362 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T15:01:38.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:38 smithi072 bash[21573]: cluster 2024-03-30T15:01:37.530238+0000 mon.a (mon.0) 363 : cluster 0 osdmap e14: 2 total, 2 up, 2 in 2024-03-30T15:01:38.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:38 smithi072 bash[28946]: cluster 2024-03-30T15:01:37.530238+0000 mon.a (mon.0) 363 : cluster 0 osdmap e14: 2 total, 2 up, 2 in 2024-03-30T15:01:38.970 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:38 smithi172 bash[23680]: cluster 2024-03-30T15:01:37.530238+0000 mon.a (mon.0) 363 : cluster 0 osdmap e14: 2 total, 2 up, 2 in 2024-03-30T15:01:39.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:39 smithi072 bash[21573]: cluster 2024-03-30T15:01:37.662630+0000 mgr.y (mgr.14152) 139 : cluster 0 pgmap v106: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:01:39.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:39 smithi072 bash[28946]: cluster 2024-03-30T15:01:37.662630+0000 mgr.y (mgr.14152) 139 : cluster 0 pgmap v106: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:01:39.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:39 smithi172 bash[23680]: cluster 2024-03-30T15:01:37.662630+0000 mgr.y (mgr.14152) 139 : cluster 0 pgmap v106: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:01:41.381 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T15:01:41.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:41 smithi072 bash[21573]: cluster 2024-03-30T15:01:39.663080+0000 mgr.y (mgr.14152) 140 : cluster 0 pgmap v107: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:01:41.672 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:41 smithi072 bash[28946]: cluster 2024-03-30T15:01:39.663080+0000 mgr.y (mgr.14152) 140 : cluster 0 pgmap v107: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:01:41.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:41 smithi172 bash[23680]: cluster 2024-03-30T15:01:39.663080+0000 mgr.y (mgr.14152) 140 : cluster 0 pgmap v107: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:01:43.840 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:43 smithi072 bash[28946]: cluster 2024-03-30T15:01:41.663536+0000 mgr.y (mgr.14152) 141 : cluster 0 pgmap v108: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:01:43.840 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:43 smithi072 bash[21573]: cluster 2024-03-30T15:01:41.663536+0000 mgr.y (mgr.14152) 141 : cluster 0 pgmap v108: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:01:43.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:43 smithi172 bash[23680]: cluster 2024-03-30T15:01:41.663536+0000 mgr.y (mgr.14152) 141 : cluster 0 pgmap v108: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:01:45.565 INFO:teuthology.orchestra.run.smithi072.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-03-30T15:01:45.565 INFO:teuthology.orchestra.run.smithi072.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-03-30T15:01:45.565 INFO:teuthology.orchestra.run.smithi072.stderr: stderr: 10+0 records in 2024-03-30T15:01:45.565 INFO:teuthology.orchestra.run.smithi072.stderr:10+0 records out 2024-03-30T15:01:45.565 INFO:teuthology.orchestra.run.smithi072.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0134516 s, 780 MB/s 2024-03-30T15:01:45.565 INFO:teuthology.orchestra.run.smithi072.stderr:--> Zapping successful for: 2024-03-30T15:01:45.903 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:45 smithi072 bash[21573]: cluster 2024-03-30T15:01:43.664038+0000 mgr.y (mgr.14152) 142 : cluster 0 pgmap v109: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:01:45.903 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:45 smithi072 bash[28946]: cluster 2024-03-30T15:01:43.664038+0000 mgr.y (mgr.14152) 142 : cluster 0 pgmap v109: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:01:45.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:45 smithi172 bash[23680]: cluster 2024-03-30T15:01:43.664038+0000 mgr.y (mgr.14152) 142 : cluster 0 pgmap v109: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:01:46.447 DEBUG:teuthology.orchestra.run.smithi072:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi072:vg_nvme/lv_2 2024-03-30T15:01:47.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:47 smithi072 bash[21573]: cluster 2024-03-30T15:01:45.664370+0000 mgr.y (mgr.14152) 143 : cluster 0 pgmap v110: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:01:47.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:47 smithi072 bash[21573]: audit 2024-03-30T15:01:46.810896+0000 mon.a (mon.0) 364 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:01:47.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:47 smithi072 bash[21573]: audit 2024-03-30T15:01:46.820383+0000 mon.a (mon.0) 365 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:01:47.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:47 smithi072 bash[21573]: audit 2024-03-30T15:01:46.822540+0000 mon.a (mon.0) 366 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:01:47.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:47 smithi072 bash[21573]: audit 2024-03-30T15:01:46.824195+0000 mon.a (mon.0) 367 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:01:47.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:47 smithi072 bash[21573]: audit 2024-03-30T15:01:46.833284+0000 mon.a (mon.0) 368 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:01:47.923 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:47 smithi072 bash[21573]: audit 2024-03-30T15:01:46.837297+0000 mon.a (mon.0) 369 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:01:47.923 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:47 smithi072 bash[21573]: audit 2024-03-30T15:01:46.838993+0000 mon.a (mon.0) 370 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:01:47.923 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:47 smithi072 bash[21573]: audit 2024-03-30T15:01:46.850271+0000 mon.a (mon.0) 371 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:01:47.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:47 smithi072 bash[28946]: cluster 2024-03-30T15:01:45.664370+0000 mgr.y (mgr.14152) 143 : cluster 0 pgmap v110: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:01:47.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:47 smithi072 bash[28946]: audit 2024-03-30T15:01:46.810896+0000 mon.a (mon.0) 364 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:01:47.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:47 smithi072 bash[28946]: audit 2024-03-30T15:01:46.820383+0000 mon.a (mon.0) 365 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:01:47.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:47 smithi072 bash[28946]: audit 2024-03-30T15:01:46.822540+0000 mon.a (mon.0) 366 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:01:47.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:47 smithi072 bash[28946]: audit 2024-03-30T15:01:46.824195+0000 mon.a (mon.0) 367 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:01:47.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:47 smithi072 bash[28946]: audit 2024-03-30T15:01:46.833284+0000 mon.a (mon.0) 368 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:01:47.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:47 smithi072 bash[28946]: audit 2024-03-30T15:01:46.837297+0000 mon.a (mon.0) 369 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:01:47.924 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:47 smithi072 bash[28946]: audit 2024-03-30T15:01:46.838993+0000 mon.a (mon.0) 370 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:01:47.924 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:47 smithi072 bash[28946]: audit 2024-03-30T15:01:46.850271+0000 mon.a (mon.0) 371 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:01:47.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:47 smithi172 bash[23680]: cluster 2024-03-30T15:01:45.664370+0000 mgr.y (mgr.14152) 143 : cluster 0 pgmap v110: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:01:47.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:47 smithi172 bash[23680]: audit 2024-03-30T15:01:46.810896+0000 mon.a (mon.0) 364 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:01:47.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:47 smithi172 bash[23680]: audit 2024-03-30T15:01:46.820383+0000 mon.a (mon.0) 365 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:01:47.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:47 smithi172 bash[23680]: audit 2024-03-30T15:01:46.822540+0000 mon.a (mon.0) 366 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:01:47.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:47 smithi172 bash[23680]: audit 2024-03-30T15:01:46.824195+0000 mon.a (mon.0) 367 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:01:47.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:47 smithi172 bash[23680]: audit 2024-03-30T15:01:46.833284+0000 mon.a (mon.0) 368 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:01:47.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:47 smithi172 bash[23680]: audit 2024-03-30T15:01:46.837297+0000 mon.a (mon.0) 369 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:01:47.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:47 smithi172 bash[23680]: audit 2024-03-30T15:01:46.838993+0000 mon.a (mon.0) 370 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:01:47.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:47 smithi172 bash[23680]: audit 2024-03-30T15:01:46.850271+0000 mon.a (mon.0) 371 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:01:48.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:48 smithi072 bash[21573]: cephadm 2024-03-30T15:01:46.801517+0000 mgr.y (mgr.14152) 144 : cephadm 1 Detected new or changed devices on smithi072 2024-03-30T15:01:48.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:48 smithi072 bash[21573]: cephadm 2024-03-30T15:01:46.825335+0000 mgr.y (mgr.14152) 145 : cephadm 1 Adjusting osd_memory_target on smithi072 to 8120M 2024-03-30T15:01:48.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:48 smithi072 bash[28946]: cephadm 2024-03-30T15:01:46.801517+0000 mgr.y (mgr.14152) 144 : cephadm 1 Detected new or changed devices on smithi072 2024-03-30T15:01:48.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:48 smithi072 bash[28946]: cephadm 2024-03-30T15:01:46.825335+0000 mgr.y (mgr.14152) 145 : cephadm 1 Adjusting osd_memory_target on smithi072 to 8120M 2024-03-30T15:01:48.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:48 smithi172 bash[23680]: cephadm 2024-03-30T15:01:46.801517+0000 mgr.y (mgr.14152) 144 : cephadm 1 Detected new or changed devices on smithi072 2024-03-30T15:01:48.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:48 smithi172 bash[23680]: cephadm 2024-03-30T15:01:46.825335+0000 mgr.y (mgr.14152) 145 : cephadm 1 Adjusting osd_memory_target on smithi072 to 8120M 2024-03-30T15:01:49.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:49 smithi072 bash[21573]: cluster 2024-03-30T15:01:47.664809+0000 mgr.y (mgr.14152) 146 : cluster 0 pgmap v111: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:01:49.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:49 smithi072 bash[28946]: cluster 2024-03-30T15:01:47.664809+0000 mgr.y (mgr.14152) 146 : cluster 0 pgmap v111: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:01:49.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:49 smithi172 bash[23680]: cluster 2024-03-30T15:01:47.664809+0000 mgr.y (mgr.14152) 146 : cluster 0 pgmap v111: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:01:51.190 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T15:01:51.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:51 smithi072 bash[28946]: cluster 2024-03-30T15:01:49.665315+0000 mgr.y (mgr.14152) 147 : cluster 0 pgmap v112: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:01:51.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:51 smithi072 bash[21573]: cluster 2024-03-30T15:01:49.665315+0000 mgr.y (mgr.14152) 147 : cluster 0 pgmap v112: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:01:51.972 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:51 smithi172 bash[23680]: cluster 2024-03-30T15:01:49.665315+0000 mgr.y (mgr.14152) 147 : cluster 0 pgmap v112: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:01:53.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:53.692+0000 7fb5f1d0e700 1 -- 172.21.15.72:0/2420907218 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5ec1011d0 msgr2=0x7fb5ec1015f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:01:53.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:53.692+0000 7fb5f1d0e700 1 --2- 172.21.15.72:0/2420907218 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5ec1011d0 0x7fb5ec1015f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc0098f0 tx=0x7fb5dc009c00 comp rx=0 tx=0).stop 2024-03-30T15:01:53.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:53.692+0000 7fb5f1d0e700 1 -- 172.21.15.72:0/2420907218 shutdown_connections 2024-03-30T15:01:53.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:53.692+0000 7fb5f1d0e700 1 --2- 172.21.15.72:0/2420907218 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5ec102d70 0x7fb5ec109620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:01:53.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:53.692+0000 7fb5f1d0e700 1 --2- 172.21.15.72:0/2420907218 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5ec1011d0 0x7fb5ec1015f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:01:53.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:53.692+0000 7fb5f1d0e700 1 --2- 172.21.15.72:0/2420907218 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5ec1023d0 0x7fb5ec102830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:01:53.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:53.692+0000 7fb5f1d0e700 1 -- 172.21.15.72:0/2420907218 >> 172.21.15.72:0/2420907218 conn(0x7fb5ec0fc770 msgr2=0x7fb5ec0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:01:53.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:53.692+0000 7fb5f1d0e700 1 -- 172.21.15.72:0/2420907218 shutdown_connections 2024-03-30T15:01:53.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:53.692+0000 7fb5f1d0e700 1 -- 172.21.15.72:0/2420907218 wait complete. 2024-03-30T15:01:53.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:53.692+0000 7fb5f1d0e700 1 Processor -- start 2024-03-30T15:01:53.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:53.692+0000 7fb5f1d0e700 1 -- start start 2024-03-30T15:01:53.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:53.692+0000 7fb5f1d0e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5ec1011d0 0x7fb5ec197b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:01:53.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:53.692+0000 7fb5f1d0e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5ec1023d0 0x7fb5ec198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:01:53.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:53.692+0000 7fb5f1d0e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5ec102d70 0x7fb5ec19f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:01:53.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:53.692+0000 7fb5f1d0e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ec10c2c0 con 0x7fb5ec1011d0 2024-03-30T15:01:53.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:53.692+0000 7fb5f1d0e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ec10c140 con 0x7fb5ec1023d0 2024-03-30T15:01:53.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:53.692+0000 7fb5f1d0e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fb5ec10c440 con 0x7fb5ec102d70 2024-03-30T15:01:53.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:53.692+0000 7fb5eb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5ec1011d0 0x7fb5ec197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:01:53.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:53.692+0000 7fb5eb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5ec1011d0 0x7fb5ec197b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34512/0 (socket says 172.21.15.72:34512) 2024-03-30T15:01:53.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:53.692+0000 7fb5eb7fe700 1 -- 172.21.15.72:0/4139359807 learned_addr learned my addr 172.21.15.72:0/4139359807 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T15:01:53.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:53.692+0000 7fb5ebfff700 1 --2- 172.21.15.72:0/4139359807 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5ec102d70 0x7fb5ec19f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:01:53.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:53.692+0000 7fb5eaffd700 1 --2- 172.21.15.72:0/4139359807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5ec1023d0 0x7fb5ec198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:01:53.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:53.692+0000 7fb5ebfff700 1 -- 172.21.15.72:0/4139359807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5ec1023d0 msgr2=0x7fb5ec198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:01:53.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:53.692+0000 7fb5ebfff700 1 --2- 172.21.15.72:0/4139359807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5ec1023d0 0x7fb5ec198040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:01:53.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:53.692+0000 7fb5ebfff700 1 -- 172.21.15.72:0/4139359807 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5ec1011d0 msgr2=0x7fb5ec197b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:01:53.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:53.692+0000 7fb5ebfff700 1 --2- 172.21.15.72:0/4139359807 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5ec1011d0 0x7fb5ec197b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:01:53.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:53.692+0000 7fb5ebfff700 1 -- 172.21.15.72:0/4139359807 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5ec19f710 con 0x7fb5ec102d70 2024-03-30T15:01:53.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:53.696+0000 7fb5eb7fe700 1 --2- 172.21.15.72:0/4139359807 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5ec1011d0 0x7fb5ec197b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T15:01:53.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:53.696+0000 7fb5ebfff700 1 --2- 172.21.15.72:0/4139359807 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5ec102d70 0x7fb5ec19f070 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb5e400ab70 tx=0x7fb5e400ae80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:01:53.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:53.696+0000 7fb5e8ff9700 1 -- 172.21.15.72:0/4139359807 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e4017020 con 0x7fb5ec102d70 2024-03-30T15:01:53.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:53.696+0000 7fb5e8ff9700 1 -- 172.21.15.72:0/4139359807 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7fb5e4004bb0 con 0x7fb5ec102d70 2024-03-30T15:01:53.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:53.696+0000 7fb5f1d0e700 1 -- 172.21.15.72:0/4139359807 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5ec19fa00 con 0x7fb5ec102d70 2024-03-30T15:01:53.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:53.696+0000 7fb5e8ff9700 1 -- 172.21.15.72:0/4139359807 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e4005280 con 0x7fb5ec102d70 2024-03-30T15:01:53.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:53.696+0000 7fb5f1d0e700 1 -- 172.21.15.72:0/4139359807 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5ec19ff40 con 0x7fb5ec102d70 2024-03-30T15:01:53.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:53.696+0000 7fb5f1d0e700 1 -- 172.21.15.72:0/4139359807 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5ec04ff00 con 0x7fb5ec102d70 2024-03-30T15:01:53.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:53.696+0000 7fb5e8ff9700 1 -- 172.21.15.72:0/4139359807 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 14) ==== 91718+0+0 (secure 0 0 0) 0x7fb5e400c600 con 0x7fb5ec102d70 2024-03-30T15:01:53.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:53.696+0000 7fb5e8ff9700 1 --2- 172.21.15.72:0/4139359807 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fb5d406dac0 0x7fb5d406ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:01:53.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:53.696+0000 7fb5e8ff9700 1 -- 172.21.15.72:0/4139359807 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(14..14 src has 1..14) ==== 2199+0+0 (secure 0 0 0) 0x7fb5e408bf70 con 0x7fb5ec102d70 2024-03-30T15:01:53.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:53.696+0000 7fb5eb7fe700 1 --2- 172.21.15.72:0/4139359807 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fb5d406dac0 0x7fb5d406ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:01:53.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:53.696+0000 7fb5eb7fe700 1 --2- 172.21.15.72:0/4139359807 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fb5d406dac0 0x7fb5d406ff80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc00c010 tx=0x7fb5dc019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:01:53.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:53.700+0000 7fb5e8ff9700 1 -- 172.21.15.72:0/4139359807 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fb5e4021020 con 0x7fb5ec102d70 2024-03-30T15:01:53.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:01:53.912+0000 7fb5f1d0e700 1 -- 172.21.15.72:0/4139359807 --> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fb5ec06b080 con 0x7fb5d406dac0 2024-03-30T15:01:53.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:53 smithi072 bash[21573]: cluster 2024-03-30T15:01:51.665714+0000 mgr.y (mgr.14152) 148 : cluster 0 pgmap v113: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:01:53.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:53 smithi072 bash[28946]: cluster 2024-03-30T15:01:51.665714+0000 mgr.y (mgr.14152) 148 : cluster 0 pgmap v113: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:01:53.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:53 smithi172 bash[23680]: cluster 2024-03-30T15:01:51.665714+0000 mgr.y (mgr.14152) 148 : cluster 0 pgmap v113: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:01:54.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:54 smithi072 bash[21573]: audit 2024-03-30T15:01:53.922898+0000 mon.a (mon.0) 372 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T15:01:54.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:54 smithi072 bash[21573]: audit 2024-03-30T15:01:53.928408+0000 mon.a (mon.0) 373 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T15:01:54.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:54 smithi072 bash[21573]: audit 2024-03-30T15:01:53.929505+0000 mon.a (mon.0) 374 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:01:54.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:54 smithi072 bash[28946]: audit 2024-03-30T15:01:53.922898+0000 mon.a (mon.0) 372 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T15:01:54.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:54 smithi072 bash[28946]: audit 2024-03-30T15:01:53.928408+0000 mon.a (mon.0) 373 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T15:01:54.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:54 smithi072 bash[28946]: audit 2024-03-30T15:01:53.929505+0000 mon.a (mon.0) 374 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:01:54.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:54 smithi172 bash[23680]: audit 2024-03-30T15:01:53.922898+0000 mon.a (mon.0) 372 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T15:01:54.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:54 smithi172 bash[23680]: audit 2024-03-30T15:01:53.928408+0000 mon.a (mon.0) 373 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T15:01:54.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:54 smithi172 bash[23680]: audit 2024-03-30T15:01:53.929505+0000 mon.a (mon.0) 374 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:01:55.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:55 smithi072 bash[21573]: cluster 2024-03-30T15:01:53.666182+0000 mgr.y (mgr.14152) 149 : cluster 0 pgmap v114: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:01:55.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:55 smithi072 bash[21573]: audit 2024-03-30T15:01:53.916360+0000 mgr.y (mgr.14152) 150 : audit 0 from='client.24167 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T15:01:55.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:55 smithi072 bash[28946]: cluster 2024-03-30T15:01:53.666182+0000 mgr.y (mgr.14152) 149 : cluster 0 pgmap v114: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:01:55.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:55 smithi072 bash[28946]: audit 2024-03-30T15:01:53.916360+0000 mgr.y (mgr.14152) 150 : audit 0 from='client.24167 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T15:01:55.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:55 smithi172 bash[23680]: cluster 2024-03-30T15:01:53.666182+0000 mgr.y (mgr.14152) 149 : cluster 0 pgmap v114: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:01:55.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:55 smithi172 bash[23680]: audit 2024-03-30T15:01:53.916360+0000 mgr.y (mgr.14152) 150 : audit 0 from='client.24167 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T15:01:57.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:57 smithi072 bash[21573]: cluster 2024-03-30T15:01:55.666636+0000 mgr.y (mgr.14152) 151 : cluster 0 pgmap v115: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:01:57.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:57 smithi072 bash[28946]: cluster 2024-03-30T15:01:55.666636+0000 mgr.y (mgr.14152) 151 : cluster 0 pgmap v115: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:01:57.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:57 smithi172 bash[23680]: cluster 2024-03-30T15:01:55.666636+0000 mgr.y (mgr.14152) 151 : cluster 0 pgmap v115: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:01:59.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:01:59 smithi072 bash[21573]: cluster 2024-03-30T15:01:57.667112+0000 mgr.y (mgr.14152) 152 : cluster 0 pgmap v116: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:01:59.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:01:59 smithi072 bash[28946]: cluster 2024-03-30T15:01:57.667112+0000 mgr.y (mgr.14152) 152 : cluster 0 pgmap v116: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:01:59.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:01:59 smithi172 bash[23680]: cluster 2024-03-30T15:01:57.667112+0000 mgr.y (mgr.14152) 152 : cluster 0 pgmap v116: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:01.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:01 smithi072 bash[21573]: cluster 2024-03-30T15:01:59.667571+0000 mgr.y (mgr.14152) 153 : cluster 0 pgmap v117: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:01.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:01 smithi072 bash[28946]: cluster 2024-03-30T15:01:59.667571+0000 mgr.y (mgr.14152) 153 : cluster 0 pgmap v117: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:01.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:01 smithi172 bash[23680]: cluster 2024-03-30T15:01:59.667571+0000 mgr.y (mgr.14152) 153 : cluster 0 pgmap v117: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:02.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:02 smithi072 bash[21573]: audit 2024-03-30T15:02:02.135760+0000 mon.a (mon.0) 375 : audit 1 from='client.? 172.21.15.72:0/3759124051' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5cba948f-92d8-402b-88d5-969c137f3c64"}]: dispatch 2024-03-30T15:02:02.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:02 smithi072 bash[21573]: audit 2024-03-30T15:02:02.138384+0000 mon.a (mon.0) 376 : audit 1 from='client.? 172.21.15.72:0/3759124051' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5cba948f-92d8-402b-88d5-969c137f3c64"}]': finished 2024-03-30T15:02:02.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:02 smithi072 bash[21573]: cluster 2024-03-30T15:02:02.142648+0000 mon.a (mon.0) 377 : cluster 0 osdmap e15: 3 total, 2 up, 3 in 2024-03-30T15:02:02.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:02 smithi072 bash[21573]: audit 2024-03-30T15:02:02.143128+0000 mon.a (mon.0) 378 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T15:02:02.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:02 smithi072 bash[28946]: audit 2024-03-30T15:02:02.135760+0000 mon.a (mon.0) 375 : audit 1 from='client.? 172.21.15.72:0/3759124051' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5cba948f-92d8-402b-88d5-969c137f3c64"}]: dispatch 2024-03-30T15:02:02.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:02 smithi072 bash[28946]: audit 2024-03-30T15:02:02.138384+0000 mon.a (mon.0) 376 : audit 1 from='client.? 172.21.15.72:0/3759124051' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5cba948f-92d8-402b-88d5-969c137f3c64"}]': finished 2024-03-30T15:02:02.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:02 smithi072 bash[28946]: cluster 2024-03-30T15:02:02.142648+0000 mon.a (mon.0) 377 : cluster 0 osdmap e15: 3 total, 2 up, 3 in 2024-03-30T15:02:02.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:02 smithi072 bash[28946]: audit 2024-03-30T15:02:02.143128+0000 mon.a (mon.0) 378 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T15:02:02.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:02 smithi172 bash[23680]: audit 2024-03-30T15:02:02.135760+0000 mon.a (mon.0) 375 : audit 1 from='client.? 172.21.15.72:0/3759124051' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5cba948f-92d8-402b-88d5-969c137f3c64"}]: dispatch 2024-03-30T15:02:02.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:02 smithi172 bash[23680]: audit 2024-03-30T15:02:02.138384+0000 mon.a (mon.0) 376 : audit 1 from='client.? 172.21.15.72:0/3759124051' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5cba948f-92d8-402b-88d5-969c137f3c64"}]': finished 2024-03-30T15:02:02.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:02 smithi172 bash[23680]: cluster 2024-03-30T15:02:02.142648+0000 mon.a (mon.0) 377 : cluster 0 osdmap e15: 3 total, 2 up, 3 in 2024-03-30T15:02:02.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:02 smithi172 bash[23680]: audit 2024-03-30T15:02:02.143128+0000 mon.a (mon.0) 378 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T15:02:03.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:03 smithi072 bash[28946]: cluster 2024-03-30T15:02:01.668008+0000 mgr.y (mgr.14152) 154 : cluster 0 pgmap v118: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:03.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:03 smithi072 bash[28946]: audit 2024-03-30T15:02:02.895744+0000 mon.c (mon.2) 9 : audit 0 from='client.? 172.21.15.72:0/2139932737' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T15:02:03.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:03 smithi072 bash[21573]: cluster 2024-03-30T15:02:01.668008+0000 mgr.y (mgr.14152) 154 : cluster 0 pgmap v118: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:03.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:03 smithi072 bash[21573]: audit 2024-03-30T15:02:02.895744+0000 mon.c (mon.2) 9 : audit 0 from='client.? 172.21.15.72:0/2139932737' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T15:02:03.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:03 smithi172 bash[23680]: cluster 2024-03-30T15:02:01.668008+0000 mgr.y (mgr.14152) 154 : cluster 0 pgmap v118: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:03.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:03 smithi172 bash[23680]: audit 2024-03-30T15:02:02.895744+0000 mon.c (mon.2) 9 : audit 0 from='client.? 172.21.15.72:0/2139932737' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T15:02:05.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:05 smithi072 bash[28946]: cluster 2024-03-30T15:02:03.668480+0000 mgr.y (mgr.14152) 155 : cluster 0 pgmap v120: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:05.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:05 smithi072 bash[21573]: cluster 2024-03-30T15:02:03.668480+0000 mgr.y (mgr.14152) 155 : cluster 0 pgmap v120: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:05.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:05 smithi172 bash[23680]: cluster 2024-03-30T15:02:03.668480+0000 mgr.y (mgr.14152) 155 : cluster 0 pgmap v120: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:07.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:07 smithi072 bash[28946]: cluster 2024-03-30T15:02:05.668945+0000 mgr.y (mgr.14152) 156 : cluster 0 pgmap v121: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:07.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:07 smithi072 bash[21573]: cluster 2024-03-30T15:02:05.668945+0000 mgr.y (mgr.14152) 156 : cluster 0 pgmap v121: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:07.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:07 smithi172 bash[23680]: cluster 2024-03-30T15:02:05.668945+0000 mgr.y (mgr.14152) 156 : cluster 0 pgmap v121: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:09.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:09 smithi072 bash[21573]: cluster 2024-03-30T15:02:07.669368+0000 mgr.y (mgr.14152) 157 : cluster 0 pgmap v122: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:09.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:09 smithi072 bash[28946]: cluster 2024-03-30T15:02:07.669368+0000 mgr.y (mgr.14152) 157 : cluster 0 pgmap v122: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:09.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:09 smithi172 bash[23680]: cluster 2024-03-30T15:02:07.669368+0000 mgr.y (mgr.14152) 157 : cluster 0 pgmap v122: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:11.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:11 smithi072 bash[21573]: cluster 2024-03-30T15:02:09.669860+0000 mgr.y (mgr.14152) 158 : cluster 0 pgmap v123: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:11.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:11 smithi072 bash[28946]: cluster 2024-03-30T15:02:09.669860+0000 mgr.y (mgr.14152) 158 : cluster 0 pgmap v123: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:11.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:11 smithi172 bash[23680]: cluster 2024-03-30T15:02:09.669860+0000 mgr.y (mgr.14152) 158 : cluster 0 pgmap v123: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:12.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:12 smithi172 bash[23680]: cluster 2024-03-30T15:02:11.670371+0000 mgr.y (mgr.14152) 159 : cluster 0 pgmap v124: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:13.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:12 smithi072 bash[21573]: cluster 2024-03-30T15:02:11.670371+0000 mgr.y (mgr.14152) 159 : cluster 0 pgmap v124: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:13.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:12 smithi072 bash[28946]: cluster 2024-03-30T15:02:11.670371+0000 mgr.y (mgr.14152) 159 : cluster 0 pgmap v124: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:14.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:14 smithi172 bash[23680]: cluster 2024-03-30T15:02:13.670916+0000 mgr.y (mgr.14152) 160 : cluster 0 pgmap v125: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:14.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:14 smithi172 bash[23680]: audit 2024-03-30T15:02:14.671230+0000 mon.a (mon.0) 379 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-30T15:02:14.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:14 smithi172 bash[23680]: audit 2024-03-30T15:02:14.672893+0000 mon.a (mon.0) 380 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:02:15.093 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:14 smithi072 bash[21573]: cluster 2024-03-30T15:02:13.670916+0000 mgr.y (mgr.14152) 160 : cluster 0 pgmap v125: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:15.093 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:14 smithi072 bash[21573]: audit 2024-03-30T15:02:14.671230+0000 mon.a (mon.0) 379 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-30T15:02:15.093 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:14 smithi072 bash[21573]: audit 2024-03-30T15:02:14.672893+0000 mon.a (mon.0) 380 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:02:15.094 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:14 smithi072 bash[28946]: cluster 2024-03-30T15:02:13.670916+0000 mgr.y (mgr.14152) 160 : cluster 0 pgmap v125: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:15.094 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:14 smithi072 bash[28946]: audit 2024-03-30T15:02:14.671230+0000 mon.a (mon.0) 379 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-30T15:02:15.094 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:14 smithi072 bash[28946]: audit 2024-03-30T15:02:14.672893+0000 mon.a (mon.0) 380 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:02:15.952 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:15 smithi072 bash[21573]: cephadm 2024-03-30T15:02:14.674459+0000 mgr.y (mgr.14152) 161 : cephadm 1 Deploying daemon osd.2 on smithi072 2024-03-30T15:02:15.952 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:15 smithi072 bash[28946]: cephadm 2024-03-30T15:02:14.674459+0000 mgr.y (mgr.14152) 161 : cephadm 1 Deploying daemon osd.2 on smithi072 2024-03-30T15:02:15.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:15 smithi172 bash[23680]: cephadm 2024-03-30T15:02:14.674459+0000 mgr.y (mgr.14152) 161 : cephadm 1 Deploying daemon osd.2 on smithi072 2024-03-30T15:02:16.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:16 smithi172 bash[23680]: cluster 2024-03-30T15:02:15.671507+0000 mgr.y (mgr.14152) 162 : cluster 0 pgmap v126: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:17.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:16 smithi072 bash[21573]: cluster 2024-03-30T15:02:15.671507+0000 mgr.y (mgr.14152) 162 : cluster 0 pgmap v126: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:17.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:16 smithi072 bash[28946]: cluster 2024-03-30T15:02:15.671507+0000 mgr.y (mgr.14152) 162 : cluster 0 pgmap v126: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:18.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:18 smithi172 bash[23680]: cluster 2024-03-30T15:02:17.671891+0000 mgr.y (mgr.14152) 163 : cluster 0 pgmap v127: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:19.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:18 smithi072 bash[21573]: cluster 2024-03-30T15:02:17.671891+0000 mgr.y (mgr.14152) 163 : cluster 0 pgmap v127: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:19.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:18 smithi072 bash[28946]: cluster 2024-03-30T15:02:17.671891+0000 mgr.y (mgr.14152) 163 : cluster 0 pgmap v127: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:20.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:20 smithi172 bash[23680]: cluster 2024-03-30T15:02:19.672332+0000 mgr.y (mgr.14152) 164 : cluster 0 pgmap v128: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:21.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:20 smithi072 bash[21573]: cluster 2024-03-30T15:02:19.672332+0000 mgr.y (mgr.14152) 164 : cluster 0 pgmap v128: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:21.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:20 smithi072 bash[28946]: cluster 2024-03-30T15:02:19.672332+0000 mgr.y (mgr.14152) 164 : cluster 0 pgmap v128: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:22.344 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:22 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:02:22.345 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 30 15:02:22 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:02:22.345 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:22 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:02:22.345 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:02:22 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:02:22.346 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 30 15:02:22 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:02:22.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:22 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:02:22.672 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:02:22 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:02:22.672 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:22 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:02:22.672 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 30 15:02:22 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:02:22.672 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 30 15:02:22 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:02:22.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:22 smithi172 bash[23680]: cluster 2024-03-30T15:02:21.672822+0000 mgr.y (mgr.14152) 165 : cluster 0 pgmap v129: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:22.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:22 smithi172 bash[23680]: audit 2024-03-30T15:02:22.635337+0000 mon.a (mon.0) 381 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:02:22.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:22 smithi172 bash[23680]: audit 2024-03-30T15:02:22.643340+0000 mon.a (mon.0) 382 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:02:22.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:22 smithi172 bash[23680]: audit 2024-03-30T15:02:22.674318+0000 mon.a (mon.0) 383 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:02:23.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:22 smithi072 bash[21573]: cluster 2024-03-30T15:02:21.672822+0000 mgr.y (mgr.14152) 165 : cluster 0 pgmap v129: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:23.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:22 smithi072 bash[21573]: audit 2024-03-30T15:02:22.635337+0000 mon.a (mon.0) 381 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:02:23.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:22 smithi072 bash[21573]: audit 2024-03-30T15:02:22.643340+0000 mon.a (mon.0) 382 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:02:23.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:22 smithi072 bash[21573]: audit 2024-03-30T15:02:22.674318+0000 mon.a (mon.0) 383 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:02:23.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:22 smithi072 bash[28946]: cluster 2024-03-30T15:02:21.672822+0000 mgr.y (mgr.14152) 165 : cluster 0 pgmap v129: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:23.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:22 smithi072 bash[28946]: audit 2024-03-30T15:02:22.635337+0000 mon.a (mon.0) 381 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:02:23.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:22 smithi072 bash[28946]: audit 2024-03-30T15:02:22.643340+0000 mon.a (mon.0) 382 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:02:23.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:22 smithi072 bash[28946]: audit 2024-03-30T15:02:22.674318+0000 mon.a (mon.0) 383 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:02:24.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:24 smithi172 bash[23680]: cluster 2024-03-30T15:02:23.673153+0000 mgr.y (mgr.14152) 166 : cluster 0 pgmap v130: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:25.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:24 smithi072 bash[28946]: cluster 2024-03-30T15:02:23.673153+0000 mgr.y (mgr.14152) 166 : cluster 0 pgmap v130: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:25.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:24 smithi072 bash[21573]: cluster 2024-03-30T15:02:23.673153+0000 mgr.y (mgr.14152) 166 : cluster 0 pgmap v130: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:26.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:26 smithi172 bash[23680]: cluster 2024-03-30T15:02:25.673466+0000 mgr.y (mgr.14152) 167 : cluster 0 pgmap v131: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:27.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:26 smithi072 bash[21573]: cluster 2024-03-30T15:02:25.673466+0000 mgr.y (mgr.14152) 167 : cluster 0 pgmap v131: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:27.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:26 smithi072 bash[28946]: cluster 2024-03-30T15:02:25.673466+0000 mgr.y (mgr.14152) 167 : cluster 0 pgmap v131: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:28.965 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:28 smithi072 bash[21573]: cluster 2024-03-30T15:02:27.673717+0000 mgr.y (mgr.14152) 168 : cluster 0 pgmap v132: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:28.965 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:28 smithi072 bash[21573]: audit 2024-03-30T15:02:27.960635+0000 mon.a (mon.0) 384 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:02:28.965 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:28 smithi072 bash[21573]: audit 2024-03-30T15:02:27.968466+0000 mon.a (mon.0) 385 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:02:28.965 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:28 smithi072 bash[21573]: audit 2024-03-30T15:02:28.539593+0000 mon.a (mon.0) 386 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:02:28.965 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:28 smithi072 bash[21573]: audit 2024-03-30T15:02:28.540698+0000 mon.a (mon.0) 387 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:02:29.221 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:28 smithi172 bash[23680]: cluster 2024-03-30T15:02:27.673717+0000 mgr.y (mgr.14152) 168 : cluster 0 pgmap v132: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:29.221 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:28 smithi172 bash[23680]: audit 2024-03-30T15:02:27.960635+0000 mon.a (mon.0) 384 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:02:29.221 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:28 smithi172 bash[23680]: audit 2024-03-30T15:02:27.968466+0000 mon.a (mon.0) 385 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:02:29.221 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:28 smithi172 bash[23680]: audit 2024-03-30T15:02:28.539593+0000 mon.a (mon.0) 386 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:02:29.221 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:28 smithi172 bash[23680]: audit 2024-03-30T15:02:28.540698+0000 mon.a (mon.0) 387 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:02:29.221 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:28 smithi172 bash[23680]: audit 2024-03-30T15:02:28.545583+0000 mon.a (mon.0) 388 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:02:29.265 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:28 smithi072 bash[28946]: cluster 2024-03-30T15:02:27.673717+0000 mgr.y (mgr.14152) 168 : cluster 0 pgmap v132: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:29.266 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:28 smithi072 bash[28946]: audit 2024-03-30T15:02:27.960635+0000 mon.a (mon.0) 384 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:02:29.266 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:28 smithi072 bash[28946]: audit 2024-03-30T15:02:27.968466+0000 mon.a (mon.0) 385 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:02:29.266 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:28 smithi072 bash[28946]: audit 2024-03-30T15:02:28.539593+0000 mon.a (mon.0) 386 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:02:29.266 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:28 smithi072 bash[28946]: audit 2024-03-30T15:02:28.540698+0000 mon.a (mon.0) 387 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:02:29.266 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:28 smithi072 bash[28946]: audit 2024-03-30T15:02:28.545583+0000 mon.a (mon.0) 388 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:02:29.266 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:28 smithi072 bash[21573]: audit 2024-03-30T15:02:28.545583+0000 mon.a (mon.0) 388 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:02:30.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:29 smithi172 bash[23680]: audit 2024-03-30T15:02:29.210286+0000 mon.c (mon.2) 10 : audit 1 from='osd.2 [v2:172.21.15.72:6818/2674031198,v1:172.21.15.72:6819/2674031198]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-30T15:02:30.221 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:29 smithi172 bash[23680]: audit 2024-03-30T15:02:29.210663+0000 mon.a (mon.0) 389 : audit 1 from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-30T15:02:30.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:29 smithi072 bash[21573]: audit 2024-03-30T15:02:29.210286+0000 mon.c (mon.2) 10 : audit 1 from='osd.2 [v2:172.21.15.72:6818/2674031198,v1:172.21.15.72:6819/2674031198]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-30T15:02:30.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:29 smithi072 bash[21573]: audit 2024-03-30T15:02:29.210663+0000 mon.a (mon.0) 389 : audit 1 from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-30T15:02:30.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:29 smithi072 bash[28946]: audit 2024-03-30T15:02:29.210286+0000 mon.c (mon.2) 10 : audit 1 from='osd.2 [v2:172.21.15.72:6818/2674031198,v1:172.21.15.72:6819/2674031198]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-30T15:02:30.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:29 smithi072 bash[28946]: audit 2024-03-30T15:02:29.210663+0000 mon.a (mon.0) 389 : audit 1 from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-30T15:02:31.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:31.384+0000 7fb5e8ff9700 1 -- 172.21.15.72:0/4139359807 <== mgr.14152 v2:172.21.15.72:6800/2777002311 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb5ec06b080 con 0x7fb5d406dac0 2024-03-30T15:02:31.388 INFO:teuthology.orchestra.run.smithi072.stdout:Created osd(s) 2 on host 'smithi072' 2024-03-30T15:02:31.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:31.388+0000 7fb5f1d0e700 1 -- 172.21.15.72:0/4139359807 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fb5d406dac0 msgr2=0x7fb5d406ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:02:31.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:31.388+0000 7fb5f1d0e700 1 --2- 172.21.15.72:0/4139359807 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fb5d406dac0 0x7fb5d406ff80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc00c010 tx=0x7fb5dc019040 comp rx=0 tx=0).stop 2024-03-30T15:02:31.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:31.388+0000 7fb5f1d0e700 1 -- 172.21.15.72:0/4139359807 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5ec102d70 msgr2=0x7fb5ec19f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:02:31.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:31.388+0000 7fb5f1d0e700 1 --2- 172.21.15.72:0/4139359807 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5ec102d70 0x7fb5ec19f070 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb5e400ab70 tx=0x7fb5e400ae80 comp rx=0 tx=0).stop 2024-03-30T15:02:31.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:31.388+0000 7fb5f1d0e700 1 -- 172.21.15.72:0/4139359807 shutdown_connections 2024-03-30T15:02:31.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:31.388+0000 7fb5f1d0e700 1 --2- 172.21.15.72:0/4139359807 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fb5d406dac0 0x7fb5d406ff80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:02:31.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:31.388+0000 7fb5f1d0e700 1 --2- 172.21.15.72:0/4139359807 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5ec102d70 0x7fb5ec19f070 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:02:31.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:31.388+0000 7fb5f1d0e700 1 --2- 172.21.15.72:0/4139359807 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5ec1011d0 0x7fb5ec197b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:02:31.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:31.388+0000 7fb5f1d0e700 1 --2- 172.21.15.72:0/4139359807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5ec1023d0 0x7fb5ec198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:02:31.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:31.388+0000 7fb5f1d0e700 1 -- 172.21.15.72:0/4139359807 >> 172.21.15.72:0/4139359807 conn(0x7fb5ec0fc770 msgr2=0x7fb5ec06a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:02:31.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:31.392+0000 7fb5f1d0e700 1 -- 172.21.15.72:0/4139359807 shutdown_connections 2024-03-30T15:02:31.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:31.392+0000 7fb5f1d0e700 1 -- 172.21.15.72:0/4139359807 wait complete. 2024-03-30T15:02:31.409 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:30 smithi072 bash[28946]: cluster 2024-03-30T15:02:29.674146+0000 mgr.y (mgr.14152) 169 : cluster 0 pgmap v133: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:31.409 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:30 smithi072 bash[28946]: audit 2024-03-30T15:02:29.976834+0000 mon.a (mon.0) 390 : audit 1 from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-30T15:02:31.409 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:30 smithi072 bash[28946]: cluster 2024-03-30T15:02:29.982322+0000 mon.a (mon.0) 391 : cluster 0 osdmap e16: 3 total, 2 up, 3 in 2024-03-30T15:02:31.409 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:30 smithi072 bash[28946]: audit 2024-03-30T15:02:29.982824+0000 mon.a (mon.0) 392 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T15:02:31.409 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:30 smithi072 bash[28946]: audit 2024-03-30T15:02:29.985304+0000 mon.c (mon.2) 11 : audit 1 from='osd.2 [v2:172.21.15.72:6818/2674031198,v1:172.21.15.72:6819/2674031198]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-03-30T15:02:31.409 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:30 smithi072 bash[28946]: audit 2024-03-30T15:02:29.985982+0000 mon.a (mon.0) 393 : audit 1 from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-03-30T15:02:31.410 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:30 smithi072 bash[21573]: cluster 2024-03-30T15:02:29.674146+0000 mgr.y (mgr.14152) 169 : cluster 0 pgmap v133: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:31.410 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:30 smithi072 bash[21573]: audit 2024-03-30T15:02:29.976834+0000 mon.a (mon.0) 390 : audit 1 from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-30T15:02:31.410 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:30 smithi072 bash[21573]: cluster 2024-03-30T15:02:29.982322+0000 mon.a (mon.0) 391 : cluster 0 osdmap e16: 3 total, 2 up, 3 in 2024-03-30T15:02:31.410 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:30 smithi072 bash[21573]: audit 2024-03-30T15:02:29.982824+0000 mon.a (mon.0) 392 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T15:02:31.410 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:30 smithi072 bash[21573]: audit 2024-03-30T15:02:29.985304+0000 mon.c (mon.2) 11 : audit 1 from='osd.2 [v2:172.21.15.72:6818/2674031198,v1:172.21.15.72:6819/2674031198]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-03-30T15:02:31.410 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:30 smithi072 bash[21573]: audit 2024-03-30T15:02:29.985982+0000 mon.a (mon.0) 393 : audit 1 from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-03-30T15:02:31.471 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:30 smithi172 bash[23680]: cluster 2024-03-30T15:02:29.674146+0000 mgr.y (mgr.14152) 169 : cluster 0 pgmap v133: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:31.471 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:30 smithi172 bash[23680]: audit 2024-03-30T15:02:29.976834+0000 mon.a (mon.0) 390 : audit 1 from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-30T15:02:31.471 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:30 smithi172 bash[23680]: cluster 2024-03-30T15:02:29.982322+0000 mon.a (mon.0) 391 : cluster 0 osdmap e16: 3 total, 2 up, 3 in 2024-03-30T15:02:31.471 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:30 smithi172 bash[23680]: audit 2024-03-30T15:02:29.982824+0000 mon.a (mon.0) 392 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T15:02:31.471 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:30 smithi172 bash[23680]: audit 2024-03-30T15:02:29.985304+0000 mon.c (mon.2) 11 : audit 1 from='osd.2 [v2:172.21.15.72:6818/2674031198,v1:172.21.15.72:6819/2674031198]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-03-30T15:02:31.471 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:30 smithi172 bash[23680]: audit 2024-03-30T15:02:29.985982+0000 mon.a (mon.0) 393 : audit 1 from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-03-30T15:02:32.131 DEBUG:teuthology.orchestra.run.smithi072:osd.2> sudo journalctl -f -n 0 -u ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@osd.2.service 2024-03-30T15:02:32.134 INFO:tasks.cephadm:Deploying osd.3 on smithi072 with /dev/vg_nvme/lv_1... 2024-03-30T15:02:32.134 DEBUG:teuthology.orchestra.run.smithi072:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-03-30T15:02:32.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:31 smithi072 bash[28946]: audit 2024-03-30T15:02:30.979162+0000 mon.a (mon.0) 394 : audit 1 from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]': finished 2024-03-30T15:02:32.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:31 smithi072 bash[28946]: cluster 2024-03-30T15:02:30.984408+0000 mon.a (mon.0) 395 : cluster 0 osdmap e17: 3 total, 2 up, 3 in 2024-03-30T15:02:32.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:31 smithi072 bash[28946]: audit 2024-03-30T15:02:30.985577+0000 mon.a (mon.0) 396 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T15:02:32.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:31 smithi072 bash[28946]: audit 2024-03-30T15:02:30.997372+0000 mon.a (mon.0) 397 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T15:02:32.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:31 smithi072 bash[28946]: audit 2024-03-30T15:02:31.369430+0000 mon.a (mon.0) 398 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:02:32.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:31 smithi072 bash[28946]: audit 2024-03-30T15:02:31.370341+0000 mon.a (mon.0) 399 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:02:32.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:31 smithi072 bash[28946]: audit 2024-03-30T15:02:31.378632+0000 mon.a (mon.0) 400 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:02:32.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:31 smithi072 bash[28946]: audit 2024-03-30T15:02:31.488623+0000 mon.a (mon.0) 401 : audit 1 from='osd.2 ' entity='osd.2' 2024-03-30T15:02:32.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:31 smithi072 bash[21573]: audit 2024-03-30T15:02:30.979162+0000 mon.a (mon.0) 394 : audit 1 from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]': finished 2024-03-30T15:02:32.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:31 smithi072 bash[21573]: cluster 2024-03-30T15:02:30.984408+0000 mon.a (mon.0) 395 : cluster 0 osdmap e17: 3 total, 2 up, 3 in 2024-03-30T15:02:32.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:31 smithi072 bash[21573]: audit 2024-03-30T15:02:30.985577+0000 mon.a (mon.0) 396 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T15:02:32.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:31 smithi072 bash[21573]: audit 2024-03-30T15:02:30.997372+0000 mon.a (mon.0) 397 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T15:02:32.423 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:31 smithi072 bash[21573]: audit 2024-03-30T15:02:31.369430+0000 mon.a (mon.0) 398 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:02:32.423 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:31 smithi072 bash[21573]: audit 2024-03-30T15:02:31.370341+0000 mon.a (mon.0) 399 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:02:32.423 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:31 smithi072 bash[21573]: audit 2024-03-30T15:02:31.378632+0000 mon.a (mon.0) 400 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:02:32.423 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:31 smithi072 bash[21573]: audit 2024-03-30T15:02:31.488623+0000 mon.a (mon.0) 401 : audit 1 from='osd.2 ' entity='osd.2' 2024-03-30T15:02:32.471 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:31 smithi172 bash[23680]: audit 2024-03-30T15:02:30.979162+0000 mon.a (mon.0) 394 : audit 1 from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]': finished 2024-03-30T15:02:32.471 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:31 smithi172 bash[23680]: cluster 2024-03-30T15:02:30.984408+0000 mon.a (mon.0) 395 : cluster 0 osdmap e17: 3 total, 2 up, 3 in 2024-03-30T15:02:32.471 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:31 smithi172 bash[23680]: audit 2024-03-30T15:02:30.985577+0000 mon.a (mon.0) 396 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T15:02:32.471 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:31 smithi172 bash[23680]: audit 2024-03-30T15:02:30.997372+0000 mon.a (mon.0) 397 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T15:02:32.471 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:31 smithi172 bash[23680]: audit 2024-03-30T15:02:31.369430+0000 mon.a (mon.0) 398 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:02:32.471 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:31 smithi172 bash[23680]: audit 2024-03-30T15:02:31.370341+0000 mon.a (mon.0) 399 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:02:32.471 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:31 smithi172 bash[23680]: audit 2024-03-30T15:02:31.378632+0000 mon.a (mon.0) 400 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:02:32.471 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:31 smithi172 bash[23680]: audit 2024-03-30T15:02:31.488623+0000 mon.a (mon.0) 401 : audit 1 from='osd.2 ' entity='osd.2' 2024-03-30T15:02:33.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:32 smithi072 bash[28946]: cluster 2024-03-30T15:02:30.253102+0000 osd.2 (osd.2) 1 : cluster 0 purged_snaps scrub starts 2024-03-30T15:02:33.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:32 smithi072 bash[28946]: cluster 2024-03-30T15:02:30.253197+0000 osd.2 (osd.2) 2 : cluster 0 purged_snaps scrub ok 2024-03-30T15:02:33.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:32 smithi072 bash[28946]: cluster 2024-03-30T15:02:31.674682+0000 mgr.y (mgr.14152) 170 : cluster 0 pgmap v136: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:33.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:32 smithi072 bash[28946]: audit 2024-03-30T15:02:31.997363+0000 mon.a (mon.0) 402 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T15:02:33.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:32 smithi072 bash[28946]: cluster 2024-03-30T15:02:32.499918+0000 mon.a (mon.0) 403 : cluster 1 osd.2 [v2:172.21.15.72:6818/2674031198,v1:172.21.15.72:6819/2674031198] boot 2024-03-30T15:02:33.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:32 smithi072 bash[28946]: cluster 2024-03-30T15:02:32.500018+0000 mon.a (mon.0) 404 : cluster 0 osdmap e18: 3 total, 3 up, 3 in 2024-03-30T15:02:33.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:32 smithi072 bash[28946]: audit 2024-03-30T15:02:32.500194+0000 mon.a (mon.0) 405 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T15:02:33.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:32 smithi072 bash[21573]: cluster 2024-03-30T15:02:30.253102+0000 osd.2 (osd.2) 1 : cluster 0 purged_snaps scrub starts 2024-03-30T15:02:33.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:32 smithi072 bash[21573]: cluster 2024-03-30T15:02:30.253197+0000 osd.2 (osd.2) 2 : cluster 0 purged_snaps scrub ok 2024-03-30T15:02:33.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:32 smithi072 bash[21573]: cluster 2024-03-30T15:02:31.674682+0000 mgr.y (mgr.14152) 170 : cluster 0 pgmap v136: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:33.423 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:32 smithi072 bash[21573]: audit 2024-03-30T15:02:31.997363+0000 mon.a (mon.0) 402 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T15:02:33.423 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:32 smithi072 bash[21573]: cluster 2024-03-30T15:02:32.499918+0000 mon.a (mon.0) 403 : cluster 1 osd.2 [v2:172.21.15.72:6818/2674031198,v1:172.21.15.72:6819/2674031198] boot 2024-03-30T15:02:33.423 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:32 smithi072 bash[21573]: cluster 2024-03-30T15:02:32.500018+0000 mon.a (mon.0) 404 : cluster 0 osdmap e18: 3 total, 3 up, 3 in 2024-03-30T15:02:33.423 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:32 smithi072 bash[21573]: audit 2024-03-30T15:02:32.500194+0000 mon.a (mon.0) 405 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T15:02:33.471 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:32 smithi172 bash[23680]: cluster 2024-03-30T15:02:30.253102+0000 osd.2 (osd.2) 1 : cluster 0 purged_snaps scrub starts 2024-03-30T15:02:33.471 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:32 smithi172 bash[23680]: cluster 2024-03-30T15:02:30.253197+0000 osd.2 (osd.2) 2 : cluster 0 purged_snaps scrub ok 2024-03-30T15:02:33.471 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:32 smithi172 bash[23680]: cluster 2024-03-30T15:02:31.674682+0000 mgr.y (mgr.14152) 170 : cluster 0 pgmap v136: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-30T15:02:33.471 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:32 smithi172 bash[23680]: audit 2024-03-30T15:02:31.997363+0000 mon.a (mon.0) 402 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T15:02:33.471 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:32 smithi172 bash[23680]: cluster 2024-03-30T15:02:32.499918+0000 mon.a (mon.0) 403 : cluster 1 osd.2 [v2:172.21.15.72:6818/2674031198,v1:172.21.15.72:6819/2674031198] boot 2024-03-30T15:02:33.471 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:32 smithi172 bash[23680]: cluster 2024-03-30T15:02:32.500018+0000 mon.a (mon.0) 404 : cluster 0 osdmap e18: 3 total, 3 up, 3 in 2024-03-30T15:02:33.471 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:32 smithi172 bash[23680]: audit 2024-03-30T15:02:32.500194+0000 mon.a (mon.0) 405 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T15:02:34.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:34 smithi072 bash[21573]: audit 2024-03-30T15:02:33.825280+0000 mon.a (mon.0) 406 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:02:34.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:34 smithi072 bash[21573]: audit 2024-03-30T15:02:34.269913+0000 mon.a (mon.0) 407 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-03-30T15:02:34.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:34 smithi072 bash[21573]: cluster 2024-03-30T15:02:34.272892+0000 mon.a (mon.0) 408 : cluster 0 osdmap e19: 3 total, 3 up, 3 in 2024-03-30T15:02:34.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:34 smithi072 bash[21573]: audit 2024-03-30T15:02:34.273945+0000 mon.a (mon.0) 409 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:02:34.672 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:34 smithi072 bash[28946]: audit 2024-03-30T15:02:33.825280+0000 mon.a (mon.0) 406 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:02:34.672 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:34 smithi072 bash[28946]: audit 2024-03-30T15:02:34.269913+0000 mon.a (mon.0) 407 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-03-30T15:02:34.672 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:34 smithi072 bash[28946]: cluster 2024-03-30T15:02:34.272892+0000 mon.a (mon.0) 408 : cluster 0 osdmap e19: 3 total, 3 up, 3 in 2024-03-30T15:02:34.672 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:34 smithi072 bash[28946]: audit 2024-03-30T15:02:34.273945+0000 mon.a (mon.0) 409 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:02:34.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:34 smithi172 bash[23680]: audit 2024-03-30T15:02:33.825280+0000 mon.a (mon.0) 406 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:02:34.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:34 smithi172 bash[23680]: audit 2024-03-30T15:02:34.269913+0000 mon.a (mon.0) 407 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-03-30T15:02:34.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:34 smithi172 bash[23680]: cluster 2024-03-30T15:02:34.272892+0000 mon.a (mon.0) 408 : cluster 0 osdmap e19: 3 total, 3 up, 3 in 2024-03-30T15:02:34.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:34 smithi172 bash[23680]: audit 2024-03-30T15:02:34.273945+0000 mon.a (mon.0) 409 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:02:35.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:35 smithi072 bash[21573]: cluster 2024-03-30T15:02:33.675190+0000 mgr.y (mgr.14152) 171 : cluster 0 pgmap v138: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:02:35.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:35 smithi072 bash[21573]: audit 2024-03-30T15:02:35.272142+0000 mon.a (mon.0) 410 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-30T15:02:35.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:35 smithi072 bash[21573]: cluster 2024-03-30T15:02:35.278640+0000 mon.a (mon.0) 411 : cluster 0 osdmap e20: 3 total, 3 up, 3 in 2024-03-30T15:02:35.672 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:35 smithi072 bash[28946]: cluster 2024-03-30T15:02:33.675190+0000 mgr.y (mgr.14152) 171 : cluster 0 pgmap v138: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:02:35.672 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:35 smithi072 bash[28946]: audit 2024-03-30T15:02:35.272142+0000 mon.a (mon.0) 410 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-30T15:02:35.672 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:35 smithi072 bash[28946]: cluster 2024-03-30T15:02:35.278640+0000 mon.a (mon.0) 411 : cluster 0 osdmap e20: 3 total, 3 up, 3 in 2024-03-30T15:02:35.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:35 smithi172 bash[23680]: cluster 2024-03-30T15:02:33.675190+0000 mgr.y (mgr.14152) 171 : cluster 0 pgmap v138: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:02:35.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:35 smithi172 bash[23680]: audit 2024-03-30T15:02:35.272142+0000 mon.a (mon.0) 410 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-30T15:02:35.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:35 smithi172 bash[23680]: cluster 2024-03-30T15:02:35.278640+0000 mon.a (mon.0) 411 : cluster 0 osdmap e20: 3 total, 3 up, 3 in 2024-03-30T15:02:36.357 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T15:02:37.613 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:37 smithi072 bash[21573]: cluster 2024-03-30T15:02:35.675714+0000 mgr.y (mgr.14152) 172 : cluster 0 pgmap v141: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:02:37.613 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:37 smithi072 bash[21573]: cluster 2024-03-30T15:02:36.334260+0000 mon.a (mon.0) 412 : cluster 0 mgrmap e15: y(active, since 4m), standbys: x 2024-03-30T15:02:37.613 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:37 smithi072 bash[21573]: cluster 2024-03-30T15:02:36.334321+0000 mon.a (mon.0) 413 : cluster 0 osdmap e21: 3 total, 3 up, 3 in 2024-03-30T15:02:37.614 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:37 smithi072 bash[21573]: audit 2024-03-30T15:02:36.784077+0000 mon.a (mon.0) 414 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:02:37.614 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:37 smithi072 bash[28946]: cluster 2024-03-30T15:02:35.675714+0000 mgr.y (mgr.14152) 172 : cluster 0 pgmap v141: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:02:37.614 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:37 smithi072 bash[28946]: cluster 2024-03-30T15:02:36.334260+0000 mon.a (mon.0) 412 : cluster 0 mgrmap e15: y(active, since 4m), standbys: x 2024-03-30T15:02:37.614 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:37 smithi072 bash[28946]: cluster 2024-03-30T15:02:36.334321+0000 mon.a (mon.0) 413 : cluster 0 osdmap e21: 3 total, 3 up, 3 in 2024-03-30T15:02:37.614 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:37 smithi072 bash[28946]: audit 2024-03-30T15:02:36.784077+0000 mon.a (mon.0) 414 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:02:37.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:37 smithi172 bash[23680]: cluster 2024-03-30T15:02:35.675714+0000 mgr.y (mgr.14152) 172 : cluster 0 pgmap v141: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:02:37.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:37 smithi172 bash[23680]: cluster 2024-03-30T15:02:36.334260+0000 mon.a (mon.0) 412 : cluster 0 mgrmap e15: y(active, since 4m), standbys: x 2024-03-30T15:02:37.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:37 smithi172 bash[23680]: cluster 2024-03-30T15:02:36.334321+0000 mon.a (mon.0) 413 : cluster 0 osdmap e21: 3 total, 3 up, 3 in 2024-03-30T15:02:37.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:37 smithi172 bash[23680]: audit 2024-03-30T15:02:36.784077+0000 mon.a (mon.0) 414 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:02:40.630 INFO:teuthology.orchestra.run.smithi072.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-03-30T15:02:40.631 INFO:teuthology.orchestra.run.smithi072.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-03-30T15:02:40.631 INFO:teuthology.orchestra.run.smithi072.stderr: stderr: 10+0 records in 2024-03-30T15:02:40.631 INFO:teuthology.orchestra.run.smithi072.stderr:10+0 records out 2024-03-30T15:02:40.631 INFO:teuthology.orchestra.run.smithi072.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0165681 s, 633 MB/s 2024-03-30T15:02:40.631 INFO:teuthology.orchestra.run.smithi072.stderr:--> Zapping successful for: 2024-03-30T15:02:40.660 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:40 smithi072 bash[21573]: cluster 2024-03-30T15:02:37.676080+0000 mgr.y (mgr.14152) 173 : cluster 0 pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:02:40.660 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:40 smithi072 bash[21573]: audit 2024-03-30T15:02:38.575240+0000 mon.a (mon.0) 415 : audit 1 from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-30T15:02:40.660 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:40 smithi072 bash[21573]: audit 2024-03-30T15:02:39.430126+0000 mon.a (mon.0) 416 : audit 1 from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-30T15:02:40.660 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:40 smithi072 bash[21573]: audit 2024-03-30T15:02:39.431091+0000 mon.a (mon.0) 417 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T15:02:40.660 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:40 smithi072 bash[21573]: audit 2024-03-30T15:02:39.431475+0000 mon.a (mon.0) 418 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T15:02:40.660 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:40 smithi072 bash[21573]: audit 2024-03-30T15:02:39.431813+0000 mon.a (mon.0) 419 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T15:02:40.660 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:40 smithi072 bash[21573]: audit 2024-03-30T15:02:39.435092+0000 mon.a (mon.0) 420 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T15:02:40.660 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:40 smithi072 bash[21573]: audit 2024-03-30T15:02:39.435639+0000 mon.a (mon.0) 421 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T15:02:40.660 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:40 smithi072 bash[21573]: audit 2024-03-30T15:02:39.436147+0000 mon.a (mon.0) 422 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T15:02:40.661 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:40 smithi072 bash[28946]: cluster 2024-03-30T15:02:37.676080+0000 mgr.y (mgr.14152) 173 : cluster 0 pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:02:40.661 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:40 smithi072 bash[28946]: audit 2024-03-30T15:02:38.575240+0000 mon.a (mon.0) 415 : audit 1 from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-30T15:02:40.661 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:40 smithi072 bash[28946]: audit 2024-03-30T15:02:39.430126+0000 mon.a (mon.0) 416 : audit 1 from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-30T15:02:40.661 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:40 smithi072 bash[28946]: audit 2024-03-30T15:02:39.431091+0000 mon.a (mon.0) 417 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T15:02:40.661 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:40 smithi072 bash[28946]: audit 2024-03-30T15:02:39.431475+0000 mon.a (mon.0) 418 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T15:02:40.661 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:40 smithi072 bash[28946]: audit 2024-03-30T15:02:39.431813+0000 mon.a (mon.0) 419 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T15:02:40.661 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:40 smithi072 bash[28946]: audit 2024-03-30T15:02:39.435092+0000 mon.a (mon.0) 420 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T15:02:40.661 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:40 smithi072 bash[28946]: audit 2024-03-30T15:02:39.435639+0000 mon.a (mon.0) 421 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T15:02:40.661 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:40 smithi072 bash[28946]: audit 2024-03-30T15:02:39.436147+0000 mon.a (mon.0) 422 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T15:02:40.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:40 smithi172 bash[23680]: cluster 2024-03-30T15:02:37.676080+0000 mgr.y (mgr.14152) 173 : cluster 0 pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:02:40.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:40 smithi172 bash[23680]: audit 2024-03-30T15:02:38.575240+0000 mon.a (mon.0) 415 : audit 1 from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-30T15:02:40.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:40 smithi172 bash[23680]: audit 2024-03-30T15:02:39.430126+0000 mon.a (mon.0) 416 : audit 1 from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-30T15:02:40.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:40 smithi172 bash[23680]: audit 2024-03-30T15:02:39.431091+0000 mon.a (mon.0) 417 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T15:02:40.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:40 smithi172 bash[23680]: audit 2024-03-30T15:02:39.431475+0000 mon.a (mon.0) 418 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T15:02:40.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:40 smithi172 bash[23680]: audit 2024-03-30T15:02:39.431813+0000 mon.a (mon.0) 419 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T15:02:40.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:40 smithi172 bash[23680]: audit 2024-03-30T15:02:39.435092+0000 mon.a (mon.0) 420 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T15:02:40.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:40 smithi172 bash[23680]: audit 2024-03-30T15:02:39.435639+0000 mon.a (mon.0) 421 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T15:02:40.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:40 smithi172 bash[23680]: audit 2024-03-30T15:02:39.436147+0000 mon.a (mon.0) 422 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T15:02:41.530 DEBUG:teuthology.orchestra.run.smithi072:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi072:vg_nvme/lv_1 2024-03-30T15:02:41.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:41 smithi072 bash[28946]: audit 2024-03-30T15:02:39.435010+0000 mon.b (mon.1) 8 : audit 1 from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-30T15:02:41.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:41 smithi072 bash[28946]: cluster 2024-03-30T15:02:39.676643+0000 mgr.y (mgr.14152) 174 : cluster 0 pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:02:41.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:41 smithi072 bash[28946]: audit 2024-03-30T15:02:40.333783+0000 mon.b (mon.1) 9 : audit 1 from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-30T15:02:41.672 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:41 smithi072 bash[28946]: audit 2024-03-30T15:02:40.360781+0000 mon.a (mon.0) 423 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:02:41.672 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:41 smithi072 bash[28946]: audit 2024-03-30T15:02:40.363609+0000 mon.c (mon.2) 12 : audit 1 from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-30T15:02:41.672 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:41 smithi072 bash[28946]: audit 2024-03-30T15:02:40.363826+0000 mon.a (mon.0) 424 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T15:02:41.672 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:41 smithi072 bash[28946]: audit 2024-03-30T15:02:40.364012+0000 mon.a (mon.0) 425 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T15:02:41.672 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:41 smithi072 bash[28946]: audit 2024-03-30T15:02:40.364157+0000 mon.a (mon.0) 426 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T15:02:41.672 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:41 smithi072 bash[28946]: audit 2024-03-30T15:02:41.232381+0000 mon.c (mon.2) 13 : audit 1 from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-30T15:02:41.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:41 smithi072 bash[21573]: audit 2024-03-30T15:02:39.435010+0000 mon.b (mon.1) 8 : audit 1 from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-30T15:02:41.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:41 smithi072 bash[21573]: cluster 2024-03-30T15:02:39.676643+0000 mgr.y (mgr.14152) 174 : cluster 0 pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:02:41.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:41 smithi072 bash[21573]: audit 2024-03-30T15:02:40.333783+0000 mon.b (mon.1) 9 : audit 1 from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-30T15:02:41.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:41 smithi072 bash[21573]: audit 2024-03-30T15:02:40.360781+0000 mon.a (mon.0) 423 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:02:41.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:41 smithi072 bash[21573]: audit 2024-03-30T15:02:40.363609+0000 mon.c (mon.2) 12 : audit 1 from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-30T15:02:41.673 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:41 smithi072 bash[21573]: audit 2024-03-30T15:02:40.363826+0000 mon.a (mon.0) 424 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T15:02:41.673 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:41 smithi072 bash[21573]: audit 2024-03-30T15:02:40.364012+0000 mon.a (mon.0) 425 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T15:02:41.673 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:41 smithi072 bash[21573]: audit 2024-03-30T15:02:40.364157+0000 mon.a (mon.0) 426 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T15:02:41.673 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:41 smithi072 bash[21573]: audit 2024-03-30T15:02:41.232381+0000 mon.c (mon.2) 13 : audit 1 from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-30T15:02:41.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:41 smithi172 bash[23680]: audit 2024-03-30T15:02:39.435010+0000 mon.b (mon.1) 8 : audit 1 from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-30T15:02:41.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:41 smithi172 bash[23680]: cluster 2024-03-30T15:02:39.676643+0000 mgr.y (mgr.14152) 174 : cluster 0 pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:02:41.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:41 smithi172 bash[23680]: audit 2024-03-30T15:02:40.333783+0000 mon.b (mon.1) 9 : audit 1 from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-30T15:02:41.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:41 smithi172 bash[23680]: audit 2024-03-30T15:02:40.360781+0000 mon.a (mon.0) 423 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:02:41.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:41 smithi172 bash[23680]: audit 2024-03-30T15:02:40.363609+0000 mon.c (mon.2) 12 : audit 1 from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-30T15:02:41.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:41 smithi172 bash[23680]: audit 2024-03-30T15:02:40.363826+0000 mon.a (mon.0) 424 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T15:02:41.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:41 smithi172 bash[23680]: audit 2024-03-30T15:02:40.364012+0000 mon.a (mon.0) 425 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T15:02:41.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:41 smithi172 bash[23680]: audit 2024-03-30T15:02:40.364157+0000 mon.a (mon.0) 426 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T15:02:41.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:41 smithi172 bash[23680]: audit 2024-03-30T15:02:41.232381+0000 mon.c (mon.2) 13 : audit 1 from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-30T15:02:43.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:43 smithi072 bash[21573]: cluster 2024-03-30T15:02:41.677206+0000 mgr.y (mgr.14152) 175 : cluster 0 pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:02:43.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:43 smithi072 bash[21573]: cephadm 2024-03-30T15:02:42.116872+0000 mgr.y (mgr.14152) 176 : cephadm 1 Detected new or changed devices on smithi072 2024-03-30T15:02:43.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:43 smithi072 bash[21573]: audit 2024-03-30T15:02:42.125975+0000 mon.a (mon.0) 427 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:02:43.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:43 smithi072 bash[21573]: audit 2024-03-30T15:02:42.137842+0000 mon.a (mon.0) 428 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:02:43.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:43 smithi072 bash[21573]: audit 2024-03-30T15:02:42.140551+0000 mon.a (mon.0) 429 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:02:43.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:43 smithi072 bash[21573]: audit 2024-03-30T15:02:42.142321+0000 mon.a (mon.0) 430 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:02:43.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:43 smithi072 bash[21573]: audit 2024-03-30T15:02:42.143911+0000 mon.a (mon.0) 431 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:02:43.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:43 smithi072 bash[21573]: cephadm 2024-03-30T15:02:42.145200+0000 mgr.y (mgr.14152) 177 : cephadm 1 Adjusting osd_memory_target on smithi072 to 5413M 2024-03-30T15:02:43.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:43 smithi072 bash[21573]: audit 2024-03-30T15:02:42.151537+0000 mon.a (mon.0) 432 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:02:43.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:43 smithi072 bash[21573]: audit 2024-03-30T15:02:42.156062+0000 mon.a (mon.0) 433 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:02:43.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:43 smithi072 bash[21573]: audit 2024-03-30T15:02:42.157800+0000 mon.a (mon.0) 434 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:02:43.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:43 smithi072 bash[21573]: audit 2024-03-30T15:02:42.167096+0000 mon.a (mon.0) 435 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:02:43.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:43 smithi072 bash[28946]: cluster 2024-03-30T15:02:41.677206+0000 mgr.y (mgr.14152) 175 : cluster 0 pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:02:43.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:43 smithi072 bash[28946]: cephadm 2024-03-30T15:02:42.116872+0000 mgr.y (mgr.14152) 176 : cephadm 1 Detected new or changed devices on smithi072 2024-03-30T15:02:43.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:43 smithi072 bash[28946]: audit 2024-03-30T15:02:42.125975+0000 mon.a (mon.0) 427 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:02:43.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:43 smithi072 bash[28946]: audit 2024-03-30T15:02:42.137842+0000 mon.a (mon.0) 428 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:02:43.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:43 smithi072 bash[28946]: audit 2024-03-30T15:02:42.140551+0000 mon.a (mon.0) 429 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:02:43.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:43 smithi072 bash[28946]: audit 2024-03-30T15:02:42.142321+0000 mon.a (mon.0) 430 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:02:43.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:43 smithi072 bash[28946]: audit 2024-03-30T15:02:42.143911+0000 mon.a (mon.0) 431 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:02:43.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:43 smithi072 bash[28946]: cephadm 2024-03-30T15:02:42.145200+0000 mgr.y (mgr.14152) 177 : cephadm 1 Adjusting osd_memory_target on smithi072 to 5413M 2024-03-30T15:02:43.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:43 smithi072 bash[28946]: audit 2024-03-30T15:02:42.151537+0000 mon.a (mon.0) 432 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:02:43.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:43 smithi072 bash[28946]: audit 2024-03-30T15:02:42.156062+0000 mon.a (mon.0) 433 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:02:43.424 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:43 smithi072 bash[28946]: audit 2024-03-30T15:02:42.157800+0000 mon.a (mon.0) 434 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:02:43.424 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:43 smithi072 bash[28946]: audit 2024-03-30T15:02:42.167096+0000 mon.a (mon.0) 435 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:02:43.471 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:43 smithi172 bash[23680]: cluster 2024-03-30T15:02:41.677206+0000 mgr.y (mgr.14152) 175 : cluster 0 pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:02:43.471 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:43 smithi172 bash[23680]: cephadm 2024-03-30T15:02:42.116872+0000 mgr.y (mgr.14152) 176 : cephadm 1 Detected new or changed devices on smithi072 2024-03-30T15:02:43.471 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:43 smithi172 bash[23680]: audit 2024-03-30T15:02:42.125975+0000 mon.a (mon.0) 427 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:02:43.471 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:43 smithi172 bash[23680]: audit 2024-03-30T15:02:42.137842+0000 mon.a (mon.0) 428 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:02:43.471 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:43 smithi172 bash[23680]: audit 2024-03-30T15:02:42.140551+0000 mon.a (mon.0) 429 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:02:43.471 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:43 smithi172 bash[23680]: audit 2024-03-30T15:02:42.142321+0000 mon.a (mon.0) 430 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:02:43.471 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:43 smithi172 bash[23680]: audit 2024-03-30T15:02:42.143911+0000 mon.a (mon.0) 431 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:02:43.471 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:43 smithi172 bash[23680]: cephadm 2024-03-30T15:02:42.145200+0000 mgr.y (mgr.14152) 177 : cephadm 1 Adjusting osd_memory_target on smithi072 to 5413M 2024-03-30T15:02:43.471 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:43 smithi172 bash[23680]: audit 2024-03-30T15:02:42.151537+0000 mon.a (mon.0) 432 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:02:43.471 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:43 smithi172 bash[23680]: audit 2024-03-30T15:02:42.156062+0000 mon.a (mon.0) 433 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:02:43.471 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:43 smithi172 bash[23680]: audit 2024-03-30T15:02:42.157800+0000 mon.a (mon.0) 434 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:02:43.472 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:43 smithi172 bash[23680]: audit 2024-03-30T15:02:42.167096+0000 mon.a (mon.0) 435 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:02:45.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:45 smithi072 bash[21573]: cluster 2024-03-30T15:02:43.677766+0000 mgr.y (mgr.14152) 178 : cluster 0 pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-03-30T15:02:45.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:45 smithi072 bash[28946]: cluster 2024-03-30T15:02:43.677766+0000 mgr.y (mgr.14152) 178 : cluster 0 pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-03-30T15:02:45.470 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:45 smithi172 bash[23680]: cluster 2024-03-30T15:02:43.677766+0000 mgr.y (mgr.14152) 178 : cluster 0 pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-03-30T15:02:46.275 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T15:02:47.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:47 smithi072 bash[21573]: cluster 2024-03-30T15:02:45.678294+0000 mgr.y (mgr.14152) 179 : cluster 0 pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-03-30T15:02:47.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:47 smithi072 bash[28946]: cluster 2024-03-30T15:02:45.678294+0000 mgr.y (mgr.14152) 179 : cluster 0 pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-03-30T15:02:47.470 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:47 smithi172 bash[23680]: cluster 2024-03-30T15:02:45.678294+0000 mgr.y (mgr.14152) 179 : cluster 0 pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-03-30T15:02:48.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:48.807+0000 7ff5fa779700 1 -- 172.21.15.72:0/1921667858 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5f4103e70 msgr2=0x7ff5f410a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:02:48.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:48.807+0000 7ff5fa779700 1 --2- 172.21.15.72:0/1921667858 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5f4103e70 0x7ff5f410a720 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec00b0a0 tx=0x7ff5ec00b3b0 comp rx=0 tx=0).stop 2024-03-30T15:02:48.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:48.807+0000 7ff5fa779700 1 -- 172.21.15.72:0/1921667858 shutdown_connections 2024-03-30T15:02:48.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:48.807+0000 7ff5fa779700 1 --2- 172.21.15.72:0/1921667858 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5f4103e70 0x7ff5f410a720 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:02:48.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:48.807+0000 7ff5fa779700 1 --2- 172.21.15.72:0/1921667858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5f41022d0 0x7ff5f41026f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:02:48.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:48.807+0000 7ff5fa779700 1 --2- 172.21.15.72:0/1921667858 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5f41034d0 0x7ff5f4103930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:02:48.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:48.807+0000 7ff5fa779700 1 -- 172.21.15.72:0/1921667858 >> 172.21.15.72:0/1921667858 conn(0x7ff5f40fd870 msgr2=0x7ff5f40ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:02:48.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:48.807+0000 7ff5fa779700 1 -- 172.21.15.72:0/1921667858 shutdown_connections 2024-03-30T15:02:48.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:48.807+0000 7ff5fa779700 1 -- 172.21.15.72:0/1921667858 wait complete. 2024-03-30T15:02:48.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:48.807+0000 7ff5fa779700 1 Processor -- start 2024-03-30T15:02:48.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:48.807+0000 7ff5fa779700 1 -- start start 2024-03-30T15:02:48.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:48.807+0000 7ff5fa779700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5f41022d0 0x7ff5f41979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:02:48.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:48.807+0000 7ff5fa779700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5f41034d0 0x7ff5f4197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:02:48.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:48.807+0000 7ff5fa779700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5f4103e70 0x7ff5f419ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:02:48.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:48.807+0000 7ff5fa779700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f410d400 con 0x7ff5f41034d0 2024-03-30T15:02:48.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:48.807+0000 7ff5fa779700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f410d280 con 0x7ff5f41022d0 2024-03-30T15:02:48.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:48.807+0000 7ff5fa779700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7ff5f410d580 con 0x7ff5f4103e70 2024-03-30T15:02:48.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:48.807+0000 7ff5f37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5f41034d0 0x7ff5f4197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:02:48.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:48.807+0000 7ff5f37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5f41034d0 0x7ff5f4197ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47076/0 (socket says 172.21.15.72:47076) 2024-03-30T15:02:48.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:48.807+0000 7ff5f8d16700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5f4103e70 0x7ff5f419ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:02:48.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:48.807+0000 7ff5f37fe700 1 -- 172.21.15.72:0/896477465 learned_addr learned my addr 172.21.15.72:0/896477465 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T15:02:48.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:48.807+0000 7ff5f3fff700 1 --2- 172.21.15.72:0/896477465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5f41022d0 0x7ff5f41979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:02:48.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:48.807+0000 7ff5f37fe700 1 -- 172.21.15.72:0/896477465 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5f4103e70 msgr2=0x7ff5f419ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:02:48.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:48.807+0000 7ff5f37fe700 1 --2- 172.21.15.72:0/896477465 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5f4103e70 0x7ff5f419ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:02:48.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:48.807+0000 7ff5f37fe700 1 -- 172.21.15.72:0/896477465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5f41022d0 msgr2=0x7ff5f41979b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:02:48.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:48.807+0000 7ff5f37fe700 1 --2- 172.21.15.72:0/896477465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5f41022d0 0x7ff5f41979b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:02:48.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:48.807+0000 7ff5f37fe700 1 -- 172.21.15.72:0/896477465 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5f419f610 con 0x7ff5f41034d0 2024-03-30T15:02:48.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:48.807+0000 7ff5f37fe700 1 --2- 172.21.15.72:0/896477465 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5f41034d0 0x7ff5f4197ef0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc00eb60 tx=0x7ff5dc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:02:48.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:48.807+0000 7ff5f17fa700 1 -- 172.21.15.72:0/896477465 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc00cc90 con 0x7ff5f41034d0 2024-03-30T15:02:48.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:48.807+0000 7ff5f17fa700 1 -- 172.21.15.72:0/896477465 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7ff5dc00ce30 con 0x7ff5f41034d0 2024-03-30T15:02:48.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:48.807+0000 7ff5fa779700 1 -- 172.21.15.72:0/896477465 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5f419f900 con 0x7ff5f41034d0 2024-03-30T15:02:48.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:48.807+0000 7ff5f17fa700 1 -- 172.21.15.72:0/896477465 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc003e60 con 0x7ff5f41034d0 2024-03-30T15:02:48.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:48.807+0000 7ff5fa779700 1 -- 172.21.15.72:0/896477465 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5f419fe90 con 0x7ff5f41034d0 2024-03-30T15:02:48.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:48.811+0000 7ff5fa779700 1 -- 172.21.15.72:0/896477465 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5f404ff00 con 0x7ff5f41034d0 2024-03-30T15:02:48.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:48.811+0000 7ff5f17fa700 1 -- 172.21.15.72:0/896477465 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 15) ==== 91774+0+0 (secure 0 0 0) 0x7ff5dc004000 con 0x7ff5f41034d0 2024-03-30T15:02:48.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:48.811+0000 7ff5f17fa700 1 --2- 172.21.15.72:0/896477465 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7ff5d406db50 0x7ff5d4070010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:02:48.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:48.811+0000 7ff5f17fa700 1 -- 172.21.15.72:0/896477465 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3017+0+0 (secure 0 0 0) 0x7ff5dc08cf10 con 0x7ff5f41034d0 2024-03-30T15:02:48.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:48.811+0000 7ff5f3fff700 1 --2- 172.21.15.72:0/896477465 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7ff5d406db50 0x7ff5d4070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:02:48.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:48.811+0000 7ff5f3fff700 1 --2- 172.21.15.72:0/896477465 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7ff5d406db50 0x7ff5d4070010 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4005950 tx=0x7ff5e40058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:02:48.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:48.815+0000 7ff5f17fa700 1 -- 172.21.15.72:0/896477465 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7ff5dc05b720 con 0x7ff5f41034d0 2024-03-30T15:02:49.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:02:49.039+0000 7ff5fa779700 1 -- 172.21.15.72:0/896477465 --> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7ff5f4062680 con 0x7ff5d406db50 2024-03-30T15:02:49.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:49 smithi072 bash[28946]: cluster 2024-03-30T15:02:47.678833+0000 mgr.y (mgr.14152) 180 : cluster 0 pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-03-30T15:02:49.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:49 smithi072 bash[28946]: audit 2024-03-30T15:02:49.046921+0000 mon.a (mon.0) 436 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T15:02:49.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:49 smithi072 bash[28946]: audit 2024-03-30T15:02:49.053120+0000 mon.a (mon.0) 437 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T15:02:49.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:49 smithi072 bash[28946]: audit 2024-03-30T15:02:49.054350+0000 mon.a (mon.0) 438 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:02:49.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:49 smithi072 bash[21573]: cluster 2024-03-30T15:02:47.678833+0000 mgr.y (mgr.14152) 180 : cluster 0 pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-03-30T15:02:49.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:49 smithi072 bash[21573]: audit 2024-03-30T15:02:49.046921+0000 mon.a (mon.0) 436 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T15:02:49.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:49 smithi072 bash[21573]: audit 2024-03-30T15:02:49.053120+0000 mon.a (mon.0) 437 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T15:02:49.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:49 smithi072 bash[21573]: audit 2024-03-30T15:02:49.054350+0000 mon.a (mon.0) 438 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:02:49.470 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:49 smithi172 bash[23680]: cluster 2024-03-30T15:02:47.678833+0000 mgr.y (mgr.14152) 180 : cluster 0 pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-03-30T15:02:49.471 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:49 smithi172 bash[23680]: audit 2024-03-30T15:02:49.046921+0000 mon.a (mon.0) 436 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T15:02:49.471 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:49 smithi172 bash[23680]: audit 2024-03-30T15:02:49.053120+0000 mon.a (mon.0) 437 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T15:02:49.471 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:49 smithi172 bash[23680]: audit 2024-03-30T15:02:49.054350+0000 mon.a (mon.0) 438 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:02:50.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:50 smithi072 bash[21573]: audit 2024-03-30T15:02:49.043092+0000 mgr.y (mgr.14152) 181 : audit 0 from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T15:02:50.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:50 smithi072 bash[28946]: audit 2024-03-30T15:02:49.043092+0000 mgr.y (mgr.14152) 181 : audit 0 from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T15:02:50.470 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:50 smithi172 bash[23680]: audit 2024-03-30T15:02:49.043092+0000 mgr.y (mgr.14152) 181 : audit 0 from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T15:02:51.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:51 smithi072 bash[21573]: cluster 2024-03-30T15:02:49.679411+0000 mgr.y (mgr.14152) 182 : cluster 0 pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-03-30T15:02:51.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:51 smithi072 bash[28946]: cluster 2024-03-30T15:02:49.679411+0000 mgr.y (mgr.14152) 182 : cluster 0 pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-03-30T15:02:51.470 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:51 smithi172 bash[23680]: cluster 2024-03-30T15:02:49.679411+0000 mgr.y (mgr.14152) 182 : cluster 0 pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-03-30T15:02:53.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:53 smithi072 bash[21573]: cluster 2024-03-30T15:02:51.679957+0000 mgr.y (mgr.14152) 183 : cluster 0 pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-03-30T15:02:53.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:53 smithi072 bash[28946]: cluster 2024-03-30T15:02:51.679957+0000 mgr.y (mgr.14152) 183 : cluster 0 pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-03-30T15:02:53.470 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:53 smithi172 bash[23680]: cluster 2024-03-30T15:02:51.679957+0000 mgr.y (mgr.14152) 183 : cluster 0 pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-03-30T15:02:55.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:55 smithi072 bash[21573]: cluster 2024-03-30T15:02:53.680535+0000 mgr.y (mgr.14152) 184 : cluster 0 pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-03-30T15:02:55.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:55 smithi072 bash[28946]: cluster 2024-03-30T15:02:53.680535+0000 mgr.y (mgr.14152) 184 : cluster 0 pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-03-30T15:02:55.471 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:55 smithi172 bash[23680]: cluster 2024-03-30T15:02:53.680535+0000 mgr.y (mgr.14152) 184 : cluster 0 pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-03-30T15:02:57.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:57 smithi072 bash[21573]: cluster 2024-03-30T15:02:55.680981+0000 mgr.y (mgr.14152) 185 : cluster 0 pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:02:57.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:57 smithi072 bash[28946]: cluster 2024-03-30T15:02:55.680981+0000 mgr.y (mgr.14152) 185 : cluster 0 pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:02:57.470 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:57 smithi172 bash[23680]: cluster 2024-03-30T15:02:55.680981+0000 mgr.y (mgr.14152) 185 : cluster 0 pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:02:58.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:58 smithi072 bash[28946]: audit 2024-03-30T15:02:57.319744+0000 mon.a (mon.0) 439 : audit 1 from='client.? 172.21.15.72:0/3536847612' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72230afa-c7a7-4d66-8734-07deda2d3694"}]: dispatch 2024-03-30T15:02:58.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:58 smithi072 bash[28946]: audit 2024-03-30T15:02:57.322831+0000 mon.a (mon.0) 440 : audit 1 from='client.? 172.21.15.72:0/3536847612' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "72230afa-c7a7-4d66-8734-07deda2d3694"}]': finished 2024-03-30T15:02:58.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:58 smithi072 bash[28946]: cluster 2024-03-30T15:02:57.328482+0000 mon.a (mon.0) 441 : cluster 0 osdmap e22: 4 total, 3 up, 4 in 2024-03-30T15:02:58.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:58 smithi072 bash[28946]: audit 2024-03-30T15:02:57.328811+0000 mon.a (mon.0) 442 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T15:02:58.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:58 smithi072 bash[28946]: audit 2024-03-30T15:02:58.054786+0000 mon.c (mon.2) 14 : audit 0 from='client.? 172.21.15.72:0/3263196407' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T15:02:58.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:58 smithi072 bash[21573]: audit 2024-03-30T15:02:57.319744+0000 mon.a (mon.0) 439 : audit 1 from='client.? 172.21.15.72:0/3536847612' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72230afa-c7a7-4d66-8734-07deda2d3694"}]: dispatch 2024-03-30T15:02:58.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:58 smithi072 bash[21573]: audit 2024-03-30T15:02:57.322831+0000 mon.a (mon.0) 440 : audit 1 from='client.? 172.21.15.72:0/3536847612' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "72230afa-c7a7-4d66-8734-07deda2d3694"}]': finished 2024-03-30T15:02:58.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:58 smithi072 bash[21573]: cluster 2024-03-30T15:02:57.328482+0000 mon.a (mon.0) 441 : cluster 0 osdmap e22: 4 total, 3 up, 4 in 2024-03-30T15:02:58.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:58 smithi072 bash[21573]: audit 2024-03-30T15:02:57.328811+0000 mon.a (mon.0) 442 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T15:02:58.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:58 smithi072 bash[21573]: audit 2024-03-30T15:02:58.054786+0000 mon.c (mon.2) 14 : audit 0 from='client.? 172.21.15.72:0/3263196407' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T15:02:58.470 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:58 smithi172 bash[23680]: audit 2024-03-30T15:02:57.319744+0000 mon.a (mon.0) 439 : audit 1 from='client.? 172.21.15.72:0/3536847612' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72230afa-c7a7-4d66-8734-07deda2d3694"}]: dispatch 2024-03-30T15:02:58.470 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:58 smithi172 bash[23680]: audit 2024-03-30T15:02:57.322831+0000 mon.a (mon.0) 440 : audit 1 from='client.? 172.21.15.72:0/3536847612' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "72230afa-c7a7-4d66-8734-07deda2d3694"}]': finished 2024-03-30T15:02:58.471 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:58 smithi172 bash[23680]: cluster 2024-03-30T15:02:57.328482+0000 mon.a (mon.0) 441 : cluster 0 osdmap e22: 4 total, 3 up, 4 in 2024-03-30T15:02:58.471 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:58 smithi172 bash[23680]: audit 2024-03-30T15:02:57.328811+0000 mon.a (mon.0) 442 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T15:02:58.471 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:58 smithi172 bash[23680]: audit 2024-03-30T15:02:58.054786+0000 mon.c (mon.2) 14 : audit 0 from='client.? 172.21.15.72:0/3263196407' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T15:02:59.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:02:59 smithi072 bash[21573]: cluster 2024-03-30T15:02:57.681327+0000 mgr.y (mgr.14152) 186 : cluster 0 pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:02:59.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:02:59 smithi072 bash[28946]: cluster 2024-03-30T15:02:57.681327+0000 mgr.y (mgr.14152) 186 : cluster 0 pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:02:59.720 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:02:59 smithi172 bash[23680]: cluster 2024-03-30T15:02:57.681327+0000 mgr.y (mgr.14152) 186 : cluster 0 pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:03:01.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:01 smithi072 bash[21573]: cluster 2024-03-30T15:02:59.681787+0000 mgr.y (mgr.14152) 187 : cluster 0 pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:03:01.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:01 smithi072 bash[28946]: cluster 2024-03-30T15:02:59.681787+0000 mgr.y (mgr.14152) 187 : cluster 0 pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:03:01.720 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:01 smithi172 bash[23680]: cluster 2024-03-30T15:02:59.681787+0000 mgr.y (mgr.14152) 187 : cluster 0 pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:03:03.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:03 smithi072 bash[21573]: cluster 2024-03-30T15:03:01.682397+0000 mgr.y (mgr.14152) 188 : cluster 0 pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:03:03.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:03 smithi072 bash[28946]: cluster 2024-03-30T15:03:01.682397+0000 mgr.y (mgr.14152) 188 : cluster 0 pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:03:03.720 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:03 smithi172 bash[23680]: cluster 2024-03-30T15:03:01.682397+0000 mgr.y (mgr.14152) 188 : cluster 0 pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:03:05.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:05 smithi072 bash[21573]: cluster 2024-03-30T15:03:03.682932+0000 mgr.y (mgr.14152) 189 : cluster 0 pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:03:05.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:05 smithi072 bash[28946]: cluster 2024-03-30T15:03:03.682932+0000 mgr.y (mgr.14152) 189 : cluster 0 pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:03:05.720 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:05 smithi172 bash[23680]: cluster 2024-03-30T15:03:03.682932+0000 mgr.y (mgr.14152) 189 : cluster 0 pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:03:07.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:07 smithi072 bash[21573]: cluster 2024-03-30T15:03:05.683433+0000 mgr.y (mgr.14152) 190 : cluster 0 pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:03:07.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:07 smithi072 bash[28946]: cluster 2024-03-30T15:03:05.683433+0000 mgr.y (mgr.14152) 190 : cluster 0 pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:03:07.720 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:07 smithi172 bash[23680]: cluster 2024-03-30T15:03:05.683433+0000 mgr.y (mgr.14152) 190 : cluster 0 pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:03:09.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:09 smithi072 bash[21573]: cluster 2024-03-30T15:03:07.683962+0000 mgr.y (mgr.14152) 191 : cluster 0 pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:03:09.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:09 smithi072 bash[28946]: cluster 2024-03-30T15:03:07.683962+0000 mgr.y (mgr.14152) 191 : cluster 0 pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:03:09.720 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:09 smithi172 bash[23680]: cluster 2024-03-30T15:03:07.683962+0000 mgr.y (mgr.14152) 191 : cluster 0 pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:03:10.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:10 smithi072 bash[21573]: audit 2024-03-30T15:03:09.908695+0000 mon.a (mon.0) 443 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-30T15:03:10.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:10 smithi072 bash[21573]: audit 2024-03-30T15:03:09.910230+0000 mon.a (mon.0) 444 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:03:10.672 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:10 smithi072 bash[28946]: audit 2024-03-30T15:03:09.908695+0000 mon.a (mon.0) 443 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-30T15:03:10.672 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:10 smithi072 bash[28946]: audit 2024-03-30T15:03:09.910230+0000 mon.a (mon.0) 444 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:03:10.720 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:10 smithi172 bash[23680]: audit 2024-03-30T15:03:09.908695+0000 mon.a (mon.0) 443 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-30T15:03:10.720 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:10 smithi172 bash[23680]: audit 2024-03-30T15:03:09.910230+0000 mon.a (mon.0) 444 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:03:11.532 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:11 smithi072 bash[21573]: cluster 2024-03-30T15:03:09.684489+0000 mgr.y (mgr.14152) 192 : cluster 0 pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:03:11.533 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:11 smithi072 bash[21573]: cephadm 2024-03-30T15:03:09.911546+0000 mgr.y (mgr.14152) 193 : cephadm 1 Deploying daemon osd.3 on smithi072 2024-03-30T15:03:11.533 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:11 smithi072 bash[28946]: cluster 2024-03-30T15:03:09.684489+0000 mgr.y (mgr.14152) 192 : cluster 0 pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:03:11.533 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:11 smithi072 bash[28946]: cephadm 2024-03-30T15:03:09.911546+0000 mgr.y (mgr.14152) 193 : cephadm 1 Deploying daemon osd.3 on smithi072 2024-03-30T15:03:11.720 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:11 smithi172 bash[23680]: cluster 2024-03-30T15:03:09.684489+0000 mgr.y (mgr.14152) 192 : cluster 0 pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:03:11.720 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:11 smithi172 bash[23680]: cephadm 2024-03-30T15:03:09.911546+0000 mgr.y (mgr.14152) 193 : cephadm 1 Deploying daemon osd.3 on smithi072 2024-03-30T15:03:13.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:13 smithi072 bash[28946]: cluster 2024-03-30T15:03:11.685054+0000 mgr.y (mgr.14152) 194 : cluster 0 pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:03:13.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:13 smithi072 bash[21573]: cluster 2024-03-30T15:03:11.685054+0000 mgr.y (mgr.14152) 194 : cluster 0 pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:03:13.720 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:13 smithi172 bash[23680]: cluster 2024-03-30T15:03:11.685054+0000 mgr.y (mgr.14152) 194 : cluster 0 pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:03:14.290 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:14 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:03:14.290 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:03:14 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:03:14.290 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:14 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:03:14.291 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 30 15:03:14 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:03:14.291 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 30 15:03:14 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:03:14.291 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 30 15:03:14 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:03:14.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:14 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:03:14.671 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 30 15:03:14 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:03:14.671 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 30 15:03:14 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:03:14.672 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 30 15:03:14 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:03:14.672 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:03:14 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:03:14.672 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:14 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:03:15.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:15 smithi072 bash[28946]: cluster 2024-03-30T15:03:13.685538+0000 mgr.y (mgr.14152) 195 : cluster 0 pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:03:15.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:15 smithi072 bash[28946]: audit 2024-03-30T15:03:14.439456+0000 mon.a (mon.0) 445 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:03:15.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:15 smithi072 bash[28946]: audit 2024-03-30T15:03:14.444770+0000 mon.a (mon.0) 446 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:03:15.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:15 smithi072 bash[28946]: audit 2024-03-30T15:03:14.482094+0000 mon.a (mon.0) 447 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:03:15.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:15 smithi072 bash[21573]: cluster 2024-03-30T15:03:13.685538+0000 mgr.y (mgr.14152) 195 : cluster 0 pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:03:15.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:15 smithi072 bash[21573]: audit 2024-03-30T15:03:14.439456+0000 mon.a (mon.0) 445 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:03:15.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:15 smithi072 bash[21573]: audit 2024-03-30T15:03:14.444770+0000 mon.a (mon.0) 446 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:03:15.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:15 smithi072 bash[21573]: audit 2024-03-30T15:03:14.482094+0000 mon.a (mon.0) 447 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:03:15.720 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:15 smithi172 bash[23680]: cluster 2024-03-30T15:03:13.685538+0000 mgr.y (mgr.14152) 195 : cluster 0 pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:03:15.720 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:15 smithi172 bash[23680]: audit 2024-03-30T15:03:14.439456+0000 mon.a (mon.0) 445 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:03:15.720 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:15 smithi172 bash[23680]: audit 2024-03-30T15:03:14.444770+0000 mon.a (mon.0) 446 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:03:15.720 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:15 smithi172 bash[23680]: audit 2024-03-30T15:03:14.482094+0000 mon.a (mon.0) 447 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:03:17.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:17 smithi072 bash[21573]: cluster 2024-03-30T15:03:15.685920+0000 mgr.y (mgr.14152) 196 : cluster 0 pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:03:17.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:17 smithi072 bash[28946]: cluster 2024-03-30T15:03:15.685920+0000 mgr.y (mgr.14152) 196 : cluster 0 pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:03:17.720 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:17 smithi172 bash[23680]: cluster 2024-03-30T15:03:15.685920+0000 mgr.y (mgr.14152) 196 : cluster 0 pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:03:19.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:19 smithi072 bash[21573]: cluster 2024-03-30T15:03:17.686418+0000 mgr.y (mgr.14152) 197 : cluster 0 pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:03:19.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:19 smithi072 bash[28946]: cluster 2024-03-30T15:03:17.686418+0000 mgr.y (mgr.14152) 197 : cluster 0 pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:03:19.720 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:19 smithi172 bash[23680]: cluster 2024-03-30T15:03:17.686418+0000 mgr.y (mgr.14152) 197 : cluster 0 pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:03:20.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:20 smithi072 bash[21573]: cluster 2024-03-30T15:03:19.686784+0000 mgr.y (mgr.14152) 198 : cluster 0 pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:03:20.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:20 smithi072 bash[21573]: audit 2024-03-30T15:03:19.764408+0000 mon.a (mon.0) 448 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:03:20.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:20 smithi072 bash[21573]: audit 2024-03-30T15:03:19.771599+0000 mon.a (mon.0) 449 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:03:20.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:20 smithi072 bash[21573]: audit 2024-03-30T15:03:19.772579+0000 mon.a (mon.0) 450 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:03:20.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:20 smithi072 bash[21573]: audit 2024-03-30T15:03:19.773323+0000 mon.a (mon.0) 451 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:03:20.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:20 smithi072 bash[21573]: audit 2024-03-30T15:03:19.780812+0000 mon.a (mon.0) 452 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:03:20.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:20 smithi072 bash[28946]: cluster 2024-03-30T15:03:19.686784+0000 mgr.y (mgr.14152) 198 : cluster 0 pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:03:20.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:20 smithi072 bash[28946]: audit 2024-03-30T15:03:19.764408+0000 mon.a (mon.0) 448 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:03:20.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:20 smithi072 bash[28946]: audit 2024-03-30T15:03:19.771599+0000 mon.a (mon.0) 449 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:03:20.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:20 smithi072 bash[28946]: audit 2024-03-30T15:03:19.772579+0000 mon.a (mon.0) 450 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:03:20.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:20 smithi072 bash[28946]: audit 2024-03-30T15:03:19.773323+0000 mon.a (mon.0) 451 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:03:20.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:20 smithi072 bash[28946]: audit 2024-03-30T15:03:19.780812+0000 mon.a (mon.0) 452 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:03:21.222 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:20 smithi172 bash[23680]: cluster 2024-03-30T15:03:19.686784+0000 mgr.y (mgr.14152) 198 : cluster 0 pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:03:21.222 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:20 smithi172 bash[23680]: audit 2024-03-30T15:03:19.764408+0000 mon.a (mon.0) 448 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:03:21.222 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:20 smithi172 bash[23680]: audit 2024-03-30T15:03:19.771599+0000 mon.a (mon.0) 449 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:03:21.222 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:20 smithi172 bash[23680]: audit 2024-03-30T15:03:19.772579+0000 mon.a (mon.0) 450 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:03:21.222 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:20 smithi172 bash[23680]: audit 2024-03-30T15:03:19.773323+0000 mon.a (mon.0) 451 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:03:21.222 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:20 smithi172 bash[23680]: audit 2024-03-30T15:03:19.780812+0000 mon.a (mon.0) 452 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:03:22.039 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:21 smithi072 bash[21573]: audit 2024-03-30T15:03:20.949421+0000 mon.a (mon.0) 453 : audit 1 from='osd.3 [v2:172.21.15.72:6826/350059956,v1:172.21.15.72:6827/350059956]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-30T15:03:22.039 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:21 smithi072 bash[28946]: audit 2024-03-30T15:03:20.949421+0000 mon.a (mon.0) 453 : audit 1 from='osd.3 [v2:172.21.15.72:6826/350059956,v1:172.21.15.72:6827/350059956]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-30T15:03:22.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:21 smithi172 bash[23680]: audit 2024-03-30T15:03:20.949421+0000 mon.a (mon.0) 453 : audit 1 from='osd.3 [v2:172.21.15.72:6826/350059956,v1:172.21.15.72:6827/350059956]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-30T15:03:22.853 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:22 smithi072 bash[21573]: cluster 2024-03-30T15:03:21.687290+0000 mgr.y (mgr.14152) 199 : cluster 0 pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:03:22.854 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:22 smithi072 bash[21573]: audit 2024-03-30T15:03:21.779649+0000 mon.a (mon.0) 454 : audit 1 from='osd.3 [v2:172.21.15.72:6826/350059956,v1:172.21.15.72:6827/350059956]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-30T15:03:22.854 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:22 smithi072 bash[21573]: cluster 2024-03-30T15:03:21.786280+0000 mon.a (mon.0) 455 : cluster 0 osdmap e23: 4 total, 3 up, 4 in 2024-03-30T15:03:22.854 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:22 smithi072 bash[21573]: audit 2024-03-30T15:03:21.786760+0000 mon.a (mon.0) 456 : audit 1 from='osd.3 [v2:172.21.15.72:6826/350059956,v1:172.21.15.72:6827/350059956]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-03-30T15:03:22.854 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:22 smithi072 bash[21573]: audit 2024-03-30T15:03:21.787251+0000 mon.a (mon.0) 457 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T15:03:23.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:22 smithi072 bash[28946]: cluster 2024-03-30T15:03:21.687290+0000 mgr.y (mgr.14152) 199 : cluster 0 pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:03:23.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:22 smithi072 bash[28946]: audit 2024-03-30T15:03:21.779649+0000 mon.a (mon.0) 454 : audit 1 from='osd.3 [v2:172.21.15.72:6826/350059956,v1:172.21.15.72:6827/350059956]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-30T15:03:23.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:22 smithi072 bash[28946]: cluster 2024-03-30T15:03:21.786280+0000 mon.a (mon.0) 455 : cluster 0 osdmap e23: 4 total, 3 up, 4 in 2024-03-30T15:03:23.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:22 smithi072 bash[28946]: audit 2024-03-30T15:03:21.786760+0000 mon.a (mon.0) 456 : audit 1 from='osd.3 [v2:172.21.15.72:6826/350059956,v1:172.21.15.72:6827/350059956]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-03-30T15:03:23.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:22 smithi072 bash[28946]: audit 2024-03-30T15:03:21.787251+0000 mon.a (mon.0) 457 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T15:03:23.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:22 smithi172 bash[23680]: cluster 2024-03-30T15:03:21.687290+0000 mgr.y (mgr.14152) 199 : cluster 0 pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:03:23.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:22 smithi172 bash[23680]: audit 2024-03-30T15:03:21.779649+0000 mon.a (mon.0) 454 : audit 1 from='osd.3 [v2:172.21.15.72:6826/350059956,v1:172.21.15.72:6827/350059956]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-30T15:03:23.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:22 smithi172 bash[23680]: cluster 2024-03-30T15:03:21.786280+0000 mon.a (mon.0) 455 : cluster 0 osdmap e23: 4 total, 3 up, 4 in 2024-03-30T15:03:23.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:22 smithi172 bash[23680]: audit 2024-03-30T15:03:21.786760+0000 mon.a (mon.0) 456 : audit 1 from='osd.3 [v2:172.21.15.72:6826/350059956,v1:172.21.15.72:6827/350059956]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-03-30T15:03:23.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:22 smithi172 bash[23680]: audit 2024-03-30T15:03:21.787251+0000 mon.a (mon.0) 457 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T15:03:23.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:03:23.447+0000 7ff5f17fa700 1 -- 172.21.15.72:0/896477465 <== mgr.14152 v2:172.21.15.72:6800/2777002311 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff5f4062680 con 0x7ff5d406db50 2024-03-30T15:03:23.450 INFO:teuthology.orchestra.run.smithi072.stdout:Created osd(s) 3 on host 'smithi072' 2024-03-30T15:03:23.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:03:23.451+0000 7ff5fa779700 1 -- 172.21.15.72:0/896477465 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7ff5d406db50 msgr2=0x7ff5d4070010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:03:23.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:03:23.451+0000 7ff5fa779700 1 --2- 172.21.15.72:0/896477465 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7ff5d406db50 0x7ff5d4070010 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4005950 tx=0x7ff5e40058e0 comp rx=0 tx=0).stop 2024-03-30T15:03:23.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:03:23.451+0000 7ff5fa779700 1 -- 172.21.15.72:0/896477465 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5f41034d0 msgr2=0x7ff5f4197ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:03:23.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:03:23.451+0000 7ff5fa779700 1 --2- 172.21.15.72:0/896477465 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5f41034d0 0x7ff5f4197ef0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc00eb60 tx=0x7ff5dc00ee70 comp rx=0 tx=0).stop 2024-03-30T15:03:23.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:03:23.451+0000 7ff5fa779700 1 -- 172.21.15.72:0/896477465 shutdown_connections 2024-03-30T15:03:23.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:03:23.451+0000 7ff5fa779700 1 --2- 172.21.15.72:0/896477465 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7ff5d406db50 0x7ff5d4070010 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:03:23.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:03:23.451+0000 7ff5fa779700 1 --2- 172.21.15.72:0/896477465 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5f4103e70 0x7ff5f419ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:03:23.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:03:23.451+0000 7ff5fa779700 1 --2- 172.21.15.72:0/896477465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5f41022d0 0x7ff5f41979b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:03:23.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:03:23.451+0000 7ff5fa779700 1 --2- 172.21.15.72:0/896477465 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5f41034d0 0x7ff5f4197ef0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:03:23.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:03:23.451+0000 7ff5fa779700 1 -- 172.21.15.72:0/896477465 >> 172.21.15.72:0/896477465 conn(0x7ff5f40fd870 msgr2=0x7ff5f41067d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:03:23.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:03:23.451+0000 7ff5fa779700 1 -- 172.21.15.72:0/896477465 shutdown_connections 2024-03-30T15:03:23.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:03:23.451+0000 7ff5fa779700 1 -- 172.21.15.72:0/896477465 wait complete. 2024-03-30T15:03:24.134 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:23 smithi072 bash[21573]: audit 2024-03-30T15:03:22.783896+0000 mon.a (mon.0) 458 : audit 1 from='osd.3 [v2:172.21.15.72:6826/350059956,v1:172.21.15.72:6827/350059956]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]': finished 2024-03-30T15:03:24.134 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:23 smithi072 bash[21573]: cluster 2024-03-30T15:03:22.791293+0000 mon.a (mon.0) 459 : cluster 0 osdmap e24: 4 total, 3 up, 4 in 2024-03-30T15:03:24.134 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:23 smithi072 bash[21573]: audit 2024-03-30T15:03:22.796063+0000 mon.a (mon.0) 460 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T15:03:24.134 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:23 smithi072 bash[21573]: audit 2024-03-30T15:03:22.802571+0000 mon.a (mon.0) 461 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T15:03:24.134 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:23 smithi072 bash[21573]: audit 2024-03-30T15:03:23.308544+0000 mon.a (mon.0) 462 : audit 1 from='osd.3 [v2:172.21.15.72:6826/350059956,v1:172.21.15.72:6827/350059956]' entity='osd.3' 2024-03-30T15:03:24.134 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:23 smithi072 bash[21573]: audit 2024-03-30T15:03:23.421880+0000 mon.a (mon.0) 463 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:03:24.134 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:23 smithi072 bash[21573]: audit 2024-03-30T15:03:23.431752+0000 mon.a (mon.0) 464 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:03:24.134 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:23 smithi072 bash[21573]: audit 2024-03-30T15:03:23.452973+0000 mon.a (mon.0) 465 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:03:24.134 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:23 smithi072 bash[21573]: audit 2024-03-30T15:03:23.802049+0000 mon.a (mon.0) 466 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T15:03:24.135 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:23 smithi072 bash[28946]: audit 2024-03-30T15:03:22.783896+0000 mon.a (mon.0) 458 : audit 1 from='osd.3 [v2:172.21.15.72:6826/350059956,v1:172.21.15.72:6827/350059956]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]': finished 2024-03-30T15:03:24.135 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:23 smithi072 bash[28946]: cluster 2024-03-30T15:03:22.791293+0000 mon.a (mon.0) 459 : cluster 0 osdmap e24: 4 total, 3 up, 4 in 2024-03-30T15:03:24.135 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:23 smithi072 bash[28946]: audit 2024-03-30T15:03:22.796063+0000 mon.a (mon.0) 460 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T15:03:24.135 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:23 smithi072 bash[28946]: audit 2024-03-30T15:03:22.802571+0000 mon.a (mon.0) 461 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T15:03:24.135 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:23 smithi072 bash[28946]: audit 2024-03-30T15:03:23.308544+0000 mon.a (mon.0) 462 : audit 1 from='osd.3 [v2:172.21.15.72:6826/350059956,v1:172.21.15.72:6827/350059956]' entity='osd.3' 2024-03-30T15:03:24.135 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:23 smithi072 bash[28946]: audit 2024-03-30T15:03:23.421880+0000 mon.a (mon.0) 463 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:03:24.135 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:23 smithi072 bash[28946]: audit 2024-03-30T15:03:23.431752+0000 mon.a (mon.0) 464 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:03:24.135 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:23 smithi072 bash[28946]: audit 2024-03-30T15:03:23.452973+0000 mon.a (mon.0) 465 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:03:24.135 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:23 smithi072 bash[28946]: audit 2024-03-30T15:03:23.802049+0000 mon.a (mon.0) 466 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T15:03:24.136 DEBUG:teuthology.orchestra.run.smithi072:osd.3> sudo journalctl -f -n 0 -u ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@osd.3.service 2024-03-30T15:03:24.139 INFO:tasks.cephadm:Deploying osd.4 on smithi172 with /dev/vg_nvme/lv_4... 2024-03-30T15:03:24.140 DEBUG:teuthology.orchestra.run.smithi172:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-03-30T15:03:24.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:23 smithi172 bash[23680]: audit 2024-03-30T15:03:22.783896+0000 mon.a (mon.0) 458 : audit 1 from='osd.3 [v2:172.21.15.72:6826/350059956,v1:172.21.15.72:6827/350059956]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]': finished 2024-03-30T15:03:24.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:23 smithi172 bash[23680]: cluster 2024-03-30T15:03:22.791293+0000 mon.a (mon.0) 459 : cluster 0 osdmap e24: 4 total, 3 up, 4 in 2024-03-30T15:03:24.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:23 smithi172 bash[23680]: audit 2024-03-30T15:03:22.796063+0000 mon.a (mon.0) 460 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T15:03:24.152 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:23 smithi172 bash[23680]: audit 2024-03-30T15:03:22.802571+0000 mon.a (mon.0) 461 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T15:03:24.152 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:23 smithi172 bash[23680]: audit 2024-03-30T15:03:23.308544+0000 mon.a (mon.0) 462 : audit 1 from='osd.3 [v2:172.21.15.72:6826/350059956,v1:172.21.15.72:6827/350059956]' entity='osd.3' 2024-03-30T15:03:24.152 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:23 smithi172 bash[23680]: audit 2024-03-30T15:03:23.421880+0000 mon.a (mon.0) 463 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:03:24.152 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:23 smithi172 bash[23680]: audit 2024-03-30T15:03:23.431752+0000 mon.a (mon.0) 464 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:03:24.152 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:23 smithi172 bash[23680]: audit 2024-03-30T15:03:23.452973+0000 mon.a (mon.0) 465 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:03:24.152 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:23 smithi172 bash[23680]: audit 2024-03-30T15:03:23.802049+0000 mon.a (mon.0) 466 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T15:03:25.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:24 smithi072 bash[21573]: cluster 2024-03-30T15:03:21.960895+0000 osd.3 (osd.3) 1 : cluster 0 purged_snaps scrub starts 2024-03-30T15:03:25.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:24 smithi072 bash[21573]: cluster 2024-03-30T15:03:21.961050+0000 osd.3 (osd.3) 2 : cluster 0 purged_snaps scrub ok 2024-03-30T15:03:25.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:24 smithi072 bash[21573]: cluster 2024-03-30T15:03:23.687798+0000 mgr.y (mgr.14152) 200 : cluster 0 pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:03:25.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:24 smithi072 bash[21573]: cluster 2024-03-30T15:03:24.314936+0000 mon.a (mon.0) 467 : cluster 1 osd.3 [v2:172.21.15.72:6826/350059956,v1:172.21.15.72:6827/350059956] boot 2024-03-30T15:03:25.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:24 smithi072 bash[21573]: cluster 2024-03-30T15:03:24.315068+0000 mon.a (mon.0) 468 : cluster 0 osdmap e25: 4 total, 4 up, 4 in 2024-03-30T15:03:25.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:24 smithi072 bash[21573]: audit 2024-03-30T15:03:24.316130+0000 mon.a (mon.0) 469 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T15:03:25.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:24 smithi072 bash[28946]: cluster 2024-03-30T15:03:21.960895+0000 osd.3 (osd.3) 1 : cluster 0 purged_snaps scrub starts 2024-03-30T15:03:25.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:24 smithi072 bash[28946]: cluster 2024-03-30T15:03:21.961050+0000 osd.3 (osd.3) 2 : cluster 0 purged_snaps scrub ok 2024-03-30T15:03:25.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:24 smithi072 bash[28946]: cluster 2024-03-30T15:03:23.687798+0000 mgr.y (mgr.14152) 200 : cluster 0 pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:03:25.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:24 smithi072 bash[28946]: cluster 2024-03-30T15:03:24.314936+0000 mon.a (mon.0) 467 : cluster 1 osd.3 [v2:172.21.15.72:6826/350059956,v1:172.21.15.72:6827/350059956] boot 2024-03-30T15:03:25.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:24 smithi072 bash[28946]: cluster 2024-03-30T15:03:24.315068+0000 mon.a (mon.0) 468 : cluster 0 osdmap e25: 4 total, 4 up, 4 in 2024-03-30T15:03:25.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:24 smithi072 bash[28946]: audit 2024-03-30T15:03:24.316130+0000 mon.a (mon.0) 469 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T15:03:25.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:24 smithi172 bash[23680]: cluster 2024-03-30T15:03:21.960895+0000 osd.3 (osd.3) 1 : cluster 0 purged_snaps scrub starts 2024-03-30T15:03:25.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:24 smithi172 bash[23680]: cluster 2024-03-30T15:03:21.961050+0000 osd.3 (osd.3) 2 : cluster 0 purged_snaps scrub ok 2024-03-30T15:03:25.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:24 smithi172 bash[23680]: cluster 2024-03-30T15:03:23.687798+0000 mgr.y (mgr.14152) 200 : cluster 0 pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-30T15:03:25.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:24 smithi172 bash[23680]: cluster 2024-03-30T15:03:24.314936+0000 mon.a (mon.0) 467 : cluster 1 osd.3 [v2:172.21.15.72:6826/350059956,v1:172.21.15.72:6827/350059956] boot 2024-03-30T15:03:25.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:24 smithi172 bash[23680]: cluster 2024-03-30T15:03:24.315068+0000 mon.a (mon.0) 468 : cluster 0 osdmap e25: 4 total, 4 up, 4 in 2024-03-30T15:03:25.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:24 smithi172 bash[23680]: audit 2024-03-30T15:03:24.316130+0000 mon.a (mon.0) 469 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T15:03:27.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:26 smithi072 bash[21573]: cluster 2024-03-30T15:03:25.688326+0000 mgr.y (mgr.14152) 201 : cluster 0 pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:27.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:26 smithi072 bash[21573]: cluster 2024-03-30T15:03:25.847920+0000 mon.a (mon.0) 470 : cluster 0 osdmap e26: 4 total, 4 up, 4 in 2024-03-30T15:03:27.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:26 smithi072 bash[28946]: cluster 2024-03-30T15:03:25.688326+0000 mgr.y (mgr.14152) 201 : cluster 0 pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:27.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:26 smithi072 bash[28946]: cluster 2024-03-30T15:03:25.847920+0000 mon.a (mon.0) 470 : cluster 0 osdmap e26: 4 total, 4 up, 4 in 2024-03-30T15:03:27.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:26 smithi172 bash[23680]: cluster 2024-03-30T15:03:25.688326+0000 mgr.y (mgr.14152) 201 : cluster 0 pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:27.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:26 smithi172 bash[23680]: cluster 2024-03-30T15:03:25.847920+0000 mon.a (mon.0) 470 : cluster 0 osdmap e26: 4 total, 4 up, 4 in 2024-03-30T15:03:28.850 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.b/config 2024-03-30T15:03:29.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:28 smithi072 bash[21573]: cluster 2024-03-30T15:03:27.688926+0000 mgr.y (mgr.14152) 202 : cluster 0 pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:29.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:28 smithi072 bash[28946]: cluster 2024-03-30T15:03:27.688926+0000 mgr.y (mgr.14152) 202 : cluster 0 pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:29.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:28 smithi172 bash[23680]: cluster 2024-03-30T15:03:27.688926+0000 mgr.y (mgr.14152) 202 : cluster 0 pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:31.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:30 smithi072 bash[28946]: cluster 2024-03-30T15:03:29.689452+0000 mgr.y (mgr.14152) 203 : cluster 0 pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:31.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:30 smithi072 bash[21573]: cluster 2024-03-30T15:03:29.689452+0000 mgr.y (mgr.14152) 203 : cluster 0 pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:31.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:30 smithi172 bash[23680]: cluster 2024-03-30T15:03:29.689452+0000 mgr.y (mgr.14152) 203 : cluster 0 pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:31.556 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-03-30T15:03:31.556 INFO:teuthology.orchestra.run.smithi172.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-03-30T15:03:31.556 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 10+0 records in 2024-03-30T15:03:31.556 INFO:teuthology.orchestra.run.smithi172.stderr:10+0 records out 2024-03-30T15:03:31.556 INFO:teuthology.orchestra.run.smithi172.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0136503 s, 768 MB/s 2024-03-30T15:03:31.556 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping successful for: 2024-03-30T15:03:32.186 DEBUG:teuthology.orchestra.run.smithi172:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi172:vg_nvme/lv_4 2024-03-30T15:03:33.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:32 smithi072 bash[28946]: cluster 2024-03-30T15:03:31.689829+0000 mgr.y (mgr.14152) 204 : cluster 0 pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:33.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:32 smithi072 bash[28946]: audit 2024-03-30T15:03:32.800188+0000 mon.a (mon.0) 471 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:03:33.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:32 smithi072 bash[28946]: audit 2024-03-30T15:03:32.811178+0000 mon.a (mon.0) 472 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:03:33.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:32 smithi072 bash[28946]: audit 2024-03-30T15:03:32.813698+0000 mon.a (mon.0) 473 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:03:33.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:32 smithi072 bash[28946]: audit 2024-03-30T15:03:32.815411+0000 mon.a (mon.0) 474 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:03:33.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:32 smithi072 bash[28946]: audit 2024-03-30T15:03:32.817108+0000 mon.a (mon.0) 475 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:03:33.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:32 smithi072 bash[28946]: audit 2024-03-30T15:03:32.818738+0000 mon.a (mon.0) 476 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:03:33.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:32 smithi072 bash[28946]: audit 2024-03-30T15:03:32.830536+0000 mon.a (mon.0) 477 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:03:33.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:32 smithi072 bash[28946]: audit 2024-03-30T15:03:32.835975+0000 mon.a (mon.0) 478 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:03:33.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:32 smithi072 bash[28946]: audit 2024-03-30T15:03:32.837266+0000 mon.a (mon.0) 479 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:03:33.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:32 smithi072 bash[28946]: audit 2024-03-30T15:03:32.848472+0000 mon.a (mon.0) 480 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:03:33.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:32 smithi072 bash[21573]: cluster 2024-03-30T15:03:31.689829+0000 mgr.y (mgr.14152) 204 : cluster 0 pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:33.172 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:32 smithi072 bash[21573]: audit 2024-03-30T15:03:32.800188+0000 mon.a (mon.0) 471 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:03:33.173 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:32 smithi072 bash[21573]: audit 2024-03-30T15:03:32.811178+0000 mon.a (mon.0) 472 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:03:33.173 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:32 smithi072 bash[21573]: audit 2024-03-30T15:03:32.813698+0000 mon.a (mon.0) 473 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:03:33.173 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:32 smithi072 bash[21573]: audit 2024-03-30T15:03:32.815411+0000 mon.a (mon.0) 474 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:03:33.173 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:32 smithi072 bash[21573]: audit 2024-03-30T15:03:32.817108+0000 mon.a (mon.0) 475 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:03:33.173 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:32 smithi072 bash[21573]: audit 2024-03-30T15:03:32.818738+0000 mon.a (mon.0) 476 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:03:33.173 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:32 smithi072 bash[21573]: audit 2024-03-30T15:03:32.830536+0000 mon.a (mon.0) 477 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:03:33.173 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:32 smithi072 bash[21573]: audit 2024-03-30T15:03:32.835975+0000 mon.a (mon.0) 478 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:03:33.173 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:32 smithi072 bash[21573]: audit 2024-03-30T15:03:32.837266+0000 mon.a (mon.0) 479 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:03:33.173 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:32 smithi072 bash[21573]: audit 2024-03-30T15:03:32.848472+0000 mon.a (mon.0) 480 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:03:33.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:32 smithi172 bash[23680]: cluster 2024-03-30T15:03:31.689829+0000 mgr.y (mgr.14152) 204 : cluster 0 pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:33.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:32 smithi172 bash[23680]: audit 2024-03-30T15:03:32.800188+0000 mon.a (mon.0) 471 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:03:33.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:32 smithi172 bash[23680]: audit 2024-03-30T15:03:32.811178+0000 mon.a (mon.0) 472 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:03:33.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:32 smithi172 bash[23680]: audit 2024-03-30T15:03:32.813698+0000 mon.a (mon.0) 473 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:03:33.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:32 smithi172 bash[23680]: audit 2024-03-30T15:03:32.815411+0000 mon.a (mon.0) 474 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:03:33.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:32 smithi172 bash[23680]: audit 2024-03-30T15:03:32.817108+0000 mon.a (mon.0) 475 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:03:33.221 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:32 smithi172 bash[23680]: audit 2024-03-30T15:03:32.818738+0000 mon.a (mon.0) 476 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:03:33.221 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:32 smithi172 bash[23680]: audit 2024-03-30T15:03:32.830536+0000 mon.a (mon.0) 477 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:03:33.221 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:32 smithi172 bash[23680]: audit 2024-03-30T15:03:32.835975+0000 mon.a (mon.0) 478 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:03:33.221 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:32 smithi172 bash[23680]: audit 2024-03-30T15:03:32.837266+0000 mon.a (mon.0) 479 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:03:33.221 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:32 smithi172 bash[23680]: audit 2024-03-30T15:03:32.848472+0000 mon.a (mon.0) 480 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:03:34.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:33 smithi072 bash[21573]: cephadm 2024-03-30T15:03:32.792638+0000 mgr.y (mgr.14152) 205 : cephadm 1 Detected new or changed devices on smithi072 2024-03-30T15:03:34.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:33 smithi072 bash[21573]: cephadm 2024-03-30T15:03:32.819918+0000 mgr.y (mgr.14152) 206 : cephadm 1 Adjusting osd_memory_target on smithi072 to 4060M 2024-03-30T15:03:34.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:33 smithi072 bash[28946]: cephadm 2024-03-30T15:03:32.792638+0000 mgr.y (mgr.14152) 205 : cephadm 1 Detected new or changed devices on smithi072 2024-03-30T15:03:34.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:33 smithi072 bash[28946]: cephadm 2024-03-30T15:03:32.819918+0000 mgr.y (mgr.14152) 206 : cephadm 1 Adjusting osd_memory_target on smithi072 to 4060M 2024-03-30T15:03:34.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:33 smithi172 bash[23680]: cephadm 2024-03-30T15:03:32.792638+0000 mgr.y (mgr.14152) 205 : cephadm 1 Detected new or changed devices on smithi072 2024-03-30T15:03:34.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:33 smithi172 bash[23680]: cephadm 2024-03-30T15:03:32.819918+0000 mgr.y (mgr.14152) 206 : cephadm 1 Adjusting osd_memory_target on smithi072 to 4060M 2024-03-30T15:03:35.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:34 smithi072 bash[21573]: cluster 2024-03-30T15:03:33.690401+0000 mgr.y (mgr.14152) 207 : cluster 0 pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:35.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:34 smithi072 bash[28946]: cluster 2024-03-30T15:03:33.690401+0000 mgr.y (mgr.14152) 207 : cluster 0 pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:35.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:34 smithi172 bash[23680]: cluster 2024-03-30T15:03:33.690401+0000 mgr.y (mgr.14152) 207 : cluster 0 pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:36.935 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.b/config 2024-03-30T15:03:37.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:36 smithi072 bash[21573]: cluster 2024-03-30T15:03:35.690878+0000 mgr.y (mgr.14152) 208 : cluster 0 pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:37.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:36 smithi072 bash[28946]: cluster 2024-03-30T15:03:35.690878+0000 mgr.y (mgr.14152) 208 : cluster 0 pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:37.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:36 smithi172 bash[23680]: cluster 2024-03-30T15:03:35.690878+0000 mgr.y (mgr.14152) 208 : cluster 0 pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:39.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:38 smithi072 bash[21573]: cluster 2024-03-30T15:03:37.691404+0000 mgr.y (mgr.14152) 209 : cluster 0 pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:39.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:38 smithi072 bash[28946]: cluster 2024-03-30T15:03:37.691404+0000 mgr.y (mgr.14152) 209 : cluster 0 pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:39.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:03:39.192+0000 7f017e657700 1 -- 172.21.15.172:0/2032596859 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0178100920 msgr2=0x7f0178107a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:03:39.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:03:39.192+0000 7f017e657700 1 --2- 172.21.15.172:0/2032596859 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0178100920 0x7f0178107a70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0168009990 tx=0x7f0168009ca0 comp rx=0 tx=0).stop 2024-03-30T15:03:39.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:03:39.192+0000 7f017e657700 1 -- 172.21.15.172:0/2032596859 shutdown_connections 2024-03-30T15:03:39.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:03:39.192+0000 7f017e657700 1 --2- 172.21.15.172:0/2032596859 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0178107fb0 0x7f017810a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:03:39.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:03:39.192+0000 7f017e657700 1 --2- 172.21.15.172:0/2032596859 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01780fff30 0x7f0178100350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:03:39.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:03:39.192+0000 7f017e657700 1 --2- 172.21.15.172:0/2032596859 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0178100920 0x7f0178107a70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:03:39.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:03:39.192+0000 7f017e657700 1 -- 172.21.15.172:0/2032596859 >> 172.21.15.172:0/2032596859 conn(0x7f01780fbaa0 msgr2=0x7f01780fdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:03:39.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:03:39.192+0000 7f017e657700 1 -- 172.21.15.172:0/2032596859 shutdown_connections 2024-03-30T15:03:39.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:03:39.192+0000 7f017e657700 1 -- 172.21.15.172:0/2032596859 wait complete. 2024-03-30T15:03:39.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:03:39.192+0000 7f017e657700 1 Processor -- start 2024-03-30T15:03:39.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:03:39.192+0000 7f017e657700 1 -- start start 2024-03-30T15:03:39.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:03:39.192+0000 7f017e657700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01780fff30 0x7f0178197b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:03:39.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:03:39.192+0000 7f017e657700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0178100920 0x7f0178198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:03:39.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:03:39.192+0000 7f017e657700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0178107fb0 0x7f017819f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:03:39.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:03:39.192+0000 7f017e657700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f017810d430 con 0x7f0178100920 2024-03-30T15:03:39.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:03:39.192+0000 7f017e657700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f017810d2b0 con 0x7f0178107fb0 2024-03-30T15:03:39.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:03:39.192+0000 7f017e657700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f017810d5b0 con 0x7f01780fff30 2024-03-30T15:03:39.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:03:39.192+0000 7f017cbf4700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0178107fb0 0x7f017819f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:03:39.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:03:39.192+0000 7f017cbf4700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0178107fb0 0x7f017819f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54668/0 (socket says 172.21.15.172:54668) 2024-03-30T15:03:39.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:03:39.192+0000 7f017cbf4700 1 -- 172.21.15.172:0/436428142 learned_addr learned my addr 172.21.15.172:0/436428142 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-03-30T15:03:39.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:03:39.192+0000 7f0177fff700 1 --2- 172.21.15.172:0/436428142 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01780fff30 0x7f0178197b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:03:39.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:03:39.192+0000 7f01777fe700 1 --2- 172.21.15.172:0/436428142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0178100920 0x7f0178198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:03:39.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:03:39.192+0000 7f017cbf4700 1 -- 172.21.15.172:0/436428142 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01780fff30 msgr2=0x7f0178197b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:03:39.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:03:39.192+0000 7f017cbf4700 1 --2- 172.21.15.172:0/436428142 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01780fff30 0x7f0178197b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:03:39.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:03:39.192+0000 7f017cbf4700 1 -- 172.21.15.172:0/436428142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0178100920 msgr2=0x7f0178198050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:03:39.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:03:39.192+0000 7f017cbf4700 1 --2- 172.21.15.172:0/436428142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0178100920 0x7f0178198050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:03:39.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:03:39.192+0000 7f017cbf4700 1 -- 172.21.15.172:0/436428142 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f017819f770 con 0x7f0178107fb0 2024-03-30T15:03:39.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:03:39.192+0000 7f01777fe700 1 --2- 172.21.15.172:0/436428142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0178100920 0x7f0178198050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T15:03:39.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:03:39.192+0000 7f017cbf4700 1 --2- 172.21.15.172:0/436428142 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0178107fb0 0x7f017819f0d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f017000b970 tx=0x7f017000bd30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:03:39.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:03:39.196+0000 7f01757fa700 1 -- 172.21.15.172:0/436428142 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0170019070 con 0x7f0178107fb0 2024-03-30T15:03:39.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:03:39.196+0000 7f01757fa700 1 -- 172.21.15.172:0/436428142 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f017000ce30 con 0x7f0178107fb0 2024-03-30T15:03:39.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:03:39.196+0000 7f017e657700 1 -- 172.21.15.172:0/436428142 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f017819fa60 con 0x7f0178107fb0 2024-03-30T15:03:39.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:03:39.196+0000 7f01757fa700 1 -- 172.21.15.172:0/436428142 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0170007370 con 0x7f0178107fb0 2024-03-30T15:03:39.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:03:39.196+0000 7f017e657700 1 -- 172.21.15.172:0/436428142 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01781a0070 con 0x7f0178107fb0 2024-03-30T15:03:39.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:03:39.196+0000 7f017e657700 1 -- 172.21.15.172:0/436428142 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f017804ff00 con 0x7f0178107fb0 2024-03-30T15:03:39.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:03:39.196+0000 7f01757fa700 1 -- 172.21.15.172:0/436428142 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 15) ==== 91774+0+0 (secure 0 0 0) 0x7f017001c070 con 0x7f0178107fb0 2024-03-30T15:03:39.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:03:39.196+0000 7f01757fa700 1 --2- 172.21.15.172:0/436428142 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f016006db50 0x7f0160070010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:03:39.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:03:39.196+0000 7f01757fa700 1 -- 172.21.15.172:0/436428142 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3449+0+0 (secure 0 0 0) 0x7f017008c520 con 0x7f0178107fb0 2024-03-30T15:03:39.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:03:39.196+0000 7f0177fff700 1 --2- 172.21.15.172:0/436428142 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f016006db50 0x7f0160070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:03:39.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:03:39.196+0000 7f0177fff700 1 --2- 172.21.15.172:0/436428142 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f016006db50 0x7f0160070010 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f016c006fd0 tx=0x7f016c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:03:39.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:03:39.200+0000 7f01757fa700 1 -- 172.21.15.172:0/436428142 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f017005ab80 con 0x7f0178107fb0 2024-03-30T15:03:39.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:38 smithi172 bash[23680]: cluster 2024-03-30T15:03:37.691404+0000 mgr.y (mgr.14152) 209 : cluster 0 pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:39.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:03:39.416+0000 7f017e657700 1 -- 172.21.15.172:0/436428142 --> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f017802ddf0 con 0x7f016006db50 2024-03-30T15:03:40.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:39 smithi072 bash[21573]: audit 2024-03-30T15:03:39.422204+0000 mgr.y (mgr.14152) 210 : audit 0 from='client.24181 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T15:03:40.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:39 smithi072 bash[21573]: audit 2024-03-30T15:03:39.429565+0000 mon.a (mon.0) 481 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T15:03:40.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:39 smithi072 bash[21573]: audit 2024-03-30T15:03:39.435895+0000 mon.a (mon.0) 482 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T15:03:40.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:39 smithi072 bash[21573]: audit 2024-03-30T15:03:39.437607+0000 mon.a (mon.0) 483 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:03:40.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:39 smithi072 bash[28946]: audit 2024-03-30T15:03:39.422204+0000 mgr.y (mgr.14152) 210 : audit 0 from='client.24181 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T15:03:40.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:39 smithi072 bash[28946]: audit 2024-03-30T15:03:39.429565+0000 mon.a (mon.0) 481 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T15:03:40.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:39 smithi072 bash[28946]: audit 2024-03-30T15:03:39.435895+0000 mon.a (mon.0) 482 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T15:03:40.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:39 smithi072 bash[28946]: audit 2024-03-30T15:03:39.437607+0000 mon.a (mon.0) 483 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:03:40.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:39 smithi172 bash[23680]: audit 2024-03-30T15:03:39.422204+0000 mgr.y (mgr.14152) 210 : audit 0 from='client.24181 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T15:03:40.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:39 smithi172 bash[23680]: audit 2024-03-30T15:03:39.429565+0000 mon.a (mon.0) 481 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T15:03:40.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:39 smithi172 bash[23680]: audit 2024-03-30T15:03:39.435895+0000 mon.a (mon.0) 482 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T15:03:40.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:39 smithi172 bash[23680]: audit 2024-03-30T15:03:39.437607+0000 mon.a (mon.0) 483 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:03:41.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:40 smithi072 bash[21573]: cluster 2024-03-30T15:03:39.691902+0000 mgr.y (mgr.14152) 211 : cluster 0 pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:41.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:40 smithi072 bash[28946]: cluster 2024-03-30T15:03:39.691902+0000 mgr.y (mgr.14152) 211 : cluster 0 pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:41.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:40 smithi172 bash[23680]: cluster 2024-03-30T15:03:39.691902+0000 mgr.y (mgr.14152) 211 : cluster 0 pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:43.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:42 smithi072 bash[21573]: cluster 2024-03-30T15:03:41.692377+0000 mgr.y (mgr.14152) 212 : cluster 0 pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:43.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:42 smithi072 bash[28946]: cluster 2024-03-30T15:03:41.692377+0000 mgr.y (mgr.14152) 212 : cluster 0 pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:43.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:42 smithi172 bash[23680]: cluster 2024-03-30T15:03:41.692377+0000 mgr.y (mgr.14152) 212 : cluster 0 pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:45.159 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:44 smithi172 bash[23680]: cluster 2024-03-30T15:03:43.692950+0000 mgr.y (mgr.14152) 213 : cluster 0 pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:45.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:44 smithi072 bash[21573]: cluster 2024-03-30T15:03:43.692950+0000 mgr.y (mgr.14152) 213 : cluster 0 pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:45.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:44 smithi072 bash[28946]: cluster 2024-03-30T15:03:43.692950+0000 mgr.y (mgr.14152) 213 : cluster 0 pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:47.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:46 smithi072 bash[21573]: cluster 2024-03-30T15:03:45.693463+0000 mgr.y (mgr.14152) 214 : cluster 0 pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:47.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:46 smithi072 bash[28946]: cluster 2024-03-30T15:03:45.693463+0000 mgr.y (mgr.14152) 214 : cluster 0 pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:47.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:46 smithi172 bash[23680]: cluster 2024-03-30T15:03:45.693463+0000 mgr.y (mgr.14152) 214 : cluster 0 pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:48.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:47 smithi072 bash[21573]: audit 2024-03-30T15:03:47.482556+0000 mon.b (mon.1) 10 : audit 1 from='client.? 172.21.15.172:0/3917144128' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7676e52-a936-4419-8e88-511820cd1355"}]: dispatch 2024-03-30T15:03:48.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:47 smithi072 bash[21573]: audit 2024-03-30T15:03:47.482728+0000 mon.a (mon.0) 484 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7676e52-a936-4419-8e88-511820cd1355"}]: dispatch 2024-03-30T15:03:48.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:47 smithi072 bash[21573]: audit 2024-03-30T15:03:47.486040+0000 mon.a (mon.0) 485 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c7676e52-a936-4419-8e88-511820cd1355"}]': finished 2024-03-30T15:03:48.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:47 smithi072 bash[21573]: cluster 2024-03-30T15:03:47.491755+0000 mon.a (mon.0) 486 : cluster 0 osdmap e27: 5 total, 4 up, 5 in 2024-03-30T15:03:48.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:47 smithi072 bash[21573]: audit 2024-03-30T15:03:47.492295+0000 mon.a (mon.0) 487 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T15:03:48.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:47 smithi072 bash[28946]: audit 2024-03-30T15:03:47.482556+0000 mon.b (mon.1) 10 : audit 1 from='client.? 172.21.15.172:0/3917144128' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7676e52-a936-4419-8e88-511820cd1355"}]: dispatch 2024-03-30T15:03:48.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:47 smithi072 bash[28946]: audit 2024-03-30T15:03:47.482728+0000 mon.a (mon.0) 484 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7676e52-a936-4419-8e88-511820cd1355"}]: dispatch 2024-03-30T15:03:48.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:47 smithi072 bash[28946]: audit 2024-03-30T15:03:47.486040+0000 mon.a (mon.0) 485 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c7676e52-a936-4419-8e88-511820cd1355"}]': finished 2024-03-30T15:03:48.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:47 smithi072 bash[28946]: cluster 2024-03-30T15:03:47.491755+0000 mon.a (mon.0) 486 : cluster 0 osdmap e27: 5 total, 4 up, 5 in 2024-03-30T15:03:48.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:47 smithi072 bash[28946]: audit 2024-03-30T15:03:47.492295+0000 mon.a (mon.0) 487 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T15:03:48.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:47 smithi172 bash[23680]: audit 2024-03-30T15:03:47.482556+0000 mon.b (mon.1) 10 : audit 1 from='client.? 172.21.15.172:0/3917144128' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7676e52-a936-4419-8e88-511820cd1355"}]: dispatch 2024-03-30T15:03:48.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:47 smithi172 bash[23680]: audit 2024-03-30T15:03:47.482728+0000 mon.a (mon.0) 484 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7676e52-a936-4419-8e88-511820cd1355"}]: dispatch 2024-03-30T15:03:48.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:47 smithi172 bash[23680]: audit 2024-03-30T15:03:47.486040+0000 mon.a (mon.0) 485 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c7676e52-a936-4419-8e88-511820cd1355"}]': finished 2024-03-30T15:03:48.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:47 smithi172 bash[23680]: cluster 2024-03-30T15:03:47.491755+0000 mon.a (mon.0) 486 : cluster 0 osdmap e27: 5 total, 4 up, 5 in 2024-03-30T15:03:48.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:47 smithi172 bash[23680]: audit 2024-03-30T15:03:47.492295+0000 mon.a (mon.0) 487 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T15:03:49.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:48 smithi072 bash[21573]: cluster 2024-03-30T15:03:47.693991+0000 mgr.y (mgr.14152) 215 : cluster 0 pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:49.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:48 smithi072 bash[21573]: audit 2024-03-30T15:03:48.220679+0000 mon.b (mon.1) 11 : audit 0 from='client.? 172.21.15.172:0/2475270218' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T15:03:49.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:48 smithi072 bash[28946]: cluster 2024-03-30T15:03:47.693991+0000 mgr.y (mgr.14152) 215 : cluster 0 pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:49.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:48 smithi072 bash[28946]: audit 2024-03-30T15:03:48.220679+0000 mon.b (mon.1) 11 : audit 0 from='client.? 172.21.15.172:0/2475270218' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T15:03:49.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:48 smithi172 bash[23680]: cluster 2024-03-30T15:03:47.693991+0000 mgr.y (mgr.14152) 215 : cluster 0 pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:49.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:48 smithi172 bash[23680]: audit 2024-03-30T15:03:48.220679+0000 mon.b (mon.1) 11 : audit 0 from='client.? 172.21.15.172:0/2475270218' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T15:03:50.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:50 smithi172 bash[23680]: cluster 2024-03-30T15:03:49.694651+0000 mgr.y (mgr.14152) 216 : cluster 0 pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:51.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:50 smithi072 bash[21573]: cluster 2024-03-30T15:03:49.694651+0000 mgr.y (mgr.14152) 216 : cluster 0 pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:51.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:50 smithi072 bash[28946]: cluster 2024-03-30T15:03:49.694651+0000 mgr.y (mgr.14152) 216 : cluster 0 pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:53.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:52 smithi072 bash[21573]: cluster 2024-03-30T15:03:51.695221+0000 mgr.y (mgr.14152) 217 : cluster 0 pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:53.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:52 smithi072 bash[28946]: cluster 2024-03-30T15:03:51.695221+0000 mgr.y (mgr.14152) 217 : cluster 0 pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:53.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:52 smithi172 bash[23680]: cluster 2024-03-30T15:03:51.695221+0000 mgr.y (mgr.14152) 217 : cluster 0 pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:55.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:54 smithi072 bash[21573]: cluster 2024-03-30T15:03:53.695767+0000 mgr.y (mgr.14152) 218 : cluster 0 pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:55.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:54 smithi072 bash[28946]: cluster 2024-03-30T15:03:53.695767+0000 mgr.y (mgr.14152) 218 : cluster 0 pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:55.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:54 smithi172 bash[23680]: cluster 2024-03-30T15:03:53.695767+0000 mgr.y (mgr.14152) 218 : cluster 0 pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:57.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:56 smithi072 bash[21573]: cluster 2024-03-30T15:03:55.696289+0000 mgr.y (mgr.14152) 219 : cluster 0 pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:57.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:56 smithi072 bash[28946]: cluster 2024-03-30T15:03:55.696289+0000 mgr.y (mgr.14152) 219 : cluster 0 pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:57.213 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:56 smithi172 bash[23680]: cluster 2024-03-30T15:03:55.696289+0000 mgr.y (mgr.14152) 219 : cluster 0 pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:59.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:58 smithi172 bash[23680]: cluster 2024-03-30T15:03:57.696816+0000 mgr.y (mgr.14152) 220 : cluster 0 pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:59.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:58 smithi072 bash[21573]: cluster 2024-03-30T15:03:57.696816+0000 mgr.y (mgr.14152) 220 : cluster 0 pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:03:59.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:58 smithi072 bash[28946]: cluster 2024-03-30T15:03:57.696816+0000 mgr.y (mgr.14152) 220 : cluster 0 pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:04:00.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:59 smithi172 bash[23680]: audit 2024-03-30T15:03:59.680081+0000 mon.a (mon.0) 488 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-30T15:04:00.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:03:59 smithi172 bash[23680]: audit 2024-03-30T15:03:59.681891+0000 mon.a (mon.0) 489 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:04:00.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:59 smithi072 bash[21573]: audit 2024-03-30T15:03:59.680081+0000 mon.a (mon.0) 488 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-30T15:04:00.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:03:59 smithi072 bash[21573]: audit 2024-03-30T15:03:59.681891+0000 mon.a (mon.0) 489 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:04:00.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:59 smithi072 bash[28946]: audit 2024-03-30T15:03:59.680081+0000 mon.a (mon.0) 488 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-30T15:04:00.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:03:59 smithi072 bash[28946]: audit 2024-03-30T15:03:59.681891+0000 mon.a (mon.0) 489 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:04:01.154 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:00 smithi172 bash[23680]: cephadm 2024-03-30T15:03:59.683499+0000 mgr.y (mgr.14152) 221 : cephadm 1 Deploying daemon osd.4 on smithi172 2024-03-30T15:04:01.155 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:00 smithi172 bash[23680]: cluster 2024-03-30T15:03:59.697328+0000 mgr.y (mgr.14152) 222 : cluster 0 pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:04:01.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:00 smithi072 bash[21573]: cephadm 2024-03-30T15:03:59.683499+0000 mgr.y (mgr.14152) 221 : cephadm 1 Deploying daemon osd.4 on smithi172 2024-03-30T15:04:01.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:00 smithi072 bash[21573]: cluster 2024-03-30T15:03:59.697328+0000 mgr.y (mgr.14152) 222 : cluster 0 pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:04:01.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:00 smithi072 bash[28946]: cephadm 2024-03-30T15:03:59.683499+0000 mgr.y (mgr.14152) 221 : cephadm 1 Deploying daemon osd.4 on smithi172 2024-03-30T15:04:01.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:00 smithi072 bash[28946]: cluster 2024-03-30T15:03:59.697328+0000 mgr.y (mgr.14152) 222 : cluster 0 pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:04:03.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:02 smithi172 bash[23680]: cluster 2024-03-30T15:04:01.697813+0000 mgr.y (mgr.14152) 223 : cluster 0 pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:04:03.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:02 smithi072 bash[21573]: cluster 2024-03-30T15:04:01.697813+0000 mgr.y (mgr.14152) 223 : cluster 0 pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:04:03.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:02 smithi072 bash[28946]: cluster 2024-03-30T15:04:01.697813+0000 mgr.y (mgr.14152) 223 : cluster 0 pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:04:03.657 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:03 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:04:03.657 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:04:03 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:04:03.938 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:03 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:04:03.938 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:04:03 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:04:05.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:04 smithi172 bash[23680]: cluster 2024-03-30T15:04:03.698394+0000 mgr.y (mgr.14152) 224 : cluster 0 pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:04:05.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:04 smithi172 bash[23680]: audit 2024-03-30T15:04:03.942378+0000 mon.a (mon.0) 490 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:04:05.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:04 smithi172 bash[23680]: audit 2024-03-30T15:04:03.956109+0000 mon.a (mon.0) 491 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:04:05.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:04 smithi172 bash[23680]: audit 2024-03-30T15:04:03.968585+0000 mon.a (mon.0) 492 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:04:05.423 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:04 smithi072 bash[21573]: cluster 2024-03-30T15:04:03.698394+0000 mgr.y (mgr.14152) 224 : cluster 0 pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:04:05.423 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:04 smithi072 bash[21573]: audit 2024-03-30T15:04:03.942378+0000 mon.a (mon.0) 490 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:04:05.423 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:04 smithi072 bash[21573]: audit 2024-03-30T15:04:03.956109+0000 mon.a (mon.0) 491 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:04:05.423 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:04 smithi072 bash[21573]: audit 2024-03-30T15:04:03.968585+0000 mon.a (mon.0) 492 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:04:05.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:04 smithi072 bash[28946]: cluster 2024-03-30T15:04:03.698394+0000 mgr.y (mgr.14152) 224 : cluster 0 pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:04:05.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:04 smithi072 bash[28946]: audit 2024-03-30T15:04:03.942378+0000 mon.a (mon.0) 490 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:04:05.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:04 smithi072 bash[28946]: audit 2024-03-30T15:04:03.956109+0000 mon.a (mon.0) 491 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:04:05.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:04 smithi072 bash[28946]: audit 2024-03-30T15:04:03.968585+0000 mon.a (mon.0) 492 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:04:07.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:06 smithi172 bash[23680]: cluster 2024-03-30T15:04:05.698910+0000 mgr.y (mgr.14152) 225 : cluster 0 pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:04:07.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:06 smithi072 bash[21573]: cluster 2024-03-30T15:04:05.698910+0000 mgr.y (mgr.14152) 225 : cluster 0 pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:04:07.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:06 smithi072 bash[28946]: cluster 2024-03-30T15:04:05.698910+0000 mgr.y (mgr.14152) 225 : cluster 0 pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:04:09.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:08 smithi172 bash[23680]: cluster 2024-03-30T15:04:07.699438+0000 mgr.y (mgr.14152) 226 : cluster 0 pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:04:09.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:08 smithi072 bash[21573]: cluster 2024-03-30T15:04:07.699438+0000 mgr.y (mgr.14152) 226 : cluster 0 pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:04:09.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:08 smithi072 bash[28946]: cluster 2024-03-30T15:04:07.699438+0000 mgr.y (mgr.14152) 226 : cluster 0 pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:04:11.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:10 smithi172 bash[23680]: cluster 2024-03-30T15:04:09.700065+0000 mgr.y (mgr.14152) 227 : cluster 0 pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:04:11.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:10 smithi172 bash[23680]: audit 2024-03-30T15:04:10.223685+0000 mon.b (mon.1) 12 : audit 1 from='osd.4 [v2:172.21.15.172:6800/3807833251,v1:172.21.15.172:6801/3807833251]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-30T15:04:11.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:10 smithi172 bash[23680]: audit 2024-03-30T15:04:10.223867+0000 mon.a (mon.0) 493 : audit 1 from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-30T15:04:11.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:10 smithi172 bash[23680]: audit 2024-03-30T15:04:10.822082+0000 mon.a (mon.0) 494 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:04:11.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:10 smithi172 bash[23680]: audit 2024-03-30T15:04:10.833299+0000 mon.a (mon.0) 495 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:04:11.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:10 smithi072 bash[21573]: cluster 2024-03-30T15:04:09.700065+0000 mgr.y (mgr.14152) 227 : cluster 0 pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:04:11.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:10 smithi072 bash[21573]: audit 2024-03-30T15:04:10.223685+0000 mon.b (mon.1) 12 : audit 1 from='osd.4 [v2:172.21.15.172:6800/3807833251,v1:172.21.15.172:6801/3807833251]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-30T15:04:11.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:10 smithi072 bash[21573]: audit 2024-03-30T15:04:10.223867+0000 mon.a (mon.0) 493 : audit 1 from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-30T15:04:11.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:10 smithi072 bash[21573]: audit 2024-03-30T15:04:10.822082+0000 mon.a (mon.0) 494 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:04:11.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:10 smithi072 bash[21573]: audit 2024-03-30T15:04:10.833299+0000 mon.a (mon.0) 495 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:04:11.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:10 smithi072 bash[28946]: cluster 2024-03-30T15:04:09.700065+0000 mgr.y (mgr.14152) 227 : cluster 0 pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:04:11.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:10 smithi072 bash[28946]: audit 2024-03-30T15:04:10.223685+0000 mon.b (mon.1) 12 : audit 1 from='osd.4 [v2:172.21.15.172:6800/3807833251,v1:172.21.15.172:6801/3807833251]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-30T15:04:11.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:10 smithi072 bash[28946]: audit 2024-03-30T15:04:10.223867+0000 mon.a (mon.0) 493 : audit 1 from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-30T15:04:11.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:10 smithi072 bash[28946]: audit 2024-03-30T15:04:10.822082+0000 mon.a (mon.0) 494 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:04:11.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:10 smithi072 bash[28946]: audit 2024-03-30T15:04:10.833299+0000 mon.a (mon.0) 495 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:04:12.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:11 smithi072 bash[21573]: audit 2024-03-30T15:04:10.954427+0000 mon.a (mon.0) 496 : audit 1 from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-30T15:04:12.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:11 smithi072 bash[21573]: audit 2024-03-30T15:04:10.963916+0000 mon.b (mon.1) 13 : audit 1 from='osd.4 [v2:172.21.15.172:6800/3807833251,v1:172.21.15.172:6801/3807833251]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-30T15:04:12.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:11 smithi072 bash[21573]: cluster 2024-03-30T15:04:10.965937+0000 mon.a (mon.0) 497 : cluster 0 osdmap e28: 5 total, 4 up, 5 in 2024-03-30T15:04:12.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:11 smithi072 bash[21573]: audit 2024-03-30T15:04:10.966793+0000 mon.a (mon.0) 498 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T15:04:12.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:11 smithi072 bash[21573]: audit 2024-03-30T15:04:10.967622+0000 mon.a (mon.0) 499 : audit 1 from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-30T15:04:12.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:11 smithi072 bash[21573]: audit 2024-03-30T15:04:11.512005+0000 mon.a (mon.0) 500 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:04:12.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:11 smithi072 bash[21573]: audit 2024-03-30T15:04:11.513791+0000 mon.a (mon.0) 501 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:04:12.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:11 smithi072 bash[21573]: audit 2024-03-30T15:04:11.523615+0000 mon.a (mon.0) 502 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:04:12.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:11 smithi072 bash[21573]: audit 2024-03-30T15:04:11.959091+0000 mon.a (mon.0) 503 : audit 1 from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-03-30T15:04:12.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:11 smithi072 bash[21573]: cluster 2024-03-30T15:04:11.967458+0000 mon.a (mon.0) 504 : cluster 0 osdmap e29: 5 total, 4 up, 5 in 2024-03-30T15:04:12.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:11 smithi072 bash[28946]: audit 2024-03-30T15:04:10.954427+0000 mon.a (mon.0) 496 : audit 1 from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-30T15:04:12.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:11 smithi072 bash[28946]: audit 2024-03-30T15:04:10.963916+0000 mon.b (mon.1) 13 : audit 1 from='osd.4 [v2:172.21.15.172:6800/3807833251,v1:172.21.15.172:6801/3807833251]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-30T15:04:12.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:11 smithi072 bash[28946]: cluster 2024-03-30T15:04:10.965937+0000 mon.a (mon.0) 497 : cluster 0 osdmap e28: 5 total, 4 up, 5 in 2024-03-30T15:04:12.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:11 smithi072 bash[28946]: audit 2024-03-30T15:04:10.966793+0000 mon.a (mon.0) 498 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T15:04:12.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:11 smithi072 bash[28946]: audit 2024-03-30T15:04:10.967622+0000 mon.a (mon.0) 499 : audit 1 from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-30T15:04:12.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:11 smithi072 bash[28946]: audit 2024-03-30T15:04:11.512005+0000 mon.a (mon.0) 500 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:04:12.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:11 smithi072 bash[28946]: audit 2024-03-30T15:04:11.513791+0000 mon.a (mon.0) 501 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:04:12.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:11 smithi072 bash[28946]: audit 2024-03-30T15:04:11.523615+0000 mon.a (mon.0) 502 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:04:12.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:11 smithi072 bash[28946]: audit 2024-03-30T15:04:11.959091+0000 mon.a (mon.0) 503 : audit 1 from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-03-30T15:04:12.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:11 smithi072 bash[28946]: cluster 2024-03-30T15:04:11.967458+0000 mon.a (mon.0) 504 : cluster 0 osdmap e29: 5 total, 4 up, 5 in 2024-03-30T15:04:12.439 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:11 smithi172 bash[23680]: audit 2024-03-30T15:04:10.954427+0000 mon.a (mon.0) 496 : audit 1 from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-30T15:04:12.439 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:11 smithi172 bash[23680]: audit 2024-03-30T15:04:10.963916+0000 mon.b (mon.1) 13 : audit 1 from='osd.4 [v2:172.21.15.172:6800/3807833251,v1:172.21.15.172:6801/3807833251]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-30T15:04:12.439 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:11 smithi172 bash[23680]: cluster 2024-03-30T15:04:10.965937+0000 mon.a (mon.0) 497 : cluster 0 osdmap e28: 5 total, 4 up, 5 in 2024-03-30T15:04:12.439 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:11 smithi172 bash[23680]: audit 2024-03-30T15:04:10.966793+0000 mon.a (mon.0) 498 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T15:04:12.440 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:11 smithi172 bash[23680]: audit 2024-03-30T15:04:10.967622+0000 mon.a (mon.0) 499 : audit 1 from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-30T15:04:12.440 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:11 smithi172 bash[23680]: audit 2024-03-30T15:04:11.512005+0000 mon.a (mon.0) 500 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:04:12.440 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:11 smithi172 bash[23680]: audit 2024-03-30T15:04:11.513791+0000 mon.a (mon.0) 501 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:04:12.440 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:11 smithi172 bash[23680]: audit 2024-03-30T15:04:11.523615+0000 mon.a (mon.0) 502 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:04:12.440 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:11 smithi172 bash[23680]: audit 2024-03-30T15:04:11.959091+0000 mon.a (mon.0) 503 : audit 1 from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-03-30T15:04:12.440 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:11 smithi172 bash[23680]: cluster 2024-03-30T15:04:11.967458+0000 mon.a (mon.0) 504 : cluster 0 osdmap e29: 5 total, 4 up, 5 in 2024-03-30T15:04:13.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:12 smithi172 bash[23680]: cluster 2024-03-30T15:04:11.700653+0000 mgr.y (mgr.14152) 228 : cluster 0 pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:04:13.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:12 smithi172 bash[23680]: audit 2024-03-30T15:04:11.970318+0000 mon.a (mon.0) 505 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T15:04:13.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:12 smithi172 bash[23680]: audit 2024-03-30T15:04:11.980632+0000 mon.a (mon.0) 506 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T15:04:13.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:12 smithi172 bash[23680]: audit 2024-03-30T15:04:12.447829+0000 mon.a (mon.0) 507 : audit 1 from='osd.4 ' entity='osd.4' 2024-03-30T15:04:13.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:12 smithi172 bash[23680]: cluster 2024-03-30T15:04:12.969196+0000 mon.a (mon.0) 508 : cluster 1 osd.4 [v2:172.21.15.172:6800/3807833251,v1:172.21.15.172:6801/3807833251] boot 2024-03-30T15:04:13.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:12 smithi172 bash[23680]: cluster 2024-03-30T15:04:12.969317+0000 mon.a (mon.0) 509 : cluster 0 osdmap e30: 5 total, 5 up, 5 in 2024-03-30T15:04:13.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:12 smithi172 bash[23680]: audit 2024-03-30T15:04:12.969683+0000 mon.a (mon.0) 510 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T15:04:13.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:12 smithi072 bash[21573]: cluster 2024-03-30T15:04:11.700653+0000 mgr.y (mgr.14152) 228 : cluster 0 pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:04:13.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:12 smithi072 bash[21573]: audit 2024-03-30T15:04:11.970318+0000 mon.a (mon.0) 505 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T15:04:13.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:12 smithi072 bash[21573]: audit 2024-03-30T15:04:11.980632+0000 mon.a (mon.0) 506 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T15:04:13.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:12 smithi072 bash[21573]: audit 2024-03-30T15:04:12.447829+0000 mon.a (mon.0) 507 : audit 1 from='osd.4 ' entity='osd.4' 2024-03-30T15:04:13.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:12 smithi072 bash[21573]: cluster 2024-03-30T15:04:12.969196+0000 mon.a (mon.0) 508 : cluster 1 osd.4 [v2:172.21.15.172:6800/3807833251,v1:172.21.15.172:6801/3807833251] boot 2024-03-30T15:04:13.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:12 smithi072 bash[21573]: cluster 2024-03-30T15:04:12.969317+0000 mon.a (mon.0) 509 : cluster 0 osdmap e30: 5 total, 5 up, 5 in 2024-03-30T15:04:13.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:12 smithi072 bash[21573]: audit 2024-03-30T15:04:12.969683+0000 mon.a (mon.0) 510 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T15:04:13.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:12 smithi072 bash[28946]: cluster 2024-03-30T15:04:11.700653+0000 mgr.y (mgr.14152) 228 : cluster 0 pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-03-30T15:04:13.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:12 smithi072 bash[28946]: audit 2024-03-30T15:04:11.970318+0000 mon.a (mon.0) 505 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T15:04:13.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:12 smithi072 bash[28946]: audit 2024-03-30T15:04:11.980632+0000 mon.a (mon.0) 506 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T15:04:13.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:12 smithi072 bash[28946]: audit 2024-03-30T15:04:12.447829+0000 mon.a (mon.0) 507 : audit 1 from='osd.4 ' entity='osd.4' 2024-03-30T15:04:13.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:12 smithi072 bash[28946]: cluster 2024-03-30T15:04:12.969196+0000 mon.a (mon.0) 508 : cluster 1 osd.4 [v2:172.21.15.172:6800/3807833251,v1:172.21.15.172:6801/3807833251] boot 2024-03-30T15:04:13.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:12 smithi072 bash[28946]: cluster 2024-03-30T15:04:12.969317+0000 mon.a (mon.0) 509 : cluster 0 osdmap e30: 5 total, 5 up, 5 in 2024-03-30T15:04:13.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:12 smithi072 bash[28946]: audit 2024-03-30T15:04:12.969683+0000 mon.a (mon.0) 510 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T15:04:13.955 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:13.955+0000 7f01757fa700 1 -- 172.21.15.172:0/436428142 <== mgr.14152 v2:172.21.15.72:6800/2777002311 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f017802ddf0 con 0x7f016006db50 2024-03-30T15:04:13.956 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 4 on host 'smithi172' 2024-03-30T15:04:13.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:13.959+0000 7f017e657700 1 -- 172.21.15.172:0/436428142 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f016006db50 msgr2=0x7f0160070010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:04:13.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:13.959+0000 7f017e657700 1 --2- 172.21.15.172:0/436428142 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f016006db50 0x7f0160070010 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f016c006fd0 tx=0x7f016c008040 comp rx=0 tx=0).stop 2024-03-30T15:04:13.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:13.959+0000 7f017e657700 1 -- 172.21.15.172:0/436428142 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0178107fb0 msgr2=0x7f017819f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:04:13.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:13.959+0000 7f017e657700 1 --2- 172.21.15.172:0/436428142 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0178107fb0 0x7f017819f0d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f017000b970 tx=0x7f017000bd30 comp rx=0 tx=0).stop 2024-03-30T15:04:13.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:13.959+0000 7f017e657700 1 -- 172.21.15.172:0/436428142 shutdown_connections 2024-03-30T15:04:13.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:13.959+0000 7f017e657700 1 --2- 172.21.15.172:0/436428142 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f016006db50 0x7f0160070010 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:04:13.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:13.959+0000 7f017e657700 1 --2- 172.21.15.172:0/436428142 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0178107fb0 0x7f017819f0d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:04:13.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:13.959+0000 7f017e657700 1 --2- 172.21.15.172:0/436428142 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01780fff30 0x7f0178197b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:04:13.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:13.959+0000 7f017e657700 1 --2- 172.21.15.172:0/436428142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0178100920 0x7f0178198050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:04:13.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:13.959+0000 7f017e657700 1 -- 172.21.15.172:0/436428142 >> 172.21.15.172:0/436428142 conn(0x7f01780fbaa0 msgr2=0x7f0178103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:04:13.961 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:13.959+0000 7f017e657700 1 -- 172.21.15.172:0/436428142 shutdown_connections 2024-03-30T15:04:13.961 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:13.959+0000 7f017e657700 1 -- 172.21.15.172:0/436428142 wait complete. 2024-03-30T15:04:14.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:13 smithi072 bash[28946]: cluster 2024-03-30T15:04:11.268055+0000 osd.4 (osd.4) 1 : cluster 0 purged_snaps scrub starts 2024-03-30T15:04:14.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:13 smithi072 bash[28946]: cluster 2024-03-30T15:04:11.268143+0000 osd.4 (osd.4) 2 : cluster 0 purged_snaps scrub ok 2024-03-30T15:04:14.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:13 smithi072 bash[28946]: audit 2024-03-30T15:04:13.913826+0000 mon.a (mon.0) 511 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:04:14.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:13 smithi072 bash[28946]: audit 2024-03-30T15:04:13.915005+0000 mon.a (mon.0) 512 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:04:14.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:13 smithi072 bash[28946]: audit 2024-03-30T15:04:13.923476+0000 mon.a (mon.0) 513 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:04:14.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:13 smithi072 bash[28946]: cluster 2024-03-30T15:04:13.970303+0000 mon.a (mon.0) 514 : cluster 0 osdmap e31: 5 total, 5 up, 5 in 2024-03-30T15:04:14.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:13 smithi072 bash[21573]: cluster 2024-03-30T15:04:11.268055+0000 osd.4 (osd.4) 1 : cluster 0 purged_snaps scrub starts 2024-03-30T15:04:14.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:13 smithi072 bash[21573]: cluster 2024-03-30T15:04:11.268143+0000 osd.4 (osd.4) 2 : cluster 0 purged_snaps scrub ok 2024-03-30T15:04:14.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:13 smithi072 bash[21573]: audit 2024-03-30T15:04:13.913826+0000 mon.a (mon.0) 511 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:04:14.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:13 smithi072 bash[21573]: audit 2024-03-30T15:04:13.915005+0000 mon.a (mon.0) 512 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:04:14.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:13 smithi072 bash[21573]: audit 2024-03-30T15:04:13.923476+0000 mon.a (mon.0) 513 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:04:14.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:13 smithi072 bash[21573]: cluster 2024-03-30T15:04:13.970303+0000 mon.a (mon.0) 514 : cluster 0 osdmap e31: 5 total, 5 up, 5 in 2024-03-30T15:04:14.469 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:13 smithi172 bash[23680]: cluster 2024-03-30T15:04:11.268055+0000 osd.4 (osd.4) 1 : cluster 0 purged_snaps scrub starts 2024-03-30T15:04:14.469 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:13 smithi172 bash[23680]: cluster 2024-03-30T15:04:11.268143+0000 osd.4 (osd.4) 2 : cluster 0 purged_snaps scrub ok 2024-03-30T15:04:14.469 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:13 smithi172 bash[23680]: audit 2024-03-30T15:04:13.913826+0000 mon.a (mon.0) 511 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:04:14.469 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:13 smithi172 bash[23680]: audit 2024-03-30T15:04:13.915005+0000 mon.a (mon.0) 512 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:04:14.470 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:13 smithi172 bash[23680]: audit 2024-03-30T15:04:13.923476+0000 mon.a (mon.0) 513 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:04:14.470 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:13 smithi172 bash[23680]: cluster 2024-03-30T15:04:13.970303+0000 mon.a (mon.0) 514 : cluster 0 osdmap e31: 5 total, 5 up, 5 in 2024-03-30T15:04:14.584 DEBUG:teuthology.orchestra.run.smithi172:osd.4> sudo journalctl -f -n 0 -u ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@osd.4.service 2024-03-30T15:04:14.587 INFO:tasks.cephadm:Deploying osd.5 on smithi172 with /dev/vg_nvme/lv_3... 2024-03-30T15:04:14.587 DEBUG:teuthology.orchestra.run.smithi172:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-03-30T15:04:15.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:14 smithi072 bash[21573]: cluster 2024-03-30T15:04:13.701190+0000 mgr.y (mgr.14152) 229 : cluster 0 pgmap v200: 1 pgs: 1 peering; 577 KiB data, 467 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:15.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:14 smithi072 bash[21573]: cluster 2024-03-30T15:04:14.973441+0000 mon.a (mon.0) 515 : cluster 0 osdmap e32: 5 total, 5 up, 5 in 2024-03-30T15:04:15.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:14 smithi072 bash[28946]: cluster 2024-03-30T15:04:13.701190+0000 mgr.y (mgr.14152) 229 : cluster 0 pgmap v200: 1 pgs: 1 peering; 577 KiB data, 467 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:15.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:14 smithi072 bash[28946]: cluster 2024-03-30T15:04:14.973441+0000 mon.a (mon.0) 515 : cluster 0 osdmap e32: 5 total, 5 up, 5 in 2024-03-30T15:04:15.469 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:14 smithi172 bash[23680]: cluster 2024-03-30T15:04:13.701190+0000 mgr.y (mgr.14152) 229 : cluster 0 pgmap v200: 1 pgs: 1 peering; 577 KiB data, 467 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:15.469 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:14 smithi172 bash[23680]: cluster 2024-03-30T15:04:14.973441+0000 mon.a (mon.0) 515 : cluster 0 osdmap e32: 5 total, 5 up, 5 in 2024-03-30T15:04:17.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:17 smithi072 bash[28946]: cluster 2024-03-30T15:04:15.701672+0000 mgr.y (mgr.14152) 230 : cluster 0 pgmap v203: 1 pgs: 1 peering; 577 KiB data, 467 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:17.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:17 smithi072 bash[28946]: cluster 2024-03-30T15:04:15.999230+0000 mon.a (mon.0) 516 : cluster 0 osdmap e33: 5 total, 5 up, 5 in 2024-03-30T15:04:17.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:17 smithi072 bash[21573]: cluster 2024-03-30T15:04:15.701672+0000 mgr.y (mgr.14152) 230 : cluster 0 pgmap v203: 1 pgs: 1 peering; 577 KiB data, 467 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:17.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:17 smithi072 bash[21573]: cluster 2024-03-30T15:04:15.999230+0000 mon.a (mon.0) 516 : cluster 0 osdmap e33: 5 total, 5 up, 5 in 2024-03-30T15:04:17.469 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:17 smithi172 bash[23680]: cluster 2024-03-30T15:04:15.701672+0000 mgr.y (mgr.14152) 230 : cluster 0 pgmap v203: 1 pgs: 1 peering; 577 KiB data, 467 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:17.469 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:17 smithi172 bash[23680]: cluster 2024-03-30T15:04:15.999230+0000 mon.a (mon.0) 516 : cluster 0 osdmap e33: 5 total, 5 up, 5 in 2024-03-30T15:04:18.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:18 smithi072 bash[28946]: cluster 2024-03-30T15:04:17.000212+0000 mon.a (mon.0) 517 : cluster 0 osdmap e34: 5 total, 5 up, 5 in 2024-03-30T15:04:18.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:18 smithi072 bash[21573]: cluster 2024-03-30T15:04:17.000212+0000 mon.a (mon.0) 517 : cluster 0 osdmap e34: 5 total, 5 up, 5 in 2024-03-30T15:04:18.469 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:18 smithi172 bash[23680]: cluster 2024-03-30T15:04:17.000212+0000 mon.a (mon.0) 517 : cluster 0 osdmap e34: 5 total, 5 up, 5 in 2024-03-30T15:04:18.894 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.b/config 2024-03-30T15:04:19.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:19 smithi172 bash[23680]: cluster 2024-03-30T15:04:17.702291+0000 mgr.y (mgr.14152) 231 : cluster 0 pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 467 MiB used, 447 GiB / 447 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-03-30T15:04:19.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:19 smithi072 bash[21573]: cluster 2024-03-30T15:04:17.702291+0000 mgr.y (mgr.14152) 231 : cluster 0 pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 467 MiB used, 447 GiB / 447 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-03-30T15:04:19.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:19 smithi072 bash[28946]: cluster 2024-03-30T15:04:17.702291+0000 mgr.y (mgr.14152) 231 : cluster 0 pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 467 MiB used, 447 GiB / 447 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-03-30T15:04:21.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:21 smithi172 bash[23680]: cluster 2024-03-30T15:04:19.702870+0000 mgr.y (mgr.14152) 232 : cluster 0 pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail; 100 KiB/s, 0 objects/s recovering 2024-03-30T15:04:21.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:21 smithi072 bash[28946]: cluster 2024-03-30T15:04:19.702870+0000 mgr.y (mgr.14152) 232 : cluster 0 pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail; 100 KiB/s, 0 objects/s recovering 2024-03-30T15:04:21.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:21 smithi072 bash[21573]: cluster 2024-03-30T15:04:19.702870+0000 mgr.y (mgr.14152) 232 : cluster 0 pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail; 100 KiB/s, 0 objects/s recovering 2024-03-30T15:04:22.615 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-03-30T15:04:22.615 INFO:teuthology.orchestra.run.smithi172.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-03-30T15:04:22.615 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 10+0 records in 2024-03-30T15:04:22.615 INFO:teuthology.orchestra.run.smithi172.stderr:10+0 records out 2024-03-30T15:04:22.616 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0126947 s, 826 MB/s 2024-03-30T15:04:22.616 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping successful for: 2024-03-30T15:04:23.234 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:23 smithi172 bash[23680]: cluster 2024-03-30T15:04:21.703441+0000 mgr.y (mgr.14152) 233 : cluster 0 pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-03-30T15:04:23.396 DEBUG:teuthology.orchestra.run.smithi172:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi172:vg_nvme/lv_3 2024-03-30T15:04:23.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:23 smithi072 bash[28946]: cluster 2024-03-30T15:04:21.703441+0000 mgr.y (mgr.14152) 233 : cluster 0 pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-03-30T15:04:23.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:23 smithi072 bash[21573]: cluster 2024-03-30T15:04:21.703441+0000 mgr.y (mgr.14152) 233 : cluster 0 pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-03-30T15:04:25.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:24 smithi072 bash[21573]: cluster 2024-03-30T15:04:23.704035+0000 mgr.y (mgr.14152) 234 : cluster 0 pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-30T15:04:25.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:24 smithi072 bash[21573]: cephadm 2024-03-30T15:04:23.816471+0000 mgr.y (mgr.14152) 235 : cephadm 1 Detected new or changed devices on smithi172 2024-03-30T15:04:25.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:24 smithi072 bash[21573]: audit 2024-03-30T15:04:23.827492+0000 mon.a (mon.0) 518 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:04:25.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:24 smithi072 bash[21573]: audit 2024-03-30T15:04:23.836522+0000 mon.a (mon.0) 519 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:04:25.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:24 smithi072 bash[21573]: audit 2024-03-30T15:04:23.838845+0000 mon.a (mon.0) 520 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:04:25.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:24 smithi072 bash[21573]: cephadm 2024-03-30T15:04:23.840395+0000 mgr.y (mgr.14152) 236 : cephadm 1 Adjusting osd_memory_target on smithi172 to 17265M 2024-03-30T15:04:25.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:24 smithi072 bash[21573]: audit 2024-03-30T15:04:23.848437+0000 mon.a (mon.0) 521 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:04:25.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:24 smithi072 bash[21573]: audit 2024-03-30T15:04:23.853876+0000 mon.a (mon.0) 522 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:04:25.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:24 smithi072 bash[21573]: audit 2024-03-30T15:04:23.855663+0000 mon.a (mon.0) 523 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:04:25.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:24 smithi072 bash[21573]: audit 2024-03-30T15:04:23.865632+0000 mon.a (mon.0) 524 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:04:25.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:24 smithi072 bash[28946]: cluster 2024-03-30T15:04:23.704035+0000 mgr.y (mgr.14152) 234 : cluster 0 pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-30T15:04:25.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:24 smithi072 bash[28946]: cephadm 2024-03-30T15:04:23.816471+0000 mgr.y (mgr.14152) 235 : cephadm 1 Detected new or changed devices on smithi172 2024-03-30T15:04:25.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:24 smithi072 bash[28946]: audit 2024-03-30T15:04:23.827492+0000 mon.a (mon.0) 518 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:04:25.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:24 smithi072 bash[28946]: audit 2024-03-30T15:04:23.836522+0000 mon.a (mon.0) 519 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:04:25.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:24 smithi072 bash[28946]: audit 2024-03-30T15:04:23.838845+0000 mon.a (mon.0) 520 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:04:25.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:24 smithi072 bash[28946]: cephadm 2024-03-30T15:04:23.840395+0000 mgr.y (mgr.14152) 236 : cephadm 1 Adjusting osd_memory_target on smithi172 to 17265M 2024-03-30T15:04:25.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:24 smithi072 bash[28946]: audit 2024-03-30T15:04:23.848437+0000 mon.a (mon.0) 521 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:04:25.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:24 smithi072 bash[28946]: audit 2024-03-30T15:04:23.853876+0000 mon.a (mon.0) 522 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:04:25.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:24 smithi072 bash[28946]: audit 2024-03-30T15:04:23.855663+0000 mon.a (mon.0) 523 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:04:25.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:24 smithi072 bash[28946]: audit 2024-03-30T15:04:23.865632+0000 mon.a (mon.0) 524 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:04:25.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:24 smithi172 bash[23680]: cluster 2024-03-30T15:04:23.704035+0000 mgr.y (mgr.14152) 234 : cluster 0 pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-30T15:04:25.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:24 smithi172 bash[23680]: cephadm 2024-03-30T15:04:23.816471+0000 mgr.y (mgr.14152) 235 : cephadm 1 Detected new or changed devices on smithi172 2024-03-30T15:04:25.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:24 smithi172 bash[23680]: audit 2024-03-30T15:04:23.827492+0000 mon.a (mon.0) 518 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:04:25.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:24 smithi172 bash[23680]: audit 2024-03-30T15:04:23.836522+0000 mon.a (mon.0) 519 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:04:25.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:24 smithi172 bash[23680]: audit 2024-03-30T15:04:23.838845+0000 mon.a (mon.0) 520 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:04:25.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:24 smithi172 bash[23680]: cephadm 2024-03-30T15:04:23.840395+0000 mgr.y (mgr.14152) 236 : cephadm 1 Adjusting osd_memory_target on smithi172 to 17265M 2024-03-30T15:04:25.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:24 smithi172 bash[23680]: audit 2024-03-30T15:04:23.848437+0000 mon.a (mon.0) 521 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:04:25.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:24 smithi172 bash[23680]: audit 2024-03-30T15:04:23.853876+0000 mon.a (mon.0) 522 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:04:25.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:24 smithi172 bash[23680]: audit 2024-03-30T15:04:23.855663+0000 mon.a (mon.0) 523 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:04:25.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:24 smithi172 bash[23680]: audit 2024-03-30T15:04:23.865632+0000 mon.a (mon.0) 524 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:04:27.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:26 smithi072 bash[21573]: cluster 2024-03-30T15:04:25.704618+0000 mgr.y (mgr.14152) 237 : cluster 0 pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-03-30T15:04:27.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:26 smithi072 bash[28946]: cluster 2024-03-30T15:04:25.704618+0000 mgr.y (mgr.14152) 237 : cluster 0 pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-03-30T15:04:27.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:26 smithi172 bash[23680]: cluster 2024-03-30T15:04:25.704618+0000 mgr.y (mgr.14152) 237 : cluster 0 pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-03-30T15:04:28.110 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.b/config 2024-03-30T15:04:29.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:28 smithi072 bash[21573]: cluster 2024-03-30T15:04:27.705210+0000 mgr.y (mgr.14152) 238 : cluster 0 pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-03-30T15:04:29.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:28 smithi072 bash[28946]: cluster 2024-03-30T15:04:27.705210+0000 mgr.y (mgr.14152) 238 : cluster 0 pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-03-30T15:04:29.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:28 smithi172 bash[23680]: cluster 2024-03-30T15:04:27.705210+0000 mgr.y (mgr.14152) 238 : cluster 0 pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-03-30T15:04:30.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:30.471+0000 7f2fb752d700 1 -- 172.21.15.172:0/1839102919 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2fb01014b0 msgr2=0x7f2fb0101930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:04:30.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:30.471+0000 7f2fb752d700 1 --2- 172.21.15.172:0/1839102919 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2fb01014b0 0x7f2fb0101930 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0009990 tx=0x7f2fa0009ca0 comp rx=0 tx=0).stop 2024-03-30T15:04:30.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:30.471+0000 7f2fb752d700 1 -- 172.21.15.172:0/1839102919 shutdown_connections 2024-03-30T15:04:30.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:30.471+0000 7f2fb752d700 1 --2- 172.21.15.172:0/1839102919 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fb0101e70 0x7f2fb01022f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:04:30.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:30.471+0000 7f2fb752d700 1 --2- 172.21.15.172:0/1839102919 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2fb0100b50 0x7f2fb0100f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:04:30.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:30.471+0000 7f2fb752d700 1 --2- 172.21.15.172:0/1839102919 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2fb01014b0 0x7f2fb0101930 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:04:30.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:30.471+0000 7f2fb752d700 1 -- 172.21.15.172:0/1839102919 >> 172.21.15.172:0/1839102919 conn(0x7f2fb00fc770 msgr2=0x7f2fb00febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:04:30.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:30.471+0000 7f2fb752d700 1 -- 172.21.15.172:0/1839102919 shutdown_connections 2024-03-30T15:04:30.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:30.471+0000 7f2fb752d700 1 -- 172.21.15.172:0/1839102919 wait complete. 2024-03-30T15:04:30.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:30.471+0000 7f2fb752d700 1 Processor -- start 2024-03-30T15:04:30.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:30.471+0000 7f2fb752d700 1 -- start start 2024-03-30T15:04:30.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:30.471+0000 7f2fb752d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2fb0100b50 0x7f2fb0199db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:04:30.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:30.471+0000 7f2fb752d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2fb01014b0 0x7f2fb019a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:04:30.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:30.471+0000 7f2fb752d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fb0101e70 0x7f2fb01a1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:04:30.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:30.471+0000 7f2fb752d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb010f5e0 con 0x7f2fb0101e70 2024-03-30T15:04:30.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:30.471+0000 7f2fb752d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb010f460 con 0x7f2fb01014b0 2024-03-30T15:04:30.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:30.471+0000 7f2fb752d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f2fb010f760 con 0x7f2fb0100b50 2024-03-30T15:04:30.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:30.471+0000 7f2fb4ac8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2fb01014b0 0x7f2fb019a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:04:30.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:30.471+0000 7f2fb4ac8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2fb01014b0 0x7f2fb019a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:60880/0 (socket says 172.21.15.172:60880) 2024-03-30T15:04:30.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:30.471+0000 7f2fb4ac8700 1 -- 172.21.15.172:0/273136655 learned_addr learned my addr 172.21.15.172:0/273136655 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-03-30T15:04:30.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:30.471+0000 7f2fb5aca700 1 --2- 172.21.15.172:0/273136655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fb0101e70 0x7f2fb01a1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:04:30.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:30.471+0000 7f2fb52c9700 1 --2- 172.21.15.172:0/273136655 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2fb0100b50 0x7f2fb0199db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:04:30.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:30.471+0000 7f2fb4ac8700 1 -- 172.21.15.172:0/273136655 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2fb0100b50 msgr2=0x7f2fb0199db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:04:30.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:30.471+0000 7f2fb4ac8700 1 --2- 172.21.15.172:0/273136655 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2fb0100b50 0x7f2fb0199db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:04:30.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:30.471+0000 7f2fb4ac8700 1 -- 172.21.15.172:0/273136655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fb0101e70 msgr2=0x7f2fb01a1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:04:30.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:30.471+0000 7f2fb4ac8700 1 --2- 172.21.15.172:0/273136655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fb0101e70 0x7f2fb01a1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:04:30.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:30.471+0000 7f2fb4ac8700 1 -- 172.21.15.172:0/273136655 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fb01a1a10 con 0x7f2fb01014b0 2024-03-30T15:04:30.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:30.471+0000 7f2fb4ac8700 1 --2- 172.21.15.172:0/273136655 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2fb01014b0 0x7f2fb019a2f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2fa00098e0 tx=0x7f2fa000f740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:04:30.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:30.471+0000 7f2fae7fc700 1 -- 172.21.15.172:0/273136655 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa0027070 con 0x7f2fb01014b0 2024-03-30T15:04:30.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:30.471+0000 7f2fae7fc700 1 -- 172.21.15.172:0/273136655 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f2fa0022470 con 0x7f2fb01014b0 2024-03-30T15:04:30.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:30.471+0000 7f2fb752d700 1 -- 172.21.15.172:0/273136655 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fb01a1ca0 con 0x7f2fb01014b0 2024-03-30T15:04:30.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:30.471+0000 7f2fae7fc700 1 -- 172.21.15.172:0/273136655 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa0003a90 con 0x7f2fb01014b0 2024-03-30T15:04:30.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:30.471+0000 7f2fb752d700 1 -- 172.21.15.172:0/273136655 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fb01a20f0 con 0x7f2fb01014b0 2024-03-30T15:04:30.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:30.475+0000 7f2fb752d700 1 -- 172.21.15.172:0/273136655 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fb004ff00 con 0x7f2fb01014b0 2024-03-30T15:04:30.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:30.475+0000 7f2fae7fc700 1 -- 172.21.15.172:0/273136655 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 15) ==== 91774+0+0 (secure 0 0 0) 0x7f2fa002a070 con 0x7f2fb01014b0 2024-03-30T15:04:30.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:30.475+0000 7f2fae7fc700 1 --2- 172.21.15.172:0/273136655 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f2f9c06db50 0x7f2f9c070010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:04:30.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:30.475+0000 7f2fae7fc700 1 -- 172.21.15.172:0/273136655 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 3991+0+0 (secure 0 0 0) 0x7f2fa008e230 con 0x7f2fb01014b0 2024-03-30T15:04:30.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:30.475+0000 7f2fb52c9700 1 --2- 172.21.15.172:0/273136655 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f2f9c06db50 0x7f2f9c070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:04:30.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:30.475+0000 7f2fb52c9700 1 --2- 172.21.15.172:0/273136655 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f2f9c06db50 0x7f2f9c070010 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2f98007dc0 tx=0x7f2f980072f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:04:30.481 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:30.479+0000 7f2fae7fc700 1 -- 172.21.15.172:0/273136655 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f2fa0013070 con 0x7f2fb01014b0 2024-03-30T15:04:30.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:04:30.691+0000 7f2fb752d700 1 -- 172.21.15.172:0/273136655 --> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f2fb002dea0 con 0x7f2f9c06db50 2024-03-30T15:04:31.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:30 smithi072 bash[21573]: cluster 2024-03-30T15:04:29.705689+0000 mgr.y (mgr.14152) 239 : cluster 0 pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:31.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:30 smithi072 bash[21573]: audit 2024-03-30T15:04:30.702659+0000 mon.a (mon.0) 525 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T15:04:31.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:30 smithi072 bash[21573]: audit 2024-03-30T15:04:30.709538+0000 mon.a (mon.0) 526 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T15:04:31.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:30 smithi072 bash[21573]: audit 2024-03-30T15:04:30.711522+0000 mon.a (mon.0) 527 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:04:31.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:30 smithi072 bash[28946]: cluster 2024-03-30T15:04:29.705689+0000 mgr.y (mgr.14152) 239 : cluster 0 pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:31.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:30 smithi072 bash[28946]: audit 2024-03-30T15:04:30.702659+0000 mon.a (mon.0) 525 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T15:04:31.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:30 smithi072 bash[28946]: audit 2024-03-30T15:04:30.709538+0000 mon.a (mon.0) 526 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T15:04:31.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:30 smithi072 bash[28946]: audit 2024-03-30T15:04:30.711522+0000 mon.a (mon.0) 527 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:04:31.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:30 smithi172 bash[23680]: cluster 2024-03-30T15:04:29.705689+0000 mgr.y (mgr.14152) 239 : cluster 0 pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:31.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:30 smithi172 bash[23680]: audit 2024-03-30T15:04:30.702659+0000 mon.a (mon.0) 525 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T15:04:31.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:30 smithi172 bash[23680]: audit 2024-03-30T15:04:30.709538+0000 mon.a (mon.0) 526 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T15:04:31.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:30 smithi172 bash[23680]: audit 2024-03-30T15:04:30.711522+0000 mon.a (mon.0) 527 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:04:32.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:31 smithi072 bash[21573]: audit 2024-03-30T15:04:30.695444+0000 mgr.y (mgr.14152) 240 : audit 0 from='client.24208 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T15:04:32.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:31 smithi072 bash[28946]: audit 2024-03-30T15:04:30.695444+0000 mgr.y (mgr.14152) 240 : audit 0 from='client.24208 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T15:04:32.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:31 smithi172 bash[23680]: audit 2024-03-30T15:04:30.695444+0000 mgr.y (mgr.14152) 240 : audit 0 from='client.24208 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T15:04:33.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:32 smithi072 bash[21573]: cluster 2024-03-30T15:04:31.706256+0000 mgr.y (mgr.14152) 241 : cluster 0 pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:33.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:32 smithi072 bash[28946]: cluster 2024-03-30T15:04:31.706256+0000 mgr.y (mgr.14152) 241 : cluster 0 pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:33.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:32 smithi172 bash[23680]: cluster 2024-03-30T15:04:31.706256+0000 mgr.y (mgr.14152) 241 : cluster 0 pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:35.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:34 smithi072 bash[28946]: cluster 2024-03-30T15:04:33.706787+0000 mgr.y (mgr.14152) 242 : cluster 0 pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:35.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:34 smithi072 bash[21573]: cluster 2024-03-30T15:04:33.706787+0000 mgr.y (mgr.14152) 242 : cluster 0 pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:35.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:34 smithi172 bash[23680]: cluster 2024-03-30T15:04:33.706787+0000 mgr.y (mgr.14152) 242 : cluster 0 pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:37.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:36 smithi072 bash[21573]: cluster 2024-03-30T15:04:35.707349+0000 mgr.y (mgr.14152) 243 : cluster 0 pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:37.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:36 smithi072 bash[28946]: cluster 2024-03-30T15:04:35.707349+0000 mgr.y (mgr.14152) 243 : cluster 0 pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:37.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:36 smithi172 bash[23680]: cluster 2024-03-30T15:04:35.707349+0000 mgr.y (mgr.14152) 243 : cluster 0 pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:39.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:38 smithi072 bash[21573]: cluster 2024-03-30T15:04:37.707894+0000 mgr.y (mgr.14152) 244 : cluster 0 pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:39.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:38 smithi072 bash[28946]: cluster 2024-03-30T15:04:37.707894+0000 mgr.y (mgr.14152) 244 : cluster 0 pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:39.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:38 smithi172 bash[23680]: cluster 2024-03-30T15:04:37.707894+0000 mgr.y (mgr.14152) 244 : cluster 0 pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:40.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:39 smithi072 bash[21573]: audit 2024-03-30T15:04:38.875156+0000 mon.a (mon.0) 528 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "92d207bb-ccd0-4b33-b4c0-b733b8b67e6c"}]: dispatch 2024-03-30T15:04:40.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:39 smithi072 bash[21573]: audit 2024-03-30T15:04:38.875340+0000 mon.b (mon.1) 14 : audit 1 from='client.? 172.21.15.172:0/815321117' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "92d207bb-ccd0-4b33-b4c0-b733b8b67e6c"}]: dispatch 2024-03-30T15:04:40.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:39 smithi072 bash[21573]: audit 2024-03-30T15:04:38.878708+0000 mon.a (mon.0) 529 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "92d207bb-ccd0-4b33-b4c0-b733b8b67e6c"}]': finished 2024-03-30T15:04:40.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:39 smithi072 bash[21573]: cluster 2024-03-30T15:04:38.884332+0000 mon.a (mon.0) 530 : cluster 0 osdmap e35: 6 total, 5 up, 6 in 2024-03-30T15:04:40.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:39 smithi072 bash[21573]: audit 2024-03-30T15:04:38.884995+0000 mon.a (mon.0) 531 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T15:04:40.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:39 smithi072 bash[21573]: audit 2024-03-30T15:04:39.600548+0000 mon.b (mon.1) 15 : audit 0 from='client.? 172.21.15.172:0/1397252244' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T15:04:40.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:39 smithi072 bash[28946]: audit 2024-03-30T15:04:38.875156+0000 mon.a (mon.0) 528 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "92d207bb-ccd0-4b33-b4c0-b733b8b67e6c"}]: dispatch 2024-03-30T15:04:40.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:39 smithi072 bash[28946]: audit 2024-03-30T15:04:38.875340+0000 mon.b (mon.1) 14 : audit 1 from='client.? 172.21.15.172:0/815321117' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "92d207bb-ccd0-4b33-b4c0-b733b8b67e6c"}]: dispatch 2024-03-30T15:04:40.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:39 smithi072 bash[28946]: audit 2024-03-30T15:04:38.878708+0000 mon.a (mon.0) 529 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "92d207bb-ccd0-4b33-b4c0-b733b8b67e6c"}]': finished 2024-03-30T15:04:40.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:39 smithi072 bash[28946]: cluster 2024-03-30T15:04:38.884332+0000 mon.a (mon.0) 530 : cluster 0 osdmap e35: 6 total, 5 up, 6 in 2024-03-30T15:04:40.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:39 smithi072 bash[28946]: audit 2024-03-30T15:04:38.884995+0000 mon.a (mon.0) 531 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T15:04:40.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:39 smithi072 bash[28946]: audit 2024-03-30T15:04:39.600548+0000 mon.b (mon.1) 15 : audit 0 from='client.? 172.21.15.172:0/1397252244' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T15:04:40.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:39 smithi172 bash[23680]: audit 2024-03-30T15:04:38.875156+0000 mon.a (mon.0) 528 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "92d207bb-ccd0-4b33-b4c0-b733b8b67e6c"}]: dispatch 2024-03-30T15:04:40.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:39 smithi172 bash[23680]: audit 2024-03-30T15:04:38.875340+0000 mon.b (mon.1) 14 : audit 1 from='client.? 172.21.15.172:0/815321117' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "92d207bb-ccd0-4b33-b4c0-b733b8b67e6c"}]: dispatch 2024-03-30T15:04:40.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:39 smithi172 bash[23680]: audit 2024-03-30T15:04:38.878708+0000 mon.a (mon.0) 529 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "92d207bb-ccd0-4b33-b4c0-b733b8b67e6c"}]': finished 2024-03-30T15:04:40.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:39 smithi172 bash[23680]: cluster 2024-03-30T15:04:38.884332+0000 mon.a (mon.0) 530 : cluster 0 osdmap e35: 6 total, 5 up, 6 in 2024-03-30T15:04:40.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:39 smithi172 bash[23680]: audit 2024-03-30T15:04:38.884995+0000 mon.a (mon.0) 531 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T15:04:40.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:39 smithi172 bash[23680]: audit 2024-03-30T15:04:39.600548+0000 mon.b (mon.1) 15 : audit 0 from='client.? 172.21.15.172:0/1397252244' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T15:04:41.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:40 smithi072 bash[21573]: cluster 2024-03-30T15:04:39.708449+0000 mgr.y (mgr.14152) 245 : cluster 0 pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:41.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:40 smithi072 bash[28946]: cluster 2024-03-30T15:04:39.708449+0000 mgr.y (mgr.14152) 245 : cluster 0 pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:41.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:40 smithi172 bash[23680]: cluster 2024-03-30T15:04:39.708449+0000 mgr.y (mgr.14152) 245 : cluster 0 pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:43.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:42 smithi072 bash[21573]: cluster 2024-03-30T15:04:41.709038+0000 mgr.y (mgr.14152) 246 : cluster 0 pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:43.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:42 smithi072 bash[28946]: cluster 2024-03-30T15:04:41.709038+0000 mgr.y (mgr.14152) 246 : cluster 0 pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:43.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:42 smithi172 bash[23680]: cluster 2024-03-30T15:04:41.709038+0000 mgr.y (mgr.14152) 246 : cluster 0 pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:45.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:44 smithi072 bash[21573]: cluster 2024-03-30T15:04:43.709580+0000 mgr.y (mgr.14152) 247 : cluster 0 pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:45.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:44 smithi072 bash[28946]: cluster 2024-03-30T15:04:43.709580+0000 mgr.y (mgr.14152) 247 : cluster 0 pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:45.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:44 smithi172 bash[23680]: cluster 2024-03-30T15:04:43.709580+0000 mgr.y (mgr.14152) 247 : cluster 0 pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:47.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:46 smithi072 bash[21573]: cluster 2024-03-30T15:04:45.710170+0000 mgr.y (mgr.14152) 248 : cluster 0 pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:47.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:46 smithi072 bash[28946]: cluster 2024-03-30T15:04:45.710170+0000 mgr.y (mgr.14152) 248 : cluster 0 pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:47.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:46 smithi172 bash[23680]: cluster 2024-03-30T15:04:45.710170+0000 mgr.y (mgr.14152) 248 : cluster 0 pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:49.133 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:48 smithi172 bash[23680]: cluster 2024-03-30T15:04:47.710728+0000 mgr.y (mgr.14152) 249 : cluster 0 pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:49.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:48 smithi072 bash[21573]: cluster 2024-03-30T15:04:47.710728+0000 mgr.y (mgr.14152) 249 : cluster 0 pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:49.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:48 smithi072 bash[28946]: cluster 2024-03-30T15:04:47.710728+0000 mgr.y (mgr.14152) 249 : cluster 0 pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:51.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:50 smithi072 bash[21573]: cluster 2024-03-30T15:04:49.711284+0000 mgr.y (mgr.14152) 250 : cluster 0 pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:51.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:50 smithi072 bash[21573]: audit 2024-03-30T15:04:50.852685+0000 mon.a (mon.0) 532 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-30T15:04:51.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:50 smithi072 bash[21573]: audit 2024-03-30T15:04:50.854751+0000 mon.a (mon.0) 533 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:04:51.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:50 smithi072 bash[28946]: cluster 2024-03-30T15:04:49.711284+0000 mgr.y (mgr.14152) 250 : cluster 0 pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:51.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:50 smithi072 bash[28946]: audit 2024-03-30T15:04:50.852685+0000 mon.a (mon.0) 532 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-30T15:04:51.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:50 smithi072 bash[28946]: audit 2024-03-30T15:04:50.854751+0000 mon.a (mon.0) 533 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:04:51.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:50 smithi172 bash[23680]: cluster 2024-03-30T15:04:49.711284+0000 mgr.y (mgr.14152) 250 : cluster 0 pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:51.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:50 smithi172 bash[23680]: audit 2024-03-30T15:04:50.852685+0000 mon.a (mon.0) 532 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-30T15:04:51.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:50 smithi172 bash[23680]: audit 2024-03-30T15:04:50.854751+0000 mon.a (mon.0) 533 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:04:52.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:51 smithi072 bash[21573]: cephadm 2024-03-30T15:04:50.856455+0000 mgr.y (mgr.14152) 251 : cephadm 1 Deploying daemon osd.5 on smithi172 2024-03-30T15:04:52.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:51 smithi072 bash[28946]: cephadm 2024-03-30T15:04:50.856455+0000 mgr.y (mgr.14152) 251 : cephadm 1 Deploying daemon osd.5 on smithi172 2024-03-30T15:04:52.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:51 smithi172 bash[23680]: cephadm 2024-03-30T15:04:50.856455+0000 mgr.y (mgr.14152) 251 : cephadm 1 Deploying daemon osd.5 on smithi172 2024-03-30T15:04:53.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:52 smithi072 bash[21573]: cluster 2024-03-30T15:04:51.711803+0000 mgr.y (mgr.14152) 252 : cluster 0 pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:53.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:52 smithi072 bash[28946]: cluster 2024-03-30T15:04:51.711803+0000 mgr.y (mgr.14152) 252 : cluster 0 pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:53.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:52 smithi172 bash[23680]: cluster 2024-03-30T15:04:51.711803+0000 mgr.y (mgr.14152) 252 : cluster 0 pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:55.054 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 30 15:04:54 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:04:55.054 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:04:54 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:04:55.054 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:54 smithi172 bash[23680]: cluster 2024-03-30T15:04:53.712453+0000 mgr.y (mgr.14152) 253 : cluster 0 pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:55.055 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:54 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:04:55.336 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:55 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:04:55.336 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:04:55 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:04:55.336 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 30 15:04:55 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:04:55.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:54 smithi072 bash[21573]: cluster 2024-03-30T15:04:53.712453+0000 mgr.y (mgr.14152) 253 : cluster 0 pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:55.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:54 smithi072 bash[28946]: cluster 2024-03-30T15:04:53.712453+0000 mgr.y (mgr.14152) 253 : cluster 0 pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:56.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:55 smithi172 bash[23680]: audit 2024-03-30T15:04:55.337270+0000 mon.a (mon.0) 534 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:04:56.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:55 smithi172 bash[23680]: audit 2024-03-30T15:04:55.344232+0000 mon.a (mon.0) 535 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:04:56.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:55 smithi172 bash[23680]: audit 2024-03-30T15:04:55.355535+0000 mon.a (mon.0) 536 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:04:56.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:55 smithi072 bash[21573]: audit 2024-03-30T15:04:55.337270+0000 mon.a (mon.0) 534 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:04:56.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:55 smithi072 bash[21573]: audit 2024-03-30T15:04:55.344232+0000 mon.a (mon.0) 535 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:04:56.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:55 smithi072 bash[21573]: audit 2024-03-30T15:04:55.355535+0000 mon.a (mon.0) 536 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:04:56.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:55 smithi072 bash[28946]: audit 2024-03-30T15:04:55.337270+0000 mon.a (mon.0) 534 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:04:56.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:55 smithi072 bash[28946]: audit 2024-03-30T15:04:55.344232+0000 mon.a (mon.0) 535 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:04:56.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:55 smithi072 bash[28946]: audit 2024-03-30T15:04:55.355535+0000 mon.a (mon.0) 536 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:04:57.670 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:57 smithi072 bash[21573]: cluster 2024-03-30T15:04:55.713145+0000 mgr.y (mgr.14152) 254 : cluster 0 pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:57.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:57 smithi072 bash[28946]: cluster 2024-03-30T15:04:55.713145+0000 mgr.y (mgr.14152) 254 : cluster 0 pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:57.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:57 smithi172 bash[23680]: cluster 2024-03-30T15:04:55.713145+0000 mgr.y (mgr.14152) 254 : cluster 0 pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:59.670 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:04:59 smithi072 bash[21573]: cluster 2024-03-30T15:04:57.713783+0000 mgr.y (mgr.14152) 255 : cluster 0 pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:59.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:04:59 smithi072 bash[28946]: cluster 2024-03-30T15:04:57.713783+0000 mgr.y (mgr.14152) 255 : cluster 0 pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:04:59.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:04:59 smithi172 bash[23680]: cluster 2024-03-30T15:04:57.713783+0000 mgr.y (mgr.14152) 255 : cluster 0 pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:05:01.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:01 smithi172 bash[23680]: cluster 2024-03-30T15:04:59.714366+0000 mgr.y (mgr.14152) 256 : cluster 0 pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:05:01.670 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:01 smithi072 bash[21573]: cluster 2024-03-30T15:04:59.714366+0000 mgr.y (mgr.14152) 256 : cluster 0 pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:05:01.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:01 smithi072 bash[28946]: cluster 2024-03-30T15:04:59.714366+0000 mgr.y (mgr.14152) 256 : cluster 0 pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:05:02.662 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:02 smithi172 bash[23680]: audit 2024-03-30T15:05:01.662395+0000 mon.a (mon.0) 537 : audit 1 from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-30T15:05:02.662 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:02 smithi172 bash[23680]: audit 2024-03-30T15:05:01.662766+0000 mon.b (mon.1) 16 : audit 1 from='osd.5 [v2:172.21.15.172:6808/1078861326,v1:172.21.15.172:6809/1078861326]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-30T15:05:02.662 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:02 smithi172 bash[23680]: audit 2024-03-30T15:05:02.183060+0000 mon.a (mon.0) 538 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:02.662 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:02 smithi172 bash[23680]: audit 2024-03-30T15:05:02.192442+0000 mon.a (mon.0) 539 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:02.662 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:02 smithi172 bash[23680]: audit 2024-03-30T15:05:02.194568+0000 mon.a (mon.0) 540 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:05:02.662 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:02 smithi172 bash[23680]: audit 2024-03-30T15:05:02.196458+0000 mon.a (mon.0) 541 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:05:02.662 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:02 smithi172 bash[23680]: audit 2024-03-30T15:05:02.206223+0000 mon.a (mon.0) 542 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:02.670 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:02 smithi072 bash[21573]: audit 2024-03-30T15:05:01.662395+0000 mon.a (mon.0) 537 : audit 1 from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-30T15:05:02.670 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:02 smithi072 bash[21573]: audit 2024-03-30T15:05:01.662766+0000 mon.b (mon.1) 16 : audit 1 from='osd.5 [v2:172.21.15.172:6808/1078861326,v1:172.21.15.172:6809/1078861326]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-30T15:05:02.670 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:02 smithi072 bash[21573]: audit 2024-03-30T15:05:02.183060+0000 mon.a (mon.0) 538 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:02.670 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:02 smithi072 bash[21573]: audit 2024-03-30T15:05:02.192442+0000 mon.a (mon.0) 539 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:02.670 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:02 smithi072 bash[21573]: audit 2024-03-30T15:05:02.194568+0000 mon.a (mon.0) 540 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:05:02.670 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:02 smithi072 bash[21573]: audit 2024-03-30T15:05:02.196458+0000 mon.a (mon.0) 541 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:05:02.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:02 smithi072 bash[21573]: audit 2024-03-30T15:05:02.206223+0000 mon.a (mon.0) 542 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:02.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:02 smithi072 bash[28946]: audit 2024-03-30T15:05:01.662395+0000 mon.a (mon.0) 537 : audit 1 from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-30T15:05:02.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:02 smithi072 bash[28946]: audit 2024-03-30T15:05:01.662766+0000 mon.b (mon.1) 16 : audit 1 from='osd.5 [v2:172.21.15.172:6808/1078861326,v1:172.21.15.172:6809/1078861326]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-30T15:05:02.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:02 smithi072 bash[28946]: audit 2024-03-30T15:05:02.183060+0000 mon.a (mon.0) 538 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:02.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:02 smithi072 bash[28946]: audit 2024-03-30T15:05:02.192442+0000 mon.a (mon.0) 539 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:02.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:02 smithi072 bash[28946]: audit 2024-03-30T15:05:02.194568+0000 mon.a (mon.0) 540 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:05:02.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:02 smithi072 bash[28946]: audit 2024-03-30T15:05:02.196458+0000 mon.a (mon.0) 541 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:05:02.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:02 smithi072 bash[28946]: audit 2024-03-30T15:05:02.206223+0000 mon.a (mon.0) 542 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:03.670 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:03 smithi072 bash[21573]: cluster 2024-03-30T15:05:01.714921+0000 mgr.y (mgr.14152) 257 : cluster 0 pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:05:03.670 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:03 smithi072 bash[21573]: audit 2024-03-30T15:05:02.367030+0000 mon.a (mon.0) 543 : audit 1 from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-30T15:05:03.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:03 smithi072 bash[21573]: cluster 2024-03-30T15:05:02.372738+0000 mon.a (mon.0) 544 : cluster 0 osdmap e36: 6 total, 5 up, 6 in 2024-03-30T15:05:03.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:03 smithi072 bash[21573]: audit 2024-03-30T15:05:02.374034+0000 mon.a (mon.0) 545 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T15:05:03.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:03 smithi072 bash[21573]: audit 2024-03-30T15:05:02.374767+0000 mon.a (mon.0) 546 : audit 1 from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-30T15:05:03.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:03 smithi072 bash[21573]: audit 2024-03-30T15:05:02.374914+0000 mon.b (mon.1) 17 : audit 1 from='osd.5 [v2:172.21.15.172:6808/1078861326,v1:172.21.15.172:6809/1078861326]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-30T15:05:03.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:03 smithi072 bash[21573]: audit 2024-03-30T15:05:03.369583+0000 mon.a (mon.0) 547 : audit 1 from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-03-30T15:05:03.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:03 smithi072 bash[28946]: cluster 2024-03-30T15:05:01.714921+0000 mgr.y (mgr.14152) 257 : cluster 0 pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:05:03.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:03 smithi072 bash[28946]: audit 2024-03-30T15:05:02.367030+0000 mon.a (mon.0) 543 : audit 1 from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-30T15:05:03.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:03 smithi072 bash[28946]: cluster 2024-03-30T15:05:02.372738+0000 mon.a (mon.0) 544 : cluster 0 osdmap e36: 6 total, 5 up, 6 in 2024-03-30T15:05:03.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:03 smithi072 bash[28946]: audit 2024-03-30T15:05:02.374034+0000 mon.a (mon.0) 545 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T15:05:03.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:03 smithi072 bash[28946]: audit 2024-03-30T15:05:02.374767+0000 mon.a (mon.0) 546 : audit 1 from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-30T15:05:03.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:03 smithi072 bash[28946]: audit 2024-03-30T15:05:02.374914+0000 mon.b (mon.1) 17 : audit 1 from='osd.5 [v2:172.21.15.172:6808/1078861326,v1:172.21.15.172:6809/1078861326]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-30T15:05:03.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:03 smithi072 bash[28946]: audit 2024-03-30T15:05:03.369583+0000 mon.a (mon.0) 547 : audit 1 from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-03-30T15:05:03.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:03 smithi172 bash[23680]: cluster 2024-03-30T15:05:01.714921+0000 mgr.y (mgr.14152) 257 : cluster 0 pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:05:03.719 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:03 smithi172 bash[23680]: audit 2024-03-30T15:05:02.367030+0000 mon.a (mon.0) 543 : audit 1 from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-30T15:05:03.719 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:03 smithi172 bash[23680]: cluster 2024-03-30T15:05:02.372738+0000 mon.a (mon.0) 544 : cluster 0 osdmap e36: 6 total, 5 up, 6 in 2024-03-30T15:05:03.719 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:03 smithi172 bash[23680]: audit 2024-03-30T15:05:02.374034+0000 mon.a (mon.0) 545 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T15:05:03.719 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:03 smithi172 bash[23680]: audit 2024-03-30T15:05:02.374767+0000 mon.a (mon.0) 546 : audit 1 from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-30T15:05:03.719 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:03 smithi172 bash[23680]: audit 2024-03-30T15:05:02.374914+0000 mon.b (mon.1) 17 : audit 1 from='osd.5 [v2:172.21.15.172:6808/1078861326,v1:172.21.15.172:6809/1078861326]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-30T15:05:03.719 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:03 smithi172 bash[23680]: audit 2024-03-30T15:05:03.369583+0000 mon.a (mon.0) 547 : audit 1 from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-03-30T15:05:04.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:04 smithi172 bash[23680]: cluster 2024-03-30T15:05:03.378313+0000 mon.a (mon.0) 548 : cluster 0 osdmap e37: 6 total, 5 up, 6 in 2024-03-30T15:05:04.469 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:04 smithi172 bash[23680]: audit 2024-03-30T15:05:03.380053+0000 mon.a (mon.0) 549 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T15:05:04.469 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:04 smithi172 bash[23680]: audit 2024-03-30T15:05:03.390690+0000 mon.a (mon.0) 550 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T15:05:04.469 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:04 smithi172 bash[23680]: audit 2024-03-30T15:05:03.891402+0000 mon.a (mon.0) 551 : audit 1 from='osd.5 ' entity='osd.5' 2024-03-30T15:05:04.469 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:04 smithi172 bash[23680]: cluster 2024-03-30T15:05:04.380051+0000 mon.a (mon.0) 552 : cluster 1 osd.5 [v2:172.21.15.172:6808/1078861326,v1:172.21.15.172:6809/1078861326] boot 2024-03-30T15:05:04.469 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:04 smithi172 bash[23680]: cluster 2024-03-30T15:05:04.380159+0000 mon.a (mon.0) 553 : cluster 0 osdmap e38: 6 total, 6 up, 6 in 2024-03-30T15:05:04.469 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:04 smithi172 bash[23680]: audit 2024-03-30T15:05:04.380518+0000 mon.a (mon.0) 554 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T15:05:04.670 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:04 smithi072 bash[21573]: cluster 2024-03-30T15:05:03.378313+0000 mon.a (mon.0) 548 : cluster 0 osdmap e37: 6 total, 5 up, 6 in 2024-03-30T15:05:04.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:04 smithi072 bash[21573]: audit 2024-03-30T15:05:03.380053+0000 mon.a (mon.0) 549 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T15:05:04.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:04 smithi072 bash[21573]: audit 2024-03-30T15:05:03.390690+0000 mon.a (mon.0) 550 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T15:05:04.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:04 smithi072 bash[21573]: audit 2024-03-30T15:05:03.891402+0000 mon.a (mon.0) 551 : audit 1 from='osd.5 ' entity='osd.5' 2024-03-30T15:05:04.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:04 smithi072 bash[21573]: cluster 2024-03-30T15:05:04.380051+0000 mon.a (mon.0) 552 : cluster 1 osd.5 [v2:172.21.15.172:6808/1078861326,v1:172.21.15.172:6809/1078861326] boot 2024-03-30T15:05:04.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:04 smithi072 bash[21573]: cluster 2024-03-30T15:05:04.380159+0000 mon.a (mon.0) 553 : cluster 0 osdmap e38: 6 total, 6 up, 6 in 2024-03-30T15:05:04.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:04 smithi072 bash[21573]: audit 2024-03-30T15:05:04.380518+0000 mon.a (mon.0) 554 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T15:05:04.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:04 smithi072 bash[28946]: cluster 2024-03-30T15:05:03.378313+0000 mon.a (mon.0) 548 : cluster 0 osdmap e37: 6 total, 5 up, 6 in 2024-03-30T15:05:04.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:04 smithi072 bash[28946]: audit 2024-03-30T15:05:03.380053+0000 mon.a (mon.0) 549 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T15:05:04.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:04 smithi072 bash[28946]: audit 2024-03-30T15:05:03.390690+0000 mon.a (mon.0) 550 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T15:05:04.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:04 smithi072 bash[28946]: audit 2024-03-30T15:05:03.891402+0000 mon.a (mon.0) 551 : audit 1 from='osd.5 ' entity='osd.5' 2024-03-30T15:05:04.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:04 smithi072 bash[28946]: cluster 2024-03-30T15:05:04.380051+0000 mon.a (mon.0) 552 : cluster 1 osd.5 [v2:172.21.15.172:6808/1078861326,v1:172.21.15.172:6809/1078861326] boot 2024-03-30T15:05:04.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:04 smithi072 bash[28946]: cluster 2024-03-30T15:05:04.380159+0000 mon.a (mon.0) 553 : cluster 0 osdmap e38: 6 total, 6 up, 6 in 2024-03-30T15:05:04.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:04 smithi072 bash[28946]: audit 2024-03-30T15:05:04.380518+0000 mon.a (mon.0) 554 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T15:05:05.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:05.567+0000 7f2fae7fc700 1 -- 172.21.15.172:0/273136655 <== mgr.14152 v2:172.21.15.72:6800/2777002311 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2fb002dea0 con 0x7f2f9c06db50 2024-03-30T15:05:05.567 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 5 on host 'smithi172' 2024-03-30T15:05:05.570 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:05.567+0000 7f2fb752d700 1 -- 172.21.15.172:0/273136655 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f2f9c06db50 msgr2=0x7f2f9c070010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:05:05.570 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:05.567+0000 7f2fb752d700 1 --2- 172.21.15.172:0/273136655 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f2f9c06db50 0x7f2f9c070010 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2f98007dc0 tx=0x7f2f980072f0 comp rx=0 tx=0).stop 2024-03-30T15:05:05.570 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:05.567+0000 7f2fb752d700 1 -- 172.21.15.172:0/273136655 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2fb01014b0 msgr2=0x7f2fb019a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:05:05.570 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:05.567+0000 7f2fb752d700 1 --2- 172.21.15.172:0/273136655 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2fb01014b0 0x7f2fb019a2f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2fa00098e0 tx=0x7f2fa000f740 comp rx=0 tx=0).stop 2024-03-30T15:05:05.570 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:05.567+0000 7f2fb752d700 1 -- 172.21.15.172:0/273136655 shutdown_connections 2024-03-30T15:05:05.570 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:05.567+0000 7f2fb752d700 1 --2- 172.21.15.172:0/273136655 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f2f9c06db50 0x7f2f9c070010 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:05:05.570 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:05.567+0000 7f2fb752d700 1 --2- 172.21.15.172:0/273136655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fb0101e70 0x7f2fb01a1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:05:05.570 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:05.567+0000 7f2fb752d700 1 --2- 172.21.15.172:0/273136655 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2fb0100b50 0x7f2fb0199db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:05:05.570 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:05.567+0000 7f2fb752d700 1 --2- 172.21.15.172:0/273136655 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2fb01014b0 0x7f2fb019a2f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:05:05.570 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:05.567+0000 7f2fb752d700 1 -- 172.21.15.172:0/273136655 >> 172.21.15.172:0/273136655 conn(0x7f2fb00fc770 msgr2=0x7f2fb00fe550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:05:05.571 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:05.571+0000 7f2fb752d700 1 -- 172.21.15.172:0/273136655 shutdown_connections 2024-03-30T15:05:05.571 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:05.571+0000 7f2fb752d700 1 -- 172.21.15.172:0/273136655 wait complete. 2024-03-30T15:05:05.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:05 smithi072 bash[28946]: cluster 2024-03-30T15:05:02.629979+0000 osd.5 (osd.5) 1 : cluster 0 purged_snaps scrub starts 2024-03-30T15:05:05.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:05 smithi072 bash[28946]: cluster 2024-03-30T15:05:02.630105+0000 osd.5 (osd.5) 2 : cluster 0 purged_snaps scrub ok 2024-03-30T15:05:05.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:05 smithi072 bash[28946]: cluster 2024-03-30T15:05:03.715472+0000 mgr.y (mgr.14152) 258 : cluster 0 pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:05:05.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:05 smithi072 bash[21573]: cluster 2024-03-30T15:05:02.629979+0000 osd.5 (osd.5) 1 : cluster 0 purged_snaps scrub starts 2024-03-30T15:05:05.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:05 smithi072 bash[21573]: cluster 2024-03-30T15:05:02.630105+0000 osd.5 (osd.5) 2 : cluster 0 purged_snaps scrub ok 2024-03-30T15:05:05.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:05 smithi072 bash[21573]: cluster 2024-03-30T15:05:03.715472+0000 mgr.y (mgr.14152) 258 : cluster 0 pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:05:05.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:05 smithi172 bash[23680]: cluster 2024-03-30T15:05:02.629979+0000 osd.5 (osd.5) 1 : cluster 0 purged_snaps scrub starts 2024-03-30T15:05:05.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:05 smithi172 bash[23680]: cluster 2024-03-30T15:05:02.630105+0000 osd.5 (osd.5) 2 : cluster 0 purged_snaps scrub ok 2024-03-30T15:05:05.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:05 smithi172 bash[23680]: cluster 2024-03-30T15:05:03.715472+0000 mgr.y (mgr.14152) 258 : cluster 0 pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-03-30T15:05:06.168 DEBUG:teuthology.orchestra.run.smithi172:osd.5> sudo journalctl -f -n 0 -u ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@osd.5.service 2024-03-30T15:05:06.170 INFO:tasks.cephadm:Deploying osd.6 on smithi172 with /dev/vg_nvme/lv_2... 2024-03-30T15:05:06.171 DEBUG:teuthology.orchestra.run.smithi172:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-03-30T15:05:06.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:06 smithi172 bash[23680]: cluster 2024-03-30T15:05:05.396105+0000 mon.a (mon.0) 555 : cluster 0 osdmap e39: 6 total, 6 up, 6 in 2024-03-30T15:05:06.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:06 smithi172 bash[23680]: audit 2024-03-30T15:05:05.533569+0000 mon.a (mon.0) 556 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:06.469 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:06 smithi172 bash[23680]: audit 2024-03-30T15:05:05.543389+0000 mon.a (mon.0) 557 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:06.469 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:06 smithi172 bash[23680]: audit 2024-03-30T15:05:05.549594+0000 mon.a (mon.0) 558 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:05:06.469 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:06 smithi172 bash[23680]: cluster 2024-03-30T15:05:06.396614+0000 mon.a (mon.0) 559 : cluster 0 osdmap e40: 6 total, 6 up, 6 in 2024-03-30T15:05:06.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:06 smithi072 bash[28946]: cluster 2024-03-30T15:05:05.396105+0000 mon.a (mon.0) 555 : cluster 0 osdmap e39: 6 total, 6 up, 6 in 2024-03-30T15:05:06.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:06 smithi072 bash[28946]: audit 2024-03-30T15:05:05.533569+0000 mon.a (mon.0) 556 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:06.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:06 smithi072 bash[28946]: audit 2024-03-30T15:05:05.543389+0000 mon.a (mon.0) 557 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:06.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:06 smithi072 bash[28946]: audit 2024-03-30T15:05:05.549594+0000 mon.a (mon.0) 558 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:05:06.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:06 smithi072 bash[28946]: cluster 2024-03-30T15:05:06.396614+0000 mon.a (mon.0) 559 : cluster 0 osdmap e40: 6 total, 6 up, 6 in 2024-03-30T15:05:06.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:06 smithi072 bash[21573]: cluster 2024-03-30T15:05:05.396105+0000 mon.a (mon.0) 555 : cluster 0 osdmap e39: 6 total, 6 up, 6 in 2024-03-30T15:05:06.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:06 smithi072 bash[21573]: audit 2024-03-30T15:05:05.533569+0000 mon.a (mon.0) 556 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:06.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:06 smithi072 bash[21573]: audit 2024-03-30T15:05:05.543389+0000 mon.a (mon.0) 557 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:06.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:06 smithi072 bash[21573]: audit 2024-03-30T15:05:05.549594+0000 mon.a (mon.0) 558 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:05:06.672 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:06 smithi072 bash[21573]: cluster 2024-03-30T15:05:06.396614+0000 mon.a (mon.0) 559 : cluster 0 osdmap e40: 6 total, 6 up, 6 in 2024-03-30T15:05:07.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:07 smithi072 bash[28946]: cluster 2024-03-30T15:05:05.716107+0000 mgr.y (mgr.14152) 259 : cluster 0 pgmap v235: 1 pgs: 1 remapped+peering; 577 KiB data, 534 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:07.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:07 smithi072 bash[28946]: cluster 2024-03-30T15:05:06.539196+0000 mon.a (mon.0) 560 : cluster 3 Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-03-30T15:05:07.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:07 smithi072 bash[28946]: cluster 2024-03-30T15:05:06.987978+0000 mon.a (mon.0) 561 : cluster 0 osdmap e41: 6 total, 6 up, 6 in 2024-03-30T15:05:07.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:07 smithi072 bash[21573]: cluster 2024-03-30T15:05:05.716107+0000 mgr.y (mgr.14152) 259 : cluster 0 pgmap v235: 1 pgs: 1 remapped+peering; 577 KiB data, 534 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:07.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:07 smithi072 bash[21573]: cluster 2024-03-30T15:05:06.539196+0000 mon.a (mon.0) 560 : cluster 3 Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-03-30T15:05:07.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:07 smithi072 bash[21573]: cluster 2024-03-30T15:05:06.987978+0000 mon.a (mon.0) 561 : cluster 0 osdmap e41: 6 total, 6 up, 6 in 2024-03-30T15:05:07.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:07 smithi172 bash[23680]: cluster 2024-03-30T15:05:05.716107+0000 mgr.y (mgr.14152) 259 : cluster 0 pgmap v235: 1 pgs: 1 remapped+peering; 577 KiB data, 534 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:07.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:07 smithi172 bash[23680]: cluster 2024-03-30T15:05:06.539196+0000 mon.a (mon.0) 560 : cluster 3 Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-03-30T15:05:07.719 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:07 smithi172 bash[23680]: cluster 2024-03-30T15:05:06.987978+0000 mon.a (mon.0) 561 : cluster 0 osdmap e41: 6 total, 6 up, 6 in 2024-03-30T15:05:09.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:08 smithi072 bash[21573]: cluster 2024-03-30T15:05:07.716731+0000 mgr.y (mgr.14152) 260 : cluster 0 pgmap v238: 1 pgs: 1 remapped+peering; 577 KiB data, 534 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:09.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:08 smithi072 bash[21573]: cluster 2024-03-30T15:05:07.990019+0000 mon.a (mon.0) 562 : cluster 0 osdmap e42: 6 total, 6 up, 6 in 2024-03-30T15:05:09.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:08 smithi072 bash[28946]: cluster 2024-03-30T15:05:07.716731+0000 mgr.y (mgr.14152) 260 : cluster 0 pgmap v238: 1 pgs: 1 remapped+peering; 577 KiB data, 534 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:09.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:08 smithi072 bash[28946]: cluster 2024-03-30T15:05:07.990019+0000 mon.a (mon.0) 562 : cluster 0 osdmap e42: 6 total, 6 up, 6 in 2024-03-30T15:05:09.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:08 smithi172 bash[23680]: cluster 2024-03-30T15:05:07.716731+0000 mgr.y (mgr.14152) 260 : cluster 0 pgmap v238: 1 pgs: 1 remapped+peering; 577 KiB data, 534 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:09.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:08 smithi172 bash[23680]: cluster 2024-03-30T15:05:07.990019+0000 mon.a (mon.0) 562 : cluster 0 osdmap e42: 6 total, 6 up, 6 in 2024-03-30T15:05:10.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:10 smithi072 bash[21573]: cluster 2024-03-30T15:05:09.986754+0000 mon.a (mon.0) 563 : cluster 1 Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-03-30T15:05:10.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:10 smithi072 bash[21573]: cluster 2024-03-30T15:05:09.986814+0000 mon.a (mon.0) 564 : cluster 1 Cluster is now healthy 2024-03-30T15:05:10.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:10 smithi072 bash[28946]: cluster 2024-03-30T15:05:09.986754+0000 mon.a (mon.0) 563 : cluster 1 Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-03-30T15:05:10.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:10 smithi072 bash[28946]: cluster 2024-03-30T15:05:09.986814+0000 mon.a (mon.0) 564 : cluster 1 Cluster is now healthy 2024-03-30T15:05:10.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:10 smithi172 bash[23680]: cluster 2024-03-30T15:05:09.986754+0000 mon.a (mon.0) 563 : cluster 1 Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-03-30T15:05:10.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:10 smithi172 bash[23680]: cluster 2024-03-30T15:05:09.986814+0000 mon.a (mon.0) 564 : cluster 1 Cluster is now healthy 2024-03-30T15:05:10.548 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.b/config 2024-03-30T15:05:11.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:11 smithi072 bash[28946]: cluster 2024-03-30T15:05:09.717311+0000 mgr.y (mgr.14152) 261 : cluster 0 pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:11.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:11 smithi072 bash[21573]: cluster 2024-03-30T15:05:09.717311+0000 mgr.y (mgr.14152) 261 : cluster 0 pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:11.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:11 smithi172 bash[23680]: cluster 2024-03-30T15:05:09.717311+0000 mgr.y (mgr.14152) 261 : cluster 0 pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:13.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:13 smithi072 bash[21573]: cluster 2024-03-30T15:05:11.717954+0000 mgr.y (mgr.14152) 262 : cluster 0 pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-30T15:05:13.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:13 smithi072 bash[28946]: cluster 2024-03-30T15:05:11.717954+0000 mgr.y (mgr.14152) 262 : cluster 0 pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-30T15:05:13.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:13 smithi172 bash[23680]: cluster 2024-03-30T15:05:11.717954+0000 mgr.y (mgr.14152) 262 : cluster 0 pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-30T15:05:14.353 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-03-30T15:05:14.353 INFO:teuthology.orchestra.run.smithi172.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-03-30T15:05:14.353 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 10+0 records in 2024-03-30T15:05:14.353 INFO:teuthology.orchestra.run.smithi172.stderr:10+0 records out 2024-03-30T15:05:14.353 INFO:teuthology.orchestra.run.smithi172.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0196894 s, 533 MB/s 2024-03-30T15:05:14.353 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping successful for: 2024-03-30T15:05:15.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:15 smithi072 bash[21573]: cluster 2024-03-30T15:05:13.718555+0000 mgr.y (mgr.14152) 263 : cluster 0 pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-03-30T15:05:15.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:15 smithi072 bash[28946]: cluster 2024-03-30T15:05:13.718555+0000 mgr.y (mgr.14152) 263 : cluster 0 pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-03-30T15:05:15.449 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:15 smithi172 bash[23680]: cluster 2024-03-30T15:05:13.718555+0000 mgr.y (mgr.14152) 263 : cluster 0 pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-03-30T15:05:15.450 DEBUG:teuthology.orchestra.run.smithi172:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi172:vg_nvme/lv_2 2024-03-30T15:05:16.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:16 smithi072 bash[21573]: cephadm 2024-03-30T15:05:15.549147+0000 mgr.y (mgr.14152) 264 : cephadm 1 Detected new or changed devices on smithi172 2024-03-30T15:05:16.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:16 smithi072 bash[21573]: audit 2024-03-30T15:05:15.561927+0000 mon.a (mon.0) 565 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:16.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:16 smithi072 bash[21573]: audit 2024-03-30T15:05:15.575055+0000 mon.a (mon.0) 566 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:16.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:16 smithi072 bash[21573]: audit 2024-03-30T15:05:15.577700+0000 mon.a (mon.0) 567 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:05:16.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:16 smithi072 bash[21573]: audit 2024-03-30T15:05:15.579595+0000 mon.a (mon.0) 568 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:05:16.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:16 smithi072 bash[21573]: cephadm 2024-03-30T15:05:15.581055+0000 mgr.y (mgr.14152) 265 : cephadm 1 Adjusting osd_memory_target on smithi172 to 8632M 2024-03-30T15:05:16.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:16 smithi072 bash[21573]: audit 2024-03-30T15:05:15.591318+0000 mon.a (mon.0) 569 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:16.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:16 smithi072 bash[21573]: audit 2024-03-30T15:05:15.597040+0000 mon.a (mon.0) 570 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:05:16.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:16 smithi072 bash[21573]: audit 2024-03-30T15:05:15.598892+0000 mon.a (mon.0) 571 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:05:16.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:16 smithi072 bash[21573]: audit 2024-03-30T15:05:15.610576+0000 mon.a (mon.0) 572 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:16.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:16 smithi072 bash[28946]: cephadm 2024-03-30T15:05:15.549147+0000 mgr.y (mgr.14152) 264 : cephadm 1 Detected new or changed devices on smithi172 2024-03-30T15:05:16.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:16 smithi072 bash[28946]: audit 2024-03-30T15:05:15.561927+0000 mon.a (mon.0) 565 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:16.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:16 smithi072 bash[28946]: audit 2024-03-30T15:05:15.575055+0000 mon.a (mon.0) 566 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:16.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:16 smithi072 bash[28946]: audit 2024-03-30T15:05:15.577700+0000 mon.a (mon.0) 567 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:05:16.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:16 smithi072 bash[28946]: audit 2024-03-30T15:05:15.579595+0000 mon.a (mon.0) 568 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:05:16.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:16 smithi072 bash[28946]: cephadm 2024-03-30T15:05:15.581055+0000 mgr.y (mgr.14152) 265 : cephadm 1 Adjusting osd_memory_target on smithi172 to 8632M 2024-03-30T15:05:16.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:16 smithi072 bash[28946]: audit 2024-03-30T15:05:15.591318+0000 mon.a (mon.0) 569 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:16.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:16 smithi072 bash[28946]: audit 2024-03-30T15:05:15.597040+0000 mon.a (mon.0) 570 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:05:16.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:16 smithi072 bash[28946]: audit 2024-03-30T15:05:15.598892+0000 mon.a (mon.0) 571 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:05:16.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:16 smithi072 bash[28946]: audit 2024-03-30T15:05:15.610576+0000 mon.a (mon.0) 572 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:16.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:16 smithi172 bash[23680]: cephadm 2024-03-30T15:05:15.549147+0000 mgr.y (mgr.14152) 264 : cephadm 1 Detected new or changed devices on smithi172 2024-03-30T15:05:16.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:16 smithi172 bash[23680]: audit 2024-03-30T15:05:15.561927+0000 mon.a (mon.0) 565 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:16.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:16 smithi172 bash[23680]: audit 2024-03-30T15:05:15.575055+0000 mon.a (mon.0) 566 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:16.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:16 smithi172 bash[23680]: audit 2024-03-30T15:05:15.577700+0000 mon.a (mon.0) 567 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:05:16.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:16 smithi172 bash[23680]: audit 2024-03-30T15:05:15.579595+0000 mon.a (mon.0) 568 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:05:16.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:16 smithi172 bash[23680]: cephadm 2024-03-30T15:05:15.581055+0000 mgr.y (mgr.14152) 265 : cephadm 1 Adjusting osd_memory_target on smithi172 to 8632M 2024-03-30T15:05:16.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:16 smithi172 bash[23680]: audit 2024-03-30T15:05:15.591318+0000 mon.a (mon.0) 569 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:16.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:16 smithi172 bash[23680]: audit 2024-03-30T15:05:15.597040+0000 mon.a (mon.0) 570 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:05:16.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:16 smithi172 bash[23680]: audit 2024-03-30T15:05:15.598892+0000 mon.a (mon.0) 571 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:05:16.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:16 smithi172 bash[23680]: audit 2024-03-30T15:05:15.610576+0000 mon.a (mon.0) 572 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:17.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:17 smithi072 bash[28946]: cluster 2024-03-30T15:05:15.719204+0000 mgr.y (mgr.14152) 266 : cluster 0 pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-03-30T15:05:17.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:17 smithi072 bash[21573]: cluster 2024-03-30T15:05:15.719204+0000 mgr.y (mgr.14152) 266 : cluster 0 pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-03-30T15:05:17.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:17 smithi172 bash[23680]: cluster 2024-03-30T15:05:15.719204+0000 mgr.y (mgr.14152) 266 : cluster 0 pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-03-30T15:05:19.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:19 smithi072 bash[21573]: cluster 2024-03-30T15:05:17.719800+0000 mgr.y (mgr.14152) 267 : cluster 0 pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-30T15:05:19.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:19 smithi072 bash[28946]: cluster 2024-03-30T15:05:17.719800+0000 mgr.y (mgr.14152) 267 : cluster 0 pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-30T15:05:19.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:19 smithi172 bash[23680]: cluster 2024-03-30T15:05:17.719800+0000 mgr.y (mgr.14152) 267 : cluster 0 pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-30T15:05:20.186 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.b/config 2024-03-30T15:05:21.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:21 smithi072 bash[21573]: cluster 2024-03-30T15:05:19.720383+0000 mgr.y (mgr.14152) 268 : cluster 0 pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-03-30T15:05:21.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:21 smithi072 bash[28946]: cluster 2024-03-30T15:05:19.720383+0000 mgr.y (mgr.14152) 268 : cluster 0 pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-03-30T15:05:21.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:21 smithi172 bash[23680]: cluster 2024-03-30T15:05:19.720383+0000 mgr.y (mgr.14152) 268 : cluster 0 pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-03-30T15:05:22.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:22.663+0000 7fcc0237d700 1 -- 172.21.15.172:0/506404530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcbfc10a480 msgr2=0x7fcbfc110d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:05:22.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:22.663+0000 7fcc0237d700 1 --2- 172.21.15.172:0/506404530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcbfc10a480 0x7fcbfc110d30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcbf400b0d0 tx=0x7fcbf400b3e0 comp rx=0 tx=0).stop 2024-03-30T15:05:22.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:22.663+0000 7fcc0237d700 1 -- 172.21.15.172:0/506404530 shutdown_connections 2024-03-30T15:05:22.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:22.663+0000 7fcc0237d700 1 --2- 172.21.15.172:0/506404530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcbfc10a480 0x7fcbfc110d30 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:05:22.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:22.663+0000 7fcc0237d700 1 --2- 172.21.15.172:0/506404530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbfc1088e0 0x7fcbfc108d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:05:22.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:22.663+0000 7fcc0237d700 1 --2- 172.21.15.172:0/506404530 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcbfc109ae0 0x7fcbfc109f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:05:22.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:22.663+0000 7fcc0237d700 1 -- 172.21.15.172:0/506404530 >> 172.21.15.172:0/506404530 conn(0x7fcbfc0778d0 msgr2=0x7fcbfc079cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:05:22.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:22.663+0000 7fcc0237d700 1 -- 172.21.15.172:0/506404530 shutdown_connections 2024-03-30T15:05:22.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:22.663+0000 7fcc0237d700 1 -- 172.21.15.172:0/506404530 wait complete. 2024-03-30T15:05:22.667 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:22.663+0000 7fcc0237d700 1 Processor -- start 2024-03-30T15:05:22.667 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:22.663+0000 7fcc0237d700 1 -- start start 2024-03-30T15:05:22.667 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:22.663+0000 7fcc0237d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbfc1088e0 0x7fcbfc19dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:05:22.667 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:22.663+0000 7fcc0237d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcbfc109ae0 0x7fcbfc19e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:05:22.667 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:22.663+0000 7fcc0237d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcbfc10a480 0x7fcbfc1a54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:05:22.667 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:22.663+0000 7fcc0237d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fcbfc113960 con 0x7fcbfc1088e0 2024-03-30T15:05:22.667 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:22.663+0000 7fcc0237d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcbfc1137e0 con 0x7fcbfc10a480 2024-03-30T15:05:22.667 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:22.663+0000 7fcc0237d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fcbfc113ae0 con 0x7fcbfc109ae0 2024-03-30T15:05:22.667 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:22.663+0000 7fcc0091a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcbfc10a480 0x7fcbfc1a54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:05:22.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:22.663+0000 7fcc0091a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcbfc10a480 0x7fcbfc1a54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48380/0 (socket says 172.21.15.172:48380) 2024-03-30T15:05:22.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:22.663+0000 7fcc0091a700 1 -- 172.21.15.172:0/587654093 learned_addr learned my addr 172.21.15.172:0/587654093 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-03-30T15:05:22.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:22.667+0000 7fcbfbfff700 1 --2- 172.21.15.172:0/587654093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbfc1088e0 0x7fcbfc19dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:05:22.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:22.667+0000 7fcbfb7fe700 1 --2- 172.21.15.172:0/587654093 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcbfc109ae0 0x7fcbfc19e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:05:22.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:22.667+0000 7fcc0091a700 1 -- 172.21.15.172:0/587654093 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcbfc109ae0 msgr2=0x7fcbfc19e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:05:22.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:22.667+0000 7fcc0091a700 1 --2- 172.21.15.172:0/587654093 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcbfc109ae0 0x7fcbfc19e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:05:22.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:22.667+0000 7fcc0091a700 1 -- 172.21.15.172:0/587654093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbfc1088e0 msgr2=0x7fcbfc19dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:05:22.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:22.667+0000 7fcc0091a700 1 --2- 172.21.15.172:0/587654093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbfc1088e0 0x7fcbfc19dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:05:22.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:22.667+0000 7fcc0091a700 1 -- 172.21.15.172:0/587654093 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbfc1a5b40 con 0x7fcbfc10a480 2024-03-30T15:05:22.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:22.667+0000 7fcc0091a700 1 --2- 172.21.15.172:0/587654093 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcbfc10a480 0x7fcbfc1a54a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4007d90 tx=0x7fcbf4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:05:22.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:22.667+0000 7fcbf97fa700 1 -- 172.21.15.172:0/587654093 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf4022070 con 0x7fcbfc10a480 2024-03-30T15:05:22.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:22.667+0000 7fcc0237d700 1 -- 172.21.15.172:0/587654093 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbfc1a5dd0 con 0x7fcbfc10a480 2024-03-30T15:05:22.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:22.667+0000 7fcbf97fa700 1 -- 172.21.15.172:0/587654093 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7fcbf4013d90 con 0x7fcbfc10a480 2024-03-30T15:05:22.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:22.667+0000 7fcbf97fa700 1 -- 172.21.15.172:0/587654093 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf401bcc0 con 0x7fcbfc10a480 2024-03-30T15:05:22.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:22.667+0000 7fcc0237d700 1 -- 172.21.15.172:0/587654093 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbfc1a6220 con 0x7fcbfc10a480 2024-03-30T15:05:22.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:22.667+0000 7fcc0237d700 1 -- 172.21.15.172:0/587654093 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbfc04ff00 con 0x7fcbfc10a480 2024-03-30T15:05:22.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:22.667+0000 7fcbf97fa700 1 -- 172.21.15.172:0/587654093 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 15) ==== 91774+0+0 (secure 0 0 0) 0x7fcbf4025070 con 0x7fcbfc10a480 2024-03-30T15:05:22.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:22.667+0000 7fcbf97fa700 1 --2- 172.21.15.172:0/587654093 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fcbe406da30 0x7fcbe406fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:05:22.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:22.667+0000 7fcbf97fa700 1 -- 172.21.15.172:0/587654093 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4423+0+0 (secure 0 0 0) 0x7fcbf400f020 con 0x7fcbfc10a480 2024-03-30T15:05:22.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:22.667+0000 7fcbfbfff700 1 --2- 172.21.15.172:0/587654093 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fcbe406da30 0x7fcbe406fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:05:22.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:22.667+0000 7fcbfbfff700 1 --2- 172.21.15.172:0/587654093 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fcbe406da30 0x7fcbe406fef0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0005950 tx=0x7fcbf00058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:05:22.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:22.671+0000 7fcbf97fa700 1 -- 172.21.15.172:0/587654093 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fcbf402c020 con 0x7fcbfc10a480 2024-03-30T15:05:22.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:22.891+0000 7fcc0237d700 1 -- 172.21.15.172:0/587654093 --> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fcbfc02df50 con 0x7fcbe406da30 2024-03-30T15:05:23.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:23 smithi072 bash[21573]: cluster 2024-03-30T15:05:21.720921+0000 mgr.y (mgr.14152) 269 : cluster 0 pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:23.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:23 smithi072 bash[21573]: audit 2024-03-30T15:05:22.902841+0000 mon.a (mon.0) 573 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T15:05:23.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:23 smithi072 bash[21573]: audit 2024-03-30T15:05:22.909432+0000 mon.a (mon.0) 574 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T15:05:23.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:23 smithi072 bash[21573]: audit 2024-03-30T15:05:22.911754+0000 mon.a (mon.0) 575 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:05:23.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:23 smithi072 bash[28946]: cluster 2024-03-30T15:05:21.720921+0000 mgr.y (mgr.14152) 269 : cluster 0 pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:23.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:23 smithi072 bash[28946]: audit 2024-03-30T15:05:22.902841+0000 mon.a (mon.0) 573 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T15:05:23.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:23 smithi072 bash[28946]: audit 2024-03-30T15:05:22.909432+0000 mon.a (mon.0) 574 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T15:05:23.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:23 smithi072 bash[28946]: audit 2024-03-30T15:05:22.911754+0000 mon.a (mon.0) 575 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:05:23.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:23 smithi172 bash[23680]: cluster 2024-03-30T15:05:21.720921+0000 mgr.y (mgr.14152) 269 : cluster 0 pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:23.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:23 smithi172 bash[23680]: audit 2024-03-30T15:05:22.902841+0000 mon.a (mon.0) 573 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T15:05:23.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:23 smithi172 bash[23680]: audit 2024-03-30T15:05:22.909432+0000 mon.a (mon.0) 574 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T15:05:23.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:23 smithi172 bash[23680]: audit 2024-03-30T15:05:22.911754+0000 mon.a (mon.0) 575 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:05:24.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:24 smithi072 bash[21573]: audit 2024-03-30T15:05:22.895721+0000 mgr.y (mgr.14152) 270 : audit 0 from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T15:05:24.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:24 smithi072 bash[28946]: audit 2024-03-30T15:05:22.895721+0000 mgr.y (mgr.14152) 270 : audit 0 from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T15:05:24.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:24 smithi172 bash[23680]: audit 2024-03-30T15:05:22.895721+0000 mgr.y (mgr.14152) 270 : audit 0 from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T15:05:25.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:25 smithi072 bash[21573]: cluster 2024-03-30T15:05:23.721452+0000 mgr.y (mgr.14152) 271 : cluster 0 pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:25.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:25 smithi072 bash[28946]: cluster 2024-03-30T15:05:23.721452+0000 mgr.y (mgr.14152) 271 : cluster 0 pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:25.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:25 smithi172 bash[23680]: cluster 2024-03-30T15:05:23.721452+0000 mgr.y (mgr.14152) 271 : cluster 0 pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:27.909 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:27 smithi172 bash[23680]: cluster 2024-03-30T15:05:25.722005+0000 mgr.y (mgr.14152) 272 : cluster 0 pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:27.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:27 smithi072 bash[28946]: cluster 2024-03-30T15:05:25.722005+0000 mgr.y (mgr.14152) 272 : cluster 0 pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:27.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:27 smithi072 bash[21573]: cluster 2024-03-30T15:05:25.722005+0000 mgr.y (mgr.14152) 272 : cluster 0 pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:29.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:29 smithi072 bash[21573]: cluster 2024-03-30T15:05:27.722588+0000 mgr.y (mgr.14152) 273 : cluster 0 pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:29.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:29 smithi072 bash[28946]: cluster 2024-03-30T15:05:27.722588+0000 mgr.y (mgr.14152) 273 : cluster 0 pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:29.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:29 smithi172 bash[23680]: cluster 2024-03-30T15:05:27.722588+0000 mgr.y (mgr.14152) 273 : cluster 0 pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:31.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:31 smithi072 bash[21573]: cluster 2024-03-30T15:05:29.723248+0000 mgr.y (mgr.14152) 274 : cluster 0 pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:31.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:31 smithi072 bash[21573]: audit 2024-03-30T15:05:30.994543+0000 mon.a (mon.0) 576 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "791e09bc-ffeb-45ec-a375-8d4c4f51f4dc"}]: dispatch 2024-03-30T15:05:31.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:31 smithi072 bash[21573]: audit 2024-03-30T15:05:30.994962+0000 mon.b (mon.1) 18 : audit 1 from='client.? 172.21.15.172:0/1171325666' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "791e09bc-ffeb-45ec-a375-8d4c4f51f4dc"}]: dispatch 2024-03-30T15:05:31.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:31 smithi072 bash[21573]: audit 2024-03-30T15:05:30.997978+0000 mon.a (mon.0) 577 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "791e09bc-ffeb-45ec-a375-8d4c4f51f4dc"}]': finished 2024-03-30T15:05:31.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:31 smithi072 bash[21573]: cluster 2024-03-30T15:05:31.003905+0000 mon.a (mon.0) 578 : cluster 0 osdmap e43: 7 total, 6 up, 7 in 2024-03-30T15:05:31.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:31 smithi072 bash[21573]: audit 2024-03-30T15:05:31.004583+0000 mon.a (mon.0) 579 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T15:05:31.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:31 smithi072 bash[28946]: cluster 2024-03-30T15:05:29.723248+0000 mgr.y (mgr.14152) 274 : cluster 0 pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:31.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:31 smithi072 bash[28946]: audit 2024-03-30T15:05:30.994543+0000 mon.a (mon.0) 576 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "791e09bc-ffeb-45ec-a375-8d4c4f51f4dc"}]: dispatch 2024-03-30T15:05:31.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:31 smithi072 bash[28946]: audit 2024-03-30T15:05:30.994962+0000 mon.b (mon.1) 18 : audit 1 from='client.? 172.21.15.172:0/1171325666' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "791e09bc-ffeb-45ec-a375-8d4c4f51f4dc"}]: dispatch 2024-03-30T15:05:31.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:31 smithi072 bash[28946]: audit 2024-03-30T15:05:30.997978+0000 mon.a (mon.0) 577 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "791e09bc-ffeb-45ec-a375-8d4c4f51f4dc"}]': finished 2024-03-30T15:05:31.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:31 smithi072 bash[28946]: cluster 2024-03-30T15:05:31.003905+0000 mon.a (mon.0) 578 : cluster 0 osdmap e43: 7 total, 6 up, 7 in 2024-03-30T15:05:31.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:31 smithi072 bash[28946]: audit 2024-03-30T15:05:31.004583+0000 mon.a (mon.0) 579 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T15:05:31.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:31 smithi172 bash[23680]: cluster 2024-03-30T15:05:29.723248+0000 mgr.y (mgr.14152) 274 : cluster 0 pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:31.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:31 smithi172 bash[23680]: audit 2024-03-30T15:05:30.994543+0000 mon.a (mon.0) 576 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "791e09bc-ffeb-45ec-a375-8d4c4f51f4dc"}]: dispatch 2024-03-30T15:05:31.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:31 smithi172 bash[23680]: audit 2024-03-30T15:05:30.994962+0000 mon.b (mon.1) 18 : audit 1 from='client.? 172.21.15.172:0/1171325666' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "791e09bc-ffeb-45ec-a375-8d4c4f51f4dc"}]: dispatch 2024-03-30T15:05:31.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:31 smithi172 bash[23680]: audit 2024-03-30T15:05:30.997978+0000 mon.a (mon.0) 577 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "791e09bc-ffeb-45ec-a375-8d4c4f51f4dc"}]': finished 2024-03-30T15:05:31.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:31 smithi172 bash[23680]: cluster 2024-03-30T15:05:31.003905+0000 mon.a (mon.0) 578 : cluster 0 osdmap e43: 7 total, 6 up, 7 in 2024-03-30T15:05:31.971 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:31 smithi172 bash[23680]: audit 2024-03-30T15:05:31.004583+0000 mon.a (mon.0) 579 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T15:05:32.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:32 smithi072 bash[21573]: audit 2024-03-30T15:05:31.779763+0000 mon.b (mon.1) 19 : audit 0 from='client.? 172.21.15.172:0/1134237227' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T15:05:32.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:32 smithi072 bash[28946]: audit 2024-03-30T15:05:31.779763+0000 mon.b (mon.1) 19 : audit 0 from='client.? 172.21.15.172:0/1134237227' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T15:05:32.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:32 smithi172 bash[23680]: audit 2024-03-30T15:05:31.779763+0000 mon.b (mon.1) 19 : audit 0 from='client.? 172.21.15.172:0/1134237227' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T15:05:33.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:33 smithi072 bash[21573]: cluster 2024-03-30T15:05:31.723944+0000 mgr.y (mgr.14152) 275 : cluster 0 pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:33.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:33 smithi072 bash[28946]: cluster 2024-03-30T15:05:31.723944+0000 mgr.y (mgr.14152) 275 : cluster 0 pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:33.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:33 smithi172 bash[23680]: cluster 2024-03-30T15:05:31.723944+0000 mgr.y (mgr.14152) 275 : cluster 0 pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:35.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:35 smithi072 bash[21573]: cluster 2024-03-30T15:05:33.724626+0000 mgr.y (mgr.14152) 276 : cluster 0 pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:35.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:35 smithi072 bash[28946]: cluster 2024-03-30T15:05:33.724626+0000 mgr.y (mgr.14152) 276 : cluster 0 pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:35.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:35 smithi172 bash[23680]: cluster 2024-03-30T15:05:33.724626+0000 mgr.y (mgr.14152) 276 : cluster 0 pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:37.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:37 smithi072 bash[21573]: cluster 2024-03-30T15:05:35.725237+0000 mgr.y (mgr.14152) 277 : cluster 0 pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:37.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:37 smithi072 bash[28946]: cluster 2024-03-30T15:05:35.725237+0000 mgr.y (mgr.14152) 277 : cluster 0 pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:37.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:37 smithi172 bash[23680]: cluster 2024-03-30T15:05:35.725237+0000 mgr.y (mgr.14152) 277 : cluster 0 pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:38.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:38 smithi172 bash[23680]: cluster 2024-03-30T15:05:37.725724+0000 mgr.y (mgr.14152) 278 : cluster 0 pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:39.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:38 smithi072 bash[28946]: cluster 2024-03-30T15:05:37.725724+0000 mgr.y (mgr.14152) 278 : cluster 0 pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:39.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:38 smithi072 bash[21573]: cluster 2024-03-30T15:05:37.725724+0000 mgr.y (mgr.14152) 278 : cluster 0 pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:41.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:40 smithi072 bash[21573]: cluster 2024-03-30T15:05:39.726286+0000 mgr.y (mgr.14152) 279 : cluster 0 pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:41.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:40 smithi072 bash[28946]: cluster 2024-03-30T15:05:39.726286+0000 mgr.y (mgr.14152) 279 : cluster 0 pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:41.176 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:40 smithi172 bash[23680]: cluster 2024-03-30T15:05:39.726286+0000 mgr.y (mgr.14152) 279 : cluster 0 pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:43.134 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:42 smithi172 bash[23680]: cluster 2024-03-30T15:05:41.726823+0000 mgr.y (mgr.14152) 280 : cluster 0 pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:43.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:42 smithi072 bash[21573]: cluster 2024-03-30T15:05:41.726823+0000 mgr.y (mgr.14152) 280 : cluster 0 pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:43.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:42 smithi072 bash[28946]: cluster 2024-03-30T15:05:41.726823+0000 mgr.y (mgr.14152) 280 : cluster 0 pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:44.054 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:43 smithi172 bash[23680]: audit 2024-03-30T15:05:43.589574+0000 mon.a (mon.0) 580 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-30T15:05:44.054 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:43 smithi172 bash[23680]: audit 2024-03-30T15:05:43.591239+0000 mon.a (mon.0) 581 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:05:44.054 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:43 smithi172 bash[23680]: cephadm 2024-03-30T15:05:43.592855+0000 mgr.y (mgr.14152) 281 : cephadm 1 Deploying daemon osd.6 on smithi172 2024-03-30T15:05:44.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:43 smithi072 bash[21573]: audit 2024-03-30T15:05:43.589574+0000 mon.a (mon.0) 580 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-30T15:05:44.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:43 smithi072 bash[21573]: audit 2024-03-30T15:05:43.591239+0000 mon.a (mon.0) 581 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:05:44.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:43 smithi072 bash[21573]: cephadm 2024-03-30T15:05:43.592855+0000 mgr.y (mgr.14152) 281 : cephadm 1 Deploying daemon osd.6 on smithi172 2024-03-30T15:05:44.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:43 smithi072 bash[28946]: audit 2024-03-30T15:05:43.589574+0000 mon.a (mon.0) 580 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-30T15:05:44.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:43 smithi072 bash[28946]: audit 2024-03-30T15:05:43.591239+0000 mon.a (mon.0) 581 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:05:44.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:43 smithi072 bash[28946]: cephadm 2024-03-30T15:05:43.592855+0000 mgr.y (mgr.14152) 281 : cephadm 1 Deploying daemon osd.6 on smithi172 2024-03-30T15:05:45.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:44 smithi072 bash[21573]: cluster 2024-03-30T15:05:43.727311+0000 mgr.y (mgr.14152) 282 : cluster 0 pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:45.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:44 smithi072 bash[28946]: cluster 2024-03-30T15:05:43.727311+0000 mgr.y (mgr.14152) 282 : cluster 0 pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:45.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:44 smithi172 bash[23680]: cluster 2024-03-30T15:05:43.727311+0000 mgr.y (mgr.14152) 282 : cluster 0 pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:46.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:46 smithi172 bash[23680]: cluster 2024-03-30T15:05:45.727882+0000 mgr.y (mgr.14152) 283 : cluster 0 pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:47.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:46 smithi072 bash[21573]: cluster 2024-03-30T15:05:45.727882+0000 mgr.y (mgr.14152) 283 : cluster 0 pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:47.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:46 smithi072 bash[28946]: cluster 2024-03-30T15:05:45.727882+0000 mgr.y (mgr.14152) 283 : cluster 0 pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:47.704 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:05:47 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:05:47.704 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 30 15:05:47 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:05:47.704 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:47 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:05:47.705 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:05:47 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:05:47.962 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:05:47 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:05:47.962 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 30 15:05:47 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:05:47.962 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:05:47 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:05:47.962 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:47 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:05:49.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:48 smithi172 bash[23680]: cluster 2024-03-30T15:05:47.728395+0000 mgr.y (mgr.14152) 284 : cluster 0 pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:49.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:48 smithi172 bash[23680]: audit 2024-03-30T15:05:47.969354+0000 mon.a (mon.0) 582 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:49.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:48 smithi172 bash[23680]: audit 2024-03-30T15:05:47.983490+0000 mon.a (mon.0) 583 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:49.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:48 smithi172 bash[23680]: audit 2024-03-30T15:05:47.985374+0000 mon.a (mon.0) 584 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:05:49.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:48 smithi072 bash[21573]: cluster 2024-03-30T15:05:47.728395+0000 mgr.y (mgr.14152) 284 : cluster 0 pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:49.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:48 smithi072 bash[21573]: audit 2024-03-30T15:05:47.969354+0000 mon.a (mon.0) 582 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:49.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:48 smithi072 bash[21573]: audit 2024-03-30T15:05:47.983490+0000 mon.a (mon.0) 583 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:49.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:48 smithi072 bash[21573]: audit 2024-03-30T15:05:47.985374+0000 mon.a (mon.0) 584 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:05:49.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:48 smithi072 bash[28946]: cluster 2024-03-30T15:05:47.728395+0000 mgr.y (mgr.14152) 284 : cluster 0 pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:49.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:48 smithi072 bash[28946]: audit 2024-03-30T15:05:47.969354+0000 mon.a (mon.0) 582 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:49.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:48 smithi072 bash[28946]: audit 2024-03-30T15:05:47.983490+0000 mon.a (mon.0) 583 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:49.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:48 smithi072 bash[28946]: audit 2024-03-30T15:05:47.985374+0000 mon.a (mon.0) 584 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:05:51.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:50 smithi172 bash[23680]: cluster 2024-03-30T15:05:49.728986+0000 mgr.y (mgr.14152) 285 : cluster 0 pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:51.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:50 smithi072 bash[21573]: cluster 2024-03-30T15:05:49.728986+0000 mgr.y (mgr.14152) 285 : cluster 0 pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:51.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:50 smithi072 bash[28946]: cluster 2024-03-30T15:05:49.728986+0000 mgr.y (mgr.14152) 285 : cluster 0 pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:53.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:52 smithi072 bash[28946]: cluster 2024-03-30T15:05:51.729517+0000 mgr.y (mgr.14152) 286 : cluster 0 pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:53.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:52 smithi072 bash[21573]: cluster 2024-03-30T15:05:51.729517+0000 mgr.y (mgr.14152) 286 : cluster 0 pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:53.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:52 smithi172 bash[23680]: cluster 2024-03-30T15:05:51.729517+0000 mgr.y (mgr.14152) 286 : cluster 0 pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:55.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:54 smithi072 bash[21573]: cluster 2024-03-30T15:05:53.730063+0000 mgr.y (mgr.14152) 287 : cluster 0 pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:55.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:54 smithi072 bash[21573]: audit 2024-03-30T15:05:54.444872+0000 mon.a (mon.0) 585 : audit 1 from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-30T15:05:55.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:54 smithi072 bash[21573]: audit 2024-03-30T15:05:54.445715+0000 mon.b (mon.1) 20 : audit 1 from='osd.6 [v2:172.21.15.172:6816/1461064998,v1:172.21.15.172:6817/1461064998]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-30T15:05:55.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:54 smithi072 bash[28946]: cluster 2024-03-30T15:05:53.730063+0000 mgr.y (mgr.14152) 287 : cluster 0 pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:55.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:54 smithi072 bash[28946]: audit 2024-03-30T15:05:54.444872+0000 mon.a (mon.0) 585 : audit 1 from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-30T15:05:55.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:54 smithi072 bash[28946]: audit 2024-03-30T15:05:54.445715+0000 mon.b (mon.1) 20 : audit 1 from='osd.6 [v2:172.21.15.172:6816/1461064998,v1:172.21.15.172:6817/1461064998]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-30T15:05:55.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:54 smithi172 bash[23680]: cluster 2024-03-30T15:05:53.730063+0000 mgr.y (mgr.14152) 287 : cluster 0 pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:55.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:54 smithi172 bash[23680]: audit 2024-03-30T15:05:54.444872+0000 mon.a (mon.0) 585 : audit 1 from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-30T15:05:55.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:54 smithi172 bash[23680]: audit 2024-03-30T15:05:54.445715+0000 mon.b (mon.1) 20 : audit 1 from='osd.6 [v2:172.21.15.172:6816/1461064998,v1:172.21.15.172:6817/1461064998]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-30T15:05:56.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:56 smithi172 bash[23680]: audit 2024-03-30T15:05:54.989179+0000 mon.a (mon.0) 586 : audit 1 from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-30T15:05:56.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:56 smithi172 bash[23680]: audit 2024-03-30T15:05:54.993125+0000 mon.b (mon.1) 21 : audit 1 from='osd.6 [v2:172.21.15.172:6816/1461064998,v1:172.21.15.172:6817/1461064998]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-30T15:05:56.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:56 smithi172 bash[23680]: audit 2024-03-30T15:05:54.997087+0000 mon.a (mon.0) 587 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:56.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:56 smithi172 bash[23680]: cluster 2024-03-30T15:05:54.997646+0000 mon.a (mon.0) 588 : cluster 0 osdmap e44: 7 total, 6 up, 7 in 2024-03-30T15:05:56.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:56 smithi172 bash[23680]: audit 2024-03-30T15:05:54.998963+0000 mon.a (mon.0) 589 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T15:05:56.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:56 smithi172 bash[23680]: audit 2024-03-30T15:05:54.999554+0000 mon.a (mon.0) 590 : audit 1 from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-30T15:05:56.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:56 smithi172 bash[23680]: audit 2024-03-30T15:05:55.009342+0000 mon.a (mon.0) 591 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:56.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:56 smithi172 bash[23680]: audit 2024-03-30T15:05:55.699055+0000 mon.a (mon.0) 592 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:05:56.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:56 smithi172 bash[23680]: audit 2024-03-30T15:05:55.701266+0000 mon.a (mon.0) 593 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:05:56.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:56 smithi172 bash[23680]: audit 2024-03-30T15:05:55.712023+0000 mon.a (mon.0) 594 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:56.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:56 smithi072 bash[21573]: audit 2024-03-30T15:05:54.989179+0000 mon.a (mon.0) 586 : audit 1 from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-30T15:05:56.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:56 smithi072 bash[21573]: audit 2024-03-30T15:05:54.993125+0000 mon.b (mon.1) 21 : audit 1 from='osd.6 [v2:172.21.15.172:6816/1461064998,v1:172.21.15.172:6817/1461064998]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-30T15:05:56.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:56 smithi072 bash[21573]: audit 2024-03-30T15:05:54.997087+0000 mon.a (mon.0) 587 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:56.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:56 smithi072 bash[21573]: cluster 2024-03-30T15:05:54.997646+0000 mon.a (mon.0) 588 : cluster 0 osdmap e44: 7 total, 6 up, 7 in 2024-03-30T15:05:56.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:56 smithi072 bash[21573]: audit 2024-03-30T15:05:54.998963+0000 mon.a (mon.0) 589 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T15:05:56.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:56 smithi072 bash[21573]: audit 2024-03-30T15:05:54.999554+0000 mon.a (mon.0) 590 : audit 1 from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-30T15:05:56.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:56 smithi072 bash[21573]: audit 2024-03-30T15:05:55.009342+0000 mon.a (mon.0) 591 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:56.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:56 smithi072 bash[21573]: audit 2024-03-30T15:05:55.699055+0000 mon.a (mon.0) 592 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:05:56.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:56 smithi072 bash[21573]: audit 2024-03-30T15:05:55.701266+0000 mon.a (mon.0) 593 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:05:56.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:56 smithi072 bash[21573]: audit 2024-03-30T15:05:55.712023+0000 mon.a (mon.0) 594 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:56.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:56 smithi072 bash[28946]: audit 2024-03-30T15:05:54.989179+0000 mon.a (mon.0) 586 : audit 1 from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-30T15:05:56.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:56 smithi072 bash[28946]: audit 2024-03-30T15:05:54.993125+0000 mon.b (mon.1) 21 : audit 1 from='osd.6 [v2:172.21.15.172:6816/1461064998,v1:172.21.15.172:6817/1461064998]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-30T15:05:56.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:56 smithi072 bash[28946]: audit 2024-03-30T15:05:54.997087+0000 mon.a (mon.0) 587 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:56.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:56 smithi072 bash[28946]: cluster 2024-03-30T15:05:54.997646+0000 mon.a (mon.0) 588 : cluster 0 osdmap e44: 7 total, 6 up, 7 in 2024-03-30T15:05:56.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:56 smithi072 bash[28946]: audit 2024-03-30T15:05:54.998963+0000 mon.a (mon.0) 589 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T15:05:56.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:56 smithi072 bash[28946]: audit 2024-03-30T15:05:54.999554+0000 mon.a (mon.0) 590 : audit 1 from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-30T15:05:56.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:56 smithi072 bash[28946]: audit 2024-03-30T15:05:55.009342+0000 mon.a (mon.0) 591 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:56.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:56 smithi072 bash[28946]: audit 2024-03-30T15:05:55.699055+0000 mon.a (mon.0) 592 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:05:56.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:56 smithi072 bash[28946]: audit 2024-03-30T15:05:55.701266+0000 mon.a (mon.0) 593 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:05:56.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:56 smithi072 bash[28946]: audit 2024-03-30T15:05:55.712023+0000 mon.a (mon.0) 594 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:57.303 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:57 smithi172 bash[23680]: cluster 2024-03-30T15:05:55.730605+0000 mgr.y (mgr.14152) 288 : cluster 0 pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:57.304 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:57 smithi172 bash[23680]: audit 2024-03-30T15:05:55.993522+0000 mon.a (mon.0) 595 : audit 1 from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-03-30T15:05:57.304 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:57 smithi172 bash[23680]: cluster 2024-03-30T15:05:55.999819+0000 mon.a (mon.0) 596 : cluster 0 osdmap e45: 7 total, 6 up, 7 in 2024-03-30T15:05:57.304 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:57 smithi172 bash[23680]: audit 2024-03-30T15:05:56.001050+0000 mon.a (mon.0) 597 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T15:05:57.304 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:57 smithi172 bash[23680]: audit 2024-03-30T15:05:56.012407+0000 mon.a (mon.0) 598 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T15:05:57.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:57 smithi072 bash[21573]: cluster 2024-03-30T15:05:55.730605+0000 mgr.y (mgr.14152) 288 : cluster 0 pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:57.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:57 smithi072 bash[21573]: audit 2024-03-30T15:05:55.993522+0000 mon.a (mon.0) 595 : audit 1 from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-03-30T15:05:57.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:57 smithi072 bash[21573]: cluster 2024-03-30T15:05:55.999819+0000 mon.a (mon.0) 596 : cluster 0 osdmap e45: 7 total, 6 up, 7 in 2024-03-30T15:05:57.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:57 smithi072 bash[21573]: audit 2024-03-30T15:05:56.001050+0000 mon.a (mon.0) 597 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T15:05:57.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:57 smithi072 bash[21573]: audit 2024-03-30T15:05:56.012407+0000 mon.a (mon.0) 598 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T15:05:57.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:57 smithi072 bash[28946]: cluster 2024-03-30T15:05:55.730605+0000 mgr.y (mgr.14152) 288 : cluster 0 pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-30T15:05:57.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:57 smithi072 bash[28946]: audit 2024-03-30T15:05:55.993522+0000 mon.a (mon.0) 595 : audit 1 from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-03-30T15:05:57.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:57 smithi072 bash[28946]: cluster 2024-03-30T15:05:55.999819+0000 mon.a (mon.0) 596 : cluster 0 osdmap e45: 7 total, 6 up, 7 in 2024-03-30T15:05:57.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:57 smithi072 bash[28946]: audit 2024-03-30T15:05:56.001050+0000 mon.a (mon.0) 597 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T15:05:57.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:57 smithi072 bash[28946]: audit 2024-03-30T15:05:56.012407+0000 mon.a (mon.0) 598 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T15:05:58.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:58 smithi172 bash[23680]: cluster 2024-03-30T15:05:55.417190+0000 osd.6 (osd.6) 1 : cluster 0 purged_snaps scrub starts 2024-03-30T15:05:58.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:58 smithi172 bash[23680]: cluster 2024-03-30T15:05:55.417292+0000 osd.6 (osd.6) 2 : cluster 0 purged_snaps scrub ok 2024-03-30T15:05:58.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:58 smithi172 bash[23680]: cluster 2024-03-30T15:05:57.002959+0000 mon.a (mon.0) 599 : cluster 1 osd.6 [v2:172.21.15.172:6816/1461064998,v1:172.21.15.172:6817/1461064998] boot 2024-03-30T15:05:58.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:58 smithi172 bash[23680]: cluster 2024-03-30T15:05:57.003140+0000 mon.a (mon.0) 600 : cluster 0 osdmap e46: 7 total, 7 up, 7 in 2024-03-30T15:05:58.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:58 smithi172 bash[23680]: audit 2024-03-30T15:05:57.003859+0000 mon.a (mon.0) 601 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T15:05:58.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:58 smithi172 bash[23680]: cluster 2024-03-30T15:05:58.003613+0000 mon.a (mon.0) 602 : cluster 0 osdmap e47: 7 total, 7 up, 7 in 2024-03-30T15:05:58.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:58 smithi072 bash[21573]: cluster 2024-03-30T15:05:55.417190+0000 osd.6 (osd.6) 1 : cluster 0 purged_snaps scrub starts 2024-03-30T15:05:58.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:58 smithi072 bash[21573]: cluster 2024-03-30T15:05:55.417292+0000 osd.6 (osd.6) 2 : cluster 0 purged_snaps scrub ok 2024-03-30T15:05:58.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:58 smithi072 bash[21573]: cluster 2024-03-30T15:05:57.002959+0000 mon.a (mon.0) 599 : cluster 1 osd.6 [v2:172.21.15.172:6816/1461064998,v1:172.21.15.172:6817/1461064998] boot 2024-03-30T15:05:58.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:58 smithi072 bash[21573]: cluster 2024-03-30T15:05:57.003140+0000 mon.a (mon.0) 600 : cluster 0 osdmap e46: 7 total, 7 up, 7 in 2024-03-30T15:05:58.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:58 smithi072 bash[21573]: audit 2024-03-30T15:05:57.003859+0000 mon.a (mon.0) 601 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T15:05:58.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:58 smithi072 bash[21573]: cluster 2024-03-30T15:05:58.003613+0000 mon.a (mon.0) 602 : cluster 0 osdmap e47: 7 total, 7 up, 7 in 2024-03-30T15:05:58.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:58 smithi072 bash[28946]: cluster 2024-03-30T15:05:55.417190+0000 osd.6 (osd.6) 1 : cluster 0 purged_snaps scrub starts 2024-03-30T15:05:58.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:58 smithi072 bash[28946]: cluster 2024-03-30T15:05:55.417292+0000 osd.6 (osd.6) 2 : cluster 0 purged_snaps scrub ok 2024-03-30T15:05:58.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:58 smithi072 bash[28946]: cluster 2024-03-30T15:05:57.002959+0000 mon.a (mon.0) 599 : cluster 1 osd.6 [v2:172.21.15.172:6816/1461064998,v1:172.21.15.172:6817/1461064998] boot 2024-03-30T15:05:58.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:58 smithi072 bash[28946]: cluster 2024-03-30T15:05:57.003140+0000 mon.a (mon.0) 600 : cluster 0 osdmap e46: 7 total, 7 up, 7 in 2024-03-30T15:05:58.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:58 smithi072 bash[28946]: audit 2024-03-30T15:05:57.003859+0000 mon.a (mon.0) 601 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T15:05:58.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:58 smithi072 bash[28946]: cluster 2024-03-30T15:05:58.003613+0000 mon.a (mon.0) 602 : cluster 0 osdmap e47: 7 total, 7 up, 7 in 2024-03-30T15:05:58.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:58.683+0000 7fcbf97fa700 1 -- 172.21.15.172:0/587654093 <== mgr.14152 v2:172.21.15.72:6800/2777002311 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fcbfc02df50 con 0x7fcbe406da30 2024-03-30T15:05:58.684 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 6 on host 'smithi172' 2024-03-30T15:05:58.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:58.687+0000 7fcc0237d700 1 -- 172.21.15.172:0/587654093 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fcbe406da30 msgr2=0x7fcbe406fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:05:58.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:58.687+0000 7fcc0237d700 1 --2- 172.21.15.172:0/587654093 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fcbe406da30 0x7fcbe406fef0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0005950 tx=0x7fcbf00058e0 comp rx=0 tx=0).stop 2024-03-30T15:05:58.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:58.687+0000 7fcc0237d700 1 -- 172.21.15.172:0/587654093 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcbfc10a480 msgr2=0x7fcbfc1a54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:05:58.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:58.687+0000 7fcc0237d700 1 --2- 172.21.15.172:0/587654093 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcbfc10a480 0x7fcbfc1a54a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4007d90 tx=0x7fcbf4009c30 comp rx=0 tx=0).stop 2024-03-30T15:05:58.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:58.687+0000 7fcc0237d700 1 -- 172.21.15.172:0/587654093 shutdown_connections 2024-03-30T15:05:58.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:58.687+0000 7fcc0237d700 1 --2- 172.21.15.172:0/587654093 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fcbe406da30 0x7fcbe406fef0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:05:58.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:58.687+0000 7fcc0237d700 1 --2- 172.21.15.172:0/587654093 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcbfc10a480 0x7fcbfc1a54a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:05:58.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:58.687+0000 7fcc0237d700 1 --2- 172.21.15.172:0/587654093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbfc1088e0 0x7fcbfc19dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:05:58.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:58.687+0000 7fcc0237d700 1 --2- 172.21.15.172:0/587654093 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcbfc109ae0 0x7fcbfc19e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:05:58.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:58.687+0000 7fcc0237d700 1 -- 172.21.15.172:0/587654093 >> 172.21.15.172:0/587654093 conn(0x7fcbfc0778d0 msgr2=0x7fcbfc0793d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:05:58.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:58.687+0000 7fcc0237d700 1 -- 172.21.15.172:0/587654093 shutdown_connections 2024-03-30T15:05:58.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:05:58.687+0000 7fcc0237d700 1 -- 172.21.15.172:0/587654093 wait complete. 2024-03-30T15:05:59.343 DEBUG:teuthology.orchestra.run.smithi172:osd.6> sudo journalctl -f -n 0 -u ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@osd.6.service 2024-03-30T15:05:59.345 INFO:tasks.cephadm:Deploying osd.7 on smithi172 with /dev/vg_nvme/lv_1... 2024-03-30T15:05:59.346 DEBUG:teuthology.orchestra.run.smithi172:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-03-30T15:05:59.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:59 smithi072 bash[21573]: cluster 2024-03-30T15:05:57.731151+0000 mgr.y (mgr.14152) 289 : cluster 0 pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:05:59.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:59 smithi072 bash[21573]: audit 2024-03-30T15:05:58.627106+0000 mon.a (mon.0) 603 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:59.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:59 smithi072 bash[21573]: audit 2024-03-30T15:05:58.639205+0000 mon.a (mon.0) 604 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:59.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:59 smithi072 bash[21573]: audit 2024-03-30T15:05:58.655323+0000 mon.a (mon.0) 605 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:05:59.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:05:59 smithi072 bash[21573]: cluster 2024-03-30T15:05:59.005608+0000 mon.a (mon.0) 606 : cluster 0 osdmap e48: 7 total, 7 up, 7 in 2024-03-30T15:05:59.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:59 smithi072 bash[28946]: cluster 2024-03-30T15:05:57.731151+0000 mgr.y (mgr.14152) 289 : cluster 0 pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:05:59.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:59 smithi072 bash[28946]: audit 2024-03-30T15:05:58.627106+0000 mon.a (mon.0) 603 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:59.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:59 smithi072 bash[28946]: audit 2024-03-30T15:05:58.639205+0000 mon.a (mon.0) 604 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:59.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:59 smithi072 bash[28946]: audit 2024-03-30T15:05:58.655323+0000 mon.a (mon.0) 605 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:05:59.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:05:59 smithi072 bash[28946]: cluster 2024-03-30T15:05:59.005608+0000 mon.a (mon.0) 606 : cluster 0 osdmap e48: 7 total, 7 up, 7 in 2024-03-30T15:05:59.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:59 smithi172 bash[23680]: cluster 2024-03-30T15:05:57.731151+0000 mgr.y (mgr.14152) 289 : cluster 0 pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:05:59.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:59 smithi172 bash[23680]: audit 2024-03-30T15:05:58.627106+0000 mon.a (mon.0) 603 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:59.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:59 smithi172 bash[23680]: audit 2024-03-30T15:05:58.639205+0000 mon.a (mon.0) 604 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:05:59.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:59 smithi172 bash[23680]: audit 2024-03-30T15:05:58.655323+0000 mon.a (mon.0) 605 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:05:59.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:05:59 smithi172 bash[23680]: cluster 2024-03-30T15:05:59.005608+0000 mon.a (mon.0) 606 : cluster 0 osdmap e48: 7 total, 7 up, 7 in 2024-03-30T15:06:01.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:01 smithi072 bash[21573]: cluster 2024-03-30T15:05:59.731722+0000 mgr.y (mgr.14152) 290 : cluster 0 pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:01.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:01 smithi072 bash[21573]: cluster 2024-03-30T15:06:00.007245+0000 mon.a (mon.0) 607 : cluster 0 osdmap e49: 7 total, 7 up, 7 in 2024-03-30T15:06:01.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:01 smithi072 bash[28946]: cluster 2024-03-30T15:05:59.731722+0000 mgr.y (mgr.14152) 290 : cluster 0 pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:01.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:01 smithi072 bash[28946]: cluster 2024-03-30T15:06:00.007245+0000 mon.a (mon.0) 607 : cluster 0 osdmap e49: 7 total, 7 up, 7 in 2024-03-30T15:06:01.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:01 smithi172 bash[23680]: cluster 2024-03-30T15:05:59.731722+0000 mgr.y (mgr.14152) 290 : cluster 0 pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:01.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:01 smithi172 bash[23680]: cluster 2024-03-30T15:06:00.007245+0000 mon.a (mon.0) 607 : cluster 0 osdmap e49: 7 total, 7 up, 7 in 2024-03-30T15:06:02.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:02 smithi072 bash[28946]: cluster 2024-03-30T15:06:01.016841+0000 mon.a (mon.0) 608 : cluster 0 osdmap e50: 7 total, 7 up, 7 in 2024-03-30T15:06:02.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:02 smithi072 bash[21573]: cluster 2024-03-30T15:06:01.016841+0000 mon.a (mon.0) 608 : cluster 0 osdmap e50: 7 total, 7 up, 7 in 2024-03-30T15:06:02.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:02 smithi172 bash[23680]: cluster 2024-03-30T15:06:01.016841+0000 mon.a (mon.0) 608 : cluster 0 osdmap e50: 7 total, 7 up, 7 in 2024-03-30T15:06:03.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:03 smithi072 bash[28946]: cluster 2024-03-30T15:06:01.732379+0000 mgr.y (mgr.14152) 291 : cluster 0 pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:03.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:03 smithi072 bash[21573]: cluster 2024-03-30T15:06:01.732379+0000 mgr.y (mgr.14152) 291 : cluster 0 pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:03.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:03 smithi172 bash[23680]: cluster 2024-03-30T15:06:01.732379+0000 mgr.y (mgr.14152) 291 : cluster 0 pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:03.639 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.b/config 2024-03-30T15:06:05.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:05 smithi072 bash[28946]: cluster 2024-03-30T15:06:03.733039+0000 mgr.y (mgr.14152) 292 : cluster 0 pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-03-30T15:06:05.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:05 smithi072 bash[21573]: cluster 2024-03-30T15:06:03.733039+0000 mgr.y (mgr.14152) 292 : cluster 0 pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-03-30T15:06:05.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:05 smithi172 bash[23680]: cluster 2024-03-30T15:06:03.733039+0000 mgr.y (mgr.14152) 292 : cluster 0 pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-03-30T15:06:07.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:07 smithi072 bash[21573]: cluster 2024-03-30T15:06:05.733631+0000 mgr.y (mgr.14152) 293 : cluster 0 pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-03-30T15:06:07.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:07 smithi072 bash[28946]: cluster 2024-03-30T15:06:05.733631+0000 mgr.y (mgr.14152) 293 : cluster 0 pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-03-30T15:06:07.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:07 smithi172 bash[23680]: cluster 2024-03-30T15:06:05.733631+0000 mgr.y (mgr.14152) 293 : cluster 0 pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-03-30T15:06:07.827 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-03-30T15:06:07.827 INFO:teuthology.orchestra.run.smithi172.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-03-30T15:06:07.827 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 10+0 records in 2024-03-30T15:06:07.827 INFO:teuthology.orchestra.run.smithi172.stderr:10+0 records out 2024-03-30T15:06:07.828 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0130739 s, 802 MB/s 2024-03-30T15:06:07.828 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping successful for: 2024-03-30T15:06:08.594 DEBUG:teuthology.orchestra.run.smithi172:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi172:vg_nvme/lv_1 2024-03-30T15:06:09.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:09 smithi072 bash[21573]: cluster 2024-03-30T15:06:07.734246+0000 mgr.y (mgr.14152) 294 : cluster 0 pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-30T15:06:09.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:09 smithi072 bash[28946]: cluster 2024-03-30T15:06:07.734246+0000 mgr.y (mgr.14152) 294 : cluster 0 pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-30T15:06:09.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:09 smithi172 bash[23680]: cluster 2024-03-30T15:06:07.734246+0000 mgr.y (mgr.14152) 294 : cluster 0 pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-30T15:06:10.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:10 smithi072 bash[21573]: cephadm 2024-03-30T15:06:09.050207+0000 mgr.y (mgr.14152) 295 : cephadm 1 Detected new or changed devices on smithi172 2024-03-30T15:06:10.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:10 smithi072 bash[21573]: audit 2024-03-30T15:06:09.060473+0000 mon.a (mon.0) 609 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:06:10.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:10 smithi072 bash[21573]: audit 2024-03-30T15:06:09.072695+0000 mon.a (mon.0) 610 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:06:10.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:10 smithi072 bash[21573]: audit 2024-03-30T15:06:09.075160+0000 mon.a (mon.0) 611 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:06:10.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:10 smithi072 bash[21573]: audit 2024-03-30T15:06:09.076932+0000 mon.a (mon.0) 612 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:06:10.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:10 smithi072 bash[21573]: audit 2024-03-30T15:06:09.078630+0000 mon.a (mon.0) 613 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:06:10.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:10 smithi072 bash[21573]: cephadm 2024-03-30T15:06:09.079895+0000 mgr.y (mgr.14152) 296 : cephadm 1 Adjusting osd_memory_target on smithi172 to 5755M 2024-03-30T15:06:10.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:10 smithi072 bash[21573]: audit 2024-03-30T15:06:09.086447+0000 mon.a (mon.0) 614 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:06:10.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:10 smithi072 bash[21573]: audit 2024-03-30T15:06:09.091036+0000 mon.a (mon.0) 615 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:06:10.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:10 smithi072 bash[21573]: audit 2024-03-30T15:06:09.092786+0000 mon.a (mon.0) 616 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:06:10.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:10 smithi072 bash[21573]: audit 2024-03-30T15:06:09.102716+0000 mon.a (mon.0) 617 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:06:10.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:10 smithi072 bash[28946]: cephadm 2024-03-30T15:06:09.050207+0000 mgr.y (mgr.14152) 295 : cephadm 1 Detected new or changed devices on smithi172 2024-03-30T15:06:10.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:10 smithi072 bash[28946]: audit 2024-03-30T15:06:09.060473+0000 mon.a (mon.0) 609 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:06:10.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:10 smithi072 bash[28946]: audit 2024-03-30T15:06:09.072695+0000 mon.a (mon.0) 610 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:06:10.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:10 smithi072 bash[28946]: audit 2024-03-30T15:06:09.075160+0000 mon.a (mon.0) 611 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:06:10.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:10 smithi072 bash[28946]: audit 2024-03-30T15:06:09.076932+0000 mon.a (mon.0) 612 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:06:10.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:10 smithi072 bash[28946]: audit 2024-03-30T15:06:09.078630+0000 mon.a (mon.0) 613 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:06:10.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:10 smithi072 bash[28946]: cephadm 2024-03-30T15:06:09.079895+0000 mgr.y (mgr.14152) 296 : cephadm 1 Adjusting osd_memory_target on smithi172 to 5755M 2024-03-30T15:06:10.424 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:10 smithi072 bash[28946]: audit 2024-03-30T15:06:09.086447+0000 mon.a (mon.0) 614 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:06:10.424 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:10 smithi072 bash[28946]: audit 2024-03-30T15:06:09.091036+0000 mon.a (mon.0) 615 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:06:10.424 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:10 smithi072 bash[28946]: audit 2024-03-30T15:06:09.092786+0000 mon.a (mon.0) 616 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:06:10.424 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:10 smithi072 bash[28946]: audit 2024-03-30T15:06:09.102716+0000 mon.a (mon.0) 617 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:06:10.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:10 smithi172 bash[23680]: cephadm 2024-03-30T15:06:09.050207+0000 mgr.y (mgr.14152) 295 : cephadm 1 Detected new or changed devices on smithi172 2024-03-30T15:06:10.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:10 smithi172 bash[23680]: audit 2024-03-30T15:06:09.060473+0000 mon.a (mon.0) 609 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:06:10.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:10 smithi172 bash[23680]: audit 2024-03-30T15:06:09.072695+0000 mon.a (mon.0) 610 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:06:10.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:10 smithi172 bash[23680]: audit 2024-03-30T15:06:09.075160+0000 mon.a (mon.0) 611 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:06:10.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:10 smithi172 bash[23680]: audit 2024-03-30T15:06:09.076932+0000 mon.a (mon.0) 612 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:06:10.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:10 smithi172 bash[23680]: audit 2024-03-30T15:06:09.078630+0000 mon.a (mon.0) 613 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:06:10.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:10 smithi172 bash[23680]: cephadm 2024-03-30T15:06:09.079895+0000 mgr.y (mgr.14152) 296 : cephadm 1 Adjusting osd_memory_target on smithi172 to 5755M 2024-03-30T15:06:10.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:10 smithi172 bash[23680]: audit 2024-03-30T15:06:09.086447+0000 mon.a (mon.0) 614 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:06:10.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:10 smithi172 bash[23680]: audit 2024-03-30T15:06:09.091036+0000 mon.a (mon.0) 615 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:06:10.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:10 smithi172 bash[23680]: audit 2024-03-30T15:06:09.092786+0000 mon.a (mon.0) 616 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:06:10.469 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:10 smithi172 bash[23680]: audit 2024-03-30T15:06:09.102716+0000 mon.a (mon.0) 617 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:06:11.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:11 smithi072 bash[21573]: cluster 2024-03-30T15:06:09.734820+0000 mgr.y (mgr.14152) 297 : cluster 0 pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-03-30T15:06:11.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:11 smithi072 bash[28946]: cluster 2024-03-30T15:06:09.734820+0000 mgr.y (mgr.14152) 297 : cluster 0 pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-03-30T15:06:11.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:11 smithi172 bash[23680]: cluster 2024-03-30T15:06:09.734820+0000 mgr.y (mgr.14152) 297 : cluster 0 pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-03-30T15:06:13.327 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.b/config 2024-03-30T15:06:13.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:13 smithi072 bash[21573]: cluster 2024-03-30T15:06:11.735424+0000 mgr.y (mgr.14152) 298 : cluster 0 pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-03-30T15:06:13.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:13 smithi072 bash[28946]: cluster 2024-03-30T15:06:11.735424+0000 mgr.y (mgr.14152) 298 : cluster 0 pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-03-30T15:06:13.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:13 smithi172 bash[23680]: cluster 2024-03-30T15:06:11.735424+0000 mgr.y (mgr.14152) 298 : cluster 0 pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-03-30T15:06:15.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:15 smithi072 bash[21573]: cluster 2024-03-30T15:06:13.735955+0000 mgr.y (mgr.14152) 299 : cluster 0 pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-03-30T15:06:15.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:15 smithi072 bash[28946]: cluster 2024-03-30T15:06:13.735955+0000 mgr.y (mgr.14152) 299 : cluster 0 pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-03-30T15:06:15.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:15 smithi172 bash[23680]: cluster 2024-03-30T15:06:13.735955+0000 mgr.y (mgr.14152) 299 : cluster 0 pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-03-30T15:06:15.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:15.822+0000 7fc5d08a0700 1 -- 172.21.15.172:0/299484477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5cc109ae0 msgr2=0x7fc5cc109f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:06:15.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:15.822+0000 7fc5d08a0700 1 --2- 172.21.15.172:0/299484477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5cc109ae0 0x7fc5cc109f40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc5c00099c0 tx=0x7fc5c0009cd0 comp rx=0 tx=0).stop 2024-03-30T15:06:15.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:15.822+0000 7fc5d08a0700 1 -- 172.21.15.172:0/299484477 shutdown_connections 2024-03-30T15:06:15.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:15.822+0000 7fc5d08a0700 1 --2- 172.21.15.172:0/299484477 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5cc10a480 0x7fc5cc110d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:06:15.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:15.822+0000 7fc5d08a0700 1 --2- 172.21.15.172:0/299484477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5cc1088e0 0x7fc5cc108d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:06:15.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:15.822+0000 7fc5d08a0700 1 --2- 172.21.15.172:0/299484477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5cc109ae0 0x7fc5cc109f40 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:06:15.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:15.822+0000 7fc5d08a0700 1 -- 172.21.15.172:0/299484477 >> 172.21.15.172:0/299484477 conn(0x7fc5cc0778d0 msgr2=0x7fc5cc079cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:06:15.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:15.822+0000 7fc5d08a0700 1 -- 172.21.15.172:0/299484477 shutdown_connections 2024-03-30T15:06:15.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:15.822+0000 7fc5d08a0700 1 -- 172.21.15.172:0/299484477 wait complete. 2024-03-30T15:06:15.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:15.822+0000 7fc5d08a0700 1 Processor -- start 2024-03-30T15:06:15.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:15.822+0000 7fc5d08a0700 1 -- start start 2024-03-30T15:06:15.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:15.822+0000 7fc5d08a0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5cc1088e0 0x7fc5cc19e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:06:15.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:15.822+0000 7fc5d08a0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5cc109ae0 0x7fc5cc19e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:06:15.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:15.822+0000 7fc5d08a0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5cc10a480 0x7fc5cc1a5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:06:15.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:15.822+0000 7fc5d08a0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc5cc1139d0 con 0x7fc5cc1088e0 2024-03-30T15:06:15.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:15.822+0000 7fc5d08a0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc5cc113850 con 0x7fc5cc109ae0 2024-03-30T15:06:15.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:15.822+0000 7fc5d08a0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fc5cc113b50 con 0x7fc5cc10a480 2024-03-30T15:06:15.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:15.822+0000 7fc5c9d9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5cc109ae0 0x7fc5cc19e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:06:15.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:15.822+0000 7fc5c9d9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5cc109ae0 0x7fc5cc19e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:55344/0 (socket says 172.21.15.172:55344) 2024-03-30T15:06:15.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:15.822+0000 7fc5c9d9b700 1 -- 172.21.15.172:0/845214907 learned_addr learned my addr 172.21.15.172:0/845214907 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-03-30T15:06:15.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:15.822+0000 7fc5ca59c700 1 --2- 172.21.15.172:0/845214907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5cc1088e0 0x7fc5cc19e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:06:15.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:15.822+0000 7fc5c9d9b700 1 -- 172.21.15.172:0/845214907 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5cc10a480 msgr2=0x7fc5cc1a5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:06:15.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:15.822+0000 7fc5c9d9b700 1 --2- 172.21.15.172:0/845214907 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5cc10a480 0x7fc5cc1a5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:06:15.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:15.822+0000 7fc5c9d9b700 1 -- 172.21.15.172:0/845214907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5cc1088e0 msgr2=0x7fc5cc19e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:06:15.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:15.822+0000 7fc5c9d9b700 1 --2- 172.21.15.172:0/845214907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5cc1088e0 0x7fc5cc19e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:06:15.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:15.822+0000 7fc5c9d9b700 1 -- 172.21.15.172:0/845214907 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5cc1a5cc0 con 0x7fc5cc109ae0 2024-03-30T15:06:15.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:15.826+0000 7fc5c9d9b700 1 --2- 172.21.15.172:0/845214907 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5cc109ae0 0x7fc5cc19e5a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0009990 tx=0x7fc5c0003970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:06:15.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:15.826+0000 7fc5bb7fe700 1 -- 172.21.15.172:0/845214907 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c0027070 con 0x7fc5cc109ae0 2024-03-30T15:06:15.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:15.826+0000 7fc5d08a0700 1 -- 172.21.15.172:0/845214907 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5cc1a5f50 con 0x7fc5cc109ae0 2024-03-30T15:06:15.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:15.826+0000 7fc5bb7fe700 1 -- 172.21.15.172:0/845214907 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7fc5c0022470 con 0x7fc5cc109ae0 2024-03-30T15:06:15.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:15.826+0000 7fc5bb7fe700 1 -- 172.21.15.172:0/845214907 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c000f6c0 con 0x7fc5cc109ae0 2024-03-30T15:06:15.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:15.826+0000 7fc5d08a0700 1 -- 172.21.15.172:0/845214907 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5cc1a6420 con 0x7fc5cc109ae0 2024-03-30T15:06:15.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:15.826+0000 7fc5d08a0700 1 -- 172.21.15.172:0/845214907 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5cc04ff00 con 0x7fc5cc109ae0 2024-03-30T15:06:15.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:15.826+0000 7fc5bb7fe700 1 -- 172.21.15.172:0/845214907 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 15) ==== 91774+0+0 (secure 0 0 0) 0x7fc5c002a070 con 0x7fc5cc109ae0 2024-03-30T15:06:15.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:15.826+0000 7fc5bb7fe700 1 --2- 172.21.15.172:0/845214907 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fc5b406db50 0x7fc5b4070010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:06:15.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:15.826+0000 7fc5bb7fe700 1 -- 172.21.15.172:0/845214907 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4855+0+0 (secure 0 0 0) 0x7fc5c008e5d0 con 0x7fc5cc109ae0 2024-03-30T15:06:15.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:15.826+0000 7fc5ca59c700 1 --2- 172.21.15.172:0/845214907 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fc5b406db50 0x7fc5b4070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:06:15.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:15.826+0000 7fc5ca59c700 1 --2- 172.21.15.172:0/845214907 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fc5b406db50 0x7fc5b4070010 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc109940 tx=0x7fc5bc005cf0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:06:15.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:15.830+0000 7fc5bb7fe700 1 -- 172.21.15.172:0/845214907 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fc5c0013070 con 0x7fc5cc109ae0 2024-03-30T15:06:16.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:16.054+0000 7fc5d08a0700 1 -- 172.21.15.172:0/845214907 --> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fc5cc062680 con 0x7fc5b406db50 2024-03-30T15:06:16.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:16 smithi072 bash[21573]: audit 2024-03-30T15:06:16.065829+0000 mon.a (mon.0) 618 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T15:06:16.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:16 smithi072 bash[21573]: audit 2024-03-30T15:06:16.072170+0000 mon.a (mon.0) 619 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T15:06:16.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:16 smithi072 bash[21573]: audit 2024-03-30T15:06:16.073989+0000 mon.a (mon.0) 620 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:06:16.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:16 smithi072 bash[28946]: audit 2024-03-30T15:06:16.065829+0000 mon.a (mon.0) 618 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T15:06:16.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:16 smithi072 bash[28946]: audit 2024-03-30T15:06:16.072170+0000 mon.a (mon.0) 619 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T15:06:16.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:16 smithi072 bash[28946]: audit 2024-03-30T15:06:16.073989+0000 mon.a (mon.0) 620 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:06:16.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:16 smithi172 bash[23680]: audit 2024-03-30T15:06:16.065829+0000 mon.a (mon.0) 618 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T15:06:16.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:16 smithi172 bash[23680]: audit 2024-03-30T15:06:16.072170+0000 mon.a (mon.0) 619 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T15:06:16.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:16 smithi172 bash[23680]: audit 2024-03-30T15:06:16.073989+0000 mon.a (mon.0) 620 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:06:17.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:17 smithi072 bash[21573]: cluster 2024-03-30T15:06:15.736605+0000 mgr.y (mgr.14152) 300 : cluster 0 pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:17.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:17 smithi072 bash[21573]: audit 2024-03-30T15:06:16.058825+0000 mgr.y (mgr.14152) 301 : audit 0 from='client.24262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T15:06:17.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:17 smithi072 bash[28946]: cluster 2024-03-30T15:06:15.736605+0000 mgr.y (mgr.14152) 300 : cluster 0 pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:17.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:17 smithi072 bash[28946]: audit 2024-03-30T15:06:16.058825+0000 mgr.y (mgr.14152) 301 : audit 0 from='client.24262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T15:06:17.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:17 smithi172 bash[23680]: cluster 2024-03-30T15:06:15.736605+0000 mgr.y (mgr.14152) 300 : cluster 0 pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:17.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:17 smithi172 bash[23680]: audit 2024-03-30T15:06:16.058825+0000 mgr.y (mgr.14152) 301 : audit 0 from='client.24262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T15:06:19.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:19 smithi072 bash[21573]: cluster 2024-03-30T15:06:17.737236+0000 mgr.y (mgr.14152) 302 : cluster 0 pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:19.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:19 smithi072 bash[28946]: cluster 2024-03-30T15:06:17.737236+0000 mgr.y (mgr.14152) 302 : cluster 0 pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:19.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:19 smithi172 bash[23680]: cluster 2024-03-30T15:06:17.737236+0000 mgr.y (mgr.14152) 302 : cluster 0 pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:21.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:21 smithi072 bash[21573]: cluster 2024-03-30T15:06:19.737838+0000 mgr.y (mgr.14152) 303 : cluster 0 pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:21.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:21 smithi072 bash[28946]: cluster 2024-03-30T15:06:19.737838+0000 mgr.y (mgr.14152) 303 : cluster 0 pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:21.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:21 smithi172 bash[23680]: cluster 2024-03-30T15:06:19.737838+0000 mgr.y (mgr.14152) 303 : cluster 0 pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:23.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:23 smithi072 bash[21573]: cluster 2024-03-30T15:06:21.738516+0000 mgr.y (mgr.14152) 304 : cluster 0 pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:23.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:23 smithi072 bash[28946]: cluster 2024-03-30T15:06:21.738516+0000 mgr.y (mgr.14152) 304 : cluster 0 pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:23.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:23 smithi172 bash[23680]: cluster 2024-03-30T15:06:21.738516+0000 mgr.y (mgr.14152) 304 : cluster 0 pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:25.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:25 smithi072 bash[21573]: cluster 2024-03-30T15:06:23.739229+0000 mgr.y (mgr.14152) 305 : cluster 0 pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:25.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:25 smithi072 bash[21573]: audit 2024-03-30T15:06:24.421863+0000 mon.a (mon.0) 621 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cbb6a8aa-f398-4980-8e11-f3c2113c93b9"}]: dispatch 2024-03-30T15:06:25.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:25 smithi072 bash[21573]: audit 2024-03-30T15:06:24.422645+0000 mon.b (mon.1) 22 : audit 1 from='client.? 172.21.15.172:0/4140645785' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cbb6a8aa-f398-4980-8e11-f3c2113c93b9"}]: dispatch 2024-03-30T15:06:25.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:25 smithi072 bash[21573]: audit 2024-03-30T15:06:24.425352+0000 mon.a (mon.0) 622 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cbb6a8aa-f398-4980-8e11-f3c2113c93b9"}]': finished 2024-03-30T15:06:25.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:25 smithi072 bash[21573]: cluster 2024-03-30T15:06:24.431868+0000 mon.a (mon.0) 623 : cluster 0 osdmap e51: 8 total, 7 up, 8 in 2024-03-30T15:06:25.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:25 smithi072 bash[21573]: audit 2024-03-30T15:06:24.432543+0000 mon.a (mon.0) 624 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T15:06:25.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:25 smithi072 bash[28946]: cluster 2024-03-30T15:06:23.739229+0000 mgr.y (mgr.14152) 305 : cluster 0 pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:25.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:25 smithi072 bash[28946]: audit 2024-03-30T15:06:24.421863+0000 mon.a (mon.0) 621 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cbb6a8aa-f398-4980-8e11-f3c2113c93b9"}]: dispatch 2024-03-30T15:06:25.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:25 smithi072 bash[28946]: audit 2024-03-30T15:06:24.422645+0000 mon.b (mon.1) 22 : audit 1 from='client.? 172.21.15.172:0/4140645785' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cbb6a8aa-f398-4980-8e11-f3c2113c93b9"}]: dispatch 2024-03-30T15:06:25.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:25 smithi072 bash[28946]: audit 2024-03-30T15:06:24.425352+0000 mon.a (mon.0) 622 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cbb6a8aa-f398-4980-8e11-f3c2113c93b9"}]': finished 2024-03-30T15:06:25.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:25 smithi072 bash[28946]: cluster 2024-03-30T15:06:24.431868+0000 mon.a (mon.0) 623 : cluster 0 osdmap e51: 8 total, 7 up, 8 in 2024-03-30T15:06:25.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:25 smithi072 bash[28946]: audit 2024-03-30T15:06:24.432543+0000 mon.a (mon.0) 624 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T15:06:25.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:25 smithi172 bash[23680]: cluster 2024-03-30T15:06:23.739229+0000 mgr.y (mgr.14152) 305 : cluster 0 pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:25.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:25 smithi172 bash[23680]: audit 2024-03-30T15:06:24.421863+0000 mon.a (mon.0) 621 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cbb6a8aa-f398-4980-8e11-f3c2113c93b9"}]: dispatch 2024-03-30T15:06:25.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:25 smithi172 bash[23680]: audit 2024-03-30T15:06:24.422645+0000 mon.b (mon.1) 22 : audit 1 from='client.? 172.21.15.172:0/4140645785' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cbb6a8aa-f398-4980-8e11-f3c2113c93b9"}]: dispatch 2024-03-30T15:06:25.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:25 smithi172 bash[23680]: audit 2024-03-30T15:06:24.425352+0000 mon.a (mon.0) 622 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cbb6a8aa-f398-4980-8e11-f3c2113c93b9"}]': finished 2024-03-30T15:06:25.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:25 smithi172 bash[23680]: cluster 2024-03-30T15:06:24.431868+0000 mon.a (mon.0) 623 : cluster 0 osdmap e51: 8 total, 7 up, 8 in 2024-03-30T15:06:25.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:25 smithi172 bash[23680]: audit 2024-03-30T15:06:24.432543+0000 mon.a (mon.0) 624 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T15:06:26.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:26 smithi072 bash[21573]: audit 2024-03-30T15:06:25.155471+0000 mon.b (mon.1) 23 : audit 0 from='client.? 172.21.15.172:0/2567432514' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T15:06:26.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:26 smithi072 bash[28946]: audit 2024-03-30T15:06:25.155471+0000 mon.b (mon.1) 23 : audit 0 from='client.? 172.21.15.172:0/2567432514' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T15:06:26.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:26 smithi172 bash[23680]: audit 2024-03-30T15:06:25.155471+0000 mon.b (mon.1) 23 : audit 0 from='client.? 172.21.15.172:0/2567432514' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T15:06:27.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:27 smithi072 bash[28946]: cluster 2024-03-30T15:06:25.739838+0000 mgr.y (mgr.14152) 306 : cluster 0 pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:27.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:27 smithi072 bash[21573]: cluster 2024-03-30T15:06:25.739838+0000 mgr.y (mgr.14152) 306 : cluster 0 pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:27.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:27 smithi172 bash[23680]: cluster 2024-03-30T15:06:25.739838+0000 mgr.y (mgr.14152) 306 : cluster 0 pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:29.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:29 smithi072 bash[21573]: cluster 2024-03-30T15:06:27.740420+0000 mgr.y (mgr.14152) 307 : cluster 0 pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:29.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:29 smithi072 bash[28946]: cluster 2024-03-30T15:06:27.740420+0000 mgr.y (mgr.14152) 307 : cluster 0 pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:29.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:29 smithi172 bash[23680]: cluster 2024-03-30T15:06:27.740420+0000 mgr.y (mgr.14152) 307 : cluster 0 pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:31.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:31 smithi072 bash[21573]: cluster 2024-03-30T15:06:29.740968+0000 mgr.y (mgr.14152) 308 : cluster 0 pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:31.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:31 smithi072 bash[28946]: cluster 2024-03-30T15:06:29.740968+0000 mgr.y (mgr.14152) 308 : cluster 0 pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:31.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:31 smithi172 bash[23680]: cluster 2024-03-30T15:06:29.740968+0000 mgr.y (mgr.14152) 308 : cluster 0 pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:33.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:33 smithi072 bash[21573]: cluster 2024-03-30T15:06:31.741488+0000 mgr.y (mgr.14152) 309 : cluster 0 pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:33.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:33 smithi072 bash[28946]: cluster 2024-03-30T15:06:31.741488+0000 mgr.y (mgr.14152) 309 : cluster 0 pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:33.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:33 smithi172 bash[23680]: cluster 2024-03-30T15:06:31.741488+0000 mgr.y (mgr.14152) 309 : cluster 0 pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:35.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:35 smithi072 bash[21573]: cluster 2024-03-30T15:06:33.742100+0000 mgr.y (mgr.14152) 310 : cluster 0 pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:35.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:35 smithi072 bash[28946]: cluster 2024-03-30T15:06:33.742100+0000 mgr.y (mgr.14152) 310 : cluster 0 pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:35.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:35 smithi172 bash[23680]: cluster 2024-03-30T15:06:33.742100+0000 mgr.y (mgr.14152) 310 : cluster 0 pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:37.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:37 smithi072 bash[21573]: cluster 2024-03-30T15:06:35.742677+0000 mgr.y (mgr.14152) 311 : cluster 0 pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:37.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:37 smithi072 bash[21573]: audit 2024-03-30T15:06:36.964120+0000 mon.a (mon.0) 625 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-30T15:06:37.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:37 smithi072 bash[21573]: audit 2024-03-30T15:06:36.965891+0000 mon.a (mon.0) 626 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:06:37.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:37 smithi072 bash[28946]: cluster 2024-03-30T15:06:35.742677+0000 mgr.y (mgr.14152) 311 : cluster 0 pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:37.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:37 smithi072 bash[28946]: audit 2024-03-30T15:06:36.964120+0000 mon.a (mon.0) 625 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-30T15:06:37.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:37 smithi072 bash[28946]: audit 2024-03-30T15:06:36.965891+0000 mon.a (mon.0) 626 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:06:37.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:37 smithi172 bash[23680]: cluster 2024-03-30T15:06:35.742677+0000 mgr.y (mgr.14152) 311 : cluster 0 pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:37.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:37 smithi172 bash[23680]: audit 2024-03-30T15:06:36.964120+0000 mon.a (mon.0) 625 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-30T15:06:37.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:37 smithi172 bash[23680]: audit 2024-03-30T15:06:36.965891+0000 mon.a (mon.0) 626 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:06:38.442 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:38 smithi172 bash[23680]: cephadm 2024-03-30T15:06:36.967457+0000 mgr.y (mgr.14152) 312 : cephadm 1 Deploying daemon osd.7 on smithi172 2024-03-30T15:06:38.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:38 smithi072 bash[21573]: cephadm 2024-03-30T15:06:36.967457+0000 mgr.y (mgr.14152) 312 : cephadm 1 Deploying daemon osd.7 on smithi172 2024-03-30T15:06:38.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:38 smithi072 bash[28946]: cephadm 2024-03-30T15:06:36.967457+0000 mgr.y (mgr.14152) 312 : cephadm 1 Deploying daemon osd.7 on smithi172 2024-03-30T15:06:39.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:39 smithi172 bash[23680]: cluster 2024-03-30T15:06:37.743345+0000 mgr.y (mgr.14152) 313 : cluster 0 pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:39.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:39 smithi072 bash[21573]: cluster 2024-03-30T15:06:37.743345+0000 mgr.y (mgr.14152) 313 : cluster 0 pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:39.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:39 smithi072 bash[28946]: cluster 2024-03-30T15:06:37.743345+0000 mgr.y (mgr.14152) 313 : cluster 0 pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:41.451 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:41 smithi172 bash[23680]: cluster 2024-03-30T15:06:39.743959+0000 mgr.y (mgr.14152) 314 : cluster 0 pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:41.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:41 smithi072 bash[21573]: cluster 2024-03-30T15:06:39.743959+0000 mgr.y (mgr.14152) 314 : cluster 0 pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:41.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:41 smithi072 bash[28946]: cluster 2024-03-30T15:06:39.743959+0000 mgr.y (mgr.14152) 314 : cluster 0 pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:41.702 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:41 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:06:41.702 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:41 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:06:41.702 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:06:41 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:06:41.703 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 30 15:06:41 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:06:41.703 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 30 15:06:41 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:06:41.703 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:06:41 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:06:41.703 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:06:41 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:06:41.704 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:06:41 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:06:41.704 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:06:41 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:06:41.967 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:06:41 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:06:42.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:42 smithi172 bash[23680]: cluster 2024-03-30T15:06:41.744614+0000 mgr.y (mgr.14152) 315 : cluster 0 pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:42.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:42 smithi172 bash[23680]: audit 2024-03-30T15:06:41.857702+0000 mon.a (mon.0) 627 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:06:42.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:42 smithi172 bash[23680]: audit 2024-03-30T15:06:41.867494+0000 mon.a (mon.0) 628 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:06:42.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:42 smithi172 bash[23680]: audit 2024-03-30T15:06:41.880342+0000 mon.a (mon.0) 629 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:06:43.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:42 smithi072 bash[28946]: cluster 2024-03-30T15:06:41.744614+0000 mgr.y (mgr.14152) 315 : cluster 0 pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:43.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:42 smithi072 bash[28946]: audit 2024-03-30T15:06:41.857702+0000 mon.a (mon.0) 627 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:06:43.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:42 smithi072 bash[28946]: audit 2024-03-30T15:06:41.867494+0000 mon.a (mon.0) 628 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:06:43.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:42 smithi072 bash[28946]: audit 2024-03-30T15:06:41.880342+0000 mon.a (mon.0) 629 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:06:43.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:42 smithi072 bash[21573]: cluster 2024-03-30T15:06:41.744614+0000 mgr.y (mgr.14152) 315 : cluster 0 pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:43.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:42 smithi072 bash[21573]: audit 2024-03-30T15:06:41.857702+0000 mon.a (mon.0) 627 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:06:43.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:42 smithi072 bash[21573]: audit 2024-03-30T15:06:41.867494+0000 mon.a (mon.0) 628 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:06:43.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:42 smithi072 bash[21573]: audit 2024-03-30T15:06:41.880342+0000 mon.a (mon.0) 629 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:06:44.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:44 smithi172 bash[23680]: cluster 2024-03-30T15:06:43.745237+0000 mgr.y (mgr.14152) 316 : cluster 0 pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:45.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:44 smithi072 bash[21573]: cluster 2024-03-30T15:06:43.745237+0000 mgr.y (mgr.14152) 316 : cluster 0 pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:45.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:44 smithi072 bash[28946]: cluster 2024-03-30T15:06:43.745237+0000 mgr.y (mgr.14152) 316 : cluster 0 pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:47.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:46 smithi072 bash[21573]: cluster 2024-03-30T15:06:45.745758+0000 mgr.y (mgr.14152) 317 : cluster 0 pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:47.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:46 smithi072 bash[28946]: cluster 2024-03-30T15:06:45.745758+0000 mgr.y (mgr.14152) 317 : cluster 0 pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:47.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:46 smithi172 bash[23680]: cluster 2024-03-30T15:06:45.745758+0000 mgr.y (mgr.14152) 317 : cluster 0 pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:49.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:48 smithi072 bash[21573]: cluster 2024-03-30T15:06:47.746335+0000 mgr.y (mgr.14152) 318 : cluster 0 pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:49.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:48 smithi072 bash[21573]: audit 2024-03-30T15:06:48.256638+0000 mon.a (mon.0) 630 : audit 1 from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-30T15:06:49.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:48 smithi072 bash[21573]: audit 2024-03-30T15:06:48.257792+0000 mon.b (mon.1) 24 : audit 1 from='osd.7 [v2:172.21.15.172:6824/1721454347,v1:172.21.15.172:6825/1721454347]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-30T15:06:49.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:48 smithi072 bash[28946]: cluster 2024-03-30T15:06:47.746335+0000 mgr.y (mgr.14152) 318 : cluster 0 pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:49.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:48 smithi072 bash[28946]: audit 2024-03-30T15:06:48.256638+0000 mon.a (mon.0) 630 : audit 1 from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-30T15:06:49.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:48 smithi072 bash[28946]: audit 2024-03-30T15:06:48.257792+0000 mon.b (mon.1) 24 : audit 1 from='osd.7 [v2:172.21.15.172:6824/1721454347,v1:172.21.15.172:6825/1721454347]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-30T15:06:49.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:48 smithi172 bash[23680]: cluster 2024-03-30T15:06:47.746335+0000 mgr.y (mgr.14152) 318 : cluster 0 pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:49.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:48 smithi172 bash[23680]: audit 2024-03-30T15:06:48.256638+0000 mon.a (mon.0) 630 : audit 1 from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-30T15:06:49.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:48 smithi172 bash[23680]: audit 2024-03-30T15:06:48.257792+0000 mon.b (mon.1) 24 : audit 1 from='osd.7 [v2:172.21.15.172:6824/1721454347,v1:172.21.15.172:6825/1721454347]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-30T15:06:49.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:49 smithi172 bash[23680]: audit 2024-03-30T15:06:48.879930+0000 mon.a (mon.0) 631 : audit 1 from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-30T15:06:49.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:49 smithi172 bash[23680]: cluster 2024-03-30T15:06:48.885640+0000 mon.a (mon.0) 632 : cluster 0 osdmap e52: 8 total, 7 up, 8 in 2024-03-30T15:06:49.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:49 smithi172 bash[23680]: audit 2024-03-30T15:06:48.885733+0000 mon.b (mon.1) 25 : audit 1 from='osd.7 [v2:172.21.15.172:6824/1721454347,v1:172.21.15.172:6825/1721454347]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-30T15:06:49.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:49 smithi172 bash[23680]: audit 2024-03-30T15:06:48.886138+0000 mon.a (mon.0) 633 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T15:06:49.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:49 smithi172 bash[23680]: audit 2024-03-30T15:06:48.887041+0000 mon.a (mon.0) 634 : audit 1 from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-30T15:06:49.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:49 smithi172 bash[23680]: audit 2024-03-30T15:06:48.893891+0000 mon.a (mon.0) 635 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:06:49.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:49 smithi172 bash[23680]: audit 2024-03-30T15:06:48.903880+0000 mon.a (mon.0) 636 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:06:49.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:49 smithi172 bash[23680]: audit 2024-03-30T15:06:48.906201+0000 mon.a (mon.0) 637 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:06:49.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:49 smithi172 bash[23680]: audit 2024-03-30T15:06:48.907845+0000 mon.a (mon.0) 638 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:06:49.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:49 smithi172 bash[23680]: audit 2024-03-30T15:06:48.918085+0000 mon.a (mon.0) 639 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:06:50.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:49 smithi072 bash[21573]: audit 2024-03-30T15:06:48.879930+0000 mon.a (mon.0) 631 : audit 1 from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-30T15:06:50.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:49 smithi072 bash[21573]: cluster 2024-03-30T15:06:48.885640+0000 mon.a (mon.0) 632 : cluster 0 osdmap e52: 8 total, 7 up, 8 in 2024-03-30T15:06:50.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:49 smithi072 bash[21573]: audit 2024-03-30T15:06:48.885733+0000 mon.b (mon.1) 25 : audit 1 from='osd.7 [v2:172.21.15.172:6824/1721454347,v1:172.21.15.172:6825/1721454347]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-30T15:06:50.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:49 smithi072 bash[21573]: audit 2024-03-30T15:06:48.886138+0000 mon.a (mon.0) 633 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T15:06:50.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:49 smithi072 bash[21573]: audit 2024-03-30T15:06:48.887041+0000 mon.a (mon.0) 634 : audit 1 from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-30T15:06:50.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:49 smithi072 bash[21573]: audit 2024-03-30T15:06:48.893891+0000 mon.a (mon.0) 635 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:06:50.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:49 smithi072 bash[21573]: audit 2024-03-30T15:06:48.903880+0000 mon.a (mon.0) 636 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:06:50.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:49 smithi072 bash[21573]: audit 2024-03-30T15:06:48.906201+0000 mon.a (mon.0) 637 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:06:50.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:49 smithi072 bash[21573]: audit 2024-03-30T15:06:48.907845+0000 mon.a (mon.0) 638 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:06:50.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:49 smithi072 bash[21573]: audit 2024-03-30T15:06:48.918085+0000 mon.a (mon.0) 639 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:06:50.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:49 smithi072 bash[28946]: audit 2024-03-30T15:06:48.879930+0000 mon.a (mon.0) 631 : audit 1 from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-30T15:06:50.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:49 smithi072 bash[28946]: cluster 2024-03-30T15:06:48.885640+0000 mon.a (mon.0) 632 : cluster 0 osdmap e52: 8 total, 7 up, 8 in 2024-03-30T15:06:50.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:49 smithi072 bash[28946]: audit 2024-03-30T15:06:48.885733+0000 mon.b (mon.1) 25 : audit 1 from='osd.7 [v2:172.21.15.172:6824/1721454347,v1:172.21.15.172:6825/1721454347]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-30T15:06:50.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:49 smithi072 bash[28946]: audit 2024-03-30T15:06:48.886138+0000 mon.a (mon.0) 633 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T15:06:50.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:49 smithi072 bash[28946]: audit 2024-03-30T15:06:48.887041+0000 mon.a (mon.0) 634 : audit 1 from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-30T15:06:50.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:49 smithi072 bash[28946]: audit 2024-03-30T15:06:48.893891+0000 mon.a (mon.0) 635 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:06:50.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:49 smithi072 bash[28946]: audit 2024-03-30T15:06:48.903880+0000 mon.a (mon.0) 636 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:06:50.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:49 smithi072 bash[28946]: audit 2024-03-30T15:06:48.906201+0000 mon.a (mon.0) 637 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:06:50.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:49 smithi072 bash[28946]: audit 2024-03-30T15:06:48.907845+0000 mon.a (mon.0) 638 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:06:50.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:49 smithi072 bash[28946]: audit 2024-03-30T15:06:48.918085+0000 mon.a (mon.0) 639 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:06:51.159 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:50 smithi172 bash[23680]: cluster 2024-03-30T15:06:49.746906+0000 mgr.y (mgr.14152) 319 : cluster 0 pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:51.159 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:50 smithi172 bash[23680]: audit 2024-03-30T15:06:49.882523+0000 mon.a (mon.0) 640 : audit 1 from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-03-30T15:06:51.159 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:50 smithi172 bash[23680]: cluster 2024-03-30T15:06:49.888620+0000 mon.a (mon.0) 641 : cluster 0 osdmap e53: 8 total, 7 up, 8 in 2024-03-30T15:06:51.159 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:50 smithi172 bash[23680]: audit 2024-03-30T15:06:49.890169+0000 mon.a (mon.0) 642 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T15:06:51.159 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:50 smithi172 bash[23680]: audit 2024-03-30T15:06:49.901074+0000 mon.a (mon.0) 643 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T15:06:51.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:50 smithi072 bash[21573]: cluster 2024-03-30T15:06:49.746906+0000 mgr.y (mgr.14152) 319 : cluster 0 pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:51.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:50 smithi072 bash[21573]: audit 2024-03-30T15:06:49.882523+0000 mon.a (mon.0) 640 : audit 1 from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-03-30T15:06:51.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:50 smithi072 bash[21573]: cluster 2024-03-30T15:06:49.888620+0000 mon.a (mon.0) 641 : cluster 0 osdmap e53: 8 total, 7 up, 8 in 2024-03-30T15:06:51.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:50 smithi072 bash[21573]: audit 2024-03-30T15:06:49.890169+0000 mon.a (mon.0) 642 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T15:06:51.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:50 smithi072 bash[21573]: audit 2024-03-30T15:06:49.901074+0000 mon.a (mon.0) 643 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T15:06:51.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:50 smithi072 bash[28946]: cluster 2024-03-30T15:06:49.746906+0000 mgr.y (mgr.14152) 319 : cluster 0 pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:51.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:50 smithi072 bash[28946]: audit 2024-03-30T15:06:49.882523+0000 mon.a (mon.0) 640 : audit 1 from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-03-30T15:06:51.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:50 smithi072 bash[28946]: cluster 2024-03-30T15:06:49.888620+0000 mon.a (mon.0) 641 : cluster 0 osdmap e53: 8 total, 7 up, 8 in 2024-03-30T15:06:51.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:50 smithi072 bash[28946]: audit 2024-03-30T15:06:49.890169+0000 mon.a (mon.0) 642 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T15:06:51.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:50 smithi072 bash[28946]: audit 2024-03-30T15:06:49.901074+0000 mon.a (mon.0) 643 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T15:06:52.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:51 smithi072 bash[21573]: cluster 2024-03-30T15:06:49.273637+0000 osd.7 (osd.7) 1 : cluster 0 purged_snaps scrub starts 2024-03-30T15:06:52.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:51 smithi072 bash[21573]: cluster 2024-03-30T15:06:49.273748+0000 osd.7 (osd.7) 2 : cluster 0 purged_snaps scrub ok 2024-03-30T15:06:52.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:51 smithi072 bash[21573]: audit 2024-03-30T15:06:50.903028+0000 mon.a (mon.0) 644 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T15:06:52.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:51 smithi072 bash[21573]: cluster 2024-03-30T15:06:50.914984+0000 mon.a (mon.0) 645 : cluster 1 osd.7 [v2:172.21.15.172:6824/1721454347,v1:172.21.15.172:6825/1721454347] boot 2024-03-30T15:06:52.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:51 smithi072 bash[21573]: cluster 2024-03-30T15:06:50.915096+0000 mon.a (mon.0) 646 : cluster 0 osdmap e54: 8 total, 8 up, 8 in 2024-03-30T15:06:52.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:51 smithi072 bash[21573]: audit 2024-03-30T15:06:50.915397+0000 mon.a (mon.0) 647 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T15:06:52.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:51 smithi072 bash[28946]: cluster 2024-03-30T15:06:49.273637+0000 osd.7 (osd.7) 1 : cluster 0 purged_snaps scrub starts 2024-03-30T15:06:52.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:51 smithi072 bash[28946]: cluster 2024-03-30T15:06:49.273748+0000 osd.7 (osd.7) 2 : cluster 0 purged_snaps scrub ok 2024-03-30T15:06:52.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:51 smithi072 bash[28946]: audit 2024-03-30T15:06:50.903028+0000 mon.a (mon.0) 644 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T15:06:52.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:51 smithi072 bash[28946]: cluster 2024-03-30T15:06:50.914984+0000 mon.a (mon.0) 645 : cluster 1 osd.7 [v2:172.21.15.172:6824/1721454347,v1:172.21.15.172:6825/1721454347] boot 2024-03-30T15:06:52.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:51 smithi072 bash[28946]: cluster 2024-03-30T15:06:50.915096+0000 mon.a (mon.0) 646 : cluster 0 osdmap e54: 8 total, 8 up, 8 in 2024-03-30T15:06:52.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:51 smithi072 bash[28946]: audit 2024-03-30T15:06:50.915397+0000 mon.a (mon.0) 647 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T15:06:52.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:51 smithi172 bash[23680]: cluster 2024-03-30T15:06:49.273637+0000 osd.7 (osd.7) 1 : cluster 0 purged_snaps scrub starts 2024-03-30T15:06:52.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:51 smithi172 bash[23680]: cluster 2024-03-30T15:06:49.273748+0000 osd.7 (osd.7) 2 : cluster 0 purged_snaps scrub ok 2024-03-30T15:06:52.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:51 smithi172 bash[23680]: audit 2024-03-30T15:06:50.903028+0000 mon.a (mon.0) 644 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T15:06:52.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:51 smithi172 bash[23680]: cluster 2024-03-30T15:06:50.914984+0000 mon.a (mon.0) 645 : cluster 1 osd.7 [v2:172.21.15.172:6824/1721454347,v1:172.21.15.172:6825/1721454347] boot 2024-03-30T15:06:52.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:51 smithi172 bash[23680]: cluster 2024-03-30T15:06:50.915096+0000 mon.a (mon.0) 646 : cluster 0 osdmap e54: 8 total, 8 up, 8 in 2024-03-30T15:06:52.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:51 smithi172 bash[23680]: audit 2024-03-30T15:06:50.915397+0000 mon.a (mon.0) 647 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T15:06:52.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:52.538+0000 7fc5bb7fe700 1 -- 172.21.15.172:0/845214907 <== mgr.14152 v2:172.21.15.72:6800/2777002311 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc5cc062680 con 0x7fc5b406db50 2024-03-30T15:06:52.537 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 7 on host 'smithi172' 2024-03-30T15:06:52.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:52.538+0000 7fc5d08a0700 1 -- 172.21.15.172:0/845214907 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fc5b406db50 msgr2=0x7fc5b4070010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:06:52.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:52.538+0000 7fc5d08a0700 1 --2- 172.21.15.172:0/845214907 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fc5b406db50 0x7fc5b4070010 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc109940 tx=0x7fc5bc005cf0 comp rx=0 tx=0).stop 2024-03-30T15:06:52.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:52.538+0000 7fc5d08a0700 1 -- 172.21.15.172:0/845214907 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5cc109ae0 msgr2=0x7fc5cc19e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:06:52.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:52.538+0000 7fc5d08a0700 1 --2- 172.21.15.172:0/845214907 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5cc109ae0 0x7fc5cc19e5a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0009990 tx=0x7fc5c0003970 comp rx=0 tx=0).stop 2024-03-30T15:06:52.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:52.538+0000 7fc5d08a0700 1 -- 172.21.15.172:0/845214907 shutdown_connections 2024-03-30T15:06:52.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:52.538+0000 7fc5d08a0700 1 --2- 172.21.15.172:0/845214907 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fc5b406db50 0x7fc5b4070010 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:06:52.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:52.538+0000 7fc5d08a0700 1 --2- 172.21.15.172:0/845214907 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5cc10a480 0x7fc5cc1a5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:06:52.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:52.538+0000 7fc5d08a0700 1 --2- 172.21.15.172:0/845214907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5cc1088e0 0x7fc5cc19e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:06:52.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:52.538+0000 7fc5d08a0700 1 --2- 172.21.15.172:0/845214907 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5cc109ae0 0x7fc5cc19e5a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:06:52.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:52.538+0000 7fc5d08a0700 1 -- 172.21.15.172:0/845214907 >> 172.21.15.172:0/845214907 conn(0x7fc5cc0778d0 msgr2=0x7fc5cc0793d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:06:52.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:52.538+0000 7fc5d08a0700 1 -- 172.21.15.172:0/845214907 shutdown_connections 2024-03-30T15:06:52.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:06:52.538+0000 7fc5d08a0700 1 -- 172.21.15.172:0/845214907 wait complete. 2024-03-30T15:06:53.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:52 smithi072 bash[21573]: cluster 2024-03-30T15:06:51.747478+0000 mgr.y (mgr.14152) 320 : cluster 0 pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:53.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:52 smithi072 bash[21573]: cluster 2024-03-30T15:06:51.924716+0000 mon.a (mon.0) 648 : cluster 0 osdmap e55: 8 total, 8 up, 8 in 2024-03-30T15:06:53.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:52 smithi072 bash[21573]: audit 2024-03-30T15:06:52.492357+0000 mon.a (mon.0) 649 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:06:53.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:52 smithi072 bash[21573]: audit 2024-03-30T15:06:52.504946+0000 mon.a (mon.0) 650 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:06:53.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:52 smithi072 bash[21573]: audit 2024-03-30T15:06:52.515760+0000 mon.a (mon.0) 651 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:06:53.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:52 smithi072 bash[28946]: cluster 2024-03-30T15:06:51.747478+0000 mgr.y (mgr.14152) 320 : cluster 0 pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:53.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:52 smithi072 bash[28946]: cluster 2024-03-30T15:06:51.924716+0000 mon.a (mon.0) 648 : cluster 0 osdmap e55: 8 total, 8 up, 8 in 2024-03-30T15:06:53.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:52 smithi072 bash[28946]: audit 2024-03-30T15:06:52.492357+0000 mon.a (mon.0) 649 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:06:53.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:52 smithi072 bash[28946]: audit 2024-03-30T15:06:52.504946+0000 mon.a (mon.0) 650 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:06:53.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:52 smithi072 bash[28946]: audit 2024-03-30T15:06:52.515760+0000 mon.a (mon.0) 651 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:06:53.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:52 smithi172 bash[23680]: cluster 2024-03-30T15:06:51.747478+0000 mgr.y (mgr.14152) 320 : cluster 0 pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-30T15:06:53.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:52 smithi172 bash[23680]: cluster 2024-03-30T15:06:51.924716+0000 mon.a (mon.0) 648 : cluster 0 osdmap e55: 8 total, 8 up, 8 in 2024-03-30T15:06:53.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:52 smithi172 bash[23680]: audit 2024-03-30T15:06:52.492357+0000 mon.a (mon.0) 649 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:06:53.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:52 smithi172 bash[23680]: audit 2024-03-30T15:06:52.504946+0000 mon.a (mon.0) 650 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:06:53.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:52 smithi172 bash[23680]: audit 2024-03-30T15:06:52.515760+0000 mon.a (mon.0) 651 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:06:53.239 DEBUG:teuthology.orchestra.run.smithi172:osd.7> sudo journalctl -f -n 0 -u ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@osd.7.service 2024-03-30T15:06:53.242 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2024-03-30T15:06:53.242 DEBUG:teuthology.orchestra.run.smithi072:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph osd stat -f json 2024-03-30T15:06:54.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:53 smithi172 bash[23680]: cluster 2024-03-30T15:06:52.934320+0000 mon.a (mon.0) 652 : cluster 0 osdmap e56: 8 total, 8 up, 8 in 2024-03-30T15:06:54.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:53 smithi072 bash[21573]: cluster 2024-03-30T15:06:52.934320+0000 mon.a (mon.0) 652 : cluster 0 osdmap e56: 8 total, 8 up, 8 in 2024-03-30T15:06:54.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:53 smithi072 bash[28946]: cluster 2024-03-30T15:06:52.934320+0000 mon.a (mon.0) 652 : cluster 0 osdmap e56: 8 total, 8 up, 8 in 2024-03-30T15:06:55.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:54 smithi172 bash[23680]: cluster 2024-03-30T15:06:53.748070+0000 mgr.y (mgr.14152) 321 : cluster 0 pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:06:55.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:54 smithi172 bash[23680]: cluster 2024-03-30T15:06:53.944090+0000 mon.a (mon.0) 653 : cluster 0 osdmap e57: 8 total, 8 up, 8 in 2024-03-30T15:06:55.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:54 smithi072 bash[21573]: cluster 2024-03-30T15:06:53.748070+0000 mgr.y (mgr.14152) 321 : cluster 0 pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:06:55.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:54 smithi072 bash[21573]: cluster 2024-03-30T15:06:53.944090+0000 mon.a (mon.0) 653 : cluster 0 osdmap e57: 8 total, 8 up, 8 in 2024-03-30T15:06:55.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:54 smithi072 bash[28946]: cluster 2024-03-30T15:06:53.748070+0000 mgr.y (mgr.14152) 321 : cluster 0 pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:06:55.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:54 smithi072 bash[28946]: cluster 2024-03-30T15:06:53.944090+0000 mon.a (mon.0) 653 : cluster 0 osdmap e57: 8 total, 8 up, 8 in 2024-03-30T15:06:56.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:55 smithi172 bash[23680]: cluster 2024-03-30T15:06:54.945613+0000 mon.a (mon.0) 654 : cluster 0 osdmap e58: 8 total, 8 up, 8 in 2024-03-30T15:06:56.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:55 smithi072 bash[21573]: cluster 2024-03-30T15:06:54.945613+0000 mon.a (mon.0) 654 : cluster 0 osdmap e58: 8 total, 8 up, 8 in 2024-03-30T15:06:56.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:55 smithi072 bash[28946]: cluster 2024-03-30T15:06:54.945613+0000 mon.a (mon.0) 654 : cluster 0 osdmap e58: 8 total, 8 up, 8 in 2024-03-30T15:06:57.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:56 smithi172 bash[23680]: cluster 2024-03-30T15:06:55.748652+0000 mgr.y (mgr.14152) 322 : cluster 0 pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:06:57.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:56 smithi072 bash[21573]: cluster 2024-03-30T15:06:55.748652+0000 mgr.y (mgr.14152) 322 : cluster 0 pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:06:57.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:56 smithi072 bash[28946]: cluster 2024-03-30T15:06:55.748652+0000 mgr.y (mgr.14152) 322 : cluster 0 pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:06:58.001 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T15:06:59.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:06:58 smithi072 bash[21573]: cluster 2024-03-30T15:06:57.749289+0000 mgr.y (mgr.14152) 323 : cluster 0 pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-03-30T15:06:59.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:06:58 smithi072 bash[28946]: cluster 2024-03-30T15:06:57.749289+0000 mgr.y (mgr.14152) 323 : cluster 0 pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-03-30T15:06:59.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:06:58 smithi172 bash[23680]: cluster 2024-03-30T15:06:57.749289+0000 mgr.y (mgr.14152) 323 : cluster 0 pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-03-30T15:07:00.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.685+0000 7f532190d700 1 -- 172.21.15.72:0/4028286546 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f531c10e8b0 msgr2=0x7f531c110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:07:00.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.685+0000 7f532190d700 1 --2- 172.21.15.72:0/4028286546 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f531c10e8b0 0x7f531c110ca0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f531400b0a0 tx=0x7f531400b3b0 comp rx=0 tx=0).stop 2024-03-30T15:07:00.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.685+0000 7f532190d700 1 -- 172.21.15.72:0/4028286546 shutdown_connections 2024-03-30T15:07:00.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.685+0000 7f532190d700 1 --2- 172.21.15.72:0/4028286546 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f531c10e8b0 0x7f531c110ca0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:00.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.685+0000 7f532190d700 1 --2- 172.21.15.72:0/4028286546 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f531c076270 0x7f531c0746d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:00.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.685+0000 7f532190d700 1 --2- 172.21.15.72:0/4028286546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f531c074ca0 0x7f531c075120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:00.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.685+0000 7f532190d700 1 -- 172.21.15.72:0/4028286546 >> 172.21.15.72:0/4028286546 conn(0x7f531c0fd870 msgr2=0x7f531c0ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:07:00.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.685+0000 7f532190d700 1 -- 172.21.15.72:0/4028286546 shutdown_connections 2024-03-30T15:07:00.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.685+0000 7f532190d700 1 -- 172.21.15.72:0/4028286546 wait complete. 2024-03-30T15:07:00.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.685+0000 7f532190d700 1 Processor -- start 2024-03-30T15:07:00.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.685+0000 7f532190d700 1 -- start start 2024-03-30T15:07:00.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.685+0000 7f532190d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f531c074ca0 0x7f531c19e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:07:00.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.685+0000 7f532190d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f531c076270 0x7f531c19e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:07:00.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.685+0000 7f532190d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f531c10e8b0 0x7f531c1a5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:07:00.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.685+0000 7f532190d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f531c1139e0 con 0x7f531c10e8b0 2024-03-30T15:07:00.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.685+0000 7f532190d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f531c113860 con 0x7f531c076270 2024-03-30T15:07:00.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.685+0000 7f532190d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f531c113b60 con 0x7f531c074ca0 2024-03-30T15:07:00.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.685+0000 7f531affd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f531c074ca0 0x7f531c19e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:07:00.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.685+0000 7f531affd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f531c074ca0 0x7f531c19e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:53530/0 (socket says 172.21.15.72:53530) 2024-03-30T15:07:00.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.685+0000 7f531affd700 1 -- 172.21.15.72:0/991764326 learned_addr learned my addr 172.21.15.72:0/991764326 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T15:07:00.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.685+0000 7f531b7fe700 1 --2- 172.21.15.72:0/991764326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f531c10e8b0 0x7f531c1a5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:07:00.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.685+0000 7f531a7fc700 1 --2- 172.21.15.72:0/991764326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f531c076270 0x7f531c19e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:07:00.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.685+0000 7f531b7fe700 1 -- 172.21.15.72:0/991764326 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f531c074ca0 msgr2=0x7f531c19e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:07:00.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.685+0000 7f531b7fe700 1 --2- 172.21.15.72:0/991764326 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f531c074ca0 0x7f531c19e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:00.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.685+0000 7f531b7fe700 1 -- 172.21.15.72:0/991764326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f531c076270 msgr2=0x7f531c19e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:07:00.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.685+0000 7f531b7fe700 1 --2- 172.21.15.72:0/991764326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f531c076270 0x7f531c19e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:00.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.685+0000 7f531b7fe700 1 -- 172.21.15.72:0/991764326 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f531c1a5cc0 con 0x7f531c10e8b0 2024-03-30T15:07:00.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.685+0000 7f531affd700 1 --2- 172.21.15.72:0/991764326 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f531c074ca0 0x7f531c19e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T15:07:00.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.685+0000 7f531b7fe700 1 --2- 172.21.15.72:0/991764326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f531c10e8b0 0x7f531c1a5620 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f531400b0a0 tx=0x7f5314004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:07:00.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.685+0000 7f532090b700 1 -- 172.21.15.72:0/991764326 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5314021070 con 0x7f531c10e8b0 2024-03-30T15:07:00.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.689+0000 7f532090b700 1 -- 172.21.15.72:0/991764326 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f5314007b80 con 0x7f531c10e8b0 2024-03-30T15:07:00.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.689+0000 7f532190d700 1 -- 172.21.15.72:0/991764326 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f531c1a5f50 con 0x7f531c10e8b0 2024-03-30T15:07:00.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.689+0000 7f532090b700 1 -- 172.21.15.72:0/991764326 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f531401b690 con 0x7f531c10e8b0 2024-03-30T15:07:00.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.689+0000 7f532190d700 1 -- 172.21.15.72:0/991764326 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f531c1a63c0 con 0x7f531c10e8b0 2024-03-30T15:07:00.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.689+0000 7f532190d700 1 -- 172.21.15.72:0/991764326 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f531c04ff00 con 0x7f531c10e8b0 2024-03-30T15:07:00.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.689+0000 7f532090b700 1 -- 172.21.15.72:0/991764326 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 15) ==== 91774+0+0 (secure 0 0 0) 0x7f5314024070 con 0x7f531c10e8b0 2024-03-30T15:07:00.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.689+0000 7f532090b700 1 --2- 172.21.15.72:0/991764326 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f530406db50 0x7f5304070010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:07:00.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.689+0000 7f532090b700 1 -- 172.21.15.72:0/991764326 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5287+0+0 (secure 0 0 0) 0x7f531400f020 con 0x7f531c10e8b0 2024-03-30T15:07:00.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.689+0000 7f531affd700 1 --2- 172.21.15.72:0/991764326 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f530406db50 0x7f5304070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:07:00.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.689+0000 7f531affd700 1 --2- 172.21.15.72:0/991764326 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f530406db50 0x7f5304070010 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5310011550 tx=0x7f5310009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:07:00.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.693+0000 7f532090b700 1 -- 172.21.15.72:0/991764326 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f531402b020 con 0x7f531c10e8b0 2024-03-30T15:07:00.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.893+0000 7f532190d700 1 -- 172.21.15.72:0/991764326 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f531c02db30 con 0x7f531c10e8b0 2024-03-30T15:07:00.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.897+0000 7f532090b700 1 -- 172.21.15.72:0/991764326 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v58) ==== 74+0+130 (secure 0 0 0) 0x7f531405c6c0 con 0x7f531c10e8b0 2024-03-30T15:07:00.898 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-30T15:07:00.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.897+0000 7f532190d700 1 -- 172.21.15.72:0/991764326 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f530406db50 msgr2=0x7f5304070010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:07:00.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.897+0000 7f532190d700 1 --2- 172.21.15.72:0/991764326 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f530406db50 0x7f5304070010 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5310011550 tx=0x7f5310009260 comp rx=0 tx=0).stop 2024-03-30T15:07:00.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.897+0000 7f532190d700 1 -- 172.21.15.72:0/991764326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f531c10e8b0 msgr2=0x7f531c1a5620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:07:00.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.897+0000 7f532190d700 1 --2- 172.21.15.72:0/991764326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f531c10e8b0 0x7f531c1a5620 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f531400b0a0 tx=0x7f5314004d00 comp rx=0 tx=0).stop 2024-03-30T15:07:00.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.897+0000 7f532190d700 1 -- 172.21.15.72:0/991764326 shutdown_connections 2024-03-30T15:07:00.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.897+0000 7f532190d700 1 --2- 172.21.15.72:0/991764326 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f530406db50 0x7f5304070010 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:00.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.897+0000 7f532190d700 1 --2- 172.21.15.72:0/991764326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f531c10e8b0 0x7f531c1a5620 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:00.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.897+0000 7f532190d700 1 --2- 172.21.15.72:0/991764326 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f531c074ca0 0x7f531c19e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:00.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.897+0000 7f532190d700 1 --2- 172.21.15.72:0/991764326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f531c076270 0x7f531c19e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:00.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.897+0000 7f532190d700 1 -- 172.21.15.72:0/991764326 >> 172.21.15.72:0/991764326 conn(0x7f531c0fd870 msgr2=0x7f531c0ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:07:00.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.897+0000 7f532190d700 1 -- 172.21.15.72:0/991764326 shutdown_connections 2024-03-30T15:07:00.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:00.897+0000 7f532190d700 1 -- 172.21.15.72:0/991764326 wait complete. 2024-03-30T15:07:01.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:00 smithi072 bash[21573]: cluster 2024-03-30T15:06:59.749728+0000 mgr.y (mgr.14152) 324 : cluster 0 pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-03-30T15:07:01.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:00 smithi072 bash[21573]: audit 2024-03-30T15:07:00.901133+0000 mon.a (mon.0) 655 : audit 0 from='client.? 172.21.15.72:0/991764326' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-30T15:07:01.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:00 smithi072 bash[28946]: cluster 2024-03-30T15:06:59.749728+0000 mgr.y (mgr.14152) 324 : cluster 0 pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-03-30T15:07:01.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:00 smithi072 bash[28946]: audit 2024-03-30T15:07:00.901133+0000 mon.a (mon.0) 655 : audit 0 from='client.? 172.21.15.72:0/991764326' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-30T15:07:01.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:00 smithi172 bash[23680]: cluster 2024-03-30T15:06:59.749728+0000 mgr.y (mgr.14152) 324 : cluster 0 pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-03-30T15:07:01.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:00 smithi172 bash[23680]: audit 2024-03-30T15:07:00.901133+0000 mon.a (mon.0) 655 : audit 0 from='client.? 172.21.15.72:0/991764326' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-30T15:07:01.650 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":58,"num_osds":8,"num_up_osds":8,"osd_up_since":1711811210,"num_in_osds":8,"osd_in_since":1711811184,"num_remapped_pgs":0} 2024-03-30T15:07:01.651 DEBUG:teuthology.orchestra.run.smithi072:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph osd dump --format=json 2024-03-30T15:07:03.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:02 smithi072 bash[21573]: cluster 2024-03-30T15:07:01.750256+0000 mgr.y (mgr.14152) 325 : cluster 0 pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-30T15:07:03.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:02 smithi072 bash[21573]: cephadm 2024-03-30T15:07:01.964439+0000 mgr.y (mgr.14152) 326 : cephadm 1 Detected new or changed devices on smithi172 2024-03-30T15:07:03.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:02 smithi072 bash[21573]: audit 2024-03-30T15:07:01.980005+0000 mon.a (mon.0) 656 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:03.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:02 smithi072 bash[21573]: audit 2024-03-30T15:07:01.991951+0000 mon.a (mon.0) 657 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:03.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:02 smithi072 bash[21573]: audit 2024-03-30T15:07:01.994700+0000 mon.a (mon.0) 658 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:07:03.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:02 smithi072 bash[21573]: audit 2024-03-30T15:07:01.996577+0000 mon.a (mon.0) 659 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:07:03.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:02 smithi072 bash[21573]: audit 2024-03-30T15:07:01.998335+0000 mon.a (mon.0) 660 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:07:03.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:02 smithi072 bash[21573]: audit 2024-03-30T15:07:02.000025+0000 mon.a (mon.0) 661 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:07:03.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:02 smithi072 bash[21573]: cephadm 2024-03-30T15:07:02.001399+0000 mgr.y (mgr.14152) 327 : cephadm 1 Adjusting osd_memory_target on smithi172 to 4316M 2024-03-30T15:07:03.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:02 smithi072 bash[21573]: audit 2024-03-30T15:07:02.007913+0000 mon.a (mon.0) 662 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:03.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:02 smithi072 bash[21573]: audit 2024-03-30T15:07:02.024423+0000 mon.a (mon.0) 663 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:07:03.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:02 smithi072 bash[21573]: audit 2024-03-30T15:07:02.026561+0000 mon.a (mon.0) 664 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:07:03.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:02 smithi072 bash[21573]: audit 2024-03-30T15:07:02.036678+0000 mon.a (mon.0) 665 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:03.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:02 smithi072 bash[28946]: cluster 2024-03-30T15:07:01.750256+0000 mgr.y (mgr.14152) 325 : cluster 0 pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-30T15:07:03.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:02 smithi072 bash[28946]: cephadm 2024-03-30T15:07:01.964439+0000 mgr.y (mgr.14152) 326 : cephadm 1 Detected new or changed devices on smithi172 2024-03-30T15:07:03.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:02 smithi072 bash[28946]: audit 2024-03-30T15:07:01.980005+0000 mon.a (mon.0) 656 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:03.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:02 smithi072 bash[28946]: audit 2024-03-30T15:07:01.991951+0000 mon.a (mon.0) 657 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:03.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:02 smithi072 bash[28946]: audit 2024-03-30T15:07:01.994700+0000 mon.a (mon.0) 658 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:07:03.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:02 smithi072 bash[28946]: audit 2024-03-30T15:07:01.996577+0000 mon.a (mon.0) 659 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:07:03.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:02 smithi072 bash[28946]: audit 2024-03-30T15:07:01.998335+0000 mon.a (mon.0) 660 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:07:03.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:02 smithi072 bash[28946]: audit 2024-03-30T15:07:02.000025+0000 mon.a (mon.0) 661 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:07:03.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:02 smithi072 bash[28946]: cephadm 2024-03-30T15:07:02.001399+0000 mgr.y (mgr.14152) 327 : cephadm 1 Adjusting osd_memory_target on smithi172 to 4316M 2024-03-30T15:07:03.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:02 smithi072 bash[28946]: audit 2024-03-30T15:07:02.007913+0000 mon.a (mon.0) 662 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:03.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:02 smithi072 bash[28946]: audit 2024-03-30T15:07:02.024423+0000 mon.a (mon.0) 663 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:07:03.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:02 smithi072 bash[28946]: audit 2024-03-30T15:07:02.026561+0000 mon.a (mon.0) 664 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:07:03.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:02 smithi072 bash[28946]: audit 2024-03-30T15:07:02.036678+0000 mon.a (mon.0) 665 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:03.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:02 smithi172 bash[23680]: cluster 2024-03-30T15:07:01.750256+0000 mgr.y (mgr.14152) 325 : cluster 0 pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-30T15:07:03.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:02 smithi172 bash[23680]: cephadm 2024-03-30T15:07:01.964439+0000 mgr.y (mgr.14152) 326 : cephadm 1 Detected new or changed devices on smithi172 2024-03-30T15:07:03.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:02 smithi172 bash[23680]: audit 2024-03-30T15:07:01.980005+0000 mon.a (mon.0) 656 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:03.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:02 smithi172 bash[23680]: audit 2024-03-30T15:07:01.991951+0000 mon.a (mon.0) 657 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:03.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:02 smithi172 bash[23680]: audit 2024-03-30T15:07:01.994700+0000 mon.a (mon.0) 658 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:07:03.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:02 smithi172 bash[23680]: audit 2024-03-30T15:07:01.996577+0000 mon.a (mon.0) 659 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:07:03.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:02 smithi172 bash[23680]: audit 2024-03-30T15:07:01.998335+0000 mon.a (mon.0) 660 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:07:03.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:02 smithi172 bash[23680]: audit 2024-03-30T15:07:02.000025+0000 mon.a (mon.0) 661 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:07:03.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:02 smithi172 bash[23680]: cephadm 2024-03-30T15:07:02.001399+0000 mgr.y (mgr.14152) 327 : cephadm 1 Adjusting osd_memory_target on smithi172 to 4316M 2024-03-30T15:07:03.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:02 smithi172 bash[23680]: audit 2024-03-30T15:07:02.007913+0000 mon.a (mon.0) 662 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:03.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:02 smithi172 bash[23680]: audit 2024-03-30T15:07:02.024423+0000 mon.a (mon.0) 663 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:07:03.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:02 smithi172 bash[23680]: audit 2024-03-30T15:07:02.026561+0000 mon.a (mon.0) 664 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:07:03.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:02 smithi172 bash[23680]: audit 2024-03-30T15:07:02.036678+0000 mon.a (mon.0) 665 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:05.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:04 smithi072 bash[21573]: cluster 2024-03-30T15:07:03.751096+0000 mgr.y (mgr.14152) 328 : cluster 0 pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-03-30T15:07:05.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:04 smithi072 bash[28946]: cluster 2024-03-30T15:07:03.751096+0000 mgr.y (mgr.14152) 328 : cluster 0 pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-03-30T15:07:05.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:04 smithi172 bash[23680]: cluster 2024-03-30T15:07:03.751096+0000 mgr.y (mgr.14152) 328 : cluster 0 pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-03-30T15:07:06.405 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T15:07:07.283 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:06 smithi072 bash[21573]: cluster 2024-03-30T15:07:05.751715+0000 mgr.y (mgr.14152) 329 : cluster 0 pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-03-30T15:07:07.283 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:06 smithi072 bash[28946]: cluster 2024-03-30T15:07:05.751715+0000 mgr.y (mgr.14152) 329 : cluster 0 pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-03-30T15:07:07.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:06 smithi172 bash[23680]: cluster 2024-03-30T15:07:05.751715+0000 mgr.y (mgr.14152) 329 : cluster 0 pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-03-30T15:07:08.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:08.988+0000 7f21d7c9f700 1 -- 172.21.15.72:0/4189498442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21d0104e10 msgr2=0x7f21d0111320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:07:08.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:08.988+0000 7f21d7c9f700 1 --2- 172.21.15.72:0/4189498442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21d0104e10 0x7f21d0111320 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f21c800b0a0 tx=0x7f21c800b3b0 comp rx=0 tx=0).stop 2024-03-30T15:07:08.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:08.988+0000 7f21d7c9f700 1 -- 172.21.15.72:0/4189498442 shutdown_connections 2024-03-30T15:07:08.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:08.988+0000 7f21d7c9f700 1 --2- 172.21.15.72:0/4189498442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21d0104e10 0x7f21d0111320 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:08.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:08.988+0000 7f21d7c9f700 1 --2- 172.21.15.72:0/4189498442 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21d010a4e0 0x7f21d010a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:08.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:08.988+0000 7f21d7c9f700 1 --2- 172.21.15.72:0/4189498442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21d0104450 0x7f21d01048d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:08.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:08.988+0000 7f21d7c9f700 1 -- 172.21.15.72:0/4189498442 >> 172.21.15.72:0/4189498442 conn(0x7f21d00fff20 msgr2=0x7f21d0102340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:07:08.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:08.988+0000 7f21d7c9f700 1 -- 172.21.15.72:0/4189498442 shutdown_connections 2024-03-30T15:07:08.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:08.988+0000 7f21d7c9f700 1 -- 172.21.15.72:0/4189498442 wait complete. 2024-03-30T15:07:08.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:08.988+0000 7f21d7c9f700 1 Processor -- start 2024-03-30T15:07:08.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:08.988+0000 7f21d7c9f700 1 -- start start 2024-03-30T15:07:08.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:08.988+0000 7f21d7c9f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21d0104450 0x7f21d019a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:07:08.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:08.988+0000 7f21d7c9f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21d0104e10 0x7f21d019a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:07:08.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:08.988+0000 7f21d7c9f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21d010a4e0 0x7f21d019e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:07:08.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:08.988+0000 7f21d7c9f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f21d0113c50 con 0x7f21d0104e10 2024-03-30T15:07:08.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:08.988+0000 7f21d7c9f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f21d0113ad0 con 0x7f21d010a4e0 2024-03-30T15:07:08.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:08.988+0000 7f21d7c9f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f21d0113dd0 con 0x7f21d0104450 2024-03-30T15:07:08.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:08.988+0000 7f21d523a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21d0104e10 0x7f21d019a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:07:08.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:08.988+0000 7f21d5a3b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21d0104450 0x7f21d019a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:07:08.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:08.988+0000 7f21d523a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21d0104e10 0x7f21d019a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34536/0 (socket says 172.21.15.72:34536) 2024-03-30T15:07:08.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:08.988+0000 7f21d523a700 1 -- 172.21.15.72:0/124891538 learned_addr learned my addr 172.21.15.72:0/124891538 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T15:07:08.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:08.988+0000 7f21d623c700 1 --2- 172.21.15.72:0/124891538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21d010a4e0 0x7f21d019e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:07:08.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:08.988+0000 7f21d5a3b700 1 -- 172.21.15.72:0/124891538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21d010a4e0 msgr2=0x7f21d019e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:07:08.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:08.988+0000 7f21d5a3b700 1 --2- 172.21.15.72:0/124891538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21d010a4e0 0x7f21d019e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:08.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:08.988+0000 7f21d5a3b700 1 -- 172.21.15.72:0/124891538 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21d0104e10 msgr2=0x7f21d019a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:07:08.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:08.988+0000 7f21d5a3b700 1 --2- 172.21.15.72:0/124891538 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21d0104e10 0x7f21d019a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:08.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:08.988+0000 7f21d5a3b700 1 -- 172.21.15.72:0/124891538 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21d019f110 con 0x7f21d0104450 2024-03-30T15:07:08.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:08.988+0000 7f21d5a3b700 1 --2- 172.21.15.72:0/124891538 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21d0104450 0x7f21d019a150 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f21c000b450 tx=0x7f21c000b760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:07:08.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:08.992+0000 7f21c6ffd700 1 -- 172.21.15.72:0/124891538 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c0015020 con 0x7f21d0104450 2024-03-30T15:07:08.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:08.992+0000 7f21c6ffd700 1 -- 172.21.15.72:0/124891538 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f21c0011cb0 con 0x7f21d0104450 2024-03-30T15:07:08.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:08.992+0000 7f21c6ffd700 1 -- 172.21.15.72:0/124891538 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c0010bc0 con 0x7f21d0104450 2024-03-30T15:07:08.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:08.992+0000 7f21d7c9f700 1 -- 172.21.15.72:0/124891538 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21d019f400 con 0x7f21d0104450 2024-03-30T15:07:08.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:08.996+0000 7f21d7c9f700 1 -- 172.21.15.72:0/124891538 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f21d01a6c80 con 0x7f21d0104450 2024-03-30T15:07:08.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:08.996+0000 7f21d7c9f700 1 -- 172.21.15.72:0/124891538 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21d004ff00 con 0x7f21d0104450 2024-03-30T15:07:08.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:08.996+0000 7f21c6ffd700 1 -- 172.21.15.72:0/124891538 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 15) ==== 91774+0+0 (secure 0 0 0) 0x7f21c0018020 con 0x7f21d0104450 2024-03-30T15:07:08.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:08.996+0000 7f21c6ffd700 1 --2- 172.21.15.72:0/124891538 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f21bc06db50 0x7f21bc070010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:07:08.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:08.996+0000 7f21c6ffd700 1 -- 172.21.15.72:0/124891538 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(58..58 src has 1..58) ==== 5287+0+0 (secure 0 0 0) 0x7f21c008cc80 con 0x7f21d0104450 2024-03-30T15:07:08.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:08.996+0000 7f21d523a700 1 --2- 172.21.15.72:0/124891538 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f21bc06db50 0x7f21bc070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:07:08.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:08.996+0000 7f21d523a700 1 --2- 172.21.15.72:0/124891538 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f21bc06db50 0x7f21bc070010 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f21d0114710 tx=0x7f21cc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:07:09.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:09.000+0000 7f21c6ffd700 1 -- 172.21.15.72:0/124891538 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f21c001f020 con 0x7f21d0104450 2024-03-30T15:07:09.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:08 smithi072 bash[21573]: cluster 2024-03-30T15:07:07.752335+0000 mgr.y (mgr.14152) 330 : cluster 0 pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-03-30T15:07:09.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:08 smithi072 bash[28946]: cluster 2024-03-30T15:07:07.752335+0000 mgr.y (mgr.14152) 330 : cluster 0 pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-03-30T15:07:09.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:09.204+0000 7f21d7c9f700 1 -- 172.21.15.72:0/124891538 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f21d01a6f10 con 0x7f21d0104450 2024-03-30T15:07:09.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:09.208+0000 7f21c6ffd700 1 -- 172.21.15.72:0/124891538 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) ==== 74+0+13566 (secure 0 0 0) 0x7f21c005abb0 con 0x7f21d0104450 2024-03-30T15:07:09.207 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-30T15:07:09.208 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":58,"fsid":"97f8e564-eea5-11ee-b647-cb9ed24678a4","created":"2024-03-30T14:57:05.374220+0000","modified":"2024-03-30T15:06:54.936079+0000","last_up_change":"2024-03-30T15:06:50.892177+0000","last_in_change":"2024-03-30T15:06:24.422973+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T15:02:34.262564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e65f2e8f-f022-4766-9e3f-58124e5372ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1463362008},{"type":"v1","addr":"172.21.15.72:6803","nonce":1463362008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1463362008},{"type":"v1","addr":"172.21.15.72:6805","nonce":1463362008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1463362008},{"type":"v1","addr":"172.21.15.72:6809","nonce":1463362008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1463362008},{"type":"v1","addr":"172.21.15.72:6807","nonce":1463362008}]},"public_addr":"172.21.15.72:6803/1463362008","cluster_addr":"172.21.15.72:6805/1463362008","heartbeat_back_addr":"172.21.15.72:6809/1463362008","heartbeat_front_addr":"172.21.15.72:6807/1463362008","state":["exists","up"]},{"osd":1,"uuid":"276c5ca1-6c16-44aa-aaa2-c0859408d86c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2191896250},{"type":"v1","addr":"172.21.15.72:6811","nonce":2191896250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2191896250},{"type":"v1","addr":"172.21.15.72:6813","nonce":2191896250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2191896250},{"type":"v1","addr":"172.21.15.72:6817","nonce":2191896250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2191896250},{"type":"v1","addr":"172.21.15.72:6815","nonce":2191896250}]},"public_addr":"172.21.15.72:6811/2191896250","cluster_addr":"172.21.15.72:6813/2191896250","heartbeat_back_addr":"172.21.15.72:6817/2191896250","heartbeat_front_addr":"172.21.15.72:6815/2191896250","state":["exists","up"]},{"osd":2,"uuid":"5cba948f-92d8-402b-88d5-969c137f3c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2674031198},{"type":"v1","addr":"172.21.15.72:6819","nonce":2674031198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":2674031198},{"type":"v1","addr":"172.21.15.72:6821","nonce":2674031198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2674031198},{"type":"v1","addr":"172.21.15.72:6825","nonce":2674031198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2674031198},{"type":"v1","addr":"172.21.15.72:6823","nonce":2674031198}]},"public_addr":"172.21.15.72:6819/2674031198","cluster_addr":"172.21.15.72:6821/2674031198","heartbeat_back_addr":"172.21.15.72:6825/2674031198","heartbeat_front_addr":"172.21.15.72:6823/2674031198","state":["exists","up"]},{"osd":3,"uuid":"72230afa-c7a7-4d66-8734-07deda2d3694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":350059956},{"type":"v1","addr":"172.21.15.72:6827","nonce":350059956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":350059956},{"type":"v1","addr":"172.21.15.72:6829","nonce":350059956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":350059956},{"type":"v1","addr":"172.21.15.72:6833","nonce":350059956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":350059956},{"type":"v1","addr":"172.21.15.72:6831","nonce":350059956}]},"public_addr":"172.21.15.72:6827/350059956","cluster_addr":"172.21.15.72:6829/350059956","heartbeat_back_addr":"172.21.15.72:6833/350059956","heartbeat_front_addr":"172.21.15.72:6831/350059956","state":["exists","up"]},{"osd":4,"uuid":"c7676e52-a936-4419-8e88-511820cd1355","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3807833251},{"type":"v1","addr":"172.21.15.172:6801","nonce":3807833251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3807833251},{"type":"v1","addr":"172.21.15.172:6803","nonce":3807833251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3807833251},{"type":"v1","addr":"172.21.15.172:6807","nonce":3807833251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3807833251},{"type":"v1","addr":"172.21.15.172:6805","nonce":3807833251}]},"public_addr":"172.21.15.172:6801/3807833251","cluster_addr":"172.21.15.172:6803/3807833251","heartbeat_back_addr":"172.21.15.172:6807/3807833251","heartbeat_front_addr":"172.21.15.172:6805/3807833251","state":["exists","up"]},{"osd":5,"uuid":"92d207bb-ccd0-4b33-b4c0-b733b8b67e6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":1078861326},{"type":"v1","addr":"172.21.15.172:6809","nonce":1078861326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":1078861326},{"type":"v1","addr":"172.21.15.172:6811","nonce":1078861326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":1078861326},{"type":"v1","addr":"172.21.15.172:6815","nonce":1078861326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":1078861326},{"type":"v1","addr":"172.21.15.172:6813","nonce":1078861326}]},"public_addr":"172.21.15.172:6809/1078861326","cluster_addr":"172.21.15.172:6811/1078861326","heartbeat_back_addr":"172.21.15.172:6815/1078861326","heartbeat_front_addr":"172.21.15.172:6813/1078861326","state":["exists","up"]},{"osd":6,"uuid":"791e09bc-ffeb-45ec-a375-8d4c4f51f4dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":1461064998},{"type":"v1","addr":"172.21.15.172:6817","nonce":1461064998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":1461064998},{"type":"v1","addr":"172.21.15.172:6819","nonce":1461064998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":1461064998},{"type":"v1","addr":"172.21.15.172:6823","nonce":1461064998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":1461064998},{"type":"v1","addr":"172.21.15.172:6821","nonce":1461064998}]},"public_addr":"172.21.15.172:6817/1461064998","cluster_addr":"172.21.15.172:6819/1461064998","heartbeat_back_addr":"172.21.15.172:6823/1461064998","heartbeat_front_addr":"172.21.15.172:6821/1461064998","state":["exists","up"]},{"osd":7,"uuid":"cbb6a8aa-f398-4980-8e11-f3c2113c93b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1721454347},{"type":"v1","addr":"172.21.15.172:6825","nonce":1721454347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1721454347},{"type":"v1","addr":"172.21.15.172:6827","nonce":1721454347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1721454347},{"type":"v1","addr":"172.21.15.172:6831","nonce":1721454347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1721454347},{"type":"v1","addr":"172.21.15.172:6829","nonce":1721454347}]},"public_addr":"172.21.15.172:6825/1721454347","cluster_addr":"172.21.15.172:6827/1721454347","heartbeat_back_addr":"172.21.15.172:6831/1721454347","heartbeat_front_addr":"172.21.15.172:6829/1721454347","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T15:00:42.799274+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T15:01:35.027238+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T15:02:30.253201+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T15:03:21.961056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T15:04:11.268147+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T15:05:02.630111+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T15:05:55.417298+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T15:06:49.273753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:0/732359376":"2024-03-31T14:58:13.611492+0000","172.21.15.72:0/1482225058":"2024-03-31T14:58:13.611492+0000","172.21.15.72:6800/3069476432":"2024-03-31T14:58:13.611492+0000","172.21.15.72:6801/3069476432":"2024-03-31T14:58:13.611492+0000","172.21.15.72:0/1532980358":"2024-03-31T14:57:38.582840+0000","172.21.15.72:6801/1939732211":"2024-03-31T14:57:38.582840+0000","172.21.15.72:0/2843947581":"2024-03-31T14:58:13.611492+0000","172.21.15.72:0/646806071":"2024-03-31T14:57:38.582840+0000","172.21.15.72:0/3660329875":"2024-03-31T14:57:38.582840+0000","172.21.15.72:6800/1939732211":"2024-03-31T14:57:38.582840+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T15:07:09.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:09.212+0000 7f21d7c9f700 1 -- 172.21.15.72:0/124891538 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f21bc06db50 msgr2=0x7f21bc070010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:07:09.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:09.212+0000 7f21d7c9f700 1 --2- 172.21.15.72:0/124891538 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f21bc06db50 0x7f21bc070010 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f21d0114710 tx=0x7f21cc009260 comp rx=0 tx=0).stop 2024-03-30T15:07:09.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:09.212+0000 7f21d7c9f700 1 -- 172.21.15.72:0/124891538 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21d0104450 msgr2=0x7f21d019a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:07:09.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:09.212+0000 7f21d7c9f700 1 --2- 172.21.15.72:0/124891538 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21d0104450 0x7f21d019a150 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f21c000b450 tx=0x7f21c000b760 comp rx=0 tx=0).stop 2024-03-30T15:07:09.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:09.212+0000 7f21d7c9f700 1 -- 172.21.15.72:0/124891538 shutdown_connections 2024-03-30T15:07:09.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:09.212+0000 7f21d7c9f700 1 --2- 172.21.15.72:0/124891538 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f21bc06db50 0x7f21bc070010 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:09.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:09.212+0000 7f21d7c9f700 1 --2- 172.21.15.72:0/124891538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21d010a4e0 0x7f21d019e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:09.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:09.212+0000 7f21d7c9f700 1 --2- 172.21.15.72:0/124891538 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21d0104450 0x7f21d019a150 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:09.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:09.212+0000 7f21d7c9f700 1 --2- 172.21.15.72:0/124891538 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21d0104e10 0x7f21d019a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:09.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:09.212+0000 7f21d7c9f700 1 -- 172.21.15.72:0/124891538 >> 172.21.15.72:0/124891538 conn(0x7f21d00fff20 msgr2=0x7f21d0100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:07:09.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:09.212+0000 7f21d7c9f700 1 -- 172.21.15.72:0/124891538 shutdown_connections 2024-03-30T15:07:09.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:09.212+0000 7f21d7c9f700 1 -- 172.21.15.72:0/124891538 wait complete. 2024-03-30T15:07:09.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:08 smithi172 bash[23680]: cluster 2024-03-30T15:07:07.752335+0000 mgr.y (mgr.14152) 330 : cluster 0 pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-03-30T15:07:09.889 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T15:02:34.262564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 7.889999866485596, 'score_stable': 7.889999866485596, 'optimal_score': 0.3799999952316284, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T15:07:09.889 DEBUG:teuthology.orchestra.run.smithi072:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph osd pool get .mgr pg_num 2024-03-30T15:07:10.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:10 smithi072 bash[21573]: audit 2024-03-30T15:07:09.208827+0000 mon.c (mon.2) 15 : audit 0 from='client.? 172.21.15.72:0/124891538' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T15:07:10.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:10 smithi072 bash[28946]: audit 2024-03-30T15:07:09.208827+0000 mon.c (mon.2) 15 : audit 0 from='client.? 172.21.15.72:0/124891538' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T15:07:10.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:10 smithi172 bash[23680]: audit 2024-03-30T15:07:09.208827+0000 mon.c (mon.2) 15 : audit 0 from='client.? 172.21.15.72:0/124891538' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T15:07:11.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:11 smithi072 bash[21573]: cluster 2024-03-30T15:07:09.752847+0000 mgr.y (mgr.14152) 331 : cluster 0 pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:07:11.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:11 smithi072 bash[28946]: cluster 2024-03-30T15:07:09.752847+0000 mgr.y (mgr.14152) 331 : cluster 0 pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:07:11.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:11 smithi172 bash[23680]: cluster 2024-03-30T15:07:09.752847+0000 mgr.y (mgr.14152) 331 : cluster 0 pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:07:13.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:13 smithi072 bash[21573]: cluster 2024-03-30T15:07:11.753468+0000 mgr.y (mgr.14152) 332 : cluster 0 pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:07:13.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:13 smithi072 bash[28946]: cluster 2024-03-30T15:07:11.753468+0000 mgr.y (mgr.14152) 332 : cluster 0 pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:07:13.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:13 smithi172 bash[23680]: cluster 2024-03-30T15:07:11.753468+0000 mgr.y (mgr.14152) 332 : cluster 0 pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:07:14.651 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T15:07:15.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:15 smithi072 bash[21573]: cluster 2024-03-30T15:07:13.753981+0000 mgr.y (mgr.14152) 333 : cluster 0 pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:07:15.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:15 smithi072 bash[28946]: cluster 2024-03-30T15:07:13.753981+0000 mgr.y (mgr.14152) 333 : cluster 0 pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:07:15.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:15 smithi172 bash[23680]: cluster 2024-03-30T15:07:13.753981+0000 mgr.y (mgr.14152) 333 : cluster 0 pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:07:17.316 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:17 smithi072 bash[21573]: cluster 2024-03-30T15:07:15.754374+0000 mgr.y (mgr.14152) 334 : cluster 0 pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:07:17.317 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:17 smithi072 bash[28946]: cluster 2024-03-30T15:07:15.754374+0000 mgr.y (mgr.14152) 334 : cluster 0 pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:07:17.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.456+0000 7fd505c5e700 1 -- 172.21.15.72:0/1985230232 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd500102ce0 msgr2=0x7fd50010f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:07:17.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.456+0000 7fd505c5e700 1 --2- 172.21.15.72:0/1985230232 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd500102ce0 0x7fd50010f0d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd4f800b0a0 tx=0x7fd4f800b3b0 comp rx=0 tx=0).stop 2024-03-30T15:07:17.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.456+0000 7fd505c5e700 1 -- 172.21.15.72:0/1985230232 shutdown_connections 2024-03-30T15:07:17.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.456+0000 7fd505c5e700 1 --2- 172.21.15.72:0/1985230232 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd500102ce0 0x7fd50010f0d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:17.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.456+0000 7fd505c5e700 1 --2- 172.21.15.72:0/1985230232 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd500108390 0x7fd500108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:17.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.456+0000 7fd505c5e700 1 --2- 172.21.15.72:0/1985230232 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd500102320 0x7fd5001027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:17.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.456+0000 7fd505c5e700 1 -- 172.21.15.72:0/1985230232 >> 172.21.15.72:0/1985230232 conn(0x7fd500079310 msgr2=0x7fd500079720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:07:17.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.456+0000 7fd505c5e700 1 -- 172.21.15.72:0/1985230232 shutdown_connections 2024-03-30T15:07:17.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.456+0000 7fd505c5e700 1 -- 172.21.15.72:0/1985230232 wait complete. 2024-03-30T15:07:17.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.456+0000 7fd505c5e700 1 Processor -- start 2024-03-30T15:07:17.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.456+0000 7fd505c5e700 1 -- start start 2024-03-30T15:07:17.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.456+0000 7fd505c5e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd500102320 0x7fd500197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:07:17.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.456+0000 7fd505c5e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd500102ce0 0x7fd500198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:07:17.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.456+0000 7fd505c5e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd500108390 0x7fd50019c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:07:17.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.456+0000 7fd505c5e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd500111ab0 con 0x7fd500108390 2024-03-30T15:07:17.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.456+0000 7fd505c5e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd500111930 con 0x7fd500102320 2024-03-30T15:07:17.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.456+0000 7fd505c5e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fd500111c30 con 0x7fd500102ce0 2024-03-30T15:07:17.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.456+0000 7fd4feffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd500102ce0 0x7fd500198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:07:17.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.456+0000 7fd4fffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd500108390 0x7fd50019c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:07:17.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.456+0000 7fd4feffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd500102ce0 0x7fd500198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:52886/0 (socket says 172.21.15.72:52886) 2024-03-30T15:07:17.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.456+0000 7fd4fffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd500108390 0x7fd50019c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34422/0 (socket says 172.21.15.72:34422) 2024-03-30T15:07:17.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.456+0000 7fd4feffd700 1 -- 172.21.15.72:0/3897392050 learned_addr learned my addr 172.21.15.72:0/3897392050 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T15:07:17.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.456+0000 7fd4ff7fe700 1 --2- 172.21.15.72:0/3897392050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd500102320 0x7fd500197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:07:17.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.456+0000 7fd4feffd700 1 -- 172.21.15.72:0/3897392050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd500102320 msgr2=0x7fd500197f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:07:17.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.456+0000 7fd4feffd700 1 --2- 172.21.15.72:0/3897392050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd500102320 0x7fd500197f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:17.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.456+0000 7fd4feffd700 1 -- 172.21.15.72:0/3897392050 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd500108390 msgr2=0x7fd50019c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:07:17.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.456+0000 7fd4feffd700 1 --2- 172.21.15.72:0/3897392050 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd500108390 0x7fd50019c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:17.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.456+0000 7fd4feffd700 1 -- 172.21.15.72:0/3897392050 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd50019cf20 con 0x7fd500102ce0 2024-03-30T15:07:17.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.456+0000 7fd4feffd700 1 --2- 172.21.15.72:0/3897392050 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd500102ce0 0x7fd500198450 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd4f400eb30 tx=0x7fd4f400ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:07:17.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.456+0000 7fd4fcff9700 1 -- 172.21.15.72:0/3897392050 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f400cc90 con 0x7fd500102ce0 2024-03-30T15:07:17.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.456+0000 7fd4fcff9700 1 -- 172.21.15.72:0/3897392050 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7fd4f400ce30 con 0x7fd500102ce0 2024-03-30T15:07:17.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.456+0000 7fd4fcff9700 1 -- 172.21.15.72:0/3897392050 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f4003d80 con 0x7fd500102ce0 2024-03-30T15:07:17.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.456+0000 7fd505c5e700 1 -- 172.21.15.72:0/3897392050 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd50019d210 con 0x7fd500102ce0 2024-03-30T15:07:17.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.456+0000 7fd505c5e700 1 -- 172.21.15.72:0/3897392050 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5001a4a90 con 0x7fd500102ce0 2024-03-30T15:07:17.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.460+0000 7fd505c5e700 1 -- 172.21.15.72:0/3897392050 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd50004ff00 con 0x7fd500102ce0 2024-03-30T15:07:17.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.460+0000 7fd4fcff9700 1 -- 172.21.15.72:0/3897392050 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 15) ==== 91774+0+0 (secure 0 0 0) 0x7fd4f4003f20 con 0x7fd500102ce0 2024-03-30T15:07:17.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.460+0000 7fd4fcff9700 1 --2- 172.21.15.72:0/3897392050 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fd4e806db50 0x7fd4e8070010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:07:17.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.460+0000 7fd4fcff9700 1 -- 172.21.15.72:0/3897392050 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(58..58 src has 1..58) ==== 5287+0+0 (secure 0 0 0) 0x7fd4f408d960 con 0x7fd500102ce0 2024-03-30T15:07:17.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.460+0000 7fd4ff7fe700 1 --2- 172.21.15.72:0/3897392050 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fd4e806db50 0x7fd4e8070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:07:17.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.460+0000 7fd4ff7fe700 1 --2- 172.21.15.72:0/3897392050 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fd4e806db50 0x7fd4e8070010 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd4f0006fd0 tx=0x7fd4f0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:07:17.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.464+0000 7fd4fcff9700 1 -- 172.21.15.72:0/3897392050 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fd4f405b7f0 con 0x7fd500102ce0 2024-03-30T15:07:17.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:17 smithi172 bash[23680]: cluster 2024-03-30T15:07:15.754374+0000 mgr.y (mgr.14152) 334 : cluster 0 pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:07:17.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.672+0000 7fd505c5e700 1 -- 172.21.15.72:0/3897392050 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd5001a4d20 con 0x7fd500102ce0 2024-03-30T15:07:17.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.672+0000 7fd4fcff9700 1 -- 172.21.15.72:0/3897392050 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) ==== 93+0+10 (secure 0 0 0) 0x7fd4f405b0f0 con 0x7fd500102ce0 2024-03-30T15:07:17.673 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-03-30T15:07:17.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.676+0000 7fd505c5e700 1 -- 172.21.15.72:0/3897392050 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fd4e806db50 msgr2=0x7fd4e8070010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:07:17.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.676+0000 7fd505c5e700 1 --2- 172.21.15.72:0/3897392050 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fd4e806db50 0x7fd4e8070010 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd4f0006fd0 tx=0x7fd4f0008040 comp rx=0 tx=0).stop 2024-03-30T15:07:17.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.676+0000 7fd505c5e700 1 -- 172.21.15.72:0/3897392050 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd500102ce0 msgr2=0x7fd500198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:07:17.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.676+0000 7fd505c5e700 1 --2- 172.21.15.72:0/3897392050 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd500102ce0 0x7fd500198450 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd4f400eb30 tx=0x7fd4f400ee40 comp rx=0 tx=0).stop 2024-03-30T15:07:17.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.676+0000 7fd505c5e700 1 -- 172.21.15.72:0/3897392050 shutdown_connections 2024-03-30T15:07:17.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.676+0000 7fd505c5e700 1 --2- 172.21.15.72:0/3897392050 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fd4e806db50 0x7fd4e8070010 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:17.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.676+0000 7fd505c5e700 1 --2- 172.21.15.72:0/3897392050 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd500108390 0x7fd50019c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:17.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.676+0000 7fd505c5e700 1 --2- 172.21.15.72:0/3897392050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd500102320 0x7fd500197f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:17.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.676+0000 7fd505c5e700 1 --2- 172.21.15.72:0/3897392050 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd500102ce0 0x7fd500198450 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:17.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.676+0000 7fd505c5e700 1 -- 172.21.15.72:0/3897392050 >> 172.21.15.72:0/3897392050 conn(0x7fd500079310 msgr2=0x7fd500105eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:07:17.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.676+0000 7fd505c5e700 1 -- 172.21.15.72:0/3897392050 shutdown_connections 2024-03-30T15:07:17.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:07:17.676+0000 7fd505c5e700 1 -- 172.21.15.72:0/3897392050 wait complete. 2024-03-30T15:07:18.406 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:18 smithi072 bash[28946]: audit 2024-03-30T15:07:17.676567+0000 mon.c (mon.2) 16 : audit 0 from='client.? 172.21.15.72:0/3897392050' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-30T15:07:18.406 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:18 smithi072 bash[21573]: audit 2024-03-30T15:07:17.676567+0000 mon.c (mon.2) 16 : audit 0 from='client.? 172.21.15.72:0/3897392050' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-30T15:07:18.407 INFO:tasks.cephadm:Adding ceph.rgw.foo.a on smithi072 2024-03-30T15:07:18.408 DEBUG:teuthology.orchestra.run.smithi172:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph orch apply rgw foo.a --placement '1;smithi072=foo.a' 2024-03-30T15:07:18.419 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:18 smithi172 bash[23680]: audit 2024-03-30T15:07:17.676567+0000 mon.c (mon.2) 16 : audit 0 from='client.? 172.21.15.72:0/3897392050' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-30T15:07:19.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:19 smithi072 bash[21573]: cluster 2024-03-30T15:07:17.754725+0000 mgr.y (mgr.14152) 335 : cluster 0 pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:07:19.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:19 smithi072 bash[28946]: cluster 2024-03-30T15:07:17.754725+0000 mgr.y (mgr.14152) 335 : cluster 0 pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:07:19.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:19 smithi172 bash[23680]: cluster 2024-03-30T15:07:17.754725+0000 mgr.y (mgr.14152) 335 : cluster 0 pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:07:21.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:21 smithi072 bash[21573]: cluster 2024-03-30T15:07:19.755256+0000 mgr.y (mgr.14152) 336 : cluster 0 pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:07:21.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:21 smithi072 bash[28946]: cluster 2024-03-30T15:07:19.755256+0000 mgr.y (mgr.14152) 336 : cluster 0 pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:07:21.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:21 smithi172 bash[23680]: cluster 2024-03-30T15:07:19.755256+0000 mgr.y (mgr.14152) 336 : cluster 0 pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:07:23.154 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.b/config 2024-03-30T15:07:23.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:23 smithi072 bash[21573]: cluster 2024-03-30T15:07:21.755807+0000 mgr.y (mgr.14152) 337 : cluster 0 pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:07:23.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:23 smithi072 bash[28946]: cluster 2024-03-30T15:07:21.755807+0000 mgr.y (mgr.14152) 337 : cluster 0 pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:07:23.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:23 smithi172 bash[23680]: cluster 2024-03-30T15:07:21.755807+0000 mgr.y (mgr.14152) 337 : cluster 0 pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:07:25.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:25 smithi172 bash[23680]: cluster 2024-03-30T15:07:23.756428+0000 mgr.y (mgr.14152) 338 : cluster 0 pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:07:25.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:25 smithi072 bash[21573]: cluster 2024-03-30T15:07:23.756428+0000 mgr.y (mgr.14152) 338 : cluster 0 pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:07:25.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:25 smithi072 bash[28946]: cluster 2024-03-30T15:07:23.756428+0000 mgr.y (mgr.14152) 338 : cluster 0 pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:07:25.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:25.833+0000 7f8258476700 1 -- 172.21.15.172:0/3483405352 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8250105690 msgr2=0x7f8250107a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:07:25.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:25.833+0000 7f8258476700 1 --2- 172.21.15.172:0/3483405352 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8250105690 0x7f8250107a80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8240009990 tx=0x7f8240009ca0 comp rx=0 tx=0).stop 2024-03-30T15:07:25.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:25.833+0000 7f8258476700 1 -- 172.21.15.172:0/3483405352 shutdown_connections 2024-03-30T15:07:25.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:25.833+0000 7f8258476700 1 --2- 172.21.15.172:0/3483405352 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8250107fc0 0x7f825010a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:25.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:25.833+0000 7f8258476700 1 --2- 172.21.15.172:0/3483405352 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8250102d60 0x7f8250105150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:25.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:25.833+0000 7f8258476700 1 --2- 172.21.15.172:0/3483405352 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8250105690 0x7f8250107a80 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:25.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:25.833+0000 7f8258476700 1 -- 172.21.15.172:0/3483405352 >> 172.21.15.172:0/3483405352 conn(0x7f82500fc790 msgr2=0x7f82500febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:07:25.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:25.833+0000 7f8258476700 1 -- 172.21.15.172:0/3483405352 shutdown_connections 2024-03-30T15:07:25.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:25.833+0000 7f8258476700 1 -- 172.21.15.172:0/3483405352 wait complete. 2024-03-30T15:07:25.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:25.833+0000 7f8258476700 1 Processor -- start 2024-03-30T15:07:25.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:25.833+0000 7f8258476700 1 -- start start 2024-03-30T15:07:25.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:25.837+0000 7f8258476700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8250102d60 0x7f82501979f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:07:25.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:25.837+0000 7f8258476700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8250105690 0x7f8250197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:07:25.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:25.837+0000 7f8258476700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8250107fc0 0x7f825019efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:07:25.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:25.837+0000 7f8258476700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f825010d3b0 con 0x7f8250102d60 2024-03-30T15:07:25.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:25.837+0000 7f8258476700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f825010d230 con 0x7f8250107fc0 2024-03-30T15:07:25.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:25.837+0000 7f8258476700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f825010d530 con 0x7f8250105690 2024-03-30T15:07:25.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:25.837+0000 7f8256a13700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8250107fc0 0x7f825019efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:07:25.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:25.837+0000 7f8256a13700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8250107fc0 0x7f825019efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56704/0 (socket says 172.21.15.172:56704) 2024-03-30T15:07:25.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:25.837+0000 7f8256a13700 1 -- 172.21.15.172:0/2816135500 learned_addr learned my addr 172.21.15.172:0/2816135500 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-03-30T15:07:25.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:25.837+0000 7f8256212700 1 --2- 172.21.15.172:0/2816135500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8250102d60 0x7f82501979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:07:25.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:25.837+0000 7f8255a11700 1 --2- 172.21.15.172:0/2816135500 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8250105690 0x7f8250197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:07:25.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:25.837+0000 7f8256a13700 1 -- 172.21.15.172:0/2816135500 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8250105690 msgr2=0x7f8250197f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:07:25.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:25.837+0000 7f8256a13700 1 --2- 172.21.15.172:0/2816135500 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8250105690 0x7f8250197f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:25.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:25.837+0000 7f8256a13700 1 -- 172.21.15.172:0/2816135500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8250102d60 msgr2=0x7f82501979f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:07:25.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:25.837+0000 7f8256a13700 1 --2- 172.21.15.172:0/2816135500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8250102d60 0x7f82501979f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:25.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:25.837+0000 7f8256a13700 1 -- 172.21.15.172:0/2816135500 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f825019f650 con 0x7f8250107fc0 2024-03-30T15:07:25.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:25.837+0000 7f8255a11700 1 --2- 172.21.15.172:0/2816135500 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8250105690 0x7f8250197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T15:07:25.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:25.837+0000 7f8256a13700 1 --2- 172.21.15.172:0/2816135500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8250107fc0 0x7f825019efb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f82480094f0 tx=0x7f8248007f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:07:25.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:25.837+0000 7f82477fe700 1 -- 172.21.15.172:0/2816135500 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8248004db0 con 0x7f8250107fc0 2024-03-30T15:07:25.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:25.837+0000 7f82477fe700 1 -- 172.21.15.172:0/2816135500 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f8248005020 con 0x7f8250107fc0 2024-03-30T15:07:25.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:25.837+0000 7f8258476700 1 -- 172.21.15.172:0/2816135500 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f825019f940 con 0x7f8250107fc0 2024-03-30T15:07:25.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:25.837+0000 7f82477fe700 1 -- 172.21.15.172:0/2816135500 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8248015660 con 0x7f8250107fc0 2024-03-30T15:07:25.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:25.837+0000 7f8258476700 1 -- 172.21.15.172:0/2816135500 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f825019fe30 con 0x7f8250107fc0 2024-03-30T15:07:25.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:25.837+0000 7f8258476700 1 -- 172.21.15.172:0/2816135500 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f825004ff00 con 0x7f8250107fc0 2024-03-30T15:07:25.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:25.837+0000 7f82477fe700 1 -- 172.21.15.172:0/2816135500 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 15) ==== 91774+0+0 (secure 0 0 0) 0x7f824800db60 con 0x7f8250107fc0 2024-03-30T15:07:25.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:25.837+0000 7f82477fe700 1 --2- 172.21.15.172:0/2816135500 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f823c06db50 0x7f823c070010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:07:25.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:25.837+0000 7f82477fe700 1 -- 172.21.15.172:0/2816135500 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5287+0+0 (secure 0 0 0) 0x7f824808d0c0 con 0x7f8250107fc0 2024-03-30T15:07:25.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:25.837+0000 7f8256212700 1 --2- 172.21.15.172:0/2816135500 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f823c06db50 0x7f823c070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:07:25.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:25.841+0000 7f8256212700 1 --2- 172.21.15.172:0/2816135500 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f823c06db50 0x7f823c070010 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f824c005950 tx=0x7f824c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:07:25.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:25.845+0000 7f82477fe700 1 -- 172.21.15.172:0/2816135500 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f8248010070 con 0x7f8250107fc0 2024-03-30T15:07:26.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:26.049+0000 7f8258476700 1 -- 172.21.15.172:0/2816135500 --> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] -- mgr_command(tid 0: {"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi072=foo.a", "target": ["mon-mgr", ""]}) -- 0x7f825002df10 con 0x7f823c06db50 2024-03-30T15:07:26.066 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:26.065+0000 7f82477fe700 1 -- 172.21.15.172:0/2816135500 <== mgr.14152 v2:172.21.15.72:6800/2777002311 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+30 (secure 0 0 0) 0x7f825002df10 con 0x7f823c06db50 2024-03-30T15:07:26.066 INFO:teuthology.orchestra.run.smithi172.stdout:Scheduled rgw.foo.a update... 2024-03-30T15:07:26.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:26.069+0000 7f8258476700 1 -- 172.21.15.172:0/2816135500 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f823c06db50 msgr2=0x7f823c070010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:07:26.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:26.069+0000 7f8258476700 1 --2- 172.21.15.172:0/2816135500 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f823c06db50 0x7f823c070010 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f824c005950 tx=0x7f824c0058e0 comp rx=0 tx=0).stop 2024-03-30T15:07:26.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:26.069+0000 7f8258476700 1 -- 172.21.15.172:0/2816135500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8250107fc0 msgr2=0x7f825019efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:07:26.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:26.069+0000 7f8258476700 1 --2- 172.21.15.172:0/2816135500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8250107fc0 0x7f825019efb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f82480094f0 tx=0x7f8248007f90 comp rx=0 tx=0).stop 2024-03-30T15:07:26.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:26.069+0000 7f8258476700 1 -- 172.21.15.172:0/2816135500 shutdown_connections 2024-03-30T15:07:26.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:26.069+0000 7f8258476700 1 --2- 172.21.15.172:0/2816135500 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f823c06db50 0x7f823c070010 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:26.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:26.069+0000 7f8258476700 1 --2- 172.21.15.172:0/2816135500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8250107fc0 0x7f825019efb0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:26.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:26.069+0000 7f8258476700 1 --2- 172.21.15.172:0/2816135500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8250102d60 0x7f82501979f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:26.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:26.069+0000 7f8258476700 1 --2- 172.21.15.172:0/2816135500 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8250105690 0x7f8250197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:26.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:26.069+0000 7f8258476700 1 -- 172.21.15.172:0/2816135500 >> 172.21.15.172:0/2816135500 conn(0x7f82500fc790 msgr2=0x7f8250103800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:07:26.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:26.069+0000 7f8258476700 1 -- 172.21.15.172:0/2816135500 shutdown_connections 2024-03-30T15:07:26.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:26.069+0000 7f8258476700 1 -- 172.21.15.172:0/2816135500 wait complete. 2024-03-30T15:07:26.781 DEBUG:teuthology.orchestra.run.smithi072:rgw.foo.a> sudo journalctl -f -n 0 -u ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@rgw.foo.a.service 2024-03-30T15:07:26.784 INFO:tasks.cephadm:Adding ceph.iscsi.iscsi.a on smithi172 2024-03-30T15:07:26.785 DEBUG:teuthology.orchestra.run.smithi172:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph osd pool create datapool 3 3 replicated 2024-03-30T15:07:27.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:27 smithi072 bash[21573]: cluster 2024-03-30T15:07:25.756999+0000 mgr.y (mgr.14152) 339 : cluster 0 pgmap v324: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:07:27.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:27 smithi072 bash[21573]: audit 2024-03-30T15:07:26.057237+0000 mgr.y (mgr.14152) 340 : audit 0 from='client.24298 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi072=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T15:07:27.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:27 smithi072 bash[21573]: cephadm 2024-03-30T15:07:26.061339+0000 mgr.y (mgr.14152) 341 : cephadm 1 Saving service rgw.foo.a spec with placement smithi072=foo.a;count:1 2024-03-30T15:07:27.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:27 smithi072 bash[21573]: audit 2024-03-30T15:07:26.068392+0000 mon.a (mon.0) 666 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:27.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:27 smithi072 bash[21573]: audit 2024-03-30T15:07:26.086790+0000 mon.a (mon.0) 667 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:07:27.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:27 smithi072 bash[21573]: audit 2024-03-30T15:07:26.714243+0000 mon.a (mon.0) 668 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:07:27.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:27 smithi072 bash[21573]: audit 2024-03-30T15:07:26.715957+0000 mon.a (mon.0) 669 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:07:27.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:27 smithi072 bash[21573]: audit 2024-03-30T15:07:26.724678+0000 mon.a (mon.0) 670 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:27.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:27 smithi072 bash[21573]: audit 2024-03-30T15:07:26.730837+0000 mon.a (mon.0) 671 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-30T15:07:27.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:27 smithi072 bash[21573]: audit 2024-03-30T15:07:26.733725+0000 mon.a (mon.0) 672 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-03-30T15:07:27.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:27 smithi072 bash[21573]: audit 2024-03-30T15:07:26.743365+0000 mon.a (mon.0) 673 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:27.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:27 smithi072 bash[21573]: audit 2024-03-30T15:07:26.746705+0000 mon.a (mon.0) 674 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:07:27.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:27 smithi072 bash[28946]: cluster 2024-03-30T15:07:25.756999+0000 mgr.y (mgr.14152) 339 : cluster 0 pgmap v324: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:07:27.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:27 smithi072 bash[28946]: audit 2024-03-30T15:07:26.057237+0000 mgr.y (mgr.14152) 340 : audit 0 from='client.24298 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi072=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T15:07:27.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:27 smithi072 bash[28946]: cephadm 2024-03-30T15:07:26.061339+0000 mgr.y (mgr.14152) 341 : cephadm 1 Saving service rgw.foo.a spec with placement smithi072=foo.a;count:1 2024-03-30T15:07:27.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:27 smithi072 bash[28946]: audit 2024-03-30T15:07:26.068392+0000 mon.a (mon.0) 666 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:27.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:27 smithi072 bash[28946]: audit 2024-03-30T15:07:26.086790+0000 mon.a (mon.0) 667 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:07:27.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:27 smithi072 bash[28946]: audit 2024-03-30T15:07:26.714243+0000 mon.a (mon.0) 668 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:07:27.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:27 smithi072 bash[28946]: audit 2024-03-30T15:07:26.715957+0000 mon.a (mon.0) 669 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:07:27.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:27 smithi072 bash[28946]: audit 2024-03-30T15:07:26.724678+0000 mon.a (mon.0) 670 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:27.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:27 smithi072 bash[28946]: audit 2024-03-30T15:07:26.730837+0000 mon.a (mon.0) 671 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-30T15:07:27.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:27 smithi072 bash[28946]: audit 2024-03-30T15:07:26.733725+0000 mon.a (mon.0) 672 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-03-30T15:07:27.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:27 smithi072 bash[28946]: audit 2024-03-30T15:07:26.743365+0000 mon.a (mon.0) 673 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:27.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:27 smithi072 bash[28946]: audit 2024-03-30T15:07:26.746705+0000 mon.a (mon.0) 674 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:07:27.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:27 smithi172 bash[23680]: cluster 2024-03-30T15:07:25.756999+0000 mgr.y (mgr.14152) 339 : cluster 0 pgmap v324: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:07:27.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:27 smithi172 bash[23680]: audit 2024-03-30T15:07:26.057237+0000 mgr.y (mgr.14152) 340 : audit 0 from='client.24298 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi072=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T15:07:27.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:27 smithi172 bash[23680]: cephadm 2024-03-30T15:07:26.061339+0000 mgr.y (mgr.14152) 341 : cephadm 1 Saving service rgw.foo.a spec with placement smithi072=foo.a;count:1 2024-03-30T15:07:27.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:27 smithi172 bash[23680]: audit 2024-03-30T15:07:26.068392+0000 mon.a (mon.0) 666 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:27.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:27 smithi172 bash[23680]: audit 2024-03-30T15:07:26.086790+0000 mon.a (mon.0) 667 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:07:27.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:27 smithi172 bash[23680]: audit 2024-03-30T15:07:26.714243+0000 mon.a (mon.0) 668 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:07:27.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:27 smithi172 bash[23680]: audit 2024-03-30T15:07:26.715957+0000 mon.a (mon.0) 669 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:07:27.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:27 smithi172 bash[23680]: audit 2024-03-30T15:07:26.724678+0000 mon.a (mon.0) 670 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:27.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:27 smithi172 bash[23680]: audit 2024-03-30T15:07:26.730837+0000 mon.a (mon.0) 671 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-30T15:07:27.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:27 smithi172 bash[23680]: audit 2024-03-30T15:07:26.733725+0000 mon.a (mon.0) 672 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-03-30T15:07:27.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:27 smithi172 bash[23680]: audit 2024-03-30T15:07:26.743365+0000 mon.a (mon.0) 673 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:27.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:27 smithi172 bash[23680]: audit 2024-03-30T15:07:26.746705+0000 mon.a (mon.0) 674 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:07:28.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:28 smithi072 bash[21573]: cephadm 2024-03-30T15:07:26.748690+0000 mgr.y (mgr.14152) 342 : cephadm 1 Deploying daemon rgw.foo.a on smithi072 2024-03-30T15:07:28.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:28 smithi072 bash[28946]: cephadm 2024-03-30T15:07:26.748690+0000 mgr.y (mgr.14152) 342 : cephadm 1 Deploying daemon rgw.foo.a on smithi072 2024-03-30T15:07:28.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:28 smithi172 bash[23680]: cephadm 2024-03-30T15:07:26.748690+0000 mgr.y (mgr.14152) 342 : cephadm 1 Deploying daemon rgw.foo.a on smithi072 2024-03-30T15:07:29.302 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 30 15:07:29 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:07:29.303 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 30 15:07:29 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:07:29.303 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:07:29 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:07:29.303 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 30 15:07:29 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:07:29.304 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:29 smithi072 bash[28946]: cluster 2024-03-30T15:07:27.757586+0000 mgr.y (mgr.14152) 343 : cluster 0 pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:07:29.304 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:29 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:07:29.304 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:29 smithi072 bash[21573]: cluster 2024-03-30T15:07:27.757586+0000 mgr.y (mgr.14152) 343 : cluster 0 pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:07:29.304 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:29 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:07:29.304 INFO:journalctl@ceph.osd.3.smithi072.stdout:Mar 30 15:07:29 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:07:29.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:29 smithi172 bash[23680]: cluster 2024-03-30T15:07:27.757586+0000 mgr.y (mgr.14152) 343 : cluster 0 pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:07:29.584 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:29 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:07:29.585 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:07:29 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:07:29.585 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:29 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:07:29.585 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 30 15:07:29 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:07:29.585 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 30 15:07:29 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:07:29.586 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 30 15:07:29 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:07:29.586 INFO:journalctl@ceph.osd.3.smithi072.stdout:Mar 30 15:07:29 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:07:29.586 INFO:journalctl@ceph.rgw.foo.a.smithi072.stdout:Mar 30 15:07:29 smithi072 systemd[1]: Started Ceph rgw.foo.a for 97f8e564-eea5-11ee-b647-cb9ed24678a4. 2024-03-30T15:07:31.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:30 smithi072 bash[21573]: audit 2024-03-30T15:07:29.586640+0000 mon.a (mon.0) 675 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:31.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:30 smithi072 bash[21573]: audit 2024-03-30T15:07:29.593367+0000 mon.a (mon.0) 676 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:31.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:30 smithi072 bash[21573]: audit 2024-03-30T15:07:29.622835+0000 mon.a (mon.0) 677 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:31.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:30 smithi072 bash[21573]: cephadm 2024-03-30T15:07:29.623649+0000 mgr.y (mgr.14152) 344 : cephadm 1 Saving service rgw.foo.a spec with placement smithi072=foo.a;count:1 2024-03-30T15:07:31.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:30 smithi072 bash[21573]: audit 2024-03-30T15:07:29.627627+0000 mon.a (mon.0) 678 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:31.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:30 smithi072 bash[21573]: audit 2024-03-30T15:07:29.631290+0000 mon.a (mon.0) 679 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:31.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:30 smithi072 bash[21573]: audit 2024-03-30T15:07:29.679968+0000 mon.a (mon.0) 680 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:07:31.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:30 smithi072 bash[21573]: audit 2024-03-30T15:07:30.291146+0000 mon.a (mon.0) 681 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:31.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:30 smithi072 bash[28946]: audit 2024-03-30T15:07:29.586640+0000 mon.a (mon.0) 675 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:31.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:30 smithi072 bash[28946]: audit 2024-03-30T15:07:29.593367+0000 mon.a (mon.0) 676 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:31.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:30 smithi072 bash[28946]: audit 2024-03-30T15:07:29.622835+0000 mon.a (mon.0) 677 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:31.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:30 smithi072 bash[28946]: cephadm 2024-03-30T15:07:29.623649+0000 mgr.y (mgr.14152) 344 : cephadm 1 Saving service rgw.foo.a spec with placement smithi072=foo.a;count:1 2024-03-30T15:07:31.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:30 smithi072 bash[28946]: audit 2024-03-30T15:07:29.627627+0000 mon.a (mon.0) 678 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:31.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:30 smithi072 bash[28946]: audit 2024-03-30T15:07:29.631290+0000 mon.a (mon.0) 679 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:31.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:30 smithi072 bash[28946]: audit 2024-03-30T15:07:29.679968+0000 mon.a (mon.0) 680 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:07:31.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:30 smithi072 bash[28946]: audit 2024-03-30T15:07:30.291146+0000 mon.a (mon.0) 681 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:31.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:30 smithi172 bash[23680]: audit 2024-03-30T15:07:29.586640+0000 mon.a (mon.0) 675 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:31.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:30 smithi172 bash[23680]: audit 2024-03-30T15:07:29.593367+0000 mon.a (mon.0) 676 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:31.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:30 smithi172 bash[23680]: audit 2024-03-30T15:07:29.622835+0000 mon.a (mon.0) 677 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:31.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:30 smithi172 bash[23680]: cephadm 2024-03-30T15:07:29.623649+0000 mgr.y (mgr.14152) 344 : cephadm 1 Saving service rgw.foo.a spec with placement smithi072=foo.a;count:1 2024-03-30T15:07:31.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:30 smithi172 bash[23680]: audit 2024-03-30T15:07:29.627627+0000 mon.a (mon.0) 678 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:31.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:30 smithi172 bash[23680]: audit 2024-03-30T15:07:29.631290+0000 mon.a (mon.0) 679 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:31.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:30 smithi172 bash[23680]: audit 2024-03-30T15:07:29.679968+0000 mon.a (mon.0) 680 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:07:31.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:30 smithi172 bash[23680]: audit 2024-03-30T15:07:30.291146+0000 mon.a (mon.0) 681 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:31.569 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.b/config 2024-03-30T15:07:32.340 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:31 smithi172 bash[23680]: cluster 2024-03-30T15:07:29.757946+0000 mgr.y (mgr.14152) 345 : cluster 0 pgmap v326: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:07:32.340 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:31 smithi172 bash[23680]: cluster 2024-03-30T15:07:31.297879+0000 mon.a (mon.0) 682 : cluster 0 osdmap e59: 8 total, 8 up, 8 in 2024-03-30T15:07:32.340 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:31 smithi172 bash[23680]: audit 2024-03-30T15:07:31.302699+0000 mon.c (mon.2) 17 : audit 1 from='client.? 172.21.15.72:0/1677455341' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-03-30T15:07:32.340 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:31 smithi172 bash[23680]: audit 2024-03-30T15:07:31.303595+0000 mon.a (mon.0) 683 : audit 1 from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-03-30T15:07:32.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:31 smithi072 bash[28946]: cluster 2024-03-30T15:07:29.757946+0000 mgr.y (mgr.14152) 345 : cluster 0 pgmap v326: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:07:32.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:31 smithi072 bash[28946]: cluster 2024-03-30T15:07:31.297879+0000 mon.a (mon.0) 682 : cluster 0 osdmap e59: 8 total, 8 up, 8 in 2024-03-30T15:07:32.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:31 smithi072 bash[28946]: audit 2024-03-30T15:07:31.302699+0000 mon.c (mon.2) 17 : audit 1 from='client.? 172.21.15.72:0/1677455341' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-03-30T15:07:32.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:31 smithi072 bash[28946]: audit 2024-03-30T15:07:31.303595+0000 mon.a (mon.0) 683 : audit 1 from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-03-30T15:07:32.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:31 smithi072 bash[21573]: cluster 2024-03-30T15:07:29.757946+0000 mgr.y (mgr.14152) 345 : cluster 0 pgmap v326: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:07:32.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:31 smithi072 bash[21573]: cluster 2024-03-30T15:07:31.297879+0000 mon.a (mon.0) 682 : cluster 0 osdmap e59: 8 total, 8 up, 8 in 2024-03-30T15:07:32.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:31 smithi072 bash[21573]: audit 2024-03-30T15:07:31.302699+0000 mon.c (mon.2) 17 : audit 1 from='client.? 172.21.15.72:0/1677455341' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-03-30T15:07:32.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:31 smithi072 bash[21573]: audit 2024-03-30T15:07:31.303595+0000 mon.a (mon.0) 683 : audit 1 from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-03-30T15:07:33.265 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:32 smithi172 bash[23680]: cluster 2024-03-30T15:07:31.758586+0000 mgr.y (mgr.14152) 346 : cluster 0 pgmap v328: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:07:33.265 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:32 smithi172 bash[23680]: cluster 2024-03-30T15:07:32.290140+0000 mon.a (mon.0) 684 : cluster 3 Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:07:33.265 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:32 smithi172 bash[23680]: audit 2024-03-30T15:07:32.300160+0000 mon.a (mon.0) 685 : audit 1 from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-03-30T15:07:33.265 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:32 smithi172 bash[23680]: cluster 2024-03-30T15:07:32.307270+0000 mon.a (mon.0) 686 : cluster 0 osdmap e60: 8 total, 8 up, 8 in 2024-03-30T15:07:33.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:32 smithi072 bash[21573]: cluster 2024-03-30T15:07:31.758586+0000 mgr.y (mgr.14152) 346 : cluster 0 pgmap v328: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:07:33.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:32 smithi072 bash[21573]: cluster 2024-03-30T15:07:32.290140+0000 mon.a (mon.0) 684 : cluster 3 Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:07:33.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:32 smithi072 bash[21573]: audit 2024-03-30T15:07:32.300160+0000 mon.a (mon.0) 685 : audit 1 from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-03-30T15:07:33.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:32 smithi072 bash[21573]: cluster 2024-03-30T15:07:32.307270+0000 mon.a (mon.0) 686 : cluster 0 osdmap e60: 8 total, 8 up, 8 in 2024-03-30T15:07:33.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:32 smithi072 bash[28946]: cluster 2024-03-30T15:07:31.758586+0000 mgr.y (mgr.14152) 346 : cluster 0 pgmap v328: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:07:33.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:32 smithi072 bash[28946]: cluster 2024-03-30T15:07:32.290140+0000 mon.a (mon.0) 684 : cluster 3 Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:07:33.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:32 smithi072 bash[28946]: audit 2024-03-30T15:07:32.300160+0000 mon.a (mon.0) 685 : audit 1 from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-03-30T15:07:33.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:32 smithi072 bash[28946]: cluster 2024-03-30T15:07:32.307270+0000 mon.a (mon.0) 686 : cluster 0 osdmap e60: 8 total, 8 up, 8 in 2024-03-30T15:07:34.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:34.293+0000 7f1a3d982700 1 -- 172.21.15.172:0/3419344189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a38100dc0 msgr2=0x7f1a38101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:07:34.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:34.293+0000 7f1a3d982700 1 --2- 172.21.15.172:0/3419344189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a38100dc0 0x7f1a38101270 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1a3000b0a0 tx=0x7f1a3000b3b0 comp rx=0 tx=0).stop 2024-03-30T15:07:34.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:34.293+0000 7f1a3d982700 1 -- 172.21.15.172:0/3419344189 shutdown_connections 2024-03-30T15:07:34.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:34.293+0000 7f1a3d982700 1 --2- 172.21.15.172:0/3419344189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a38100dc0 0x7f1a38101270 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:34.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:34.293+0000 7f1a3d982700 1 --2- 172.21.15.172:0/3419344189 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a38102900 0x7f1a38102d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:34.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:34.293+0000 7f1a3d982700 1 --2- 172.21.15.172:0/3419344189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a38100400 0x7f1a38100880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:34.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:34.293+0000 7f1a3d982700 1 -- 172.21.15.172:0/3419344189 >> 172.21.15.172:0/3419344189 conn(0x7f1a380fbfa0 msgr2=0x7f1a380fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:07:34.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:34.293+0000 7f1a3d982700 1 -- 172.21.15.172:0/3419344189 shutdown_connections 2024-03-30T15:07:34.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:34.293+0000 7f1a3d982700 1 -- 172.21.15.172:0/3419344189 wait complete. 2024-03-30T15:07:34.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:34.293+0000 7f1a3d982700 1 Processor -- start 2024-03-30T15:07:34.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:34.293+0000 7f1a3d982700 1 -- start start 2024-03-30T15:07:34.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:34.293+0000 7f1a3d982700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a38100400 0x7f1a38199cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:07:34.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:34.293+0000 7f1a3d982700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a38100dc0 0x7f1a3819a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:07:34.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:34.293+0000 7f1a3d982700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a38102900 0x7f1a381a11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:07:34.298 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:34.293+0000 7f1a3d982700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3810f6d0 con 0x7f1a38100dc0 2024-03-30T15:07:34.298 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:34.293+0000 7f1a3d982700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3810f550 con 0x7f1a38102900 2024-03-30T15:07:34.298 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:34.293+0000 7f1a3d982700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f1a3810f850 con 0x7f1a38100400 2024-03-30T15:07:34.298 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:34.293+0000 7f1a377fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a38102900 0x7f1a381a11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:07:34.298 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:34.293+0000 7f1a377fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a38102900 0x7f1a381a11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47622/0 (socket says 172.21.15.172:47622) 2024-03-30T15:07:34.298 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:34.293+0000 7f1a377fe700 1 -- 172.21.15.172:0/3447814131 learned_addr learned my addr 172.21.15.172:0/3447814131 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-03-30T15:07:34.298 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:34.297+0000 7f1a36ffd700 1 --2- 172.21.15.172:0/3447814131 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a38100400 0x7f1a38199cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:07:34.298 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:34.297+0000 7f1a367fc700 1 --2- 172.21.15.172:0/3447814131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a38100dc0 0x7f1a3819a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:07:34.298 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:34.297+0000 7f1a377fe700 1 -- 172.21.15.172:0/3447814131 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a38100400 msgr2=0x7f1a38199cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:07:34.298 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:34.297+0000 7f1a377fe700 1 --2- 172.21.15.172:0/3447814131 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a38100400 0x7f1a38199cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:34.298 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:34.297+0000 7f1a377fe700 1 -- 172.21.15.172:0/3447814131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a38100dc0 msgr2=0x7f1a3819a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:07:34.298 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:34.297+0000 7f1a377fe700 1 --2- 172.21.15.172:0/3447814131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a38100dc0 0x7f1a3819a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:34.298 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:34.297+0000 7f1a377fe700 1 -- 172.21.15.172:0/3447814131 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a381a18b0 con 0x7f1a38102900 2024-03-30T15:07:34.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:34.297+0000 7f1a367fc700 1 --2- 172.21.15.172:0/3447814131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a38100dc0 0x7f1a3819a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T15:07:34.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:34.297+0000 7f1a36ffd700 1 --2- 172.21.15.172:0/3447814131 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a38100400 0x7f1a38199cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T15:07:34.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:34.297+0000 7f1a377fe700 1 --2- 172.21.15.172:0/3447814131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a38102900 0x7f1a381a11e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1a300062a0 tx=0x7f1a3000cf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:07:34.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:34.297+0000 7f1a3c980700 1 -- 172.21.15.172:0/3447814131 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a30021070 con 0x7f1a38102900 2024-03-30T15:07:34.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:34.297+0000 7f1a3c980700 1 -- 172.21.15.172:0/3447814131 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f1a3001d8d0 con 0x7f1a38102900 2024-03-30T15:07:34.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:34.297+0000 7f1a3c980700 1 -- 172.21.15.172:0/3447814131 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a300054f0 con 0x7f1a38102900 2024-03-30T15:07:34.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:34.297+0000 7f1a3d982700 1 -- 172.21.15.172:0/3447814131 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a381a1b40 con 0x7f1a38102900 2024-03-30T15:07:34.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:34.297+0000 7f1a3d982700 1 -- 172.21.15.172:0/3447814131 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a381a1fa0 con 0x7f1a38102900 2024-03-30T15:07:34.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:34.297+0000 7f1a3d982700 1 -- 172.21.15.172:0/3447814131 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a3804ff00 con 0x7f1a38102900 2024-03-30T15:07:34.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:34.297+0000 7f1a3c980700 1 -- 172.21.15.172:0/3447814131 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 15) ==== 91774+0+0 (secure 0 0 0) 0x7f1a30024070 con 0x7f1a38102900 2024-03-30T15:07:34.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:34.297+0000 7f1a3c980700 1 --2- 172.21.15.172:0/3447814131 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f1a2006db50 0x7f1a20070010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:07:34.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:34.297+0000 7f1a3c980700 1 -- 172.21.15.172:0/3447814131 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6000+0+0 (secure 0 0 0) 0x7f1a3000f020 con 0x7f1a38102900 2024-03-30T15:07:34.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:34.297+0000 7f1a36ffd700 1 --2- 172.21.15.172:0/3447814131 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f1a2006db50 0x7f1a20070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:07:34.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:34.297+0000 7f1a36ffd700 1 --2- 172.21.15.172:0/3447814131 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f1a2006db50 0x7f1a20070010 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1a28005fd0 tx=0x7f1a28005de0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:07:34.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:34.301+0000 7f1a3c980700 1 -- 172.21.15.172:0/3447814131 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f1a3002b020 con 0x7f1a38102900 2024-03-30T15:07:34.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:34 smithi172 bash[23680]: cluster 2024-03-30T15:07:33.312547+0000 mon.a (mon.0) 687 : cluster 0 osdmap e61: 8 total, 8 up, 8 in 2024-03-30T15:07:34.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:34 smithi172 bash[23680]: audit 2024-03-30T15:07:33.315567+0000 mon.c (mon.2) 18 : audit 1 from='client.? 172.21.15.72:0/4040452553' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-03-30T15:07:34.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:34 smithi172 bash[23680]: audit 2024-03-30T15:07:33.318501+0000 mon.a (mon.0) 688 : audit 1 from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-03-30T15:07:34.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:34.521+0000 7f1a3d982700 1 -- 172.21.15.172:0/3447814131 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"} v 0) -- 0x7f1a38062e50 con 0x7f1a38102900 2024-03-30T15:07:34.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:34 smithi072 bash[21573]: cluster 2024-03-30T15:07:33.312547+0000 mon.a (mon.0) 687 : cluster 0 osdmap e61: 8 total, 8 up, 8 in 2024-03-30T15:07:34.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:34 smithi072 bash[21573]: audit 2024-03-30T15:07:33.315567+0000 mon.c (mon.2) 18 : audit 1 from='client.? 172.21.15.72:0/4040452553' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-03-30T15:07:34.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:34 smithi072 bash[21573]: audit 2024-03-30T15:07:33.318501+0000 mon.a (mon.0) 688 : audit 1 from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-03-30T15:07:34.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:34 smithi072 bash[28946]: cluster 2024-03-30T15:07:33.312547+0000 mon.a (mon.0) 687 : cluster 0 osdmap e61: 8 total, 8 up, 8 in 2024-03-30T15:07:34.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:34 smithi072 bash[28946]: audit 2024-03-30T15:07:33.315567+0000 mon.c (mon.2) 18 : audit 1 from='client.? 172.21.15.72:0/4040452553' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-03-30T15:07:34.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:34 smithi072 bash[28946]: audit 2024-03-30T15:07:33.318501+0000 mon.a (mon.0) 688 : audit 1 from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-03-30T15:07:35.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:35.321+0000 7f1a3c980700 1 -- 172.21.15.172:0/3447814131 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]=0 pool 'datapool' created v63) ==== 160+0+0 (secure 0 0 0) 0x7f1a3005cf40 con 0x7f1a38102900 2024-03-30T15:07:35.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:35.329+0000 7f1a3d982700 1 -- 172.21.15.172:0/3447814131 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f1a2006db50 msgr2=0x7f1a20070010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:07:35.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:35.329+0000 7f1a3d982700 1 --2- 172.21.15.172:0/3447814131 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f1a2006db50 0x7f1a20070010 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1a28005fd0 tx=0x7f1a28005de0 comp rx=0 tx=0).stop 2024-03-30T15:07:35.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:35.329+0000 7f1a3d982700 1 -- 172.21.15.172:0/3447814131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a38102900 msgr2=0x7f1a381a11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:07:35.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:35.329+0000 7f1a3d982700 1 --2- 172.21.15.172:0/3447814131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a38102900 0x7f1a381a11e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1a300062a0 tx=0x7f1a3000cf70 comp rx=0 tx=0).stop 2024-03-30T15:07:35.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:35.329+0000 7f1a3d982700 1 -- 172.21.15.172:0/3447814131 shutdown_connections 2024-03-30T15:07:35.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:35.329+0000 7f1a3d982700 1 --2- 172.21.15.172:0/3447814131 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f1a2006db50 0x7f1a20070010 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:35.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:35.329+0000 7f1a3d982700 1 --2- 172.21.15.172:0/3447814131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a38102900 0x7f1a381a11e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:35.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:35.329+0000 7f1a3d982700 1 --2- 172.21.15.172:0/3447814131 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a38100400 0x7f1a38199cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:35.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:35.329+0000 7f1a3d982700 1 --2- 172.21.15.172:0/3447814131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a38100dc0 0x7f1a3819a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:35.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:35.329+0000 7f1a3d982700 1 -- 172.21.15.172:0/3447814131 >> 172.21.15.172:0/3447814131 conn(0x7f1a380fbfa0 msgr2=0x7f1a380fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:07:35.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:35.329+0000 7f1a3d982700 1 -- 172.21.15.172:0/3447814131 shutdown_connections 2024-03-30T15:07:35.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:35.333+0000 7f1a3d982700 1 -- 172.21.15.172:0/3447814131 wait complete. 2024-03-30T15:07:35.334 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'datapool' created 2024-03-30T15:07:35.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:35 smithi072 bash[21573]: cluster 2024-03-30T15:07:33.759268+0000 mgr.y (mgr.14152) 347 : cluster 0 pgmap v331: 65 pgs: 11 creating+peering, 42 unknown, 12 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 511 B/s wr, 1 op/s 2024-03-30T15:07:35.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:35 smithi072 bash[21573]: audit 2024-03-30T15:07:34.315419+0000 mon.a (mon.0) 689 : audit 1 from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-03-30T15:07:35.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:35 smithi072 bash[21573]: cluster 2024-03-30T15:07:34.325462+0000 mon.a (mon.0) 690 : cluster 0 osdmap e62: 8 total, 8 up, 8 in 2024-03-30T15:07:35.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:35 smithi072 bash[21573]: audit 2024-03-30T15:07:34.525936+0000 mon.b (mon.1) 26 : audit 1 from='client.? 172.21.15.172:0/3447814131' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-03-30T15:07:35.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:35 smithi072 bash[21573]: audit 2024-03-30T15:07:34.796368+0000 mon.a (mon.0) 691 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-03-30T15:07:35.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:35 smithi072 bash[21573]: audit 2024-03-30T15:07:35.215360+0000 mon.a (mon.0) 692 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:35.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:35 smithi072 bash[21573]: audit 2024-03-30T15:07:35.223306+0000 mon.a (mon.0) 693 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:35.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:35 smithi072 bash[21573]: audit 2024-03-30T15:07:35.224618+0000 mon.a (mon.0) 694 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:07:35.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:35 smithi072 bash[21573]: audit 2024-03-30T15:07:35.225797+0000 mon.a (mon.0) 695 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:07:35.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:35 smithi072 bash[28946]: cluster 2024-03-30T15:07:33.759268+0000 mgr.y (mgr.14152) 347 : cluster 0 pgmap v331: 65 pgs: 11 creating+peering, 42 unknown, 12 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 511 B/s wr, 1 op/s 2024-03-30T15:07:35.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:35 smithi072 bash[28946]: audit 2024-03-30T15:07:34.315419+0000 mon.a (mon.0) 689 : audit 1 from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-03-30T15:07:35.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:35 smithi072 bash[28946]: cluster 2024-03-30T15:07:34.325462+0000 mon.a (mon.0) 690 : cluster 0 osdmap e62: 8 total, 8 up, 8 in 2024-03-30T15:07:35.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:35 smithi072 bash[28946]: audit 2024-03-30T15:07:34.525936+0000 mon.b (mon.1) 26 : audit 1 from='client.? 172.21.15.172:0/3447814131' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-03-30T15:07:35.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:35 smithi072 bash[28946]: audit 2024-03-30T15:07:34.796368+0000 mon.a (mon.0) 691 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-03-30T15:07:35.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:35 smithi072 bash[28946]: audit 2024-03-30T15:07:35.215360+0000 mon.a (mon.0) 692 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:35.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:35 smithi072 bash[28946]: audit 2024-03-30T15:07:35.223306+0000 mon.a (mon.0) 693 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:35.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:35 smithi072 bash[28946]: audit 2024-03-30T15:07:35.224618+0000 mon.a (mon.0) 694 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:07:35.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:35 smithi072 bash[28946]: audit 2024-03-30T15:07:35.225797+0000 mon.a (mon.0) 695 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:07:35.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:35 smithi172 bash[23680]: cluster 2024-03-30T15:07:33.759268+0000 mgr.y (mgr.14152) 347 : cluster 0 pgmap v331: 65 pgs: 11 creating+peering, 42 unknown, 12 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 511 B/s wr, 1 op/s 2024-03-30T15:07:35.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:35 smithi172 bash[23680]: audit 2024-03-30T15:07:34.315419+0000 mon.a (mon.0) 689 : audit 1 from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-03-30T15:07:35.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:35 smithi172 bash[23680]: cluster 2024-03-30T15:07:34.325462+0000 mon.a (mon.0) 690 : cluster 0 osdmap e62: 8 total, 8 up, 8 in 2024-03-30T15:07:35.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:35 smithi172 bash[23680]: audit 2024-03-30T15:07:34.525936+0000 mon.b (mon.1) 26 : audit 1 from='client.? 172.21.15.172:0/3447814131' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-03-30T15:07:35.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:35 smithi172 bash[23680]: audit 2024-03-30T15:07:34.796368+0000 mon.a (mon.0) 691 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-03-30T15:07:35.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:35 smithi172 bash[23680]: audit 2024-03-30T15:07:35.215360+0000 mon.a (mon.0) 692 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:35.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:35 smithi172 bash[23680]: audit 2024-03-30T15:07:35.223306+0000 mon.a (mon.0) 693 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:35.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:35 smithi172 bash[23680]: audit 2024-03-30T15:07:35.224618+0000 mon.a (mon.0) 694 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:07:35.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:35 smithi172 bash[23680]: audit 2024-03-30T15:07:35.225797+0000 mon.a (mon.0) 695 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:07:36.152 DEBUG:teuthology.orchestra.run.smithi172:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- rbd pool init datapool 2024-03-30T15:07:36.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:36 smithi172 bash[23680]: cephadm 2024-03-30T15:07:35.230583+0000 mgr.y (mgr.14152) 348 : cephadm 1 Checking dashboard <-> RGW credentials 2024-03-30T15:07:36.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:36 smithi172 bash[23680]: audit 2024-03-30T15:07:35.317011+0000 mon.a (mon.0) 696 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-03-30T15:07:36.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:36 smithi172 bash[23680]: cluster 2024-03-30T15:07:35.320440+0000 mon.a (mon.0) 697 : cluster 0 osdmap e63: 8 total, 8 up, 8 in 2024-03-30T15:07:36.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:36 smithi172 bash[23680]: audit 2024-03-30T15:07:35.325615+0000 mon.c (mon.2) 19 : audit 1 from='client.? 172.21.15.72:0/4040452553' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-03-30T15:07:36.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:36 smithi172 bash[23680]: audit 2024-03-30T15:07:35.330384+0000 mon.a (mon.0) 698 : audit 1 from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-03-30T15:07:36.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:36 smithi172 bash[23680]: audit 2024-03-30T15:07:36.319754+0000 mon.a (mon.0) 699 : audit 1 from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-03-30T15:07:36.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:36 smithi172 bash[23680]: cluster 2024-03-30T15:07:36.327625+0000 mon.a (mon.0) 700 : cluster 0 osdmap e64: 8 total, 8 up, 8 in 2024-03-30T15:07:36.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:36 smithi072 bash[21573]: cephadm 2024-03-30T15:07:35.230583+0000 mgr.y (mgr.14152) 348 : cephadm 1 Checking dashboard <-> RGW credentials 2024-03-30T15:07:36.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:36 smithi072 bash[21573]: audit 2024-03-30T15:07:35.317011+0000 mon.a (mon.0) 696 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-03-30T15:07:36.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:36 smithi072 bash[21573]: cluster 2024-03-30T15:07:35.320440+0000 mon.a (mon.0) 697 : cluster 0 osdmap e63: 8 total, 8 up, 8 in 2024-03-30T15:07:36.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:36 smithi072 bash[21573]: audit 2024-03-30T15:07:35.325615+0000 mon.c (mon.2) 19 : audit 1 from='client.? 172.21.15.72:0/4040452553' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-03-30T15:07:36.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:36 smithi072 bash[21573]: audit 2024-03-30T15:07:35.330384+0000 mon.a (mon.0) 698 : audit 1 from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-03-30T15:07:36.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:36 smithi072 bash[21573]: audit 2024-03-30T15:07:36.319754+0000 mon.a (mon.0) 699 : audit 1 from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-03-30T15:07:36.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:36 smithi072 bash[21573]: cluster 2024-03-30T15:07:36.327625+0000 mon.a (mon.0) 700 : cluster 0 osdmap e64: 8 total, 8 up, 8 in 2024-03-30T15:07:36.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:36 smithi072 bash[28946]: cephadm 2024-03-30T15:07:35.230583+0000 mgr.y (mgr.14152) 348 : cephadm 1 Checking dashboard <-> RGW credentials 2024-03-30T15:07:36.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:36 smithi072 bash[28946]: audit 2024-03-30T15:07:35.317011+0000 mon.a (mon.0) 696 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-03-30T15:07:36.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:36 smithi072 bash[28946]: cluster 2024-03-30T15:07:35.320440+0000 mon.a (mon.0) 697 : cluster 0 osdmap e63: 8 total, 8 up, 8 in 2024-03-30T15:07:36.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:36 smithi072 bash[28946]: audit 2024-03-30T15:07:35.325615+0000 mon.c (mon.2) 19 : audit 1 from='client.? 172.21.15.72:0/4040452553' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-03-30T15:07:36.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:36 smithi072 bash[28946]: audit 2024-03-30T15:07:35.330384+0000 mon.a (mon.0) 698 : audit 1 from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-03-30T15:07:36.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:36 smithi072 bash[28946]: audit 2024-03-30T15:07:36.319754+0000 mon.a (mon.0) 699 : audit 1 from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-03-30T15:07:36.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:36 smithi072 bash[28946]: cluster 2024-03-30T15:07:36.327625+0000 mon.a (mon.0) 700 : cluster 0 osdmap e64: 8 total, 8 up, 8 in 2024-03-30T15:07:37.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:37 smithi072 bash[21573]: cluster 2024-03-30T15:07:35.760377+0000 mgr.y (mgr.14152) 349 : cluster 0 pgmap v334: 100 pgs: 16 creating+peering, 45 unknown, 39 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-03-30T15:07:37.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:37 smithi072 bash[21573]: cluster 2024-03-30T15:07:37.344911+0000 mon.a (mon.0) 701 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:07:37.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:37 smithi072 bash[28946]: cluster 2024-03-30T15:07:35.760377+0000 mgr.y (mgr.14152) 349 : cluster 0 pgmap v334: 100 pgs: 16 creating+peering, 45 unknown, 39 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-03-30T15:07:37.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:37 smithi072 bash[28946]: cluster 2024-03-30T15:07:37.344911+0000 mon.a (mon.0) 701 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:07:37.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:37 smithi172 bash[23680]: cluster 2024-03-30T15:07:35.760377+0000 mgr.y (mgr.14152) 349 : cluster 0 pgmap v334: 100 pgs: 16 creating+peering, 45 unknown, 39 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-03-30T15:07:37.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:37 smithi172 bash[23680]: cluster 2024-03-30T15:07:37.344911+0000 mon.a (mon.0) 701 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:07:38.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:38 smithi072 bash[21573]: cluster 2024-03-30T15:07:37.365660+0000 mon.a (mon.0) 702 : cluster 0 osdmap e65: 8 total, 8 up, 8 in 2024-03-30T15:07:38.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:38 smithi072 bash[21573]: audit 2024-03-30T15:07:37.368866+0000 mon.c (mon.2) 20 : audit 1 from='client.? 172.21.15.72:0/3439155674' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-03-30T15:07:38.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:38 smithi072 bash[21573]: audit 2024-03-30T15:07:37.369517+0000 mon.c (mon.2) 21 : audit 1 from='client.? 172.21.15.72:0/4040452553' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-03-30T15:07:38.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:38 smithi072 bash[21573]: audit 2024-03-30T15:07:37.370467+0000 mon.a (mon.0) 703 : audit 1 from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-03-30T15:07:38.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:38 smithi072 bash[21573]: audit 2024-03-30T15:07:37.370876+0000 mon.a (mon.0) 704 : audit 1 from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-03-30T15:07:38.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:38 smithi072 bash[21573]: audit 2024-03-30T15:07:38.351295+0000 mon.a (mon.0) 705 : audit 1 from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-03-30T15:07:38.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:38 smithi072 bash[21573]: audit 2024-03-30T15:07:38.351535+0000 mon.a (mon.0) 706 : audit 1 from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-03-30T15:07:38.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:38 smithi072 bash[21573]: cluster 2024-03-30T15:07:38.359830+0000 mon.a (mon.0) 707 : cluster 0 osdmap e66: 8 total, 8 up, 8 in 2024-03-30T15:07:38.670 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:38 smithi072 bash[21573]: audit 2024-03-30T15:07:38.364570+0000 mon.c (mon.2) 22 : audit 1 from='client.? 172.21.15.72:0/3439155674' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-03-30T15:07:38.670 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:38 smithi072 bash[21573]: audit 2024-03-30T15:07:38.365333+0000 mon.c (mon.2) 23 : audit 1 from='client.? 172.21.15.72:0/4040452553' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-03-30T15:07:38.670 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:38 smithi072 bash[21573]: audit 2024-03-30T15:07:38.366120+0000 mon.a (mon.0) 708 : audit 1 from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-03-30T15:07:38.670 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:38 smithi072 bash[21573]: audit 2024-03-30T15:07:38.367000+0000 mon.a (mon.0) 709 : audit 1 from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-03-30T15:07:38.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:38 smithi072 bash[28946]: cluster 2024-03-30T15:07:37.365660+0000 mon.a (mon.0) 702 : cluster 0 osdmap e65: 8 total, 8 up, 8 in 2024-03-30T15:07:38.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:38 smithi072 bash[28946]: audit 2024-03-30T15:07:37.368866+0000 mon.c (mon.2) 20 : audit 1 from='client.? 172.21.15.72:0/3439155674' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-03-30T15:07:38.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:38 smithi072 bash[28946]: audit 2024-03-30T15:07:37.369517+0000 mon.c (mon.2) 21 : audit 1 from='client.? 172.21.15.72:0/4040452553' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-03-30T15:07:38.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:38 smithi072 bash[28946]: audit 2024-03-30T15:07:37.370467+0000 mon.a (mon.0) 703 : audit 1 from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-03-30T15:07:38.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:38 smithi072 bash[28946]: audit 2024-03-30T15:07:37.370876+0000 mon.a (mon.0) 704 : audit 1 from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-03-30T15:07:38.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:38 smithi072 bash[28946]: audit 2024-03-30T15:07:38.351295+0000 mon.a (mon.0) 705 : audit 1 from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-03-30T15:07:38.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:38 smithi072 bash[28946]: audit 2024-03-30T15:07:38.351535+0000 mon.a (mon.0) 706 : audit 1 from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-03-30T15:07:38.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:38 smithi072 bash[28946]: cluster 2024-03-30T15:07:38.359830+0000 mon.a (mon.0) 707 : cluster 0 osdmap e66: 8 total, 8 up, 8 in 2024-03-30T15:07:38.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:38 smithi072 bash[28946]: audit 2024-03-30T15:07:38.364570+0000 mon.c (mon.2) 22 : audit 1 from='client.? 172.21.15.72:0/3439155674' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-03-30T15:07:38.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:38 smithi072 bash[28946]: audit 2024-03-30T15:07:38.365333+0000 mon.c (mon.2) 23 : audit 1 from='client.? 172.21.15.72:0/4040452553' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-03-30T15:07:38.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:38 smithi072 bash[28946]: audit 2024-03-30T15:07:38.366120+0000 mon.a (mon.0) 708 : audit 1 from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-03-30T15:07:38.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:38 smithi072 bash[28946]: audit 2024-03-30T15:07:38.367000+0000 mon.a (mon.0) 709 : audit 1 from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-03-30T15:07:38.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:38 smithi172 bash[23680]: cluster 2024-03-30T15:07:37.365660+0000 mon.a (mon.0) 702 : cluster 0 osdmap e65: 8 total, 8 up, 8 in 2024-03-30T15:07:38.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:38 smithi172 bash[23680]: audit 2024-03-30T15:07:37.368866+0000 mon.c (mon.2) 20 : audit 1 from='client.? 172.21.15.72:0/3439155674' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-03-30T15:07:38.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:38 smithi172 bash[23680]: audit 2024-03-30T15:07:37.369517+0000 mon.c (mon.2) 21 : audit 1 from='client.? 172.21.15.72:0/4040452553' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-03-30T15:07:38.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:38 smithi172 bash[23680]: audit 2024-03-30T15:07:37.370467+0000 mon.a (mon.0) 703 : audit 1 from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-03-30T15:07:38.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:38 smithi172 bash[23680]: audit 2024-03-30T15:07:37.370876+0000 mon.a (mon.0) 704 : audit 1 from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-03-30T15:07:38.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:38 smithi172 bash[23680]: audit 2024-03-30T15:07:38.351295+0000 mon.a (mon.0) 705 : audit 1 from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-03-30T15:07:38.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:38 smithi172 bash[23680]: audit 2024-03-30T15:07:38.351535+0000 mon.a (mon.0) 706 : audit 1 from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-03-30T15:07:38.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:38 smithi172 bash[23680]: cluster 2024-03-30T15:07:38.359830+0000 mon.a (mon.0) 707 : cluster 0 osdmap e66: 8 total, 8 up, 8 in 2024-03-30T15:07:38.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:38 smithi172 bash[23680]: audit 2024-03-30T15:07:38.364570+0000 mon.c (mon.2) 22 : audit 1 from='client.? 172.21.15.72:0/3439155674' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-03-30T15:07:38.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:38 smithi172 bash[23680]: audit 2024-03-30T15:07:38.365333+0000 mon.c (mon.2) 23 : audit 1 from='client.? 172.21.15.72:0/4040452553' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-03-30T15:07:38.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:38 smithi172 bash[23680]: audit 2024-03-30T15:07:38.366120+0000 mon.a (mon.0) 708 : audit 1 from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-03-30T15:07:38.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:38 smithi172 bash[23680]: audit 2024-03-30T15:07:38.367000+0000 mon.a (mon.0) 709 : audit 1 from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-03-30T15:07:39.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:39 smithi072 bash[21573]: cluster 2024-03-30T15:07:37.761333+0000 mgr.y (mgr.14152) 350 : cluster 0 pgmap v337: 132 pgs: 8 creating+peering, 54 unknown, 70 active+clean; 578 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1023 B/s wr, 4 op/s 2024-03-30T15:07:39.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:39 smithi072 bash[21573]: audit 2024-03-30T15:07:39.353772+0000 mon.a (mon.0) 710 : audit 1 from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-03-30T15:07:39.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:39 smithi072 bash[21573]: audit 2024-03-30T15:07:39.353961+0000 mon.a (mon.0) 711 : audit 1 from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-03-30T15:07:39.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:39 smithi072 bash[21573]: cluster 2024-03-30T15:07:39.362611+0000 mon.a (mon.0) 712 : cluster 0 osdmap e67: 8 total, 8 up, 8 in 2024-03-30T15:07:39.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:39 smithi072 bash[28946]: cluster 2024-03-30T15:07:37.761333+0000 mgr.y (mgr.14152) 350 : cluster 0 pgmap v337: 132 pgs: 8 creating+peering, 54 unknown, 70 active+clean; 578 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1023 B/s wr, 4 op/s 2024-03-30T15:07:39.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:39 smithi072 bash[28946]: audit 2024-03-30T15:07:39.353772+0000 mon.a (mon.0) 710 : audit 1 from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-03-30T15:07:39.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:39 smithi072 bash[28946]: audit 2024-03-30T15:07:39.353961+0000 mon.a (mon.0) 711 : audit 1 from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-03-30T15:07:39.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:39 smithi072 bash[28946]: cluster 2024-03-30T15:07:39.362611+0000 mon.a (mon.0) 712 : cluster 0 osdmap e67: 8 total, 8 up, 8 in 2024-03-30T15:07:39.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:39 smithi172 bash[23680]: cluster 2024-03-30T15:07:37.761333+0000 mgr.y (mgr.14152) 350 : cluster 0 pgmap v337: 132 pgs: 8 creating+peering, 54 unknown, 70 active+clean; 578 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1023 B/s wr, 4 op/s 2024-03-30T15:07:39.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:39 smithi172 bash[23680]: audit 2024-03-30T15:07:39.353772+0000 mon.a (mon.0) 710 : audit 1 from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-03-30T15:07:39.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:39 smithi172 bash[23680]: audit 2024-03-30T15:07:39.353961+0000 mon.a (mon.0) 711 : audit 1 from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-03-30T15:07:39.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:39 smithi172 bash[23680]: cluster 2024-03-30T15:07:39.362611+0000 mon.a (mon.0) 712 : cluster 0 osdmap e67: 8 total, 8 up, 8 in 2024-03-30T15:07:40.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:40 smithi072 bash[21573]: audit 2024-03-30T15:07:39.650720+0000 mon.a (mon.0) 713 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:40.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:40 smithi072 bash[21573]: audit 2024-03-30T15:07:39.656360+0000 mon.a (mon.0) 714 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:40.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:40 smithi072 bash[21573]: audit 2024-03-30T15:07:39.666926+0000 mon.a (mon.0) 715 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:40.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:40 smithi072 bash[21573]: audit 2024-03-30T15:07:39.753811+0000 mon.a (mon.0) 716 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:07:40.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:40 smithi072 bash[21573]: audit 2024-03-30T15:07:39.755982+0000 mon.a (mon.0) 717 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:07:40.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:40 smithi072 bash[21573]: audit 2024-03-30T15:07:39.756938+0000 mon.a (mon.0) 718 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:07:40.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:40 smithi072 bash[21573]: audit 2024-03-30T15:07:40.055680+0000 mon.a (mon.0) 719 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:40.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:40 smithi072 bash[28946]: audit 2024-03-30T15:07:39.650720+0000 mon.a (mon.0) 713 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:40.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:40 smithi072 bash[28946]: audit 2024-03-30T15:07:39.656360+0000 mon.a (mon.0) 714 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:40.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:40 smithi072 bash[28946]: audit 2024-03-30T15:07:39.666926+0000 mon.a (mon.0) 715 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:40.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:40 smithi072 bash[28946]: audit 2024-03-30T15:07:39.753811+0000 mon.a (mon.0) 716 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:07:40.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:40 smithi072 bash[28946]: audit 2024-03-30T15:07:39.755982+0000 mon.a (mon.0) 717 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:07:40.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:40 smithi072 bash[28946]: audit 2024-03-30T15:07:39.756938+0000 mon.a (mon.0) 718 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:07:40.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:40 smithi072 bash[28946]: audit 2024-03-30T15:07:40.055680+0000 mon.a (mon.0) 719 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:40.922 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.b/config 2024-03-30T15:07:40.944 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:40 smithi172 bash[23680]: audit 2024-03-30T15:07:39.650720+0000 mon.a (mon.0) 713 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:40.944 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:40 smithi172 bash[23680]: audit 2024-03-30T15:07:39.656360+0000 mon.a (mon.0) 714 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:40.944 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:40 smithi172 bash[23680]: audit 2024-03-30T15:07:39.666926+0000 mon.a (mon.0) 715 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:40.944 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:40 smithi172 bash[23680]: audit 2024-03-30T15:07:39.753811+0000 mon.a (mon.0) 716 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:07:40.944 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:40 smithi172 bash[23680]: audit 2024-03-30T15:07:39.755982+0000 mon.a (mon.0) 717 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:07:40.944 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:40 smithi172 bash[23680]: audit 2024-03-30T15:07:39.756938+0000 mon.a (mon.0) 718 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:07:40.944 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:40 smithi172 bash[23680]: audit 2024-03-30T15:07:40.055680+0000 mon.a (mon.0) 719 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:41.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:41 smithi072 bash[21573]: cluster 2024-03-30T15:07:39.762286+0000 mgr.y (mgr.14152) 351 : cluster 0 pgmap v340: 132 pgs: 15 creating+peering, 26 unknown, 91 active+clean; 578 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1023 B/s wr, 6 op/s 2024-03-30T15:07:41.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:41 smithi072 bash[21573]: cephadm 2024-03-30T15:07:39.762465+0000 mgr.y (mgr.14152) 352 : cephadm 1 Checking dashboard <-> RGW credentials 2024-03-30T15:07:41.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:41 smithi072 bash[28946]: cluster 2024-03-30T15:07:39.762286+0000 mgr.y (mgr.14152) 351 : cluster 0 pgmap v340: 132 pgs: 15 creating+peering, 26 unknown, 91 active+clean; 578 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1023 B/s wr, 6 op/s 2024-03-30T15:07:41.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:41 smithi072 bash[28946]: cephadm 2024-03-30T15:07:39.762465+0000 mgr.y (mgr.14152) 352 : cephadm 1 Checking dashboard <-> RGW credentials 2024-03-30T15:07:41.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:41 smithi172 bash[23680]: cluster 2024-03-30T15:07:39.762286+0000 mgr.y (mgr.14152) 351 : cluster 0 pgmap v340: 132 pgs: 15 creating+peering, 26 unknown, 91 active+clean; 578 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1023 B/s wr, 6 op/s 2024-03-30T15:07:41.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:41 smithi172 bash[23680]: cephadm 2024-03-30T15:07:39.762465+0000 mgr.y (mgr.14152) 352 : cephadm 1 Checking dashboard <-> RGW credentials 2024-03-30T15:07:42.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:42 smithi172 bash[23680]: cluster 2024-03-30T15:07:42.345745+0000 mon.a (mon.0) 720 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:07:43.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:42 smithi072 bash[21573]: cluster 2024-03-30T15:07:42.345745+0000 mon.a (mon.0) 720 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:07:43.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:42 smithi072 bash[28946]: cluster 2024-03-30T15:07:42.345745+0000 mon.a (mon.0) 720 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:07:43.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:43 smithi172 bash[23680]: cluster 2024-03-30T15:07:41.763661+0000 mgr.y (mgr.14152) 353 : cluster 0 pgmap v341: 132 pgs: 10 creating+peering, 6 unknown, 116 active+clean; 579 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 28 KiB/s rd, 2.4 KiB/s wr, 67 op/s 2024-03-30T15:07:44.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:43 smithi072 bash[21573]: cluster 2024-03-30T15:07:41.763661+0000 mgr.y (mgr.14152) 353 : cluster 0 pgmap v341: 132 pgs: 10 creating+peering, 6 unknown, 116 active+clean; 579 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 28 KiB/s rd, 2.4 KiB/s wr, 67 op/s 2024-03-30T15:07:44.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:43 smithi072 bash[28946]: cluster 2024-03-30T15:07:41.763661+0000 mgr.y (mgr.14152) 353 : cluster 0 pgmap v341: 132 pgs: 10 creating+peering, 6 unknown, 116 active+clean; 579 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 28 KiB/s rd, 2.4 KiB/s wr, 67 op/s 2024-03-30T15:07:44.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:44 smithi172 bash[23680]: audit 2024-03-30T15:07:43.814557+0000 mon.a (mon.0) 721 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-03-30T15:07:44.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:44 smithi172 bash[23680]: audit 2024-03-30T15:07:43.815225+0000 mon.b (mon.1) 27 : audit 1 from='client.? 172.21.15.172:0/1931539628' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-03-30T15:07:45.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:44 smithi072 bash[21573]: audit 2024-03-30T15:07:43.814557+0000 mon.a (mon.0) 721 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-03-30T15:07:45.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:44 smithi072 bash[21573]: audit 2024-03-30T15:07:43.815225+0000 mon.b (mon.1) 27 : audit 1 from='client.? 172.21.15.172:0/1931539628' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-03-30T15:07:45.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:44 smithi072 bash[28946]: audit 2024-03-30T15:07:43.814557+0000 mon.a (mon.0) 721 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-03-30T15:07:45.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:44 smithi072 bash[28946]: audit 2024-03-30T15:07:43.815225+0000 mon.b (mon.1) 27 : audit 1 from='client.? 172.21.15.172:0/1931539628' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-03-30T15:07:45.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:45 smithi172 bash[23680]: cluster 2024-03-30T15:07:43.765192+0000 mgr.y (mgr.14152) 354 : cluster 0 pgmap v342: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s rd, 5.1 KiB/s wr, 151 op/s 2024-03-30T15:07:45.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:45 smithi172 bash[23680]: audit 2024-03-30T15:07:44.688414+0000 mon.a (mon.0) 722 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2024-03-30T15:07:45.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:45 smithi172 bash[23680]: cluster 2024-03-30T15:07:44.696007+0000 mon.a (mon.0) 723 : cluster 0 osdmap e68: 8 total, 8 up, 8 in 2024-03-30T15:07:46.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:45 smithi072 bash[21573]: cluster 2024-03-30T15:07:43.765192+0000 mgr.y (mgr.14152) 354 : cluster 0 pgmap v342: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s rd, 5.1 KiB/s wr, 151 op/s 2024-03-30T15:07:46.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:45 smithi072 bash[21573]: audit 2024-03-30T15:07:44.688414+0000 mon.a (mon.0) 722 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2024-03-30T15:07:46.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:45 smithi072 bash[21573]: cluster 2024-03-30T15:07:44.696007+0000 mon.a (mon.0) 723 : cluster 0 osdmap e68: 8 total, 8 up, 8 in 2024-03-30T15:07:46.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:45 smithi072 bash[28946]: cluster 2024-03-30T15:07:43.765192+0000 mgr.y (mgr.14152) 354 : cluster 0 pgmap v342: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s rd, 5.1 KiB/s wr, 151 op/s 2024-03-30T15:07:46.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:45 smithi072 bash[28946]: audit 2024-03-30T15:07:44.688414+0000 mon.a (mon.0) 722 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2024-03-30T15:07:46.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:45 smithi072 bash[28946]: cluster 2024-03-30T15:07:44.696007+0000 mon.a (mon.0) 723 : cluster 0 osdmap e68: 8 total, 8 up, 8 in 2024-03-30T15:07:46.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:46 smithi172 bash[23680]: cluster 2024-03-30T15:07:45.700864+0000 mon.a (mon.0) 724 : cluster 0 osdmap e69: 8 total, 8 up, 8 in 2024-03-30T15:07:46.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:46 smithi172 bash[23680]: cluster 2024-03-30T15:07:45.765901+0000 mgr.y (mgr.14152) 355 : cluster 0 pgmap v345: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 75 KiB/s rd, 5.5 KiB/s wr, 177 op/s 2024-03-30T15:07:47.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:46 smithi072 bash[21573]: cluster 2024-03-30T15:07:45.700864+0000 mon.a (mon.0) 724 : cluster 0 osdmap e69: 8 total, 8 up, 8 in 2024-03-30T15:07:47.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:46 smithi072 bash[21573]: cluster 2024-03-30T15:07:45.765901+0000 mgr.y (mgr.14152) 355 : cluster 0 pgmap v345: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 75 KiB/s rd, 5.5 KiB/s wr, 177 op/s 2024-03-30T15:07:47.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:46 smithi072 bash[28946]: cluster 2024-03-30T15:07:45.700864+0000 mon.a (mon.0) 724 : cluster 0 osdmap e69: 8 total, 8 up, 8 in 2024-03-30T15:07:47.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:46 smithi072 bash[28946]: cluster 2024-03-30T15:07:45.765901+0000 mgr.y (mgr.14152) 355 : cluster 0 pgmap v345: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 75 KiB/s rd, 5.5 KiB/s wr, 177 op/s 2024-03-30T15:07:47.467 DEBUG:teuthology.orchestra.run.smithi172:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph orch apply iscsi datapool admin admin --trusted_ip_list 172.21.15.172 --placement '1;smithi172=iscsi.a' 2024-03-30T15:07:47.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:47 smithi172 bash[23680]: cluster 2024-03-30T15:07:46.703686+0000 mon.a (mon.0) 725 : cluster 1 Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-03-30T15:07:47.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:47 smithi172 bash[23680]: cluster 2024-03-30T15:07:46.703760+0000 mon.a (mon.0) 726 : cluster 1 Cluster is now healthy 2024-03-30T15:07:47.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:47 smithi172 bash[23680]: cluster 2024-03-30T15:07:46.722598+0000 mon.a (mon.0) 727 : cluster 0 osdmap e70: 8 total, 8 up, 8 in 2024-03-30T15:07:48.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:47 smithi072 bash[21573]: cluster 2024-03-30T15:07:46.703686+0000 mon.a (mon.0) 725 : cluster 1 Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-03-30T15:07:48.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:47 smithi072 bash[21573]: cluster 2024-03-30T15:07:46.703760+0000 mon.a (mon.0) 726 : cluster 1 Cluster is now healthy 2024-03-30T15:07:48.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:47 smithi072 bash[21573]: cluster 2024-03-30T15:07:46.722598+0000 mon.a (mon.0) 727 : cluster 0 osdmap e70: 8 total, 8 up, 8 in 2024-03-30T15:07:48.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:47 smithi072 bash[28946]: cluster 2024-03-30T15:07:46.703686+0000 mon.a (mon.0) 725 : cluster 1 Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-03-30T15:07:48.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:47 smithi072 bash[28946]: cluster 2024-03-30T15:07:46.703760+0000 mon.a (mon.0) 726 : cluster 1 Cluster is now healthy 2024-03-30T15:07:48.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:47 smithi072 bash[28946]: cluster 2024-03-30T15:07:46.722598+0000 mon.a (mon.0) 727 : cluster 0 osdmap e70: 8 total, 8 up, 8 in 2024-03-30T15:07:49.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:48 smithi072 bash[21573]: cluster 2024-03-30T15:07:47.766982+0000 mgr.y (mgr.14152) 356 : cluster 0 pgmap v347: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 56 KiB/s rd, 4.3 KiB/s wr, 131 op/s 2024-03-30T15:07:49.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:48 smithi072 bash[28946]: cluster 2024-03-30T15:07:47.766982+0000 mgr.y (mgr.14152) 356 : cluster 0 pgmap v347: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 56 KiB/s rd, 4.3 KiB/s wr, 131 op/s 2024-03-30T15:07:49.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:48 smithi172 bash[23680]: cluster 2024-03-30T15:07:47.766982+0000 mgr.y (mgr.14152) 356 : cluster 0 pgmap v347: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 56 KiB/s rd, 4.3 KiB/s wr, 131 op/s 2024-03-30T15:07:51.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:50 smithi072 bash[21573]: cluster 2024-03-30T15:07:49.768023+0000 mgr.y (mgr.14152) 357 : cluster 0 pgmap v348: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 12 KiB/s rd, 852 B/s wr, 29 op/s 2024-03-30T15:07:51.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:50 smithi072 bash[28946]: cluster 2024-03-30T15:07:49.768023+0000 mgr.y (mgr.14152) 357 : cluster 0 pgmap v348: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 12 KiB/s rd, 852 B/s wr, 29 op/s 2024-03-30T15:07:51.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:50 smithi172 bash[23680]: cluster 2024-03-30T15:07:49.768023+0000 mgr.y (mgr.14152) 357 : cluster 0 pgmap v348: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 12 KiB/s rd, 852 B/s wr, 29 op/s 2024-03-30T15:07:52.223 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.b/config 2024-03-30T15:07:53.461 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:53 smithi172 bash[23680]: cluster 2024-03-30T15:07:51.768988+0000 mgr.y (mgr.14152) 358 : cluster 0 pgmap v349: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 868 B/s rd, 289 B/s wr, 2 op/s 2024-03-30T15:07:53.461 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:53 smithi172 bash[23680]: cluster 2024-03-30T15:07:52.357522+0000 mon.a (mon.0) 728 : cluster 0 osdmap e71: 8 total, 8 up, 8 in 2024-03-30T15:07:53.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:53 smithi072 bash[21573]: cluster 2024-03-30T15:07:51.768988+0000 mgr.y (mgr.14152) 358 : cluster 0 pgmap v349: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 868 B/s rd, 289 B/s wr, 2 op/s 2024-03-30T15:07:53.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:53 smithi072 bash[21573]: cluster 2024-03-30T15:07:52.357522+0000 mon.a (mon.0) 728 : cluster 0 osdmap e71: 8 total, 8 up, 8 in 2024-03-30T15:07:53.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:53 smithi072 bash[28946]: cluster 2024-03-30T15:07:51.768988+0000 mgr.y (mgr.14152) 358 : cluster 0 pgmap v349: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 868 B/s rd, 289 B/s wr, 2 op/s 2024-03-30T15:07:53.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:53 smithi072 bash[28946]: cluster 2024-03-30T15:07:52.357522+0000 mon.a (mon.0) 728 : cluster 0 osdmap e71: 8 total, 8 up, 8 in 2024-03-30T15:07:54.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:54.933+0000 7f698c1a0700 1 -- 172.21.15.172:0/2246762948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6984103e70 msgr2=0x7f698410a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:07:54.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:54.933+0000 7f698c1a0700 1 --2- 172.21.15.172:0/2246762948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6984103e70 0x7f698410a720 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f697c0099c0 tx=0x7f697c009cd0 comp rx=0 tx=0).stop 2024-03-30T15:07:54.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:54.933+0000 7f698c1a0700 1 -- 172.21.15.172:0/2246762948 shutdown_connections 2024-03-30T15:07:54.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:54.933+0000 7f698c1a0700 1 --2- 172.21.15.172:0/2246762948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6984103e70 0x7f698410a720 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:54.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:54.933+0000 7f698c1a0700 1 --2- 172.21.15.172:0/2246762948 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69841022d0 0x7f69841026f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:54.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:54.933+0000 7f698c1a0700 1 --2- 172.21.15.172:0/2246762948 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f69841034d0 0x7f6984103930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:54.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:54.933+0000 7f698c1a0700 1 -- 172.21.15.172:0/2246762948 >> 172.21.15.172:0/2246762948 conn(0x7f69840fd870 msgr2=0x7f69840ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:07:54.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:54.933+0000 7f698c1a0700 1 -- 172.21.15.172:0/2246762948 shutdown_connections 2024-03-30T15:07:54.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:54.933+0000 7f698c1a0700 1 -- 172.21.15.172:0/2246762948 wait complete. 2024-03-30T15:07:54.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:54.933+0000 7f698c1a0700 1 Processor -- start 2024-03-30T15:07:54.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:54.933+0000 7f698c1a0700 1 -- start start 2024-03-30T15:07:54.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:54.933+0000 7f698c1a0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f69841022d0 0x7f69841979a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:07:54.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:54.933+0000 7f698c1a0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69841034d0 0x7f6984197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:07:54.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:54.933+0000 7f698c1a0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6984103e70 0x7f698419ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:07:54.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:54.933+0000 7f698c1a0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f698410d3c0 con 0x7f6984103e70 2024-03-30T15:07:54.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:54.933+0000 7f698c1a0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f698410d240 con 0x7f69841034d0 2024-03-30T15:07:54.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:54.933+0000 7f698c1a0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f698410d540 con 0x7f69841022d0 2024-03-30T15:07:54.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:54.933+0000 7f698973b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69841034d0 0x7f6984197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:07:54.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:54.933+0000 7f698973b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69841034d0 0x7f6984197ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:52552/0 (socket says 172.21.15.172:52552) 2024-03-30T15:07:54.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:54.933+0000 7f698973b700 1 -- 172.21.15.172:0/1472681480 learned_addr learned my addr 172.21.15.172:0/1472681480 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-03-30T15:07:54.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:54.933+0000 7f6989f3c700 1 --2- 172.21.15.172:0/1472681480 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f69841022d0 0x7f69841979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:07:54.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:54.933+0000 7f698a73d700 1 --2- 172.21.15.172:0/1472681480 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6984103e70 0x7f698419ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:07:54.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:54.933+0000 7f698973b700 1 -- 172.21.15.172:0/1472681480 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f69841022d0 msgr2=0x7f69841979a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:07:54.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:54.933+0000 7f698973b700 1 --2- 172.21.15.172:0/1472681480 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f69841022d0 0x7f69841979a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:54.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:54.933+0000 7f698973b700 1 -- 172.21.15.172:0/1472681480 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6984103e70 msgr2=0x7f698419ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:07:54.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:54.933+0000 7f698973b700 1 --2- 172.21.15.172:0/1472681480 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6984103e70 0x7f698419ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:54.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:54.933+0000 7f698973b700 1 -- 172.21.15.172:0/1472681480 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f698419f600 con 0x7f69841034d0 2024-03-30T15:07:54.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:54.933+0000 7f698a73d700 1 --2- 172.21.15.172:0/1472681480 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6984103e70 0x7f698419ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T15:07:54.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:54.933+0000 7f6989f3c700 1 --2- 172.21.15.172:0/1472681480 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f69841022d0 0x7f69841979a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T15:07:54.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:54.933+0000 7f698973b700 1 --2- 172.21.15.172:0/1472681480 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69841034d0 0x7f6984197ee0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f69780060b0 tx=0x7f6978007f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:07:54.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:54.933+0000 7f6982ffd700 1 -- 172.21.15.172:0/1472681480 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f697801a070 con 0x7f69841034d0 2024-03-30T15:07:54.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:54.933+0000 7f6982ffd700 1 -- 172.21.15.172:0/1472681480 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f697800de20 con 0x7f69841034d0 2024-03-30T15:07:54.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:54.933+0000 7f698c1a0700 1 -- 172.21.15.172:0/1472681480 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f698419f8f0 con 0x7f69841034d0 2024-03-30T15:07:54.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:54.933+0000 7f6982ffd700 1 -- 172.21.15.172:0/1472681480 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6978014600 con 0x7f69841034d0 2024-03-30T15:07:54.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:54.933+0000 7f698c1a0700 1 -- 172.21.15.172:0/1472681480 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f698419fe30 con 0x7f69841034d0 2024-03-30T15:07:54.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:54.937+0000 7f698c1a0700 1 -- 172.21.15.172:0/1472681480 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f698404ff00 con 0x7f69841034d0 2024-03-30T15:07:54.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:54.937+0000 7f6982ffd700 1 -- 172.21.15.172:0/1472681480 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 15) ==== 91774+0+0 (secure 0 0 0) 0x7f697801d070 con 0x7f69841034d0 2024-03-30T15:07:54.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:54.937+0000 7f6982ffd700 1 --2- 172.21.15.172:0/1472681480 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f696c06db50 0x7f696c070010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:07:54.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:54.937+0000 7f6982ffd700 1 -- 172.21.15.172:0/1472681480 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7148+0+0 (secure 0 0 0) 0x7f697808d630 con 0x7f69841034d0 2024-03-30T15:07:54.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:54.937+0000 7f6989f3c700 1 --2- 172.21.15.172:0/1472681480 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f696c06db50 0x7f696c070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:07:54.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:54.937+0000 7f6989f3c700 1 --2- 172.21.15.172:0/1472681480 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f696c06db50 0x7f696c070010 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6974005fd0 tx=0x7f6974005f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:07:54.938 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:54.941+0000 7f6982ffd700 1 -- 172.21.15.172:0/1472681480 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f6978010070 con 0x7f69841034d0 2024-03-30T15:07:55.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:55.161+0000 7f698c1a0700 1 -- 172.21.15.172:0/1472681480 --> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] -- mgr_command(tid 0: {"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.172", "placement": "1;smithi172=iscsi.a", "target": ["mon-mgr", ""]}) -- 0x7f6984062680 con 0x7f696c06db50 2024-03-30T15:07:55.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:55.177+0000 7f6982ffd700 1 -- 172.21.15.172:0/1472681480 <== mgr.14152 v2:172.21.15.72:6800/2777002311 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+35 (secure 0 0 0) 0x7f6984062680 con 0x7f696c06db50 2024-03-30T15:07:55.175 INFO:teuthology.orchestra.run.smithi172.stdout:Scheduled iscsi.datapool update... 2024-03-30T15:07:55.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:55.181+0000 7f698c1a0700 1 -- 172.21.15.172:0/1472681480 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f696c06db50 msgr2=0x7f696c070010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:07:55.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:55.181+0000 7f698c1a0700 1 --2- 172.21.15.172:0/1472681480 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f696c06db50 0x7f696c070010 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6974005fd0 tx=0x7f6974005f00 comp rx=0 tx=0).stop 2024-03-30T15:07:55.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:55.181+0000 7f698c1a0700 1 -- 172.21.15.172:0/1472681480 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69841034d0 msgr2=0x7f6984197ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:07:55.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:55.181+0000 7f698c1a0700 1 --2- 172.21.15.172:0/1472681480 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69841034d0 0x7f6984197ee0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f69780060b0 tx=0x7f6978007f90 comp rx=0 tx=0).stop 2024-03-30T15:07:55.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:55.181+0000 7f698c1a0700 1 -- 172.21.15.172:0/1472681480 shutdown_connections 2024-03-30T15:07:55.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:55.181+0000 7f698c1a0700 1 --2- 172.21.15.172:0/1472681480 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f696c06db50 0x7f696c070010 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:55.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:55.181+0000 7f698c1a0700 1 --2- 172.21.15.172:0/1472681480 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6984103e70 0x7f698419ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:55.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:55.181+0000 7f698c1a0700 1 --2- 172.21.15.172:0/1472681480 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f69841022d0 0x7f69841979a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:55.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:55.181+0000 7f698c1a0700 1 --2- 172.21.15.172:0/1472681480 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69841034d0 0x7f6984197ee0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:07:55.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:55.181+0000 7f698c1a0700 1 -- 172.21.15.172:0/1472681480 >> 172.21.15.172:0/1472681480 conn(0x7f69840fd870 msgr2=0x7f69841067f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:07:55.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:55.181+0000 7f698c1a0700 1 -- 172.21.15.172:0/1472681480 shutdown_connections 2024-03-30T15:07:55.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:07:55.181+0000 7f698c1a0700 1 -- 172.21.15.172:0/1472681480 wait complete. 2024-03-30T15:07:55.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:55 smithi172 bash[23680]: cluster 2024-03-30T15:07:53.770008+0000 mgr.y (mgr.14152) 359 : cluster 0 pgmap v351: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-03-30T15:07:55.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:55 smithi172 bash[23680]: audit 2024-03-30T15:07:55.177213+0000 mon.a (mon.0) 729 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:55.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:55 smithi172 bash[23680]: audit 2024-03-30T15:07:55.220566+0000 mon.a (mon.0) 730 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:07:55.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:55 smithi072 bash[21573]: cluster 2024-03-30T15:07:53.770008+0000 mgr.y (mgr.14152) 359 : cluster 0 pgmap v351: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-03-30T15:07:55.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:55 smithi072 bash[21573]: audit 2024-03-30T15:07:55.177213+0000 mon.a (mon.0) 729 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:55.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:55 smithi072 bash[21573]: audit 2024-03-30T15:07:55.220566+0000 mon.a (mon.0) 730 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:07:55.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:55 smithi072 bash[28946]: cluster 2024-03-30T15:07:53.770008+0000 mgr.y (mgr.14152) 359 : cluster 0 pgmap v351: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-03-30T15:07:55.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:55 smithi072 bash[28946]: audit 2024-03-30T15:07:55.177213+0000 mon.a (mon.0) 729 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:55.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:55 smithi072 bash[28946]: audit 2024-03-30T15:07:55.220566+0000 mon.a (mon.0) 730 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:07:55.964 INFO:tasks.cephadm:Distributing iscsi-gateway.cfg... 2024-03-30T15:07:55.964 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-30T15:07:55.964 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/ceph/iscsi-gateway.cfg 2024-03-30T15:07:55.979 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-03-30T15:07:55.979 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/iscsi-gateway.cfg 2024-03-30T15:07:55.993 DEBUG:teuthology.orchestra.run.smithi172:iscsi.iscsi.a> sudo journalctl -f -n 0 -u ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@iscsi.iscsi.a.service 2024-03-30T15:07:56.041 INFO:tasks.cephadm:Adding prometheus.a on smithi172 2024-03-30T15:07:56.042 DEBUG:teuthology.orchestra.run.smithi172:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph orch apply prometheus '1;smithi172=a' 2024-03-30T15:07:56.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:56 smithi072 bash[21573]: audit 2024-03-30T15:07:55.163031+0000 mgr.y (mgr.14152) 360 : audit 0 from='client.24376 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.172", "placement": "1;smithi172=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T15:07:56.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:56 smithi072 bash[21573]: cephadm 2024-03-30T15:07:55.169286+0000 mgr.y (mgr.14152) 361 : cephadm 1 Saving service iscsi.datapool spec with placement smithi172=iscsi.a;count:1 2024-03-30T15:07:56.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:56 smithi072 bash[21573]: audit 2024-03-30T15:07:55.847351+0000 mon.a (mon.0) 731 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:07:56.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:56 smithi072 bash[21573]: audit 2024-03-30T15:07:55.849089+0000 mon.a (mon.0) 732 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:07:56.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:56 smithi072 bash[21573]: audit 2024-03-30T15:07:55.858201+0000 mon.a (mon.0) 733 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:56.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:56 smithi072 bash[21573]: audit 2024-03-30T15:07:55.863678+0000 mon.a (mon.0) 734 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T15:07:56.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:56 smithi072 bash[21573]: audit 2024-03-30T15:07:55.867024+0000 mon.a (mon.0) 735 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-03-30T15:07:56.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:56 smithi072 bash[21573]: audit 2024-03-30T15:07:55.886437+0000 mon.a (mon.0) 736 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:07:56.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:56 smithi072 bash[28946]: audit 2024-03-30T15:07:55.163031+0000 mgr.y (mgr.14152) 360 : audit 0 from='client.24376 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.172", "placement": "1;smithi172=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T15:07:56.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:56 smithi072 bash[28946]: cephadm 2024-03-30T15:07:55.169286+0000 mgr.y (mgr.14152) 361 : cephadm 1 Saving service iscsi.datapool spec with placement smithi172=iscsi.a;count:1 2024-03-30T15:07:56.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:56 smithi072 bash[28946]: audit 2024-03-30T15:07:55.847351+0000 mon.a (mon.0) 731 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:07:56.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:56 smithi072 bash[28946]: audit 2024-03-30T15:07:55.849089+0000 mon.a (mon.0) 732 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:07:56.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:56 smithi072 bash[28946]: audit 2024-03-30T15:07:55.858201+0000 mon.a (mon.0) 733 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:56.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:56 smithi072 bash[28946]: audit 2024-03-30T15:07:55.863678+0000 mon.a (mon.0) 734 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T15:07:56.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:56 smithi072 bash[28946]: audit 2024-03-30T15:07:55.867024+0000 mon.a (mon.0) 735 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-03-30T15:07:56.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:56 smithi072 bash[28946]: audit 2024-03-30T15:07:55.886437+0000 mon.a (mon.0) 736 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:07:56.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:56 smithi172 bash[23680]: audit 2024-03-30T15:07:55.163031+0000 mgr.y (mgr.14152) 360 : audit 0 from='client.24376 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.172", "placement": "1;smithi172=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T15:07:56.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:56 smithi172 bash[23680]: cephadm 2024-03-30T15:07:55.169286+0000 mgr.y (mgr.14152) 361 : cephadm 1 Saving service iscsi.datapool spec with placement smithi172=iscsi.a;count:1 2024-03-30T15:07:56.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:56 smithi172 bash[23680]: audit 2024-03-30T15:07:55.847351+0000 mon.a (mon.0) 731 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:07:56.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:56 smithi172 bash[23680]: audit 2024-03-30T15:07:55.849089+0000 mon.a (mon.0) 732 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:07:56.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:56 smithi172 bash[23680]: audit 2024-03-30T15:07:55.858201+0000 mon.a (mon.0) 733 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:56.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:56 smithi172 bash[23680]: audit 2024-03-30T15:07:55.863678+0000 mon.a (mon.0) 734 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T15:07:56.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:56 smithi172 bash[23680]: audit 2024-03-30T15:07:55.867024+0000 mon.a (mon.0) 735 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-03-30T15:07:56.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:56 smithi172 bash[23680]: audit 2024-03-30T15:07:55.886437+0000 mon.a (mon.0) 736 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:07:57.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:57 smithi072 bash[21573]: cluster 2024-03-30T15:07:55.771105+0000 mgr.y (mgr.14152) 362 : cluster 0 pgmap v352: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 226 B/s wr, 0 op/s 2024-03-30T15:07:57.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:57 smithi072 bash[21573]: cephadm 2024-03-30T15:07:55.888243+0000 mgr.y (mgr.14152) 363 : cephadm 1 Deploying daemon iscsi.iscsi.a on smithi172 2024-03-30T15:07:57.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:57 smithi072 bash[28946]: cluster 2024-03-30T15:07:55.771105+0000 mgr.y (mgr.14152) 362 : cluster 0 pgmap v352: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 226 B/s wr, 0 op/s 2024-03-30T15:07:57.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:57 smithi072 bash[28946]: cephadm 2024-03-30T15:07:55.888243+0000 mgr.y (mgr.14152) 363 : cephadm 1 Deploying daemon iscsi.iscsi.a on smithi172 2024-03-30T15:07:57.713 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:57 smithi172 bash[23680]: cluster 2024-03-30T15:07:55.771105+0000 mgr.y (mgr.14152) 362 : cluster 0 pgmap v352: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 226 B/s wr, 0 op/s 2024-03-30T15:07:57.713 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:57 smithi172 bash[23680]: cephadm 2024-03-30T15:07:55.888243+0000 mgr.y (mgr.14152) 363 : cephadm 1 Deploying daemon iscsi.iscsi.a on smithi172 2024-03-30T15:07:58.565 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 30 15:07:58 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:07:58.566 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:07:58 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:07:58.566 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:07:58 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:07:58.566 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:07:58 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:07:58.567 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:58 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:07:58.567 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:07:58 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:07:58.819 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:58 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:07:58.819 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:07:58 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:07:58.819 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 30 15:07:58 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:07:58.819 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:07:58 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:07:58.820 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:07:58 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:07:58.820 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:07:58 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:07:59.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:59 smithi072 bash[21573]: cluster 2024-03-30T15:07:57.772128+0000 mgr.y (mgr.14152) 364 : cluster 0 pgmap v353: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:07:59.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:59 smithi072 bash[21573]: audit 2024-03-30T15:07:58.880936+0000 mon.a (mon.0) 737 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:59.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:59 smithi072 bash[21573]: audit 2024-03-30T15:07:58.895245+0000 mon.a (mon.0) 738 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:59.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:59 smithi072 bash[21573]: audit 2024-03-30T15:07:58.919166+0000 mon.a (mon.0) 739 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:59.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:59 smithi072 bash[21573]: audit 2024-03-30T15:07:58.940292+0000 mon.a (mon.0) 740 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:59.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:07:59 smithi072 bash[21573]: audit 2024-03-30T15:07:59.005795+0000 mon.a (mon.0) 741 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:07:59.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:59 smithi072 bash[28946]: cluster 2024-03-30T15:07:57.772128+0000 mgr.y (mgr.14152) 364 : cluster 0 pgmap v353: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:07:59.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:59 smithi072 bash[28946]: audit 2024-03-30T15:07:58.880936+0000 mon.a (mon.0) 737 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:59.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:59 smithi072 bash[28946]: audit 2024-03-30T15:07:58.895245+0000 mon.a (mon.0) 738 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:59.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:59 smithi072 bash[28946]: audit 2024-03-30T15:07:58.919166+0000 mon.a (mon.0) 739 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:59.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:59 smithi072 bash[28946]: audit 2024-03-30T15:07:58.940292+0000 mon.a (mon.0) 740 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:59.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:07:59 smithi072 bash[28946]: audit 2024-03-30T15:07:59.005795+0000 mon.a (mon.0) 741 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:07:59.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:59 smithi172 bash[23680]: cluster 2024-03-30T15:07:57.772128+0000 mgr.y (mgr.14152) 364 : cluster 0 pgmap v353: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:07:59.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:59 smithi172 bash[23680]: audit 2024-03-30T15:07:58.880936+0000 mon.a (mon.0) 737 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:59.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:59 smithi172 bash[23680]: audit 2024-03-30T15:07:58.895245+0000 mon.a (mon.0) 738 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:59.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:59 smithi172 bash[23680]: audit 2024-03-30T15:07:58.919166+0000 mon.a (mon.0) 739 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:59.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:59 smithi172 bash[23680]: audit 2024-03-30T15:07:58.940292+0000 mon.a (mon.0) 740 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:07:59.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:07:59 smithi172 bash[23680]: audit 2024-03-30T15:07:59.005795+0000 mon.a (mon.0) 741 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:08:00.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:00 smithi172 bash[23680]: cephadm 2024-03-30T15:07:58.921033+0000 mgr.y (mgr.14152) 365 : cephadm 1 Checking pool "datapool" exists for service iscsi.datapool 2024-03-30T15:08:00.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:00 smithi172 bash[23680]: audit 2024-03-30T15:07:59.480374+0000 mon.a (mon.0) 742 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:08:00.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:00 smithi172 bash[23680]: audit 2024-03-30T15:07:59.487466+0000 mon.a (mon.0) 743 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:08:00.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:00 smithi172 bash[23680]: cluster 2024-03-30T15:07:59.955157+0000 mon.a (mon.0) 744 : cluster 0 mgrmap e16: y(active, since 9m), standbys: x 2024-03-30T15:08:00.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:00 smithi172 bash[23680]: audit 2024-03-30T15:08:00.300621+0000 mon.a (mon.0) 745 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:08:00.717 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:08:00 smithi172 bash[47790]: debug Processing osd blocklist entries for this node 2024-03-30T15:08:00.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:00 smithi072 bash[21573]: cephadm 2024-03-30T15:07:58.921033+0000 mgr.y (mgr.14152) 365 : cephadm 1 Checking pool "datapool" exists for service iscsi.datapool 2024-03-30T15:08:00.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:00 smithi072 bash[21573]: audit 2024-03-30T15:07:59.480374+0000 mon.a (mon.0) 742 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:08:00.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:00 smithi072 bash[21573]: audit 2024-03-30T15:07:59.487466+0000 mon.a (mon.0) 743 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:08:00.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:00 smithi072 bash[21573]: cluster 2024-03-30T15:07:59.955157+0000 mon.a (mon.0) 744 : cluster 0 mgrmap e16: y(active, since 9m), standbys: x 2024-03-30T15:08:00.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:00 smithi072 bash[21573]: audit 2024-03-30T15:08:00.300621+0000 mon.a (mon.0) 745 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:08:00.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:00 smithi072 bash[28946]: cephadm 2024-03-30T15:07:58.921033+0000 mgr.y (mgr.14152) 365 : cephadm 1 Checking pool "datapool" exists for service iscsi.datapool 2024-03-30T15:08:00.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:00 smithi072 bash[28946]: audit 2024-03-30T15:07:59.480374+0000 mon.a (mon.0) 742 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:08:00.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:00 smithi072 bash[28946]: audit 2024-03-30T15:07:59.487466+0000 mon.a (mon.0) 743 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:08:00.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:00 smithi072 bash[28946]: cluster 2024-03-30T15:07:59.955157+0000 mon.a (mon.0) 744 : cluster 0 mgrmap e16: y(active, since 9m), standbys: x 2024-03-30T15:08:00.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:00 smithi072 bash[28946]: audit 2024-03-30T15:08:00.300621+0000 mon.a (mon.0) 745 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:08:01.216 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:08:00 smithi172 bash[47790]: debug Reading the configuration object to update local LIO configuration 2024-03-30T15:08:01.217 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:08:00 smithi172 bash[47790]: debug Configuration does not have an entry for this host(smithi172.front.sepia.ceph.com) - nothing to define to LIO 2024-03-30T15:08:01.217 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:08:00 smithi172 bash[47790]: debug * Running on http://[::]:5000/ (Press CTRL+C to quit) 2024-03-30T15:08:01.828 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.b/config 2024-03-30T15:08:01.853 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:01 smithi172 bash[23680]: cluster 2024-03-30T15:07:59.773126+0000 mgr.y (mgr.14152) 366 : cluster 0 pgmap v354: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:08:01.853 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:01 smithi172 bash[23680]: audit 2024-03-30T15:08:00.744583+0000 mon.b (mon.1) 28 : audit 0 from='client.? 172.21.15.172:0/1436523666' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-30T15:08:01.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:01 smithi072 bash[21573]: cluster 2024-03-30T15:07:59.773126+0000 mgr.y (mgr.14152) 366 : cluster 0 pgmap v354: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:08:01.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:01 smithi072 bash[21573]: audit 2024-03-30T15:08:00.744583+0000 mon.b (mon.1) 28 : audit 0 from='client.? 172.21.15.172:0/1436523666' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-30T15:08:01.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:01 smithi072 bash[28946]: cluster 2024-03-30T15:07:59.773126+0000 mgr.y (mgr.14152) 366 : cluster 0 pgmap v354: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:08:01.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:01 smithi072 bash[28946]: audit 2024-03-30T15:08:00.744583+0000 mon.b (mon.1) 28 : audit 0 from='client.? 172.21.15.172:0/1436523666' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-30T15:08:03.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:03 smithi072 bash[21573]: cluster 2024-03-30T15:08:01.774137+0000 mgr.y (mgr.14152) 367 : cluster 0 pgmap v355: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:08:03.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:03 smithi072 bash[28946]: cluster 2024-03-30T15:08:01.774137+0000 mgr.y (mgr.14152) 367 : cluster 0 pgmap v355: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:08:03.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:03 smithi172 bash[23680]: cluster 2024-03-30T15:08:01.774137+0000 mgr.y (mgr.14152) 367 : cluster 0 pgmap v355: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:08:04.572 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.573+0000 7f587e985700 1 -- 172.21.15.172:0/2988433883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5878106080 msgr2=0x7f587810c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:08:04.572 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.573+0000 7f587e985700 1 --2- 172.21.15.172:0/2988433883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5878106080 0x7f587810c930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f587000b0d0 tx=0x7f587000b3e0 comp rx=0 tx=0).stop 2024-03-30T15:08:04.572 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.573+0000 7f587e985700 1 -- 172.21.15.172:0/2988433883 shutdown_connections 2024-03-30T15:08:04.572 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.573+0000 7f587e985700 1 --2- 172.21.15.172:0/2988433883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5878106080 0x7f587810c930 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:08:04.572 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.573+0000 7f587e985700 1 --2- 172.21.15.172:0/2988433883 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58781044e0 0x7f5878104900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:08:04.572 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.573+0000 7f587e985700 1 --2- 172.21.15.172:0/2988433883 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f58781056e0 0x7f5878105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:08:04.572 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.573+0000 7f587e985700 1 -- 172.21.15.172:0/2988433883 >> 172.21.15.172:0/2988433883 conn(0x7f58780ffaa0 msgr2=0x7f5878101ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:08:04.572 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.573+0000 7f587e985700 1 -- 172.21.15.172:0/2988433883 shutdown_connections 2024-03-30T15:08:04.572 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.573+0000 7f587e985700 1 -- 172.21.15.172:0/2988433883 wait complete. 2024-03-30T15:08:04.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.573+0000 7f587e985700 1 Processor -- start 2024-03-30T15:08:04.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.573+0000 7f587e985700 1 -- start start 2024-03-30T15:08:04.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.573+0000 7f587e985700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f58781044e0 0x7f5878199ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:08:04.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.573+0000 7f587e985700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58781056e0 0x7f587819a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:08:04.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.573+0000 7f587e985700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5878106080 0x7f58781a1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:08:04.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.573+0000 7f587e985700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f587810f610 con 0x7f5878106080 2024-03-30T15:08:04.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.573+0000 7f587e985700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f587810f490 con 0x7f58781056e0 2024-03-30T15:08:04.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.573+0000 7f587e985700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f587810f790 con 0x7f58781044e0 2024-03-30T15:08:04.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.573+0000 7f58777fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58781056e0 0x7f587819a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:08:04.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.573+0000 7f58777fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58781056e0 0x7f587819a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:37704/0 (socket says 172.21.15.172:37704) 2024-03-30T15:08:04.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.573+0000 7f58777fe700 1 -- 172.21.15.172:0/3246047361 learned_addr learned my addr 172.21.15.172:0/3246047361 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-03-30T15:08:04.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.573+0000 7f5877fff700 1 --2- 172.21.15.172:0/3246047361 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f58781044e0 0x7f5878199ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:08:04.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.573+0000 7f587cf22700 1 --2- 172.21.15.172:0/3246047361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5878106080 0x7f58781a1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:08:04.574 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.573+0000 7f58777fe700 1 -- 172.21.15.172:0/3246047361 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f58781044e0 msgr2=0x7f5878199ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:08:04.574 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.573+0000 7f58777fe700 1 --2- 172.21.15.172:0/3246047361 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f58781044e0 0x7f5878199ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:08:04.574 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.573+0000 7f58777fe700 1 -- 172.21.15.172:0/3246047361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5878106080 msgr2=0x7f58781a1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:08:04.574 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.573+0000 7f58777fe700 1 --2- 172.21.15.172:0/3246047361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5878106080 0x7f58781a1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:08:04.574 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.573+0000 7f58777fe700 1 -- 172.21.15.172:0/3246047361 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58781a1730 con 0x7f58781056e0 2024-03-30T15:08:04.574 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.573+0000 7f587cf22700 1 --2- 172.21.15.172:0/3246047361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5878106080 0x7f58781a1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T15:08:04.574 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.573+0000 7f58777fe700 1 --2- 172.21.15.172:0/3246047361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58781056e0 0x7f587819a010 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f586c00c9b0 tx=0x7f586c00ccc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:08:04.575 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.577+0000 7f58757fa700 1 -- 172.21.15.172:0/3246047361 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f586c007b00 con 0x7f58781056e0 2024-03-30T15:08:04.575 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.577+0000 7f58757fa700 1 -- 172.21.15.172:0/3246047361 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f586c007ca0 con 0x7f58781056e0 2024-03-30T15:08:04.575 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.577+0000 7f587e985700 1 -- 172.21.15.172:0/3246047361 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58781a1a20 con 0x7f58781056e0 2024-03-30T15:08:04.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.577+0000 7f58757fa700 1 -- 172.21.15.172:0/3246047361 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f586c00fe60 con 0x7f58781056e0 2024-03-30T15:08:04.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.577+0000 7f587e985700 1 -- 172.21.15.172:0/3246047361 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58781a1f60 con 0x7f58781056e0 2024-03-30T15:08:04.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.577+0000 7f58757fa700 1 -- 172.21.15.172:0/3246047361 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 91825+0+0 (secure 0 0 0) 0x7f586c004830 con 0x7f58781056e0 2024-03-30T15:08:04.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.577+0000 7f58757fa700 1 --2- 172.21.15.172:0/3246047361 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f586006dbe0 0x7f58600700a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:08:04.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.577+0000 7f58757fa700 1 -- 172.21.15.172:0/3246047361 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7148+0+0 (secure 0 0 0) 0x7f586c08ded0 con 0x7f58781056e0 2024-03-30T15:08:04.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.577+0000 7f587e985700 1 -- 172.21.15.172:0/3246047361 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f587810fd70 con 0x7f58781056e0 2024-03-30T15:08:04.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.577+0000 7f5877fff700 1 --2- 172.21.15.172:0/3246047361 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f586006dbe0 0x7f58600700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:08:04.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.577+0000 7f5877fff700 1 --2- 172.21.15.172:0/3246047361 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f586006dbe0 0x7f58600700a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5878105540 tx=0x7f586800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:08:04.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.581+0000 7f58757fa700 1 -- 172.21.15.172:0/3246047361 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f586c014030 con 0x7f58781056e0 2024-03-30T15:08:04.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.801+0000 7f587e985700 1 -- 172.21.15.172:0/3246047361 --> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi172=a", "target": ["mon-mgr", ""]}) -- 0x7f587802dd50 con 0x7f586006dbe0 2024-03-30T15:08:04.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.833+0000 7f58757fa700 1 -- 172.21.15.172:0/3246047361 <== mgr.14152 v2:172.21.15.72:6800/2777002311 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+31 (secure 0 0 0) 0x7f587802dd50 con 0x7f586006dbe0 2024-03-30T15:08:04.830 INFO:teuthology.orchestra.run.smithi172.stdout:Scheduled prometheus update... 2024-03-30T15:08:04.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.837+0000 7f587e985700 1 -- 172.21.15.172:0/3246047361 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f586006dbe0 msgr2=0x7f58600700a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:08:04.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.837+0000 7f587e985700 1 --2- 172.21.15.172:0/3246047361 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f586006dbe0 0x7f58600700a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5878105540 tx=0x7f586800b410 comp rx=0 tx=0).stop 2024-03-30T15:08:04.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.837+0000 7f587e985700 1 -- 172.21.15.172:0/3246047361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58781056e0 msgr2=0x7f587819a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:08:04.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.837+0000 7f587e985700 1 --2- 172.21.15.172:0/3246047361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58781056e0 0x7f587819a010 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f586c00c9b0 tx=0x7f586c00ccc0 comp rx=0 tx=0).stop 2024-03-30T15:08:04.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.837+0000 7f587e985700 1 -- 172.21.15.172:0/3246047361 shutdown_connections 2024-03-30T15:08:04.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.837+0000 7f587e985700 1 --2- 172.21.15.172:0/3246047361 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f586006dbe0 0x7f58600700a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:08:04.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.837+0000 7f587e985700 1 --2- 172.21.15.172:0/3246047361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5878106080 0x7f58781a1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:08:04.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.837+0000 7f587e985700 1 --2- 172.21.15.172:0/3246047361 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f58781044e0 0x7f5878199ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:08:04.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.837+0000 7f587e985700 1 --2- 172.21.15.172:0/3246047361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58781056e0 0x7f587819a010 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:08:04.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.837+0000 7f587e985700 1 -- 172.21.15.172:0/3246047361 >> 172.21.15.172:0/3246047361 conn(0x7f58780ffaa0 msgr2=0x7f5878108910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:08:04.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.837+0000 7f587e985700 1 -- 172.21.15.172:0/3246047361 shutdown_connections 2024-03-30T15:08:04.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:04.837+0000 7f587e985700 1 -- 172.21.15.172:0/3246047361 wait complete. 2024-03-30T15:08:05.510 DEBUG:teuthology.orchestra.run.smithi172:prometheus.a> sudo journalctl -f -n 0 -u ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@prometheus.a.service 2024-03-30T15:08:05.512 INFO:tasks.cephadm:Adding node-exporter.a on smithi072 2024-03-30T15:08:05.513 INFO:tasks.cephadm:Adding node-exporter.b on smithi172 2024-03-30T15:08:05.513 DEBUG:teuthology.orchestra.run.smithi172:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph orch apply node-exporter '2;smithi072=a;smithi172=b' 2024-03-30T15:08:05.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:05 smithi072 bash[21573]: cluster 2024-03-30T15:08:03.775330+0000 mgr.y (mgr.14152) 368 : cluster 0 pgmap v356: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:08:05.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:05 smithi072 bash[21573]: audit 2024-03-30T15:08:04.659337+0000 mon.a (mon.0) 746 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:08:05.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:05 smithi072 bash[21573]: audit 2024-03-30T15:08:04.673281+0000 mon.a (mon.0) 747 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:08:05.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:05 smithi072 bash[21573]: audit 2024-03-30T15:08:04.675760+0000 mon.a (mon.0) 748 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:08:05.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:05 smithi072 bash[21573]: audit 2024-03-30T15:08:04.677755+0000 mon.a (mon.0) 749 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:08:05.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:05 smithi072 bash[21573]: audit 2024-03-30T15:08:04.690124+0000 mon.a (mon.0) 750 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:08:05.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:05 smithi072 bash[21573]: audit 2024-03-30T15:08:04.773937+0000 mon.a (mon.0) 751 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-03-30T15:08:05.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:05 smithi072 bash[21573]: audit 2024-03-30T15:08:04.778354+0000 mon.a (mon.0) 752 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-03-30T15:08:05.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:05 smithi072 bash[21573]: audit 2024-03-30T15:08:04.790312+0000 mon.a (mon.0) 753 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:08:05.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:05 smithi072 bash[21573]: audit 2024-03-30T15:08:04.810039+0000 mon.a (mon.0) 754 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi172"}]: dispatch 2024-03-30T15:08:05.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:05 smithi072 bash[21573]: audit 2024-03-30T15:08:04.832745+0000 mon.a (mon.0) 755 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:08:05.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:05 smithi072 bash[21573]: audit 2024-03-30T15:08:04.840978+0000 mon.a (mon.0) 756 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:08:05.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:05 smithi072 bash[21573]: audit 2024-03-30T15:08:04.844273+0000 mon.a (mon.0) 757 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:08:05.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:05 smithi072 bash[21573]: audit 2024-03-30T15:08:04.847507+0000 mon.a (mon.0) 758 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:08:05.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:05 smithi072 bash[21573]: audit 2024-03-30T15:08:04.849120+0000 mon.a (mon.0) 759 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:08:05.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:05 smithi072 bash[21573]: audit 2024-03-30T15:08:04.861157+0000 mon.a (mon.0) 760 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:08:05.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:05 smithi072 bash[28946]: cluster 2024-03-30T15:08:03.775330+0000 mgr.y (mgr.14152) 368 : cluster 0 pgmap v356: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:08:05.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:05 smithi072 bash[28946]: audit 2024-03-30T15:08:04.659337+0000 mon.a (mon.0) 746 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:08:05.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:05 smithi072 bash[28946]: audit 2024-03-30T15:08:04.673281+0000 mon.a (mon.0) 747 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:08:05.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:05 smithi072 bash[28946]: audit 2024-03-30T15:08:04.675760+0000 mon.a (mon.0) 748 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:08:05.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:05 smithi072 bash[28946]: audit 2024-03-30T15:08:04.677755+0000 mon.a (mon.0) 749 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:08:05.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:05 smithi072 bash[28946]: audit 2024-03-30T15:08:04.690124+0000 mon.a (mon.0) 750 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:08:05.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:05 smithi072 bash[28946]: audit 2024-03-30T15:08:04.773937+0000 mon.a (mon.0) 751 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-03-30T15:08:05.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:05 smithi072 bash[28946]: audit 2024-03-30T15:08:04.778354+0000 mon.a (mon.0) 752 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-03-30T15:08:05.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:05 smithi072 bash[28946]: audit 2024-03-30T15:08:04.790312+0000 mon.a (mon.0) 753 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:08:05.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:05 smithi072 bash[28946]: audit 2024-03-30T15:08:04.810039+0000 mon.a (mon.0) 754 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi172"}]: dispatch 2024-03-30T15:08:05.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:05 smithi072 bash[28946]: audit 2024-03-30T15:08:04.832745+0000 mon.a (mon.0) 755 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:08:05.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:05 smithi072 bash[28946]: audit 2024-03-30T15:08:04.840978+0000 mon.a (mon.0) 756 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:08:05.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:05 smithi072 bash[28946]: audit 2024-03-30T15:08:04.844273+0000 mon.a (mon.0) 757 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:08:05.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:05 smithi072 bash[28946]: audit 2024-03-30T15:08:04.847507+0000 mon.a (mon.0) 758 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:08:05.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:05 smithi072 bash[28946]: audit 2024-03-30T15:08:04.849120+0000 mon.a (mon.0) 759 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:08:05.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:05 smithi072 bash[28946]: audit 2024-03-30T15:08:04.861157+0000 mon.a (mon.0) 760 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:08:05.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:05 smithi172 bash[23680]: cluster 2024-03-30T15:08:03.775330+0000 mgr.y (mgr.14152) 368 : cluster 0 pgmap v356: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:08:05.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:05 smithi172 bash[23680]: audit 2024-03-30T15:08:04.659337+0000 mon.a (mon.0) 746 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:08:05.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:05 smithi172 bash[23680]: audit 2024-03-30T15:08:04.673281+0000 mon.a (mon.0) 747 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:08:05.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:05 smithi172 bash[23680]: audit 2024-03-30T15:08:04.675760+0000 mon.a (mon.0) 748 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:08:05.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:05 smithi172 bash[23680]: audit 2024-03-30T15:08:04.677755+0000 mon.a (mon.0) 749 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:08:05.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:05 smithi172 bash[23680]: audit 2024-03-30T15:08:04.690124+0000 mon.a (mon.0) 750 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:08:05.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:05 smithi172 bash[23680]: audit 2024-03-30T15:08:04.773937+0000 mon.a (mon.0) 751 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-03-30T15:08:05.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:05 smithi172 bash[23680]: audit 2024-03-30T15:08:04.778354+0000 mon.a (mon.0) 752 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-03-30T15:08:05.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:05 smithi172 bash[23680]: audit 2024-03-30T15:08:04.790312+0000 mon.a (mon.0) 753 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:08:05.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:05 smithi172 bash[23680]: audit 2024-03-30T15:08:04.810039+0000 mon.a (mon.0) 754 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi172"}]: dispatch 2024-03-30T15:08:05.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:05 smithi172 bash[23680]: audit 2024-03-30T15:08:04.832745+0000 mon.a (mon.0) 755 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:08:05.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:05 smithi172 bash[23680]: audit 2024-03-30T15:08:04.840978+0000 mon.a (mon.0) 756 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:08:05.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:05 smithi172 bash[23680]: audit 2024-03-30T15:08:04.844273+0000 mon.a (mon.0) 757 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:08:05.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:05 smithi172 bash[23680]: audit 2024-03-30T15:08:04.847507+0000 mon.a (mon.0) 758 : audit 0 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:08:05.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:05 smithi172 bash[23680]: audit 2024-03-30T15:08:04.849120+0000 mon.a (mon.0) 759 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:08:05.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:05 smithi172 bash[23680]: audit 2024-03-30T15:08:04.861157+0000 mon.a (mon.0) 760 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:08:06.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:06 smithi072 bash[21573]: audit 2024-03-30T15:08:04.775426+0000 mgr.y (mgr.14152) 369 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-03-30T15:08:06.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:06 smithi072 bash[21573]: cephadm 2024-03-30T15:08:04.777800+0000 mgr.y (mgr.14152) 370 : cephadm 1 Adding iSCSI gateway http://:@172.21.15.172:5000 to Dashboard 2024-03-30T15:08:06.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:06 smithi072 bash[21573]: audit 2024-03-30T15:08:04.779344+0000 mgr.y (mgr.14152) 371 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-03-30T15:08:06.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:06 smithi072 bash[21573]: audit 2024-03-30T15:08:04.805059+0000 mgr.y (mgr.14152) 372 : audit 0 from='client.24412 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi172=a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T15:08:06.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:06 smithi072 bash[21573]: audit 2024-03-30T15:08:04.811438+0000 mgr.y (mgr.14152) 373 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi172"}]: dispatch 2024-03-30T15:08:06.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:06 smithi072 bash[21573]: cephadm 2024-03-30T15:08:04.822180+0000 mgr.y (mgr.14152) 374 : cephadm 1 Saving service prometheus spec with placement smithi172=a;count:1 2024-03-30T15:08:06.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:06 smithi072 bash[21573]: cephadm 2024-03-30T15:08:05.134882+0000 mgr.y (mgr.14152) 375 : cephadm 1 Deploying daemon prometheus.a on smithi172 2024-03-30T15:08:06.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:06 smithi072 bash[28946]: audit 2024-03-30T15:08:04.775426+0000 mgr.y (mgr.14152) 369 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-03-30T15:08:06.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:06 smithi072 bash[28946]: cephadm 2024-03-30T15:08:04.777800+0000 mgr.y (mgr.14152) 370 : cephadm 1 Adding iSCSI gateway http://:@172.21.15.172:5000 to Dashboard 2024-03-30T15:08:06.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:06 smithi072 bash[28946]: audit 2024-03-30T15:08:04.779344+0000 mgr.y (mgr.14152) 371 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-03-30T15:08:06.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:06 smithi072 bash[28946]: audit 2024-03-30T15:08:04.805059+0000 mgr.y (mgr.14152) 372 : audit 0 from='client.24412 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi172=a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T15:08:06.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:06 smithi072 bash[28946]: audit 2024-03-30T15:08:04.811438+0000 mgr.y (mgr.14152) 373 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi172"}]: dispatch 2024-03-30T15:08:06.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:06 smithi072 bash[28946]: cephadm 2024-03-30T15:08:04.822180+0000 mgr.y (mgr.14152) 374 : cephadm 1 Saving service prometheus spec with placement smithi172=a;count:1 2024-03-30T15:08:06.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:06 smithi072 bash[28946]: cephadm 2024-03-30T15:08:05.134882+0000 mgr.y (mgr.14152) 375 : cephadm 1 Deploying daemon prometheus.a on smithi172 2024-03-30T15:08:06.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:06 smithi172 bash[23680]: audit 2024-03-30T15:08:04.775426+0000 mgr.y (mgr.14152) 369 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-03-30T15:08:06.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:06 smithi172 bash[23680]: cephadm 2024-03-30T15:08:04.777800+0000 mgr.y (mgr.14152) 370 : cephadm 1 Adding iSCSI gateway http://:@172.21.15.172:5000 to Dashboard 2024-03-30T15:08:06.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:06 smithi172 bash[23680]: audit 2024-03-30T15:08:04.779344+0000 mgr.y (mgr.14152) 371 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-03-30T15:08:06.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:06 smithi172 bash[23680]: audit 2024-03-30T15:08:04.805059+0000 mgr.y (mgr.14152) 372 : audit 0 from='client.24412 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi172=a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T15:08:06.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:06 smithi172 bash[23680]: audit 2024-03-30T15:08:04.811438+0000 mgr.y (mgr.14152) 373 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi172"}]: dispatch 2024-03-30T15:08:06.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:06 smithi172 bash[23680]: cephadm 2024-03-30T15:08:04.822180+0000 mgr.y (mgr.14152) 374 : cephadm 1 Saving service prometheus spec with placement smithi172=a;count:1 2024-03-30T15:08:06.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:06 smithi172 bash[23680]: cephadm 2024-03-30T15:08:05.134882+0000 mgr.y (mgr.14152) 375 : cephadm 1 Deploying daemon prometheus.a on smithi172 2024-03-30T15:08:07.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:07 smithi072 bash[21573]: cluster 2024-03-30T15:08:05.776416+0000 mgr.y (mgr.14152) 376 : cluster 0 pgmap v357: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 426 B/s rd, 85 B/s wr, 1 op/s 2024-03-30T15:08:07.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:07 smithi072 bash[28946]: cluster 2024-03-30T15:08:05.776416+0000 mgr.y (mgr.14152) 376 : cluster 0 pgmap v357: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 426 B/s rd, 85 B/s wr, 1 op/s 2024-03-30T15:08:07.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:07 smithi172 bash[23680]: cluster 2024-03-30T15:08:05.776416+0000 mgr.y (mgr.14152) 376 : cluster 0 pgmap v357: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 426 B/s rd, 85 B/s wr, 1 op/s 2024-03-30T15:08:09.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:09 smithi072 bash[21573]: cluster 2024-03-30T15:08:07.777459+0000 mgr.y (mgr.14152) 377 : cluster 0 pgmap v358: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 426 B/s rd, 85 B/s wr, 1 op/s 2024-03-30T15:08:09.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:09 smithi072 bash[28946]: cluster 2024-03-30T15:08:07.777459+0000 mgr.y (mgr.14152) 377 : cluster 0 pgmap v358: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 426 B/s rd, 85 B/s wr, 1 op/s 2024-03-30T15:08:09.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:09 smithi172 bash[23680]: cluster 2024-03-30T15:08:07.777459+0000 mgr.y (mgr.14152) 377 : cluster 0 pgmap v358: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 426 B/s rd, 85 B/s wr, 1 op/s 2024-03-30T15:08:10.284 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.b/config 2024-03-30T15:08:10.731 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:08:10 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:08:11.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:11 smithi172 bash[23680]: cluster 2024-03-30T15:08:09.778444+0000 mgr.y (mgr.14152) 378 : cluster 0 pgmap v359: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 426 B/s rd, 85 B/s wr, 1 op/s 2024-03-30T15:08:11.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:11 smithi172 bash[23680]: audit 2024-03-30T15:08:10.445043+0000 mgr.y (mgr.14152) 379 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:08:12.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:11 smithi072 bash[21573]: cluster 2024-03-30T15:08:09.778444+0000 mgr.y (mgr.14152) 378 : cluster 0 pgmap v359: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 426 B/s rd, 85 B/s wr, 1 op/s 2024-03-30T15:08:12.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:11 smithi072 bash[21573]: audit 2024-03-30T15:08:10.445043+0000 mgr.y (mgr.14152) 379 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:08:12.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:11 smithi072 bash[28946]: cluster 2024-03-30T15:08:09.778444+0000 mgr.y (mgr.14152) 378 : cluster 0 pgmap v359: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 426 B/s rd, 85 B/s wr, 1 op/s 2024-03-30T15:08:12.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:11 smithi072 bash[28946]: audit 2024-03-30T15:08:10.445043+0000 mgr.y (mgr.14152) 379 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:08:13.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:13 smithi172 bash[23680]: cluster 2024-03-30T15:08:11.779427+0000 mgr.y (mgr.14152) 380 : cluster 0 pgmap v360: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-03-30T15:08:14.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:13 smithi072 bash[21573]: cluster 2024-03-30T15:08:11.779427+0000 mgr.y (mgr.14152) 380 : cluster 0 pgmap v360: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-03-30T15:08:14.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:13 smithi072 bash[28946]: cluster 2024-03-30T15:08:11.779427+0000 mgr.y (mgr.14152) 380 : cluster 0 pgmap v360: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-03-30T15:08:14.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:14 smithi172 bash[23680]: audit 2024-03-30T15:08:13.708282+0000 mon.a (mon.0) 761 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2024-03-30T15:08:14.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:14 smithi172 bash[23680]: audit 2024-03-30T15:08:13.709074+0000 mon.a (mon.0) 762 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2024-03-30T15:08:14.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:14 smithi172 bash[23680]: audit 2024-03-30T15:08:13.709819+0000 mon.a (mon.0) 763 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2024-03-30T15:08:14.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:14 smithi172 bash[23680]: audit 2024-03-30T15:08:13.710567+0000 mon.a (mon.0) 764 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-03-30T15:08:15.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:14 smithi072 bash[21573]: audit 2024-03-30T15:08:13.708282+0000 mon.a (mon.0) 761 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2024-03-30T15:08:15.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:14 smithi072 bash[21573]: audit 2024-03-30T15:08:13.709074+0000 mon.a (mon.0) 762 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2024-03-30T15:08:15.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:14 smithi072 bash[21573]: audit 2024-03-30T15:08:13.709819+0000 mon.a (mon.0) 763 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2024-03-30T15:08:15.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:14 smithi072 bash[21573]: audit 2024-03-30T15:08:13.710567+0000 mon.a (mon.0) 764 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-03-30T15:08:15.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:14 smithi072 bash[28946]: audit 2024-03-30T15:08:13.708282+0000 mon.a (mon.0) 761 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2024-03-30T15:08:15.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:14 smithi072 bash[28946]: audit 2024-03-30T15:08:13.709074+0000 mon.a (mon.0) 762 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2024-03-30T15:08:15.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:14 smithi072 bash[28946]: audit 2024-03-30T15:08:13.709819+0000 mon.a (mon.0) 763 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2024-03-30T15:08:15.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:14 smithi072 bash[28946]: audit 2024-03-30T15:08:13.710567+0000 mon.a (mon.0) 764 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-03-30T15:08:15.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:15 smithi172 bash[23680]: cluster 2024-03-30T15:08:13.780563+0000 mgr.y (mgr.14152) 381 : cluster 0 pgmap v361: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-03-30T15:08:15.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:15 smithi172 bash[23680]: audit 2024-03-30T15:08:14.697941+0000 mon.a (mon.0) 765 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]': finished 2024-03-30T15:08:15.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:15 smithi172 bash[23680]: audit 2024-03-30T15:08:14.698176+0000 mon.a (mon.0) 766 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]': finished 2024-03-30T15:08:15.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:15 smithi172 bash[23680]: audit 2024-03-30T15:08:14.698361+0000 mon.a (mon.0) 767 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]': finished 2024-03-30T15:08:15.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:15 smithi172 bash[23680]: audit 2024-03-30T15:08:14.698559+0000 mon.a (mon.0) 768 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]': finished 2024-03-30T15:08:15.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:15 smithi172 bash[23680]: cluster 2024-03-30T15:08:14.708075+0000 mon.a (mon.0) 769 : cluster 0 osdmap e72: 8 total, 8 up, 8 in 2024-03-30T15:08:16.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:15 smithi072 bash[21573]: cluster 2024-03-30T15:08:13.780563+0000 mgr.y (mgr.14152) 381 : cluster 0 pgmap v361: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-03-30T15:08:16.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:15 smithi072 bash[21573]: audit 2024-03-30T15:08:14.697941+0000 mon.a (mon.0) 765 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]': finished 2024-03-30T15:08:16.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:15 smithi072 bash[21573]: audit 2024-03-30T15:08:14.698176+0000 mon.a (mon.0) 766 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]': finished 2024-03-30T15:08:16.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:15 smithi072 bash[21573]: audit 2024-03-30T15:08:14.698361+0000 mon.a (mon.0) 767 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]': finished 2024-03-30T15:08:16.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:15 smithi072 bash[21573]: audit 2024-03-30T15:08:14.698559+0000 mon.a (mon.0) 768 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]': finished 2024-03-30T15:08:16.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:15 smithi072 bash[21573]: cluster 2024-03-30T15:08:14.708075+0000 mon.a (mon.0) 769 : cluster 0 osdmap e72: 8 total, 8 up, 8 in 2024-03-30T15:08:16.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:15 smithi072 bash[28946]: cluster 2024-03-30T15:08:13.780563+0000 mgr.y (mgr.14152) 381 : cluster 0 pgmap v361: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-03-30T15:08:16.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:15 smithi072 bash[28946]: audit 2024-03-30T15:08:14.697941+0000 mon.a (mon.0) 765 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]': finished 2024-03-30T15:08:16.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:15 smithi072 bash[28946]: audit 2024-03-30T15:08:14.698176+0000 mon.a (mon.0) 766 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]': finished 2024-03-30T15:08:16.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:15 smithi072 bash[28946]: audit 2024-03-30T15:08:14.698361+0000 mon.a (mon.0) 767 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]': finished 2024-03-30T15:08:16.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:15 smithi072 bash[28946]: audit 2024-03-30T15:08:14.698559+0000 mon.a (mon.0) 768 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]': finished 2024-03-30T15:08:16.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:15 smithi072 bash[28946]: cluster 2024-03-30T15:08:14.708075+0000 mon.a (mon.0) 769 : cluster 0 osdmap e72: 8 total, 8 up, 8 in 2024-03-30T15:08:16.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:16.840+0000 7f140c15c700 1 -- 172.21.15.172:0/723943067 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1404101700 msgr2=0x7f1404101b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:08:16.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:16.840+0000 7f140c15c700 1 --2- 172.21.15.172:0/723943067 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1404101700 0x7f1404101b60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1400009990 tx=0x7f1400009ca0 comp rx=0 tx=0).stop 2024-03-30T15:08:16.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:16.840+0000 7f140c15c700 1 -- 172.21.15.172:0/723943067 shutdown_connections 2024-03-30T15:08:16.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:16.840+0000 7f140c15c700 1 --2- 172.21.15.172:0/723943067 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f14041020a0 0x7f1404108950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:08:16.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:16.840+0000 7f140c15c700 1 --2- 172.21.15.172:0/723943067 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1404100500 0x7f1404100920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:08:16.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:16.840+0000 7f140c15c700 1 --2- 172.21.15.172:0/723943067 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1404101700 0x7f1404101b60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:08:16.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:16.840+0000 7f140c15c700 1 -- 172.21.15.172:0/723943067 >> 172.21.15.172:0/723943067 conn(0x7f14040fbaa0 msgr2=0x7f14040fdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:08:16.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:16.840+0000 7f140c15c700 1 -- 172.21.15.172:0/723943067 shutdown_connections 2024-03-30T15:08:16.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:16.840+0000 7f140c15c700 1 -- 172.21.15.172:0/723943067 wait complete. 2024-03-30T15:08:16.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:16.840+0000 7f140c15c700 1 Processor -- start 2024-03-30T15:08:16.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:16.840+0000 7f140c15c700 1 -- start start 2024-03-30T15:08:16.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:16.840+0000 7f140c15c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1404100500 0x7f1404197b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:08:16.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:16.840+0000 7f140c15c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1404101700 0x7f14041980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:08:16.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:16.840+0000 7f140c15c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14041020a0 0x7f140419f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:08:16.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:16.840+0000 7f140c15c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f140410c320 con 0x7f14041020a0 2024-03-30T15:08:16.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:16.840+0000 7f140c15c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f140410c1a0 con 0x7f1404101700 2024-03-30T15:08:16.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:16.840+0000 7f140c15c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f140410c4a0 con 0x7f1404100500 2024-03-30T15:08:16.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:16.840+0000 7f14096f7700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1404101700 0x7f14041980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:08:16.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:16.840+0000 7f14096f7700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1404101700 0x7f14041980c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:60404/0 (socket says 172.21.15.172:60404) 2024-03-30T15:08:16.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:16.840+0000 7f14096f7700 1 -- 172.21.15.172:0/1365349073 learned_addr learned my addr 172.21.15.172:0/1365349073 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-03-30T15:08:16.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:16.840+0000 7f140a6f9700 1 --2- 172.21.15.172:0/1365349073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14041020a0 0x7f140419f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:08:16.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:16.840+0000 7f14096f7700 1 -- 172.21.15.172:0/1365349073 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1404100500 msgr2=0x7f1404197b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:08:16.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:16.840+0000 7f1409ef8700 1 --2- 172.21.15.172:0/1365349073 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1404100500 0x7f1404197b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:08:16.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:16.840+0000 7f14096f7700 1 --2- 172.21.15.172:0/1365349073 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1404100500 0x7f1404197b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:08:16.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:16.840+0000 7f14096f7700 1 -- 172.21.15.172:0/1365349073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14041020a0 msgr2=0x7f140419f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:08:16.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:16.840+0000 7f14096f7700 1 --2- 172.21.15.172:0/1365349073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14041020a0 0x7f140419f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:08:16.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:16.840+0000 7f14096f7700 1 -- 172.21.15.172:0/1365349073 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f140419f790 con 0x7f1404101700 2024-03-30T15:08:16.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:16.840+0000 7f1409ef8700 1 --2- 172.21.15.172:0/1365349073 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1404100500 0x7f1404197b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T15:08:16.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:16.840+0000 7f140a6f9700 1 --2- 172.21.15.172:0/1365349073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14041020a0 0x7f140419f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T15:08:16.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:16.840+0000 7f14096f7700 1 --2- 172.21.15.172:0/1365349073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1404101700 0x7f14041980c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f14000098e0 tx=0x7f140000f740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:08:16.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:16.840+0000 7f13faffd700 1 -- 172.21.15.172:0/1365349073 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1400027070 con 0x7f1404101700 2024-03-30T15:08:16.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:16.840+0000 7f140c15c700 1 -- 172.21.15.172:0/1365349073 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f140419fa20 con 0x7f1404101700 2024-03-30T15:08:16.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:16.844+0000 7f13faffd700 1 -- 172.21.15.172:0/1365349073 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f1400022470 con 0x7f1404101700 2024-03-30T15:08:16.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:16.844+0000 7f13faffd700 1 -- 172.21.15.172:0/1365349073 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1400003a90 con 0x7f1404101700 2024-03-30T15:08:16.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:16.844+0000 7f140c15c700 1 -- 172.21.15.172:0/1365349073 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f140419ff50 con 0x7f1404101700 2024-03-30T15:08:16.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:16.844+0000 7f140c15c700 1 -- 172.21.15.172:0/1365349073 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f140404ff00 con 0x7f1404101700 2024-03-30T15:08:16.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:16.844+0000 7f13faffd700 1 -- 172.21.15.172:0/1365349073 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 91825+0+0 (secure 0 0 0) 0x7f140002a070 con 0x7f1404101700 2024-03-30T15:08:16.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:16.844+0000 7f13faffd700 1 --2- 172.21.15.172:0/1365349073 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f13f006dbe0 0x7f13f00700a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:08:16.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:16.844+0000 7f13faffd700 1 -- 172.21.15.172:0/1365349073 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7236+0+0 (secure 0 0 0) 0x7f140008efd0 con 0x7f1404101700 2024-03-30T15:08:16.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:16.844+0000 7f1409ef8700 1 --2- 172.21.15.172:0/1365349073 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f13f006dbe0 0x7f13f00700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:08:16.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:16.844+0000 7f1409ef8700 1 --2- 172.21.15.172:0/1365349073 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f13f006dbe0 0x7f13f00700a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1404101560 tx=0x7f13f4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:08:16.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:16.848+0000 7f13faffd700 1 -- 172.21.15.172:0/1365349073 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f1400013070 con 0x7f1404101700 2024-03-30T15:08:16.905 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:16 smithi172 bash[23680]: cluster 2024-03-30T15:08:15.707863+0000 mon.a (mon.0) 770 : cluster 0 osdmap e73: 8 total, 8 up, 8 in 2024-03-30T15:08:16.906 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:16 smithi172 bash[23680]: cluster 2024-03-30T15:08:15.781291+0000 mgr.y (mgr.14152) 382 : cluster 0 pgmap v364: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:08:17.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:17.064+0000 7f140c15c700 1 -- 172.21.15.172:0/1365349073 --> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi072=a;smithi172=b", "target": ["mon-mgr", ""]}) -- 0x7f14040fd6f0 con 0x7f13f006dbe0 2024-03-30T15:08:17.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:17.080+0000 7f13faffd700 1 -- 172.21.15.172:0/1365349073 <== mgr.14152 v2:172.21.15.72:6800/2777002311 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+34 (secure 0 0 0) 0x7f14040fd6f0 con 0x7f13f006dbe0 2024-03-30T15:08:17.077 INFO:teuthology.orchestra.run.smithi172.stdout:Scheduled node-exporter update... 2024-03-30T15:08:17.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:17.080+0000 7f140c15c700 1 -- 172.21.15.172:0/1365349073 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f13f006dbe0 msgr2=0x7f13f00700a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:08:17.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:17.080+0000 7f140c15c700 1 --2- 172.21.15.172:0/1365349073 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f13f006dbe0 0x7f13f00700a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1404101560 tx=0x7f13f4008040 comp rx=0 tx=0).stop 2024-03-30T15:08:17.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:17.080+0000 7f140c15c700 1 -- 172.21.15.172:0/1365349073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1404101700 msgr2=0x7f14041980c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:08:17.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:17.080+0000 7f140c15c700 1 --2- 172.21.15.172:0/1365349073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1404101700 0x7f14041980c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f14000098e0 tx=0x7f140000f740 comp rx=0 tx=0).stop 2024-03-30T15:08:17.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:17.080+0000 7f140c15c700 1 -- 172.21.15.172:0/1365349073 shutdown_connections 2024-03-30T15:08:17.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:17.080+0000 7f140c15c700 1 --2- 172.21.15.172:0/1365349073 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7f13f006dbe0 0x7f13f00700a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:08:17.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:17.080+0000 7f140c15c700 1 --2- 172.21.15.172:0/1365349073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14041020a0 0x7f140419f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:08:17.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:17.080+0000 7f140c15c700 1 --2- 172.21.15.172:0/1365349073 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1404100500 0x7f1404197b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:08:17.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:17.084+0000 7f140c15c700 1 --2- 172.21.15.172:0/1365349073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1404101700 0x7f14041980c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:08:17.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:17.084+0000 7f140c15c700 1 -- 172.21.15.172:0/1365349073 >> 172.21.15.172:0/1365349073 conn(0x7f14040fbaa0 msgr2=0x7f14040fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:08:17.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:17.084+0000 7f140c15c700 1 -- 172.21.15.172:0/1365349073 shutdown_connections 2024-03-30T15:08:17.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:17.084+0000 7f140c15c700 1 -- 172.21.15.172:0/1365349073 wait complete. 2024-03-30T15:08:17.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:16 smithi072 bash[21573]: cluster 2024-03-30T15:08:15.707863+0000 mon.a (mon.0) 770 : cluster 0 osdmap e73: 8 total, 8 up, 8 in 2024-03-30T15:08:17.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:16 smithi072 bash[21573]: cluster 2024-03-30T15:08:15.781291+0000 mgr.y (mgr.14152) 382 : cluster 0 pgmap v364: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:08:17.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:16 smithi072 bash[28946]: cluster 2024-03-30T15:08:15.707863+0000 mon.a (mon.0) 770 : cluster 0 osdmap e73: 8 total, 8 up, 8 in 2024-03-30T15:08:17.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:16 smithi072 bash[28946]: cluster 2024-03-30T15:08:15.781291+0000 mgr.y (mgr.14152) 382 : cluster 0 pgmap v364: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:08:18.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:18 smithi072 bash[21573]: audit 2024-03-30T15:08:17.068980+0000 mgr.y (mgr.14152) 383 : audit 0 from='client.24418 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi072=a;smithi172=b", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T15:08:18.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:18 smithi072 bash[21573]: cephadm 2024-03-30T15:08:17.072686+0000 mgr.y (mgr.14152) 384 : cephadm 1 Saving service node-exporter spec with placement smithi072=a;smithi172=b;count:2 2024-03-30T15:08:18.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:18 smithi072 bash[21573]: audit 2024-03-30T15:08:17.080049+0000 mon.a (mon.0) 771 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:08:18.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:18 smithi072 bash[28946]: audit 2024-03-30T15:08:17.068980+0000 mgr.y (mgr.14152) 383 : audit 0 from='client.24418 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi072=a;smithi172=b", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T15:08:18.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:18 smithi072 bash[28946]: cephadm 2024-03-30T15:08:17.072686+0000 mgr.y (mgr.14152) 384 : cephadm 1 Saving service node-exporter spec with placement smithi072=a;smithi172=b;count:2 2024-03-30T15:08:18.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:18 smithi072 bash[28946]: audit 2024-03-30T15:08:17.080049+0000 mon.a (mon.0) 771 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:08:18.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:18 smithi172 bash[23680]: audit 2024-03-30T15:08:17.068980+0000 mgr.y (mgr.14152) 383 : audit 0 from='client.24418 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi072=a;smithi172=b", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T15:08:18.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:18 smithi172 bash[23680]: cephadm 2024-03-30T15:08:17.072686+0000 mgr.y (mgr.14152) 384 : cephadm 1 Saving service node-exporter spec with placement smithi072=a;smithi172=b;count:2 2024-03-30T15:08:18.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:18 smithi172 bash[23680]: audit 2024-03-30T15:08:17.080049+0000 mon.a (mon.0) 771 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:08:18.492 DEBUG:teuthology.orchestra.run.smithi072:node-exporter.a> sudo journalctl -f -n 0 -u ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@node-exporter.a.service 2024-03-30T15:08:18.495 DEBUG:teuthology.orchestra.run.smithi172:node-exporter.b> sudo journalctl -f -n 0 -u ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@node-exporter.b.service 2024-03-30T15:08:18.497 INFO:tasks.cephadm:Adding alertmanager.a on smithi072 2024-03-30T15:08:18.497 DEBUG:teuthology.orchestra.run.smithi172:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph orch apply alertmanager '1;smithi072=a' 2024-03-30T15:08:19.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:19 smithi172 bash[23680]: cluster 2024-03-30T15:08:17.782288+0000 mgr.y (mgr.14152) 385 : cluster 0 pgmap v365: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-03-30T15:08:19.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:19 smithi072 bash[21573]: cluster 2024-03-30T15:08:17.782288+0000 mgr.y (mgr.14152) 385 : cluster 0 pgmap v365: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-03-30T15:08:19.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:19 smithi072 bash[28946]: cluster 2024-03-30T15:08:17.782288+0000 mgr.y (mgr.14152) 385 : cluster 0 pgmap v365: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-03-30T15:08:20.199 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:20 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:20.199 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:08:20 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:20.199 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:08:20 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:20.200 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 30 15:08:20 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:20.200 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:08:20 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:20.200 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:08:20 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:20.200 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:08:20 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:20.201 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:08:20 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:20.201 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:08:20 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:20.453 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 30 15:08:20 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:20.454 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:08:20 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:20.454 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:08:20 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:20.455 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:08:20 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:20.455 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:08:20 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:20.455 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:08:20 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:20.455 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:08:20 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:20.455 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:20 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:20.456 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:08:20 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:20.717 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:08:20 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:08:20.717 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:08:20 smithi172 systemd[1]: Started Ceph prometheus.a for 97f8e564-eea5-11ee-b647-cb9ed24678a4. 2024-03-30T15:08:21.771 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:08:21 smithi172 bash[24582]: ignoring --setuser ceph since I am not root 2024-03-30T15:08:21.771 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:08:21 smithi172 bash[24582]: ignoring --setgroup ceph since I am not root 2024-03-30T15:08:21.772 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:21 smithi172 bash[23680]: cluster 2024-03-30T15:08:19.783209+0000 mgr.y (mgr.14152) 386 : cluster 0 pgmap v366: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 0 B/s, 0 objects/s recovering 2024-03-30T15:08:21.772 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:21 smithi172 bash[23680]: audit 2024-03-30T15:08:20.456625+0000 mgr.y (mgr.14152) 387 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:08:21.772 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:21 smithi172 bash[23680]: audit 2024-03-30T15:08:20.518278+0000 mon.a (mon.0) 772 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:08:21.772 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:21 smithi172 bash[23680]: audit 2024-03-30T15:08:20.531342+0000 mon.a (mon.0) 773 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:08:21.772 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:21 smithi172 bash[23680]: audit 2024-03-30T15:08:20.559529+0000 mon.a (mon.0) 774 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:08:21.772 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:21 smithi172 bash[23680]: audit 2024-03-30T15:08:20.567298+0000 mon.a (mon.0) 775 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-03-30T15:08:21.773 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:08:21 smithi172 bash[48881]: ts=2024-03-30T15:08:21.622Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-03-30T15:08:21.773 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:08:21 smithi172 bash[48881]: ts=2024-03-30T15:08:21.622Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-03-30T15:08:21.773 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:08:21 smithi172 bash[48881]: ts=2024-03-30T15:08:21.622Z caller=main.go:570 level=info host_details="(Linux 5.15.0-101-generic #111-Ubuntu SMP Tue Mar 5 20:16:58 UTC 2024 x86_64 smithi172 (none))" 2024-03-30T15:08:21.773 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:08:21 smithi172 bash[48881]: ts=2024-03-30T15:08:21.622Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-03-30T15:08:21.773 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:08:21 smithi172 bash[48881]: ts=2024-03-30T15:08:21.622Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-03-30T15:08:21.773 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:08:21 smithi172 bash[48881]: ts=2024-03-30T15:08:21.624Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-03-30T15:08:21.773 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:08:21 smithi172 bash[48881]: ts=2024-03-30T15:08:21.625Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-03-30T15:08:21.773 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:08:21 smithi172 bash[48881]: ts=2024-03-30T15:08:21.632Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-03-30T15:08:21.773 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:08:21 smithi172 bash[48881]: ts=2024-03-30T15:08:21.633Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-03-30T15:08:21.773 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:08:21 smithi172 bash[48881]: ts=2024-03-30T15:08:21.634Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-03-30T15:08:21.773 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:08:21 smithi172 bash[48881]: ts=2024-03-30T15:08:21.634Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.757µs 2024-03-30T15:08:21.773 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:08:21 smithi172 bash[48881]: ts=2024-03-30T15:08:21.634Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-03-30T15:08:21.774 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:08:21 smithi172 bash[48881]: ts=2024-03-30T15:08:21.634Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0 2024-03-30T15:08:21.774 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:08:21 smithi172 bash[48881]: ts=2024-03-30T15:08:21.634Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=46.807µs wal_replay_duration=215.808µs wbl_replay_duration=147ns total_replay_duration=316.747µs 2024-03-30T15:08:21.774 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:08:21 smithi172 bash[48881]: ts=2024-03-30T15:08:21.635Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-03-30T15:08:21.774 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:08:21 smithi172 bash[48881]: ts=2024-03-30T15:08:21.635Z caller=main.go:1029 level=info msg="TSDB started" 2024-03-30T15:08:21.774 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:08:21 smithi172 bash[48881]: ts=2024-03-30T15:08:21.635Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-03-30T15:08:21.774 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:08:21 smithi172 bash[48881]: ts=2024-03-30T15:08:21.636Z caller=refresh.go:80 level=error component="discovery manager scrape" discovery=http config=ceph msg="Unable to refresh target groups" err="Get \"http://172.21.15.72:8765/sd/prometheus/sd-config?service=mgr-prometheus\": dial tcp 172.21.15.72:8765: connect: connection refused" 2024-03-30T15:08:21.774 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:08:21 smithi172 bash[48881]: ts=2024-03-30T15:08:21.636Z caller=refresh.go:80 level=error component="discovery manager scrape" discovery=http config=ceph-exporter msg="Unable to refresh target groups" err="Get \"http://172.21.15.72:8765/sd/prometheus/sd-config?service=ceph-exporter\": dial tcp 172.21.15.72:8765: connect: connection refused" 2024-03-30T15:08:21.774 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:08:21 smithi172 bash[48881]: ts=2024-03-30T15:08:21.659Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=23.143955ms db_storage=977ns remote_storage=1.574µs web_handler=352ns query_engine=763ns scrape=277.123µs scrape_sd=88.327µs notify=1.264µs notify_sd=2.281µs rules=22.562434ms tracing=7.397µs 2024-03-30T15:08:21.774 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:08:21 smithi172 bash[48881]: ts=2024-03-30T15:08:21.659Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-03-30T15:08:21.774 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:08:21 smithi172 bash[48881]: ts=2024-03-30T15:08:21.659Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-03-30T15:08:21.775 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:08:21 smithi072 bash[21828]: ignoring --setuser ceph since I am not root 2024-03-30T15:08:21.775 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:08:21 smithi072 bash[21828]: ignoring --setgroup ceph since I am not root 2024-03-30T15:08:21.775 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:21 smithi072 bash[28946]: cluster 2024-03-30T15:08:19.783209+0000 mgr.y (mgr.14152) 386 : cluster 0 pgmap v366: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 0 B/s, 0 objects/s recovering 2024-03-30T15:08:21.775 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:21 smithi072 bash[28946]: audit 2024-03-30T15:08:20.456625+0000 mgr.y (mgr.14152) 387 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:08:21.775 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:21 smithi072 bash[28946]: audit 2024-03-30T15:08:20.518278+0000 mon.a (mon.0) 772 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:08:21.775 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:21 smithi072 bash[28946]: audit 2024-03-30T15:08:20.531342+0000 mon.a (mon.0) 773 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:08:21.776 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:21 smithi072 bash[28946]: audit 2024-03-30T15:08:20.559529+0000 mon.a (mon.0) 774 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:08:21.776 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:21 smithi072 bash[28946]: audit 2024-03-30T15:08:20.567298+0000 mon.a (mon.0) 775 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-03-30T15:08:21.776 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:21 smithi072 bash[21573]: cluster 2024-03-30T15:08:19.783209+0000 mgr.y (mgr.14152) 386 : cluster 0 pgmap v366: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 0 B/s, 0 objects/s recovering 2024-03-30T15:08:21.776 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:21 smithi072 bash[21573]: audit 2024-03-30T15:08:20.456625+0000 mgr.y (mgr.14152) 387 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:08:21.776 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:21 smithi072 bash[21573]: audit 2024-03-30T15:08:20.518278+0000 mon.a (mon.0) 772 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:08:21.776 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:21 smithi072 bash[21573]: audit 2024-03-30T15:08:20.531342+0000 mon.a (mon.0) 773 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:08:21.776 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:21 smithi072 bash[21573]: audit 2024-03-30T15:08:20.559529+0000 mon.a (mon.0) 774 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' 2024-03-30T15:08:21.776 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:21 smithi072 bash[21573]: audit 2024-03-30T15:08:20.567298+0000 mon.a (mon.0) 775 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-03-30T15:08:22.168 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:08:21 smithi072 bash[21828]: debug 2024-03-30T15:08:21.776+0000 7f175061d200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-30T15:08:22.216 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:08:21 smithi172 bash[24582]: debug 2024-03-30T15:08:21.772+0000 7f5beb029200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-30T15:08:22.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:22 smithi072 bash[28946]: audit 2024-03-30T15:08:21.559693+0000 mon.a (mon.0) 776 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-03-30T15:08:22.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:22 smithi072 bash[28946]: cluster 2024-03-30T15:08:21.573716+0000 mon.a (mon.0) 777 : cluster 0 mgrmap e17: y(active, since 10m), standbys: x 2024-03-30T15:08:22.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:22 smithi072 bash[21573]: audit 2024-03-30T15:08:21.559693+0000 mon.a (mon.0) 776 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-03-30T15:08:22.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:22 smithi072 bash[21573]: cluster 2024-03-30T15:08:21.573716+0000 mon.a (mon.0) 777 : cluster 0 mgrmap e17: y(active, since 10m), standbys: x 2024-03-30T15:08:22.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:22 smithi172 bash[23680]: audit 2024-03-30T15:08:21.559693+0000 mon.a (mon.0) 776 : audit 1 from='mgr.14152 172.21.15.72:0/3652981321' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-03-30T15:08:22.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:22 smithi172 bash[23680]: cluster 2024-03-30T15:08:21.573716+0000 mon.a (mon.0) 777 : cluster 0 mgrmap e17: y(active, since 10m), standbys: x 2024-03-30T15:08:23.298 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.b/config 2024-03-30T15:08:23.668 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:08:23 smithi072 bash[21828]: debug 2024-03-30T15:08:23.360+0000 7f175061d200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-30T15:08:23.668 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:08:23 smithi072 bash[21828]: debug 2024-03-30T15:08:23.456+0000 7f175061d200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-30T15:08:23.699 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:08:23 smithi172 bash[24582]: debug 2024-03-30T15:08:23.352+0000 7f5beb029200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-30T15:08:23.699 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:08:23 smithi172 bash[24582]: debug 2024-03-30T15:08:23.452+0000 7f5beb029200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-30T15:08:23.966 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:08:23 smithi172 bash[24582]: debug 2024-03-30T15:08:23.700+0000 7f5beb029200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-30T15:08:24.168 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:08:23 smithi072 bash[21828]: debug 2024-03-30T15:08:23.704+0000 7f175061d200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-30T15:08:24.716 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:08:24 smithi172 bash[24582]: debug 2024-03-30T15:08:24.504+0000 7f5beb029200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-30T15:08:24.717 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:08:24 smithi172 bash[24582]: debug 2024-03-30T15:08:24.620+0000 7f5beb029200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-30T15:08:24.918 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:08:24 smithi072 bash[21828]: debug 2024-03-30T15:08:24.504+0000 7f175061d200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-30T15:08:24.918 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:08:24 smithi072 bash[21828]: debug 2024-03-30T15:08:24.616+0000 7f175061d200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-30T15:08:24.918 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:08:24 smithi072 bash[21828]: debug 2024-03-30T15:08:24.720+0000 7f175061d200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-30T15:08:25.084 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:08:24 smithi172 bash[24582]: debug 2024-03-30T15:08:24.728+0000 7f5beb029200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-30T15:08:25.418 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:08:25 smithi072 bash[21828]: debug 2024-03-30T15:08:25.072+0000 7f175061d200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-30T15:08:25.418 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:08:25 smithi072 bash[21828]: debug 2024-03-30T15:08:25.188+0000 7f175061d200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-30T15:08:25.418 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:08:25 smithi072 bash[21828]: debug 2024-03-30T15:08:25.292+0000 7f175061d200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-30T15:08:25.467 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:08:25 smithi172 bash[24582]: debug 2024-03-30T15:08:25.084+0000 7f5beb029200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-30T15:08:25.467 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:08:25 smithi172 bash[24582]: debug 2024-03-30T15:08:25.200+0000 7f5beb029200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-30T15:08:25.467 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:08:25 smithi172 bash[24582]: debug 2024-03-30T15:08:25.304+0000 7f5beb029200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-30T15:08:25.918 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:08:25 smithi072 bash[21828]: debug 2024-03-30T15:08:25.648+0000 7f175061d200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-30T15:08:25.918 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:08:25 smithi072 bash[21828]: debug 2024-03-30T15:08:25.888+0000 7f175061d200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-30T15:08:25.966 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:08:25 smithi172 bash[24582]: debug 2024-03-30T15:08:25.664+0000 7f5beb029200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-30T15:08:25.967 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:08:25 smithi172 bash[24582]: debug 2024-03-30T15:08:25.908+0000 7f5beb029200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-30T15:08:26.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:26.304+0000 7fe0c6c42700 1 -- 172.21.15.172:0/4005684401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0c01011c0 msgr2=0x7fe0c01015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:08:26.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:26.304+0000 7fe0c6c42700 1 --2- 172.21.15.172:0/4005684401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0c01011c0 0x7fe0c01015e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc0099c0 tx=0x7fe0bc009cd0 comp rx=0 tx=0).stop 2024-03-30T15:08:26.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:26.304+0000 7fe0c6c42700 1 -- 172.21.15.172:0/4005684401 shutdown_connections 2024-03-30T15:08:26.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:26.304+0000 7fe0c6c42700 1 --2- 172.21.15.172:0/4005684401 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0c0102d60 0x7fe0c0109610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:08:26.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:26.304+0000 7fe0c6c42700 1 --2- 172.21.15.172:0/4005684401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0c01011c0 0x7fe0c01015e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:08:26.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:26.304+0000 7fe0c6c42700 1 --2- 172.21.15.172:0/4005684401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0c01023c0 0x7fe0c0102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:08:26.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:26.304+0000 7fe0c6c42700 1 -- 172.21.15.172:0/4005684401 >> 172.21.15.172:0/4005684401 conn(0x7fe0c00fc760 msgr2=0x7fe0c00feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:08:26.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:26.304+0000 7fe0c6c42700 1 -- 172.21.15.172:0/4005684401 shutdown_connections 2024-03-30T15:08:26.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:26.304+0000 7fe0c6c42700 1 -- 172.21.15.172:0/4005684401 wait complete. 2024-03-30T15:08:26.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:26.304+0000 7fe0c6c42700 1 Processor -- start 2024-03-30T15:08:26.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:26.304+0000 7fe0c6c42700 1 -- start start 2024-03-30T15:08:26.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:26.304+0000 7fe0c6c42700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0c01011c0 0x7fe0c0197bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:08:26.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:26.304+0000 7fe0c6c42700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0c01023c0 0x7fe0c0198130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:08:26.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:26.304+0000 7fe0c6c42700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0c0102d60 0x7fe0c019f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:08:26.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:26.304+0000 7fe0c6c42700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c010c2f0 con 0x7fe0c0102d60 2024-03-30T15:08:26.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:26.304+0000 7fe0c6c42700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c010c170 con 0x7fe0c01011c0 2024-03-30T15:08:26.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:26.304+0000 7fe0c6c42700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fe0c010c470 con 0x7fe0c01023c0 2024-03-30T15:08:26.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:26.304+0000 7fe0c49de700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0c01011c0 0x7fe0c0197bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:08:26.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:26.304+0000 7fe0c49de700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0c01011c0 0x7fe0c0197bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49312/0 (socket says 172.21.15.172:49312) 2024-03-30T15:08:26.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:26.304+0000 7fe0c49de700 1 -- 172.21.15.172:0/252469207 learned_addr learned my addr 172.21.15.172:0/252469207 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-03-30T15:08:26.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:26.304+0000 7fe0b7fff700 1 --2- 172.21.15.172:0/252469207 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0c01023c0 0x7fe0c0198130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:08:26.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:26.304+0000 7fe0c51df700 1 --2- 172.21.15.172:0/252469207 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0c0102d60 0x7fe0c019f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:08:26.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:26.304+0000 7fe0c49de700 1 -- 172.21.15.172:0/252469207 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0c01023c0 msgr2=0x7fe0c0198130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:08:26.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:26.304+0000 7fe0c49de700 1 --2- 172.21.15.172:0/252469207 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0c01023c0 0x7fe0c0198130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:08:26.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:26.304+0000 7fe0c49de700 1 -- 172.21.15.172:0/252469207 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0c0102d60 msgr2=0x7fe0c019f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:08:26.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:26.304+0000 7fe0c49de700 1 --2- 172.21.15.172:0/252469207 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0c0102d60 0x7fe0c019f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:08:26.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:26.304+0000 7fe0c49de700 1 -- 172.21.15.172:0/252469207 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0c019f800 con 0x7fe0c01011c0 2024-03-30T15:08:26.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:26.304+0000 7fe0c49de700 1 --2- 172.21.15.172:0/252469207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0c01011c0 0x7fe0c0197bf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc0047b0 tx=0x7fe0bc00bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:08:26.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:26.304+0000 7fe0b5ffb700 1 -- 172.21.15.172:0/252469207 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc027070 con 0x7fe0c01011c0 2024-03-30T15:08:26.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:26.304+0000 7fe0c6c42700 1 -- 172.21.15.172:0/252469207 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0c019fa90 con 0x7fe0c01011c0 2024-03-30T15:08:26.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:26.304+0000 7fe0b5ffb700 1 -- 172.21.15.172:0/252469207 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7fe0bc022470 con 0x7fe0c01011c0 2024-03-30T15:08:26.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:26.304+0000 7fe0b5ffb700 1 -- 172.21.15.172:0/252469207 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc00f6c0 con 0x7fe0c01011c0 2024-03-30T15:08:26.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:26.304+0000 7fe0c6c42700 1 -- 172.21.15.172:0/252469207 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0c019ffc0 con 0x7fe0c01011c0 2024-03-30T15:08:26.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:26.304+0000 7fe0c6c42700 1 -- 172.21.15.172:0/252469207 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0c004ff00 con 0x7fe0c01011c0 2024-03-30T15:08:26.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:26.308+0000 7fe0b5ffb700 1 -- 172.21.15.172:0/252469207 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 17) ==== 91839+0+0 (secure 0 0 0) 0x7fe0bc02a070 con 0x7fe0c01011c0 2024-03-30T15:08:26.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:26.308+0000 7fe0b5ffb700 1 --2- 172.21.15.172:0/252469207 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fe0a806db10 0x7fe0a806ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:08:26.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:26.308+0000 7fe0b7fff700 1 -- 172.21.15.172:0/252469207 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fe0a806db10 msgr2=0x7fe0a806ffd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/2777002311 2024-03-30T15:08:26.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:26.308+0000 7fe0b5ffb700 1 -- 172.21.15.172:0/252469207 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7236+0+0 (secure 0 0 0) 0x7fe0bc08ebf0 con 0x7fe0c01011c0 2024-03-30T15:08:26.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:26.308+0000 7fe0b7fff700 1 --2- 172.21.15.172:0/252469207 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fe0a806db10 0x7fe0a806ffd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-30T15:08:26.309 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:26.312+0000 7fe0b5ffb700 1 -- 172.21.15.172:0/252469207 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fe0bc013070 con 0x7fe0c01011c0 2024-03-30T15:08:26.418 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:08:26 smithi072 bash[21828]: debug 2024-03-30T15:08:26.152+0000 7f175061d200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-30T15:08:26.418 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:08:26 smithi072 bash[21828]: debug 2024-03-30T15:08:26.264+0000 7f175061d200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-30T15:08:26.466 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:08:26 smithi172 bash[24582]: debug 2024-03-30T15:08:26.180+0000 7f5beb029200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-30T15:08:26.466 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:08:26 smithi172 bash[24582]: debug 2024-03-30T15:08:26.296+0000 7f5beb029200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-30T15:08:26.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:26.512+0000 7fe0b7fff700 1 -- 172.21.15.172:0/252469207 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fe0a806db10 msgr2=0x7fe0a806ffd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/2777002311 2024-03-30T15:08:26.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:26.512+0000 7fe0b7fff700 1 --2- 172.21.15.172:0/252469207 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fe0a806db10 0x7fe0a806ffd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-30T15:08:26.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:26.536+0000 7fe0c6c42700 1 -- 172.21.15.172:0/252469207 --> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi072=a", "target": ["mon-mgr", ""]}) -- 0x7fe0c002df50 con 0x7fe0a806db10 2024-03-30T15:08:26.913 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:26.916+0000 7fe0b7fff700 1 -- 172.21.15.172:0/252469207 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fe0a806db10 msgr2=0x7fe0a806ffd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/2777002311 2024-03-30T15:08:26.913 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:26.916+0000 7fe0b7fff700 1 --2- 172.21.15.172:0/252469207 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fe0a806db10 0x7fe0a806ffd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-30T15:08:26.918 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:08:26 smithi072 bash[21828]: debug 2024-03-30T15:08:26.544+0000 7f175061d200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-30T15:08:26.966 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:08:26 smithi172 bash[24582]: debug 2024-03-30T15:08:26.580+0000 7f5beb029200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-30T15:08:27.319 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:08:26 smithi072 bash[21828]: debug 2024-03-30T15:08:26.956+0000 7f175061d200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-30T15:08:27.319 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:08:27 smithi072 bash[21828]: debug 2024-03-30T15:08:27.200+0000 7f175061d200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-30T15:08:27.350 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:08:26 smithi172 bash[24582]: debug 2024-03-30T15:08:26.996+0000 7f5beb029200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-30T15:08:27.350 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:08:27 smithi172 bash[24582]: debug 2024-03-30T15:08:27.236+0000 7f5beb029200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-30T15:08:27.571 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:08:27 smithi072 bash[21828]: debug 2024-03-30T15:08:27.320+0000 7f175061d200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-30T15:08:27.717 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:08:27 smithi172 bash[24582]: debug 2024-03-30T15:08:27.352+0000 7f5beb029200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-30T15:08:27.717 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:08:27 smithi172 bash[24582]: debug 2024-03-30T15:08:27.600+0000 7f5beb029200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-30T15:08:27.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:27.720+0000 7fe0b7fff700 1 -- 172.21.15.172:0/252469207 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fe0a806db10 msgr2=0x7fe0a806ffd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/2777002311 2024-03-30T15:08:27.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:27.720+0000 7fe0b7fff700 1 --2- 172.21.15.172:0/252469207 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fe0a806db10 0x7fe0a806ffd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-30T15:08:27.918 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:08:27 smithi072 bash[21828]: debug 2024-03-30T15:08:27.572+0000 7f175061d200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-30T15:08:28.918 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:08:28 smithi072 bash[21828]: debug 2024-03-30T15:08:28.580+0000 7f175061d200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-30T15:08:28.918 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:08:28 smithi072 bash[21828]: debug 2024-03-30T15:08:28.696+0000 7f175061d200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-30T15:08:28.966 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:08:28 smithi172 bash[24582]: debug 2024-03-30T15:08:28.612+0000 7f5beb029200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-30T15:08:28.967 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:08:28 smithi172 bash[24582]: debug 2024-03-30T15:08:28.728+0000 7f5beb029200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-30T15:08:29.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:29.324+0000 7fe0b7fff700 1 -- 172.21.15.172:0/252469207 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fe0a806db10 msgr2=0x7fe0a806ffd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/2777002311 2024-03-30T15:08:29.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:29.324+0000 7fe0b7fff700 1 --2- 172.21.15.172:0/252469207 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fe0a806db10 0x7fe0a806ffd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-03-30T15:08:29.418 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:08:28 smithi072 bash[21828]: debug 2024-03-30T15:08:28.992+0000 7f175061d200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-30T15:08:29.418 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[21828]: debug 2024-03-30T15:08:29.108+0000 7f175061d200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-30T15:08:29.466 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:08:29 smithi172 bash[24582]: debug 2024-03-30T15:08:29.020+0000 7f5beb029200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-30T15:08:29.466 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:08:29 smithi172 bash[24582]: debug 2024-03-30T15:08:29.132+0000 7f5beb029200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-30T15:08:29.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:29.720+0000 7fe0b5ffb700 1 -- 172.21.15.172:0/252469207 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mgrmap(e 18) ==== 91456+0+0 (secure 0 0 0) 0x7fe0bc0581f0 con 0x7fe0c01011c0 2024-03-30T15:08:29.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:29.720+0000 7fe0b5ffb700 1 -- 172.21.15.172:0/252469207 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fe0a806db10 msgr2=0x7fe0a806ffd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-30T15:08:29.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:29.720+0000 7fe0b5ffb700 1 --2- 172.21.15.172:0/252469207 >> [v2:172.21.15.72:6800/2777002311,v1:172.21.15.72:6801/2777002311] conn(0x7fe0a806db10 0x7fe0a806ffd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:08:29.833 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:08:29 smithi172 bash[24582]: debug 2024-03-30T15:08:29.584+0000 7f5beb029200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-30T15:08:29.834 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:08:29 smithi172 bash[24582]: debug 2024-03-30T15:08:29.704+0000 7f5beb029200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-30T15:08:29.834 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:08:29 smithi172 bash[24582]: [30/Mar/2024:15:08:29] ENGINE Bus STARTING 2024-03-30T15:08:29.834 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:29 smithi172 bash[23680]: cluster 2024-03-30T15:08:29.706875+0000 mon.a (mon.0) 778 : cluster 1 Active manager daemon y restarted 2024-03-30T15:08:29.834 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:29 smithi172 bash[23680]: cluster 2024-03-30T15:08:29.707549+0000 mon.a (mon.0) 779 : cluster 1 Activating manager daemon y 2024-03-30T15:08:29.834 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:29 smithi172 bash[23680]: cluster 2024-03-30T15:08:29.716834+0000 mon.a (mon.0) 780 : cluster 0 osdmap e74: 8 total, 8 up, 8 in 2024-03-30T15:08:29.835 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:29 smithi172 bash[23680]: cluster 2024-03-30T15:08:29.717259+0000 mon.a (mon.0) 781 : cluster 0 mgrmap e18: y(active, starting, since 0.0099205s), standbys: x 2024-03-30T15:08:29.835 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:29 smithi172 bash[23680]: audit 2024-03-30T15:08:29.728024+0000 mon.c (mon.2) 24 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T15:08:29.835 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:29 smithi172 bash[23680]: audit 2024-03-30T15:08:29.728467+0000 mon.c (mon.2) 25 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T15:08:29.835 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:29 smithi172 bash[23680]: cluster 2024-03-30T15:08:29.728909+0000 mon.a (mon.0) 782 : cluster 0 Standby manager daemon x restarted 2024-03-30T15:08:29.835 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:29 smithi172 bash[23680]: audit 2024-03-30T15:08:29.729034+0000 mon.c (mon.2) 26 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T15:08:29.835 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:29 smithi172 bash[23680]: cluster 2024-03-30T15:08:29.729194+0000 mon.a (mon.0) 783 : cluster 0 Standby manager daemon x started 2024-03-30T15:08:29.835 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:29 smithi172 bash[23680]: audit 2024-03-30T15:08:29.730601+0000 mon.c (mon.2) 27 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-30T15:08:29.835 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:29 smithi172 bash[23680]: audit 2024-03-30T15:08:29.731078+0000 mon.c (mon.2) 28 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-30T15:08:29.835 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:29 smithi172 bash[23680]: audit 2024-03-30T15:08:29.731722+0000 mon.c (mon.2) 29 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T15:08:29.835 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:29 smithi172 bash[23680]: audit 2024-03-30T15:08:29.732414+0000 mon.c (mon.2) 30 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T15:08:29.835 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:29 smithi172 bash[23680]: audit 2024-03-30T15:08:29.733162+0000 mon.c (mon.2) 31 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T15:08:29.835 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:29 smithi172 bash[23680]: audit 2024-03-30T15:08:29.733851+0000 mon.c (mon.2) 32 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T15:08:29.835 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:29 smithi172 bash[23680]: audit 2024-03-30T15:08:29.734113+0000 mon.b (mon.1) 29 : audit 0 from='mgr.? 172.21.15.172:0/4119031910' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T15:08:29.836 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:29 smithi172 bash[23680]: audit 2024-03-30T15:08:29.734580+0000 mon.c (mon.2) 33 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T15:08:29.836 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:29 smithi172 bash[23680]: audit 2024-03-30T15:08:29.735038+0000 mon.b (mon.1) 30 : audit 0 from='mgr.? 172.21.15.172:0/4119031910' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T15:08:29.836 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:29 smithi172 bash[23680]: audit 2024-03-30T15:08:29.735317+0000 mon.c (mon.2) 34 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T15:08:29.836 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:29 smithi172 bash[23680]: audit 2024-03-30T15:08:29.735979+0000 mon.c (mon.2) 35 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T15:08:29.836 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:29 smithi172 bash[23680]: audit 2024-03-30T15:08:29.736670+0000 mon.c (mon.2) 36 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T15:08:29.836 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:29 smithi172 bash[23680]: audit 2024-03-30T15:08:29.737447+0000 mon.c (mon.2) 37 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-30T15:08:29.836 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:29 smithi172 bash[23680]: audit 2024-03-30T15:08:29.737702+0000 mon.b (mon.1) 31 : audit 0 from='mgr.? 172.21.15.172:0/4119031910' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T15:08:29.836 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:29 smithi172 bash[23680]: audit 2024-03-30T15:08:29.737938+0000 mon.c (mon.2) 38 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-30T15:08:29.837 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:29 smithi172 bash[23680]: audit 2024-03-30T15:08:29.738300+0000 mon.b (mon.1) 32 : audit 0 from='mgr.? 172.21.15.172:0/4119031910' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T15:08:29.837 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:29 smithi172 bash[23680]: audit 2024-03-30T15:08:29.739262+0000 mon.c (mon.2) 39 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-30T15:08:29.839 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[21828]: debug 2024-03-30T15:08:29.560+0000 7f175061d200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-30T15:08:29.840 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[21828]: debug 2024-03-30T15:08:29.684+0000 7f175061d200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-30T15:08:29.840 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[21573]: cluster 2024-03-30T15:08:29.706875+0000 mon.a (mon.0) 778 : cluster 1 Active manager daemon y restarted 2024-03-30T15:08:29.840 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[21573]: cluster 2024-03-30T15:08:29.707549+0000 mon.a (mon.0) 779 : cluster 1 Activating manager daemon y 2024-03-30T15:08:29.840 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[21573]: cluster 2024-03-30T15:08:29.716834+0000 mon.a (mon.0) 780 : cluster 0 osdmap e74: 8 total, 8 up, 8 in 2024-03-30T15:08:29.840 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[21573]: cluster 2024-03-30T15:08:29.717259+0000 mon.a (mon.0) 781 : cluster 0 mgrmap e18: y(active, starting, since 0.0099205s), standbys: x 2024-03-30T15:08:29.841 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[21573]: audit 2024-03-30T15:08:29.728024+0000 mon.c (mon.2) 24 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T15:08:29.841 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[21573]: audit 2024-03-30T15:08:29.728467+0000 mon.c (mon.2) 25 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T15:08:29.841 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[21573]: cluster 2024-03-30T15:08:29.728909+0000 mon.a (mon.0) 782 : cluster 0 Standby manager daemon x restarted 2024-03-30T15:08:29.841 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[21573]: audit 2024-03-30T15:08:29.729034+0000 mon.c (mon.2) 26 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T15:08:29.841 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[21573]: cluster 2024-03-30T15:08:29.729194+0000 mon.a (mon.0) 783 : cluster 0 Standby manager daemon x started 2024-03-30T15:08:29.841 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[21573]: audit 2024-03-30T15:08:29.730601+0000 mon.c (mon.2) 27 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-30T15:08:29.841 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[21573]: audit 2024-03-30T15:08:29.731078+0000 mon.c (mon.2) 28 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-30T15:08:29.841 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[21573]: audit 2024-03-30T15:08:29.731722+0000 mon.c (mon.2) 29 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T15:08:29.841 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[21573]: audit 2024-03-30T15:08:29.732414+0000 mon.c (mon.2) 30 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T15:08:29.841 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[21573]: audit 2024-03-30T15:08:29.733162+0000 mon.c (mon.2) 31 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T15:08:29.841 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[21573]: audit 2024-03-30T15:08:29.733851+0000 mon.c (mon.2) 32 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T15:08:29.841 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[21573]: audit 2024-03-30T15:08:29.734113+0000 mon.b (mon.1) 29 : audit 0 from='mgr.? 172.21.15.172:0/4119031910' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T15:08:29.841 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[21573]: audit 2024-03-30T15:08:29.734580+0000 mon.c (mon.2) 33 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T15:08:29.841 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[21573]: audit 2024-03-30T15:08:29.735038+0000 mon.b (mon.1) 30 : audit 0 from='mgr.? 172.21.15.172:0/4119031910' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T15:08:29.841 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[21573]: audit 2024-03-30T15:08:29.735317+0000 mon.c (mon.2) 34 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T15:08:29.842 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[21573]: audit 2024-03-30T15:08:29.735979+0000 mon.c (mon.2) 35 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T15:08:29.842 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[21573]: audit 2024-03-30T15:08:29.736670+0000 mon.c (mon.2) 36 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T15:08:29.842 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[21573]: audit 2024-03-30T15:08:29.737447+0000 mon.c (mon.2) 37 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-30T15:08:29.842 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[21573]: audit 2024-03-30T15:08:29.737702+0000 mon.b (mon.1) 31 : audit 0 from='mgr.? 172.21.15.172:0/4119031910' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T15:08:29.842 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[21573]: audit 2024-03-30T15:08:29.737938+0000 mon.c (mon.2) 38 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-30T15:08:29.842 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[21573]: audit 2024-03-30T15:08:29.738300+0000 mon.b (mon.1) 32 : audit 0 from='mgr.? 172.21.15.172:0/4119031910' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T15:08:29.842 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[21573]: audit 2024-03-30T15:08:29.739262+0000 mon.c (mon.2) 39 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-30T15:08:29.842 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[28946]: cluster 2024-03-30T15:08:29.706875+0000 mon.a (mon.0) 778 : cluster 1 Active manager daemon y restarted 2024-03-30T15:08:29.842 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[28946]: cluster 2024-03-30T15:08:29.707549+0000 mon.a (mon.0) 779 : cluster 1 Activating manager daemon y 2024-03-30T15:08:29.843 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[28946]: cluster 2024-03-30T15:08:29.716834+0000 mon.a (mon.0) 780 : cluster 0 osdmap e74: 8 total, 8 up, 8 in 2024-03-30T15:08:29.843 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[28946]: cluster 2024-03-30T15:08:29.717259+0000 mon.a (mon.0) 781 : cluster 0 mgrmap e18: y(active, starting, since 0.0099205s), standbys: x 2024-03-30T15:08:29.843 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[28946]: audit 2024-03-30T15:08:29.728024+0000 mon.c (mon.2) 24 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T15:08:29.843 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[28946]: audit 2024-03-30T15:08:29.728467+0000 mon.c (mon.2) 25 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T15:08:29.843 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[28946]: cluster 2024-03-30T15:08:29.728909+0000 mon.a (mon.0) 782 : cluster 0 Standby manager daemon x restarted 2024-03-30T15:08:29.843 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[28946]: audit 2024-03-30T15:08:29.729034+0000 mon.c (mon.2) 26 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T15:08:29.843 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[28946]: cluster 2024-03-30T15:08:29.729194+0000 mon.a (mon.0) 783 : cluster 0 Standby manager daemon x started 2024-03-30T15:08:29.843 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[28946]: audit 2024-03-30T15:08:29.730601+0000 mon.c (mon.2) 27 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-30T15:08:29.843 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[28946]: audit 2024-03-30T15:08:29.731078+0000 mon.c (mon.2) 28 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-30T15:08:29.843 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[28946]: audit 2024-03-30T15:08:29.731722+0000 mon.c (mon.2) 29 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T15:08:29.843 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[28946]: audit 2024-03-30T15:08:29.732414+0000 mon.c (mon.2) 30 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T15:08:29.843 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[28946]: audit 2024-03-30T15:08:29.733162+0000 mon.c (mon.2) 31 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T15:08:29.843 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[28946]: audit 2024-03-30T15:08:29.733851+0000 mon.c (mon.2) 32 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T15:08:29.844 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[28946]: audit 2024-03-30T15:08:29.734113+0000 mon.b (mon.1) 29 : audit 0 from='mgr.? 172.21.15.172:0/4119031910' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T15:08:29.844 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[28946]: audit 2024-03-30T15:08:29.734580+0000 mon.c (mon.2) 33 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T15:08:29.844 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[28946]: audit 2024-03-30T15:08:29.735038+0000 mon.b (mon.1) 30 : audit 0 from='mgr.? 172.21.15.172:0/4119031910' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T15:08:29.844 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[28946]: audit 2024-03-30T15:08:29.735317+0000 mon.c (mon.2) 34 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T15:08:29.844 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[28946]: audit 2024-03-30T15:08:29.735979+0000 mon.c (mon.2) 35 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T15:08:29.844 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[28946]: audit 2024-03-30T15:08:29.736670+0000 mon.c (mon.2) 36 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T15:08:29.844 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[28946]: audit 2024-03-30T15:08:29.737447+0000 mon.c (mon.2) 37 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-30T15:08:29.844 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[28946]: audit 2024-03-30T15:08:29.737702+0000 mon.b (mon.1) 31 : audit 0 from='mgr.? 172.21.15.172:0/4119031910' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T15:08:29.844 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[28946]: audit 2024-03-30T15:08:29.737938+0000 mon.c (mon.2) 38 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-30T15:08:29.844 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[28946]: audit 2024-03-30T15:08:29.738300+0000 mon.b (mon.1) 32 : audit 0 from='mgr.? 172.21.15.172:0/4119031910' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T15:08:29.844 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[28946]: audit 2024-03-30T15:08:29.739262+0000 mon.c (mon.2) 39 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-30T15:08:30.168 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[21828]: [30/Mar/2024:15:08:29] ENGINE Bus STARTING 2024-03-30T15:08:30.168 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[21828]: CherryPy Checker: 2024-03-30T15:08:30.168 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[21828]: The Application mounted at '' has an empty config. 2024-03-30T15:08:30.168 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[21828]: [30/Mar/2024:15:08:29] ENGINE Serving on http://:::9283 2024-03-30T15:08:30.168 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:08:29 smithi072 bash[21828]: [30/Mar/2024:15:08:29] ENGINE Bus STARTED 2024-03-30T15:08:30.216 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:08:29 smithi172 bash[24582]: CherryPy Checker: 2024-03-30T15:08:30.217 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:08:29 smithi172 bash[24582]: The Application mounted at '' has an empty config. 2024-03-30T15:08:30.217 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:08:29 smithi172 bash[24582]: [30/Mar/2024:15:08:29] ENGINE Serving on http://:::9283 2024-03-30T15:08:30.217 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:08:29 smithi172 bash[24582]: [30/Mar/2024:15:08:29] ENGINE Bus STARTED 2024-03-30T15:08:30.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:30.728+0000 7fe0b5ffb700 1 -- 172.21.15.172:0/252469207 <== mon.1 v2:172.21.15.172:3300/0 8 ==== mgrmap(e 19) ==== 91583+0+0 (secure 0 0 0) 0x7fe0bc064070 con 0x7fe0c01011c0 2024-03-30T15:08:30.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:30.732+0000 7fe0b5ffb700 1 --2- 172.21.15.172:0/252469207 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fe0a8077410 0x7fe0a8079800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:08:30.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:30.732+0000 7fe0b5ffb700 1 -- 172.21.15.172:0/252469207 --> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi072=a", "target": ["mon-mgr", ""]}) -- 0x7fe0bc0576e0 con 0x7fe0a8077410 2024-03-30T15:08:30.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:30.732+0000 7fe0b7fff700 1 --2- 172.21.15.172:0/252469207 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fe0a8077410 0x7fe0a8079800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:08:30.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:30.732+0000 7fe0b7fff700 1 --2- 172.21.15.172:0/252469207 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fe0a8077410 0x7fe0a8079800 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0006b30 tx=0x7fe0b0006ac0 comp rx=0 tx=0).ready entity=mgr.14526 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:08:30.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:30.752+0000 7fe0b5ffb700 1 -- 172.21.15.172:0/252469207 <== mgr.14526 v2:172.21.15.72:6800/2033000132 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+33 (secure 0 0 0) 0x7fe0bc0576e0 con 0x7fe0a8077410 2024-03-30T15:08:30.750 INFO:teuthology.orchestra.run.smithi172.stdout:Scheduled alertmanager update... 2024-03-30T15:08:30.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:30.756+0000 7fe0c6c42700 1 -- 172.21.15.172:0/252469207 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fe0a8077410 msgr2=0x7fe0a8079800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:08:30.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:30.756+0000 7fe0c6c42700 1 --2- 172.21.15.172:0/252469207 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fe0a8077410 0x7fe0a8079800 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0006b30 tx=0x7fe0b0006ac0 comp rx=0 tx=0).stop 2024-03-30T15:08:30.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:30.756+0000 7fe0c6c42700 1 -- 172.21.15.172:0/252469207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0c01011c0 msgr2=0x7fe0c0197bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:08:30.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:30.756+0000 7fe0c6c42700 1 --2- 172.21.15.172:0/252469207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0c01011c0 0x7fe0c0197bf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc0047b0 tx=0x7fe0bc00bfd0 comp rx=0 tx=0).stop 2024-03-30T15:08:30.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:30.756+0000 7fe0c51df700 1 -- 172.21.15.172:0/252469207 reap_dead start 2024-03-30T15:08:30.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:30.756+0000 7fe0c6c42700 1 -- 172.21.15.172:0/252469207 shutdown_connections 2024-03-30T15:08:30.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:30.756+0000 7fe0c6c42700 1 -- 172.21.15.172:0/252469207 >> 172.21.15.172:0/252469207 conn(0x7fe0c00fc760 msgr2=0x7fe0c00ffac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:08:30.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:30.756+0000 7fe0c6c42700 1 -- 172.21.15.172:0/252469207 shutdown_connections 2024-03-30T15:08:30.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:30.756+0000 7fe0c6c42700 1 -- 172.21.15.172:0/252469207 wait complete. 2024-03-30T15:08:31.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:30 smithi072 bash[21573]: cluster 2024-03-30T15:08:29.766329+0000 mon.a (mon.0) 784 : cluster 1 Manager daemon y is now available 2024-03-30T15:08:31.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:30 smithi072 bash[21573]: audit 2024-03-30T15:08:29.805083+0000 mon.c (mon.2) 40 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:08:31.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:30 smithi072 bash[21573]: audit 2024-03-30T15:08:29.823676+0000 mon.a (mon.0) 785 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:31.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:30 smithi072 bash[21573]: audit 2024-03-30T15:08:29.842309+0000 mon.c (mon.2) 41 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:08:31.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:30 smithi072 bash[21573]: audit 2024-03-30T15:08:29.847957+0000 mon.c (mon.2) 42 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T15:08:31.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:30 smithi072 bash[21573]: audit 2024-03-30T15:08:29.848298+0000 mon.a (mon.0) 786 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T15:08:31.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:30 smithi072 bash[21573]: audit 2024-03-30T15:08:29.871036+0000 mon.c (mon.2) 43 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T15:08:31.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:30 smithi072 bash[21573]: audit 2024-03-30T15:08:29.871465+0000 mon.a (mon.0) 787 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T15:08:31.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:30 smithi072 bash[21573]: cephadm 2024-03-30T15:08:30.501754+0000 mgr.y (mgr.14526) 1 : cephadm 1 [30/Mar/2024:15:08:30] ENGINE Bus STARTING 2024-03-30T15:08:31.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:30 smithi072 bash[21573]: cephadm 2024-03-30T15:08:30.620459+0000 mgr.y (mgr.14526) 2 : cephadm 1 [30/Mar/2024:15:08:30] ENGINE Serving on https://172.21.15.72:7150 2024-03-30T15:08:31.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:30 smithi072 bash[21573]: cluster 2024-03-30T15:08:30.725865+0000 mon.a (mon.0) 788 : cluster 0 mgrmap e19: y(active, since 1.01852s), standbys: x 2024-03-30T15:08:31.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:30 smithi072 bash[21573]: audit 2024-03-30T15:08:30.751175+0000 mon.a (mon.0) 789 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:31.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:30 smithi072 bash[28946]: cluster 2024-03-30T15:08:29.766329+0000 mon.a (mon.0) 784 : cluster 1 Manager daemon y is now available 2024-03-30T15:08:31.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:30 smithi072 bash[28946]: audit 2024-03-30T15:08:29.805083+0000 mon.c (mon.2) 40 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:08:31.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:30 smithi072 bash[28946]: audit 2024-03-30T15:08:29.823676+0000 mon.a (mon.0) 785 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:31.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:30 smithi072 bash[28946]: audit 2024-03-30T15:08:29.842309+0000 mon.c (mon.2) 41 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:08:31.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:30 smithi072 bash[28946]: audit 2024-03-30T15:08:29.847957+0000 mon.c (mon.2) 42 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T15:08:31.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:30 smithi072 bash[28946]: audit 2024-03-30T15:08:29.848298+0000 mon.a (mon.0) 786 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T15:08:31.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:30 smithi072 bash[28946]: audit 2024-03-30T15:08:29.871036+0000 mon.c (mon.2) 43 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T15:08:31.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:30 smithi072 bash[28946]: audit 2024-03-30T15:08:29.871465+0000 mon.a (mon.0) 787 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T15:08:31.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:30 smithi072 bash[28946]: cephadm 2024-03-30T15:08:30.501754+0000 mgr.y (mgr.14526) 1 : cephadm 1 [30/Mar/2024:15:08:30] ENGINE Bus STARTING 2024-03-30T15:08:31.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:30 smithi072 bash[28946]: cephadm 2024-03-30T15:08:30.620459+0000 mgr.y (mgr.14526) 2 : cephadm 1 [30/Mar/2024:15:08:30] ENGINE Serving on https://172.21.15.72:7150 2024-03-30T15:08:31.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:30 smithi072 bash[28946]: cluster 2024-03-30T15:08:30.725865+0000 mon.a (mon.0) 788 : cluster 0 mgrmap e19: y(active, since 1.01852s), standbys: x 2024-03-30T15:08:31.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:30 smithi072 bash[28946]: audit 2024-03-30T15:08:30.751175+0000 mon.a (mon.0) 789 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:31.217 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:08:30 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:08:31.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:30 smithi172 bash[23680]: cluster 2024-03-30T15:08:29.766329+0000 mon.a (mon.0) 784 : cluster 1 Manager daemon y is now available 2024-03-30T15:08:31.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:30 smithi172 bash[23680]: audit 2024-03-30T15:08:29.805083+0000 mon.c (mon.2) 40 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:08:31.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:30 smithi172 bash[23680]: audit 2024-03-30T15:08:29.823676+0000 mon.a (mon.0) 785 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:31.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:30 smithi172 bash[23680]: audit 2024-03-30T15:08:29.842309+0000 mon.c (mon.2) 41 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:08:31.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:30 smithi172 bash[23680]: audit 2024-03-30T15:08:29.847957+0000 mon.c (mon.2) 42 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T15:08:31.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:30 smithi172 bash[23680]: audit 2024-03-30T15:08:29.848298+0000 mon.a (mon.0) 786 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T15:08:31.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:30 smithi172 bash[23680]: audit 2024-03-30T15:08:29.871036+0000 mon.c (mon.2) 43 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T15:08:31.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:30 smithi172 bash[23680]: audit 2024-03-30T15:08:29.871465+0000 mon.a (mon.0) 787 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T15:08:31.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:30 smithi172 bash[23680]: cephadm 2024-03-30T15:08:30.501754+0000 mgr.y (mgr.14526) 1 : cephadm 1 [30/Mar/2024:15:08:30] ENGINE Bus STARTING 2024-03-30T15:08:31.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:30 smithi172 bash[23680]: cephadm 2024-03-30T15:08:30.620459+0000 mgr.y (mgr.14526) 2 : cephadm 1 [30/Mar/2024:15:08:30] ENGINE Serving on https://172.21.15.72:7150 2024-03-30T15:08:31.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:30 smithi172 bash[23680]: cluster 2024-03-30T15:08:30.725865+0000 mon.a (mon.0) 788 : cluster 0 mgrmap e19: y(active, since 1.01852s), standbys: x 2024-03-30T15:08:31.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:30 smithi172 bash[23680]: audit 2024-03-30T15:08:30.751175+0000 mon.a (mon.0) 789 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:31.584 DEBUG:teuthology.orchestra.run.smithi072:alertmanager.a> sudo journalctl -f -n 0 -u ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@alertmanager.a.service 2024-03-30T15:08:31.587 INFO:tasks.cephadm:Adding grafana.a on smithi172 2024-03-30T15:08:31.587 DEBUG:teuthology.orchestra.run.smithi172:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph orch apply grafana '1;smithi172=a' 2024-03-30T15:08:31.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:31 smithi072 bash[21573]: cephadm 2024-03-30T15:08:30.721894+0000 mgr.y (mgr.14526) 3 : cephadm 1 [30/Mar/2024:15:08:30] ENGINE Serving on http://172.21.15.72:8765 2024-03-30T15:08:31.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:31 smithi072 bash[21573]: cephadm 2024-03-30T15:08:30.722058+0000 mgr.y (mgr.14526) 4 : cephadm 1 [30/Mar/2024:15:08:30] ENGINE Bus STARTED 2024-03-30T15:08:31.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:31 smithi072 bash[21573]: audit 2024-03-30T15:08:30.737622+0000 mgr.y (mgr.14526) 5 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:08:31.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:31 smithi072 bash[21573]: audit 2024-03-30T15:08:30.739486+0000 mgr.y (mgr.14526) 6 : audit 0 from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi072=a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T15:08:31.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:31 smithi072 bash[21573]: cephadm 2024-03-30T15:08:30.745922+0000 mgr.y (mgr.14526) 7 : cephadm 1 Saving service alertmanager spec with placement smithi072=a;count:1 2024-03-30T15:08:31.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:31 smithi072 bash[21573]: cluster 2024-03-30T15:08:30.747234+0000 mgr.y (mgr.14526) 8 : cluster 0 pgmap v3: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:08:31.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:31 smithi072 bash[28946]: cephadm 2024-03-30T15:08:30.721894+0000 mgr.y (mgr.14526) 3 : cephadm 1 [30/Mar/2024:15:08:30] ENGINE Serving on http://172.21.15.72:8765 2024-03-30T15:08:31.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:31 smithi072 bash[28946]: cephadm 2024-03-30T15:08:30.722058+0000 mgr.y (mgr.14526) 4 : cephadm 1 [30/Mar/2024:15:08:30] ENGINE Bus STARTED 2024-03-30T15:08:31.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:31 smithi072 bash[28946]: audit 2024-03-30T15:08:30.737622+0000 mgr.y (mgr.14526) 5 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:08:31.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:31 smithi072 bash[28946]: audit 2024-03-30T15:08:30.739486+0000 mgr.y (mgr.14526) 6 : audit 0 from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi072=a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T15:08:31.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:31 smithi072 bash[28946]: cephadm 2024-03-30T15:08:30.745922+0000 mgr.y (mgr.14526) 7 : cephadm 1 Saving service alertmanager spec with placement smithi072=a;count:1 2024-03-30T15:08:31.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:31 smithi072 bash[28946]: cluster 2024-03-30T15:08:30.747234+0000 mgr.y (mgr.14526) 8 : cluster 0 pgmap v3: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:08:31.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:31 smithi172 bash[23680]: cephadm 2024-03-30T15:08:30.721894+0000 mgr.y (mgr.14526) 3 : cephadm 1 [30/Mar/2024:15:08:30] ENGINE Serving on http://172.21.15.72:8765 2024-03-30T15:08:31.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:31 smithi172 bash[23680]: cephadm 2024-03-30T15:08:30.722058+0000 mgr.y (mgr.14526) 4 : cephadm 1 [30/Mar/2024:15:08:30] ENGINE Bus STARTED 2024-03-30T15:08:31.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:31 smithi172 bash[23680]: audit 2024-03-30T15:08:30.737622+0000 mgr.y (mgr.14526) 5 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:08:31.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:31 smithi172 bash[23680]: audit 2024-03-30T15:08:30.739486+0000 mgr.y (mgr.14526) 6 : audit 0 from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi072=a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T15:08:31.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:31 smithi172 bash[23680]: cephadm 2024-03-30T15:08:30.745922+0000 mgr.y (mgr.14526) 7 : cephadm 1 Saving service alertmanager spec with placement smithi072=a;count:1 2024-03-30T15:08:31.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:31 smithi172 bash[23680]: cluster 2024-03-30T15:08:30.747234+0000 mgr.y (mgr.14526) 8 : cluster 0 pgmap v3: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:08:33.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:32 smithi072 bash[21573]: cluster 2024-03-30T15:08:31.733103+0000 mgr.y (mgr.14526) 9 : cluster 0 pgmap v4: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:08:33.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:32 smithi072 bash[21573]: cluster 2024-03-30T15:08:32.742127+0000 mon.a (mon.0) 790 : cluster 0 mgrmap e20: y(active, since 3s), standbys: x 2024-03-30T15:08:33.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:32 smithi072 bash[28946]: cluster 2024-03-30T15:08:31.733103+0000 mgr.y (mgr.14526) 9 : cluster 0 pgmap v4: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:08:33.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:32 smithi072 bash[28946]: cluster 2024-03-30T15:08:32.742127+0000 mon.a (mon.0) 790 : cluster 0 mgrmap e20: y(active, since 3s), standbys: x 2024-03-30T15:08:33.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:32 smithi172 bash[23680]: cluster 2024-03-30T15:08:31.733103+0000 mgr.y (mgr.14526) 9 : cluster 0 pgmap v4: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:08:33.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:32 smithi172 bash[23680]: cluster 2024-03-30T15:08:32.742127+0000 mon.a (mon.0) 790 : cluster 0 mgrmap e20: y(active, since 3s), standbys: x 2024-03-30T15:08:35.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:34 smithi072 bash[21573]: cluster 2024-03-30T15:08:33.733828+0000 mgr.y (mgr.14526) 10 : cluster 0 pgmap v5: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:08:35.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:34 smithi072 bash[21573]: cluster 2024-03-30T15:08:33.788192+0000 mon.a (mon.0) 791 : cluster 0 mgrmap e21: y(active, since 4s), standbys: x 2024-03-30T15:08:35.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:34 smithi072 bash[28946]: cluster 2024-03-30T15:08:33.733828+0000 mgr.y (mgr.14526) 10 : cluster 0 pgmap v5: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:08:35.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:34 smithi072 bash[28946]: cluster 2024-03-30T15:08:33.788192+0000 mon.a (mon.0) 791 : cluster 0 mgrmap e21: y(active, since 4s), standbys: x 2024-03-30T15:08:35.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:34 smithi172 bash[23680]: cluster 2024-03-30T15:08:33.733828+0000 mgr.y (mgr.14526) 10 : cluster 0 pgmap v5: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:08:35.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:34 smithi172 bash[23680]: cluster 2024-03-30T15:08:33.788192+0000 mon.a (mon.0) 791 : cluster 0 mgrmap e21: y(active, since 4s), standbys: x 2024-03-30T15:08:36.228 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.b/config 2024-03-30T15:08:36.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:36 smithi072 bash[21573]: audit 2024-03-30T15:08:35.583756+0000 mon.a (mon.0) 792 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:36.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:36 smithi072 bash[21573]: audit 2024-03-30T15:08:35.592589+0000 mon.a (mon.0) 793 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:36.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:36 smithi072 bash[21573]: audit 2024-03-30T15:08:35.888576+0000 mon.a (mon.0) 794 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:36.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:36 smithi072 bash[21573]: audit 2024-03-30T15:08:35.905739+0000 mon.a (mon.0) 795 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:36.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:36 smithi072 bash[28946]: audit 2024-03-30T15:08:35.583756+0000 mon.a (mon.0) 792 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:36.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:36 smithi072 bash[28946]: audit 2024-03-30T15:08:35.592589+0000 mon.a (mon.0) 793 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:36.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:36 smithi072 bash[28946]: audit 2024-03-30T15:08:35.888576+0000 mon.a (mon.0) 794 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:36.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:36 smithi072 bash[28946]: audit 2024-03-30T15:08:35.905739+0000 mon.a (mon.0) 795 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:36.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:36 smithi172 bash[23680]: audit 2024-03-30T15:08:35.583756+0000 mon.a (mon.0) 792 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:36.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:36 smithi172 bash[23680]: audit 2024-03-30T15:08:35.592589+0000 mon.a (mon.0) 793 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:36.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:36 smithi172 bash[23680]: audit 2024-03-30T15:08:35.888576+0000 mon.a (mon.0) 794 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:36.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:36 smithi172 bash[23680]: audit 2024-03-30T15:08:35.905739+0000 mon.a (mon.0) 795 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:37.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[28946]: cluster 2024-03-30T15:08:35.734544+0000 mgr.y (mgr.14526) 11 : cluster 0 pgmap v6: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:08:37.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[28946]: audit 2024-03-30T15:08:36.593168+0000 mon.a (mon.0) 796 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:37.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[28946]: audit 2024-03-30T15:08:36.607278+0000 mon.a (mon.0) 797 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:37.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[28946]: audit 2024-03-30T15:08:36.609294+0000 mon.c (mon.2) 44 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[28946]: audit 2024-03-30T15:08:36.609646+0000 mon.a (mon.0) 798 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[28946]: audit 2024-03-30T15:08:36.610615+0000 mon.c (mon.2) 45 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[28946]: audit 2024-03-30T15:08:36.610915+0000 mon.a (mon.0) 799 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[28946]: audit 2024-03-30T15:08:36.611727+0000 mon.c (mon.2) 46 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[28946]: audit 2024-03-30T15:08:36.612031+0000 mon.a (mon.0) 800 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[28946]: audit 2024-03-30T15:08:36.612813+0000 mon.c (mon.2) 47 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[28946]: audit 2024-03-30T15:08:36.613132+0000 mon.a (mon.0) 801 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[28946]: cephadm 2024-03-30T15:08:36.613821+0000 mgr.y (mgr.14526) 12 : cephadm 1 Adjusting osd_memory_target on smithi072 to 3804M 2024-03-30T15:08:37.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[28946]: audit 2024-03-30T15:08:36.617204+0000 mon.a (mon.0) 802 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:37.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[28946]: audit 2024-03-30T15:08:36.959711+0000 mon.a (mon.0) 803 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:37.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[28946]: audit 2024-03-30T15:08:36.978495+0000 mon.a (mon.0) 804 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:37.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[28946]: audit 2024-03-30T15:08:36.982945+0000 mon.c (mon.2) 48 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[28946]: audit 2024-03-30T15:08:36.983637+0000 mon.a (mon.0) 805 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[28946]: audit 2024-03-30T15:08:36.985850+0000 mon.c (mon.2) 49 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[28946]: audit 2024-03-30T15:08:36.986445+0000 mon.a (mon.0) 806 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[28946]: audit 2024-03-30T15:08:36.988479+0000 mon.c (mon.2) 50 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[28946]: audit 2024-03-30T15:08:36.989169+0000 mon.a (mon.0) 807 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[28946]: audit 2024-03-30T15:08:36.991300+0000 mon.c (mon.2) 51 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[28946]: audit 2024-03-30T15:08:36.991947+0000 mon.a (mon.0) 808 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[28946]: audit 2024-03-30T15:08:37.001214+0000 mon.a (mon.0) 809 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:37.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[28946]: audit 2024-03-30T15:08:37.006039+0000 mon.c (mon.2) 52 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:08:37.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[28946]: audit 2024-03-30T15:08:37.007682+0000 mon.c (mon.2) 53 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:08:37.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[21573]: cluster 2024-03-30T15:08:35.734544+0000 mgr.y (mgr.14526) 11 : cluster 0 pgmap v6: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:08:37.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[21573]: audit 2024-03-30T15:08:36.593168+0000 mon.a (mon.0) 796 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:37.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[21573]: audit 2024-03-30T15:08:36.607278+0000 mon.a (mon.0) 797 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:37.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[21573]: audit 2024-03-30T15:08:36.609294+0000 mon.c (mon.2) 44 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[21573]: audit 2024-03-30T15:08:36.609646+0000 mon.a (mon.0) 798 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[21573]: audit 2024-03-30T15:08:36.610615+0000 mon.c (mon.2) 45 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[21573]: audit 2024-03-30T15:08:36.610915+0000 mon.a (mon.0) 799 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[21573]: audit 2024-03-30T15:08:36.611727+0000 mon.c (mon.2) 46 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[21573]: audit 2024-03-30T15:08:36.612031+0000 mon.a (mon.0) 800 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[21573]: audit 2024-03-30T15:08:36.612813+0000 mon.c (mon.2) 47 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[21573]: audit 2024-03-30T15:08:36.613132+0000 mon.a (mon.0) 801 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[21573]: cephadm 2024-03-30T15:08:36.613821+0000 mgr.y (mgr.14526) 12 : cephadm 1 Adjusting osd_memory_target on smithi072 to 3804M 2024-03-30T15:08:37.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[21573]: audit 2024-03-30T15:08:36.617204+0000 mon.a (mon.0) 802 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:37.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[21573]: audit 2024-03-30T15:08:36.959711+0000 mon.a (mon.0) 803 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:37.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[21573]: audit 2024-03-30T15:08:36.978495+0000 mon.a (mon.0) 804 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:37.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[21573]: audit 2024-03-30T15:08:36.982945+0000 mon.c (mon.2) 48 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[21573]: audit 2024-03-30T15:08:36.983637+0000 mon.a (mon.0) 805 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[21573]: audit 2024-03-30T15:08:36.985850+0000 mon.c (mon.2) 49 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[21573]: audit 2024-03-30T15:08:36.986445+0000 mon.a (mon.0) 806 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[21573]: audit 2024-03-30T15:08:36.988479+0000 mon.c (mon.2) 50 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[21573]: audit 2024-03-30T15:08:36.989169+0000 mon.a (mon.0) 807 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[21573]: audit 2024-03-30T15:08:36.991300+0000 mon.c (mon.2) 51 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.923 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[21573]: audit 2024-03-30T15:08:36.991947+0000 mon.a (mon.0) 808 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.923 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[21573]: audit 2024-03-30T15:08:37.001214+0000 mon.a (mon.0) 809 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:37.923 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[21573]: audit 2024-03-30T15:08:37.006039+0000 mon.c (mon.2) 52 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:08:37.923 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:37 smithi072 bash[21573]: audit 2024-03-30T15:08:37.007682+0000 mon.c (mon.2) 53 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:08:37.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:37 smithi172 bash[23680]: cluster 2024-03-30T15:08:35.734544+0000 mgr.y (mgr.14526) 11 : cluster 0 pgmap v6: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:08:37.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:37 smithi172 bash[23680]: audit 2024-03-30T15:08:36.593168+0000 mon.a (mon.0) 796 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:37.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:37 smithi172 bash[23680]: audit 2024-03-30T15:08:36.607278+0000 mon.a (mon.0) 797 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:37.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:37 smithi172 bash[23680]: audit 2024-03-30T15:08:36.609294+0000 mon.c (mon.2) 44 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:37 smithi172 bash[23680]: audit 2024-03-30T15:08:36.609646+0000 mon.a (mon.0) 798 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:37 smithi172 bash[23680]: audit 2024-03-30T15:08:36.610615+0000 mon.c (mon.2) 45 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:37 smithi172 bash[23680]: audit 2024-03-30T15:08:36.610915+0000 mon.a (mon.0) 799 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:37 smithi172 bash[23680]: audit 2024-03-30T15:08:36.611727+0000 mon.c (mon.2) 46 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:37 smithi172 bash[23680]: audit 2024-03-30T15:08:36.612031+0000 mon.a (mon.0) 800 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:37 smithi172 bash[23680]: audit 2024-03-30T15:08:36.612813+0000 mon.c (mon.2) 47 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:37 smithi172 bash[23680]: audit 2024-03-30T15:08:36.613132+0000 mon.a (mon.0) 801 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:37 smithi172 bash[23680]: cephadm 2024-03-30T15:08:36.613821+0000 mgr.y (mgr.14526) 12 : cephadm 1 Adjusting osd_memory_target on smithi072 to 3804M 2024-03-30T15:08:37.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:37 smithi172 bash[23680]: audit 2024-03-30T15:08:36.617204+0000 mon.a (mon.0) 802 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:37.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:37 smithi172 bash[23680]: audit 2024-03-30T15:08:36.959711+0000 mon.a (mon.0) 803 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:37.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:37 smithi172 bash[23680]: audit 2024-03-30T15:08:36.978495+0000 mon.a (mon.0) 804 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:37.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:37 smithi172 bash[23680]: audit 2024-03-30T15:08:36.982945+0000 mon.c (mon.2) 48 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:37 smithi172 bash[23680]: audit 2024-03-30T15:08:36.983637+0000 mon.a (mon.0) 805 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:37 smithi172 bash[23680]: audit 2024-03-30T15:08:36.985850+0000 mon.c (mon.2) 49 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:37 smithi172 bash[23680]: audit 2024-03-30T15:08:36.986445+0000 mon.a (mon.0) 806 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:37 smithi172 bash[23680]: audit 2024-03-30T15:08:36.988479+0000 mon.c (mon.2) 50 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:37 smithi172 bash[23680]: audit 2024-03-30T15:08:36.989169+0000 mon.a (mon.0) 807 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:37 smithi172 bash[23680]: audit 2024-03-30T15:08:36.991300+0000 mon.c (mon.2) 51 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:37 smithi172 bash[23680]: audit 2024-03-30T15:08:36.991947+0000 mon.a (mon.0) 808 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:08:37.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:37 smithi172 bash[23680]: audit 2024-03-30T15:08:37.001214+0000 mon.a (mon.0) 809 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:37.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:37 smithi172 bash[23680]: audit 2024-03-30T15:08:37.006039+0000 mon.c (mon.2) 52 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:08:37.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:37 smithi172 bash[23680]: audit 2024-03-30T15:08:37.007682+0000 mon.c (mon.2) 53 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:08:38.765 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 30 15:08:38 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:38.765 INFO:journalctl@ceph.osd.3.smithi072.stdout:Mar 30 15:08:38 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:38.765 INFO:journalctl@ceph.rgw.foo.a.smithi072.stdout:Mar 30 15:08:38 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:38.766 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 30 15:08:38 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:38.766 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 30 15:08:38 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:38.766 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:38 smithi072 bash[21573]: cephadm 2024-03-30T15:08:36.993651+0000 mgr.y (mgr.14526) 13 : cephadm 1 Adjusting osd_memory_target on smithi172 to 3804M 2024-03-30T15:08:38.767 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:38 smithi072 bash[21573]: cephadm 2024-03-30T15:08:37.009726+0000 mgr.y (mgr.14526) 14 : cephadm 1 Updating smithi072:/etc/ceph/ceph.conf 2024-03-30T15:08:38.767 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:38 smithi072 bash[21573]: cephadm 2024-03-30T15:08:37.010041+0000 mgr.y (mgr.14526) 15 : cephadm 1 Updating smithi172:/etc/ceph/ceph.conf 2024-03-30T15:08:38.767 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:38 smithi072 bash[21573]: cephadm 2024-03-30T15:08:37.526354+0000 mgr.y (mgr.14526) 16 : cephadm 1 Updating smithi072:/var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T15:08:38.767 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:38 smithi072 bash[21573]: cephadm 2024-03-30T15:08:37.526658+0000 mgr.y (mgr.14526) 17 : cephadm 1 Updating smithi172:/var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T15:08:38.767 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:38 smithi072 bash[21573]: audit 2024-03-30T15:08:37.977824+0000 mon.a (mon.0) 810 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:38.767 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:38 smithi072 bash[21573]: audit 2024-03-30T15:08:37.985400+0000 mon.a (mon.0) 811 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:38.767 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:38 smithi072 bash[21573]: audit 2024-03-30T15:08:38.080075+0000 mon.a (mon.0) 812 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:38.767 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:38 smithi072 bash[21573]: audit 2024-03-30T15:08:38.093044+0000 mon.a (mon.0) 813 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:38.767 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:38 smithi072 bash[21573]: audit 2024-03-30T15:08:38.105123+0000 mon.a (mon.0) 814 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:38.767 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:38 smithi072 bash[28946]: cephadm 2024-03-30T15:08:36.993651+0000 mgr.y (mgr.14526) 13 : cephadm 1 Adjusting osd_memory_target on smithi172 to 3804M 2024-03-30T15:08:38.768 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:38 smithi072 bash[28946]: cephadm 2024-03-30T15:08:37.009726+0000 mgr.y (mgr.14526) 14 : cephadm 1 Updating smithi072:/etc/ceph/ceph.conf 2024-03-30T15:08:38.768 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:38 smithi072 bash[28946]: cephadm 2024-03-30T15:08:37.010041+0000 mgr.y (mgr.14526) 15 : cephadm 1 Updating smithi172:/etc/ceph/ceph.conf 2024-03-30T15:08:38.768 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:38 smithi072 bash[28946]: cephadm 2024-03-30T15:08:37.526354+0000 mgr.y (mgr.14526) 16 : cephadm 1 Updating smithi072:/var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T15:08:38.768 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:38 smithi072 bash[28946]: cephadm 2024-03-30T15:08:37.526658+0000 mgr.y (mgr.14526) 17 : cephadm 1 Updating smithi172:/var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T15:08:38.768 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:38 smithi072 bash[28946]: audit 2024-03-30T15:08:37.977824+0000 mon.a (mon.0) 810 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:38.768 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:38 smithi072 bash[28946]: audit 2024-03-30T15:08:37.985400+0000 mon.a (mon.0) 811 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:38.768 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:38 smithi072 bash[28946]: audit 2024-03-30T15:08:38.080075+0000 mon.a (mon.0) 812 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:38.768 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:38 smithi072 bash[28946]: audit 2024-03-30T15:08:38.093044+0000 mon.a (mon.0) 813 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:38.768 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:38 smithi072 bash[28946]: audit 2024-03-30T15:08:38.105123+0000 mon.a (mon.0) 814 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:38.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:38 smithi172 bash[23680]: cephadm 2024-03-30T15:08:36.993651+0000 mgr.y (mgr.14526) 13 : cephadm 1 Adjusting osd_memory_target on smithi172 to 3804M 2024-03-30T15:08:38.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:38 smithi172 bash[23680]: cephadm 2024-03-30T15:08:37.009726+0000 mgr.y (mgr.14526) 14 : cephadm 1 Updating smithi072:/etc/ceph/ceph.conf 2024-03-30T15:08:38.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:38 smithi172 bash[23680]: cephadm 2024-03-30T15:08:37.010041+0000 mgr.y (mgr.14526) 15 : cephadm 1 Updating smithi172:/etc/ceph/ceph.conf 2024-03-30T15:08:38.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:38 smithi172 bash[23680]: cephadm 2024-03-30T15:08:37.526354+0000 mgr.y (mgr.14526) 16 : cephadm 1 Updating smithi072:/var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T15:08:38.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:38 smithi172 bash[23680]: cephadm 2024-03-30T15:08:37.526658+0000 mgr.y (mgr.14526) 17 : cephadm 1 Updating smithi172:/var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T15:08:38.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:38 smithi172 bash[23680]: audit 2024-03-30T15:08:37.977824+0000 mon.a (mon.0) 810 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:38.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:38 smithi172 bash[23680]: audit 2024-03-30T15:08:37.985400+0000 mon.a (mon.0) 811 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:38.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:38 smithi172 bash[23680]: audit 2024-03-30T15:08:38.080075+0000 mon.a (mon.0) 812 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:38.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:38 smithi172 bash[23680]: audit 2024-03-30T15:08:38.093044+0000 mon.a (mon.0) 813 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:38.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:38 smithi172 bash[23680]: audit 2024-03-30T15:08:38.105123+0000 mon.a (mon.0) 814 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:39.019 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:38 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:39.019 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:08:38 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:39.020 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:38 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:39.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.216+0000 7f9001131700 1 -- 172.21.15.172:0/3794443760 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ffc102520 msgr2=0x7f8ffc102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:08:39.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.216+0000 7f9001131700 1 --2- 172.21.15.172:0/3794443760 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ffc102520 0x7f8ffc102900 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8fec009990 tx=0x7f8fec009ca0 comp rx=0 tx=0).stop 2024-03-30T15:08:39.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.216+0000 7f9001131700 1 -- 172.21.15.172:0/3794443760 shutdown_connections 2024-03-30T15:08:39.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.216+0000 7f9001131700 1 --2- 172.21.15.172:0/3794443760 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ffc1075e0 0x7f8ffc10f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:08:39.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.216+0000 7f9001131700 1 --2- 172.21.15.172:0/3794443760 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ffc102520 0x7f8ffc102900 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:08:39.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.216+0000 7f9001131700 1 --2- 172.21.15.172:0/3794443760 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ffc102ed0 0x7f8ffc106f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:08:39.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.216+0000 7f9001131700 1 -- 172.21.15.172:0/3794443760 >> 172.21.15.172:0/3794443760 conn(0x7f8ffc0793f0 msgr2=0x7f8ffc079800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:08:39.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.216+0000 7f9001131700 1 -- 172.21.15.172:0/3794443760 shutdown_connections 2024-03-30T15:08:39.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.216+0000 7f9001131700 1 -- 172.21.15.172:0/3794443760 wait complete. 2024-03-30T15:08:39.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.216+0000 7f9001131700 1 Processor -- start 2024-03-30T15:08:39.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.216+0000 7f9001131700 1 -- start start 2024-03-30T15:08:39.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.216+0000 7f9001131700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ffc102520 0x7f8ffc19a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:08:39.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.216+0000 7f9001131700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ffc102ed0 0x7f8ffc19a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:08:39.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.216+0000 7f9001131700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ffc1075e0 0x7f8ffc19eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:08:39.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.216+0000 7f9001131700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8ffc111a20 con 0x7f8ffc102520 2024-03-30T15:08:39.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.216+0000 7f9001131700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8ffc1118a0 con 0x7f8ffc1075e0 2024-03-30T15:08:39.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.216+0000 7f9001131700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f8ffc111ba0 con 0x7f8ffc102ed0 2024-03-30T15:08:39.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.216+0000 7f8ffb59e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ffc1075e0 0x7f8ffc19eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:08:39.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.216+0000 7f8ffb59e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ffc1075e0 0x7f8ffc19eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:44942/0 (socket says 172.21.15.172:44942) 2024-03-30T15:08:39.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.216+0000 7f8ffb59e700 1 -- 172.21.15.172:0/4150532574 learned_addr learned my addr 172.21.15.172:0/4150532574 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-03-30T15:08:39.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.216+0000 7f8ffad9d700 1 --2- 172.21.15.172:0/4150532574 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ffc102520 0x7f8ffc19a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:08:39.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.216+0000 7f8ffa59c700 1 --2- 172.21.15.172:0/4150532574 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ffc102ed0 0x7f8ffc19a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:08:39.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.216+0000 7f8ffb59e700 1 -- 172.21.15.172:0/4150532574 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ffc102ed0 msgr2=0x7f8ffc19a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:08:39.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.216+0000 7f8ffb59e700 1 --2- 172.21.15.172:0/4150532574 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ffc102ed0 0x7f8ffc19a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:08:39.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.216+0000 7f8ffb59e700 1 -- 172.21.15.172:0/4150532574 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ffc102520 msgr2=0x7f8ffc19a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:08:39.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.216+0000 7f8ffb59e700 1 --2- 172.21.15.172:0/4150532574 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ffc102520 0x7f8ffc19a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:08:39.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.216+0000 7f8ffb59e700 1 -- 172.21.15.172:0/4150532574 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ffc19f230 con 0x7f8ffc1075e0 2024-03-30T15:08:39.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.216+0000 7f8ffa59c700 1 --2- 172.21.15.172:0/4150532574 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ffc102ed0 0x7f8ffc19a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T15:08:39.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.216+0000 7f8ffad9d700 1 --2- 172.21.15.172:0/4150532574 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ffc102520 0x7f8ffc19a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T15:08:39.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.216+0000 7f8ffb59e700 1 --2- 172.21.15.172:0/4150532574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ffc1075e0 0x7f8ffc19eaf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8ff400efc0 tx=0x7f8ff400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:08:39.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.216+0000 7f8ff3fff700 1 -- 172.21.15.172:0/4150532574 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff40092e0 con 0x7f8ffc1075e0 2024-03-30T15:08:39.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.216+0000 7f8ff3fff700 1 -- 172.21.15.172:0/4150532574 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f8ff4004bb0 con 0x7f8ffc1075e0 2024-03-30T15:08:39.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.216+0000 7f9001131700 1 -- 172.21.15.172:0/4150532574 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ffc19f4c0 con 0x7f8ffc1075e0 2024-03-30T15:08:39.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.216+0000 7f8ff3fff700 1 -- 172.21.15.172:0/4150532574 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff4004020 con 0x7f8ffc1075e0 2024-03-30T15:08:39.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.216+0000 7f9001131700 1 -- 172.21.15.172:0/4150532574 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ffc1a6da0 con 0x7f8ffc1075e0 2024-03-30T15:08:39.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.220+0000 7f9001131700 1 -- 172.21.15.172:0/4150532574 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fdc005120 con 0x7f8ffc1075e0 2024-03-30T15:08:39.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.220+0000 7f8ff3fff700 1 -- 172.21.15.172:0/4150532574 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 21) ==== 91831+0+0 (secure 0 0 0) 0x7f8ff401b030 con 0x7f8ffc1075e0 2024-03-30T15:08:39.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.220+0000 7f8ff3fff700 1 --2- 172.21.15.172:0/4150532574 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f8fe806dc40 0x7f8fe8070100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:08:39.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.220+0000 7f8ff3fff700 1 -- 172.21.15.172:0/4150532574 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7537+0+0 (secure 0 0 0) 0x7f8ff408da10 con 0x7f8ffc1075e0 2024-03-30T15:08:39.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.220+0000 7f8ffad9d700 1 --2- 172.21.15.172:0/4150532574 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f8fe806dc40 0x7f8fe8070100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:08:39.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.220+0000 7f8ffad9d700 1 --2- 172.21.15.172:0/4150532574 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f8fe806dc40 0x7f8fe8070100 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8fec00b2e0 tx=0x7f8fec005e80 comp rx=0 tx=0).ready entity=mgr.14526 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:08:39.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.224+0000 7f8ff3fff700 1 -- 172.21.15.172:0/4150532574 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f8ff4022020 con 0x7f8ffc1075e0 2024-03-30T15:08:39.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:39 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:39.418 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 30 15:08:39 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:39.419 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 30 15:08:39 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:39.419 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 30 15:08:39 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:39.419 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:08:39 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:39.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:39 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:39.420 INFO:journalctl@ceph.osd.3.smithi072.stdout:Mar 30 15:08:39 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:39.420 INFO:journalctl@ceph.rgw.foo.a.smithi072.stdout:Mar 30 15:08:39 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:39.420 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:39 smithi072 systemd[1]: Started Ceph node-exporter.a for 97f8e564-eea5-11ee-b647-cb9ed24678a4. 2024-03-30T15:08:39.420 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:39 smithi072 bash[57649]: Unable to find image 'quay.io/prometheus/node-exporter:v1.5.0' locally 2024-03-30T15:08:39.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.448+0000 7f9001131700 1 -- 172.21.15.172:0/4150532574 --> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi172=a", "target": ["mon-mgr", ""]}) -- 0x7f8fdc000bc0 con 0x7f8fe806dc40 2024-03-30T15:08:39.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.464+0000 7f8ff3fff700 1 -- 172.21.15.172:0/4150532574 <== mgr.14526 v2:172.21.15.72:6800/2033000132 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f8fdc000bc0 con 0x7f8fe806dc40 2024-03-30T15:08:39.461 INFO:teuthology.orchestra.run.smithi172.stdout:Scheduled grafana update... 2024-03-30T15:08:39.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.464+0000 7f9001131700 1 -- 172.21.15.172:0/4150532574 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f8fe806dc40 msgr2=0x7f8fe8070100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:08:39.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.464+0000 7f9001131700 1 --2- 172.21.15.172:0/4150532574 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f8fe806dc40 0x7f8fe8070100 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8fec00b2e0 tx=0x7f8fec005e80 comp rx=0 tx=0).stop 2024-03-30T15:08:39.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.464+0000 7f9001131700 1 -- 172.21.15.172:0/4150532574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ffc1075e0 msgr2=0x7f8ffc19eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:08:39.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.464+0000 7f9001131700 1 --2- 172.21.15.172:0/4150532574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ffc1075e0 0x7f8ffc19eaf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8ff400efc0 tx=0x7f8ff400c3a0 comp rx=0 tx=0).stop 2024-03-30T15:08:39.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.464+0000 7f9001131700 1 -- 172.21.15.172:0/4150532574 shutdown_connections 2024-03-30T15:08:39.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.464+0000 7f9001131700 1 --2- 172.21.15.172:0/4150532574 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f8fe806dc40 0x7f8fe8070100 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:08:39.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.464+0000 7f9001131700 1 --2- 172.21.15.172:0/4150532574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ffc1075e0 0x7f8ffc19eaf0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:08:39.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.464+0000 7f9001131700 1 --2- 172.21.15.172:0/4150532574 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ffc102520 0x7f8ffc19a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:08:39.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.464+0000 7f9001131700 1 --2- 172.21.15.172:0/4150532574 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ffc102ed0 0x7f8ffc19a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:08:39.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.464+0000 7f9001131700 1 -- 172.21.15.172:0/4150532574 >> 172.21.15.172:0/4150532574 conn(0x7f8ffc0793f0 msgr2=0x7f8ffc100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:08:39.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.464+0000 7f9001131700 1 -- 172.21.15.172:0/4150532574 shutdown_connections 2024-03-30T15:08:39.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:08:39.464+0000 7f9001131700 1 -- 172.21.15.172:0/4150532574 wait complete. 2024-03-30T15:08:39.918 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:39 smithi072 bash[57649]: v1.5.0: Pulling from prometheus/node-exporter 2024-03-30T15:08:39.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:39 smithi072 bash[28946]: cephadm 2024-03-30T15:08:37.690773+0000 mgr.y (mgr.14526) 18 : cephadm 1 Updating smithi072:/etc/ceph/ceph.client.admin.keyring 2024-03-30T15:08:39.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:39 smithi072 bash[28946]: cluster 2024-03-30T15:08:37.735886+0000 mgr.y (mgr.14526) 19 : cluster 0 pgmap v7: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-03-30T15:08:39.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:39 smithi072 bash[28946]: cephadm 2024-03-30T15:08:37.792185+0000 mgr.y (mgr.14526) 20 : cephadm 1 Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-03-30T15:08:39.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:39 smithi072 bash[28946]: cephadm 2024-03-30T15:08:37.805346+0000 mgr.y (mgr.14526) 21 : cephadm 1 Updating smithi072:/var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T15:08:39.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:39 smithi072 bash[28946]: cephadm 2024-03-30T15:08:37.956662+0000 mgr.y (mgr.14526) 22 : cephadm 1 Updating smithi172:/var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T15:08:39.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:39 smithi072 bash[28946]: cephadm 2024-03-30T15:08:38.113534+0000 mgr.y (mgr.14526) 23 : cephadm 1 Deploying daemon node-exporter.a on smithi072 2024-03-30T15:08:39.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:39 smithi072 bash[28946]: audit 2024-03-30T15:08:39.171684+0000 mon.a (mon.0) 815 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:39.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:39 smithi072 bash[28946]: audit 2024-03-30T15:08:39.178575+0000 mon.a (mon.0) 816 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:39.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:39 smithi072 bash[28946]: audit 2024-03-30T15:08:39.232703+0000 mon.a (mon.0) 817 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:39.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:39 smithi072 bash[28946]: audit 2024-03-30T15:08:39.463141+0000 mon.a (mon.0) 818 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:39.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:39 smithi072 bash[21573]: cephadm 2024-03-30T15:08:37.690773+0000 mgr.y (mgr.14526) 18 : cephadm 1 Updating smithi072:/etc/ceph/ceph.client.admin.keyring 2024-03-30T15:08:39.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:39 smithi072 bash[21573]: cluster 2024-03-30T15:08:37.735886+0000 mgr.y (mgr.14526) 19 : cluster 0 pgmap v7: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-03-30T15:08:39.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:39 smithi072 bash[21573]: cephadm 2024-03-30T15:08:37.792185+0000 mgr.y (mgr.14526) 20 : cephadm 1 Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-03-30T15:08:39.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:39 smithi072 bash[21573]: cephadm 2024-03-30T15:08:37.805346+0000 mgr.y (mgr.14526) 21 : cephadm 1 Updating smithi072:/var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T15:08:39.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:39 smithi072 bash[21573]: cephadm 2024-03-30T15:08:37.956662+0000 mgr.y (mgr.14526) 22 : cephadm 1 Updating smithi172:/var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T15:08:39.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:39 smithi072 bash[21573]: cephadm 2024-03-30T15:08:38.113534+0000 mgr.y (mgr.14526) 23 : cephadm 1 Deploying daemon node-exporter.a on smithi072 2024-03-30T15:08:39.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:39 smithi072 bash[21573]: audit 2024-03-30T15:08:39.171684+0000 mon.a (mon.0) 815 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:39.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:39 smithi072 bash[21573]: audit 2024-03-30T15:08:39.178575+0000 mon.a (mon.0) 816 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:39.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:39 smithi072 bash[21573]: audit 2024-03-30T15:08:39.232703+0000 mon.a (mon.0) 817 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:39.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:39 smithi072 bash[21573]: audit 2024-03-30T15:08:39.463141+0000 mon.a (mon.0) 818 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:39.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:39 smithi172 bash[23680]: cephadm 2024-03-30T15:08:37.690773+0000 mgr.y (mgr.14526) 18 : cephadm 1 Updating smithi072:/etc/ceph/ceph.client.admin.keyring 2024-03-30T15:08:39.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:39 smithi172 bash[23680]: cluster 2024-03-30T15:08:37.735886+0000 mgr.y (mgr.14526) 19 : cluster 0 pgmap v7: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-03-30T15:08:39.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:39 smithi172 bash[23680]: cephadm 2024-03-30T15:08:37.792185+0000 mgr.y (mgr.14526) 20 : cephadm 1 Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-03-30T15:08:39.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:39 smithi172 bash[23680]: cephadm 2024-03-30T15:08:37.805346+0000 mgr.y (mgr.14526) 21 : cephadm 1 Updating smithi072:/var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T15:08:39.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:39 smithi172 bash[23680]: cephadm 2024-03-30T15:08:37.956662+0000 mgr.y (mgr.14526) 22 : cephadm 1 Updating smithi172:/var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T15:08:39.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:39 smithi172 bash[23680]: cephadm 2024-03-30T15:08:38.113534+0000 mgr.y (mgr.14526) 23 : cephadm 1 Deploying daemon node-exporter.a on smithi072 2024-03-30T15:08:39.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:39 smithi172 bash[23680]: audit 2024-03-30T15:08:39.171684+0000 mon.a (mon.0) 815 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:39.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:39 smithi172 bash[23680]: audit 2024-03-30T15:08:39.178575+0000 mon.a (mon.0) 816 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:39.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:39 smithi172 bash[23680]: audit 2024-03-30T15:08:39.232703+0000 mon.a (mon.0) 817 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:39.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:39 smithi172 bash[23680]: audit 2024-03-30T15:08:39.463141+0000 mon.a (mon.0) 818 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:40.252 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:08:40 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:40.252 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:08:40 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:40.253 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:08:40 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:40.253 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:08:40 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:40.253 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 30 15:08:40 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:40.254 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:40 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:40.254 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:08:40 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:40.254 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:08:40 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:40.369 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:39 smithi072 bash[57649]: 22b70bddd3ac: Pulling fs layer 2024-03-30T15:08:40.370 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:39 smithi072 bash[57649]: 5c12815fee55: Pulling fs layer 2024-03-30T15:08:40.370 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:39 smithi072 bash[57649]: c0e87333d380: Pulling fs layer 2024-03-30T15:08:40.370 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:40 smithi072 bash[57649]: 22b70bddd3ac: Download complete 2024-03-30T15:08:40.370 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:40 smithi072 bash[57649]: 5c12815fee55: Verifying Checksum 2024-03-30T15:08:40.370 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:40 smithi072 bash[57649]: 5c12815fee55: Download complete 2024-03-30T15:08:40.370 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:40 smithi072 bash[57649]: 22b70bddd3ac: Pull complete 2024-03-30T15:08:40.465 DEBUG:teuthology.orchestra.run.smithi172:grafana.a> sudo journalctl -f -n 0 -u ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@grafana.a.service 2024-03-30T15:08:40.467 INFO:tasks.cephadm:Setting up client nodes... 2024-03-30T15:08:40.468 DEBUG:teuthology.orchestra.run.smithi072:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-03-30T15:08:40.534 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:08:40 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:40.534 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 30 15:08:40 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:40.534 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:08:40 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:40.535 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:08:40 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:40.535 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:08:40 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:40.535 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:40 smithi172 systemd[1]: Started Ceph node-exporter.b for 97f8e564-eea5-11ee-b647-cb9ed24678a4. 2024-03-30T15:08:40.536 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:40 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:40.536 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:08:40 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:40.536 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:08:40 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:40.667 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:40 smithi072 bash[57649]: c0e87333d380: Download complete 2024-03-30T15:08:40.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:40 smithi072 bash[21573]: cephadm 2024-03-30T15:08:39.234187+0000 mgr.y (mgr.14526) 24 : cephadm 1 Deploying daemon node-exporter.b on smithi172 2024-03-30T15:08:40.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:40 smithi072 bash[21573]: audit 2024-03-30T15:08:39.451090+0000 mgr.y (mgr.14526) 25 : audit 0 from='client.24460 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi172=a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T15:08:40.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:40 smithi072 bash[21573]: cephadm 2024-03-30T15:08:39.455180+0000 mgr.y (mgr.14526) 26 : cephadm 1 Saving service grafana spec with placement smithi172=a;count:1 2024-03-30T15:08:40.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:40 smithi072 bash[21573]: audit 2024-03-30T15:08:40.541676+0000 mon.a (mon.0) 819 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:40.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:40 smithi072 bash[21573]: audit 2024-03-30T15:08:40.550056+0000 mon.a (mon.0) 820 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:40.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:40 smithi072 bash[28946]: cephadm 2024-03-30T15:08:39.234187+0000 mgr.y (mgr.14526) 24 : cephadm 1 Deploying daemon node-exporter.b on smithi172 2024-03-30T15:08:40.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:40 smithi072 bash[28946]: audit 2024-03-30T15:08:39.451090+0000 mgr.y (mgr.14526) 25 : audit 0 from='client.24460 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi172=a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T15:08:40.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:40 smithi072 bash[28946]: cephadm 2024-03-30T15:08:39.455180+0000 mgr.y (mgr.14526) 26 : cephadm 1 Saving service grafana spec with placement smithi172=a;count:1 2024-03-30T15:08:40.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:40 smithi072 bash[28946]: audit 2024-03-30T15:08:40.541676+0000 mon.a (mon.0) 819 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:40.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:40 smithi072 bash[28946]: audit 2024-03-30T15:08:40.550056+0000 mon.a (mon.0) 820 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:40.717 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:40 smithi172 bash[49913]: Unable to find image 'quay.io/prometheus/node-exporter:v1.5.0' locally 2024-03-30T15:08:40.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:40 smithi172 bash[23680]: cephadm 2024-03-30T15:08:39.234187+0000 mgr.y (mgr.14526) 24 : cephadm 1 Deploying daemon node-exporter.b on smithi172 2024-03-30T15:08:40.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:40 smithi172 bash[23680]: audit 2024-03-30T15:08:39.451090+0000 mgr.y (mgr.14526) 25 : audit 0 from='client.24460 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi172=a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T15:08:40.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:40 smithi172 bash[23680]: cephadm 2024-03-30T15:08:39.455180+0000 mgr.y (mgr.14526) 26 : cephadm 1 Saving service grafana spec with placement smithi172=a;count:1 2024-03-30T15:08:40.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:40 smithi172 bash[23680]: audit 2024-03-30T15:08:40.541676+0000 mon.a (mon.0) 819 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:40.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:40 smithi172 bash[23680]: audit 2024-03-30T15:08:40.550056+0000 mon.a (mon.0) 820 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:40.966 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:08:40 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:08:41.031 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:40 smithi072 bash[57649]: 5c12815fee55: Pull complete 2024-03-30T15:08:41.031 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:41 smithi072 bash[57649]: c0e87333d380: Pull complete 2024-03-30T15:08:41.284 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:41 smithi072 bash[57649]: Digest: sha256:39c642b2b337e38c18e80266fb14383754178202f40103646337722a594d984c 2024-03-30T15:08:41.284 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:41 smithi072 bash[57649]: Status: Downloaded newer image for quay.io/prometheus/node-exporter:v1.5.0 2024-03-30T15:08:41.284 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:08:41 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:41.467 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:41 smithi172 bash[49913]: v1.5.0: Pulling from prometheus/node-exporter 2024-03-30T15:08:41.467 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:41 smithi172 bash[49913]: 22b70bddd3ac: Pulling fs layer 2024-03-30T15:08:41.467 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:41 smithi172 bash[49913]: 5c12815fee55: Pulling fs layer 2024-03-30T15:08:41.467 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:41 smithi172 bash[49913]: c0e87333d380: Pulling fs layer 2024-03-30T15:08:41.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:41 smithi072 bash[28946]: cluster 2024-03-30T15:08:39.736624+0000 mgr.y (mgr.14526) 27 : cluster 0 pgmap v8: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-03-30T15:08:41.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:41 smithi072 bash[28946]: audit 2024-03-30T15:08:40.606110+0000 mon.a (mon.0) 821 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:41.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:41 smithi072 bash[28946]: audit 2024-03-30T15:08:40.619209+0000 mon.a (mon.0) 822 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:41.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:41 smithi072 bash[28946]: audit 2024-03-30T15:08:40.629431+0000 mon.a (mon.0) 823 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:41.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:41 smithi072 bash[21573]: cluster 2024-03-30T15:08:39.736624+0000 mgr.y (mgr.14526) 27 : cluster 0 pgmap v8: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-03-30T15:08:41.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:41 smithi072 bash[21573]: audit 2024-03-30T15:08:40.606110+0000 mon.a (mon.0) 821 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:41.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:41 smithi072 bash[21573]: audit 2024-03-30T15:08:40.619209+0000 mon.a (mon.0) 822 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:41.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:41 smithi072 bash[21573]: audit 2024-03-30T15:08:40.629431+0000 mon.a (mon.0) 823 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:41.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:41 smithi172 bash[23680]: cluster 2024-03-30T15:08:39.736624+0000 mgr.y (mgr.14526) 27 : cluster 0 pgmap v8: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-03-30T15:08:41.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:41 smithi172 bash[23680]: audit 2024-03-30T15:08:40.606110+0000 mon.a (mon.0) 821 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:41.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:41 smithi172 bash[23680]: audit 2024-03-30T15:08:40.619209+0000 mon.a (mon.0) 822 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:41.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:41 smithi172 bash[23680]: audit 2024-03-30T15:08:40.629431+0000 mon.a (mon.0) 823 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:41.967 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:41 smithi172 bash[49913]: 22b70bddd3ac: Verifying Checksum 2024-03-30T15:08:41.967 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:41 smithi172 bash[49913]: 22b70bddd3ac: Download complete 2024-03-30T15:08:41.967 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:41 smithi172 bash[49913]: 5c12815fee55: Verifying Checksum 2024-03-30T15:08:41.967 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:41 smithi172 bash[49913]: 5c12815fee55: Download complete 2024-03-30T15:08:41.967 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:41 smithi172 bash[49913]: 22b70bddd3ac: Pull complete 2024-03-30T15:08:41.967 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:41 smithi172 bash[49913]: c0e87333d380: Verifying Checksum 2024-03-30T15:08:41.967 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:41 smithi172 bash[49913]: c0e87333d380: Download complete 2024-03-30T15:08:42.566 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:42 smithi172 bash[49913]: 5c12815fee55: Pull complete 2024-03-30T15:08:42.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:42 smithi072 bash[28946]: cephadm 2024-03-30T15:08:40.645332+0000 mgr.y (mgr.14526) 28 : cephadm 1 Deploying daemon alertmanager.a on smithi072 2024-03-30T15:08:42.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:42 smithi072 bash[28946]: audit 2024-03-30T15:08:40.745043+0000 mgr.y (mgr.14526) 29 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:08:42.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:42 smithi072 bash[21573]: cephadm 2024-03-30T15:08:40.645332+0000 mgr.y (mgr.14526) 28 : cephadm 1 Deploying daemon alertmanager.a on smithi072 2024-03-30T15:08:42.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:42 smithi072 bash[21573]: audit 2024-03-30T15:08:40.745043+0000 mgr.y (mgr.14526) 29 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:08:42.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:42 smithi172 bash[23680]: cephadm 2024-03-30T15:08:40.645332+0000 mgr.y (mgr.14526) 28 : cephadm 1 Deploying daemon alertmanager.a on smithi072 2024-03-30T15:08:42.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:42 smithi172 bash[23680]: audit 2024-03-30T15:08:40.745043+0000 mgr.y (mgr.14526) 29 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:08:42.967 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:42 smithi172 bash[49913]: c0e87333d380: Pull complete 2024-03-30T15:08:42.967 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:42 smithi172 bash[49913]: Digest: sha256:39c642b2b337e38c18e80266fb14383754178202f40103646337722a594d984c 2024-03-30T15:08:42.967 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:42 smithi172 bash[49913]: Status: Downloaded newer image for quay.io/prometheus/node-exporter:v1.5.0 2024-03-30T15:08:43.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[21573]: cluster 2024-03-30T15:08:41.738207+0000 mgr.y (mgr.14526) 30 : cluster 0 pgmap v9: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-03-30T15:08:43.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[28946]: cluster 2024-03-30T15:08:41.738207+0000 mgr.y (mgr.14526) 30 : cluster 0 pgmap v9: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-03-30T15:08:43.918 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.592Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-03-30T15:08:43.919 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.592Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-03-30T15:08:43.919 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.592Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-03-30T15:08:43.919 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.592Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-03-30T15:08:43.919 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.593Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-03-30T15:08:43.919 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.593Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-03-30T15:08:43.919 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.594Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-03-30T15:08:43.919 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.594Z caller=node_exporter.go:117 level=info collector=arp 2024-03-30T15:08:43.919 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.594Z caller=node_exporter.go:117 level=info collector=bcache 2024-03-30T15:08:43.919 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.594Z caller=node_exporter.go:117 level=info collector=bonding 2024-03-30T15:08:43.919 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.594Z caller=node_exporter.go:117 level=info collector=btrfs 2024-03-30T15:08:43.919 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.594Z caller=node_exporter.go:117 level=info collector=conntrack 2024-03-30T15:08:43.919 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.594Z caller=node_exporter.go:117 level=info collector=cpu 2024-03-30T15:08:43.920 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.594Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-03-30T15:08:43.920 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.594Z caller=node_exporter.go:117 level=info collector=diskstats 2024-03-30T15:08:43.920 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.594Z caller=node_exporter.go:117 level=info collector=dmi 2024-03-30T15:08:43.920 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.594Z caller=node_exporter.go:117 level=info collector=edac 2024-03-30T15:08:43.920 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.594Z caller=node_exporter.go:117 level=info collector=entropy 2024-03-30T15:08:43.920 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.594Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-03-30T15:08:43.920 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.594Z caller=node_exporter.go:117 level=info collector=filefd 2024-03-30T15:08:43.920 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.594Z caller=node_exporter.go:117 level=info collector=filesystem 2024-03-30T15:08:43.920 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.594Z caller=node_exporter.go:117 level=info collector=hwmon 2024-03-30T15:08:43.920 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.594Z caller=node_exporter.go:117 level=info collector=infiniband 2024-03-30T15:08:43.920 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.594Z caller=node_exporter.go:117 level=info collector=ipvs 2024-03-30T15:08:43.920 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.594Z caller=node_exporter.go:117 level=info collector=loadavg 2024-03-30T15:08:43.920 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.594Z caller=node_exporter.go:117 level=info collector=mdadm 2024-03-30T15:08:43.920 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.594Z caller=node_exporter.go:117 level=info collector=meminfo 2024-03-30T15:08:43.920 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.594Z caller=node_exporter.go:117 level=info collector=netclass 2024-03-30T15:08:43.921 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.594Z caller=node_exporter.go:117 level=info collector=netdev 2024-03-30T15:08:43.921 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.594Z caller=node_exporter.go:117 level=info collector=netstat 2024-03-30T15:08:43.921 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.594Z caller=node_exporter.go:117 level=info collector=nfs 2024-03-30T15:08:43.921 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.594Z caller=node_exporter.go:117 level=info collector=nfsd 2024-03-30T15:08:43.921 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.594Z caller=node_exporter.go:117 level=info collector=nvme 2024-03-30T15:08:43.921 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.594Z caller=node_exporter.go:117 level=info collector=os 2024-03-30T15:08:43.921 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.594Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-03-30T15:08:43.921 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.594Z caller=node_exporter.go:117 level=info collector=pressure 2024-03-30T15:08:43.921 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.594Z caller=node_exporter.go:117 level=info collector=rapl 2024-03-30T15:08:43.921 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.594Z caller=node_exporter.go:117 level=info collector=schedstat 2024-03-30T15:08:43.921 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.594Z caller=node_exporter.go:117 level=info collector=selinux 2024-03-30T15:08:43.921 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.594Z caller=node_exporter.go:117 level=info collector=sockstat 2024-03-30T15:08:43.921 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.594Z caller=node_exporter.go:117 level=info collector=softnet 2024-03-30T15:08:43.921 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.594Z caller=node_exporter.go:117 level=info collector=stat 2024-03-30T15:08:43.922 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.594Z caller=node_exporter.go:117 level=info collector=tapestats 2024-03-30T15:08:43.922 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.594Z caller=node_exporter.go:117 level=info collector=textfile 2024-03-30T15:08:43.922 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.594Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-03-30T15:08:43.922 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.594Z caller=node_exporter.go:117 level=info collector=time 2024-03-30T15:08:43.922 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.594Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-03-30T15:08:43.922 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.594Z caller=node_exporter.go:117 level=info collector=uname 2024-03-30T15:08:43.922 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.594Z caller=node_exporter.go:117 level=info collector=vmstat 2024-03-30T15:08:43.922 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.594Z caller=node_exporter.go:117 level=info collector=xfs 2024-03-30T15:08:43.922 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.594Z caller=node_exporter.go:117 level=info collector=zfs 2024-03-30T15:08:43.922 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.594Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-03-30T15:08:43.922 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:43 smithi072 bash[57649]: ts=2024-03-30T15:08:43.594Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-03-30T15:08:43.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:43 smithi172 bash[23680]: cluster 2024-03-30T15:08:41.738207+0000 mgr.y (mgr.14526) 30 : cluster 0 pgmap v9: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-03-30T15:08:44.467 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.152Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-03-30T15:08:44.468 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.152Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-03-30T15:08:44.468 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.153Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-03-30T15:08:44.468 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.153Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-03-30T15:08:44.468 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.153Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-03-30T15:08:44.468 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.153Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-03-30T15:08:44.468 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.153Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-03-30T15:08:44.468 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.154Z caller=node_exporter.go:117 level=info collector=arp 2024-03-30T15:08:44.468 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.154Z caller=node_exporter.go:117 level=info collector=bcache 2024-03-30T15:08:44.468 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.154Z caller=node_exporter.go:117 level=info collector=bonding 2024-03-30T15:08:44.468 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.154Z caller=node_exporter.go:117 level=info collector=btrfs 2024-03-30T15:08:44.468 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.154Z caller=node_exporter.go:117 level=info collector=conntrack 2024-03-30T15:08:44.468 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.154Z caller=node_exporter.go:117 level=info collector=cpu 2024-03-30T15:08:44.468 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.154Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-03-30T15:08:44.469 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.154Z caller=node_exporter.go:117 level=info collector=diskstats 2024-03-30T15:08:44.469 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.154Z caller=node_exporter.go:117 level=info collector=dmi 2024-03-30T15:08:44.469 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.154Z caller=node_exporter.go:117 level=info collector=edac 2024-03-30T15:08:44.469 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.154Z caller=node_exporter.go:117 level=info collector=entropy 2024-03-30T15:08:44.469 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.154Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-03-30T15:08:44.469 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.154Z caller=node_exporter.go:117 level=info collector=filefd 2024-03-30T15:08:44.469 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.154Z caller=node_exporter.go:117 level=info collector=filesystem 2024-03-30T15:08:44.469 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.154Z caller=node_exporter.go:117 level=info collector=hwmon 2024-03-30T15:08:44.469 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.154Z caller=node_exporter.go:117 level=info collector=infiniband 2024-03-30T15:08:44.469 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.154Z caller=node_exporter.go:117 level=info collector=ipvs 2024-03-30T15:08:44.469 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.154Z caller=node_exporter.go:117 level=info collector=loadavg 2024-03-30T15:08:44.469 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.154Z caller=node_exporter.go:117 level=info collector=mdadm 2024-03-30T15:08:44.470 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.154Z caller=node_exporter.go:117 level=info collector=meminfo 2024-03-30T15:08:44.470 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.154Z caller=node_exporter.go:117 level=info collector=netclass 2024-03-30T15:08:44.470 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.154Z caller=node_exporter.go:117 level=info collector=netdev 2024-03-30T15:08:44.470 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.154Z caller=node_exporter.go:117 level=info collector=netstat 2024-03-30T15:08:44.470 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.154Z caller=node_exporter.go:117 level=info collector=nfs 2024-03-30T15:08:44.470 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.154Z caller=node_exporter.go:117 level=info collector=nfsd 2024-03-30T15:08:44.470 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.154Z caller=node_exporter.go:117 level=info collector=nvme 2024-03-30T15:08:44.470 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.154Z caller=node_exporter.go:117 level=info collector=os 2024-03-30T15:08:44.470 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.154Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-03-30T15:08:44.470 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.154Z caller=node_exporter.go:117 level=info collector=pressure 2024-03-30T15:08:44.470 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.154Z caller=node_exporter.go:117 level=info collector=rapl 2024-03-30T15:08:44.470 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.154Z caller=node_exporter.go:117 level=info collector=schedstat 2024-03-30T15:08:44.471 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.154Z caller=node_exporter.go:117 level=info collector=selinux 2024-03-30T15:08:44.471 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.154Z caller=node_exporter.go:117 level=info collector=sockstat 2024-03-30T15:08:44.471 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.154Z caller=node_exporter.go:117 level=info collector=softnet 2024-03-30T15:08:44.471 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.154Z caller=node_exporter.go:117 level=info collector=stat 2024-03-30T15:08:44.471 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.154Z caller=node_exporter.go:117 level=info collector=tapestats 2024-03-30T15:08:44.471 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.154Z caller=node_exporter.go:117 level=info collector=textfile 2024-03-30T15:08:44.471 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.154Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-03-30T15:08:44.471 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.154Z caller=node_exporter.go:117 level=info collector=time 2024-03-30T15:08:44.471 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.154Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-03-30T15:08:44.471 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.154Z caller=node_exporter.go:117 level=info collector=uname 2024-03-30T15:08:44.471 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.154Z caller=node_exporter.go:117 level=info collector=vmstat 2024-03-30T15:08:44.471 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.154Z caller=node_exporter.go:117 level=info collector=xfs 2024-03-30T15:08:44.471 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.154Z caller=node_exporter.go:117 level=info collector=zfs 2024-03-30T15:08:44.472 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.154Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-03-30T15:08:44.472 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:08:44 smithi172 bash[49913]: ts=2024-03-30T15:08:44.154Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-03-30T15:08:45.232 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T15:08:45.923 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:45 smithi072 bash[21573]: cluster 2024-03-30T15:08:43.738770+0000 mgr.y (mgr.14526) 31 : cluster 0 pgmap v10: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-30T15:08:45.923 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:45 smithi072 bash[21573]: audit 2024-03-30T15:08:44.831463+0000 mon.a (mon.0) 824 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:45.924 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:45 smithi072 bash[21573]: audit 2024-03-30T15:08:44.870837+0000 mon.c (mon.2) 54 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:08:45.924 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:45 smithi072 bash[28946]: cluster 2024-03-30T15:08:43.738770+0000 mgr.y (mgr.14526) 31 : cluster 0 pgmap v10: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-30T15:08:45.924 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:45 smithi072 bash[28946]: audit 2024-03-30T15:08:44.831463+0000 mon.a (mon.0) 824 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:45.924 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:45 smithi072 bash[28946]: audit 2024-03-30T15:08:44.870837+0000 mon.c (mon.2) 54 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:08:45.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:45 smithi172 bash[23680]: cluster 2024-03-30T15:08:43.738770+0000 mgr.y (mgr.14526) 31 : cluster 0 pgmap v10: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-30T15:08:45.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:45 smithi172 bash[23680]: audit 2024-03-30T15:08:44.831463+0000 mon.a (mon.0) 824 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:45.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:45 smithi172 bash[23680]: audit 2024-03-30T15:08:44.870837+0000 mon.c (mon.2) 54 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:08:47.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:47 smithi072 bash[21573]: cluster 2024-03-30T15:08:45.739783+0000 mgr.y (mgr.14526) 32 : cluster 0 pgmap v11: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-30T15:08:47.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:47 smithi072 bash[28946]: cluster 2024-03-30T15:08:45.739783+0000 mgr.y (mgr.14526) 32 : cluster 0 pgmap v11: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-30T15:08:47.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:47 smithi172 bash[23680]: cluster 2024-03-30T15:08:45.739783+0000 mgr.y (mgr.14526) 32 : cluster 0 pgmap v11: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-30T15:08:49.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:49 smithi072 bash[21573]: cluster 2024-03-30T15:08:47.741107+0000 mgr.y (mgr.14526) 33 : cluster 0 pgmap v12: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-30T15:08:49.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:49 smithi072 bash[28946]: cluster 2024-03-30T15:08:47.741107+0000 mgr.y (mgr.14526) 33 : cluster 0 pgmap v12: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-30T15:08:49.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:49 smithi172 bash[23680]: cluster 2024-03-30T15:08:47.741107+0000 mgr.y (mgr.14526) 33 : cluster 0 pgmap v12: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-30T15:08:51.217 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:08:50 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:08:51.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.551+0000 7f4c0cb04700 1 -- 172.21.15.72:0/2686035871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c0810c8a0 msgr2=0x7f4c0810ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:08:51.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.551+0000 7f4c0cb04700 1 --2- 172.21.15.72:0/2686035871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c0810c8a0 0x7f4c0810ed40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4c0000b0a0 tx=0x7f4c0000b3b0 comp rx=0 tx=0).stop 2024-03-30T15:08:51.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.551+0000 7f4c0cb04700 1 -- 172.21.15.72:0/2686035871 shutdown_connections 2024-03-30T15:08:51.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.551+0000 7f4c0cb04700 1 --2- 172.21.15.72:0/2686035871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c0810c8a0 0x7f4c0810ed40 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:08:51.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.551+0000 7f4c0cb04700 1 --2- 172.21.15.72:0/2686035871 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c08103550 0x7f4c08103930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:08:51.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.551+0000 7f4c0cb04700 1 --2- 172.21.15.72:0/2686035871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c08103e70 0x7f4c0810c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:08:51.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.551+0000 7f4c0cb04700 1 -- 172.21.15.72:0/2686035871 >> 172.21.15.72:0/2686035871 conn(0x7f4c080782f0 msgr2=0x7f4c08078700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:08:51.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.551+0000 7f4c0cb04700 1 -- 172.21.15.72:0/2686035871 shutdown_connections 2024-03-30T15:08:51.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.551+0000 7f4c0cb04700 1 -- 172.21.15.72:0/2686035871 wait complete. 2024-03-30T15:08:51.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.551+0000 7f4c0cb04700 1 Processor -- start 2024-03-30T15:08:51.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.551+0000 7f4c0cb04700 1 -- start start 2024-03-30T15:08:51.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.551+0000 7f4c0cb04700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c08103550 0x7f4c081011b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:08:51.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.551+0000 7f4c0cb04700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c08103e70 0x7f4c081016f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:08:51.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.551+0000 7f4c0cb04700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c0810c8a0 0x7f4c08101c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:08:51.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.551+0000 7f4c0cb04700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4c08111b00 con 0x7f4c08103550 2024-03-30T15:08:51.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.551+0000 7f4c0cb04700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4c08111980 con 0x7f4c0810c8a0 2024-03-30T15:08:51.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.551+0000 7f4c0cb04700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f4c08111c80 con 0x7f4c08103e70 2024-03-30T15:08:51.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.551+0000 7f4c0659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c08103550 0x7f4c081011b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:08:51.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.551+0000 7f4c0659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c08103550 0x7f4c081011b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41414/0 (socket says 172.21.15.72:41414) 2024-03-30T15:08:51.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.551+0000 7f4c0659c700 1 -- 172.21.15.72:0/1528901882 learned_addr learned my addr 172.21.15.72:0/1528901882 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T15:08:51.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.551+0000 7f4c05d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c08103e70 0x7f4c081016f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:08:51.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.551+0000 7f4c0659c700 1 -- 172.21.15.72:0/1528901882 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c08103e70 msgr2=0x7f4c081016f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:08:51.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.551+0000 7f4c0659c700 1 --2- 172.21.15.72:0/1528901882 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c08103e70 0x7f4c081016f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:08:51.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.551+0000 7f4c0659c700 1 -- 172.21.15.72:0/1528901882 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c0810c8a0 msgr2=0x7f4c08101c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:08:51.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.551+0000 7f4c0659c700 1 --2- 172.21.15.72:0/1528901882 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c0810c8a0 0x7f4c08101c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:08:51.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.551+0000 7f4c0659c700 1 -- 172.21.15.72:0/1528901882 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c081a6530 con 0x7f4c08103550 2024-03-30T15:08:51.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.551+0000 7f4c0659c700 1 --2- 172.21.15.72:0/1528901882 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c08103550 0x7f4c081011b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4bf800eb30 tx=0x7f4bf800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:08:51.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.551+0000 7f4bf77fe700 1 -- 172.21.15.72:0/1528901882 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf800cc90 con 0x7f4c08103550 2024-03-30T15:08:51.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.551+0000 7f4bf77fe700 1 -- 172.21.15.72:0/1528901882 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f4bf800ce30 con 0x7f4c08103550 2024-03-30T15:08:51.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.551+0000 7f4c0cb04700 1 -- 172.21.15.72:0/1528901882 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c081a6820 con 0x7f4c08103550 2024-03-30T15:08:51.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.551+0000 7f4bf77fe700 1 -- 172.21.15.72:0/1528901882 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf8003d80 con 0x7f4c08103550 2024-03-30T15:08:51.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.551+0000 7f4c0cb04700 1 -- 172.21.15.72:0/1528901882 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c081a6d60 con 0x7f4c08103550 2024-03-30T15:08:51.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.551+0000 7f4c0cb04700 1 -- 172.21.15.72:0/1528901882 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c0804ff00 con 0x7f4c08103550 2024-03-30T15:08:51.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.555+0000 7f4bf77fe700 1 -- 172.21.15.72:0/1528901882 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 21) ==== 91831+0+0 (secure 0 0 0) 0x7f4bf8003f20 con 0x7f4c08103550 2024-03-30T15:08:51.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.555+0000 7f4bf77fe700 1 --2- 172.21.15.72:0/1528901882 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f4bf006dc40 0x7f4bf0070100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:08:51.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.555+0000 7f4bf77fe700 1 -- 172.21.15.72:0/1528901882 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7537+0+0 (secure 0 0 0) 0x7f4bf808e330 con 0x7f4c08103550 2024-03-30T15:08:51.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.555+0000 7f4c05d9b700 1 --2- 172.21.15.72:0/1528901882 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f4bf006dc40 0x7f4bf0070100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:08:51.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.555+0000 7f4c05d9b700 1 --2- 172.21.15.72:0/1528901882 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f4bf006dc40 0x7f4bf0070100 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4c08078a40 tx=0x7f4bfc009190 comp rx=0 tx=0).ready entity=mgr.14526 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:08:51.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.559+0000 7f4bf77fe700 1 -- 172.21.15.72:0/1528901882 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f4bf805b910 con 0x7f4c08103550 2024-03-30T15:08:51.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.843+0000 7f4c0cb04700 1 -- 172.21.15.72:0/1528901882 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f4c0802db30 con 0x7f4c08103550 2024-03-30T15:08:51.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.851+0000 7f4bf77fe700 1 -- 172.21.15.72:0/1528901882 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) ==== 170+0+59 (secure 0 0 0) 0x7f4bf805f360 con 0x7f4c08103550 2024-03-30T15:08:51.849 INFO:teuthology.orchestra.run.smithi072.stdout:[client.0] 2024-03-30T15:08:51.849 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQADKwhmyBSjMhAAr1edrJyecw1uanW1MQQByw== 2024-03-30T15:08:51.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.851+0000 7f4c0cb04700 1 -- 172.21.15.72:0/1528901882 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f4bf006dc40 msgr2=0x7f4bf0070100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:08:51.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.851+0000 7f4c0cb04700 1 --2- 172.21.15.72:0/1528901882 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f4bf006dc40 0x7f4bf0070100 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4c08078a40 tx=0x7f4bfc009190 comp rx=0 tx=0).stop 2024-03-30T15:08:51.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.851+0000 7f4c0cb04700 1 -- 172.21.15.72:0/1528901882 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c08103550 msgr2=0x7f4c081011b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:08:51.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.851+0000 7f4c0cb04700 1 --2- 172.21.15.72:0/1528901882 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c08103550 0x7f4c081011b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4bf800eb30 tx=0x7f4bf800ee40 comp rx=0 tx=0).stop 2024-03-30T15:08:51.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.851+0000 7f4c0cb04700 1 -- 172.21.15.72:0/1528901882 shutdown_connections 2024-03-30T15:08:51.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.851+0000 7f4c0cb04700 1 --2- 172.21.15.72:0/1528901882 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f4bf006dc40 0x7f4bf0070100 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:08:51.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.851+0000 7f4c0cb04700 1 --2- 172.21.15.72:0/1528901882 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c0810c8a0 0x7f4c08101c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:08:51.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.851+0000 7f4c0cb04700 1 --2- 172.21.15.72:0/1528901882 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c08103550 0x7f4c081011b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:08:51.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.851+0000 7f4c0cb04700 1 --2- 172.21.15.72:0/1528901882 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c08103e70 0x7f4c081016f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:08:51.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.851+0000 7f4c0cb04700 1 -- 172.21.15.72:0/1528901882 >> 172.21.15.72:0/1528901882 conn(0x7f4c080782f0 msgr2=0x7f4c08104300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:08:51.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.851+0000 7f4c0cb04700 1 -- 172.21.15.72:0/1528901882 shutdown_connections 2024-03-30T15:08:51.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:08:51.851+0000 7f4c0cb04700 1 -- 172.21.15.72:0/1528901882 wait complete. 2024-03-30T15:08:51.894 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:51 smithi072 bash[21573]: cluster 2024-03-30T15:08:49.741803+0000 mgr.y (mgr.14526) 34 : cluster 0 pgmap v13: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:08:51.894 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:51 smithi072 bash[28946]: cluster 2024-03-30T15:08:49.741803+0000 mgr.y (mgr.14526) 34 : cluster 0 pgmap v13: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:08:51.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:51 smithi172 bash[23680]: cluster 2024-03-30T15:08:49.741803+0000 mgr.y (mgr.14526) 34 : cluster 0 pgmap v13: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:08:52.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:52 smithi072 bash[21573]: audit 2024-03-30T15:08:50.756315+0000 mgr.y (mgr.14526) 35 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:08:52.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:52 smithi072 bash[21573]: audit 2024-03-30T15:08:51.849376+0000 mon.a (mon.0) 825 : audit 1 from='client.? 172.21.15.72:0/1528901882' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-30T15:08:52.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:52 smithi072 bash[21573]: audit 2024-03-30T15:08:51.853448+0000 mon.a (mon.0) 826 : audit 1 from='client.? 172.21.15.72:0/1528901882' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-30T15:08:52.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:52 smithi072 bash[28946]: audit 2024-03-30T15:08:50.756315+0000 mgr.y (mgr.14526) 35 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:08:52.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:52 smithi072 bash[28946]: audit 2024-03-30T15:08:51.849376+0000 mon.a (mon.0) 825 : audit 1 from='client.? 172.21.15.72:0/1528901882' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-30T15:08:52.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:52 smithi072 bash[28946]: audit 2024-03-30T15:08:51.853448+0000 mon.a (mon.0) 826 : audit 1 from='client.? 172.21.15.72:0/1528901882' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-30T15:08:52.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:52 smithi172 bash[23680]: audit 2024-03-30T15:08:50.756315+0000 mgr.y (mgr.14526) 35 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:08:52.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:52 smithi172 bash[23680]: audit 2024-03-30T15:08:51.849376+0000 mon.a (mon.0) 825 : audit 1 from='client.? 172.21.15.72:0/1528901882' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-30T15:08:52.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:52 smithi172 bash[23680]: audit 2024-03-30T15:08:51.853448+0000 mon.a (mon.0) 826 : audit 1 from='client.? 172.21.15.72:0/1528901882' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-30T15:08:53.065 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-30T15:08:53.065 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-03-30T15:08:53.065 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-30T15:08:53.087 DEBUG:teuthology.orchestra.run.smithi172:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-03-30T15:08:53.237 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:53 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:53.237 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:53 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:53.238 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:53 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:53.238 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 30 15:08:53 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:53.238 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 30 15:08:53 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:53.239 INFO:journalctl@ceph.osd.3.smithi072.stdout:Mar 30 15:08:53 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:53.239 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 30 15:08:53 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:53.239 INFO:journalctl@ceph.rgw.foo.a.smithi072.stdout:Mar 30 15:08:53 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:53.239 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:08:53 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:53.359 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:08:53 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:53.359 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:08:53 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:53.360 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:08:53 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:53.510 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:53 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:53.510 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 30 15:08:53 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:53.511 INFO:journalctl@ceph.rgw.foo.a.smithi072.stdout:Mar 30 15:08:53 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:53.511 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 30 15:08:53 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:53.512 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:08:53 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:53.512 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:08:53 smithi072 systemd[1]: Started Ceph alertmanager.a for 97f8e564-eea5-11ee-b647-cb9ed24678a4. 2024-03-30T15:08:53.512 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 30 15:08:53 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:53.513 INFO:journalctl@ceph.osd.3.smithi072.stdout:Mar 30 15:08:53 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:53.513 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:08:53 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:53.514 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:53 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:53.514 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:08:53 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:08:53.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:53 smithi072 bash[28946]: cluster 2024-03-30T15:08:51.743364+0000 mgr.y (mgr.14526) 36 : cluster 0 pgmap v14: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:08:53.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:53 smithi072 bash[28946]: audit 2024-03-30T15:08:53.513078+0000 mon.a (mon.0) 827 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:53.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:53 smithi072 bash[28946]: audit 2024-03-30T15:08:53.523473+0000 mon.a (mon.0) 828 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:53.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:53 smithi072 bash[28946]: audit 2024-03-30T15:08:53.542520+0000 mon.a (mon.0) 829 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:53.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:53 smithi072 bash[28946]: audit 2024-03-30T15:08:53.551007+0000 mon.a (mon.0) 830 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:53.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:53 smithi072 bash[28946]: audit 2024-03-30T15:08:53.602258+0000 mon.c (mon.2) 55 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:08:53.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:53 smithi072 bash[21573]: cluster 2024-03-30T15:08:51.743364+0000 mgr.y (mgr.14526) 36 : cluster 0 pgmap v14: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:08:53.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:53 smithi072 bash[21573]: audit 2024-03-30T15:08:53.513078+0000 mon.a (mon.0) 827 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:53.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:53 smithi072 bash[21573]: audit 2024-03-30T15:08:53.523473+0000 mon.a (mon.0) 828 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:53.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:53 smithi072 bash[21573]: audit 2024-03-30T15:08:53.542520+0000 mon.a (mon.0) 829 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:53.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:53 smithi072 bash[21573]: audit 2024-03-30T15:08:53.551007+0000 mon.a (mon.0) 830 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:53.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:53 smithi072 bash[21573]: audit 2024-03-30T15:08:53.602258+0000 mon.c (mon.2) 55 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:08:53.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:53 smithi172 bash[23680]: cluster 2024-03-30T15:08:51.743364+0000 mgr.y (mgr.14526) 36 : cluster 0 pgmap v14: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:08:53.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:53 smithi172 bash[23680]: audit 2024-03-30T15:08:53.513078+0000 mon.a (mon.0) 827 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:53.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:53 smithi172 bash[23680]: audit 2024-03-30T15:08:53.523473+0000 mon.a (mon.0) 828 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:53.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:53 smithi172 bash[23680]: audit 2024-03-30T15:08:53.542520+0000 mon.a (mon.0) 829 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:53.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:53 smithi172 bash[23680]: audit 2024-03-30T15:08:53.551007+0000 mon.a (mon.0) 830 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:53.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:53 smithi172 bash[23680]: audit 2024-03-30T15:08:53.602258+0000 mon.c (mon.2) 55 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:08:55.168 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:08:54 smithi072 bash[58202]: ts=2024-03-30T15:08:54.865Z caller=main.go:240 level=info msg="Starting Alertmanager" version="(version=0.25.0, branch=HEAD, revision=258fab7cdd551f2cf251ed0348f0ad7289aee789)" 2024-03-30T15:08:55.168 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:08:54 smithi072 bash[58202]: ts=2024-03-30T15:08:54.865Z caller=main.go:241 level=info build_context="(go=go1.19.4, user=root@abe866dd5717, date=20221222-14:51:36)" 2024-03-30T15:08:55.168 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:08:54 smithi072 bash[58202]: ts=2024-03-30T15:08:54.867Z caller=cluster.go:185 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.72 port=9094 2024-03-30T15:08:55.168 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:08:54 smithi072 bash[58202]: ts=2024-03-30T15:08:54.868Z caller=cluster.go:681 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-03-30T15:08:55.168 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:08:54 smithi072 bash[58202]: ts=2024-03-30T15:08:54.898Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-03-30T15:08:55.168 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:08:54 smithi072 bash[58202]: ts=2024-03-30T15:08:54.899Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-03-30T15:08:55.169 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:08:54 smithi072 bash[58202]: ts=2024-03-30T15:08:54.902Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9093 2024-03-30T15:08:55.169 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:08:54 smithi072 bash[58202]: ts=2024-03-30T15:08:54.902Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-03-30T15:08:55.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:55 smithi072 bash[21573]: cluster 2024-03-30T15:08:53.744021+0000 mgr.y (mgr.14526) 37 : cluster 0 pgmap v15: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:08:55.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:55 smithi072 bash[21573]: audit 2024-03-30T15:08:54.840978+0000 mon.a (mon.0) 831 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:55.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:55 smithi072 bash[28946]: cluster 2024-03-30T15:08:53.744021+0000 mgr.y (mgr.14526) 37 : cluster 0 pgmap v15: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:08:55.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:55 smithi072 bash[28946]: audit 2024-03-30T15:08:54.840978+0000 mon.a (mon.0) 831 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:55.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:55 smithi172 bash[23680]: cluster 2024-03-30T15:08:53.744021+0000 mgr.y (mgr.14526) 37 : cluster 0 pgmap v15: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:08:55.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:55 smithi172 bash[23680]: audit 2024-03-30T15:08:54.840978+0000 mon.a (mon.0) 831 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:56.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:56 smithi072 bash[21573]: cluster 2024-03-30T15:08:55.745186+0000 mgr.y (mgr.14526) 38 : cluster 0 pgmap v16: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:08:56.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:56 smithi072 bash[28946]: cluster 2024-03-30T15:08:55.745186+0000 mgr.y (mgr.14526) 38 : cluster 0 pgmap v16: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:08:56.918 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:08:56 smithi072 bash[58202]: ts=2024-03-30T15:08:56.869Z caller=cluster.go:706 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000305506s 2024-03-30T15:08:56.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:56 smithi172 bash[23680]: cluster 2024-03-30T15:08:55.745186+0000 mgr.y (mgr.14526) 38 : cluster 0 pgmap v16: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:08:57.867 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.b/config 2024-03-30T15:08:59.633 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:08:59 smithi072 bash[21828]: [30/Mar/2024:15:08:59] ENGINE Bus STOPPING 2024-03-30T15:08:59.633 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:08:59 smithi072 bash[21828]: [30/Mar/2024:15:08:59] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-30T15:08:59.633 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:08:59 smithi072 bash[21828]: [30/Mar/2024:15:08:59] ENGINE Bus STOPPED 2024-03-30T15:08:59.633 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:08:59 smithi072 bash[21828]: [30/Mar/2024:15:08:59] ENGINE Bus STARTING 2024-03-30T15:08:59.633 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:08:59 smithi072 bash[21828]: [30/Mar/2024:15:08:59] ENGINE Serving on http://:::9283 2024-03-30T15:08:59.633 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:08:59 smithi072 bash[21828]: [30/Mar/2024:15:08:59] ENGINE Bus STARTED 2024-03-30T15:08:59.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:59 smithi072 bash[28946]: cluster 2024-03-30T15:08:57.746158+0000 mgr.y (mgr.14526) 39 : cluster 0 pgmap v17: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:08:59.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:59 smithi072 bash[28946]: audit 2024-03-30T15:08:58.635572+0000 mon.a (mon.0) 832 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:59.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:59 smithi072 bash[28946]: audit 2024-03-30T15:08:58.647445+0000 mon.a (mon.0) 833 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:59.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:59 smithi072 bash[28946]: audit 2024-03-30T15:08:59.186714+0000 mon.a (mon.0) 834 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:59.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:59 smithi072 bash[28946]: audit 2024-03-30T15:08:59.193489+0000 mon.a (mon.0) 835 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:59.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:59 smithi072 bash[28946]: audit 2024-03-30T15:08:59.195253+0000 mon.c (mon.2) 56 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:08:59.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:59 smithi072 bash[28946]: audit 2024-03-30T15:08:59.196073+0000 mon.c (mon.2) 57 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:08:59.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:59 smithi072 bash[28946]: audit 2024-03-30T15:08:59.202240+0000 mon.a (mon.0) 836 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:59.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:59 smithi072 bash[28946]: audit 2024-03-30T15:08:59.250113+0000 mon.a (mon.0) 837 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:59.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:59 smithi072 bash[28946]: audit 2024-03-30T15:08:59.256658+0000 mon.a (mon.0) 838 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:59.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:59 smithi072 bash[28946]: audit 2024-03-30T15:08:59.263026+0000 mon.c (mon.2) 58 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-03-30T15:08:59.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:08:59 smithi072 bash[28946]: audit 2024-03-30T15:08:59.270670+0000 mon.a (mon.0) 839 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:59.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:59 smithi072 bash[21573]: cluster 2024-03-30T15:08:57.746158+0000 mgr.y (mgr.14526) 39 : cluster 0 pgmap v17: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:08:59.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:59 smithi072 bash[21573]: audit 2024-03-30T15:08:58.635572+0000 mon.a (mon.0) 832 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:59.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:59 smithi072 bash[21573]: audit 2024-03-30T15:08:58.647445+0000 mon.a (mon.0) 833 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:59.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:59 smithi072 bash[21573]: audit 2024-03-30T15:08:59.186714+0000 mon.a (mon.0) 834 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:59.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:59 smithi072 bash[21573]: audit 2024-03-30T15:08:59.193489+0000 mon.a (mon.0) 835 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:59.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:59 smithi072 bash[21573]: audit 2024-03-30T15:08:59.195253+0000 mon.c (mon.2) 56 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:08:59.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:59 smithi072 bash[21573]: audit 2024-03-30T15:08:59.196073+0000 mon.c (mon.2) 57 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:08:59.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:59 smithi072 bash[21573]: audit 2024-03-30T15:08:59.202240+0000 mon.a (mon.0) 836 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:59.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:59 smithi072 bash[21573]: audit 2024-03-30T15:08:59.250113+0000 mon.a (mon.0) 837 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:59.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:59 smithi072 bash[21573]: audit 2024-03-30T15:08:59.256658+0000 mon.a (mon.0) 838 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:59.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:59 smithi072 bash[21573]: audit 2024-03-30T15:08:59.263026+0000 mon.c (mon.2) 58 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-03-30T15:08:59.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:08:59 smithi072 bash[21573]: audit 2024-03-30T15:08:59.270670+0000 mon.a (mon.0) 839 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:59.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:59 smithi172 bash[23680]: cluster 2024-03-30T15:08:57.746158+0000 mgr.y (mgr.14526) 39 : cluster 0 pgmap v17: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:08:59.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:59 smithi172 bash[23680]: audit 2024-03-30T15:08:58.635572+0000 mon.a (mon.0) 832 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:59.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:59 smithi172 bash[23680]: audit 2024-03-30T15:08:58.647445+0000 mon.a (mon.0) 833 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:59.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:59 smithi172 bash[23680]: audit 2024-03-30T15:08:59.186714+0000 mon.a (mon.0) 834 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:59.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:59 smithi172 bash[23680]: audit 2024-03-30T15:08:59.193489+0000 mon.a (mon.0) 835 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:59.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:59 smithi172 bash[23680]: audit 2024-03-30T15:08:59.195253+0000 mon.c (mon.2) 56 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:08:59.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:59 smithi172 bash[23680]: audit 2024-03-30T15:08:59.196073+0000 mon.c (mon.2) 57 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:08:59.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:59 smithi172 bash[23680]: audit 2024-03-30T15:08:59.202240+0000 mon.a (mon.0) 836 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:59.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:59 smithi172 bash[23680]: audit 2024-03-30T15:08:59.250113+0000 mon.a (mon.0) 837 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:59.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:59 smithi172 bash[23680]: audit 2024-03-30T15:08:59.256658+0000 mon.a (mon.0) 838 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:08:59.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:59 smithi172 bash[23680]: audit 2024-03-30T15:08:59.263026+0000 mon.c (mon.2) 58 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-03-30T15:08:59.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:08:59 smithi172 bash[23680]: audit 2024-03-30T15:08:59.270670+0000 mon.a (mon.0) 839 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:00.467 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:00 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:09:00.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.679+0000 7f0b1c4a4700 1 -- 172.21.15.172:0/1631508289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b1406a960 msgr2=0x7f0b1406ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:00.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.679+0000 7f0b1c4a4700 1 --2- 172.21.15.172:0/1631508289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b1406a960 0x7f0b1406ad40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0b10009990 tx=0x7f0b10009ca0 comp rx=0 tx=0).stop 2024-03-30T15:09:00.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.679+0000 7f0b1c4a4700 1 -- 172.21.15.172:0/1631508289 shutdown_connections 2024-03-30T15:09:00.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.679+0000 7f0b1c4a4700 1 --2- 172.21.15.172:0/1631508289 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b1410ec90 0x7f0b14111080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:00.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.679+0000 7f0b1c4a4700 1 --2- 172.21.15.172:0/1631508289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b1406a960 0x7f0b1406ad40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:00.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.679+0000 7f0b1c4a4700 1 --2- 172.21.15.172:0/1631508289 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b1406b280 0x7f0b1410e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:00.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.679+0000 7f0b1c4a4700 1 -- 172.21.15.172:0/1631508289 >> 172.21.15.172:0/1631508289 conn(0x7f0b14078290 msgr2=0x7f0b140786a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:09:00.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.679+0000 7f0b1c4a4700 1 -- 172.21.15.172:0/1631508289 shutdown_connections 2024-03-30T15:09:00.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.679+0000 7f0b1c4a4700 1 -- 172.21.15.172:0/1631508289 wait complete. 2024-03-30T15:09:00.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.679+0000 7f0b1c4a4700 1 Processor -- start 2024-03-30T15:09:00.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.679+0000 7f0b1c4a4700 1 -- start start 2024-03-30T15:09:00.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.679+0000 7f0b1c4a4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b1406a960 0x7f0b1419a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:00.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.679+0000 7f0b1c4a4700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b1406b280 0x7f0b1419a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:00.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.679+0000 7f0b1c4a4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b1410ec90 0x7f0b1419eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:00.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.679+0000 7f0b1c4a4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0b14113d00 con 0x7f0b1410ec90 2024-03-30T15:09:00.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.679+0000 7f0b1c4a4700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0b14113b80 con 0x7f0b1406b280 2024-03-30T15:09:00.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.679+0000 7f0b1c4a4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f0b14113e80 con 0x7f0b1406a960 2024-03-30T15:09:00.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.679+0000 7f0b19a3f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b1406b280 0x7f0b1419a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:00.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.679+0000 7f0b19a3f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b1406b280 0x7f0b1419a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41884/0 (socket says 172.21.15.172:41884) 2024-03-30T15:09:00.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.679+0000 7f0b19a3f700 1 -- 172.21.15.172:0/1279225472 learned_addr learned my addr 172.21.15.172:0/1279225472 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-03-30T15:09:00.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.679+0000 7f0b1a240700 1 --2- 172.21.15.172:0/1279225472 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b1406a960 0x7f0b1419a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:00.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.679+0000 7f0b1aa41700 1 --2- 172.21.15.172:0/1279225472 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b1410ec90 0x7f0b1419eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:00.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.679+0000 7f0b19a3f700 1 -- 172.21.15.172:0/1279225472 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b1406a960 msgr2=0x7f0b1419a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:00.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.679+0000 7f0b19a3f700 1 --2- 172.21.15.172:0/1279225472 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b1406a960 0x7f0b1419a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:00.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.679+0000 7f0b19a3f700 1 -- 172.21.15.172:0/1279225472 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b1410ec90 msgr2=0x7f0b1419eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:00.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.679+0000 7f0b19a3f700 1 --2- 172.21.15.172:0/1279225472 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b1410ec90 0x7f0b1419eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:00.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.679+0000 7f0b19a3f700 1 -- 172.21.15.172:0/1279225472 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b1419f270 con 0x7f0b1406b280 2024-03-30T15:09:00.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.679+0000 7f0b1aa41700 1 --2- 172.21.15.172:0/1279225472 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b1410ec90 0x7f0b1419eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T15:09:00.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.683+0000 7f0b19a3f700 1 --2- 172.21.15.172:0/1279225472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b1406b280 0x7f0b1419a7a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0b0400b500 tx=0x7f0b0400b8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:09:00.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.683+0000 7f0b0b7fe700 1 -- 172.21.15.172:0/1279225472 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b04015020 con 0x7f0b1406b280 2024-03-30T15:09:00.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.683+0000 7f0b0b7fe700 1 -- 172.21.15.172:0/1279225472 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f0b04011cb0 con 0x7f0b1406b280 2024-03-30T15:09:00.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.683+0000 7f0b1c4a4700 1 -- 172.21.15.172:0/1279225472 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b1419f560 con 0x7f0b1406b280 2024-03-30T15:09:00.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.683+0000 7f0b0b7fe700 1 -- 172.21.15.172:0/1279225472 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b04010c70 con 0x7f0b1406b280 2024-03-30T15:09:00.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.683+0000 7f0b1c4a4700 1 -- 172.21.15.172:0/1279225472 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b141a6de0 con 0x7f0b1406b280 2024-03-30T15:09:00.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.683+0000 7f0b1c4a4700 1 -- 172.21.15.172:0/1279225472 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b141017b0 con 0x7f0b1406b280 2024-03-30T15:09:00.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.683+0000 7f0b0b7fe700 1 -- 172.21.15.172:0/1279225472 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 21) ==== 91831+0+0 (secure 0 0 0) 0x7f0b04018020 con 0x7f0b1406b280 2024-03-30T15:09:00.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.683+0000 7f0b0b7fe700 1 --2- 172.21.15.172:0/1279225472 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f0b0006dc40 0x7f0b00070100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:00.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.683+0000 7f0b0b7fe700 1 -- 172.21.15.172:0/1279225472 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7537+0+0 (secure 0 0 0) 0x7f0b0408d870 con 0x7f0b1406b280 2024-03-30T15:09:00.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.683+0000 7f0b1a240700 1 --2- 172.21.15.172:0/1279225472 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f0b0006dc40 0x7f0b00070100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:00.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.683+0000 7f0b1a240700 1 --2- 172.21.15.172:0/1279225472 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f0b0006dc40 0x7f0b00070100 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0b10006010 tx=0x7f0b1001a040 comp rx=0 tx=0).ready entity=mgr.14526 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:09:00.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.687+0000 7f0b0b7fe700 1 -- 172.21.15.172:0/1279225472 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f0b0401f020 con 0x7f0b1406b280 2024-03-30T15:09:00.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:00 smithi072 bash[21573]: cephadm 2024-03-30T15:08:59.217789+0000 mgr.y (mgr.14526) 40 : cephadm 1 Regenerating cephadm self-signed grafana TLS certificates 2024-03-30T15:09:00.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:00 smithi072 bash[21573]: audit 2024-03-30T15:08:59.264111+0000 mgr.y (mgr.14526) 41 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-03-30T15:09:00.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:00 smithi072 bash[21573]: cephadm 2024-03-30T15:08:59.300155+0000 mgr.y (mgr.14526) 42 : cephadm 1 Deploying daemon grafana.a on smithi172 2024-03-30T15:09:00.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:00 smithi072 bash[21573]: audit 2024-03-30T15:08:59.901951+0000 mon.c (mon.2) 59 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:09:00.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:00 smithi072 bash[28946]: cephadm 2024-03-30T15:08:59.217789+0000 mgr.y (mgr.14526) 40 : cephadm 1 Regenerating cephadm self-signed grafana TLS certificates 2024-03-30T15:09:00.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:00 smithi072 bash[28946]: audit 2024-03-30T15:08:59.264111+0000 mgr.y (mgr.14526) 41 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-03-30T15:09:00.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:00 smithi072 bash[28946]: cephadm 2024-03-30T15:08:59.300155+0000 mgr.y (mgr.14526) 42 : cephadm 1 Deploying daemon grafana.a on smithi172 2024-03-30T15:09:00.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:00 smithi072 bash[28946]: audit 2024-03-30T15:08:59.901951+0000 mon.c (mon.2) 59 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:09:00.967 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:09:00 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:09:00.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:00 smithi172 bash[23680]: cephadm 2024-03-30T15:08:59.217789+0000 mgr.y (mgr.14526) 40 : cephadm 1 Regenerating cephadm self-signed grafana TLS certificates 2024-03-30T15:09:00.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:00 smithi172 bash[23680]: audit 2024-03-30T15:08:59.264111+0000 mgr.y (mgr.14526) 41 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-03-30T15:09:00.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:00 smithi172 bash[23680]: cephadm 2024-03-30T15:08:59.300155+0000 mgr.y (mgr.14526) 42 : cephadm 1 Deploying daemon grafana.a on smithi172 2024-03-30T15:09:00.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:00 smithi172 bash[23680]: audit 2024-03-30T15:08:59.901951+0000 mon.c (mon.2) 59 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:09:00.987 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.987+0000 7f0b1c4a4700 1 -- 172.21.15.172:0/1279225472 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f0b141a6fb0 con 0x7f0b1406b280 2024-03-30T15:09:00.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.999+0000 7f0b0b7fe700 1 -- 172.21.15.172:0/1279225472 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v18) ==== 170+0+59 (secure 0 0 0) 0x7f0b0405e8a0 con 0x7f0b1406b280 2024-03-30T15:09:00.997 INFO:teuthology.orchestra.run.smithi172.stdout:[client.1] 2024-03-30T15:09:00.997 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQAMKwhmGoA3OxAAKRjWVdy6G/HEFuyVLtn4mA== 2024-03-30T15:09:01.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.999+0000 7f0b1c4a4700 1 -- 172.21.15.172:0/1279225472 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f0b0006dc40 msgr2=0x7f0b00070100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:01.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.999+0000 7f0b1c4a4700 1 --2- 172.21.15.172:0/1279225472 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f0b0006dc40 0x7f0b00070100 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0b10006010 tx=0x7f0b1001a040 comp rx=0 tx=0).stop 2024-03-30T15:09:01.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.999+0000 7f0b1c4a4700 1 -- 172.21.15.172:0/1279225472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b1406b280 msgr2=0x7f0b1419a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:01.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.999+0000 7f0b1c4a4700 1 --2- 172.21.15.172:0/1279225472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b1406b280 0x7f0b1419a7a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0b0400b500 tx=0x7f0b0400b8c0 comp rx=0 tx=0).stop 2024-03-30T15:09:01.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.999+0000 7f0b1c4a4700 1 -- 172.21.15.172:0/1279225472 shutdown_connections 2024-03-30T15:09:01.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.999+0000 7f0b1c4a4700 1 --2- 172.21.15.172:0/1279225472 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b1410ec90 0x7f0b1419eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:01.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.999+0000 7f0b1c4a4700 1 --2- 172.21.15.172:0/1279225472 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b1406a960 0x7f0b1419a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:01.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.999+0000 7f0b1c4a4700 1 --2- 172.21.15.172:0/1279225472 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f0b0006dc40 0x7f0b00070100 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:01.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.999+0000 7f0b1c4a4700 1 --2- 172.21.15.172:0/1279225472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b1406b280 0x7f0b1419a7a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:01.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.999+0000 7f0b1c4a4700 1 -- 172.21.15.172:0/1279225472 >> 172.21.15.172:0/1279225472 conn(0x7f0b14078290 msgr2=0x7f0b141000d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:09:01.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.999+0000 7f0b1c4a4700 1 -- 172.21.15.172:0/1279225472 shutdown_connections 2024-03-30T15:09:01.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-30T15:09:00.999+0000 7f0b1c4a4700 1 -- 172.21.15.172:0/1279225472 wait complete. 2024-03-30T15:09:01.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:01 smithi072 bash[21573]: cluster 2024-03-30T15:08:59.746805+0000 mgr.y (mgr.14526) 43 : cluster 0 pgmap v18: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:01.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:01 smithi072 bash[21573]: audit 2024-03-30T15:09:00.763755+0000 mgr.y (mgr.14526) 44 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:09:01.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:01 smithi072 bash[21573]: audit 2024-03-30T15:09:00.992614+0000 mon.b (mon.1) 33 : audit 1 from='client.? 172.21.15.172:0/1279225472' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-30T15:09:01.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:01 smithi072 bash[21573]: audit 2024-03-30T15:09:00.993064+0000 mon.a (mon.0) 840 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-30T15:09:01.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:01 smithi072 bash[21573]: audit 2024-03-30T15:09:00.996729+0000 mon.a (mon.0) 841 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-30T15:09:01.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:01 smithi072 bash[28946]: cluster 2024-03-30T15:08:59.746805+0000 mgr.y (mgr.14526) 43 : cluster 0 pgmap v18: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:01.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:01 smithi072 bash[28946]: audit 2024-03-30T15:09:00.763755+0000 mgr.y (mgr.14526) 44 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:09:01.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:01 smithi072 bash[28946]: audit 2024-03-30T15:09:00.992614+0000 mon.b (mon.1) 33 : audit 1 from='client.? 172.21.15.172:0/1279225472' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-30T15:09:01.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:01 smithi072 bash[28946]: audit 2024-03-30T15:09:00.993064+0000 mon.a (mon.0) 840 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-30T15:09:01.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:01 smithi072 bash[28946]: audit 2024-03-30T15:09:00.996729+0000 mon.a (mon.0) 841 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-30T15:09:02.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:01 smithi172 bash[23680]: cluster 2024-03-30T15:08:59.746805+0000 mgr.y (mgr.14526) 43 : cluster 0 pgmap v18: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:02.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:01 smithi172 bash[23680]: audit 2024-03-30T15:09:00.763755+0000 mgr.y (mgr.14526) 44 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:09:02.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:01 smithi172 bash[23680]: audit 2024-03-30T15:09:00.992614+0000 mon.b (mon.1) 33 : audit 1 from='client.? 172.21.15.172:0/1279225472' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-30T15:09:02.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:01 smithi172 bash[23680]: audit 2024-03-30T15:09:00.993064+0000 mon.a (mon.0) 840 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-30T15:09:02.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:01 smithi172 bash[23680]: audit 2024-03-30T15:09:00.996729+0000 mon.a (mon.0) 841 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-30T15:09:02.675 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-03-30T15:09:02.675 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-03-30T15:09:02.675 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-03-30T15:09:02.698 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-30T15:09:02.699 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-03-30T15:09:02.699 DEBUG:teuthology.orchestra.run.smithi072:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph mgr dump --format=json 2024-03-30T15:09:02.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:02 smithi072 bash[21573]: cluster 2024-03-30T15:09:01.748236+0000 mgr.y (mgr.14526) 45 : cluster 0 pgmap v19: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:09:02.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:02 smithi072 bash[28946]: cluster 2024-03-30T15:09:01.748236+0000 mgr.y (mgr.14526) 45 : cluster 0 pgmap v19: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:09:02.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:02 smithi172 bash[23680]: cluster 2024-03-30T15:09:01.748236+0000 mgr.y (mgr.14526) 45 : cluster 0 pgmap v19: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:09:05.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:04 smithi072 bash[21573]: cluster 2024-03-30T15:09:03.748959+0000 mgr.y (mgr.14526) 46 : cluster 0 pgmap v20: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:05.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:04 smithi072 bash[28946]: cluster 2024-03-30T15:09:03.748959+0000 mgr.y (mgr.14526) 46 : cluster 0 pgmap v20: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:05.168 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:09:04 smithi072 bash[58202]: ts=2024-03-30T15:09:04.872Z caller=cluster.go:698 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.003216661s 2024-03-30T15:09:05.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:04 smithi172 bash[23680]: cluster 2024-03-30T15:09:03.748959+0000 mgr.y (mgr.14526) 46 : cluster 0 pgmap v20: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:07.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:06 smithi072 bash[21573]: cluster 2024-03-30T15:09:05.750347+0000 mgr.y (mgr.14526) 47 : cluster 0 pgmap v21: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:09:07.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:06 smithi072 bash[28946]: cluster 2024-03-30T15:09:05.750347+0000 mgr.y (mgr.14526) 47 : cluster 0 pgmap v21: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:09:07.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:06 smithi172 bash[23680]: cluster 2024-03-30T15:09:05.750347+0000 mgr.y (mgr.14526) 47 : cluster 0 pgmap v21: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:09:07.477 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T15:09:09.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:09 smithi072 bash[21573]: cluster 2024-03-30T15:09:07.751147+0000 mgr.y (mgr.14526) 48 : cluster 0 pgmap v22: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:09.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:09 smithi072 bash[28946]: cluster 2024-03-30T15:09:07.751147+0000 mgr.y (mgr.14526) 48 : cluster 0 pgmap v22: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:09.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:09 smithi172 bash[23680]: cluster 2024-03-30T15:09:07.751147+0000 mgr.y (mgr.14526) 48 : cluster 0 pgmap v22: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:10.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.175+0000 7f6ba6a25700 1 -- 172.21.15.72:0/3443792920 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ba0102e60 msgr2=0x7f6ba0106eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:10.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.175+0000 7f6ba6a25700 1 --2- 172.21.15.72:0/3443792920 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ba0102e60 0x7f6ba0106eb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6b880099c0 tx=0x7f6b88009cd0 comp rx=0 tx=0).stop 2024-03-30T15:09:10.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.175+0000 7f6ba6a25700 1 -- 172.21.15.72:0/3443792920 shutdown_connections 2024-03-30T15:09:10.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.175+0000 7f6ba6a25700 1 --2- 172.21.15.72:0/3443792920 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ba0107590 0x7f6ba010f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:10.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.175+0000 7f6ba6a25700 1 --2- 172.21.15.72:0/3443792920 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ba01024b0 0x7f6ba0102890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:10.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.175+0000 7f6ba6a25700 1 --2- 172.21.15.72:0/3443792920 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ba0102e60 0x7f6ba0106eb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:10.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.175+0000 7f6ba6a25700 1 -- 172.21.15.72:0/3443792920 >> 172.21.15.72:0/3443792920 conn(0x7f6ba0079610 msgr2=0x7f6ba0079a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:09:10.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.175+0000 7f6ba6a25700 1 -- 172.21.15.72:0/3443792920 shutdown_connections 2024-03-30T15:09:10.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.175+0000 7f6ba6a25700 1 -- 172.21.15.72:0/3443792920 wait complete. 2024-03-30T15:09:10.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.175+0000 7f6ba6a25700 1 Processor -- start 2024-03-30T15:09:10.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.175+0000 7f6ba6a25700 1 -- start start 2024-03-30T15:09:10.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.175+0000 7f6ba6a25700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ba01024b0 0x7f6ba0109180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:10.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.175+0000 7f6ba6a25700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ba0102e60 0x7f6ba01096c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:10.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.175+0000 7f6ba6a25700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ba0107590 0x7f6ba0109c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:10.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.175+0000 7f6ba6a25700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba0111aa0 con 0x7f6ba0107590 2024-03-30T15:09:10.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.175+0000 7f6ba6a25700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba0111920 con 0x7f6ba01024b0 2024-03-30T15:09:10.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.175+0000 7f6ba6a25700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f6ba0111c20 con 0x7f6ba0102e60 2024-03-30T15:09:10.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.175+0000 7f6b977fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ba0102e60 0x7f6ba01096c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:10.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.175+0000 7f6b977fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ba0102e60 0x7f6ba01096c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44410/0 (socket says 172.21.15.72:44410) 2024-03-30T15:09:10.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.175+0000 7f6b977fe700 1 -- 172.21.15.72:0/764380386 learned_addr learned my addr 172.21.15.72:0/764380386 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T15:09:10.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.175+0000 7f6ba4fc2700 1 --2- 172.21.15.72:0/764380386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ba0107590 0x7f6ba0109c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:10.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.175+0000 7f6b9ffff700 1 --2- 172.21.15.72:0/764380386 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ba01024b0 0x7f6ba0109180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:10.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.175+0000 7f6b977fe700 1 -- 172.21.15.72:0/764380386 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ba01024b0 msgr2=0x7f6ba0109180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:10.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.175+0000 7f6b977fe700 1 --2- 172.21.15.72:0/764380386 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ba01024b0 0x7f6ba0109180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:10.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.175+0000 7f6b977fe700 1 -- 172.21.15.72:0/764380386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ba0107590 msgr2=0x7f6ba0109c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:10.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.175+0000 7f6b977fe700 1 --2- 172.21.15.72:0/764380386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ba0107590 0x7f6ba0109c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:10.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.175+0000 7f6b977fe700 1 -- 172.21.15.72:0/764380386 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ba01aa950 con 0x7f6ba0102e60 2024-03-30T15:09:10.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.175+0000 7f6ba4fc2700 1 --2- 172.21.15.72:0/764380386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ba0107590 0x7f6ba0109c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T15:09:10.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.175+0000 7f6b977fe700 1 --2- 172.21.15.72:0/764380386 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ba0102e60 0x7f6ba01096c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6b88004610 tx=0x7f6b88004640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:09:10.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.175+0000 7f6b9dffb700 1 -- 172.21.15.72:0/764380386 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b88026070 con 0x7f6ba0102e60 2024-03-30T15:09:10.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.175+0000 7f6ba6a25700 1 -- 172.21.15.72:0/764380386 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ba01aabe0 con 0x7f6ba0102e60 2024-03-30T15:09:10.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.175+0000 7f6b9dffb700 1 -- 172.21.15.72:0/764380386 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f6b88003e50 con 0x7f6ba0102e60 2024-03-30T15:09:10.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.175+0000 7f6b9dffb700 1 -- 172.21.15.72:0/764380386 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8800fa80 con 0x7f6ba0102e60 2024-03-30T15:09:10.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.175+0000 7f6ba6a25700 1 -- 172.21.15.72:0/764380386 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ba01ab090 con 0x7f6ba0102e60 2024-03-30T15:09:10.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.179+0000 7f6ba6a25700 1 -- 172.21.15.72:0/764380386 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ba0103990 con 0x7f6ba0102e60 2024-03-30T15:09:10.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.179+0000 7f6b9dffb700 1 -- 172.21.15.72:0/764380386 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 21) ==== 91831+0+0 (secure 0 0 0) 0x7f6b88029070 con 0x7f6ba0102e60 2024-03-30T15:09:10.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.179+0000 7f6b9dffb700 1 --2- 172.21.15.72:0/764380386 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f6b8c06dc40 0x7f6b8c070100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:10.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.179+0000 7f6b9dffb700 1 -- 172.21.15.72:0/764380386 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(74..74 src has 1..74) ==== 7537+0+0 (secure 0 0 0) 0x7f6b8808ea20 con 0x7f6ba0102e60 2024-03-30T15:09:10.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.179+0000 7f6b9ffff700 1 --2- 172.21.15.72:0/764380386 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f6b8c06dc40 0x7f6b8c070100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:10.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.179+0000 7f6b9ffff700 1 --2- 172.21.15.72:0/764380386 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f6b8c06dc40 0x7f6b8c070100 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6b90009bf0 tx=0x7f6b90009260 comp rx=0 tx=0).ready entity=mgr.14526 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:09:10.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.183+0000 7f6b9dffb700 1 -- 172.21.15.72:0/764380386 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f6b88013070 con 0x7f6ba0102e60 2024-03-30T15:09:10.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.451+0000 7f6ba6a25700 1 -- 172.21.15.72:0/764380386 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f6ba010a6b0 con 0x7f6ba0102e60 2024-03-30T15:09:10.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.463+0000 7f6b9dffb700 1 -- 172.21.15.72:0/764380386 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v21) ==== 74+0+175410 (secure 0 0 0) 0x7f6b8805c080 con 0x7f6ba0102e60 2024-03-30T15:09:10.463 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-30T15:09:10.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.463+0000 7f6ba6a25700 1 -- 172.21.15.72:0/764380386 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f6b8c06dc40 msgr2=0x7f6b8c070100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:10.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.463+0000 7f6ba6a25700 1 --2- 172.21.15.72:0/764380386 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f6b8c06dc40 0x7f6b8c070100 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6b90009bf0 tx=0x7f6b90009260 comp rx=0 tx=0).stop 2024-03-30T15:09:10.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.463+0000 7f6ba6a25700 1 -- 172.21.15.72:0/764380386 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ba0102e60 msgr2=0x7f6ba01096c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:10.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.463+0000 7f6ba6a25700 1 --2- 172.21.15.72:0/764380386 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ba0102e60 0x7f6ba01096c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6b88004610 tx=0x7f6b88004640 comp rx=0 tx=0).stop 2024-03-30T15:09:10.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.463+0000 7f6ba6a25700 1 -- 172.21.15.72:0/764380386 shutdown_connections 2024-03-30T15:09:10.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.463+0000 7f6ba6a25700 1 --2- 172.21.15.72:0/764380386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ba0107590 0x7f6ba0109c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:10.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.463+0000 7f6ba6a25700 1 --2- 172.21.15.72:0/764380386 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f6b8c06dc40 0x7f6b8c070100 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:10.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.463+0000 7f6ba6a25700 1 --2- 172.21.15.72:0/764380386 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ba01024b0 0x7f6ba0109180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:10.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.463+0000 7f6ba6a25700 1 --2- 172.21.15.72:0/764380386 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ba0102e60 0x7f6ba01096c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:10.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.463+0000 7f6ba6a25700 1 -- 172.21.15.72:0/764380386 >> 172.21.15.72:0/764380386 conn(0x7f6ba0079610 msgr2=0x7f6ba00ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:09:10.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.463+0000 7f6ba6a25700 1 -- 172.21.15.72:0/764380386 shutdown_connections 2024-03-30T15:09:10.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:10.463+0000 7f6ba6a25700 1 -- 172.21.15.72:0/764380386 wait complete. 2024-03-30T15:09:11.194 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":21,"flags":0,"active_gid":14526,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2033000132},{"type":"v1","addr":"172.21.15.72:6801","nonce":2033000132}]},"active_addr":"172.21.15.72:6801/2033000132","active_change":"2024-03-30T15:08:29.707326+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24424,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.72:8443/","prometheus":"http://172.21.15.72:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":74,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":2432903891}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":3534125915}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":422417540}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":1212739347}]}]} 2024-03-30T15:09:11.198 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-03-30T15:09:11.199 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-03-30T15:09:11.199 DEBUG:teuthology.orchestra.run.smithi072:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph osd dump --format=json 2024-03-30T15:09:11.216 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:09:10 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:09:11.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:11 smithi072 bash[21573]: cluster 2024-03-30T15:09:09.751884+0000 mgr.y (mgr.14526) 49 : cluster 0 pgmap v23: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:11.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:11 smithi072 bash[21573]: audit 2024-03-30T15:09:10.456831+0000 mon.c (mon.2) 60 : audit 0 from='client.? 172.21.15.72:0/764380386' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-30T15:09:11.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:11 smithi072 bash[28946]: cluster 2024-03-30T15:09:09.751884+0000 mgr.y (mgr.14526) 49 : cluster 0 pgmap v23: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:11.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:11 smithi072 bash[28946]: audit 2024-03-30T15:09:10.456831+0000 mon.c (mon.2) 60 : audit 0 from='client.? 172.21.15.72:0/764380386' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-30T15:09:11.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:11 smithi172 bash[23680]: cluster 2024-03-30T15:09:09.751884+0000 mgr.y (mgr.14526) 49 : cluster 0 pgmap v23: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:11.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:11 smithi172 bash[23680]: audit 2024-03-30T15:09:10.456831+0000 mon.c (mon.2) 60 : audit 0 from='client.? 172.21.15.72:0/764380386' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-30T15:09:12.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:12 smithi072 bash[21573]: audit 2024-03-30T15:09:10.769613+0000 mgr.y (mgr.14526) 50 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:09:12.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:12 smithi072 bash[28946]: audit 2024-03-30T15:09:10.769613+0000 mgr.y (mgr.14526) 50 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:09:12.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:12 smithi172 bash[23680]: audit 2024-03-30T15:09:10.769613+0000 mgr.y (mgr.14526) 50 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:09:13.646 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:13 smithi172 bash[23680]: cluster 2024-03-30T15:09:11.753336+0000 mgr.y (mgr.14526) 51 : cluster 0 pgmap v24: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:09:13.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:13 smithi072 bash[28946]: cluster 2024-03-30T15:09:11.753336+0000 mgr.y (mgr.14526) 51 : cluster 0 pgmap v24: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:09:13.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:13 smithi072 bash[21573]: cluster 2024-03-30T15:09:11.753336+0000 mgr.y (mgr.14526) 51 : cluster 0 pgmap v24: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:09:15.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:15 smithi172 bash[23680]: cluster 2024-03-30T15:09:13.754053+0000 mgr.y (mgr.14526) 52 : cluster 0 pgmap v25: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:15.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:15 smithi172 bash[23680]: audit 2024-03-30T15:09:14.959274+0000 mon.c (mon.2) 61 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:09:15.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:15 smithi072 bash[21573]: cluster 2024-03-30T15:09:13.754053+0000 mgr.y (mgr.14526) 52 : cluster 0 pgmap v25: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:15.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:15 smithi072 bash[21573]: audit 2024-03-30T15:09:14.959274+0000 mon.c (mon.2) 61 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:09:15.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:15 smithi072 bash[28946]: cluster 2024-03-30T15:09:13.754053+0000 mgr.y (mgr.14526) 52 : cluster 0 pgmap v25: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:15.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:15 smithi072 bash[28946]: audit 2024-03-30T15:09:14.959274+0000 mon.c (mon.2) 61 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:09:15.982 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T15:09:15.983 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:09:15 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:09:15.983 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 30 15:09:15 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:09:15.984 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:09:15 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:09:15.984 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:15 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:09:15.984 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:09:15 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:09:15.984 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:09:15 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:09:15.985 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:09:15 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:09:15.985 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:15 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:09:15.985 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:15 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:09:15.985 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:09:15 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:09:15.986 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:09:15 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:09:16.247 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:16 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:09:16.248 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:09:16 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:09:16.248 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:09:16 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:09:16.248 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:15 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:09:16.248 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:16 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:09:16.249 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 30 15:09:16 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:09:16.249 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:09:16 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:09:16.249 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:09:16 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:09:16.250 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:09:16 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:09:16.250 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:09:16 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:09:16.250 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:09:16 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:09:16.716 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:16 smithi172 systemd[1]: Started Ceph grafana.a for 97f8e564-eea5-11ee-b647-cb9ed24678a4. 2024-03-30T15:09:17.532 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:17 smithi172 bash[23680]: cluster 2024-03-30T15:09:15.755472+0000 mgr.y (mgr.14526) 53 : cluster 0 pgmap v26: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:09:17.532 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:17 smithi172 bash[23680]: audit 2024-03-30T15:09:16.302796+0000 mon.a (mon.0) 842 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:17.532 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:17 smithi172 bash[23680]: audit 2024-03-30T15:09:16.322041+0000 mon.a (mon.0) 843 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:17.532 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:17 smithi172 bash[23680]: audit 2024-03-30T15:09:16.383815+0000 mon.a (mon.0) 844 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:17.532 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:17 smithi172 bash[23680]: audit 2024-03-30T15:09:16.397642+0000 mon.a (mon.0) 845 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:17.532 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:17 smithi172 bash[23680]: audit 2024-03-30T15:09:16.467483+0000 mon.c (mon.2) 62 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:09:17.532 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:17 smithi172 bash[23680]: audit 2024-03-30T15:09:16.991884+0000 mon.a (mon.0) 846 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:17.533 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:17 smithi172 bash[23680]: audit 2024-03-30T15:09:17.003397+0000 mon.a (mon.0) 847 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:17.533 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:17 smithi172 bash[50795]: logger=settings t=2024-03-30T15:09:17.514705066Z level=info msg="Starting Grafana" version=9.4.12 commit=37ee25ba46 branch=HEAD compiled=2023-05-22T15:58:05Z 2024-03-30T15:09:17.533 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:17 smithi172 bash[50795]: logger=settings t=2024-03-30T15:09:17.514955571Z level=warn msg="\"sentry\" frontend logging provider is deprecated and will be removed in the next major version. Use \"grafana\" provider instead." 2024-03-30T15:09:17.533 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:17 smithi172 bash[50795]: logger=settings t=2024-03-30T15:09:17.514974125Z level=info msg="Config loaded from" file=/usr/share/grafana/conf/defaults.ini 2024-03-30T15:09:17.533 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:17 smithi172 bash[50795]: logger=settings t=2024-03-30T15:09:17.514983308Z level=info msg="Config loaded from" file=/etc/grafana/grafana.ini 2024-03-30T15:09:17.533 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:17 smithi172 bash[50795]: logger=settings t=2024-03-30T15:09:17.514988955Z level=info msg="Config overridden from command line" arg="default.paths.data=/var/lib/grafana" 2024-03-30T15:09:17.533 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:17 smithi172 bash[50795]: logger=settings t=2024-03-30T15:09:17.515001334Z level=info msg="Config overridden from command line" arg="default.paths.logs=/var/log/grafana" 2024-03-30T15:09:17.533 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:17 smithi172 bash[50795]: logger=settings t=2024-03-30T15:09:17.515007127Z level=info msg="Config overridden from command line" arg="default.paths.plugins=/var/lib/grafana/plugins" 2024-03-30T15:09:17.533 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:17 smithi172 bash[50795]: logger=settings t=2024-03-30T15:09:17.515013169Z level=info msg="Config overridden from command line" arg="default.paths.provisioning=/etc/grafana/provisioning" 2024-03-30T15:09:17.534 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:17 smithi172 bash[50795]: logger=settings t=2024-03-30T15:09:17.515019938Z level=info msg="Config overridden from command line" arg="default.log.mode=console" 2024-03-30T15:09:17.534 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:17 smithi172 bash[50795]: logger=settings t=2024-03-30T15:09:17.515030805Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_DATA=/var/lib/grafana" 2024-03-30T15:09:17.534 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:17 smithi172 bash[50795]: logger=settings t=2024-03-30T15:09:17.515041103Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_LOGS=/var/log/grafana" 2024-03-30T15:09:17.534 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:17 smithi172 bash[50795]: logger=settings t=2024-03-30T15:09:17.515048101Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2024-03-30T15:09:17.534 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:17 smithi172 bash[50795]: logger=settings t=2024-03-30T15:09:17.515051442Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2024-03-30T15:09:17.534 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:17 smithi172 bash[50795]: logger=settings t=2024-03-30T15:09:17.515055327Z level=info msg="Path Home" path=/usr/share/grafana 2024-03-30T15:09:17.534 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:17 smithi172 bash[50795]: logger=settings t=2024-03-30T15:09:17.515063919Z level=info msg="Path Data" path=/var/lib/grafana 2024-03-30T15:09:17.534 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:17 smithi172 bash[50795]: logger=settings t=2024-03-30T15:09:17.515070912Z level=info msg="Path Logs" path=/var/log/grafana 2024-03-30T15:09:17.534 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:17 smithi172 bash[50795]: logger=settings t=2024-03-30T15:09:17.515077029Z level=info msg="Path Plugins" path=/var/lib/grafana/plugins 2024-03-30T15:09:17.534 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:17 smithi172 bash[50795]: logger=settings t=2024-03-30T15:09:17.515082631Z level=info msg="Path Provisioning" path=/etc/grafana/provisioning 2024-03-30T15:09:17.534 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:17 smithi172 bash[50795]: logger=settings t=2024-03-30T15:09:17.515087737Z level=info msg="App mode production" 2024-03-30T15:09:17.534 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:17 smithi172 bash[50795]: logger=sqlstore t=2024-03-30T15:09:17.515152632Z level=info msg="Connecting to DB" dbtype=sqlite3 2024-03-30T15:09:17.534 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:17 smithi172 bash[50795]: logger=sqlstore t=2024-03-30T15:09:17.515184786Z level=warn msg="SQLite database file has broader permissions than it should" path=/var/lib/grafana/grafana.db mode=-rw-r--r-- expected=-rw-r----- 2024-03-30T15:09:17.534 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:17 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:17.516532712Z level=info msg="Starting DB migrations" 2024-03-30T15:09:17.535 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:17 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:17.516661141Z level=info msg="Executing migration" id="create migration_log table" 2024-03-30T15:09:17.535 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:17 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:17.536961738Z level=info msg="Executing migration" id="create user table" 2024-03-30T15:09:17.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:17 smithi072 bash[21573]: cluster 2024-03-30T15:09:15.755472+0000 mgr.y (mgr.14526) 53 : cluster 0 pgmap v26: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:09:17.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:17 smithi072 bash[21573]: audit 2024-03-30T15:09:16.302796+0000 mon.a (mon.0) 842 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:17.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:17 smithi072 bash[21573]: audit 2024-03-30T15:09:16.322041+0000 mon.a (mon.0) 843 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:17.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:17 smithi072 bash[21573]: audit 2024-03-30T15:09:16.383815+0000 mon.a (mon.0) 844 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:17.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:17 smithi072 bash[21573]: audit 2024-03-30T15:09:16.397642+0000 mon.a (mon.0) 845 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:17.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:17 smithi072 bash[21573]: audit 2024-03-30T15:09:16.467483+0000 mon.c (mon.2) 62 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:09:17.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:17 smithi072 bash[21573]: audit 2024-03-30T15:09:16.991884+0000 mon.a (mon.0) 846 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:17.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:17 smithi072 bash[21573]: audit 2024-03-30T15:09:17.003397+0000 mon.a (mon.0) 847 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:17.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:17 smithi072 bash[28946]: cluster 2024-03-30T15:09:15.755472+0000 mgr.y (mgr.14526) 53 : cluster 0 pgmap v26: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:09:17.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:17 smithi072 bash[28946]: audit 2024-03-30T15:09:16.302796+0000 mon.a (mon.0) 842 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:17.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:17 smithi072 bash[28946]: audit 2024-03-30T15:09:16.322041+0000 mon.a (mon.0) 843 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:17.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:17 smithi072 bash[28946]: audit 2024-03-30T15:09:16.383815+0000 mon.a (mon.0) 844 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:17.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:17 smithi072 bash[28946]: audit 2024-03-30T15:09:16.397642+0000 mon.a (mon.0) 845 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:17.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:17 smithi072 bash[28946]: audit 2024-03-30T15:09:16.467483+0000 mon.c (mon.2) 62 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:09:17.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:17 smithi072 bash[28946]: audit 2024-03-30T15:09:16.991884+0000 mon.a (mon.0) 846 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:17.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:17 smithi072 bash[28946]: audit 2024-03-30T15:09:17.003397+0000 mon.a (mon.0) 847 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:17.802 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:17 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:17.570566692Z level=info msg="Executing migration" id="add unique index user.login" 2024-03-30T15:09:17.802 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:17 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:17.59616112Z level=info msg="Executing migration" id="add unique index user.email" 2024-03-30T15:09:17.802 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:17 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:17.621337208Z level=info msg="Executing migration" id="drop index UQE_user_login - v1" 2024-03-30T15:09:17.802 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:17 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:17.663361792Z level=info msg="Executing migration" id="drop index UQE_user_email - v1" 2024-03-30T15:09:17.802 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:17 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:17.688728413Z level=info msg="Executing migration" id="Rename table user to user_v1 - v1" 2024-03-30T15:09:17.802 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:17 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:17.713964116Z level=info msg="Executing migration" id="create user table v2" 2024-03-30T15:09:17.802 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:17 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:17.739189774Z level=info msg="Executing migration" id="create index UQE_user_login - v2" 2024-03-30T15:09:17.802 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:17 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:17.76444401Z level=info msg="Executing migration" id="create index UQE_user_email - v2" 2024-03-30T15:09:17.803 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:17 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:17.806539704Z level=info msg="Executing migration" id="copy data_source v1 to v2" 2024-03-30T15:09:18.054 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:17 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:17.83174488Z level=info msg="Executing migration" id="Drop old table user_v1" 2024-03-30T15:09:18.054 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:17 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:17.857020374Z level=info msg="Executing migration" id="Add column help_flags1 to user table" 2024-03-30T15:09:18.054 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:17 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:17.882150322Z level=info msg="Executing migration" id="Update user table charset" 2024-03-30T15:09:18.054 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:17 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:17.924247539Z level=info msg="Executing migration" id="Add last_seen_at column to user" 2024-03-30T15:09:18.054 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:17 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:17.966186279Z level=info msg="Executing migration" id="Add missing user data" 2024-03-30T15:09:18.055 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:17 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:17.991543986Z level=info msg="Executing migration" id="Add is_disabled column to user" 2024-03-30T15:09:18.055 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:18 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:18.016800222Z level=info msg="Executing migration" id="Add index user.login/user.email" 2024-03-30T15:09:18.055 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:18 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:18.058758557Z level=info msg="Executing migration" id="Add is_service_account column to user" 2024-03-30T15:09:18.315 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:18 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:18.084089836Z level=info msg="Executing migration" id="Update is_service_account column to nullable" 2024-03-30T15:09:18.316 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:18 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:18.109367143Z level=info msg="Executing migration" id="create temp user table v1-7" 2024-03-30T15:09:18.316 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:18 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:18.134675186Z level=info msg="Executing migration" id="create index IDX_temp_user_email - v1-7" 2024-03-30T15:09:18.316 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:18 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:18.159948811Z level=info msg="Executing migration" id="create index IDX_temp_user_org_id - v1-7" 2024-03-30T15:09:18.316 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:18 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:18.18522944Z level=info msg="Executing migration" id="create index IDX_temp_user_code - v1-7" 2024-03-30T15:09:18.316 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:18 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:18.227179888Z level=info msg="Executing migration" id="create index IDX_temp_user_status - v1-7" 2024-03-30T15:09:18.316 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:18 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:18.252539247Z level=info msg="Executing migration" id="Update temp_user table charset" 2024-03-30T15:09:18.316 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:18 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:18.277801898Z level=info msg="Executing migration" id="drop index IDX_temp_user_email - v1" 2024-03-30T15:09:18.316 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:18 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:18.320078578Z level=info msg="Executing migration" id="drop index IDX_temp_user_org_id - v1" 2024-03-30T15:09:18.584 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:18 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:18.370545601Z level=info msg="Executing migration" id="drop index IDX_temp_user_code - v1" 2024-03-30T15:09:18.585 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:18 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:18.420925882Z level=info msg="Executing migration" id="drop index IDX_temp_user_status - v1" 2024-03-30T15:09:18.585 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:18 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:18.471356936Z level=info msg="Executing migration" id="Rename table temp_user to temp_user_tmp_qwerty - v1" 2024-03-30T15:09:18.585 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:18 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:18.49664854Z level=info msg="Executing migration" id="create temp_user v2" 2024-03-30T15:09:18.585 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:18 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:18.538666966Z level=info msg="Executing migration" id="create index IDX_temp_user_email - v2" 2024-03-30T15:09:18.585 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:18 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:18.563920087Z level=info msg="Executing migration" id="create index IDX_temp_user_org_id - v2" 2024-03-30T15:09:18.585 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:18 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:18.589191708Z level=info msg="Executing migration" id="create index IDX_temp_user_code - v2" 2024-03-30T15:09:18.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.723+0000 7f409723c700 1 -- 172.21.15.72:0/915063835 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4090107350 msgr2=0x7f4090107730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:18.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.723+0000 7f409723c700 1 --2- 172.21.15.72:0/915063835 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4090107350 0x7f4090107730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4080009fc0 tx=0x7f408000b330 comp rx=0 tx=0).stop 2024-03-30T15:09:18.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.723+0000 7f409723c700 1 -- 172.21.15.72:0/915063835 shutdown_connections 2024-03-30T15:09:18.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.723+0000 7f409723c700 1 --2- 172.21.15.72:0/915063835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4090101e20 0x7f409010dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:18.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.723+0000 7f409723c700 1 --2- 172.21.15.72:0/915063835 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4090107350 0x7f4090107730 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:18.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.723+0000 7f409723c700 1 --2- 172.21.15.72:0/915063835 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4090101460 0x7f40901018e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:18.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.723+0000 7f409723c700 1 -- 172.21.15.72:0/915063835 >> 172.21.15.72:0/915063835 conn(0x7f4090077ea0 msgr2=0x7f40900782b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:09:18.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.723+0000 7f409723c700 1 -- 172.21.15.72:0/915063835 shutdown_connections 2024-03-30T15:09:18.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.723+0000 7f409723c700 1 -- 172.21.15.72:0/915063835 wait complete. 2024-03-30T15:09:18.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.723+0000 7f409723c700 1 Processor -- start 2024-03-30T15:09:18.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.723+0000 7f409723c700 1 -- start start 2024-03-30T15:09:18.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.723+0000 7f409723c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4090101460 0x7f4090197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:18.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.723+0000 7f409723c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4090101e20 0x7f4090198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:18.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.723+0000 7f409723c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4090107350 0x7f409019c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:18.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.723+0000 7f409723c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4090111b30 con 0x7f4090101460 2024-03-30T15:09:18.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.723+0000 7f409723c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f40901119b0 con 0x7f4090101e20 2024-03-30T15:09:18.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.723+0000 7f409723c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f4090111cb0 con 0x7f4090107350 2024-03-30T15:09:18.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.723+0000 7f40957d9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4090107350 0x7f409019c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:18.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.723+0000 7f40957d9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4090107350 0x7f409019c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:54694/0 (socket says 172.21.15.72:54694) 2024-03-30T15:09:18.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.723+0000 7f40957d9700 1 -- 172.21.15.72:0/1220405151 learned_addr learned my addr 172.21.15.72:0/1220405151 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T15:09:18.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.723+0000 7f4094fd8700 1 --2- 172.21.15.72:0/1220405151 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4090101460 0x7f4090197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:18.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.723+0000 7f408ffff700 1 --2- 172.21.15.72:0/1220405151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4090101e20 0x7f4090198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:18.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.723+0000 7f40957d9700 1 -- 172.21.15.72:0/1220405151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4090101e20 msgr2=0x7f4090198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:18.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.723+0000 7f40957d9700 1 --2- 172.21.15.72:0/1220405151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4090101e20 0x7f4090198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:18.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.723+0000 7f40957d9700 1 -- 172.21.15.72:0/1220405151 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4090101460 msgr2=0x7f4090197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:18.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.723+0000 7f40957d9700 1 --2- 172.21.15.72:0/1220405151 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4090101460 0x7f4090197f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:18.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.723+0000 7f40957d9700 1 -- 172.21.15.72:0/1220405151 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f409019cf60 con 0x7f4090107350 2024-03-30T15:09:18.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.723+0000 7f4094fd8700 1 --2- 172.21.15.72:0/1220405151 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4090101460 0x7f4090197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T15:09:18.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.723+0000 7f40957d9700 1 --2- 172.21.15.72:0/1220405151 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4090107350 0x7f409019c820 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f408800d980 tx=0x7f408800dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:09:18.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.727+0000 7f408dffb700 1 -- 172.21.15.72:0/1220405151 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4088017070 con 0x7f4090107350 2024-03-30T15:09:18.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.727+0000 7f409723c700 1 -- 172.21.15.72:0/1220405151 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f409019d250 con 0x7f4090107350 2024-03-30T15:09:18.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.727+0000 7f408dffb700 1 -- 172.21.15.72:0/1220405151 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f4088005020 con 0x7f4090107350 2024-03-30T15:09:18.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.727+0000 7f408dffb700 1 -- 172.21.15.72:0/1220405151 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4088009990 con 0x7f4090107350 2024-03-30T15:09:18.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.727+0000 7f409723c700 1 -- 172.21.15.72:0/1220405151 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f40901a4ad0 con 0x7f4090107350 2024-03-30T15:09:18.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.727+0000 7f409723c700 1 -- 172.21.15.72:0/1220405151 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f409004ff00 con 0x7f4090107350 2024-03-30T15:09:18.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.727+0000 7f408dffb700 1 -- 172.21.15.72:0/1220405151 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 21) ==== 91831+0+0 (secure 0 0 0) 0x7f40880054b0 con 0x7f4090107350 2024-03-30T15:09:18.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.727+0000 7f408dffb700 1 --2- 172.21.15.72:0/1220405151 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f407806dc40 0x7f4078070100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:18.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.727+0000 7f408dffb700 1 -- 172.21.15.72:0/1220405151 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(74..74 src has 1..74) ==== 7537+0+0 (secure 0 0 0) 0x7f408808de30 con 0x7f4090107350 2024-03-30T15:09:18.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.727+0000 7f4094fd8700 1 --2- 172.21.15.72:0/1220405151 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f407806dc40 0x7f4078070100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:18.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.727+0000 7f4094fd8700 1 --2- 172.21.15.72:0/1220405151 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f407806dc40 0x7f4078070100 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4080009f90 tx=0x7f4080007f90 comp rx=0 tx=0).ready entity=mgr.14526 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:09:18.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.731+0000 7f408dffb700 1 -- 172.21.15.72:0/1220405151 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f4088020020 con 0x7f4090107350 2024-03-30T15:09:18.854 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:18 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:18.614366811Z level=info msg="Executing migration" id="create index IDX_temp_user_status - v2" 2024-03-30T15:09:18.854 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:18 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:18.639826167Z level=info msg="Executing migration" id="copy temp_user v1 to v2" 2024-03-30T15:09:18.854 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:18 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:18.673297372Z level=info msg="Executing migration" id="drop temp_user_tmp_qwerty" 2024-03-30T15:09:18.854 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:18 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:18.698574416Z level=info msg="Executing migration" id="Set created for temp users that will otherwise prematurely expire" 2024-03-30T15:09:18.854 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:18 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:18.723858113Z level=info msg="Executing migration" id="create star table" 2024-03-30T15:09:18.854 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:18 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:18.782539663Z level=info msg="Executing migration" id="add unique index star.user_id_dashboard_id" 2024-03-30T15:09:18.854 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:18 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:18.807966734Z level=info msg="Executing migration" id="create org table v1" 2024-03-30T15:09:18.854 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:18 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:18.83314355Z level=info msg="Executing migration" id="create index UQE_org_name - v1" 2024-03-30T15:09:18.854 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:18 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:18.858300639Z level=info msg="Executing migration" id="create org_user table v1" 2024-03-30T15:09:18.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.935+0000 7f409723c700 1 -- 172.21.15.72:0/1220405151 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f40901a4d00 con 0x7f4090107350 2024-03-30T15:09:18.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.939+0000 7f408dffb700 1 -- 172.21.15.72:0/1220405151 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+23223 (secure 0 0 0) 0x7f408805b410 con 0x7f4090107350 2024-03-30T15:09:18.938 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-30T15:09:18.938 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":74,"fsid":"97f8e564-eea5-11ee-b647-cb9ed24678a4","created":"2024-03-30T14:57:05.374220+0000","modified":"2024-03-30T15:08:29.706989+0000","last_up_change":"2024-03-30T15:06:50.892177+0000","last_in_change":"2024-03-30T15:06:24.422973+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T15:02:34.262564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".rgw.root","create_time":"2024-03-30T15:07:30.986622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.log","create_time":"2024-03-30T15:07:32.885330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.control","create_time":"2024-03-30T15:07:34.795978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"datapool","create_time":"2024-03-30T15:07:35.209879+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.6500000953674316,"score_stable":2.6500000953674316,"optimal_score":0.87999999523162842,"raw_score_acting":2.3299999237060547,"raw_score_stable":2.3299999237060547,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2024-03-30T15:07:36.907221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e65f2e8f-f022-4766-9e3f-58124e5372ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1463362008},{"type":"v1","addr":"172.21.15.72:6803","nonce":1463362008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1463362008},{"type":"v1","addr":"172.21.15.72:6805","nonce":1463362008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1463362008},{"type":"v1","addr":"172.21.15.72:6809","nonce":1463362008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1463362008},{"type":"v1","addr":"172.21.15.72:6807","nonce":1463362008}]},"public_addr":"172.21.15.72:6803/1463362008","cluster_addr":"172.21.15.72:6805/1463362008","heartbeat_back_addr":"172.21.15.72:6809/1463362008","heartbeat_front_addr":"172.21.15.72:6807/1463362008","state":["exists","up"]},{"osd":1,"uuid":"276c5ca1-6c16-44aa-aaa2-c0859408d86c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2191896250},{"type":"v1","addr":"172.21.15.72:6811","nonce":2191896250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2191896250},{"type":"v1","addr":"172.21.15.72:6813","nonce":2191896250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2191896250},{"type":"v1","addr":"172.21.15.72:6817","nonce":2191896250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2191896250},{"type":"v1","addr":"172.21.15.72:6815","nonce":2191896250}]},"public_addr":"172.21.15.72:6811/2191896250","cluster_addr":"172.21.15.72:6813/2191896250","heartbeat_back_addr":"172.21.15.72:6817/2191896250","heartbeat_front_addr":"172.21.15.72:6815/2191896250","state":["exists","up"]},{"osd":2,"uuid":"5cba948f-92d8-402b-88d5-969c137f3c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2674031198},{"type":"v1","addr":"172.21.15.72:6819","nonce":2674031198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":2674031198},{"type":"v1","addr":"172.21.15.72:6821","nonce":2674031198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2674031198},{"type":"v1","addr":"172.21.15.72:6825","nonce":2674031198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2674031198},{"type":"v1","addr":"172.21.15.72:6823","nonce":2674031198}]},"public_addr":"172.21.15.72:6819/2674031198","cluster_addr":"172.21.15.72:6821/2674031198","heartbeat_back_addr":"172.21.15.72:6825/2674031198","heartbeat_front_addr":"172.21.15.72:6823/2674031198","state":["exists","up"]},{"osd":3,"uuid":"72230afa-c7a7-4d66-8734-07deda2d3694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":350059956},{"type":"v1","addr":"172.21.15.72:6827","nonce":350059956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":350059956},{"type":"v1","addr":"172.21.15.72:6829","nonce":350059956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":350059956},{"type":"v1","addr":"172.21.15.72:6833","nonce":350059956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":350059956},{"type":"v1","addr":"172.21.15.72:6831","nonce":350059956}]},"public_addr":"172.21.15.72:6827/350059956","cluster_addr":"172.21.15.72:6829/350059956","heartbeat_back_addr":"172.21.15.72:6833/350059956","heartbeat_front_addr":"172.21.15.72:6831/350059956","state":["exists","up"]},{"osd":4,"uuid":"c7676e52-a936-4419-8e88-511820cd1355","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3807833251},{"type":"v1","addr":"172.21.15.172:6801","nonce":3807833251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3807833251},{"type":"v1","addr":"172.21.15.172:6803","nonce":3807833251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3807833251},{"type":"v1","addr":"172.21.15.172:6807","nonce":3807833251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3807833251},{"type":"v1","addr":"172.21.15.172:6805","nonce":3807833251}]},"public_addr":"172.21.15.172:6801/3807833251","cluster_addr":"172.21.15.172:6803/3807833251","heartbeat_back_addr":"172.21.15.172:6807/3807833251","heartbeat_front_addr":"172.21.15.172:6805/3807833251","state":["exists","up"]},{"osd":5,"uuid":"92d207bb-ccd0-4b33-b4c0-b733b8b67e6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":1078861326},{"type":"v1","addr":"172.21.15.172:6809","nonce":1078861326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":1078861326},{"type":"v1","addr":"172.21.15.172:6811","nonce":1078861326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":1078861326},{"type":"v1","addr":"172.21.15.172:6815","nonce":1078861326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":1078861326},{"type":"v1","addr":"172.21.15.172:6813","nonce":1078861326}]},"public_addr":"172.21.15.172:6809/1078861326","cluster_addr":"172.21.15.172:6811/1078861326","heartbeat_back_addr":"172.21.15.172:6815/1078861326","heartbeat_front_addr":"172.21.15.172:6813/1078861326","state":["exists","up"]},{"osd":6,"uuid":"791e09bc-ffeb-45ec-a375-8d4c4f51f4dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":1461064998},{"type":"v1","addr":"172.21.15.172:6817","nonce":1461064998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":1461064998},{"type":"v1","addr":"172.21.15.172:6819","nonce":1461064998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":1461064998},{"type":"v1","addr":"172.21.15.172:6823","nonce":1461064998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":1461064998},{"type":"v1","addr":"172.21.15.172:6821","nonce":1461064998}]},"public_addr":"172.21.15.172:6817/1461064998","cluster_addr":"172.21.15.172:6819/1461064998","heartbeat_back_addr":"172.21.15.172:6823/1461064998","heartbeat_front_addr":"172.21.15.172:6821/1461064998","state":["exists","up"]},{"osd":7,"uuid":"cbb6a8aa-f398-4980-8e11-f3c2113c93b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1721454347},{"type":"v1","addr":"172.21.15.172:6825","nonce":1721454347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1721454347},{"type":"v1","addr":"172.21.15.172:6827","nonce":1721454347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1721454347},{"type":"v1","addr":"172.21.15.172:6831","nonce":1721454347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1721454347},{"type":"v1","addr":"172.21.15.172:6829","nonce":1721454347}]},"public_addr":"172.21.15.172:6825/1721454347","cluster_addr":"172.21.15.172:6827/1721454347","heartbeat_back_addr":"172.21.15.172:6831/1721454347","heartbeat_front_addr":"172.21.15.172:6829/1721454347","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T15:00:42.799274+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T15:01:35.027238+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T15:02:30.253201+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T15:03:21.961056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T15:04:11.268147+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T15:05:02.630111+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T15:05:55.417298+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T15:06:49.273753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.1d","mappings":[{"from":7,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":5}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:0/2166827504":"2024-03-31T15:08:29.706916+0000","172.21.15.72:6800/1939732211":"2024-03-31T14:57:38.582840+0000","172.21.15.72:0/1698464030":"2024-03-31T15:08:29.706916+0000","172.21.15.72:0/2245616261":"2024-03-31T15:08:29.706916+0000","172.21.15.72:0/3673920411":"2024-03-31T15:08:29.706916+0000","172.21.15.72:0/3660329875":"2024-03-31T14:57:38.582840+0000","172.21.15.72:0/646806071":"2024-03-31T14:57:38.582840+0000","172.21.15.72:6801/2777002311":"2024-03-31T15:08:29.706916+0000","172.21.15.72:0/2843947581":"2024-03-31T14:58:13.611492+0000","172.21.15.72:6801/1939732211":"2024-03-31T14:57:38.582840+0000","172.21.15.72:0/1532980358":"2024-03-31T14:57:38.582840+0000","172.21.15.72:6801/3069476432":"2024-03-31T14:58:13.611492+0000","172.21.15.72:6800/3069476432":"2024-03-31T14:58:13.611492+0000","172.21.15.72:0/1482225058":"2024-03-31T14:58:13.611492+0000","172.21.15.72:0/732359376":"2024-03-31T14:58:13.611492+0000","172.21.15.72:0/2805885446":"2024-03-31T15:08:29.706916+0000","172.21.15.72:6800/2777002311":"2024-03-31T15:08:29.706916+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T15:09:18.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.943+0000 7f409723c700 1 -- 172.21.15.72:0/1220405151 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f407806dc40 msgr2=0x7f4078070100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:18.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.943+0000 7f409723c700 1 --2- 172.21.15.72:0/1220405151 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f407806dc40 0x7f4078070100 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4080009f90 tx=0x7f4080007f90 comp rx=0 tx=0).stop 2024-03-30T15:09:18.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.943+0000 7f409723c700 1 -- 172.21.15.72:0/1220405151 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4090107350 msgr2=0x7f409019c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:18.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.943+0000 7f409723c700 1 --2- 172.21.15.72:0/1220405151 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4090107350 0x7f409019c820 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f408800d980 tx=0x7f408800dc90 comp rx=0 tx=0).stop 2024-03-30T15:09:18.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.943+0000 7f409723c700 1 -- 172.21.15.72:0/1220405151 shutdown_connections 2024-03-30T15:09:18.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.943+0000 7f409723c700 1 --2- 172.21.15.72:0/1220405151 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4090107350 0x7f409019c820 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:18.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.943+0000 7f409723c700 1 --2- 172.21.15.72:0/1220405151 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4090101460 0x7f4090197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:18.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.943+0000 7f409723c700 1 --2- 172.21.15.72:0/1220405151 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f407806dc40 0x7f4078070100 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:18.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.943+0000 7f409723c700 1 --2- 172.21.15.72:0/1220405151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4090101e20 0x7f4090198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:18.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.943+0000 7f409723c700 1 -- 172.21.15.72:0/1220405151 >> 172.21.15.72:0/1220405151 conn(0x7f4090077ea0 msgr2=0x7f4090104e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:09:18.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.943+0000 7f409723c700 1 -- 172.21.15.72:0/1220405151 shutdown_connections 2024-03-30T15:09:18.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:18.943+0000 7f409723c700 1 -- 172.21.15.72:0/1220405151 wait complete. 2024-03-30T15:09:19.106 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:18 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:18.883645692Z level=info msg="Executing migration" id="create index IDX_org_user_org_id - v1" 2024-03-30T15:09:19.106 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:18 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:18.908931739Z level=info msg="Executing migration" id="create index UQE_org_user_org_id_user_id - v1" 2024-03-30T15:09:19.106 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:18 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:18.950863868Z level=info msg="Executing migration" id="create index IDX_org_user_user_id - v1" 2024-03-30T15:09:19.106 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:18 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:18.992850251Z level=info msg="Executing migration" id="Update org table charset" 2024-03-30T15:09:19.106 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:19 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:19.034855172Z level=info msg="Executing migration" id="Update org_user table charset" 2024-03-30T15:09:19.106 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:19 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:19.060132194Z level=info msg="Executing migration" id="Migrate all Read Only Viewers to Viewers" 2024-03-30T15:09:19.106 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:19 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:19.085412863Z level=info msg="Executing migration" id="create dashboard table" 2024-03-30T15:09:19.107 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:19 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:19.110664562Z level=info msg="Executing migration" id="add index dashboard.account_id" 2024-03-30T15:09:19.375 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:19 smithi172 bash[23680]: cluster 2024-03-30T15:09:17.755928+0000 mgr.y (mgr.14526) 54 : cluster 0 pgmap v27: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:19.376 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:19 smithi172 bash[23680]: audit 2024-03-30T15:09:18.939791+0000 mon.c (mon.2) 63 : audit 0 from='client.? 172.21.15.72:0/1220405151' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T15:09:19.376 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:19 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:19.135957186Z level=info msg="Executing migration" id="add unique index dashboard_account_id_slug" 2024-03-30T15:09:19.376 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:19 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:19.161233898Z level=info msg="Executing migration" id="create dashboard_tag table" 2024-03-30T15:09:19.376 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:19 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:19.186505952Z level=info msg="Executing migration" id="add unique index dashboard_tag.dasboard_id_term" 2024-03-30T15:09:19.376 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:19 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:19.212005373Z level=info msg="Executing migration" id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2024-03-30T15:09:19.376 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:19 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:19.237246758Z level=info msg="Executing migration" id="Rename table dashboard to dashboard_v1 - v1" 2024-03-30T15:09:19.376 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:19 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:19.262395119Z level=info msg="Executing migration" id="create dashboard v2" 2024-03-30T15:09:19.376 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:19 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:19.287718956Z level=info msg="Executing migration" id="create index IDX_dashboard_org_id - v2" 2024-03-30T15:09:19.376 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:19 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:19.329825953Z level=info msg="Executing migration" id="create index UQE_dashboard_org_id_slug - v2" 2024-03-30T15:09:19.376 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:19 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:19.346715393Z level=info msg="Executing migration" id="copy dashboard v1 to v2" 2024-03-30T15:09:19.628 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:19 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:19.380262982Z level=info msg="Executing migration" id="drop table dashboard_v1" 2024-03-30T15:09:19.628 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:19 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:19.413954011Z level=info msg="Executing migration" id="alter dashboard.data to mediumtext v1" 2024-03-30T15:09:19.628 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:19 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:19.456080004Z level=info msg="Executing migration" id="Add column updated_by in dashboard - v2" 2024-03-30T15:09:19.628 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:19 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:19.481344668Z level=info msg="Executing migration" id="Add column created_by in dashboard - v2" 2024-03-30T15:09:19.629 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:19 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:19.531736532Z level=info msg="Executing migration" id="Add column gnetId in dashboard" 2024-03-30T15:09:19.629 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:19 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:19.557112221Z level=info msg="Executing migration" id="Add index for gnetId in dashboard" 2024-03-30T15:09:19.629 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:19 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:19.582300735Z level=info msg="Executing migration" id="Add column plugin_id in dashboard" 2024-03-30T15:09:19.629 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:19 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:19.607576487Z level=info msg="Executing migration" id="Add index for plugin_id in dashboard" 2024-03-30T15:09:19.629 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:19 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:19.632877134Z level=info msg="Executing migration" id="Add index for dashboard_id in dashboard_tag" 2024-03-30T15:09:19.665 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:19 smithi072 bash[21573]: cluster 2024-03-30T15:09:17.755928+0000 mgr.y (mgr.14526) 54 : cluster 0 pgmap v27: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:19.665 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:19 smithi072 bash[21573]: audit 2024-03-30T15:09:18.939791+0000 mon.c (mon.2) 63 : audit 0 from='client.? 172.21.15.72:0/1220405151' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T15:09:19.665 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:19 smithi072 bash[28946]: cluster 2024-03-30T15:09:17.755928+0000 mgr.y (mgr.14526) 54 : cluster 0 pgmap v27: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:19.665 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:19 smithi072 bash[28946]: audit 2024-03-30T15:09:18.939791+0000 mon.c (mon.2) 63 : audit 0 from='client.? 172.21.15.72:0/1220405151' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T15:09:19.667 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-03-30T15:09:19.667 DEBUG:teuthology.orchestra.run.smithi072:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph osd dump --format=json 2024-03-30T15:09:19.889 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:19 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:19.658054904Z level=info msg="Executing migration" id="Update dashboard table charset" 2024-03-30T15:09:19.889 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:19 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:19.683283204Z level=info msg="Executing migration" id="Update dashboard_tag table charset" 2024-03-30T15:09:19.889 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:19 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:19.708552642Z level=info msg="Executing migration" id="Add column folder_id in dashboard" 2024-03-30T15:09:19.889 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:19 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:19.750551847Z level=info msg="Executing migration" id="Add column isFolder in dashboard" 2024-03-30T15:09:19.889 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:19 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:19.77577582Z level=info msg="Executing migration" id="Add column has_acl in dashboard" 2024-03-30T15:09:19.889 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:19 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:19.801015539Z level=info msg="Executing migration" id="Add column uid in dashboard" 2024-03-30T15:09:19.890 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:19 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:19.826209355Z level=info msg="Executing migration" id="Update uid column values in dashboard" 2024-03-30T15:09:19.890 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:19 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:19.85149354Z level=info msg="Executing migration" id="Add unique index dashboard_org_id_uid" 2024-03-30T15:09:19.890 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:19 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:19.893557324Z level=info msg="Executing migration" id="Remove unique index org_id_slug" 2024-03-30T15:09:20.149 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:19 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:19.935350084Z level=info msg="Executing migration" id="Update dashboard title length" 2024-03-30T15:09:20.150 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:19 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:19.977407911Z level=info msg="Executing migration" id="Add unique index for dashboard_org_id_title_folder_id" 2024-03-30T15:09:20.150 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:20 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:20.019485267Z level=info msg="Executing migration" id="create dashboard_provisioning" 2024-03-30T15:09:20.150 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:20 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:20.044640725Z level=info msg="Executing migration" id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2024-03-30T15:09:20.150 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:20 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:20.069771248Z level=info msg="Executing migration" id="create dashboard_provisioning v2" 2024-03-30T15:09:20.150 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:20 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:20.103739647Z level=info msg="Executing migration" id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2024-03-30T15:09:20.150 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:20 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:20.129023316Z level=info msg="Executing migration" id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2024-03-30T15:09:20.150 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:20 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:20.154243737Z level=info msg="Executing migration" id="copy dashboard_provisioning v1 to v2" 2024-03-30T15:09:20.402 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:20 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:20.179437994Z level=info msg="Executing migration" id="drop dashboard_provisioning_tmp_qwerty" 2024-03-30T15:09:20.402 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:20 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:20.237945482Z level=info msg="Executing migration" id="Add check_sum column" 2024-03-30T15:09:20.402 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:20 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:20.271907006Z level=info msg="Executing migration" id="Add index for dashboard_title" 2024-03-30T15:09:20.402 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:20 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:20.29716756Z level=info msg="Executing migration" id="delete tags for deleted dashboards" 2024-03-30T15:09:20.402 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:20 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:20.338991097Z level=info msg="Executing migration" id="delete stars for deleted dashboards" 2024-03-30T15:09:20.402 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:20 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:20.372771062Z level=info msg="Executing migration" id="Add index for dashboard_is_folder" 2024-03-30T15:09:20.671 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:20 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:20.406670545Z level=info msg="Executing migration" id="Add isPublic for dashboard" 2024-03-30T15:09:20.671 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:20 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:20.440324133Z level=info msg="Executing migration" id="create data_source table" 2024-03-30T15:09:20.672 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:20 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:20.457435126Z level=info msg="Executing migration" id="add index data_source.account_id" 2024-03-30T15:09:20.672 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:20 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:20.499309695Z level=info msg="Executing migration" id="add unique index data_source.account_id_name" 2024-03-30T15:09:20.672 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:20 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:20.541357588Z level=info msg="Executing migration" id="drop index IDX_data_source_account_id - v1" 2024-03-30T15:09:20.672 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:20 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:20.583302597Z level=info msg="Executing migration" id="drop index UQE_data_source_account_id_name - v1" 2024-03-30T15:09:20.672 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:20 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:20.625344943Z level=info msg="Executing migration" id="Rename table data_source to data_source_v1 - v1" 2024-03-30T15:09:20.672 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:20 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:20.650773816Z level=info msg="Executing migration" id="create data_source table v2" 2024-03-30T15:09:20.941 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:09:20 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:09:20.941 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:20 smithi172 bash[23680]: cluster 2024-03-30T15:09:19.756541+0000 mgr.y (mgr.14526) 55 : cluster 0 pgmap v28: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:20.941 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:20 smithi172 bash[23680]: audit 2024-03-30T15:09:19.856607+0000 mon.a (mon.0) 848 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:20.942 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:20 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:20.676030376Z level=info msg="Executing migration" id="create index IDX_data_source_org_id - v2" 2024-03-30T15:09:20.942 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:20 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:20.701282602Z level=info msg="Executing migration" id="create index UQE_data_source_org_id_name - v2" 2024-03-30T15:09:20.942 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:20 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:20.743318879Z level=info msg="Executing migration" id="Drop old table data_source_v1 #2" 2024-03-30T15:09:20.942 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:20 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:20.785504449Z level=info msg="Executing migration" id="Add column with_credentials" 2024-03-30T15:09:20.942 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:20 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:20.810751425Z level=info msg="Executing migration" id="Add secure json data column" 2024-03-30T15:09:20.942 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:20 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:20.836036344Z level=info msg="Executing migration" id="Update data_source table charset" 2024-03-30T15:09:20.942 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:20 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:20.878001312Z level=info msg="Executing migration" id="Update initial version to 1" 2024-03-30T15:09:20.942 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:20 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:20.920384444Z level=info msg="Executing migration" id="Add read_only data column" 2024-03-30T15:09:20.942 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:20 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:20.945643798Z level=info msg="Executing migration" id="Migrate logging ds to loki ds" 2024-03-30T15:09:21.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:20 smithi072 bash[21573]: cluster 2024-03-30T15:09:19.756541+0000 mgr.y (mgr.14526) 55 : cluster 0 pgmap v28: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:21.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:20 smithi072 bash[21573]: audit 2024-03-30T15:09:19.856607+0000 mon.a (mon.0) 848 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:21.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:20 smithi072 bash[28946]: cluster 2024-03-30T15:09:19.756541+0000 mgr.y (mgr.14526) 55 : cluster 0 pgmap v28: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:21.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:20 smithi072 bash[28946]: audit 2024-03-30T15:09:19.856607+0000 mon.a (mon.0) 848 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:21.217 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:20 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:20.970917667Z level=info msg="Executing migration" id="Update json_data with nulls" 2024-03-30T15:09:21.217 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:20 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:20.996226759Z level=info msg="Executing migration" id="Add uid column" 2024-03-30T15:09:21.217 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:21 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:21.038185308Z level=info msg="Executing migration" id="Update uid value" 2024-03-30T15:09:21.217 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:21 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:21.063552377Z level=info msg="Executing migration" id="Add unique index datasource_org_id_uid" 2024-03-30T15:09:21.217 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:21 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:21.088853064Z level=info msg="Executing migration" id="add unique index datasource_org_id_is_default" 2024-03-30T15:09:21.217 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:21 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:21.114110597Z level=info msg="Executing migration" id="create api_key table" 2024-03-30T15:09:21.217 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:21 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:21.14777045Z level=info msg="Executing migration" id="add index api_key.account_id" 2024-03-30T15:09:21.217 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:21 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:21.181242564Z level=info msg="Executing migration" id="add index api_key.key" 2024-03-30T15:09:21.504 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:21 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:21.231618538Z level=info msg="Executing migration" id="add index api_key.account_id_name" 2024-03-30T15:09:21.504 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:21 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:21.26544999Z level=info msg="Executing migration" id="drop index IDX_api_key_account_id - v1" 2024-03-30T15:09:21.504 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:21 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:21.298915981Z level=info msg="Executing migration" id="drop index UQE_api_key_key - v1" 2024-03-30T15:09:21.504 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:21 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:21.332543797Z level=info msg="Executing migration" id="drop index UQE_api_key_account_id_name - v1" 2024-03-30T15:09:21.504 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:21 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:21.382816534Z level=info msg="Executing migration" id="Rename table api_key to api_key_v1 - v1" 2024-03-30T15:09:21.504 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:21 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:21.424840182Z level=info msg="Executing migration" id="create api_key table v2" 2024-03-30T15:09:21.504 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:21 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:21.466856878Z level=info msg="Executing migration" id="create index IDX_api_key_org_id - v2" 2024-03-30T15:09:21.785 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:21 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:21.508734868Z level=info msg="Executing migration" id="create index UQE_api_key_key - v2" 2024-03-30T15:09:21.785 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:21 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:21.534030555Z level=info msg="Executing migration" id="create index UQE_api_key_org_id_name - v2" 2024-03-30T15:09:21.785 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:21 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:21.559447Z level=info msg="Executing migration" id="copy api_key v1 to v2" 2024-03-30T15:09:21.785 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:21 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:21.584664212Z level=info msg="Executing migration" id="Drop old table api_key_v1" 2024-03-30T15:09:21.785 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:21 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:21.626452468Z level=info msg="Executing migration" id="Update api_key table charset" 2024-03-30T15:09:21.785 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:21 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:21.651914404Z level=info msg="Executing migration" id="Add expires to api_key table" 2024-03-30T15:09:21.785 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:21 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:21.677188019Z level=info msg="Executing migration" id="Add service account foreign key" 2024-03-30T15:09:21.785 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:21 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:21.702436214Z level=info msg="Executing migration" id="set service account foreign key to nil if 0" 2024-03-30T15:09:21.785 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:21 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:21.789346Z level=info msg="Executing migration" id="Add last_used_at to api_key table" 2024-03-30T15:09:22.050 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:21 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:21.820199345Z level=info msg="Executing migration" id="Add is_revoked column to api_key table" 2024-03-30T15:09:22.051 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:21 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:21.854054447Z level=info msg="Executing migration" id="create dashboard_snapshot table v4" 2024-03-30T15:09:22.051 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:21 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:21.896078579Z level=info msg="Executing migration" id="drop table dashboard_snapshot_v4 #1" 2024-03-30T15:09:22.051 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:21 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:21.921426845Z level=info msg="Executing migration" id="create dashboard_snapshot table v5 #2" 2024-03-30T15:09:22.051 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:21 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:21.963355325Z level=info msg="Executing migration" id="create index UQE_dashboard_snapshot_key - v5" 2024-03-30T15:09:22.051 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:21 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:21.988693705Z level=info msg="Executing migration" id="create index UQE_dashboard_snapshot_delete_key - v5" 2024-03-30T15:09:22.051 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:22 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:22.013792441Z level=info msg="Executing migration" id="create index IDX_dashboard_snapshot_user_id - v5" 2024-03-30T15:09:22.051 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:22 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:22.055699155Z level=info msg="Executing migration" id="alter dashboard_snapshot to mediumtext v2" 2024-03-30T15:09:22.051 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:21 smithi172 bash[23680]: audit 2024-03-30T15:09:20.781237+0000 mgr.y (mgr.14526) 56 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:09:22.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:21 smithi072 bash[21573]: audit 2024-03-30T15:09:20.781237+0000 mgr.y (mgr.14526) 56 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:09:22.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:21 smithi072 bash[28946]: audit 2024-03-30T15:09:20.781237+0000 mgr.y (mgr.14526) 56 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:09:22.303 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:22 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:22.097773117Z level=info msg="Executing migration" id="Update dashboard_snapshot table charset" 2024-03-30T15:09:22.304 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:22 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:22.12306771Z level=info msg="Executing migration" id="Add column external_delete_url to dashboard_snapshots table" 2024-03-30T15:09:22.304 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:22 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:22.148409999Z level=info msg="Executing migration" id="Add encrypted dashboard json column" 2024-03-30T15:09:22.304 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:22 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:22.173704667Z level=info msg="Executing migration" id="Change dashboard_encrypted column to MEDIUMBLOB" 2024-03-30T15:09:22.304 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:22 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:22.215720133Z level=info msg="Executing migration" id="create quota table v1" 2024-03-30T15:09:22.304 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:22 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:22.257743329Z level=info msg="Executing migration" id="create index UQE_quota_org_id_user_id_target - v1" 2024-03-30T15:09:22.304 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:22 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:22.28309404Z level=info msg="Executing migration" id="Update quota table charset" 2024-03-30T15:09:22.304 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:22 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:22.308336523Z level=info msg="Executing migration" id="create plugin_setting table" 2024-03-30T15:09:22.572 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:22 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:22.333696975Z level=info msg="Executing migration" id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2024-03-30T15:09:22.573 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:22 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:22.375755466Z level=info msg="Executing migration" id="Add column plugin_version to plugin_settings" 2024-03-30T15:09:22.573 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:22 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:22.426164277Z level=info msg="Executing migration" id="Update plugin_setting table charset" 2024-03-30T15:09:22.573 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:22 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:22.468163958Z level=info msg="Executing migration" id="create session table" 2024-03-30T15:09:22.573 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:22 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:22.493504582Z level=info msg="Executing migration" id="Drop old table playlist table" 2024-03-30T15:09:22.573 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:22 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:22.535497967Z level=info msg="Executing migration" id="Drop old table playlist_item table" 2024-03-30T15:09:22.573 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:22 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:22.577662182Z level=info msg="Executing migration" id="create playlist table v2" 2024-03-30T15:09:22.826 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:22 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:22.619831862Z level=info msg="Executing migration" id="create playlist item table v2" 2024-03-30T15:09:22.826 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:22 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:22.645347522Z level=info msg="Executing migration" id="Update playlist table charset" 2024-03-30T15:09:22.826 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:22 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:22.687425688Z level=info msg="Executing migration" id="Update playlist_item table charset" 2024-03-30T15:09:22.826 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:22 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:22.729702312Z level=info msg="Executing migration" id="drop preferences table v2" 2024-03-30T15:09:22.826 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:22 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:22.782302077Z level=info msg="Executing migration" id="drop preferences table v3" 2024-03-30T15:09:22.826 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:22 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:22.805517172Z level=info msg="Executing migration" id="create preferences table v3" 2024-03-30T15:09:22.826 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:22 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:22.830860516Z level=info msg="Executing migration" id="Update preferences table charset" 2024-03-30T15:09:23.095 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:22 smithi172 bash[23680]: cluster 2024-03-30T15:09:21.757972+0000 mgr.y (mgr.14526) 57 : cluster 0 pgmap v29: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:09:23.095 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:22 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:22.856061218Z level=info msg="Executing migration" id="Add column team_id in preferences" 2024-03-30T15:09:23.096 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:22 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:22.889927786Z level=info msg="Executing migration" id="Update team_id column values in preferences" 2024-03-30T15:09:23.096 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:22 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:22.93179783Z level=info msg="Executing migration" id="Add column week_start in preferences" 2024-03-30T15:09:23.096 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:22 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:22.973797845Z level=info msg="Executing migration" id="Add column preferences.json_data" 2024-03-30T15:09:23.096 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:23 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:23.015723246Z level=info msg="Executing migration" id="alter preferences.json_data to mediumtext v1" 2024-03-30T15:09:23.096 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:23 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:23.057869627Z level=info msg="Executing migration" id="Add preferences index org_id" 2024-03-30T15:09:23.096 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:23 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:23.099965659Z level=info msg="Executing migration" id="Add preferences index user_id" 2024-03-30T15:09:23.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:22 smithi072 bash[28946]: cluster 2024-03-30T15:09:21.757972+0000 mgr.y (mgr.14526) 57 : cluster 0 pgmap v29: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:09:23.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:22 smithi072 bash[21573]: cluster 2024-03-30T15:09:21.757972+0000 mgr.y (mgr.14526) 57 : cluster 0 pgmap v29: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:09:23.348 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:23 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:23.14203124Z level=info msg="Executing migration" id="create alert table v1" 2024-03-30T15:09:23.348 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:23 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:23.167373663Z level=info msg="Executing migration" id="add index alert org_id & id " 2024-03-30T15:09:23.348 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:23 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:23.20093596Z level=info msg="Executing migration" id="add index alert state" 2024-03-30T15:09:23.348 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:23 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:23.234502847Z level=info msg="Executing migration" id="add index alert dashboard_id" 2024-03-30T15:09:23.348 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:23 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:23.268078471Z level=info msg="Executing migration" id="Create alert_rule_tag table v1" 2024-03-30T15:09:23.348 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:23 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:23.318592284Z level=info msg="Executing migration" id="Add unique index alert_rule_tag.alert_id_tag_id" 2024-03-30T15:09:23.348 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:23 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:23.352198025Z level=info msg="Executing migration" id="drop index UQE_alert_rule_tag_alert_id_tag_id - v1" 2024-03-30T15:09:23.534 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T15:09:23.600 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:23 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:23.402495422Z level=info msg="Executing migration" id="Rename table alert_rule_tag to alert_rule_tag_v1 - v1" 2024-03-30T15:09:23.600 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:23 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:23.452842404Z level=info msg="Executing migration" id="Create alert_rule_tag table v2" 2024-03-30T15:09:23.600 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:23 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:23.478060118Z level=info msg="Executing migration" id="create index UQE_alert_rule_tag_alert_id_tag_id - Add unique index alert_rule_tag.alert_id_tag_id V2" 2024-03-30T15:09:23.600 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:23 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:23.503472728Z level=info msg="Executing migration" id="copy alert_rule_tag v1 to v2" 2024-03-30T15:09:23.601 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:23 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:23.528653216Z level=info msg="Executing migration" id="drop table alert_rule_tag_v1" 2024-03-30T15:09:23.601 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:23 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:23.554121519Z level=info msg="Executing migration" id="create alert_notification table v1" 2024-03-30T15:09:23.601 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:23 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:23.579489269Z level=info msg="Executing migration" id="Add column is_default" 2024-03-30T15:09:23.601 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:23 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:23.604791548Z level=info msg="Executing migration" id="Add column frequency" 2024-03-30T15:09:23.869 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:23 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:23.646749095Z level=info msg="Executing migration" id="Add column send_reminder" 2024-03-30T15:09:23.869 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:23 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:23.672096979Z level=info msg="Executing migration" id="Add column disable_resolve_message" 2024-03-30T15:09:23.869 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:23 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:23.697259818Z level=info msg="Executing migration" id="add index alert_notification org_id & name" 2024-03-30T15:09:23.869 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:23 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:23.739333299Z level=info msg="Executing migration" id="Update alert table charset" 2024-03-30T15:09:23.869 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:23 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:23.764659404Z level=info msg="Executing migration" id="Update alert_notification table charset" 2024-03-30T15:09:23.869 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:23 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:23.831586307Z level=info msg="Executing migration" id="create notification_journal table v1" 2024-03-30T15:09:23.869 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:23 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:23.873630698Z level=info msg="Executing migration" id="add index notification_journal org_id & alert_id & notifier_id" 2024-03-30T15:09:24.130 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:23 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:23.89891735Z level=info msg="Executing migration" id="drop alert_notification_journal" 2024-03-30T15:09:24.130 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:23 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:23.949190829Z level=info msg="Executing migration" id="create alert_notification_state table v1" 2024-03-30T15:09:24.130 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:23 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:23.974456715Z level=info msg="Executing migration" id="add index alert_notification_state org_id & alert_id & notifier_id" 2024-03-30T15:09:24.130 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:24 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:24.016575585Z level=info msg="Executing migration" id="Add for to alert table" 2024-03-30T15:09:24.130 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:24 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:24.041923545Z level=info msg="Executing migration" id="Add column uid in alert_notification" 2024-03-30T15:09:24.130 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:24 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:24.067104134Z level=info msg="Executing migration" id="Update uid column values in alert_notification" 2024-03-30T15:09:24.130 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:24 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:24.092400387Z level=info msg="Executing migration" id="Add unique index alert_notification_org_id_uid" 2024-03-30T15:09:24.131 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:24 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:24.134371679Z level=info msg="Executing migration" id="Remove unique index org_id_name" 2024-03-30T15:09:24.131 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:23 smithi172 bash[23680]: audit 2024-03-30T15:09:22.992311+0000 mon.a (mon.0) 849 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:24.131 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:23 smithi172 bash[23680]: audit 2024-03-30T15:09:23.000308+0000 mon.a (mon.0) 850 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:24.131 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:23 smithi172 bash[23680]: audit 2024-03-30T15:09:23.111232+0000 mon.a (mon.0) 851 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:24.131 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:23 smithi172 bash[23680]: audit 2024-03-30T15:09:23.121122+0000 mon.a (mon.0) 852 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:24.131 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:23 smithi172 bash[23680]: audit 2024-03-30T15:09:23.123645+0000 mon.c (mon.2) 64 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:09:24.131 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:23 smithi172 bash[23680]: audit 2024-03-30T15:09:23.124574+0000 mon.c (mon.2) 65 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:09:24.131 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:23 smithi172 bash[23680]: audit 2024-03-30T15:09:23.132230+0000 mon.a (mon.0) 853 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:24.131 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:23 smithi172 bash[23680]: cephadm 2024-03-30T15:09:23.187144+0000 mgr.y (mgr.14526) 58 : cephadm 1 Reconfiguring alertmanager.a (dependencies changed)... 2024-03-30T15:09:24.132 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:23 smithi172 bash[23680]: cephadm 2024-03-30T15:09:23.195498+0000 mgr.y (mgr.14526) 59 : cephadm 1 Reconfiguring daemon alertmanager.a on smithi072 2024-03-30T15:09:24.399 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:24 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:24.176351067Z level=info msg="Executing migration" id="Add column secure_settings in alert_notification" 2024-03-30T15:09:24.399 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:24 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:24.20167564Z level=info msg="Executing migration" id="alter alert.settings to mediumtext" 2024-03-30T15:09:24.399 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:24 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:24.226921648Z level=info msg="Executing migration" id="Add non-unique index alert_notification_state_alert_id" 2024-03-30T15:09:24.400 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:24 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:24.25228642Z level=info msg="Executing migration" id="Add non-unique index alert_rule_tag_alert_id" 2024-03-30T15:09:24.400 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:24 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:24.294196439Z level=info msg="Executing migration" id="Drop old annotation table v4" 2024-03-30T15:09:24.400 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:24 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:24.319562885Z level=info msg="Executing migration" id="create annotation table v5" 2024-03-30T15:09:24.400 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:24 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:24.361582449Z level=info msg="Executing migration" id="add index annotation 0 v3" 2024-03-30T15:09:24.400 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:24 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:24.403780249Z level=info msg="Executing migration" id="add index annotation 1 v3" 2024-03-30T15:09:24.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:23 smithi072 bash[21573]: audit 2024-03-30T15:09:22.992311+0000 mon.a (mon.0) 849 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:24.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:23 smithi072 bash[21573]: audit 2024-03-30T15:09:23.000308+0000 mon.a (mon.0) 850 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:24.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:23 smithi072 bash[21573]: audit 2024-03-30T15:09:23.111232+0000 mon.a (mon.0) 851 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:24.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:23 smithi072 bash[21573]: audit 2024-03-30T15:09:23.121122+0000 mon.a (mon.0) 852 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:24.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:23 smithi072 bash[21573]: audit 2024-03-30T15:09:23.123645+0000 mon.c (mon.2) 64 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:09:24.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:23 smithi072 bash[21573]: audit 2024-03-30T15:09:23.124574+0000 mon.c (mon.2) 65 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:09:24.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:23 smithi072 bash[21573]: audit 2024-03-30T15:09:23.132230+0000 mon.a (mon.0) 853 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:24.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:23 smithi072 bash[21573]: cephadm 2024-03-30T15:09:23.187144+0000 mgr.y (mgr.14526) 58 : cephadm 1 Reconfiguring alertmanager.a (dependencies changed)... 2024-03-30T15:09:24.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:23 smithi072 bash[21573]: cephadm 2024-03-30T15:09:23.195498+0000 mgr.y (mgr.14526) 59 : cephadm 1 Reconfiguring daemon alertmanager.a on smithi072 2024-03-30T15:09:24.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:23 smithi072 bash[28946]: audit 2024-03-30T15:09:22.992311+0000 mon.a (mon.0) 849 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:24.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:23 smithi072 bash[28946]: audit 2024-03-30T15:09:23.000308+0000 mon.a (mon.0) 850 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:24.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:23 smithi072 bash[28946]: audit 2024-03-30T15:09:23.111232+0000 mon.a (mon.0) 851 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:24.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:23 smithi072 bash[28946]: audit 2024-03-30T15:09:23.121122+0000 mon.a (mon.0) 852 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:24.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:23 smithi072 bash[28946]: audit 2024-03-30T15:09:23.123645+0000 mon.c (mon.2) 64 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:09:24.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:23 smithi072 bash[28946]: audit 2024-03-30T15:09:23.124574+0000 mon.c (mon.2) 65 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:09:24.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:23 smithi072 bash[28946]: audit 2024-03-30T15:09:23.132230+0000 mon.a (mon.0) 853 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:24.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:23 smithi072 bash[28946]: cephadm 2024-03-30T15:09:23.187144+0000 mgr.y (mgr.14526) 58 : cephadm 1 Reconfiguring alertmanager.a (dependencies changed)... 2024-03-30T15:09:24.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:23 smithi072 bash[28946]: cephadm 2024-03-30T15:09:23.195498+0000 mgr.y (mgr.14526) 59 : cephadm 1 Reconfiguring daemon alertmanager.a on smithi072 2024-03-30T15:09:24.660 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:24 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:24.446133419Z level=info msg="Executing migration" id="add index annotation 2 v3" 2024-03-30T15:09:24.660 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:24 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:24.479781744Z level=info msg="Executing migration" id="add index annotation 3 v3" 2024-03-30T15:09:24.660 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:24 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:24.513366022Z level=info msg="Executing migration" id="add index annotation 4 v3" 2024-03-30T15:09:24.660 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:24 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:24.546923675Z level=info msg="Executing migration" id="Update annotation table charset" 2024-03-30T15:09:24.660 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:24 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:24.572187362Z level=info msg="Executing migration" id="Add column region_id to annotation table" 2024-03-30T15:09:24.660 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:24 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:24.59743901Z level=info msg="Executing migration" id="Drop category_id index" 2024-03-30T15:09:24.661 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:24 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:24.639425814Z level=info msg="Executing migration" id="Add column tags to annotation table" 2024-03-30T15:09:24.921 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:24 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:24.664707095Z level=info msg="Executing migration" id="Create annotation_tag table v2" 2024-03-30T15:09:24.921 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:24 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:24.690046357Z level=info msg="Executing migration" id="Add unique index annotation_tag.annotation_id_tag_id" 2024-03-30T15:09:24.921 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:24 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:24.715277042Z level=info msg="Executing migration" id="drop index UQE_annotation_tag_annotation_id_tag_id - v2" 2024-03-30T15:09:24.921 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:24 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:24.757258734Z level=info msg="Executing migration" id="Rename table annotation_tag to annotation_tag_v2 - v2" 2024-03-30T15:09:24.921 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:24 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:24.790871748Z level=info msg="Executing migration" id="Create annotation_tag table v3" 2024-03-30T15:09:24.921 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:24 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:24.816078514Z level=info msg="Executing migration" id="create index UQE_annotation_tag_annotation_id_tag_id - Add unique index annotation_tag.annotation_id_tag_id V3" 2024-03-30T15:09:24.921 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:24 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:24.85813897Z level=info msg="Executing migration" id="copy annotation_tag v2 to v3" 2024-03-30T15:09:24.921 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:24 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:24.900165831Z level=info msg="Executing migration" id="drop table annotation_tag_v2" 2024-03-30T15:09:24.921 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:24 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:24.92550222Z level=info msg="Executing migration" id="Update alert annotations and set TEXT to empty" 2024-03-30T15:09:25.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:25 smithi172 bash[23680]: cluster 2024-03-30T15:09:23.758646+0000 mgr.y (mgr.14526) 60 : cluster 0 pgmap v30: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:25.174 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:24 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:24.950755704Z level=info msg="Executing migration" id="Add created time to annotation table" 2024-03-30T15:09:25.174 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:24 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:24.992734339Z level=info msg="Executing migration" id="Add updated time to annotation table" 2024-03-30T15:09:25.174 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:25 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:25.018016523Z level=info msg="Executing migration" id="Add index for created in annotation table" 2024-03-30T15:09:25.174 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:25 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:25.043286575Z level=info msg="Executing migration" id="Add index for updated in annotation table" 2024-03-30T15:09:25.174 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:25 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:25.068651675Z level=info msg="Executing migration" id="Convert existing annotations from seconds to milliseconds" 2024-03-30T15:09:25.174 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:25 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:25.110493391Z level=info msg="Executing migration" id="Add epoch_end column" 2024-03-30T15:09:25.174 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:25 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:25.152787011Z level=info msg="Executing migration" id="Add index for epoch_end" 2024-03-30T15:09:25.174 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:25 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:25.178036703Z level=info msg="Executing migration" id="Make epoch_end the same as epoch" 2024-03-30T15:09:25.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:25 smithi072 bash[21573]: cluster 2024-03-30T15:09:23.758646+0000 mgr.y (mgr.14526) 60 : cluster 0 pgmap v30: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:25.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:25 smithi072 bash[28946]: cluster 2024-03-30T15:09:23.758646+0000 mgr.y (mgr.14526) 60 : cluster 0 pgmap v30: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:25.426 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:25 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:25.20323321Z level=info msg="Executing migration" id="Move region to single row" 2024-03-30T15:09:25.426 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:25 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:25.228516801Z level=info msg="Executing migration" id="Remove index org_id_epoch from annotation table" 2024-03-30T15:09:25.426 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:25 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:25.253816022Z level=info msg="Executing migration" id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2024-03-30T15:09:25.426 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:25 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:25.279386788Z level=info msg="Executing migration" id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2024-03-30T15:09:25.426 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:25 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:25.321413199Z level=info msg="Executing migration" id="Add index for org_id_epoch_end_epoch on annotation table" 2024-03-30T15:09:25.426 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:25 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:25.346660282Z level=info msg="Executing migration" id="Remove index org_id_epoch_epoch_end from annotation table" 2024-03-30T15:09:25.426 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:25 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:25.388655475Z level=info msg="Executing migration" id="Add index for alert_id on annotation table" 2024-03-30T15:09:25.426 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:25 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:25.430613982Z level=info msg="Executing migration" id="Increase tags column to length 4096" 2024-03-30T15:09:25.712 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:25 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:25.456004432Z level=info msg="Executing migration" id="create test_data table" 2024-03-30T15:09:25.712 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:25 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:25.481362168Z level=info msg="Executing migration" id="create dashboard_version table v1" 2024-03-30T15:09:25.713 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:25 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:25.506545042Z level=info msg="Executing migration" id="add index dashboard_version.dashboard_id" 2024-03-30T15:09:25.713 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:25 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:25.531850379Z level=info msg="Executing migration" id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2024-03-30T15:09:25.713 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:25 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:25.557096471Z level=info msg="Executing migration" id="Set dashboard version to 1 where 0" 2024-03-30T15:09:25.713 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:25 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:25.582281448Z level=info msg="Executing migration" id="save existing dashboard data in dashboard_version table v1" 2024-03-30T15:09:25.713 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:25 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:25.624236819Z level=info msg="Executing migration" id="alter dashboard_version.data to mediumtext v1" 2024-03-30T15:09:25.713 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:25 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:25.649597045Z level=info msg="Executing migration" id="create team table" 2024-03-30T15:09:25.713 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:25 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:25.674888557Z level=info msg="Executing migration" id="add index team.org_id" 2024-03-30T15:09:25.713 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:25 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:25.716799475Z level=info msg="Executing migration" id="add unique index team_org_id_name" 2024-03-30T15:09:25.964 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:25 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:25.742102599Z level=info msg="Executing migration" id="create team member table" 2024-03-30T15:09:25.964 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:25 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:25.784288015Z level=info msg="Executing migration" id="add index team_member.org_id" 2024-03-30T15:09:25.965 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:25 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:25.809571887Z level=info msg="Executing migration" id="add unique index team_member_org_id_team_id_user_id" 2024-03-30T15:09:25.965 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:25 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:25.834787193Z level=info msg="Executing migration" id="add index team_member.team_id" 2024-03-30T15:09:25.965 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:25 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:25.901786633Z level=info msg="Executing migration" id="Add column email to team table" 2024-03-30T15:09:25.965 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:25 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:25.943804223Z level=info msg="Executing migration" id="Add column external to team_member table" 2024-03-30T15:09:25.965 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:25 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:25.969110493Z level=info msg="Executing migration" id="Add column permission to team_member table" 2024-03-30T15:09:26.217 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:26 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:26.011142379Z level=info msg="Executing migration" id="create dashboard acl table" 2024-03-30T15:09:26.217 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:26 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:26.036427398Z level=info msg="Executing migration" id="add index dashboard_acl_dashboard_id" 2024-03-30T15:09:26.217 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:26 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:26.070056859Z level=info msg="Executing migration" id="add unique index dashboard_acl_dashboard_id_user_id" 2024-03-30T15:09:26.217 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:26 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:26.087052759Z level=info msg="Executing migration" id="add unique index dashboard_acl_dashboard_id_team_id" 2024-03-30T15:09:26.217 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:26 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:26.112291085Z level=info msg="Executing migration" id="add index dashboard_acl_user_id" 2024-03-30T15:09:26.217 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:26 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:26.15463347Z level=info msg="Executing migration" id="add index dashboard_acl_team_id" 2024-03-30T15:09:26.217 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:26 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:26.179818991Z level=info msg="Executing migration" id="add index dashboard_acl_org_id_role" 2024-03-30T15:09:26.217 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:26 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:26.205084001Z level=info msg="Executing migration" id="add index dashboard_permission" 2024-03-30T15:09:26.503 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:26 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:26.246999631Z level=info msg="Executing migration" id="save default acl rules in dashboard_acl table" 2024-03-30T15:09:26.503 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:26 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:26.272388401Z level=info msg="Executing migration" id="delete acl rules for deleted dashboards and folders" 2024-03-30T15:09:26.503 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:26 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:26.31421778Z level=info msg="Executing migration" id="create tag table" 2024-03-30T15:09:26.503 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:26 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:26.356343712Z level=info msg="Executing migration" id="add index tag.key_value" 2024-03-30T15:09:26.504 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:26 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:26.398541659Z level=info msg="Executing migration" id="create login attempt table" 2024-03-30T15:09:26.504 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:26 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:26.423845474Z level=info msg="Executing migration" id="add index login_attempt.username" 2024-03-30T15:09:26.504 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:26 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:26.465769578Z level=info msg="Executing migration" id="drop index IDX_login_attempt_username - v1" 2024-03-30T15:09:26.504 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:26 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:26.507893866Z level=info msg="Executing migration" id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2024-03-30T15:09:26.755 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:26 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:26.54153174Z level=info msg="Executing migration" id="create login_attempt v2" 2024-03-30T15:09:26.756 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:26 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:26.566753914Z level=info msg="Executing migration" id="create index IDX_login_attempt_username - v2" 2024-03-30T15:09:26.756 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:26 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:26.608727952Z level=info msg="Executing migration" id="copy login_attempt v1 to v2" 2024-03-30T15:09:26.756 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:26 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:26.634023971Z level=info msg="Executing migration" id="drop login_attempt_tmp_qwerty" 2024-03-30T15:09:26.756 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:26 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:26.667613653Z level=info msg="Executing migration" id="create user auth table" 2024-03-30T15:09:26.756 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:26 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:26.709596274Z level=info msg="Executing migration" id="create index IDX_user_auth_auth_module_auth_id - v1" 2024-03-30T15:09:26.756 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:26 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:26.734873151Z level=info msg="Executing migration" id="alter user_auth.auth_id to length 190" 2024-03-30T15:09:26.756 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:26 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:26.760112274Z level=info msg="Executing migration" id="Add OAuth access token to user_auth" 2024-03-30T15:09:27.114 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:26 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:26.785371464Z level=info msg="Executing migration" id="Add OAuth refresh token to user_auth" 2024-03-30T15:09:27.115 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:26 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:26.810624787Z level=info msg="Executing migration" id="Add OAuth token type to user_auth" 2024-03-30T15:09:27.115 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:26 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:26.835913072Z level=info msg="Executing migration" id="Add OAuth expiry to user_auth" 2024-03-30T15:09:27.115 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:26 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:26.955619682Z level=info msg="Executing migration" id="Add index to user_id column in user_auth" 2024-03-30T15:09:27.115 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:27 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:27.01005063Z level=info msg="Executing migration" id="Add OAuth ID token to user_auth" 2024-03-30T15:09:27.367 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:27 smithi172 bash[23680]: cluster 2024-03-30T15:09:25.760090+0000 mgr.y (mgr.14526) 61 : cluster 0 pgmap v31: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:09:27.368 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:27 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:27.119401702Z level=info msg="Executing migration" id="create server_lock table" 2024-03-30T15:09:27.368 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:27 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:27.272031907Z level=info msg="Executing migration" id="add index server_lock.operation_uid" 2024-03-30T15:09:27.368 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:27 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:27.33012483Z level=info msg="Executing migration" id="create user auth token table" 2024-03-30T15:09:27.368 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:27 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:27.372013692Z level=info msg="Executing migration" id="add unique index user_auth_token.auth_token" 2024-03-30T15:09:27.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:27 smithi072 bash[21573]: cluster 2024-03-30T15:09:25.760090+0000 mgr.y (mgr.14526) 61 : cluster 0 pgmap v31: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:09:27.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:27 smithi072 bash[28946]: cluster 2024-03-30T15:09:25.760090+0000 mgr.y (mgr.14526) 61 : cluster 0 pgmap v31: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:09:27.629 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:27 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:27.447583579Z level=info msg="Executing migration" id="add unique index user_auth_token.prev_auth_token" 2024-03-30T15:09:27.629 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:27 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:27.464669211Z level=info msg="Executing migration" id="add index user_auth_token.user_id" 2024-03-30T15:09:27.629 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:27 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:27.498171619Z level=info msg="Executing migration" id="Add revoked_at to the user auth token" 2024-03-30T15:09:27.629 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:27 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:27.515188716Z level=info msg="Executing migration" id="create cache_data table" 2024-03-30T15:09:27.629 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:27 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:27.548981941Z level=info msg="Executing migration" id="add unique index cache_data.cache_key" 2024-03-30T15:09:27.629 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:27 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:27.565889787Z level=info msg="Executing migration" id="create short_url table v1" 2024-03-30T15:09:27.629 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:27 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:27.599535455Z level=info msg="Executing migration" id="add index short_url.org_id-uid" 2024-03-30T15:09:27.629 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:27 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:27.61648644Z level=info msg="Executing migration" id="alter table short_url alter column created_by type to bigint" 2024-03-30T15:09:27.630 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:27 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:27.633388326Z level=info msg="Executing migration" id="delete alert_definition table" 2024-03-30T15:09:27.890 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:27 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:27.650235103Z level=info msg="Executing migration" id="recreate alert_definition table" 2024-03-30T15:09:27.890 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:27 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:27.692412199Z level=info msg="Executing migration" id="add index in alert_definition on org_id and title columns" 2024-03-30T15:09:27.890 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:27 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:27.717611921Z level=info msg="Executing migration" id="add index in alert_definition on org_id and uid columns" 2024-03-30T15:09:27.890 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:27 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:27.759644564Z level=info msg="Executing migration" id="alter alert_definition table data column to mediumtext in mysql" 2024-03-30T15:09:27.890 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:27 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:27.784938437Z level=info msg="Executing migration" id="drop index in alert_definition on org_id and title columns" 2024-03-30T15:09:27.890 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:27 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:27.810147536Z level=info msg="Executing migration" id="drop index in alert_definition on org_id and uid columns" 2024-03-30T15:09:27.890 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:27 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:27.852140989Z level=info msg="Executing migration" id="add unique index in alert_definition on org_id and title columns" 2024-03-30T15:09:27.890 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:27 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:27.894225607Z level=info msg="Executing migration" id="add unique index in alert_definition on org_id and uid columns" 2024-03-30T15:09:27.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:27.991+0000 7f1326602700 1 -- 172.21.15.72:0/3539182895 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1320108390 msgr2=0x7f1320108770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:27.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:27.991+0000 7f1326602700 1 --2- 172.21.15.72:0/3539182895 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1320108390 0x7f1320108770 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f131800b0a0 tx=0x7f131800b3b0 comp rx=0 tx=0).stop 2024-03-30T15:09:27.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:27.991+0000 7f1326602700 1 -- 172.21.15.72:0/3539182895 shutdown_connections 2024-03-30T15:09:27.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:27.991+0000 7f1326602700 1 --2- 172.21.15.72:0/3539182895 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1320102ce0 0x7f132010f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:27.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:27.991+0000 7f1326602700 1 --2- 172.21.15.72:0/3539182895 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1320108390 0x7f1320108770 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:27.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:27.991+0000 7f1326602700 1 --2- 172.21.15.72:0/3539182895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1320102320 0x7f13201027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:27.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:27.991+0000 7f1326602700 1 -- 172.21.15.72:0/3539182895 >> 172.21.15.72:0/3539182895 conn(0x7f1320079310 msgr2=0x7f1320079720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:09:27.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:27.991+0000 7f1326602700 1 -- 172.21.15.72:0/3539182895 shutdown_connections 2024-03-30T15:09:27.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:27.991+0000 7f1326602700 1 -- 172.21.15.72:0/3539182895 wait complete. 2024-03-30T15:09:27.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:27.991+0000 7f1326602700 1 Processor -- start 2024-03-30T15:09:27.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:27.991+0000 7f1326602700 1 -- start start 2024-03-30T15:09:27.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:27.995+0000 7f1326602700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1320102320 0x7f1320198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:27.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:27.995+0000 7f1326602700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1320102ce0 0x7f1320198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:27.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:27.995+0000 7f1326602700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1320108390 0x7f132019c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:27.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:27.995+0000 7f1326602700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1320111ab0 con 0x7f1320102320 2024-03-30T15:09:27.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:27.995+0000 7f1326602700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1320111930 con 0x7f1320108390 2024-03-30T15:09:27.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:27.995+0000 7f1326602700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f1320111c30 con 0x7f1320102ce0 2024-03-30T15:09:27.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:27.995+0000 7f131ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1320102320 0x7f1320198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:27.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:27.995+0000 7f131ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1320102320 0x7f1320198010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34782/0 (socket says 172.21.15.72:34782) 2024-03-30T15:09:27.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:27.995+0000 7f131ffff700 1 -- 172.21.15.72:0/3042575216 learned_addr learned my addr 172.21.15.72:0/3042575216 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T15:09:27.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:27.995+0000 7f131f7fe700 1 --2- 172.21.15.72:0/3042575216 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1320102ce0 0x7f1320198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:27.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:27.995+0000 7f131ffff700 1 -- 172.21.15.72:0/3042575216 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1320102ce0 msgr2=0x7f1320198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:27.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:27.995+0000 7f1324b9f700 1 --2- 172.21.15.72:0/3042575216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1320108390 0x7f132019c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:27.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:27.995+0000 7f131ffff700 1 --2- 172.21.15.72:0/3042575216 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1320102ce0 0x7f1320198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:27.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:27.995+0000 7f131ffff700 1 -- 172.21.15.72:0/3042575216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1320108390 msgr2=0x7f132019c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:27.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:27.995+0000 7f131ffff700 1 --2- 172.21.15.72:0/3042575216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1320108390 0x7f132019c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:27.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:27.995+0000 7f131ffff700 1 -- 172.21.15.72:0/3042575216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f132019cfd0 con 0x7f1320102320 2024-03-30T15:09:27.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:27.995+0000 7f131ffff700 1 --2- 172.21.15.72:0/3042575216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1320102320 0x7f1320198010 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f131800b070 tx=0x7f1318007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:09:27.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:27.995+0000 7f131d7fa700 1 -- 172.21.15.72:0/3042575216 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1318003c00 con 0x7f1320102320 2024-03-30T15:09:27.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:27.995+0000 7f131d7fa700 1 -- 172.21.15.72:0/3042575216 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f1318022070 con 0x7f1320102320 2024-03-30T15:09:27.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:27.995+0000 7f131d7fa700 1 -- 172.21.15.72:0/3042575216 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f131801b6c0 con 0x7f1320102320 2024-03-30T15:09:27.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:27.995+0000 7f1326602700 1 -- 172.21.15.72:0/3042575216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f132019d260 con 0x7f1320102320 2024-03-30T15:09:27.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:27.995+0000 7f1326602700 1 -- 172.21.15.72:0/3042575216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13201a4b40 con 0x7f1320102320 2024-03-30T15:09:27.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:27.995+0000 7f1326602700 1 -- 172.21.15.72:0/3042575216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13201039b0 con 0x7f1320102320 2024-03-30T15:09:27.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:27.995+0000 7f131d7fa700 1 -- 172.21.15.72:0/3042575216 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 21) ==== 91831+0+0 (secure 0 0 0) 0x7f131801d470 con 0x7f1320102320 2024-03-30T15:09:27.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:27.995+0000 7f131d7fa700 1 --2- 172.21.15.72:0/3042575216 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f130806dc40 0x7f1308070100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:27.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:27.995+0000 7f131d7fa700 1 -- 172.21.15.72:0/3042575216 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7537+0+0 (secure 0 0 0) 0x7f131800f020 con 0x7f1320102320 2024-03-30T15:09:27.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:27.995+0000 7f131f7fe700 1 --2- 172.21.15.72:0/3042575216 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f130806dc40 0x7f1308070100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:27.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:27.995+0000 7f131f7fe700 1 --2- 172.21.15.72:0/3042575216 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f130806dc40 0x7f1308070100 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1320112570 tx=0x7f1314009190 comp rx=0 tx=0).ready entity=mgr.14526 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:09:28.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:28.003+0000 7f131d7fa700 1 -- 172.21.15.72:0/3042575216 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f131805c450 con 0x7f1320102320 2024-03-30T15:09:28.161 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:27 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:27.919531224Z level=info msg="Executing migration" id="Add column paused in alert_definition" 2024-03-30T15:09:28.161 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:27 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:27.944825464Z level=info msg="Executing migration" id="drop alert_definition table" 2024-03-30T15:09:28.161 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:27 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:27.986771235Z level=info msg="Executing migration" id="delete alert_definition_version table" 2024-03-30T15:09:28.161 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:28 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:28.02875811Z level=info msg="Executing migration" id="recreate alert_definition_version table" 2024-03-30T15:09:28.161 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:28 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:28.070832293Z level=info msg="Executing migration" id="add index in alert_definition_version table on alert_definition_id and version columns" 2024-03-30T15:09:28.161 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:28 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:28.098085977Z level=info msg="Executing migration" id="add index in alert_definition_version table on alert_definition_uid and version columns" 2024-03-30T15:09:28.161 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:28 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:28.123418127Z level=info msg="Executing migration" id="alter alert_definition_version table data column to mediumtext in mysql" 2024-03-30T15:09:28.162 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:28 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:28.165433249Z level=info msg="Executing migration" id="drop alert_definition_version table" 2024-03-30T15:09:28.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:28.207+0000 7f1326602700 1 -- 172.21.15.72:0/3042575216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1320199320 con 0x7f1320102320 2024-03-30T15:09:28.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:28.211+0000 7f131d7fa700 1 -- 172.21.15.72:0/3042575216 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+23223 (secure 0 0 0) 0x7f131805fea0 con 0x7f1320102320 2024-03-30T15:09:28.210 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-30T15:09:28.210 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":74,"fsid":"97f8e564-eea5-11ee-b647-cb9ed24678a4","created":"2024-03-30T14:57:05.374220+0000","modified":"2024-03-30T15:08:29.706989+0000","last_up_change":"2024-03-30T15:06:50.892177+0000","last_in_change":"2024-03-30T15:06:24.422973+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T15:02:34.262564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".rgw.root","create_time":"2024-03-30T15:07:30.986622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.log","create_time":"2024-03-30T15:07:32.885330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.control","create_time":"2024-03-30T15:07:34.795978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"datapool","create_time":"2024-03-30T15:07:35.209879+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.6500000953674316,"score_stable":2.6500000953674316,"optimal_score":0.87999999523162842,"raw_score_acting":2.3299999237060547,"raw_score_stable":2.3299999237060547,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2024-03-30T15:07:36.907221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e65f2e8f-f022-4766-9e3f-58124e5372ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1463362008},{"type":"v1","addr":"172.21.15.72:6803","nonce":1463362008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1463362008},{"type":"v1","addr":"172.21.15.72:6805","nonce":1463362008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1463362008},{"type":"v1","addr":"172.21.15.72:6809","nonce":1463362008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1463362008},{"type":"v1","addr":"172.21.15.72:6807","nonce":1463362008}]},"public_addr":"172.21.15.72:6803/1463362008","cluster_addr":"172.21.15.72:6805/1463362008","heartbeat_back_addr":"172.21.15.72:6809/1463362008","heartbeat_front_addr":"172.21.15.72:6807/1463362008","state":["exists","up"]},{"osd":1,"uuid":"276c5ca1-6c16-44aa-aaa2-c0859408d86c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2191896250},{"type":"v1","addr":"172.21.15.72:6811","nonce":2191896250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2191896250},{"type":"v1","addr":"172.21.15.72:6813","nonce":2191896250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2191896250},{"type":"v1","addr":"172.21.15.72:6817","nonce":2191896250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2191896250},{"type":"v1","addr":"172.21.15.72:6815","nonce":2191896250}]},"public_addr":"172.21.15.72:6811/2191896250","cluster_addr":"172.21.15.72:6813/2191896250","heartbeat_back_addr":"172.21.15.72:6817/2191896250","heartbeat_front_addr":"172.21.15.72:6815/2191896250","state":["exists","up"]},{"osd":2,"uuid":"5cba948f-92d8-402b-88d5-969c137f3c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":2674031198},{"type":"v1","addr":"172.21.15.72:6819","nonce":2674031198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":2674031198},{"type":"v1","addr":"172.21.15.72:6821","nonce":2674031198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2674031198},{"type":"v1","addr":"172.21.15.72:6825","nonce":2674031198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":2674031198},{"type":"v1","addr":"172.21.15.72:6823","nonce":2674031198}]},"public_addr":"172.21.15.72:6819/2674031198","cluster_addr":"172.21.15.72:6821/2674031198","heartbeat_back_addr":"172.21.15.72:6825/2674031198","heartbeat_front_addr":"172.21.15.72:6823/2674031198","state":["exists","up"]},{"osd":3,"uuid":"72230afa-c7a7-4d66-8734-07deda2d3694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":350059956},{"type":"v1","addr":"172.21.15.72:6827","nonce":350059956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":350059956},{"type":"v1","addr":"172.21.15.72:6829","nonce":350059956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":350059956},{"type":"v1","addr":"172.21.15.72:6833","nonce":350059956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":350059956},{"type":"v1","addr":"172.21.15.72:6831","nonce":350059956}]},"public_addr":"172.21.15.72:6827/350059956","cluster_addr":"172.21.15.72:6829/350059956","heartbeat_back_addr":"172.21.15.72:6833/350059956","heartbeat_front_addr":"172.21.15.72:6831/350059956","state":["exists","up"]},{"osd":4,"uuid":"c7676e52-a936-4419-8e88-511820cd1355","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3807833251},{"type":"v1","addr":"172.21.15.172:6801","nonce":3807833251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3807833251},{"type":"v1","addr":"172.21.15.172:6803","nonce":3807833251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3807833251},{"type":"v1","addr":"172.21.15.172:6807","nonce":3807833251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3807833251},{"type":"v1","addr":"172.21.15.172:6805","nonce":3807833251}]},"public_addr":"172.21.15.172:6801/3807833251","cluster_addr":"172.21.15.172:6803/3807833251","heartbeat_back_addr":"172.21.15.172:6807/3807833251","heartbeat_front_addr":"172.21.15.172:6805/3807833251","state":["exists","up"]},{"osd":5,"uuid":"92d207bb-ccd0-4b33-b4c0-b733b8b67e6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":1078861326},{"type":"v1","addr":"172.21.15.172:6809","nonce":1078861326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":1078861326},{"type":"v1","addr":"172.21.15.172:6811","nonce":1078861326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":1078861326},{"type":"v1","addr":"172.21.15.172:6815","nonce":1078861326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":1078861326},{"type":"v1","addr":"172.21.15.172:6813","nonce":1078861326}]},"public_addr":"172.21.15.172:6809/1078861326","cluster_addr":"172.21.15.172:6811/1078861326","heartbeat_back_addr":"172.21.15.172:6815/1078861326","heartbeat_front_addr":"172.21.15.172:6813/1078861326","state":["exists","up"]},{"osd":6,"uuid":"791e09bc-ffeb-45ec-a375-8d4c4f51f4dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":1461064998},{"type":"v1","addr":"172.21.15.172:6817","nonce":1461064998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":1461064998},{"type":"v1","addr":"172.21.15.172:6819","nonce":1461064998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":1461064998},{"type":"v1","addr":"172.21.15.172:6823","nonce":1461064998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":1461064998},{"type":"v1","addr":"172.21.15.172:6821","nonce":1461064998}]},"public_addr":"172.21.15.172:6817/1461064998","cluster_addr":"172.21.15.172:6819/1461064998","heartbeat_back_addr":"172.21.15.172:6823/1461064998","heartbeat_front_addr":"172.21.15.172:6821/1461064998","state":["exists","up"]},{"osd":7,"uuid":"cbb6a8aa-f398-4980-8e11-f3c2113c93b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1721454347},{"type":"v1","addr":"172.21.15.172:6825","nonce":1721454347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1721454347},{"type":"v1","addr":"172.21.15.172:6827","nonce":1721454347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1721454347},{"type":"v1","addr":"172.21.15.172:6831","nonce":1721454347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1721454347},{"type":"v1","addr":"172.21.15.172:6829","nonce":1721454347}]},"public_addr":"172.21.15.172:6825/1721454347","cluster_addr":"172.21.15.172:6827/1721454347","heartbeat_back_addr":"172.21.15.172:6831/1721454347","heartbeat_front_addr":"172.21.15.172:6829/1721454347","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T15:00:42.799274+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T15:01:35.027238+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T15:02:30.253201+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T15:03:21.961056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T15:04:11.268147+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T15:05:02.630111+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T15:05:55.417298+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T15:06:49.273753+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.1d","mappings":[{"from":7,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":5}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:0/2166827504":"2024-03-31T15:08:29.706916+0000","172.21.15.72:6800/1939732211":"2024-03-31T14:57:38.582840+0000","172.21.15.72:0/1698464030":"2024-03-31T15:08:29.706916+0000","172.21.15.72:0/2245616261":"2024-03-31T15:08:29.706916+0000","172.21.15.72:0/3673920411":"2024-03-31T15:08:29.706916+0000","172.21.15.72:0/3660329875":"2024-03-31T14:57:38.582840+0000","172.21.15.72:0/646806071":"2024-03-31T14:57:38.582840+0000","172.21.15.72:6801/2777002311":"2024-03-31T15:08:29.706916+0000","172.21.15.72:0/2843947581":"2024-03-31T14:58:13.611492+0000","172.21.15.72:6801/1939732211":"2024-03-31T14:57:38.582840+0000","172.21.15.72:0/1532980358":"2024-03-31T14:57:38.582840+0000","172.21.15.72:6801/3069476432":"2024-03-31T14:58:13.611492+0000","172.21.15.72:6800/3069476432":"2024-03-31T14:58:13.611492+0000","172.21.15.72:0/1482225058":"2024-03-31T14:58:13.611492+0000","172.21.15.72:0/732359376":"2024-03-31T14:58:13.611492+0000","172.21.15.72:0/2805885446":"2024-03-31T15:08:29.706916+0000","172.21.15.72:6800/2777002311":"2024-03-31T15:08:29.706916+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T15:09:28.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:28.215+0000 7f1326602700 1 -- 172.21.15.72:0/3042575216 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f130806dc40 msgr2=0x7f1308070100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:28.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:28.215+0000 7f1326602700 1 --2- 172.21.15.72:0/3042575216 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f130806dc40 0x7f1308070100 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1320112570 tx=0x7f1314009190 comp rx=0 tx=0).stop 2024-03-30T15:09:28.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:28.215+0000 7f1326602700 1 -- 172.21.15.72:0/3042575216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1320102320 msgr2=0x7f1320198010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:28.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:28.215+0000 7f1326602700 1 --2- 172.21.15.72:0/3042575216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1320102320 0x7f1320198010 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f131800b070 tx=0x7f1318007a00 comp rx=0 tx=0).stop 2024-03-30T15:09:28.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:28.215+0000 7f1326602700 1 -- 172.21.15.72:0/3042575216 shutdown_connections 2024-03-30T15:09:28.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:28.215+0000 7f1326602700 1 --2- 172.21.15.72:0/3042575216 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f130806dc40 0x7f1308070100 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:28.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:28.215+0000 7f1326602700 1 --2- 172.21.15.72:0/3042575216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1320108390 0x7f132019c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:28.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:28.215+0000 7f1326602700 1 --2- 172.21.15.72:0/3042575216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1320102320 0x7f1320198010 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:28.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:28.215+0000 7f1326602700 1 --2- 172.21.15.72:0/3042575216 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1320102ce0 0x7f1320198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:28.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:28.215+0000 7f1326602700 1 -- 172.21.15.72:0/3042575216 >> 172.21.15.72:0/3042575216 conn(0x7f1320079310 msgr2=0x7f1320105eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:09:28.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:28.215+0000 7f1326602700 1 -- 172.21.15.72:0/3042575216 shutdown_connections 2024-03-30T15:09:28.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:28.215+0000 7f1326602700 1 -- 172.21.15.72:0/3042575216 wait complete. 2024-03-30T15:09:28.421 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:28 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:28.19072124Z level=info msg="Executing migration" id="create alert_instance table" 2024-03-30T15:09:28.422 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:28 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:28.215993461Z level=info msg="Executing migration" id="add index in alert_instance table on def_org_id, def_uid and current_state columns" 2024-03-30T15:09:28.422 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:28 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:28.232954067Z level=info msg="Executing migration" id="add index in alert_instance table on def_org_id, current_state columns" 2024-03-30T15:09:28.422 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:28 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:28.25816259Z level=info msg="Executing migration" id="add column current_state_end to alert_instance" 2024-03-30T15:09:28.422 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:28 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:28.283456464Z level=info msg="Executing migration" id="remove index def_org_id, def_uid, current_state on alert_instance" 2024-03-30T15:09:28.422 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:28 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:28.325453169Z level=info msg="Executing migration" id="remove index def_org_id, current_state on alert_instance" 2024-03-30T15:09:28.422 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:28 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:28.367445645Z level=info msg="Executing migration" id="rename def_org_id to rule_org_id in alert_instance" 2024-03-30T15:09:28.422 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:28 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:28.426199969Z level=info msg="Executing migration" id="rename def_uid to rule_uid in alert_instance" 2024-03-30T15:09:28.675 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:28 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:28.459980876Z level=info msg="Executing migration" id="add index rule_org_id, rule_uid, current_state on alert_instance" 2024-03-30T15:09:28.675 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:28 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:28.485216019Z level=info msg="Executing migration" id="add index rule_org_id, current_state on alert_instance" 2024-03-30T15:09:28.675 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:28 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:28.527186228Z level=info msg="Executing migration" id="add current_reason column related to current_state" 2024-03-30T15:09:28.675 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:28 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:28.544257434Z level=info msg="Executing migration" id="create alert_rule table" 2024-03-30T15:09:28.675 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:28 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:28.561151464Z level=info msg="Executing migration" id="add index in alert_rule on org_id and title columns" 2024-03-30T15:09:28.675 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:28 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:28.578132496Z level=info msg="Executing migration" id="add index in alert_rule on org_id and uid columns" 2024-03-30T15:09:28.675 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:28 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:28.611746067Z level=info msg="Executing migration" id="add index in alert_rule on org_id, namespace_uid, group_uid columns" 2024-03-30T15:09:28.675 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:28 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:28.62863922Z level=info msg="Executing migration" id="alter alert_rule table data column to mediumtext in mysql" 2024-03-30T15:09:28.675 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:28 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:28.662163989Z level=info msg="Executing migration" id="add column for to alert_rule" 2024-03-30T15:09:28.675 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:28 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:28.679235026Z level=info msg="Executing migration" id="add column annotations to alert_rule" 2024-03-30T15:09:28.953 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:28 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:28.704535786Z level=info msg="Executing migration" id="add column labels to alert_rule" 2024-03-30T15:09:28.953 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:28 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:28.72142059Z level=info msg="Executing migration" id="remove unique index from alert_rule on org_id, title columns" 2024-03-30T15:09:28.953 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:28 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:28.73834598Z level=info msg="Executing migration" id="add index in alert_rule on org_id, namespase_uid and title columns" 2024-03-30T15:09:28.953 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:28 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:28.755316691Z level=info msg="Executing migration" id="add dashboard_uid column to alert_rule" 2024-03-30T15:09:28.954 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:28 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:28.780562206Z level=info msg="Executing migration" id="add panel_id column to alert_rule" 2024-03-30T15:09:28.954 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:28 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:28.81420471Z level=info msg="Executing migration" id="add index in alert_rule on org_id, dashboard_uid and panel_id columns" 2024-03-30T15:09:28.954 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:28 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:28.839880639Z level=info msg="Executing migration" id="add rule_group_idx column to alert_rule" 2024-03-30T15:09:28.954 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:28 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:28.86507331Z level=info msg="Executing migration" id="add is_paused column to alert_rule table" 2024-03-30T15:09:28.954 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:28 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:28.890327368Z level=info msg="Executing migration" id="fix is_paused column for alert_rule table" 2024-03-30T15:09:28.954 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:28 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:28.915691767Z level=info msg="Executing migration" id="create alert_rule_version table" 2024-03-30T15:09:28.954 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:28 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:28.957699856Z level=info msg="Executing migration" id="add index in alert_rule_version table on rule_org_id, rule_uid and version columns" 2024-03-30T15:09:29.205 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:29 smithi172 bash[23680]: cluster 2024-03-30T15:09:27.760834+0000 mgr.y (mgr.14526) 62 : cluster 0 pgmap v32: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:29.205 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:29 smithi172 bash[23680]: audit 2024-03-30T15:09:28.213208+0000 mon.a (mon.0) 854 : audit 0 from='client.? 172.21.15.72:0/3042575216' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T15:09:29.206 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:28 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:28.982933308Z level=info msg="Executing migration" id="add index in alert_rule_version table on rule_org_id, rule_namespace_uid and rule_group columns" 2024-03-30T15:09:29.206 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:29 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:29.008209173Z level=info msg="Executing migration" id="alter alert_rule_version table data column to mediumtext in mysql" 2024-03-30T15:09:29.206 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:29 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:29.0500163Z level=info msg="Executing migration" id="add column for to alert_rule_version" 2024-03-30T15:09:29.206 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:29 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:29.075509369Z level=info msg="Executing migration" id="add column annotations to alert_rule_version" 2024-03-30T15:09:29.206 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:29 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:29.117408954Z level=info msg="Executing migration" id="add column labels to alert_rule_version" 2024-03-30T15:09:29.206 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:29 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:29.159541709Z level=info msg="Executing migration" id="add rule_group_idx column to alert_rule_version" 2024-03-30T15:09:29.206 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:29 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:29.184796632Z level=info msg="Executing migration" id="add is_paused column to alert_rule_versions table" 2024-03-30T15:09:29.206 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:29 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:29.210016042Z level=info msg="Executing migration" id="fix is_paused column for alert_rule_version table" 2024-03-30T15:09:29.417 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:09:29 smithi072 systemd[1]: Stopping Ceph alertmanager.a for 97f8e564-eea5-11ee-b647-cb9ed24678a4... 2024-03-30T15:09:29.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:29 smithi072 bash[21573]: cluster 2024-03-30T15:09:27.760834+0000 mgr.y (mgr.14526) 62 : cluster 0 pgmap v32: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:29.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:29 smithi072 bash[21573]: audit 2024-03-30T15:09:28.213208+0000 mon.a (mon.0) 854 : audit 0 from='client.? 172.21.15.72:0/3042575216' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T15:09:29.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:29 smithi072 bash[28946]: cluster 2024-03-30T15:09:27.760834+0000 mgr.y (mgr.14526) 62 : cluster 0 pgmap v32: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:29.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:29 smithi072 bash[28946]: audit 2024-03-30T15:09:28.213208+0000 mon.a (mon.0) 854 : audit 0 from='client.? 172.21.15.72:0/3042575216' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T15:09:29.458 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:29 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:29.235359213Z level=info msg="Executing migration" id=create_alert_configuration_table 2024-03-30T15:09:29.458 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:29 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:29.26075071Z level=info msg="Executing migration" id="Add column default in alert_configuration" 2024-03-30T15:09:29.458 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:29 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:29.285946871Z level=info msg="Executing migration" id="alert alert_configuration alertmanager_configuration column from TEXT to MEDIUMTEXT if mysql" 2024-03-30T15:09:29.458 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:29 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:29.31121142Z level=info msg="Executing migration" id="add column org_id in alert_configuration" 2024-03-30T15:09:29.458 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:29 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:29.336534939Z level=info msg="Executing migration" id="add index in alert_configuration table on org_id column" 2024-03-30T15:09:29.458 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:29 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:29.378511996Z level=info msg="Executing migration" id="add configuration_hash column to alert_configuration" 2024-03-30T15:09:29.459 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:29 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:29.420590694Z level=info msg="Executing migration" id=create_ngalert_configuration_table 2024-03-30T15:09:29.459 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:29 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:29.462606074Z level=info msg="Executing migration" id="add index in ngalert_configuration on org_id column" 2024-03-30T15:09:29.539 DEBUG:teuthology.orchestra.run.smithi072:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph tell osd.0 flush_pg_stats 2024-03-30T15:09:29.540 DEBUG:teuthology.orchestra.run.smithi072:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph tell osd.1 flush_pg_stats 2024-03-30T15:09:29.540 DEBUG:teuthology.orchestra.run.smithi072:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph tell osd.2 flush_pg_stats 2024-03-30T15:09:29.541 DEBUG:teuthology.orchestra.run.smithi072:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph tell osd.3 flush_pg_stats 2024-03-30T15:09:29.541 DEBUG:teuthology.orchestra.run.smithi072:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph tell osd.4 flush_pg_stats 2024-03-30T15:09:29.541 DEBUG:teuthology.orchestra.run.smithi072:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph tell osd.5 flush_pg_stats 2024-03-30T15:09:29.542 DEBUG:teuthology.orchestra.run.smithi072:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph tell osd.6 flush_pg_stats 2024-03-30T15:09:29.542 DEBUG:teuthology.orchestra.run.smithi072:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph tell osd.7 flush_pg_stats 2024-03-30T15:09:29.717 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:29 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:29.48790052Z level=info msg="Executing migration" id="add column send_alerts_to in ngalert_configuration" 2024-03-30T15:09:29.717 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:29 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:29.529875864Z level=info msg="Executing migration" id="create provenance_type table" 2024-03-30T15:09:29.717 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:29 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:29.555258064Z level=info msg="Executing migration" id="add index to uniquify (record_key, record_type, org_id) columns" 2024-03-30T15:09:29.717 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:29 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:29.580548534Z level=info msg="Executing migration" id="create alert_image table" 2024-03-30T15:09:29.717 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:29 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:29.614128076Z level=info msg="Executing migration" id="add unique index on token to alert_image table" 2024-03-30T15:09:29.717 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:29 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:29.639414489Z level=info msg="Executing migration" id="support longer URLs in alert_image table" 2024-03-30T15:09:29.717 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:29 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:29.673298684Z level=info msg="Executing migration" id=create_alert_configuration_history_table 2024-03-30T15:09:29.717 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:29 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:29.707177417Z level=info msg="Executing migration" id="drop non-unique orgID index on alert_configuration" 2024-03-30T15:09:29.735 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:09:29 smithi072 bash[58202]: ts=2024-03-30T15:09:29.487Z caller=main.go:583 level=info msg="Received SIGTERM, exiting gracefully..." 2024-03-30T15:09:29.999 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:29 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:29.749083803Z level=info msg="Executing migration" id="drop unique orgID index on alert_configuration if exists" 2024-03-30T15:09:29.999 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:29 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:29.74938841Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop unique orgID index on alert_configuration if exists" 2024-03-30T15:09:29.999 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:29 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:29.791038631Z level=info msg="Executing migration" id="extract alertmanager configuration history to separate table" 2024-03-30T15:09:29.999 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:29 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:29.808086132Z level=info msg="Executing migration" id="add unique index on orgID to alert_configuration" 2024-03-30T15:09:29.999 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:29 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:29.833322132Z level=info msg="Executing migration" id="clear migration entry \"remove unified alerting data\"" 2024-03-30T15:09:30.000 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:29 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:29.833825754Z level=info msg="Executing migration" id="move dashboard alerts to unified alerting" 2024-03-30T15:09:30.000 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:29 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:29.834217436Z level=info msg="alerts found to migrate" alerts=0 2024-03-30T15:09:30.000 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:29 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:29.858632757Z level=info msg="Executing migration" id="create library_element table v1" 2024-03-30T15:09:30.000 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:29 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:29.900693473Z level=info msg="Executing migration" id="add index library_element org_id-folder_id-name-kind" 2024-03-30T15:09:30.000 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:29 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:29.917633086Z level=info msg="Executing migration" id="create library_element_connection table v1" 2024-03-30T15:09:30.000 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:29 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:29.93453467Z level=info msg="Executing migration" id="add index library_element_connection element_id-kind-connection_id" 2024-03-30T15:09:30.000 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:29 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:29.951435974Z level=info msg="Executing migration" id="add unique index library_element org_id_uid" 2024-03-30T15:09:30.000 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:29 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:29.968387673Z level=info msg="Executing migration" id="increase max description length to 2048" 2024-03-30T15:09:30.000 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:29 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:29.985298504Z level=info msg="Executing migration" id="clone move dashboard alerts to unified alerting" 2024-03-30T15:09:30.000 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:30 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:30.002186058Z level=info msg="Executing migration" id="create data_keys table" 2024-03-30T15:09:30.259 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:30 smithi172 bash[23680]: audit 2024-03-30T15:09:29.989087+0000 mon.c (mon.2) 66 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:09:30.259 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:30 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:30.019264975Z level=info msg="Executing migration" id="create secrets table" 2024-03-30T15:09:30.259 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:30 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:30.036194657Z level=info msg="Executing migration" id="rename data_keys name column to id" 2024-03-30T15:09:30.259 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:30 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:30.069741441Z level=info msg="Executing migration" id="add name column into data_keys" 2024-03-30T15:09:30.259 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:30 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:30.103383284Z level=info msg="Executing migration" id="copy data_keys id column values into name" 2024-03-30T15:09:30.259 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:30 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:30.120275362Z level=info msg="Executing migration" id="rename data_keys name column to label" 2024-03-30T15:09:30.259 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:30 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:30.170738715Z level=info msg="Executing migration" id="rename data_keys id column back to name" 2024-03-30T15:09:30.259 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:30 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:30.212855668Z level=info msg="Executing migration" id="create kv_store table v1" 2024-03-30T15:09:30.259 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:30 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:30.238116818Z level=info msg="Executing migration" id="add index kv_store.org_id-namespace-key" 2024-03-30T15:09:30.260 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:30 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:30.263412288Z level=info msg="Executing migration" id="update dashboard_uid and panel_id from existing annotations" 2024-03-30T15:09:30.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:30 smithi072 bash[21573]: audit 2024-03-30T15:09:29.989087+0000 mon.c (mon.2) 66 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:09:30.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:30 smithi072 bash[28946]: audit 2024-03-30T15:09:29.989087+0000 mon.c (mon.2) 66 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:09:30.418 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:09:30 smithi072 bash[59688]: ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4-alertmanager-a 2024-03-30T15:09:30.512 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:30 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:30.280289043Z level=info msg="Executing migration" id="create permission table" 2024-03-30T15:09:30.512 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:30 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:30.29722496Z level=info msg="Executing migration" id="add unique index permission.role_id" 2024-03-30T15:09:30.512 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:30 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:30.31407314Z level=info msg="Executing migration" id="add unique index role_id_action_scope" 2024-03-30T15:09:30.512 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:30 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:30.331124095Z level=info msg="Executing migration" id="create role table" 2024-03-30T15:09:30.512 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:30 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:30.364729005Z level=info msg="Executing migration" id="add column display_name" 2024-03-30T15:09:30.512 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:30 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:30.406998125Z level=info msg="Executing migration" id="add column group_name" 2024-03-30T15:09:30.512 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:30 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:30.449149693Z level=info msg="Executing migration" id="add index role.org_id" 2024-03-30T15:09:30.512 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:30 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:30.474478843Z level=info msg="Executing migration" id="add unique index role_org_id_name" 2024-03-30T15:09:30.781 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:30 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:30.516677891Z level=info msg="Executing migration" id="add index role_org_id_uid" 2024-03-30T15:09:30.781 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:30 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:30.541970244Z level=info msg="Executing migration" id="create team role table" 2024-03-30T15:09:30.782 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:30 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:30.583944833Z level=info msg="Executing migration" id="add index team_role.org_id" 2024-03-30T15:09:30.782 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:30 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:30.609299312Z level=info msg="Executing migration" id="add unique index team_role_org_id_team_id_role_id" 2024-03-30T15:09:30.782 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:30 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:30.651360579Z level=info msg="Executing migration" id="add index team_role.team_id" 2024-03-30T15:09:30.782 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:30 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:30.676566588Z level=info msg="Executing migration" id="create user role table" 2024-03-30T15:09:30.782 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:30 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:30.701864134Z level=info msg="Executing migration" id="add index user_role.org_id" 2024-03-30T15:09:30.782 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:30 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:30.743777914Z level=info msg="Executing migration" id="add unique index user_role_org_id_user_id_role_id" 2024-03-30T15:09:30.879 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:09:30 smithi072 bash[59886]: Error response from daemon: No such container: ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4-alertmanager-a 2024-03-30T15:09:30.879 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:09:30 smithi072 systemd[1]: ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@alertmanager.a.service: Deactivated successfully. 2024-03-30T15:09:30.879 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:09:30 smithi072 systemd[1]: Stopped Ceph alertmanager.a for 97f8e564-eea5-11ee-b647-cb9ed24678a4. 2024-03-30T15:09:30.880 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:09:30 smithi072 systemd[1]: Started Ceph alertmanager.a for 97f8e564-eea5-11ee-b647-cb9ed24678a4. 2024-03-30T15:09:31.033 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:09:30 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:09:31.033 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:30 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:30.785965043Z level=info msg="Executing migration" id="add index user_role.user_id" 2024-03-30T15:09:31.033 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:30 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:30.827945679Z level=info msg="Executing migration" id="create builtin role table" 2024-03-30T15:09:31.034 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:30 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:30.853291271Z level=info msg="Executing migration" id="add index builtin_role.role_id" 2024-03-30T15:09:31.034 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:30 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:30.8786069Z level=info msg="Executing migration" id="add index builtin_role.name" 2024-03-30T15:09:31.034 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:30 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:30.920487968Z level=info msg="Executing migration" id="Add column org_id to builtin_role table" 2024-03-30T15:09:31.034 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:30 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:30.94568612Z level=info msg="Executing migration" id="add index builtin_role.org_id" 2024-03-30T15:09:31.034 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:31 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:31.01275717Z level=info msg="Executing migration" id="add unique index builtin_role_org_id_role_id_role" 2024-03-30T15:09:31.167 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:09:31 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:09:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:09:31.403 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:31 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:31.037991606Z level=info msg="Executing migration" id="Remove unique index role_org_id_uid" 2024-03-30T15:09:31.403 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:31 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:31.079840749Z level=info msg="Executing migration" id="add unique index role.uid" 2024-03-30T15:09:31.403 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:31 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:31.105155036Z level=info msg="Executing migration" id="create seed assignment table" 2024-03-30T15:09:31.403 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:31 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:31.130410741Z level=info msg="Executing migration" id="add unique index builtin_role_role_name" 2024-03-30T15:09:31.404 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:31 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:31.155616671Z level=info msg="Executing migration" id="add column hidden to role table" 2024-03-30T15:09:31.404 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:31 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:31.197366903Z level=info msg="Executing migration" id="create query_history table v1" 2024-03-30T15:09:31.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:31 smithi072 bash[21573]: cluster 2024-03-30T15:09:29.761414+0000 mgr.y (mgr.14526) 63 : cluster 0 pgmap v33: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:31.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:31 smithi072 bash[21573]: audit 2024-03-30T15:09:30.498268+0000 mon.a (mon.0) 855 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:31.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:31 smithi072 bash[21573]: audit 2024-03-30T15:09:30.505613+0000 mon.a (mon.0) 856 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:31.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:31 smithi072 bash[21573]: cephadm 2024-03-30T15:09:30.526050+0000 mgr.y (mgr.14526) 64 : cephadm 1 Reconfiguring prometheus.a (dependencies changed)... 2024-03-30T15:09:31.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:31 smithi072 bash[28946]: cluster 2024-03-30T15:09:29.761414+0000 mgr.y (mgr.14526) 63 : cluster 0 pgmap v33: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:31.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:31 smithi072 bash[28946]: audit 2024-03-30T15:09:30.498268+0000 mon.a (mon.0) 855 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:31.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:31 smithi072 bash[28946]: audit 2024-03-30T15:09:30.505613+0000 mon.a (mon.0) 856 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:31.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:31 smithi072 bash[28946]: cephadm 2024-03-30T15:09:30.526050+0000 mgr.y (mgr.14526) 64 : cephadm 1 Reconfiguring prometheus.a (dependencies changed)... 2024-03-30T15:09:31.668 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:09:31 smithi072 bash[59916]: ts=2024-03-30T15:09:31.506Z caller=main.go:240 level=info msg="Starting Alertmanager" version="(version=0.25.0, branch=HEAD, revision=258fab7cdd551f2cf251ed0348f0ad7289aee789)" 2024-03-30T15:09:31.668 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:09:31 smithi072 bash[59916]: ts=2024-03-30T15:09:31.507Z caller=main.go:241 level=info build_context="(go=go1.19.4, user=root@abe866dd5717, date=20221222-14:51:36)" 2024-03-30T15:09:31.669 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:09:31 smithi072 bash[59916]: ts=2024-03-30T15:09:31.509Z caller=cluster.go:185 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.72 port=9094 2024-03-30T15:09:31.669 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:09:31 smithi072 bash[59916]: ts=2024-03-30T15:09:31.510Z caller=cluster.go:681 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-03-30T15:09:31.669 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:09:31 smithi072 bash[59916]: ts=2024-03-30T15:09:31.540Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-03-30T15:09:31.669 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:09:31 smithi072 bash[59916]: ts=2024-03-30T15:09:31.541Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-03-30T15:09:31.669 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:09:31 smithi072 bash[59916]: ts=2024-03-30T15:09:31.544Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9093 2024-03-30T15:09:31.669 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:09:31 smithi072 bash[59916]: ts=2024-03-30T15:09:31.544Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-03-30T15:09:31.716 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:31 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:31.407886345Z level=info msg="Executing migration" id="add index query_history.org_id-created_by-datasource_uid" 2024-03-30T15:09:31.717 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:31 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:31.636670141Z level=info msg="Executing migration" id="alter table query_history alter column created_by type to bigint" 2024-03-30T15:09:31.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:31 smithi172 bash[23680]: cluster 2024-03-30T15:09:29.761414+0000 mgr.y (mgr.14526) 63 : cluster 0 pgmap v33: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:31.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:31 smithi172 bash[23680]: audit 2024-03-30T15:09:30.498268+0000 mon.a (mon.0) 855 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:31.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:31 smithi172 bash[23680]: audit 2024-03-30T15:09:30.505613+0000 mon.a (mon.0) 856 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:31.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:31 smithi172 bash[23680]: cephadm 2024-03-30T15:09:30.526050+0000 mgr.y (mgr.14526) 64 : cephadm 1 Reconfiguring prometheus.a (dependencies changed)... 2024-03-30T15:09:32.217 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:31 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:31.937692531Z level=info msg="Executing migration" id="teams permissions migration" 2024-03-30T15:09:32.217 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:32 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:32.077436713Z level=info msg="Executing migration" id="dashboard permissions" 2024-03-30T15:09:32.616 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:32 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:32.3651227Z level=info msg="Executing migration" id="dashboard permissions uid scopes" 2024-03-30T15:09:32.616 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:32 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:32.528360695Z level=info msg="Executing migration" id="drop managed folder create actions" 2024-03-30T15:09:32.616 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:32 smithi172 bash[23680]: cephadm 2024-03-30T15:09:30.751160+0000 mgr.y (mgr.14526) 65 : cephadm 1 Reconfiguring daemon prometheus.a on smithi172 2024-03-30T15:09:32.616 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:32 smithi172 bash[23680]: audit 2024-03-30T15:09:30.789698+0000 mgr.y (mgr.14526) 66 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:09:32.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:32 smithi072 bash[21573]: cephadm 2024-03-30T15:09:30.751160+0000 mgr.y (mgr.14526) 65 : cephadm 1 Reconfiguring daemon prometheus.a on smithi172 2024-03-30T15:09:32.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:32 smithi072 bash[21573]: audit 2024-03-30T15:09:30.789698+0000 mgr.y (mgr.14526) 66 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:09:32.918 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:32 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:32.620754981Z level=info msg="Executing migration" id="alerting notification permissions" 2024-03-30T15:09:32.918 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:32 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:32.744299265Z level=info msg="Executing migration" id="create query_history_star table v1" 2024-03-30T15:09:32.918 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:32 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:32.829947913Z level=info msg="Executing migration" id="add index query_history.user_id-query_uid" 2024-03-30T15:09:32.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:32 smithi072 bash[28946]: cephadm 2024-03-30T15:09:30.751160+0000 mgr.y (mgr.14526) 65 : cephadm 1 Reconfiguring daemon prometheus.a on smithi172 2024-03-30T15:09:32.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:32 smithi072 bash[28946]: audit 2024-03-30T15:09:30.789698+0000 mgr.y (mgr.14526) 66 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:09:33.212 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:32 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:32.922197606Z level=info msg="Executing migration" id="add column org_id in query_history_star" 2024-03-30T15:09:33.212 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:32 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:32.997896058Z level=info msg="Executing migration" id="alter table query_history_star_mig column user_id type to bigint" 2024-03-30T15:09:33.212 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:33 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:33.06988642Z level=info msg="Executing migration" id="create correlation table v1" 2024-03-30T15:09:33.212 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:33 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:33.107480211Z level=info msg="Executing migration" id="add index correlations.uid" 2024-03-30T15:09:33.212 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:33 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:33.149548166Z level=info msg="Executing migration" id="add index correlations.source_uid" 2024-03-30T15:09:33.467 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:33 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:33.217116938Z level=info msg="Executing migration" id="add correlation config column" 2024-03-30T15:09:33.467 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:33 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:33.259192468Z level=info msg="Executing migration" id="create entity_events table" 2024-03-30T15:09:33.467 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:33 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:33.339927606Z level=info msg="Executing migration" id="create dashboard public config v1" 2024-03-30T15:09:33.467 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:33 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:33.435357775Z level=info msg="Executing migration" id="drop index UQE_dashboard_public_config_uid - v1" 2024-03-30T15:09:33.467 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:33 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:33.435723488Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop index UQE_dashboard_public_config_uid - v1" 2024-03-30T15:09:33.765 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:33 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:33.519653297Z level=info msg="Executing migration" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-03-30T15:09:33.765 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:33 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:33.520137967Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-03-30T15:09:33.766 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:33 smithi172 bash[23680]: cluster 2024-03-30T15:09:31.762867+0000 mgr.y (mgr.14526) 67 : cluster 0 pgmap v34: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:09:33.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:33 smithi072 bash[21573]: cluster 2024-03-30T15:09:31.762867+0000 mgr.y (mgr.14526) 67 : cluster 0 pgmap v34: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:09:33.917 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:09:33 smithi072 bash[59916]: ts=2024-03-30T15:09:33.511Z caller=cluster.go:706 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.001019692s 2024-03-30T15:09:33.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:33 smithi072 bash[28946]: cluster 2024-03-30T15:09:31.762867+0000 mgr.y (mgr.14526) 67 : cluster 0 pgmap v34: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:09:34.065 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:33 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:33.769879251Z level=info msg="Executing migration" id="Drop old dashboard public config table" 2024-03-30T15:09:34.345 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:34 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:34.070537014Z level=info msg="Executing migration" id="recreate dashboard public config v1" 2024-03-30T15:09:34.346 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:34 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:34.187940053Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_uid - v1" 2024-03-30T15:09:34.346 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:34 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:34.263711134Z level=info msg="Executing migration" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-03-30T15:09:34.717 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:34 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:34.348744512Z level=info msg="Executing migration" id="drop index UQE_dashboard_public_config_uid - v2" 2024-03-30T15:09:34.717 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:34 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:34.532712346Z level=info msg="Executing migration" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v2" 2024-03-30T15:09:35.217 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:34 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:34.780786968Z level=info msg="Executing migration" id="Drop public config table" 2024-03-30T15:09:35.217 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:34 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:34.952120187Z level=info msg="Executing migration" id="Recreate dashboard public config v2" 2024-03-30T15:09:35.435 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T15:09:35.435 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T15:09:35.439 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T15:09:35.439 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T15:09:35.439 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T15:09:35.439 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T15:09:35.440 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T15:09:35.441 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T15:09:35.642 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:35 smithi172 bash[23680]: cluster 2024-03-30T15:09:33.763528+0000 mgr.y (mgr.14526) 68 : cluster 0 pgmap v35: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:35.642 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:35 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:35.294536249Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_uid - v2" 2024-03-30T15:09:35.642 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:35 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:35.436846929Z level=info msg="Executing migration" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v2" 2024-03-30T15:09:35.642 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:35 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:35.537931201Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_access_token - v2" 2024-03-30T15:09:35.910 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:35 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:35.646731052Z level=info msg="Executing migration" id="Rename table dashboard_public_config to dashboard_public - v2" 2024-03-30T15:09:35.910 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:35 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:35.755442714Z level=info msg="Executing migration" id="add annotations_enabled column" 2024-03-30T15:09:35.911 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:35 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:35.831298427Z level=info msg="Executing migration" id="add time_selection_enabled column" 2024-03-30T15:09:35.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:35 smithi072 bash[21573]: cluster 2024-03-30T15:09:33.763528+0000 mgr.y (mgr.14526) 68 : cluster 0 pgmap v35: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:35.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:35 smithi072 bash[28946]: cluster 2024-03-30T15:09:33.763528+0000 mgr.y (mgr.14526) 68 : cluster 0 pgmap v35: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:36.164 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:35 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:35.915340981Z level=info msg="Executing migration" id="delete orphaned public dashboards" 2024-03-30T15:09:36.164 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:35 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:35.974081299Z level=info msg="Executing migration" id="add share column" 2024-03-30T15:09:36.164 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:36 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:36.032650083Z level=info msg="Executing migration" id="create default alerting folders" 2024-03-30T15:09:36.165 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:36 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:36.109059415Z level=info msg="Executing migration" id="create file table" 2024-03-30T15:09:36.165 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:36 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:36.169318965Z level=info msg="Executing migration" id="file table idx: path natural pk" 2024-03-30T15:09:36.466 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:36 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:36.243269204Z level=info msg="Executing migration" id="file table idx: parent_folder_path_hash fast folder retrieval" 2024-03-30T15:09:36.467 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:36 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:36.337752784Z level=info msg="Executing migration" id="create file_meta table" 2024-03-30T15:09:36.842 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:36 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:36.532696849Z level=info msg="Executing migration" id="file table idx: path key" 2024-03-30T15:09:37.109 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:36 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:36.846924658Z level=info msg="Executing migration" id="set path collation in file table" 2024-03-30T15:09:37.109 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:37 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:37.054652103Z level=info msg="Executing migration" id="managed permissions migration" 2024-03-30T15:09:37.415 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:37 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:37.113719597Z level=info msg="Executing migration" id="managed folder permissions alert actions migration" 2024-03-30T15:09:37.415 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:37 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:37.189223007Z level=info msg="Executing migration" id="RBAC action name migrator" 2024-03-30T15:09:37.415 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:37 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:37.240785839Z level=info msg="Executing migration" id="Add UID column to playlist" 2024-03-30T15:09:37.415 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:37 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:37.282816844Z level=info msg="Executing migration" id="Update uid column values in playlist" 2024-03-30T15:09:37.415 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:37 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:37.308084485Z level=info msg="Executing migration" id="Add index for uid in playlist" 2024-03-30T15:09:37.415 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:37 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:37.358648082Z level=info msg="Executing migration" id="update group index for alert rules" 2024-03-30T15:09:37.415 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:09:37 smithi172 systemd[1]: Stopping Ceph prometheus.a for 97f8e564-eea5-11ee-b647-cb9ed24678a4... 2024-03-30T15:09:37.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:37 smithi172 bash[23680]: cluster 2024-03-30T15:09:35.764931+0000 mgr.y (mgr.14526) 69 : cluster 0 pgmap v36: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:09:37.717 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:37 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:37.426119766Z level=info msg="Executing migration" id="managed folder permissions alert actions repeated migration" 2024-03-30T15:09:37.717 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:37 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:37.468118043Z level=info msg="Executing migration" id="admin only folder/dashboard permission" 2024-03-30T15:09:37.717 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:37 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:37.526016298Z level=info msg="Executing migration" id="add action column to seed_assignment" 2024-03-30T15:09:37.717 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:37 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:37.614453073Z level=info msg="Executing migration" id="add scope column to seed_assignment" 2024-03-30T15:09:37.717 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:09:37 smithi172 bash[48881]: ts=2024-03-30T15:09:37.419Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-03-30T15:09:37.717 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:09:37 smithi172 bash[48881]: ts=2024-03-30T15:09:37.419Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-03-30T15:09:37.718 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:09:37 smithi172 bash[48881]: ts=2024-03-30T15:09:37.419Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-03-30T15:09:37.718 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:09:37 smithi172 bash[48881]: ts=2024-03-30T15:09:37.419Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-03-30T15:09:37.718 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:09:37 smithi172 bash[48881]: ts=2024-03-30T15:09:37.419Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-03-30T15:09:37.718 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:09:37 smithi172 bash[48881]: ts=2024-03-30T15:09:37.420Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-03-30T15:09:37.718 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:09:37 smithi172 bash[48881]: ts=2024-03-30T15:09:37.420Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-03-30T15:09:37.718 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:09:37 smithi172 bash[48881]: ts=2024-03-30T15:09:37.420Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-03-30T15:09:37.718 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:09:37 smithi172 bash[48881]: ts=2024-03-30T15:09:37.420Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-03-30T15:09:37.718 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:09:37 smithi172 bash[48881]: ts=2024-03-30T15:09:37.420Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-03-30T15:09:37.718 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:09:37 smithi172 bash[48881]: ts=2024-03-30T15:09:37.420Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-03-30T15:09:37.718 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:09:37 smithi172 bash[48881]: ts=2024-03-30T15:09:37.420Z caller=main.go:1147 level=info msg="See you next time!" 2024-03-30T15:09:37.783 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:37 smithi072 bash[21573]: cluster 2024-03-30T15:09:35.764931+0000 mgr.y (mgr.14526) 69 : cluster 0 pgmap v36: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:09:37.783 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:37 smithi072 bash[28946]: cluster 2024-03-30T15:09:35.764931+0000 mgr.y (mgr.14526) 69 : cluster 0 pgmap v36: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:09:38.217 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:37 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:37.722688994Z level=info msg="Executing migration" id="remove unique index builtin_role_role_name before nullable update" 2024-03-30T15:09:38.217 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:37 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:37.945704059Z level=info msg="Executing migration" id="update seed_assignment role_name column to nullable" 2024-03-30T15:09:38.570 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:09:38 smithi172 bash[51456]: ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4-prometheus-a 2024-03-30T15:09:38.570 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:09:38 smithi172 bash[51517]: Error response from daemon: No such container: ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4-prometheus-a 2024-03-30T15:09:38.571 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:38 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:38.413019322Z level=info msg="Executing migration" id="add unique index builtin_role_name back" 2024-03-30T15:09:38.571 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:38 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:38.480757854Z level=info msg="Executing migration" id="add unique index builtin_role_action_scope" 2024-03-30T15:09:38.571 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:38 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:38.556726067Z level=info msg="Executing migration" id="add primary key to seed_assigment" 2024-03-30T15:09:38.783 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:09:38 smithi072 bash[21828]: [30/Mar/2024:15:09:38] ENGINE Bus STOPPING 2024-03-30T15:09:38.783 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:09:38 smithi072 bash[21828]: [30/Mar/2024:15:09:38] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-30T15:09:38.783 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:09:38 smithi072 bash[21828]: [30/Mar/2024:15:09:38] ENGINE Bus STOPPED 2024-03-30T15:09:38.783 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:09:38 smithi072 bash[21828]: [30/Mar/2024:15:09:38] ENGINE Bus STARTING 2024-03-30T15:09:38.854 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:09:38 smithi172 systemd[1]: ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@prometheus.a.service: Deactivated successfully. 2024-03-30T15:09:38.854 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:09:38 smithi172 systemd[1]: Stopped Ceph prometheus.a for 97f8e564-eea5-11ee-b647-cb9ed24678a4. 2024-03-30T15:09:38.854 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:09:38 smithi172 systemd[1]: Started Ceph prometheus.a for 97f8e564-eea5-11ee-b647-cb9ed24678a4. 2024-03-30T15:09:38.854 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:38 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:38.624251803Z level=info msg="Executing migration" id="managed folder permissions alert actions repeated fixed migration" 2024-03-30T15:09:39.037 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:09:38 smithi072 bash[21828]: [30/Mar/2024:15:09:38] ENGINE Serving on http://:::9283 2024-03-30T15:09:39.037 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:09:38 smithi072 bash[21828]: [30/Mar/2024:15:09:38] ENGINE Bus STARTED 2024-03-30T15:09:39.037 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:09:38 smithi072 bash[21828]: [30/Mar/2024:15:09:38] ENGINE Bus STOPPING 2024-03-30T15:09:39.037 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:09:38 smithi072 bash[21828]: [30/Mar/2024:15:09:38] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-30T15:09:39.038 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:09:38 smithi072 bash[21828]: [30/Mar/2024:15:09:38] ENGINE Bus STOPPED 2024-03-30T15:09:39.038 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:09:38 smithi072 bash[21828]: [30/Mar/2024:15:09:38] ENGINE Bus STARTING 2024-03-30T15:09:39.038 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:09:38 smithi072 bash[21828]: [30/Mar/2024:15:09:38] ENGINE Serving on http://:::9283 2024-03-30T15:09:39.038 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:09:38 smithi072 bash[21828]: [30/Mar/2024:15:09:38] ENGINE Bus STARTED 2024-03-30T15:09:39.038 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:09:38 smithi072 bash[21828]: [30/Mar/2024:15:09:38] ENGINE Bus STOPPING 2024-03-30T15:09:39.038 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:09:38 smithi072 bash[21828]: [30/Mar/2024:15:09:38] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-30T15:09:39.038 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:09:38 smithi072 bash[21828]: [30/Mar/2024:15:09:38] ENGINE Bus STOPPED 2024-03-30T15:09:39.038 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:09:38 smithi072 bash[21828]: [30/Mar/2024:15:09:38] ENGINE Bus STARTING 2024-03-30T15:09:39.038 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:09:39 smithi072 bash[21828]: [30/Mar/2024:15:09:39] ENGINE Serving on http://:::9283 2024-03-30T15:09:39.038 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:09:39 smithi072 bash[21828]: [30/Mar/2024:15:09:39] ENGINE Bus STARTED 2024-03-30T15:09:39.216 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:38 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:38.85867123Z level=info msg="Executing migration" id="migrate external alertmanagers to datsourcse" 2024-03-30T15:09:39.216 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:39 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:39.105410555Z level=info msg="Executing migration" id="create folder table" 2024-03-30T15:09:39.717 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:39 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:39.444633085Z level=info msg="Executing migration" id="Add index for parent_uid" 2024-03-30T15:09:39.717 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:39 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:39.561969077Z level=info msg="Executing migration" id="Add unique index for folder.uid and folder.org_id" 2024-03-30T15:09:39.717 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:39 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:39.654556904Z level=info msg="Executing migration" id="Update folder title length" 2024-03-30T15:09:39.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:39 smithi172 bash[23680]: cluster 2024-03-30T15:09:37.765383+0000 mgr.y (mgr.14526) 70 : cluster 0 pgmap v37: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:39.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:39 smithi172 bash[23680]: audit 2024-03-30T15:09:38.623006+0000 mon.a (mon.0) 857 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:39.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:39 smithi172 bash[23680]: audit 2024-03-30T15:09:38.629980+0000 mon.a (mon.0) 858 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:39.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:39 smithi172 bash[23680]: audit 2024-03-30T15:09:38.646499+0000 mon.c (mon.2) 67 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-30T15:09:39.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:39 smithi172 bash[23680]: audit 2024-03-30T15:09:38.646994+0000 mgr.y (mgr.14526) 71 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-30T15:09:39.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:39 smithi172 bash[23680]: audit 2024-03-30T15:09:38.648019+0000 mon.c (mon.2) 68 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi072.front.sepia.ceph.com:9093"}]: dispatch 2024-03-30T15:09:39.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:39 smithi172 bash[23680]: audit 2024-03-30T15:09:38.648366+0000 mgr.y (mgr.14526) 72 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi072.front.sepia.ceph.com:9093"}]: dispatch 2024-03-30T15:09:39.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:39 smithi172 bash[23680]: audit 2024-03-30T15:09:38.652350+0000 mon.a (mon.0) 859 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:39.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:39 smithi172 bash[23680]: audit 2024-03-30T15:09:38.664218+0000 mon.c (mon.2) 69 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T15:09:39.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:39 smithi172 bash[23680]: audit 2024-03-30T15:09:38.666395+0000 mon.c (mon.2) 70 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi172.front.sepia.ceph.com:9095"}]: dispatch 2024-03-30T15:09:39.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:39 smithi172 bash[23680]: audit 2024-03-30T15:09:38.670813+0000 mon.a (mon.0) 860 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:39.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:39 smithi172 bash[23680]: audit 2024-03-30T15:09:38.684459+0000 mon.c (mon.2) 71 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-30T15:09:39.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:39 smithi172 bash[23680]: audit 2024-03-30T15:09:38.689042+0000 mon.c (mon.2) 72 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi172.front.sepia.ceph.com:3000"}]: dispatch 2024-03-30T15:09:39.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:39 smithi172 bash[23680]: audit 2024-03-30T15:09:38.694002+0000 mon.a (mon.0) 861 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:39.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:39 smithi172 bash[23680]: audit 2024-03-30T15:09:38.710812+0000 mon.c (mon.2) 73 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:09:39.884 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:39 smithi072 bash[21573]: cluster 2024-03-30T15:09:37.765383+0000 mgr.y (mgr.14526) 70 : cluster 0 pgmap v37: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:39.884 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:39 smithi072 bash[21573]: audit 2024-03-30T15:09:38.623006+0000 mon.a (mon.0) 857 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:39.884 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:39 smithi072 bash[21573]: audit 2024-03-30T15:09:38.629980+0000 mon.a (mon.0) 858 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:39.884 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:39 smithi072 bash[21573]: audit 2024-03-30T15:09:38.646499+0000 mon.c (mon.2) 67 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-30T15:09:39.885 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:39 smithi072 bash[21573]: audit 2024-03-30T15:09:38.646994+0000 mgr.y (mgr.14526) 71 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-30T15:09:39.885 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:39 smithi072 bash[21573]: audit 2024-03-30T15:09:38.648019+0000 mon.c (mon.2) 68 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi072.front.sepia.ceph.com:9093"}]: dispatch 2024-03-30T15:09:39.885 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:39 smithi072 bash[21573]: audit 2024-03-30T15:09:38.648366+0000 mgr.y (mgr.14526) 72 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi072.front.sepia.ceph.com:9093"}]: dispatch 2024-03-30T15:09:39.885 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:39 smithi072 bash[21573]: audit 2024-03-30T15:09:38.652350+0000 mon.a (mon.0) 859 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:39.885 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:39 smithi072 bash[21573]: audit 2024-03-30T15:09:38.664218+0000 mon.c (mon.2) 69 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T15:09:39.885 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:39 smithi072 bash[21573]: audit 2024-03-30T15:09:38.666395+0000 mon.c (mon.2) 70 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi172.front.sepia.ceph.com:9095"}]: dispatch 2024-03-30T15:09:39.885 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:39 smithi072 bash[21573]: audit 2024-03-30T15:09:38.670813+0000 mon.a (mon.0) 860 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:39.885 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:39 smithi072 bash[21573]: audit 2024-03-30T15:09:38.684459+0000 mon.c (mon.2) 71 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-30T15:09:39.885 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:39 smithi072 bash[21573]: audit 2024-03-30T15:09:38.689042+0000 mon.c (mon.2) 72 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi172.front.sepia.ceph.com:3000"}]: dispatch 2024-03-30T15:09:39.885 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:39 smithi072 bash[21573]: audit 2024-03-30T15:09:38.694002+0000 mon.a (mon.0) 861 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:39.885 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:39 smithi072 bash[21573]: audit 2024-03-30T15:09:38.710812+0000 mon.c (mon.2) 73 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:09:39.886 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:39 smithi072 bash[28946]: cluster 2024-03-30T15:09:37.765383+0000 mgr.y (mgr.14526) 70 : cluster 0 pgmap v37: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:39.886 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:39 smithi072 bash[28946]: audit 2024-03-30T15:09:38.623006+0000 mon.a (mon.0) 857 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:39.886 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:39 smithi072 bash[28946]: audit 2024-03-30T15:09:38.629980+0000 mon.a (mon.0) 858 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:39.886 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:39 smithi072 bash[28946]: audit 2024-03-30T15:09:38.646499+0000 mon.c (mon.2) 67 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-30T15:09:39.886 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:39 smithi072 bash[28946]: audit 2024-03-30T15:09:38.646994+0000 mgr.y (mgr.14526) 71 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-30T15:09:39.886 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:39 smithi072 bash[28946]: audit 2024-03-30T15:09:38.648019+0000 mon.c (mon.2) 68 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi072.front.sepia.ceph.com:9093"}]: dispatch 2024-03-30T15:09:39.886 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:39 smithi072 bash[28946]: audit 2024-03-30T15:09:38.648366+0000 mgr.y (mgr.14526) 72 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi072.front.sepia.ceph.com:9093"}]: dispatch 2024-03-30T15:09:39.886 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:39 smithi072 bash[28946]: audit 2024-03-30T15:09:38.652350+0000 mon.a (mon.0) 859 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:39.886 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:39 smithi072 bash[28946]: audit 2024-03-30T15:09:38.664218+0000 mon.c (mon.2) 69 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T15:09:39.886 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:39 smithi072 bash[28946]: audit 2024-03-30T15:09:38.666395+0000 mon.c (mon.2) 70 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi172.front.sepia.ceph.com:9095"}]: dispatch 2024-03-30T15:09:39.886 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:39 smithi072 bash[28946]: audit 2024-03-30T15:09:38.670813+0000 mon.a (mon.0) 860 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:39.886 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:39 smithi072 bash[28946]: audit 2024-03-30T15:09:38.684459+0000 mon.c (mon.2) 71 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-30T15:09:39.887 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:39 smithi072 bash[28946]: audit 2024-03-30T15:09:38.689042+0000 mon.c (mon.2) 72 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi172.front.sepia.ceph.com:3000"}]: dispatch 2024-03-30T15:09:39.887 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:39 smithi072 bash[28946]: audit 2024-03-30T15:09:38.694002+0000 mon.a (mon.0) 861 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:39.887 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:39 smithi072 bash[28946]: audit 2024-03-30T15:09:38.710812+0000 mon.c (mon.2) 73 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:09:40.008 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:39 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:39.761992731Z level=info msg="Executing migration" id="Add unique index for folder.title and folder.parent_uid" 2024-03-30T15:09:40.087 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:39 smithi172 bash[50795]: logger=migrator t=2024-03-30T15:09:39.863879404Z level=info msg="migrations completed" performed=485 skipped=0 duration=22.347272567s 2024-03-30T15:09:40.087 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:39 smithi172 bash[50795]: logger=sqlstore t=2024-03-30T15:09:39.865263406Z level=info msg="Created default organization" 2024-03-30T15:09:40.087 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:40 smithi172 bash[50795]: logger=plugin.finder t=2024-03-30T15:09:40.008047243Z level=warn msg="Skipping finding plugins as directory does not exist" path=/usr/share/grafana/plugins-bundled 2024-03-30T15:09:40.087 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:40 smithi172 bash[50795]: logger=secrets t=2024-03-30T15:09:40.008214837Z level=info msg="Envelope encryption state" enabled=true currentprovider=secretKey.v1 2024-03-30T15:09:40.466 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:40 smithi172 bash[50795]: logger=query_data t=2024-03-30T15:09:40.013671769Z level=info msg="Query Service initialization" 2024-03-30T15:09:40.467 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:40 smithi172 bash[50795]: logger=live.push_http t=2024-03-30T15:09:40.017085207Z level=info msg="Live Push Gateway initialization" 2024-03-30T15:09:40.467 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:09:40 smithi172 bash[51546]: ts=2024-03-30T15:09:40.131Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-03-30T15:09:40.467 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:09:40 smithi172 bash[51546]: ts=2024-03-30T15:09:40.131Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-03-30T15:09:40.467 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:09:40 smithi172 bash[51546]: ts=2024-03-30T15:09:40.131Z caller=main.go:570 level=info host_details="(Linux 5.15.0-101-generic #111-Ubuntu SMP Tue Mar 5 20:16:58 UTC 2024 x86_64 smithi172 (none))" 2024-03-30T15:09:40.467 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:09:40 smithi172 bash[51546]: ts=2024-03-30T15:09:40.132Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-03-30T15:09:40.467 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:09:40 smithi172 bash[51546]: ts=2024-03-30T15:09:40.132Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-03-30T15:09:40.467 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:09:40 smithi172 bash[51546]: ts=2024-03-30T15:09:40.134Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-03-30T15:09:40.467 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:09:40 smithi172 bash[51546]: ts=2024-03-30T15:09:40.135Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-03-30T15:09:40.467 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:09:40 smithi172 bash[51546]: ts=2024-03-30T15:09:40.137Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-03-30T15:09:40.468 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:09:40 smithi172 bash[51546]: ts=2024-03-30T15:09:40.137Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-03-30T15:09:40.468 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:09:40 smithi172 bash[51546]: ts=2024-03-30T15:09:40.140Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-03-30T15:09:40.468 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:09:40 smithi172 bash[51546]: ts=2024-03-30T15:09:40.140Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.684µs 2024-03-30T15:09:40.468 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:09:40 smithi172 bash[51546]: ts=2024-03-30T15:09:40.140Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-03-30T15:09:40.468 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:09:40 smithi172 bash[51546]: ts=2024-03-30T15:09:40.140Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=1 2024-03-30T15:09:40.468 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:09:40 smithi172 bash[51546]: ts=2024-03-30T15:09:40.140Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=1 2024-03-30T15:09:40.468 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:09:40 smithi172 bash[51546]: ts=2024-03-30T15:09:40.140Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=31.96µs wal_replay_duration=727.286µs wbl_replay_duration=134ns total_replay_duration=791.502µs 2024-03-30T15:09:40.468 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:09:40 smithi172 bash[51546]: ts=2024-03-30T15:09:40.142Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-03-30T15:09:40.468 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:09:40 smithi172 bash[51546]: ts=2024-03-30T15:09:40.142Z caller=main.go:1029 level=info msg="TSDB started" 2024-03-30T15:09:40.468 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:09:40 smithi172 bash[51546]: ts=2024-03-30T15:09:40.142Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-03-30T15:09:40.468 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:09:40 smithi172 bash[51546]: ts=2024-03-30T15:09:40.164Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=22.463451ms db_storage=1.174µs remote_storage=1.227µs web_handler=371ns query_engine=730ns scrape=241.46µs scrape_sd=80.485µs notify=10.381µs notify_sd=18.087µs rules=21.836312ms tracing=7.813µs 2024-03-30T15:09:40.468 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:09:40 smithi172 bash[51546]: ts=2024-03-30T15:09:40.164Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-03-30T15:09:40.468 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:09:40 smithi172 bash[51546]: ts=2024-03-30T15:09:40.164Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-03-30T15:09:40.934 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:40 smithi072 bash[21573]: audit 2024-03-30T15:09:38.664715+0000 mgr.y (mgr.14526) 73 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T15:09:40.934 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:40 smithi072 bash[21573]: audit 2024-03-30T15:09:38.666858+0000 mgr.y (mgr.14526) 74 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi172.front.sepia.ceph.com:9095"}]: dispatch 2024-03-30T15:09:40.934 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:40 smithi072 bash[21573]: audit 2024-03-30T15:09:38.685014+0000 mgr.y (mgr.14526) 75 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-30T15:09:40.934 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:40 smithi072 bash[21573]: audit 2024-03-30T15:09:38.689463+0000 mgr.y (mgr.14526) 76 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi172.front.sepia.ceph.com:3000"}]: dispatch 2024-03-30T15:09:40.935 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:40 smithi072 bash[28946]: audit 2024-03-30T15:09:38.664715+0000 mgr.y (mgr.14526) 73 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T15:09:40.935 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:40 smithi072 bash[28946]: audit 2024-03-30T15:09:38.666858+0000 mgr.y (mgr.14526) 74 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi172.front.sepia.ceph.com:9095"}]: dispatch 2024-03-30T15:09:40.935 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:40 smithi072 bash[28946]: audit 2024-03-30T15:09:38.685014+0000 mgr.y (mgr.14526) 75 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-30T15:09:40.935 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:40 smithi072 bash[28946]: audit 2024-03-30T15:09:38.689463+0000 mgr.y (mgr.14526) 76 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi172.front.sepia.ceph.com:3000"}]: dispatch 2024-03-30T15:09:40.966 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:09:40 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:09:40.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:40 smithi172 bash[23680]: audit 2024-03-30T15:09:38.664715+0000 mgr.y (mgr.14526) 73 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T15:09:40.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:40 smithi172 bash[23680]: audit 2024-03-30T15:09:38.666858+0000 mgr.y (mgr.14526) 74 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi172.front.sepia.ceph.com:9095"}]: dispatch 2024-03-30T15:09:40.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:40 smithi172 bash[23680]: audit 2024-03-30T15:09:38.685014+0000 mgr.y (mgr.14526) 75 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-30T15:09:40.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:40 smithi172 bash[23680]: audit 2024-03-30T15:09:38.689463+0000 mgr.y (mgr.14526) 76 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi172.front.sepia.ceph.com:3000"}]: dispatch 2024-03-30T15:09:41.467 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:41 smithi172 bash[50795]: logger=infra.usagestats.collector t=2024-03-30T15:09:41.006407282Z level=info msg="registering usage stat providers" usageStatsProvidersLen=2 2024-03-30T15:09:41.467 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:41 smithi172 bash[50795]: logger=provisioning.datasources t=2024-03-30T15:09:41.007575777Z level=info msg="inserting datasource from configuration " name=Dashboard1 uid=P43CA22E17D0F9596 2024-03-30T15:09:41.467 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:41 smithi172 bash[50795]: logger=provisioning.datasources t=2024-03-30T15:09:41.049733104Z level=info msg="inserting datasource from configuration " name=Loki uid=P8E80F9AEF21F6940 2024-03-30T15:09:41.467 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:41 smithi172 bash[50795]: logger=provisioning.alerting t=2024-03-30T15:09:41.100193638Z level=info msg="starting to provision alerting" 2024-03-30T15:09:41.467 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:41 smithi172 bash[50795]: logger=provisioning.alerting t=2024-03-30T15:09:41.100216148Z level=info msg="finished to provision alerting" 2024-03-30T15:09:41.467 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:41 smithi172 bash[50795]: logger=grafanaStorageLogger t=2024-03-30T15:09:41.100493918Z level=info msg="storage starting" 2024-03-30T15:09:41.467 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:41 smithi172 bash[50795]: logger=ngalert.state.manager t=2024-03-30T15:09:41.100637668Z level=info msg="Warming state cache for startup" 2024-03-30T15:09:41.467 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:41 smithi172 bash[50795]: logger=ngalert.state.manager t=2024-03-30T15:09:41.103600108Z level=info msg="State cache has been initialized" states=0 duration=2.96074ms 2024-03-30T15:09:41.468 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:41 smithi172 bash[50795]: logger=ticker t=2024-03-30T15:09:41.104473662Z level=info msg=starting first_tick=2024-03-30T15:09:50Z 2024-03-30T15:09:41.468 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:41 smithi172 bash[50795]: logger=ngalert.multiorg.alertmanager t=2024-03-30T15:09:41.10463655Z level=info msg="starting MultiOrg Alertmanager" 2024-03-30T15:09:41.468 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:41 smithi172 bash[50795]: logger=http.server t=2024-03-30T15:09:41.110531487Z level=info msg="HTTP Server Listen" address=[::]:3000 protocol=https subUrl= socket= 2024-03-30T15:09:41.468 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:09:41 smithi172 bash[50795]: logger=sqlstore.transactions t=2024-03-30T15:09:41.208607649Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-03-30T15:09:41.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:41 smithi072 bash[21573]: cluster 2024-03-30T15:09:39.765962+0000 mgr.y (mgr.14526) 77 : cluster 0 pgmap v38: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:41.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:41 smithi072 bash[28946]: cluster 2024-03-30T15:09:39.765962+0000 mgr.y (mgr.14526) 77 : cluster 0 pgmap v38: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:41.918 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:09:41 smithi072 bash[59916]: ts=2024-03-30T15:09:41.514Z caller=cluster.go:698 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.004401965s 2024-03-30T15:09:41.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:41 smithi172 bash[23680]: cluster 2024-03-30T15:09:39.765962+0000 mgr.y (mgr.14526) 77 : cluster 0 pgmap v38: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:42.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:42 smithi172 bash[23680]: audit 2024-03-30T15:09:40.801081+0000 mgr.y (mgr.14526) 78 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:09:43.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:42 smithi072 bash[21573]: audit 2024-03-30T15:09:40.801081+0000 mgr.y (mgr.14526) 78 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:09:43.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:42 smithi072 bash[28946]: audit 2024-03-30T15:09:40.801081+0000 mgr.y (mgr.14526) 78 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:09:43.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:43 smithi172 bash[23680]: cluster 2024-03-30T15:09:41.767365+0000 mgr.y (mgr.14526) 79 : cluster 0 pgmap v39: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:09:44.160 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:43 smithi072 bash[21573]: cluster 2024-03-30T15:09:41.767365+0000 mgr.y (mgr.14526) 79 : cluster 0 pgmap v39: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:09:44.161 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:43 smithi072 bash[28946]: cluster 2024-03-30T15:09:41.767365+0000 mgr.y (mgr.14526) 79 : cluster 0 pgmap v39: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:09:45.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:45 smithi072 bash[21573]: cluster 2024-03-30T15:09:43.768059+0000 mgr.y (mgr.14526) 80 : cluster 0 pgmap v40: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:45.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:45 smithi072 bash[21573]: audit 2024-03-30T15:09:45.018071+0000 mon.c (mon.2) 74 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:09:45.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:45 smithi072 bash[28946]: cluster 2024-03-30T15:09:43.768059+0000 mgr.y (mgr.14526) 80 : cluster 0 pgmap v40: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:45.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:45 smithi072 bash[28946]: audit 2024-03-30T15:09:45.018071+0000 mon.c (mon.2) 74 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:09:45.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:45 smithi172 bash[23680]: cluster 2024-03-30T15:09:43.768059+0000 mgr.y (mgr.14526) 80 : cluster 0 pgmap v40: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:45.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:45 smithi172 bash[23680]: audit 2024-03-30T15:09:45.018071+0000 mon.c (mon.2) 74 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:09:46.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.599+0000 7f841af98700 1 -- 172.21.15.72:0/1012040960 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8414103f60 msgr2=0x7f84141043e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:46.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.599+0000 7f841af98700 1 --2- 172.21.15.72:0/1012040960 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8414103f60 0x7f84141043e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f83fc009990 tx=0x7f83fc009ca0 comp rx=0 tx=0).stop 2024-03-30T15:09:46.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.599+0000 7f841af98700 1 -- 172.21.15.72:0/1012040960 shutdown_connections 2024-03-30T15:09:46.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.599+0000 7f841af98700 1 --2- 172.21.15.72:0/1012040960 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8414104920 0x7f841410f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:46.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.599+0000 7f841af98700 1 --2- 172.21.15.72:0/1012040960 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f841406ac50 0x7f841406b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:46.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.599+0000 7f841af98700 1 --2- 172.21.15.72:0/1012040960 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8414103f60 0x7f84141043e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:46.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.599+0000 7f841af98700 1 -- 172.21.15.72:0/1012040960 >> 172.21.15.72:0/1012040960 conn(0x7f84140771e0 msgr2=0x7f84140775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:09:46.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.599+0000 7f841af98700 1 -- 172.21.15.72:0/1012040960 shutdown_connections 2024-03-30T15:09:46.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.599+0000 7f841af98700 1 -- 172.21.15.72:0/1012040960 wait complete. 2024-03-30T15:09:46.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.599+0000 7f841af98700 1 Processor -- start 2024-03-30T15:09:46.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.599+0000 7f841af98700 1 -- start start 2024-03-30T15:09:46.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.599+0000 7f841af98700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f841406ac50 0x7f8414101310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:46.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.599+0000 7f841af98700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8414103f60 0x7f8414101850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:46.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.599+0000 7f841af98700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8414104920 0x7f8414101d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:46.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.599+0000 7f841af98700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8414111c00 con 0x7f8414104920 2024-03-30T15:09:46.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.599+0000 7f841af98700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8414111a80 con 0x7f8414103f60 2024-03-30T15:09:46.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.599+0000 7f841af98700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f8414111d80 con 0x7f841406ac50 2024-03-30T15:09:46.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.599+0000 7f8419535700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8414104920 0x7f8414101d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:46.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.599+0000 7f8419535700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8414104920 0x7f8414101d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57868/0 (socket says 172.21.15.72:57868) 2024-03-30T15:09:46.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.599+0000 7f8419535700 1 -- 172.21.15.72:0/2933749312 learned_addr learned my addr 172.21.15.72:0/2933749312 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T15:09:46.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.599+0000 7f8418d34700 1 --2- 172.21.15.72:0/2933749312 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f841406ac50 0x7f8414101310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:46.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.599+0000 7f8413fff700 1 --2- 172.21.15.72:0/2933749312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8414103f60 0x7f8414101850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:46.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.599+0000 7f8419535700 1 -- 172.21.15.72:0/2933749312 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f841406ac50 msgr2=0x7f8414101310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:46.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.599+0000 7f8419535700 1 --2- 172.21.15.72:0/2933749312 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f841406ac50 0x7f8414101310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:46.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.599+0000 7f8419535700 1 -- 172.21.15.72:0/2933749312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8414103f60 msgr2=0x7f8414101850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:46.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.599+0000 7f8419535700 1 --2- 172.21.15.72:0/2933749312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8414103f60 0x7f8414101850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:46.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.599+0000 7f8419535700 1 -- 172.21.15.72:0/2933749312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84141a6670 con 0x7f8414104920 2024-03-30T15:09:46.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.599+0000 7f8419535700 1 --2- 172.21.15.72:0/2933749312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8414104920 0x7f8414101d90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f840c00c970 tx=0x7f840c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:09:46.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.599+0000 7f8411ffb700 1 -- 172.21.15.72:0/2933749312 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840c00ce60 con 0x7f8414104920 2024-03-30T15:09:46.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.599+0000 7f8411ffb700 1 -- 172.21.15.72:0/2933749312 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f840c004830 con 0x7f8414104920 2024-03-30T15:09:46.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.599+0000 7f8411ffb700 1 -- 172.21.15.72:0/2933749312 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840c0053a0 con 0x7f8414104920 2024-03-30T15:09:46.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.599+0000 7f841af98700 1 -- 172.21.15.72:0/2933749312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84141a6960 con 0x7f8414104920 2024-03-30T15:09:46.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.599+0000 7f841af98700 1 -- 172.21.15.72:0/2933749312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84141a6ea0 con 0x7f8414104920 2024-03-30T15:09:46.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.599+0000 7f841af98700 1 -- 172.21.15.72:0/2933749312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f84141089f0 con 0x7f8414104920 2024-03-30T15:09:46.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.603+0000 7f8411ffb700 1 -- 172.21.15.72:0/2933749312 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 21) ==== 91831+0+0 (secure 0 0 0) 0x7f840c005540 con 0x7f8414104920 2024-03-30T15:09:46.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.603+0000 7f8411ffb700 1 --2- 172.21.15.72:0/2933749312 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f840006dc40 0x7f8400070100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:46.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.603+0000 7f8411ffb700 1 -- 172.21.15.72:0/2933749312 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7537+0+0 (secure 0 0 0) 0x7f840c08ded0 con 0x7f8414104920 2024-03-30T15:09:46.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.603+0000 7f8418d34700 1 --2- 172.21.15.72:0/2933749312 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f840006dc40 0x7f8400070100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:46.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.603+0000 7f8411ffb700 1 --2- 172.21.15.72:0/2933749312 >> [v2:172.21.15.72:6802/1463362008,v1:172.21.15.72:6803/1463362008] conn(0x7f8400077bd0 0x7f840007a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:46.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.603+0000 7f8411ffb700 1 -- 172.21.15.72:0/2933749312 --> [v2:172.21.15.72:6802/1463362008,v1:172.21.15.72:6803/1463362008] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f840007a740 con 0x7f8400077bd0 2024-03-30T15:09:46.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.603+0000 7f8411ffb700 1 -- 172.21.15.72:0/2933749312 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f840c08e3b0 con 0x7f8414104920 2024-03-30T15:09:46.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.603+0000 7f8413fff700 1 --2- 172.21.15.72:0/2933749312 >> [v2:172.21.15.72:6802/1463362008,v1:172.21.15.72:6803/1463362008] conn(0x7f8400077bd0 0x7f840007a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:46.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.603+0000 7f8418d34700 1 --2- 172.21.15.72:0/2933749312 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f840006dc40 0x7f8400070100 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f840400f540 tx=0x7f840400b040 comp rx=0 tx=0).ready entity=mgr.14526 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:09:46.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.603+0000 7f8413fff700 1 --2- 172.21.15.72:0/2933749312 >> [v2:172.21.15.72:6802/1463362008,v1:172.21.15.72:6803/1463362008] conn(0x7f8400077bd0 0x7f840007a070 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:09:46.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.603+0000 7f8411ffb700 1 -- 172.21.15.72:0/2933749312 <== osd.0 v2:172.21.15.72:6802/1463362008 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f840007a740 con 0x7f8400077bd0 2024-03-30T15:09:46.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.619+0000 7f841af98700 1 -- 172.21.15.72:0/2933749312 --> [v2:172.21.15.72:6802/1463362008,v1:172.21.15.72:6803/1463362008] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8414103a70 con 0x7f8400077bd0 2024-03-30T15:09:46.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.623+0000 7f8411ffb700 1 -- 172.21.15.72:0/2933749312 <== osd.0 v2:172.21.15.72:6802/1463362008 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8414103a70 con 0x7f8400077bd0 2024-03-30T15:09:46.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.623+0000 7f841af98700 1 -- 172.21.15.72:0/2933749312 >> [v2:172.21.15.72:6802/1463362008,v1:172.21.15.72:6803/1463362008] conn(0x7f8400077bd0 msgr2=0x7f840007a070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:46.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.623+0000 7f841af98700 1 --2- 172.21.15.72:0/2933749312 >> [v2:172.21.15.72:6802/1463362008,v1:172.21.15.72:6803/1463362008] conn(0x7f8400077bd0 0x7f840007a070 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:46.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.623+0000 7f841af98700 1 -- 172.21.15.72:0/2933749312 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f840006dc40 msgr2=0x7f8400070100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:46.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.623+0000 7f841af98700 1 --2- 172.21.15.72:0/2933749312 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f840006dc40 0x7f8400070100 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f840400f540 tx=0x7f840400b040 comp rx=0 tx=0).stop 2024-03-30T15:09:46.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.623+0000 7f841af98700 1 -- 172.21.15.72:0/2933749312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8414104920 msgr2=0x7f8414101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:46.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.623+0000 7f841af98700 1 --2- 172.21.15.72:0/2933749312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8414104920 0x7f8414101d90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f840c00c970 tx=0x7f840c00cc80 comp rx=0 tx=0).stop 2024-03-30T15:09:46.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.623+0000 7f8419535700 1 -- 172.21.15.72:0/2933749312 reap_dead start 2024-03-30T15:09:46.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.623+0000 7f841af98700 1 -- 172.21.15.72:0/2933749312 shutdown_connections 2024-03-30T15:09:46.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.623+0000 7f841af98700 1 -- 172.21.15.72:0/2933749312 >> 172.21.15.72:0/2933749312 conn(0x7f84140771e0 msgr2=0x7f8414107080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:09:46.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.623+0000 7f841af98700 1 -- 172.21.15.72:0/2933749312 shutdown_connections 2024-03-30T15:09:46.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:46.623+0000 7f841af98700 1 -- 172.21.15.72:0/2933749312 wait complete. 2024-03-30T15:09:46.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:46 smithi072 bash[28946]: audit 2024-03-30T15:09:45.759199+0000 mon.a (mon.0) 862 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:46.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:46 smithi072 bash[28946]: cluster 2024-03-30T15:09:45.769547+0000 mgr.y (mgr.14526) 81 : cluster 0 pgmap v41: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:09:46.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:46 smithi072 bash[28946]: audit 2024-03-30T15:09:45.773891+0000 mon.a (mon.0) 863 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:46.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:46 smithi072 bash[21573]: audit 2024-03-30T15:09:45.759199+0000 mon.a (mon.0) 862 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:46.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:46 smithi072 bash[21573]: cluster 2024-03-30T15:09:45.769547+0000 mgr.y (mgr.14526) 81 : cluster 0 pgmap v41: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:09:46.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:46 smithi072 bash[21573]: audit 2024-03-30T15:09:45.773891+0000 mon.a (mon.0) 863 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:47.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:46 smithi172 bash[23680]: audit 2024-03-30T15:09:45.759199+0000 mon.a (mon.0) 862 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:47.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:46 smithi172 bash[23680]: cluster 2024-03-30T15:09:45.769547+0000 mgr.y (mgr.14526) 81 : cluster 0 pgmap v41: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:09:47.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:46 smithi172 bash[23680]: audit 2024-03-30T15:09:45.773891+0000 mon.a (mon.0) 863 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:47.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.747+0000 7f301877b700 1 -- 172.21.15.72:0/2660724340 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3010101b60 msgr2=0x7f301010dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:47.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.747+0000 7f301877b700 1 --2- 172.21.15.72:0/2660724340 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3010101b60 0x7f301010dfd0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f30000098f0 tx=0x7f3000009c00 comp rx=0 tx=0).stop 2024-03-30T15:09:47.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.747+0000 7f301877b700 1 -- 172.21.15.72:0/2660724340 shutdown_connections 2024-03-30T15:09:47.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.747+0000 7f301877b700 1 --2- 172.21.15.72:0/2660724340 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3010101b60 0x7f301010dfd0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:47.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.747+0000 7f301877b700 1 --2- 172.21.15.72:0/2660724340 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3010107220 0x7f3010107600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:47.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.747+0000 7f301877b700 1 --2- 172.21.15.72:0/2660724340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30101011a0 0x7f3010101620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:47.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.747+0000 7f301877b700 1 -- 172.21.15.72:0/2660724340 >> 172.21.15.72:0/2660724340 conn(0x7f30100771e0 msgr2=0x7f30100775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:09:47.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.747+0000 7f301877b700 1 -- 172.21.15.72:0/2660724340 shutdown_connections 2024-03-30T15:09:47.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.747+0000 7f301877b700 1 -- 172.21.15.72:0/2660724340 wait complete. 2024-03-30T15:09:47.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.747+0000 7f301877b700 1 Processor -- start 2024-03-30T15:09:47.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.747+0000 7f301877b700 1 -- start start 2024-03-30T15:09:47.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.747+0000 7f301877b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30101011a0 0x7f3010197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:47.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.747+0000 7f301877b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3010101b60 0x7f3010198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:47.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.747+0000 7f301877b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3010107220 0x7f301019c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:47.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.747+0000 7f301877b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f30101108e0 con 0x7f3010101b60 2024-03-30T15:09:47.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.747+0000 7f301877b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3010110760 con 0x7f30101011a0 2024-03-30T15:09:47.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.747+0000 7f301877b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f3010110a60 con 0x7f3010107220 2024-03-30T15:09:47.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.747+0000 7f3015d16700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3010101b60 0x7f3010198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:47.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.747+0000 7f3016d18700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3010107220 0x7f301019c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:47.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.747+0000 7f3016d18700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3010107220 0x7f301019c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46166/0 (socket says 172.21.15.72:46166) 2024-03-30T15:09:47.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.747+0000 7f3015d16700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3010101b60 0x7f3010198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44968/0 (socket says 172.21.15.72:44968) 2024-03-30T15:09:47.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.747+0000 7f3016d18700 1 -- 172.21.15.72:0/1999417168 learned_addr learned my addr 172.21.15.72:0/1999417168 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T15:09:47.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.751+0000 7f3016517700 1 --2- 172.21.15.72:0/1999417168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30101011a0 0x7f3010197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:47.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.751+0000 7f3016d18700 1 -- 172.21.15.72:0/1999417168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30101011a0 msgr2=0x7f3010197ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:47.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.751+0000 7f3016d18700 1 --2- 172.21.15.72:0/1999417168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30101011a0 0x7f3010197ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:47.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.751+0000 7f3016d18700 1 -- 172.21.15.72:0/1999417168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3010101b60 msgr2=0x7f3010198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:47.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.751+0000 7f3016d18700 1 --2- 172.21.15.72:0/1999417168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3010101b60 0x7f3010198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:47.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.751+0000 7f3016d18700 1 -- 172.21.15.72:0/1999417168 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f301019cf00 con 0x7f3010107220 2024-03-30T15:09:47.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.751+0000 7f3016517700 1 --2- 172.21.15.72:0/1999417168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30101011a0 0x7f3010197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T15:09:47.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.751+0000 7f3015d16700 1 --2- 172.21.15.72:0/1999417168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3010101b60 0x7f3010198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T15:09:47.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.751+0000 7f3016d18700 1 --2- 172.21.15.72:0/1999417168 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3010107220 0x7f301019c7c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3000009fd0 tx=0x7f300000fa70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:09:47.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.751+0000 7f300f7fe700 1 -- 172.21.15.72:0/1999417168 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300001ba40 con 0x7f3010107220 2024-03-30T15:09:47.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.751+0000 7f300f7fe700 1 -- 172.21.15.72:0/1999417168 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f300000b9e0 con 0x7f3010107220 2024-03-30T15:09:47.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.751+0000 7f300f7fe700 1 -- 172.21.15.72:0/1999417168 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3000005490 con 0x7f3010107220 2024-03-30T15:09:47.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.751+0000 7f301877b700 1 -- 172.21.15.72:0/1999417168 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f301019d190 con 0x7f3010107220 2024-03-30T15:09:47.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.751+0000 7f301877b700 1 -- 172.21.15.72:0/1999417168 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3010102d50 con 0x7f3010107220 2024-03-30T15:09:47.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.751+0000 7f301877b700 1 -- 172.21.15.72:0/1999417168 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f301019d620 con 0x7f3010107220 2024-03-30T15:09:47.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.751+0000 7f300f7fe700 1 -- 172.21.15.72:0/1999417168 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 21) ==== 91831+0+0 (secure 0 0 0) 0x7f300000bb90 con 0x7f3010107220 2024-03-30T15:09:47.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.751+0000 7f300f7fe700 1 --2- 172.21.15.72:0/1999417168 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f2ff806dc40 0x7f2ff8070100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:47.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.751+0000 7f300f7fe700 1 -- 172.21.15.72:0/1999417168 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(74..74 src has 1..74) ==== 7537+0+0 (secure 0 0 0) 0x7f3000093e60 con 0x7f3010107220 2024-03-30T15:09:47.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.751+0000 7f3016517700 1 --2- 172.21.15.72:0/1999417168 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f2ff806dc40 0x7f2ff8070100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:47.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.751+0000 7f300f7fe700 1 --2- 172.21.15.72:0/1999417168 >> [v2:172.21.15.172:6816/1461064998,v1:172.21.15.172:6817/1461064998] conn(0x7f2ff8077bd0 0x7f2ff807a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:47.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.751+0000 7f300f7fe700 1 -- 172.21.15.72:0/1999417168 --> [v2:172.21.15.172:6816/1461064998,v1:172.21.15.172:6817/1461064998] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3000001d30 con 0x7f2ff8077bd0 2024-03-30T15:09:47.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.751+0000 7f300f7fe700 1 -- 172.21.15.72:0/1999417168 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f30000942f0 con 0x7f3010107220 2024-03-30T15:09:47.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.751+0000 7f3016517700 1 --2- 172.21.15.72:0/1999417168 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f2ff806dc40 0x7f2ff8070100 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3008009fd0 tx=0x7f300800b040 comp rx=0 tx=0).ready entity=mgr.14526 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:09:47.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.751+0000 7f3015d16700 1 --2- 172.21.15.72:0/1999417168 >> [v2:172.21.15.172:6816/1461064998,v1:172.21.15.172:6817/1461064998] conn(0x7f2ff8077bd0 0x7f2ff807a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:47.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.755+0000 7f3015d16700 1 --2- 172.21.15.72:0/1999417168 >> [v2:172.21.15.172:6816/1461064998,v1:172.21.15.172:6817/1461064998] conn(0x7f2ff8077bd0 0x7f2ff807a070 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:09:47.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.755+0000 7f300f7fe700 1 -- 172.21.15.72:0/1999417168 <== osd.6 v2:172.21.15.172:6816/1461064998 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3000001d30 con 0x7f2ff8077bd0 2024-03-30T15:09:47.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.771+0000 7f301877b700 1 -- 172.21.15.72:0/1999417168 --> [v2:172.21.15.172:6816/1461064998,v1:172.21.15.172:6817/1461064998] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f301006abf0 con 0x7f2ff8077bd0 2024-03-30T15:09:47.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.775+0000 7f300f7fe700 1 -- 172.21.15.72:0/1999417168 <== osd.6 v2:172.21.15.172:6816/1461064998 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f301006abf0 con 0x7f2ff8077bd0 2024-03-30T15:09:47.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.775+0000 7f301877b700 1 -- 172.21.15.72:0/1999417168 >> [v2:172.21.15.172:6816/1461064998,v1:172.21.15.172:6817/1461064998] conn(0x7f2ff8077bd0 msgr2=0x7f2ff807a070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:47.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.775+0000 7f301877b700 1 --2- 172.21.15.72:0/1999417168 >> [v2:172.21.15.172:6816/1461064998,v1:172.21.15.172:6817/1461064998] conn(0x7f2ff8077bd0 0x7f2ff807a070 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:47.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.775+0000 7f301877b700 1 -- 172.21.15.72:0/1999417168 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f2ff806dc40 msgr2=0x7f2ff8070100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:47.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.775+0000 7f301877b700 1 --2- 172.21.15.72:0/1999417168 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f2ff806dc40 0x7f2ff8070100 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3008009fd0 tx=0x7f300800b040 comp rx=0 tx=0).stop 2024-03-30T15:09:47.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.775+0000 7f301877b700 1 -- 172.21.15.72:0/1999417168 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3010107220 msgr2=0x7f301019c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:47.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.775+0000 7f301877b700 1 --2- 172.21.15.72:0/1999417168 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3010107220 0x7f301019c7c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3000009fd0 tx=0x7f300000fa70 comp rx=0 tx=0).stop 2024-03-30T15:09:47.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.775+0000 7f3016d18700 1 -- 172.21.15.72:0/1999417168 reap_dead start 2024-03-30T15:09:47.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.775+0000 7f301877b700 1 -- 172.21.15.72:0/1999417168 shutdown_connections 2024-03-30T15:09:47.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.775+0000 7f301877b700 1 -- 172.21.15.72:0/1999417168 >> 172.21.15.72:0/1999417168 conn(0x7f30100771e0 msgr2=0x7f3010069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:09:47.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.775+0000 7f301877b700 1 -- 172.21.15.72:0/1999417168 shutdown_connections 2024-03-30T15:09:47.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:47.775+0000 7f301877b700 1 -- 172.21.15.72:0/1999417168 wait complete. 2024-03-30T15:09:48.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.151+0000 7f58f8def700 1 -- 172.21.15.72:0/672030963 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f58f4106290 msgr2=0x7f58f4106670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:48.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.151+0000 7f58f8def700 1 --2- 172.21.15.72:0/672030963 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f58f4106290 0x7f58f4106670 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f58e4009990 tx=0x7f58e4009ca0 comp rx=0 tx=0).stop 2024-03-30T15:09:48.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.151+0000 7f58f8def700 1 -- 172.21.15.72:0/672030963 shutdown_connections 2024-03-30T15:09:48.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.151+0000 7f58f8def700 1 --2- 172.21.15.72:0/672030963 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58f4102710 0x7f58f410df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:48.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.151+0000 7f58f8def700 1 --2- 172.21.15.72:0/672030963 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f58f4106290 0x7f58f4106670 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:48.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.151+0000 7f58f8def700 1 --2- 172.21.15.72:0/672030963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58f4101d50 0x7f58f41021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:48.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.151+0000 7f58f8def700 1 -- 172.21.15.72:0/672030963 >> 172.21.15.72:0/672030963 conn(0x7f58f40782b0 msgr2=0x7f58f40fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:09:48.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.151+0000 7f58f8def700 1 -- 172.21.15.72:0/672030963 shutdown_connections 2024-03-30T15:09:48.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.151+0000 7f58f8def700 1 -- 172.21.15.72:0/672030963 wait complete. 2024-03-30T15:09:48.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.155+0000 7f58f8def700 1 Processor -- start 2024-03-30T15:09:48.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.155+0000 7f58f8def700 1 -- start start 2024-03-30T15:09:48.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.155+0000 7f58f8def700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58f4101d50 0x7f58f4197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:48.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.155+0000 7f58f8def700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58f4102710 0x7f58f4198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:48.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.155+0000 7f58f8def700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f58f4106290 0x7f58f419c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:48.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.155+0000 7f58f8def700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f58f4111ad0 con 0x7f58f4102710 2024-03-30T15:09:48.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.155+0000 7f58f8def700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f58f4111950 con 0x7f58f4101d50 2024-03-30T15:09:48.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.155+0000 7f58f8def700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f58f4111c50 con 0x7f58f4106290 2024-03-30T15:09:48.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.155+0000 7f58f2d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f58f4106290 0x7f58f419c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:48.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.155+0000 7f58f1d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58f4102710 0x7f58f4198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:48.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.155+0000 7f58f2d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f58f4106290 0x7f58f419c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46196/0 (socket says 172.21.15.72:46196) 2024-03-30T15:09:48.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.155+0000 7f58f2d9d700 1 -- 172.21.15.72:0/3220762190 learned_addr learned my addr 172.21.15.72:0/3220762190 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T15:09:48.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.155+0000 7f58f259c700 1 --2- 172.21.15.72:0/3220762190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58f4101d50 0x7f58f4197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:48.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.155+0000 7f58f2d9d700 1 -- 172.21.15.72:0/3220762190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58f4101d50 msgr2=0x7f58f4197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:48.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.155+0000 7f58f2d9d700 1 --2- 172.21.15.72:0/3220762190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58f4101d50 0x7f58f4197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:48.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.155+0000 7f58f2d9d700 1 -- 172.21.15.72:0/3220762190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58f4102710 msgr2=0x7f58f4198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:48.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.155+0000 7f58f2d9d700 1 --2- 172.21.15.72:0/3220762190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58f4102710 0x7f58f4198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:48.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.155+0000 7f58f2d9d700 1 -- 172.21.15.72:0/3220762190 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58f419cf30 con 0x7f58f4106290 2024-03-30T15:09:48.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.155+0000 7f58f259c700 1 --2- 172.21.15.72:0/3220762190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58f4101d50 0x7f58f4197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T15:09:48.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.155+0000 7f58f1d9b700 1 --2- 172.21.15.72:0/3220762190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58f4102710 0x7f58f4198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T15:09:48.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.155+0000 7f58f2d9d700 1 --2- 172.21.15.72:0/3220762190 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f58f4106290 0x7f58f419c7f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f58ec00c370 tx=0x7f58ec00c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:09:48.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.155+0000 7f58e37fe700 1 -- 172.21.15.72:0/3220762190 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ec0090d0 con 0x7f58f4106290 2024-03-30T15:09:48.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.155+0000 7f58f8def700 1 -- 172.21.15.72:0/3220762190 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58f419d1c0 con 0x7f58f4106290 2024-03-30T15:09:48.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.155+0000 7f58e37fe700 1 -- 172.21.15.72:0/3220762190 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f58ec009270 con 0x7f58f4106290 2024-03-30T15:09:48.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.155+0000 7f58e37fe700 1 -- 172.21.15.72:0/3220762190 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ec004710 con 0x7f58f4106290 2024-03-30T15:09:48.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.155+0000 7f58f8def700 1 -- 172.21.15.72:0/3220762190 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f58f41a4aa0 con 0x7f58f4106290 2024-03-30T15:09:48.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.155+0000 7f58f8def700 1 -- 172.21.15.72:0/3220762190 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f58f4062950 con 0x7f58f4106290 2024-03-30T15:09:48.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.155+0000 7f58e37fe700 1 -- 172.21.15.72:0/3220762190 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 21) ==== 91831+0+0 (secure 0 0 0) 0x7f58ec01a020 con 0x7f58f4106290 2024-03-30T15:09:48.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.155+0000 7f58e37fe700 1 --2- 172.21.15.72:0/3220762190 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f58dc06dc40 0x7f58dc070100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:48.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.155+0000 7f58e37fe700 1 -- 172.21.15.72:0/3220762190 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(74..74 src has 1..74) ==== 7537+0+0 (secure 0 0 0) 0x7f58ec08da60 con 0x7f58f4106290 2024-03-30T15:09:48.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.155+0000 7f58f259c700 1 --2- 172.21.15.72:0/3220762190 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f58dc06dc40 0x7f58dc070100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:48.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.155+0000 7f58e37fe700 1 --2- 172.21.15.72:0/3220762190 >> [v2:172.21.15.72:6810/2191896250,v1:172.21.15.72:6811/2191896250] conn(0x7f58dc077b50 0x7f58dc079ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:48.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.155+0000 7f58e37fe700 1 -- 172.21.15.72:0/3220762190 --> [v2:172.21.15.72:6810/2191896250,v1:172.21.15.72:6811/2191896250] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f58dc07a6c0 con 0x7f58dc077b50 2024-03-30T15:09:48.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.155+0000 7f58e37fe700 1 -- 172.21.15.72:0/3220762190 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f58ec0922c0 con 0x7f58f4106290 2024-03-30T15:09:48.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.155+0000 7f58f1d9b700 1 --2- 172.21.15.72:0/3220762190 >> [v2:172.21.15.72:6810/2191896250,v1:172.21.15.72:6811/2191896250] conn(0x7f58dc077b50 0x7f58dc079ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:48.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.159+0000 7f58f259c700 1 --2- 172.21.15.72:0/3220762190 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f58dc06dc40 0x7f58dc070100 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f58e400b2e0 tx=0x7f58e401a040 comp rx=0 tx=0).ready entity=mgr.14526 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:09:48.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.159+0000 7f58f1d9b700 1 --2- 172.21.15.72:0/3220762190 >> [v2:172.21.15.72:6810/2191896250,v1:172.21.15.72:6811/2191896250] conn(0x7f58dc077b50 0x7f58dc079ff0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:09:48.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.159+0000 7f58e37fe700 1 -- 172.21.15.72:0/3220762190 <== osd.1 v2:172.21.15.72:6810/2191896250 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f58dc07a6c0 con 0x7f58dc077b50 2024-03-30T15:09:48.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.175+0000 7f58f8def700 1 -- 172.21.15.72:0/3220762190 --> [v2:172.21.15.72:6810/2191896250,v1:172.21.15.72:6811/2191896250] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f58f4062d50 con 0x7f58dc077b50 2024-03-30T15:09:48.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.175+0000 7f58e37fe700 1 -- 172.21.15.72:0/3220762190 <== osd.1 v2:172.21.15.72:6810/2191896250 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f58f4062d50 con 0x7f58dc077b50 2024-03-30T15:09:48.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.175+0000 7f58f8def700 1 -- 172.21.15.72:0/3220762190 >> [v2:172.21.15.72:6810/2191896250,v1:172.21.15.72:6811/2191896250] conn(0x7f58dc077b50 msgr2=0x7f58dc079ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:48.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.175+0000 7f58f8def700 1 --2- 172.21.15.72:0/3220762190 >> [v2:172.21.15.72:6810/2191896250,v1:172.21.15.72:6811/2191896250] conn(0x7f58dc077b50 0x7f58dc079ff0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:48.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.175+0000 7f58f8def700 1 -- 172.21.15.72:0/3220762190 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f58dc06dc40 msgr2=0x7f58dc070100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:48.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.175+0000 7f58f8def700 1 --2- 172.21.15.72:0/3220762190 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f58dc06dc40 0x7f58dc070100 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f58e400b2e0 tx=0x7f58e401a040 comp rx=0 tx=0).stop 2024-03-30T15:09:48.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.175+0000 7f58f8def700 1 -- 172.21.15.72:0/3220762190 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f58f4106290 msgr2=0x7f58f419c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:48.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.175+0000 7f58f8def700 1 --2- 172.21.15.72:0/3220762190 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f58f4106290 0x7f58f419c7f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f58ec00c370 tx=0x7f58ec00c730 comp rx=0 tx=0).stop 2024-03-30T15:09:48.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.175+0000 7f58f2d9d700 1 -- 172.21.15.72:0/3220762190 reap_dead start 2024-03-30T15:09:48.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.175+0000 7f58f8def700 1 -- 172.21.15.72:0/3220762190 shutdown_connections 2024-03-30T15:09:48.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.175+0000 7f58f8def700 1 -- 172.21.15.72:0/3220762190 >> 172.21.15.72:0/3220762190 conn(0x7f58f40782b0 msgr2=0x7f58f40fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:09:48.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.175+0000 7f58f8def700 1 -- 172.21.15.72:0/3220762190 shutdown_connections 2024-03-30T15:09:48.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:48.175+0000 7f58f8def700 1 -- 172.21.15.72:0/3220762190 wait complete. 2024-03-30T15:09:49.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.011+0000 7f094300c700 1 -- 172.21.15.72:0/1344265748 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f093c1076a0 msgr2=0x7f093c10f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:49.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.011+0000 7f094300c700 1 --2- 172.21.15.72:0/1344265748 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f093c1076a0 0x7f093c10f1c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f093400b0a0 tx=0x7f093400b3b0 comp rx=0 tx=0).stop 2024-03-30T15:09:49.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.011+0000 7f094300c700 1 -- 172.21.15.72:0/1344265748 shutdown_connections 2024-03-30T15:09:49.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.011+0000 7f094300c700 1 --2- 172.21.15.72:0/1344265748 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f093c1076a0 0x7f093c10f1c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:49.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.011+0000 7f094300c700 1 --2- 172.21.15.72:0/1344265748 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f093c100550 0x7f093c100930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:49.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.011+0000 7f094300c700 1 --2- 172.21.15.72:0/1344265748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f093c100f00 0x7f093c106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:49.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.011+0000 7f094300c700 1 -- 172.21.15.72:0/1344265748 >> 172.21.15.72:0/1344265748 conn(0x7f093c0782b0 msgr2=0x7f093c0fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:09:49.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.011+0000 7f094300c700 1 -- 172.21.15.72:0/1344265748 shutdown_connections 2024-03-30T15:09:49.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.011+0000 7f094300c700 1 -- 172.21.15.72:0/1344265748 wait complete. 2024-03-30T15:09:49.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.011+0000 7f094300c700 1 Processor -- start 2024-03-30T15:09:49.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.011+0000 7f094300c700 1 -- start start 2024-03-30T15:09:49.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.011+0000 7f094300c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f093c100550 0x7f093c197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:49.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.011+0000 7f094300c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f093c100f00 0x7f093c198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:49.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.011+0000 7f094300c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f093c1076a0 0x7f093c19c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:49.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.011+0000 7f094300c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f093c1119e0 con 0x7f093c1076a0 2024-03-30T15:09:49.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.011+0000 7f094300c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f093c111860 con 0x7f093c100f00 2024-03-30T15:09:49.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.011+0000 7f094300c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f093c111b60 con 0x7f093c100550 2024-03-30T15:09:49.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.011+0000 7f0940da8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f093c100550 0x7f093c197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:49.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.011+0000 7f09415a9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f093c1076a0 0x7f093c19c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:49.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.011+0000 7f0940da8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f093c100550 0x7f093c197e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46214/0 (socket says 172.21.15.72:46214) 2024-03-30T15:09:49.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.011+0000 7f0940da8700 1 -- 172.21.15.72:0/2409641368 learned_addr learned my addr 172.21.15.72:0/2409641368 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T15:09:49.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.011+0000 7f093bfff700 1 --2- 172.21.15.72:0/2409641368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f093c100f00 0x7f093c198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:49.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.011+0000 7f0940da8700 1 -- 172.21.15.72:0/2409641368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f093c100f00 msgr2=0x7f093c198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:49.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.011+0000 7f0940da8700 1 --2- 172.21.15.72:0/2409641368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f093c100f00 0x7f093c198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:49.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.011+0000 7f0940da8700 1 -- 172.21.15.72:0/2409641368 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f093c1076a0 msgr2=0x7f093c19c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:49.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.011+0000 7f0940da8700 1 --2- 172.21.15.72:0/2409641368 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f093c1076a0 0x7f093c19c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:49.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.011+0000 7f0940da8700 1 -- 172.21.15.72:0/2409641368 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f093c19ce50 con 0x7f093c100550 2024-03-30T15:09:49.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.011+0000 7f0940da8700 1 --2- 172.21.15.72:0/2409641368 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f093c100550 0x7f093c197e40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f093000e970 tx=0x7f093000ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:09:49.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.011+0000 7f0939ffb700 1 -- 172.21.15.72:0/2409641368 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f093000cbd0 con 0x7f093c100550 2024-03-30T15:09:49.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.011+0000 7f094300c700 1 -- 172.21.15.72:0/2409641368 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f093c19d140 con 0x7f093c100550 2024-03-30T15:09:49.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.011+0000 7f0939ffb700 1 -- 172.21.15.72:0/2409641368 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f09300044a0 con 0x7f093c100550 2024-03-30T15:09:49.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.011+0000 7f0939ffb700 1 -- 172.21.15.72:0/2409641368 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0930003c70 con 0x7f093c100550 2024-03-30T15:09:49.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.011+0000 7f094300c700 1 -- 172.21.15.72:0/2409641368 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f093c1a49c0 con 0x7f093c100550 2024-03-30T15:09:49.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.011+0000 7f094300c700 1 -- 172.21.15.72:0/2409641368 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f093c105930 con 0x7f093c100550 2024-03-30T15:09:49.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.015+0000 7f0939ffb700 1 -- 172.21.15.72:0/2409641368 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 21) ==== 91831+0+0 (secure 0 0 0) 0x7f0930003e10 con 0x7f093c100550 2024-03-30T15:09:49.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.015+0000 7f0939ffb700 1 --2- 172.21.15.72:0/2409641368 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f092406dc40 0x7f0924070100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:49.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.015+0000 7f0939ffb700 1 -- 172.21.15.72:0/2409641368 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(74..74 src has 1..74) ==== 7537+0+0 (secure 0 0 0) 0x7f093008e2a0 con 0x7f093c100550 2024-03-30T15:09:49.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.015+0000 7f093bfff700 1 --2- 172.21.15.72:0/2409641368 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f092406dc40 0x7f0924070100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:49.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.015+0000 7f0939ffb700 1 --2- 172.21.15.72:0/2409641368 >> [v2:172.21.15.72:6826/350059956,v1:172.21.15.72:6827/350059956] conn(0x7f0924077bd0 0x7f092407a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:49.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.015+0000 7f0939ffb700 1 -- 172.21.15.72:0/2409641368 --> [v2:172.21.15.72:6826/350059956,v1:172.21.15.72:6827/350059956] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f093001ee50 con 0x7f0924077bd0 2024-03-30T15:09:49.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.015+0000 7f0939ffb700 1 -- 172.21.15.72:0/2409641368 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f0930095050 con 0x7f093c100550 2024-03-30T15:09:49.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.015+0000 7f09415a9700 1 --2- 172.21.15.72:0/2409641368 >> [v2:172.21.15.72:6826/350059956,v1:172.21.15.72:6827/350059956] conn(0x7f0924077bd0 0x7f092407a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:49.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.015+0000 7f093bfff700 1 --2- 172.21.15.72:0/2409641368 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f092406dc40 0x7f0924070100 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f092c005fd0 tx=0x7f092c00af20 comp rx=0 tx=0).ready entity=mgr.14526 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:09:49.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.015+0000 7f09415a9700 1 --2- 172.21.15.72:0/2409641368 >> [v2:172.21.15.72:6826/350059956,v1:172.21.15.72:6827/350059956] conn(0x7f0924077bd0 0x7f092407a070 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:09:49.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.015+0000 7f0939ffb700 1 -- 172.21.15.72:0/2409641368 <== osd.3 v2:172.21.15.72:6826/350059956 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f093001ee50 con 0x7f0924077bd0 2024-03-30T15:09:49.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.031+0000 7f094300c700 1 -- 172.21.15.72:0/2409641368 --> [v2:172.21.15.72:6826/350059956,v1:172.21.15.72:6827/350059956] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f093c1017b0 con 0x7f0924077bd0 2024-03-30T15:09:49.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.031+0000 7f0939ffb700 1 -- 172.21.15.72:0/2409641368 <== osd.3 v2:172.21.15.72:6826/350059956 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f093c1017b0 con 0x7f0924077bd0 2024-03-30T15:09:49.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.035+0000 7f094300c700 1 -- 172.21.15.72:0/2409641368 >> [v2:172.21.15.72:6826/350059956,v1:172.21.15.72:6827/350059956] conn(0x7f0924077bd0 msgr2=0x7f092407a070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:49.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.035+0000 7f094300c700 1 --2- 172.21.15.72:0/2409641368 >> [v2:172.21.15.72:6826/350059956,v1:172.21.15.72:6827/350059956] conn(0x7f0924077bd0 0x7f092407a070 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:49.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.035+0000 7f094300c700 1 -- 172.21.15.72:0/2409641368 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f092406dc40 msgr2=0x7f0924070100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:49.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.035+0000 7f094300c700 1 --2- 172.21.15.72:0/2409641368 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f092406dc40 0x7f0924070100 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f092c005fd0 tx=0x7f092c00af20 comp rx=0 tx=0).stop 2024-03-30T15:09:49.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.035+0000 7f094300c700 1 -- 172.21.15.72:0/2409641368 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f093c100550 msgr2=0x7f093c197e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:49.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.035+0000 7f094300c700 1 --2- 172.21.15.72:0/2409641368 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f093c100550 0x7f093c197e40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f093000e970 tx=0x7f093000ec80 comp rx=0 tx=0).stop 2024-03-30T15:09:49.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.035+0000 7f09415a9700 1 -- 172.21.15.72:0/2409641368 reap_dead start 2024-03-30T15:09:49.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.035+0000 7f094300c700 1 -- 172.21.15.72:0/2409641368 shutdown_connections 2024-03-30T15:09:49.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.035+0000 7f094300c700 1 -- 172.21.15.72:0/2409641368 >> 172.21.15.72:0/2409641368 conn(0x7f093c0782b0 msgr2=0x7f093c104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:09:49.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.035+0000 7f094300c700 1 -- 172.21.15.72:0/2409641368 shutdown_connections 2024-03-30T15:09:49.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.035+0000 7f094300c700 1 -- 172.21.15.72:0/2409641368 wait complete. 2024-03-30T15:09:49.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:48 smithi072 bash[21573]: cluster 2024-03-30T15:09:47.770056+0000 mgr.y (mgr.14526) 82 : cluster 0 pgmap v42: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:49.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:48 smithi072 bash[28946]: cluster 2024-03-30T15:09:47.770056+0000 mgr.y (mgr.14526) 82 : cluster 0 pgmap v42: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:49.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:48 smithi172 bash[23680]: cluster 2024-03-30T15:09:47.770056+0000 mgr.y (mgr.14526) 82 : cluster 0 pgmap v42: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:49.362 INFO:teuthology.orchestra.run.smithi072.stdout:34359738479 2024-03-30T15:09:49.363 DEBUG:teuthology.orchestra.run.smithi072:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.0 2024-03-30T15:09:49.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.411+0000 7f3941591700 1 -- 172.21.15.72:0/4231439194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f393c1011a0 msgr2=0x7f393c101620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:49.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.411+0000 7f3941591700 1 --2- 172.21.15.72:0/4231439194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f393c1011a0 0x7f393c101620 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3930009990 tx=0x7f3930009ca0 comp rx=0 tx=0).stop 2024-03-30T15:09:49.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.411+0000 7f3941591700 1 -- 172.21.15.72:0/4231439194 shutdown_connections 2024-03-30T15:09:49.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.411+0000 7f3941591700 1 --2- 172.21.15.72:0/4231439194 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f393c101b60 0x7f393c10dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:49.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.411+0000 7f3941591700 1 --2- 172.21.15.72:0/4231439194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f393c107220 0x7f393c107600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:49.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.411+0000 7f3941591700 1 --2- 172.21.15.72:0/4231439194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f393c1011a0 0x7f393c101620 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:49.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.411+0000 7f3941591700 1 -- 172.21.15.72:0/4231439194 >> 172.21.15.72:0/4231439194 conn(0x7f393c0771e0 msgr2=0x7f393c0775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:09:49.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.411+0000 7f3941591700 1 -- 172.21.15.72:0/4231439194 shutdown_connections 2024-03-30T15:09:49.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.411+0000 7f3941591700 1 -- 172.21.15.72:0/4231439194 wait complete. 2024-03-30T15:09:49.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.415+0000 7f3941591700 1 Processor -- start 2024-03-30T15:09:49.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.415+0000 7f3941591700 1 -- start start 2024-03-30T15:09:49.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.415+0000 7f3941591700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f393c1011a0 0x7f393c102e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:49.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.415+0000 7f3941591700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f393c101b60 0x7f393c103360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:49.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.415+0000 7f3941591700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f393c107220 0x7f393c1038a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:49.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.415+0000 7f3941591700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f393c1108e0 con 0x7f393c101b60 2024-03-30T15:09:49.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.415+0000 7f3941591700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f393c110760 con 0x7f393c1011a0 2024-03-30T15:09:49.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.415+0000 7f3941591700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f393c110a60 con 0x7f393c107220 2024-03-30T15:09:49.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.415+0000 7f393a7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f393c101b60 0x7f393c103360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:49.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.415+0000 7f393a7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f393c101b60 0x7f393c103360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45008/0 (socket says 172.21.15.72:45008) 2024-03-30T15:09:49.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.415+0000 7f393a7fc700 1 -- 172.21.15.72:0/1092296999 learned_addr learned my addr 172.21.15.72:0/1092296999 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T15:09:49.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.415+0000 7f393b7fe700 1 --2- 172.21.15.72:0/1092296999 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f393c107220 0x7f393c1038a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:49.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.415+0000 7f393affd700 1 --2- 172.21.15.72:0/1092296999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f393c1011a0 0x7f393c102e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:49.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.415+0000 7f393a7fc700 1 -- 172.21.15.72:0/1092296999 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f393c107220 msgr2=0x7f393c1038a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:49.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.415+0000 7f393a7fc700 1 --2- 172.21.15.72:0/1092296999 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f393c107220 0x7f393c1038a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:49.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.415+0000 7f393a7fc700 1 -- 172.21.15.72:0/1092296999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f393c1011a0 msgr2=0x7f393c102e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:49.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.415+0000 7f393a7fc700 1 --2- 172.21.15.72:0/1092296999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f393c1011a0 0x7f393c102e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:49.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.415+0000 7f393a7fc700 1 -- 172.21.15.72:0/1092296999 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f393c1a63c0 con 0x7f393c101b60 2024-03-30T15:09:49.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.415+0000 7f393a7fc700 1 --2- 172.21.15.72:0/1092296999 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f393c101b60 0x7f393c103360 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f39300057c0 tx=0x7f39300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:09:49.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.415+0000 7f3923fff700 1 -- 172.21.15.72:0/1092296999 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3930026070 con 0x7f393c101b60 2024-03-30T15:09:49.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.415+0000 7f3923fff700 1 -- 172.21.15.72:0/1092296999 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f393000fbf0 con 0x7f393c101b60 2024-03-30T15:09:49.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.415+0000 7f3941591700 1 -- 172.21.15.72:0/1092296999 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f393c1a6650 con 0x7f393c101b60 2024-03-30T15:09:49.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.415+0000 7f3923fff700 1 -- 172.21.15.72:0/1092296999 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39300173f0 con 0x7f393c101b60 2024-03-30T15:09:49.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.415+0000 7f3941591700 1 -- 172.21.15.72:0/1092296999 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f393c1a6b80 con 0x7f393c101b60 2024-03-30T15:09:49.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.415+0000 7f3941591700 1 -- 172.21.15.72:0/1092296999 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f393c100790 con 0x7f393c101b60 2024-03-30T15:09:49.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.415+0000 7f3923fff700 1 -- 172.21.15.72:0/1092296999 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 21) ==== 91831+0+0 (secure 0 0 0) 0x7f3930029070 con 0x7f393c101b60 2024-03-30T15:09:49.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.415+0000 7f3923fff700 1 --2- 172.21.15.72:0/1092296999 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f392406dc40 0x7f3924070100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:49.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.415+0000 7f3923fff700 1 -- 172.21.15.72:0/1092296999 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7537+0+0 (secure 0 0 0) 0x7f393008ef30 con 0x7f393c101b60 2024-03-30T15:09:49.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.415+0000 7f393affd700 1 --2- 172.21.15.72:0/1092296999 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f392406dc40 0x7f3924070100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:49.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.419+0000 7f3923fff700 1 --2- 172.21.15.72:0/1092296999 >> [v2:172.21.15.172:6800/3807833251,v1:172.21.15.172:6801/3807833251] conn(0x7f3924077bd0 0x7f392407a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:49.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.419+0000 7f3923fff700 1 -- 172.21.15.72:0/1092296999 --> [v2:172.21.15.172:6800/3807833251,v1:172.21.15.172:6801/3807833251] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f392407a740 con 0x7f3924077bd0 2024-03-30T15:09:49.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.419+0000 7f3923fff700 1 -- 172.21.15.72:0/1092296999 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f3930091630 con 0x7f393c101b60 2024-03-30T15:09:49.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.419+0000 7f393affd700 1 --2- 172.21.15.72:0/1092296999 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f392406dc40 0x7f3924070100 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f392c005fd0 tx=0x7f392c005db0 comp rx=0 tx=0).ready entity=mgr.14526 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:09:49.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.419+0000 7f393b7fe700 1 --2- 172.21.15.72:0/1092296999 >> [v2:172.21.15.172:6800/3807833251,v1:172.21.15.172:6801/3807833251] conn(0x7f3924077bd0 0x7f392407a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:49.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.419+0000 7f393b7fe700 1 --2- 172.21.15.72:0/1092296999 >> [v2:172.21.15.172:6800/3807833251,v1:172.21.15.172:6801/3807833251] conn(0x7f3924077bd0 0x7f392407a070 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:09:49.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.419+0000 7f3923fff700 1 -- 172.21.15.72:0/1092296999 <== osd.4 v2:172.21.15.172:6800/3807833251 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f392407a740 con 0x7f3924077bd0 2024-03-30T15:09:49.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.439+0000 7f3941591700 1 -- 172.21.15.72:0/1092296999 --> [v2:172.21.15.172:6800/3807833251,v1:172.21.15.172:6801/3807833251] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f393c102860 con 0x7f3924077bd0 2024-03-30T15:09:49.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.439+0000 7f3923fff700 1 -- 172.21.15.72:0/1092296999 <== osd.4 v2:172.21.15.172:6800/3807833251 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f393c102860 con 0x7f3924077bd0 2024-03-30T15:09:49.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.439+0000 7f3941591700 1 -- 172.21.15.72:0/1092296999 >> [v2:172.21.15.172:6800/3807833251,v1:172.21.15.172:6801/3807833251] conn(0x7f3924077bd0 msgr2=0x7f392407a070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:49.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.439+0000 7f3941591700 1 --2- 172.21.15.72:0/1092296999 >> [v2:172.21.15.172:6800/3807833251,v1:172.21.15.172:6801/3807833251] conn(0x7f3924077bd0 0x7f392407a070 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:49.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.439+0000 7f3941591700 1 -- 172.21.15.72:0/1092296999 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f392406dc40 msgr2=0x7f3924070100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:49.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.439+0000 7f3941591700 1 --2- 172.21.15.72:0/1092296999 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f392406dc40 0x7f3924070100 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f392c005fd0 tx=0x7f392c005db0 comp rx=0 tx=0).stop 2024-03-30T15:09:49.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.439+0000 7f3941591700 1 -- 172.21.15.72:0/1092296999 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f393c101b60 msgr2=0x7f393c103360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:49.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.439+0000 7f3941591700 1 --2- 172.21.15.72:0/1092296999 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f393c101b60 0x7f393c103360 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f39300057c0 tx=0x7f39300057f0 comp rx=0 tx=0).stop 2024-03-30T15:09:49.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.439+0000 7f393b7fe700 1 -- 172.21.15.72:0/1092296999 reap_dead start 2024-03-30T15:09:49.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.439+0000 7f3941591700 1 -- 172.21.15.72:0/1092296999 shutdown_connections 2024-03-30T15:09:49.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.439+0000 7f3941591700 1 -- 172.21.15.72:0/1092296999 >> 172.21.15.72:0/1092296999 conn(0x7f393c0771e0 msgr2=0x7f393c0ffdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:09:49.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.439+0000 7f3941591700 1 -- 172.21.15.72:0/1092296999 shutdown_connections 2024-03-30T15:09:49.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:49.439+0000 7f3941591700 1 -- 172.21.15.72:0/1092296999 wait complete. 2024-03-30T15:09:50.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.427+0000 7fe24d470700 1 -- 172.21.15.72:0/2965218411 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe248102320 msgr2=0x7fe2481027a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:50.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.427+0000 7fe24d470700 1 --2- 172.21.15.72:0/2965218411 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe248102320 0x7fe2481027a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe23000b0a0 tx=0x7fe23000b3b0 comp rx=0 tx=0).stop 2024-03-30T15:09:50.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.427+0000 7fe24d470700 1 -- 172.21.15.72:0/2965218411 shutdown_connections 2024-03-30T15:09:50.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.427+0000 7fe24d470700 1 --2- 172.21.15.72:0/2965218411 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe248102ce0 0x7fe24810f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:50.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.427+0000 7fe24d470700 1 --2- 172.21.15.72:0/2965218411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe248108390 0x7fe248108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:50.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.427+0000 7fe24d470700 1 --2- 172.21.15.72:0/2965218411 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe248102320 0x7fe2481027a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:50.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.427+0000 7fe24d470700 1 -- 172.21.15.72:0/2965218411 >> 172.21.15.72:0/2965218411 conn(0x7fe248079310 msgr2=0x7fe248079720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:09:50.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.427+0000 7fe24d470700 1 -- 172.21.15.72:0/2965218411 shutdown_connections 2024-03-30T15:09:50.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.427+0000 7fe24d470700 1 -- 172.21.15.72:0/2965218411 wait complete. 2024-03-30T15:09:50.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.427+0000 7fe24d470700 1 Processor -- start 2024-03-30T15:09:50.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.427+0000 7fe24d470700 1 -- start start 2024-03-30T15:09:50.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.427+0000 7fe24d470700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe248102320 0x7fe248198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:50.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.427+0000 7fe24d470700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe248102ce0 0x7fe248198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:50.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.427+0000 7fe24d470700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe248108390 0x7fe24819c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:50.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.427+0000 7fe24d470700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe248111b00 con 0x7fe248108390 2024-03-30T15:09:50.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.427+0000 7fe24d470700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe248111980 con 0x7fe248102320 2024-03-30T15:09:50.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.427+0000 7fe24d470700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fe248111c80 con 0x7fe248102ce0 2024-03-30T15:09:50.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.427+0000 7fe2477fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe248108390 0x7fe24819c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:50.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.427+0000 7fe2467fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe248102ce0 0x7fe248198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:50.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.427+0000 7fe2477fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe248108390 0x7fe24819c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45028/0 (socket says 172.21.15.72:45028) 2024-03-30T15:09:50.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.427+0000 7fe2477fe700 1 -- 172.21.15.72:0/3340375375 learned_addr learned my addr 172.21.15.72:0/3340375375 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T15:09:50.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.427+0000 7fe246ffd700 1 --2- 172.21.15.72:0/3340375375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe248102320 0x7fe248198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:50.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.427+0000 7fe2467fc700 1 -- 172.21.15.72:0/3340375375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe248102320 msgr2=0x7fe248198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:50.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.427+0000 7fe2467fc700 1 --2- 172.21.15.72:0/3340375375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe248102320 0x7fe248198040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:50.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.427+0000 7fe2467fc700 1 -- 172.21.15.72:0/3340375375 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe248108390 msgr2=0x7fe24819c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:50.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.427+0000 7fe2467fc700 1 --2- 172.21.15.72:0/3340375375 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe248108390 0x7fe24819c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:50.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.427+0000 7fe2467fc700 1 -- 172.21.15.72:0/3340375375 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe24819d000 con 0x7fe248102ce0 2024-03-30T15:09:50.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.427+0000 7fe2477fe700 1 --2- 172.21.15.72:0/3340375375 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe248108390 0x7fe24819c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T15:09:50.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.427+0000 7fe2467fc700 1 --2- 172.21.15.72:0/3340375375 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe248102ce0 0x7fe248198580 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe23000b070 tx=0x7fe230007a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:09:50.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.427+0000 7fe23ffff700 1 -- 172.21.15.72:0/3340375375 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe230021020 con 0x7fe248102ce0 2024-03-30T15:09:50.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.427+0000 7fe23ffff700 1 -- 172.21.15.72:0/3340375375 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7fe230004c50 con 0x7fe248102ce0 2024-03-30T15:09:50.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.427+0000 7fe24d470700 1 -- 172.21.15.72:0/3340375375 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe24819d290 con 0x7fe248102ce0 2024-03-30T15:09:50.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.427+0000 7fe23ffff700 1 -- 172.21.15.72:0/3340375375 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe230005050 con 0x7fe248102ce0 2024-03-30T15:09:50.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.427+0000 7fe24d470700 1 -- 172.21.15.72:0/3340375375 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2481a4b70 con 0x7fe248102ce0 2024-03-30T15:09:50.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.427+0000 7fe24d470700 1 -- 172.21.15.72:0/3340375375 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe228000fb0 con 0x7fe248102ce0 2024-03-30T15:09:50.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.427+0000 7fe23ffff700 1 -- 172.21.15.72:0/3340375375 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 21) ==== 91831+0+0 (secure 0 0 0) 0x7fe230024020 con 0x7fe248102ce0 2024-03-30T15:09:50.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.431+0000 7fe23ffff700 1 --2- 172.21.15.72:0/3340375375 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fe23406dc40 0x7fe234070100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:50.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.431+0000 7fe23ffff700 1 -- 172.21.15.72:0/3340375375 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(74..74 src has 1..74) ==== 7537+0+0 (secure 0 0 0) 0x7fe23000f020 con 0x7fe248102ce0 2024-03-30T15:09:50.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.431+0000 7fe246ffd700 1 --2- 172.21.15.72:0/3340375375 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fe23406dc40 0x7fe234070100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:50.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.431+0000 7fe23ffff700 1 --2- 172.21.15.72:0/3340375375 >> [v2:172.21.15.172:6824/1721454347,v1:172.21.15.172:6825/1721454347] conn(0x7fe234077b50 0x7fe234079ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:50.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.431+0000 7fe23ffff700 1 -- 172.21.15.72:0/3340375375 --> [v2:172.21.15.172:6824/1721454347,v1:172.21.15.172:6825/1721454347] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe230005a50 con 0x7fe234077b50 2024-03-30T15:09:50.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.431+0000 7fe23ffff700 1 -- 172.21.15.72:0/3340375375 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fe2300915f0 con 0x7fe248102ce0 2024-03-30T15:09:50.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.431+0000 7fe246ffd700 1 --2- 172.21.15.72:0/3340375375 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fe23406dc40 0x7fe234070100 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe238006fd0 tx=0x7fe238008040 comp rx=0 tx=0).ready entity=mgr.14526 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:09:50.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.431+0000 7fe2477fe700 1 --2- 172.21.15.72:0/3340375375 >> [v2:172.21.15.172:6824/1721454347,v1:172.21.15.172:6825/1721454347] conn(0x7fe234077b50 0x7fe234079ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:50.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.431+0000 7fe2477fe700 1 --2- 172.21.15.72:0/3340375375 >> [v2:172.21.15.172:6824/1721454347,v1:172.21.15.172:6825/1721454347] conn(0x7fe234077b50 0x7fe234079ff0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:09:50.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.431+0000 7fe23ffff700 1 -- 172.21.15.72:0/3340375375 <== osd.7 v2:172.21.15.172:6824/1721454347 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe230005a50 con 0x7fe234077b50 2024-03-30T15:09:50.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.451+0000 7fe24d470700 1 -- 172.21.15.72:0/3340375375 --> [v2:172.21.15.172:6824/1721454347,v1:172.21.15.172:6825/1721454347] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe228002d30 con 0x7fe234077b50 2024-03-30T15:09:50.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.451+0000 7fe23ffff700 1 -- 172.21.15.72:0/3340375375 <== osd.7 v2:172.21.15.172:6824/1721454347 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe228002d30 con 0x7fe234077b50 2024-03-30T15:09:50.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.451+0000 7fe24d470700 1 -- 172.21.15.72:0/3340375375 >> [v2:172.21.15.172:6824/1721454347,v1:172.21.15.172:6825/1721454347] conn(0x7fe234077b50 msgr2=0x7fe234079ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:50.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.451+0000 7fe24d470700 1 --2- 172.21.15.72:0/3340375375 >> [v2:172.21.15.172:6824/1721454347,v1:172.21.15.172:6825/1721454347] conn(0x7fe234077b50 0x7fe234079ff0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:50.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.451+0000 7fe24d470700 1 -- 172.21.15.72:0/3340375375 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fe23406dc40 msgr2=0x7fe234070100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:50.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.451+0000 7fe24d470700 1 --2- 172.21.15.72:0/3340375375 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fe23406dc40 0x7fe234070100 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe238006fd0 tx=0x7fe238008040 comp rx=0 tx=0).stop 2024-03-30T15:09:50.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.451+0000 7fe24d470700 1 -- 172.21.15.72:0/3340375375 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe248102ce0 msgr2=0x7fe248198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:50.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.451+0000 7fe24d470700 1 --2- 172.21.15.72:0/3340375375 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe248102ce0 0x7fe248198580 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe23000b070 tx=0x7fe230007a20 comp rx=0 tx=0).stop 2024-03-30T15:09:50.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.451+0000 7fe2477fe700 1 -- 172.21.15.72:0/3340375375 reap_dead start 2024-03-30T15:09:50.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.451+0000 7fe24d470700 1 -- 172.21.15.72:0/3340375375 shutdown_connections 2024-03-30T15:09:50.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.451+0000 7fe24d470700 1 -- 172.21.15.72:0/3340375375 >> 172.21.15.72:0/3340375375 conn(0x7fe248079310 msgr2=0x7fe248105eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:09:50.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.451+0000 7fe24d470700 1 -- 172.21.15.72:0/3340375375 shutdown_connections 2024-03-30T15:09:50.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.451+0000 7fe24d470700 1 -- 172.21.15.72:0/3340375375 wait complete. 2024-03-30T15:09:50.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.659+0000 7fb6c8f42700 1 -- 172.21.15.72:0/1366804550 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6c406ab80 msgr2=0x7fb6c4106ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:50.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.659+0000 7fb6c8f42700 1 --2- 172.21.15.72:0/1366804550 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6c406ab80 0x7fb6c4106ef0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb6b80099c0 tx=0x7fb6b8009cd0 comp rx=0 tx=0).stop 2024-03-30T15:09:50.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.659+0000 7fb6c8f42700 1 -- 172.21.15.72:0/1366804550 shutdown_connections 2024-03-30T15:09:50.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.659+0000 7fb6c8f42700 1 --2- 172.21.15.72:0/1366804550 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6c4107620 0x7fb6c410f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:50.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.659+0000 7fb6c8f42700 1 --2- 172.21.15.72:0/1366804550 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6c406a1d0 0x7fb6c406a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:50.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.659+0000 7fb6c8f42700 1 --2- 172.21.15.72:0/1366804550 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6c406ab80 0x7fb6c4106ef0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:50.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.659+0000 7fb6c8f42700 1 -- 172.21.15.72:0/1366804550 >> 172.21.15.72:0/1366804550 conn(0x7fb6c40771e0 msgr2=0x7fb6c40775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:09:50.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.659+0000 7fb6c8f42700 1 -- 172.21.15.72:0/1366804550 shutdown_connections 2024-03-30T15:09:50.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.659+0000 7fb6c8f42700 1 -- 172.21.15.72:0/1366804550 wait complete. 2024-03-30T15:09:50.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.659+0000 7fb6c8f42700 1 Processor -- start 2024-03-30T15:09:50.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.659+0000 7fb6c8f42700 1 -- start start 2024-03-30T15:09:50.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.659+0000 7fb6c8f42700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6c406a1d0 0x7fb6c4101270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:50.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.659+0000 7fb6c8f42700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6c406ab80 0x7fb6c41017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:50.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.659+0000 7fb6c8f42700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6c4107620 0x7fb6c4101cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:50.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.659+0000 7fb6c8f42700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c4111ae0 con 0x7fb6c406ab80 2024-03-30T15:09:50.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.659+0000 7fb6c8f42700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c4111960 con 0x7fb6c4107620 2024-03-30T15:09:50.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.659+0000 7fb6c8f42700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fb6c4111c60 con 0x7fb6c406a1d0 2024-03-30T15:09:50.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.659+0000 7fb6c259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6c406a1d0 0x7fb6c4101270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:50.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.659+0000 7fb6c259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6c406a1d0 0x7fb6c4101270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46274/0 (socket says 172.21.15.72:46274) 2024-03-30T15:09:50.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.659+0000 7fb6c1d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6c406ab80 0x7fb6c41017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:50.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.659+0000 7fb6c259c700 1 -- 172.21.15.72:0/1770244187 learned_addr learned my addr 172.21.15.72:0/1770244187 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T15:09:50.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.659+0000 7fb6c259c700 1 -- 172.21.15.72:0/1770244187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6c4107620 msgr2=0x7fb6c4101cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:50.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.659+0000 7fb6c2d9d700 1 --2- 172.21.15.72:0/1770244187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6c4107620 0x7fb6c4101cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:50.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.659+0000 7fb6c259c700 1 --2- 172.21.15.72:0/1770244187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6c4107620 0x7fb6c4101cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:50.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.659+0000 7fb6c259c700 1 -- 172.21.15.72:0/1770244187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6c406ab80 msgr2=0x7fb6c41017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:50.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.659+0000 7fb6c259c700 1 --2- 172.21.15.72:0/1770244187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6c406ab80 0x7fb6c41017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:50.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.659+0000 7fb6c259c700 1 -- 172.21.15.72:0/1770244187 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c41a6550 con 0x7fb6c406a1d0 2024-03-30T15:09:50.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.659+0000 7fb6c1d9b700 1 --2- 172.21.15.72:0/1770244187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6c406ab80 0x7fb6c41017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T15:09:50.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.659+0000 7fb6c259c700 1 --2- 172.21.15.72:0/1770244187 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6c406a1d0 0x7fb6c4101270 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb6b400eb30 tx=0x7fb6b400ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:09:50.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.659+0000 7fb6b37fe700 1 -- 172.21.15.72:0/1770244187 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b400cc90 con 0x7fb6c406a1d0 2024-03-30T15:09:50.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.659+0000 7fb6c8f42700 1 -- 172.21.15.72:0/1770244187 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6c41a6840 con 0x7fb6c406a1d0 2024-03-30T15:09:50.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.659+0000 7fb6b37fe700 1 -- 172.21.15.72:0/1770244187 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7fb6b400ce30 con 0x7fb6c406a1d0 2024-03-30T15:09:50.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.659+0000 7fb6b37fe700 1 -- 172.21.15.72:0/1770244187 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b4003d80 con 0x7fb6c406a1d0 2024-03-30T15:09:50.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.659+0000 7fb6c8f42700 1 -- 172.21.15.72:0/1770244187 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6c41a6da0 con 0x7fb6c406a1d0 2024-03-30T15:09:50.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.663+0000 7fb6c8f42700 1 -- 172.21.15.72:0/1770244187 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb6c40ff970 con 0x7fb6c406a1d0 2024-03-30T15:09:50.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.663+0000 7fb6b37fe700 1 -- 172.21.15.72:0/1770244187 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 21) ==== 91831+0+0 (secure 0 0 0) 0x7fb6b4003f20 con 0x7fb6c406a1d0 2024-03-30T15:09:50.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.663+0000 7fb6b37fe700 1 --2- 172.21.15.72:0/1770244187 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fb6ac06dc40 0x7fb6ac070100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:50.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.663+0000 7fb6b37fe700 1 -- 172.21.15.72:0/1770244187 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(74..74 src has 1..74) ==== 7537+0+0 (secure 0 0 0) 0x7fb6b408e2f0 con 0x7fb6c406a1d0 2024-03-30T15:09:50.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.663+0000 7fb6c1d9b700 1 --2- 172.21.15.72:0/1770244187 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fb6ac06dc40 0x7fb6ac070100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:50.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.663+0000 7fb6b37fe700 1 --2- 172.21.15.72:0/1770244187 >> [v2:172.21.15.172:6808/1078861326,v1:172.21.15.172:6809/1078861326] conn(0x7fb6ac077b50 0x7fb6ac079ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:50.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.663+0000 7fb6b37fe700 1 -- 172.21.15.72:0/1770244187 --> [v2:172.21.15.172:6808/1078861326,v1:172.21.15.172:6809/1078861326] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb6b400be50 con 0x7fb6ac077b50 2024-03-30T15:09:50.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.663+0000 7fb6b37fe700 1 -- 172.21.15.72:0/1770244187 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fb6b4095050 con 0x7fb6c406a1d0 2024-03-30T15:09:50.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.663+0000 7fb6c1d9b700 1 --2- 172.21.15.72:0/1770244187 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fb6ac06dc40 0x7fb6ac070100 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb6b8009990 tx=0x7fb6b8005fb0 comp rx=0 tx=0).ready entity=mgr.14526 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:09:50.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.663+0000 7fb6c2d9d700 1 --2- 172.21.15.72:0/1770244187 >> [v2:172.21.15.172:6808/1078861326,v1:172.21.15.172:6809/1078861326] conn(0x7fb6ac077b50 0x7fb6ac079ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:50.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.663+0000 7fb6c2d9d700 1 --2- 172.21.15.72:0/1770244187 >> [v2:172.21.15.172:6808/1078861326,v1:172.21.15.172:6809/1078861326] conn(0x7fb6ac077b50 0x7fb6ac079ff0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:09:50.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.667+0000 7fb6b37fe700 1 -- 172.21.15.72:0/1770244187 <== osd.5 v2:172.21.15.172:6808/1078861326 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb6b400be50 con 0x7fb6ac077b50 2024-03-30T15:09:50.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.683+0000 7fb6c8f42700 1 -- 172.21.15.72:0/1770244187 --> [v2:172.21.15.172:6808/1078861326,v1:172.21.15.172:6809/1078861326] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb6c41039d0 con 0x7fb6ac077b50 2024-03-30T15:09:50.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.683+0000 7fb6b37fe700 1 -- 172.21.15.72:0/1770244187 <== osd.5 v2:172.21.15.172:6808/1078861326 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb6c41039d0 con 0x7fb6ac077b50 2024-03-30T15:09:50.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.683+0000 7fb6c8f42700 1 -- 172.21.15.72:0/1770244187 >> [v2:172.21.15.172:6808/1078861326,v1:172.21.15.172:6809/1078861326] conn(0x7fb6ac077b50 msgr2=0x7fb6ac079ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:50.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.683+0000 7fb6c8f42700 1 --2- 172.21.15.72:0/1770244187 >> [v2:172.21.15.172:6808/1078861326,v1:172.21.15.172:6809/1078861326] conn(0x7fb6ac077b50 0x7fb6ac079ff0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:50.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.683+0000 7fb6c8f42700 1 -- 172.21.15.72:0/1770244187 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fb6ac06dc40 msgr2=0x7fb6ac070100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:50.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.683+0000 7fb6c8f42700 1 --2- 172.21.15.72:0/1770244187 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fb6ac06dc40 0x7fb6ac070100 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb6b8009990 tx=0x7fb6b8005fb0 comp rx=0 tx=0).stop 2024-03-30T15:09:50.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.683+0000 7fb6c8f42700 1 -- 172.21.15.72:0/1770244187 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6c406a1d0 msgr2=0x7fb6c4101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:50.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.683+0000 7fb6c8f42700 1 --2- 172.21.15.72:0/1770244187 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6c406a1d0 0x7fb6c4101270 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb6b400eb30 tx=0x7fb6b400ee40 comp rx=0 tx=0).stop 2024-03-30T15:09:50.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.683+0000 7fb6c2d9d700 1 -- 172.21.15.72:0/1770244187 reap_dead start 2024-03-30T15:09:50.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.683+0000 7fb6c8f42700 1 -- 172.21.15.72:0/1770244187 shutdown_connections 2024-03-30T15:09:50.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.683+0000 7fb6c8f42700 1 -- 172.21.15.72:0/1770244187 >> 172.21.15.72:0/1770244187 conn(0x7fb6c40771e0 msgr2=0x7fb6c40ff010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:09:50.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.683+0000 7fb6c8f42700 1 -- 172.21.15.72:0/1770244187 shutdown_connections 2024-03-30T15:09:50.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:50.683+0000 7fb6c8f42700 1 -- 172.21.15.72:0/1770244187 wait complete. 2024-03-30T15:09:50.978 INFO:teuthology.orchestra.run.smithi072.stdout:197568495663 2024-03-30T15:09:50.979 DEBUG:teuthology.orchestra.run.smithi072:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.6 2024-03-30T15:09:51.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:50 smithi072 bash[21573]: cluster 2024-03-30T15:09:49.770871+0000 mgr.y (mgr.14526) 83 : cluster 0 pgmap v43: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T15:09:51.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:50 smithi072 bash[28946]: cluster 2024-03-30T15:09:49.770871+0000 mgr.y (mgr.14526) 83 : cluster 0 pgmap v43: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T15:09:51.167 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:09:51 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:09:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:09:51.217 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:09:50 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:09:51.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:50 smithi172 bash[23680]: cluster 2024-03-30T15:09:49.770871+0000 mgr.y (mgr.14526) 83 : cluster 0 pgmap v43: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T15:09:52.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:51 smithi072 bash[21573]: audit 2024-03-30T15:09:50.808756+0000 mgr.y (mgr.14526) 84 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:09:52.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:51 smithi072 bash[28946]: audit 2024-03-30T15:09:50.808756+0000 mgr.y (mgr.14526) 84 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:09:52.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:51 smithi172 bash[23680]: audit 2024-03-30T15:09:50.808756+0000 mgr.y (mgr.14526) 84 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:09:52.601 INFO:teuthology.orchestra.run.smithi072.stdout:55834574948 2024-03-30T15:09:52.601 DEBUG:teuthology.orchestra.run.smithi072:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.1 2024-03-30T15:09:52.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.727+0000 7f7c3fffa700 1 -- 172.21.15.72:0/1220642307 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c38107680 msgr2=0x7f7c3810f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:52.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.727+0000 7f7c3fffa700 1 --2- 172.21.15.72:0/1220642307 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c38107680 0x7f7c3810f230 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7c300098f0 tx=0x7f7c30009c00 comp rx=0 tx=0).stop 2024-03-30T15:09:52.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.727+0000 7f7c3fffa700 1 -- 172.21.15.72:0/1220642307 shutdown_connections 2024-03-30T15:09:52.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.727+0000 7f7c3fffa700 1 --2- 172.21.15.72:0/1220642307 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c38107680 0x7f7c3810f230 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:52.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.727+0000 7f7c3fffa700 1 --2- 172.21.15.72:0/1220642307 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c3806ab00 0x7f7c3806aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:52.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.727+0000 7f7c3fffa700 1 --2- 172.21.15.72:0/1220642307 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c3806b4b0 0x7f7c38106fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:52.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.727+0000 7f7c3fffa700 1 -- 172.21.15.72:0/1220642307 >> 172.21.15.72:0/1220642307 conn(0x7f7c38078240 msgr2=0x7f7c38078650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:09:52.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.727+0000 7f7c3fffa700 1 -- 172.21.15.72:0/1220642307 shutdown_connections 2024-03-30T15:09:52.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.727+0000 7f7c3fffa700 1 -- 172.21.15.72:0/1220642307 wait complete. 2024-03-30T15:09:52.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.727+0000 7f7c3fffa700 1 Processor -- start 2024-03-30T15:09:52.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.727+0000 7f7c3fffa700 1 -- start start 2024-03-30T15:09:52.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.727+0000 7f7c3fffa700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c3806ab00 0x7f7c3819a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:52.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.727+0000 7f7c3fffa700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c3806b4b0 0x7f7c3819a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:52.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.727+0000 7f7c3fffa700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c38107680 0x7f7c3819eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:52.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.727+0000 7f7c3fffa700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7c38111ac0 con 0x7f7c38107680 2024-03-30T15:09:52.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.727+0000 7f7c3fffa700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7c38111940 con 0x7f7c3806ab00 2024-03-30T15:09:52.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.727+0000 7f7c3fffa700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f7c38111c40 con 0x7f7c3806b4b0 2024-03-30T15:09:52.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.727+0000 7f7c3d595700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c3806b4b0 0x7f7c3819a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:52.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.727+0000 7f7c3e597700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c38107680 0x7f7c3819eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:52.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.727+0000 7f7c3d595700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c3806b4b0 0x7f7c3819a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46294/0 (socket says 172.21.15.72:46294) 2024-03-30T15:09:52.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.727+0000 7f7c3e597700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c38107680 0x7f7c3819eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45064/0 (socket says 172.21.15.72:45064) 2024-03-30T15:09:52.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.727+0000 7f7c3d595700 1 -- 172.21.15.72:0/331599441 learned_addr learned my addr 172.21.15.72:0/331599441 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T15:09:52.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.727+0000 7f7c3dd96700 1 --2- 172.21.15.72:0/331599441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c3806ab00 0x7f7c3819a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:52.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.727+0000 7f7c3d595700 1 -- 172.21.15.72:0/331599441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c3806ab00 msgr2=0x7f7c3819a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:52.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.727+0000 7f7c3d595700 1 --2- 172.21.15.72:0/331599441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c3806ab00 0x7f7c3819a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:52.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.727+0000 7f7c3d595700 1 -- 172.21.15.72:0/331599441 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c38107680 msgr2=0x7f7c3819eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:52.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.727+0000 7f7c3d595700 1 --2- 172.21.15.72:0/331599441 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c38107680 0x7f7c3819eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:52.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.727+0000 7f7c3d595700 1 -- 172.21.15.72:0/331599441 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c3819f1e0 con 0x7f7c3806b4b0 2024-03-30T15:09:52.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.727+0000 7f7c3e597700 1 --2- 172.21.15.72:0/331599441 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c38107680 0x7f7c3819eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T15:09:52.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.727+0000 7f7c3d595700 1 --2- 172.21.15.72:0/331599441 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c3806b4b0 0x7f7c3819a760 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c00ec70 tx=0x7f7c2c00ef80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:09:52.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.727+0000 7f7c36ffd700 1 -- 172.21.15.72:0/331599441 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c00cd40 con 0x7f7c3806b4b0 2024-03-30T15:09:52.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.727+0000 7f7c36ffd700 1 -- 172.21.15.72:0/331599441 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f7c2c0044a0 con 0x7f7c3806b4b0 2024-03-30T15:09:52.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.727+0000 7f7c3fffa700 1 -- 172.21.15.72:0/331599441 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c3819f4d0 con 0x7f7c3806b4b0 2024-03-30T15:09:52.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.731+0000 7f7c36ffd700 1 -- 172.21.15.72:0/331599441 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c010430 con 0x7f7c3806b4b0 2024-03-30T15:09:52.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.731+0000 7f7c3fffa700 1 -- 172.21.15.72:0/331599441 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c381a6d50 con 0x7f7c3806b4b0 2024-03-30T15:09:52.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.731+0000 7f7c3fffa700 1 -- 172.21.15.72:0/331599441 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7c3810de90 con 0x7f7c3806b4b0 2024-03-30T15:09:52.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.731+0000 7f7c36ffd700 1 -- 172.21.15.72:0/331599441 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 21) ==== 91831+0+0 (secure 0 0 0) 0x7f7c2c003eb0 con 0x7f7c3806b4b0 2024-03-30T15:09:52.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.731+0000 7f7c36ffd700 1 --2- 172.21.15.72:0/331599441 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f7c2006dc40 0x7f7c20070100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:52.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.731+0000 7f7c36ffd700 1 -- 172.21.15.72:0/331599441 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(74..74 src has 1..74) ==== 7537+0+0 (secure 0 0 0) 0x7f7c2c08e760 con 0x7f7c3806b4b0 2024-03-30T15:09:52.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.731+0000 7f7c3dd96700 1 --2- 172.21.15.72:0/331599441 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f7c2006dc40 0x7f7c20070100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:52.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.731+0000 7f7c36ffd700 1 --2- 172.21.15.72:0/331599441 >> [v2:172.21.15.72:6818/2674031198,v1:172.21.15.72:6819/2674031198] conn(0x7f7c20077bd0 0x7f7c2007a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:09:52.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.731+0000 7f7c36ffd700 1 -- 172.21.15.72:0/331599441 --> [v2:172.21.15.72:6818/2674031198,v1:172.21.15.72:6819/2674031198] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7c2c00be50 con 0x7f7c20077bd0 2024-03-30T15:09:52.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.731+0000 7f7c36ffd700 1 -- 172.21.15.72:0/331599441 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f7c2c08ebf0 con 0x7f7c3806b4b0 2024-03-30T15:09:52.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.731+0000 7f7c3e597700 1 --2- 172.21.15.72:0/331599441 >> [v2:172.21.15.72:6818/2674031198,v1:172.21.15.72:6819/2674031198] conn(0x7f7c20077bd0 0x7f7c2007a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:09:52.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.731+0000 7f7c3dd96700 1 --2- 172.21.15.72:0/331599441 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f7c2006dc40 0x7f7c20070100 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7c28009f20 tx=0x7f7c280094f0 comp rx=0 tx=0).ready entity=mgr.14526 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:09:52.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.731+0000 7f7c3e597700 1 --2- 172.21.15.72:0/331599441 >> [v2:172.21.15.72:6818/2674031198,v1:172.21.15.72:6819/2674031198] conn(0x7f7c20077bd0 0x7f7c2007a070 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:09:52.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.735+0000 7f7c36ffd700 1 -- 172.21.15.72:0/331599441 <== osd.2 v2:172.21.15.72:6818/2674031198 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7c2c00be50 con 0x7f7c20077bd0 2024-03-30T15:09:52.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.751+0000 7f7c3fffa700 1 -- 172.21.15.72:0/331599441 --> [v2:172.21.15.72:6818/2674031198,v1:172.21.15.72:6819/2674031198] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7c38103a10 con 0x7f7c20077bd0 2024-03-30T15:09:52.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.751+0000 7f7c36ffd700 1 -- 172.21.15.72:0/331599441 <== osd.2 v2:172.21.15.72:6818/2674031198 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7c38103a10 con 0x7f7c20077bd0 2024-03-30T15:09:52.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.751+0000 7f7c3fffa700 1 -- 172.21.15.72:0/331599441 >> [v2:172.21.15.72:6818/2674031198,v1:172.21.15.72:6819/2674031198] conn(0x7f7c20077bd0 msgr2=0x7f7c2007a070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:52.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.751+0000 7f7c3fffa700 1 --2- 172.21.15.72:0/331599441 >> [v2:172.21.15.72:6818/2674031198,v1:172.21.15.72:6819/2674031198] conn(0x7f7c20077bd0 0x7f7c2007a070 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:09:52.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.751+0000 7f7c3fffa700 1 -- 172.21.15.72:0/331599441 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f7c2006dc40 msgr2=0x7f7c20070100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:52.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.751+0000 7f7c3fffa700 1 --2- 172.21.15.72:0/331599441 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f7c2006dc40 0x7f7c20070100 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7c28009f20 tx=0x7f7c280094f0 comp rx=0 tx=0).stop 2024-03-30T15:09:52.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.751+0000 7f7c3fffa700 1 -- 172.21.15.72:0/331599441 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c3806b4b0 msgr2=0x7f7c3819a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:09:52.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.751+0000 7f7c3fffa700 1 --2- 172.21.15.72:0/331599441 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c3806b4b0 0x7f7c3819a760 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c00ec70 tx=0x7f7c2c00ef80 comp rx=0 tx=0).stop 2024-03-30T15:09:52.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.751+0000 7f7c3e597700 1 -- 172.21.15.72:0/331599441 reap_dead start 2024-03-30T15:09:52.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.751+0000 7f7c3fffa700 1 -- 172.21.15.72:0/331599441 shutdown_connections 2024-03-30T15:09:52.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.751+0000 7f7c3fffa700 1 -- 172.21.15.72:0/331599441 >> 172.21.15.72:0/331599441 conn(0x7f7c38078240 msgr2=0x7f7c3810d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:09:52.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.751+0000 7f7c3fffa700 1 -- 172.21.15.72:0/331599441 shutdown_connections 2024-03-30T15:09:52.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:09:52.751+0000 7f7c3fffa700 1 -- 172.21.15.72:0/331599441 wait complete. 2024-03-30T15:09:52.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:52 smithi072 bash[21573]: cluster 2024-03-30T15:09:51.772264+0000 mgr.y (mgr.14526) 85 : cluster 0 pgmap v44: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:09:52.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:52 smithi072 bash[28946]: cluster 2024-03-30T15:09:51.772264+0000 mgr.y (mgr.14526) 85 : cluster 0 pgmap v44: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:09:53.126 INFO:teuthology.orchestra.run.smithi072.stdout:107374182479 2024-03-30T15:09:53.126 DEBUG:teuthology.orchestra.run.smithi072:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.3 2024-03-30T15:09:53.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:52 smithi172 bash[23680]: cluster 2024-03-30T15:09:51.772264+0000 mgr.y (mgr.14526) 85 : cluster 0 pgmap v44: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:09:53.611 INFO:teuthology.orchestra.run.smithi072.stdout:128849018947 2024-03-30T15:09:53.612 DEBUG:teuthology.orchestra.run.smithi072:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.4 2024-03-30T15:09:54.537 INFO:teuthology.orchestra.run.smithi072.stdout:231928234020 2024-03-30T15:09:54.537 DEBUG:teuthology.orchestra.run.smithi072:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.7 2024-03-30T15:09:54.550 INFO:teuthology.orchestra.run.smithi072.stdout:163208757306 2024-03-30T15:09:54.550 DEBUG:teuthology.orchestra.run.smithi072:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.5 2024-03-30T15:09:54.592 INFO:teuthology.orchestra.run.smithi072.stdout:77309411417 2024-03-30T15:09:54.592 DEBUG:teuthology.orchestra.run.smithi072:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.2 2024-03-30T15:09:54.837 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:54 smithi072 bash[21573]: cluster 2024-03-30T15:09:53.772985+0000 mgr.y (mgr.14526) 86 : cluster 0 pgmap v45: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:55.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:54 smithi072 bash[28946]: cluster 2024-03-30T15:09:53.772985+0000 mgr.y (mgr.14526) 86 : cluster 0 pgmap v45: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:55.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:54 smithi172 bash[23680]: cluster 2024-03-30T15:09:53.772985+0000 mgr.y (mgr.14526) 86 : cluster 0 pgmap v45: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:56.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:56 smithi072 bash[21573]: audit 2024-03-30T15:09:55.629082+0000 mon.a (mon.0) 864 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:56.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:56 smithi072 bash[21573]: audit 2024-03-30T15:09:55.639436+0000 mon.a (mon.0) 865 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:56.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:56 smithi072 bash[21573]: audit 2024-03-30T15:09:56.215206+0000 mon.c (mon.2) 75 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:09:56.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:56 smithi072 bash[21573]: audit 2024-03-30T15:09:56.216945+0000 mon.c (mon.2) 76 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:09:56.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:56 smithi072 bash[21573]: audit 2024-03-30T15:09:56.226196+0000 mon.a (mon.0) 866 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:56.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:56 smithi072 bash[28946]: audit 2024-03-30T15:09:55.629082+0000 mon.a (mon.0) 864 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:56.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:56 smithi072 bash[28946]: audit 2024-03-30T15:09:55.639436+0000 mon.a (mon.0) 865 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:56.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:56 smithi072 bash[28946]: audit 2024-03-30T15:09:56.215206+0000 mon.c (mon.2) 75 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:09:56.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:56 smithi072 bash[28946]: audit 2024-03-30T15:09:56.216945+0000 mon.c (mon.2) 76 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:09:56.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:56 smithi072 bash[28946]: audit 2024-03-30T15:09:56.226196+0000 mon.a (mon.0) 866 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:56.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:56 smithi172 bash[23680]: audit 2024-03-30T15:09:55.629082+0000 mon.a (mon.0) 864 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:56.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:56 smithi172 bash[23680]: audit 2024-03-30T15:09:55.639436+0000 mon.a (mon.0) 865 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:56.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:56 smithi172 bash[23680]: audit 2024-03-30T15:09:56.215206+0000 mon.c (mon.2) 75 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:09:56.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:56 smithi172 bash[23680]: audit 2024-03-30T15:09:56.216945+0000 mon.c (mon.2) 76 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:09:56.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:56 smithi172 bash[23680]: audit 2024-03-30T15:09:56.226196+0000 mon.a (mon.0) 866 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:09:57.146 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T15:09:57.147 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T15:09:57.149 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T15:09:57.149 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T15:09:57.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:57 smithi072 bash[21573]: cluster 2024-03-30T15:09:55.774364+0000 mgr.y (mgr.14526) 87 : cluster 0 pgmap v46: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:09:57.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:57 smithi072 bash[28946]: cluster 2024-03-30T15:09:55.774364+0000 mgr.y (mgr.14526) 87 : cluster 0 pgmap v46: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:09:57.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:57 smithi172 bash[23680]: cluster 2024-03-30T15:09:55.774364+0000 mgr.y (mgr.14526) 87 : cluster 0 pgmap v46: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:09:58.159 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T15:09:59.183 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T15:09:59.184 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T15:09:59.185 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T15:09:59.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:09:59 smithi072 bash[21573]: cluster 2024-03-30T15:09:57.775066+0000 mgr.y (mgr.14526) 88 : cluster 0 pgmap v47: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:59.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:09:59 smithi072 bash[28946]: cluster 2024-03-30T15:09:57.775066+0000 mgr.y (mgr.14526) 88 : cluster 0 pgmap v47: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:09:59.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:09:59 smithi172 bash[23680]: cluster 2024-03-30T15:09:57.775066+0000 mgr.y (mgr.14526) 88 : cluster 0 pgmap v47: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:10:00.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:00 smithi072 bash[21573]: cluster 2024-03-30T15:10:00.000119+0000 mon.a (mon.0) 867 : cluster 1 overall HEALTH_OK 2024-03-30T15:10:00.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:00 smithi072 bash[21573]: audit 2024-03-30T15:10:00.035092+0000 mon.c (mon.2) 77 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:10:00.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:00 smithi072 bash[28946]: cluster 2024-03-30T15:10:00.000119+0000 mon.a (mon.0) 867 : cluster 1 overall HEALTH_OK 2024-03-30T15:10:00.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:00 smithi072 bash[28946]: audit 2024-03-30T15:10:00.035092+0000 mon.c (mon.2) 77 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:10:00.967 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:10:00 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:10:00.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:00 smithi172 bash[23680]: cluster 2024-03-30T15:10:00.000119+0000 mon.a (mon.0) 867 : cluster 1 overall HEALTH_OK 2024-03-30T15:10:00.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:00 smithi172 bash[23680]: audit 2024-03-30T15:10:00.035092+0000 mon.c (mon.2) 77 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:10:01.417 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:10:01 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:10:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:10:01.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:01 smithi072 bash[21573]: cluster 2024-03-30T15:09:59.775742+0000 mgr.y (mgr.14526) 89 : cluster 0 pgmap v48: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:10:01.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:01 smithi072 bash[28946]: cluster 2024-03-30T15:09:59.775742+0000 mgr.y (mgr.14526) 89 : cluster 0 pgmap v48: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:10:01.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:01 smithi172 bash[23680]: cluster 2024-03-30T15:09:59.775742+0000 mgr.y (mgr.14526) 89 : cluster 0 pgmap v48: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:10:02.729 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:02 smithi072 bash[21573]: audit 2024-03-30T15:10:00.820237+0000 mgr.y (mgr.14526) 90 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:10:02.729 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:02 smithi072 bash[21573]: cluster 2024-03-30T15:10:01.776813+0000 mgr.y (mgr.14526) 91 : cluster 0 pgmap v49: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T15:10:02.729 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:02 smithi072 bash[28946]: audit 2024-03-30T15:10:00.820237+0000 mgr.y (mgr.14526) 90 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:10:02.729 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:02 smithi072 bash[28946]: cluster 2024-03-30T15:10:01.776813+0000 mgr.y (mgr.14526) 91 : cluster 0 pgmap v49: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T15:10:02.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:02 smithi172 bash[23680]: audit 2024-03-30T15:10:00.820237+0000 mgr.y (mgr.14526) 90 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:10:02.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:02 smithi172 bash[23680]: cluster 2024-03-30T15:10:01.776813+0000 mgr.y (mgr.14526) 91 : cluster 0 pgmap v49: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T15:10:05.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:04 smithi072 bash[21573]: cluster 2024-03-30T15:10:03.777504+0000 mgr.y (mgr.14526) 92 : cluster 0 pgmap v50: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:10:05.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:04 smithi072 bash[28946]: cluster 2024-03-30T15:10:03.777504+0000 mgr.y (mgr.14526) 92 : cluster 0 pgmap v50: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:10:05.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:04 smithi172 bash[23680]: cluster 2024-03-30T15:10:03.777504+0000 mgr.y (mgr.14526) 92 : cluster 0 pgmap v50: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:10:07.035 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:06 smithi072 bash[21573]: cluster 2024-03-30T15:10:05.778889+0000 mgr.y (mgr.14526) 93 : cluster 0 pgmap v51: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:10:07.036 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:06 smithi072 bash[28946]: cluster 2024-03-30T15:10:05.778889+0000 mgr.y (mgr.14526) 93 : cluster 0 pgmap v51: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:10:07.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:06 smithi172 bash[23680]: cluster 2024-03-30T15:10:05.778889+0000 mgr.y (mgr.14526) 93 : cluster 0 pgmap v51: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:10:08.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.731+0000 7f505908b700 1 -- 172.21.15.72:0/927299932 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50541008e0 msgr2=0x7f5054100d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:08.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.731+0000 7f505908b700 1 --2- 172.21.15.72:0/927299932 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50541008e0 0x7f5054100d60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f504800aaa0 tx=0x7f504800adb0 comp rx=0 tx=0).stop 2024-03-30T15:10:08.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.731+0000 7f505908b700 1 -- 172.21.15.72:0/927299932 shutdown_connections 2024-03-30T15:10:08.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.731+0000 7f505908b700 1 --2- 172.21.15.72:0/927299932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50541012a0 0x7f505410d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:08.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.731+0000 7f505908b700 1 --2- 172.21.15.72:0/927299932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50541068e0 0x7f5054106cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:08.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.731+0000 7f505908b700 1 --2- 172.21.15.72:0/927299932 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50541008e0 0x7f5054100d60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:08.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.731+0000 7f505908b700 1 -- 172.21.15.72:0/927299932 >> 172.21.15.72:0/927299932 conn(0x7f5054077740 msgr2=0x7f50540feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:10:08.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.731+0000 7f505908b700 1 -- 172.21.15.72:0/927299932 shutdown_connections 2024-03-30T15:10:08.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.731+0000 7f505908b700 1 -- 172.21.15.72:0/927299932 wait complete. 2024-03-30T15:10:08.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.731+0000 7f505908b700 1 Processor -- start 2024-03-30T15:10:08.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.731+0000 7f505908b700 1 -- start start 2024-03-30T15:10:08.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.735+0000 7f505908b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50541008e0 0x7f5054195d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:10:08.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.735+0000 7f505908b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50541012a0 0x7f5054196290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:10:08.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.735+0000 7f505908b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50541068e0 0x7f505419a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:10:08.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.735+0000 7f505908b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f505410f8b0 con 0x7f50541008e0 2024-03-30T15:10:08.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.735+0000 7f505908b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f505410f730 con 0x7f50541068e0 2024-03-30T15:10:08.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.735+0000 7f505908b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f505410fa30 con 0x7f50541012a0 2024-03-30T15:10:08.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.735+0000 7f5052d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50541008e0 0x7f5054195d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:10:08.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.735+0000 7f5052d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50541008e0 0x7f5054195d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57262/0 (socket says 172.21.15.72:57262) 2024-03-30T15:10:08.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.735+0000 7f505259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50541012a0 0x7f5054196290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:10:08.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.735+0000 7f5052d9d700 1 -- 172.21.15.72:0/717773189 learned_addr learned my addr 172.21.15.72:0/717773189 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T15:10:08.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.735+0000 7f505359e700 1 --2- 172.21.15.72:0/717773189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50541068e0 0x7f505419a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:10:08.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.735+0000 7f5052d9d700 1 -- 172.21.15.72:0/717773189 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50541012a0 msgr2=0x7f5054196290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:08.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.735+0000 7f5052d9d700 1 --2- 172.21.15.72:0/717773189 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50541012a0 0x7f5054196290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:08.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.735+0000 7f5052d9d700 1 -- 172.21.15.72:0/717773189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50541068e0 msgr2=0x7f505419a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:08.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.735+0000 7f5052d9d700 1 --2- 172.21.15.72:0/717773189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50541068e0 0x7f505419a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:08.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.735+0000 7f5052d9d700 1 -- 172.21.15.72:0/717773189 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f505419ad60 con 0x7f50541008e0 2024-03-30T15:10:08.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.735+0000 7f505359e700 1 --2- 172.21.15.72:0/717773189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50541068e0 0x7f505419a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T15:10:08.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.735+0000 7f5052d9d700 1 --2- 172.21.15.72:0/717773189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50541008e0 0x7f5054195d50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f504400e9a0 tx=0x7f504400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:10:08.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.735+0000 7f503bfff700 1 -- 172.21.15.72:0/717773189 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f504400cbd0 con 0x7f50541008e0 2024-03-30T15:10:08.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.735+0000 7f503bfff700 1 -- 172.21.15.72:0/717773189 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f504400cd70 con 0x7f50541008e0 2024-03-30T15:10:08.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.735+0000 7f503bfff700 1 -- 172.21.15.72:0/717773189 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5044018680 con 0x7f50541008e0 2024-03-30T15:10:08.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.735+0000 7f505908b700 1 -- 172.21.15.72:0/717773189 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f505419b050 con 0x7f50541008e0 2024-03-30T15:10:08.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.735+0000 7f505908b700 1 -- 172.21.15.72:0/717773189 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50541a28d0 con 0x7f50541008e0 2024-03-30T15:10:08.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.735+0000 7f505908b700 1 -- 172.21.15.72:0/717773189 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f505404ff00 con 0x7f50541008e0 2024-03-30T15:10:08.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.735+0000 7f503bfff700 1 -- 172.21.15.72:0/717773189 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 21) ==== 91831+0+0 (secure 0 0 0) 0x7f5044010430 con 0x7f50541008e0 2024-03-30T15:10:08.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.735+0000 7f503bfff700 1 --2- 172.21.15.72:0/717773189 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f503c06dc40 0x7f503c070100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:10:08.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.735+0000 7f503bfff700 1 -- 172.21.15.72:0/717773189 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7537+0+0 (secure 0 0 0) 0x7f504408e1f0 con 0x7f50541008e0 2024-03-30T15:10:08.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.739+0000 7f505259c700 1 --2- 172.21.15.72:0/717773189 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f503c06dc40 0x7f503c070100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:10:08.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.739+0000 7f505259c700 1 --2- 172.21.15.72:0/717773189 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f503c06dc40 0x7f503c070100 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f504800c6d0 tx=0x7f5048005960 comp rx=0 tx=0).ready entity=mgr.14526 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:10:08.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.743+0000 7f503bfff700 1 -- 172.21.15.72:0/717773189 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f504405b850 con 0x7f50541008e0 2024-03-30T15:10:08.932 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:08 smithi072 bash[21573]: cluster 2024-03-30T15:10:07.779574+0000 mgr.y (mgr.14526) 94 : cluster 0 pgmap v52: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:10:08.933 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:08 smithi072 bash[28946]: cluster 2024-03-30T15:10:07.779574+0000 mgr.y (mgr.14526) 94 : cluster 0 pgmap v52: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:10:08.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.975+0000 7f505908b700 1 -- 172.21.15.72:0/717773189 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f50541a2aa0 con 0x7f50541008e0 2024-03-30T15:10:08.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.975+0000 7f503bfff700 1 -- 172.21.15.72:0/717773189 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f504405f2a0 con 0x7f50541008e0 2024-03-30T15:10:08.975 INFO:teuthology.orchestra.run.smithi072.stdout:197568495667 2024-03-30T15:10:08.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.979+0000 7f505908b700 1 -- 172.21.15.72:0/717773189 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f503c06dc40 msgr2=0x7f503c070100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:08.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.979+0000 7f505908b700 1 --2- 172.21.15.72:0/717773189 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f503c06dc40 0x7f503c070100 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f504800c6d0 tx=0x7f5048005960 comp rx=0 tx=0).stop 2024-03-30T15:10:08.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.979+0000 7f505908b700 1 -- 172.21.15.72:0/717773189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50541008e0 msgr2=0x7f5054195d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:08.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.979+0000 7f505908b700 1 --2- 172.21.15.72:0/717773189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50541008e0 0x7f5054195d50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f504400e9a0 tx=0x7f504400ecb0 comp rx=0 tx=0).stop 2024-03-30T15:10:08.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.979+0000 7f505908b700 1 -- 172.21.15.72:0/717773189 shutdown_connections 2024-03-30T15:10:08.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.979+0000 7f505908b700 1 --2- 172.21.15.72:0/717773189 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f503c06dc40 0x7f503c070100 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:08.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.979+0000 7f505908b700 1 --2- 172.21.15.72:0/717773189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50541068e0 0x7f505419a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:08.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.979+0000 7f505908b700 1 --2- 172.21.15.72:0/717773189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50541008e0 0x7f5054195d50 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:08.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.979+0000 7f505908b700 1 --2- 172.21.15.72:0/717773189 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50541012a0 0x7f5054196290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:08.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.979+0000 7f505908b700 1 -- 172.21.15.72:0/717773189 >> 172.21.15.72:0/717773189 conn(0x7f5054077740 msgr2=0x7f5054103270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:10:08.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.979+0000 7f505908b700 1 -- 172.21.15.72:0/717773189 shutdown_connections 2024-03-30T15:10:08.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:08.979+0000 7f505908b700 1 -- 172.21.15.72:0/717773189 wait complete. 2024-03-30T15:10:09.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.207+0000 7ff9dc4cb700 1 -- 172.21.15.72:0/587306566 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9d4102580 msgr2=0x7ff9d4102960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:09.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.207+0000 7ff9dc4cb700 1 --2- 172.21.15.72:0/587306566 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9d4102580 0x7ff9d4102960 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff9d00099c0 tx=0x7ff9d0009cd0 comp rx=0 tx=0).stop 2024-03-30T15:10:09.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.207+0000 7ff9dc4cb700 1 -- 172.21.15.72:0/587306566 shutdown_connections 2024-03-30T15:10:09.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.207+0000 7ff9dc4cb700 1 --2- 172.21.15.72:0/587306566 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9d41075b0 0x7ff9d410f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:09.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.207+0000 7ff9dc4cb700 1 --2- 172.21.15.72:0/587306566 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9d4102580 0x7ff9d4102960 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:09.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.207+0000 7ff9dc4cb700 1 --2- 172.21.15.72:0/587306566 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9d4102f30 0x7ff9d4106ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:09.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.207+0000 7ff9dc4cb700 1 -- 172.21.15.72:0/587306566 >> 172.21.15.72:0/587306566 conn(0x7ff9d40793a0 msgr2=0x7ff9d40797b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:10:09.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.207+0000 7ff9dc4cb700 1 -- 172.21.15.72:0/587306566 shutdown_connections 2024-03-30T15:10:09.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.207+0000 7ff9dc4cb700 1 -- 172.21.15.72:0/587306566 wait complete. 2024-03-30T15:10:09.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.207+0000 7ff9dc4cb700 1 Processor -- start 2024-03-30T15:10:09.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.207+0000 7ff9dc4cb700 1 -- start start 2024-03-30T15:10:09.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.207+0000 7ff9dc4cb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9d4102580 0x7ff9d4197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:10:09.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.207+0000 7ff9dc4cb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9d4102f30 0x7ff9d41984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:10:09.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.207+0000 7ff9dc4cb700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9d41075b0 0x7ff9d419c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:10:09.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.207+0000 7ff9dc4cb700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d4111a90 con 0x7ff9d4102f30 2024-03-30T15:10:09.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.207+0000 7ff9dc4cb700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d4111910 con 0x7ff9d41075b0 2024-03-30T15:10:09.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.207+0000 7ff9dc4cb700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7ff9d4111c10 con 0x7ff9d4102580 2024-03-30T15:10:09.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.207+0000 7ff9da267700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9d4102580 0x7ff9d4197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:10:09.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.207+0000 7ff9d9a66700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9d4102f30 0x7ff9d41984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:10:09.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.207+0000 7ff9da267700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9d4102580 0x7ff9d4197fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:49138/0 (socket says 172.21.15.72:49138) 2024-03-30T15:10:09.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.207+0000 7ff9da267700 1 -- 172.21.15.72:0/1113422832 learned_addr learned my addr 172.21.15.72:0/1113422832 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T15:10:09.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.211+0000 7ff9da267700 1 -- 172.21.15.72:0/1113422832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9d41075b0 msgr2=0x7ff9d419c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:09.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.211+0000 7ff9daa68700 1 --2- 172.21.15.72:0/1113422832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9d41075b0 0x7ff9d419c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:10:09.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.211+0000 7ff9da267700 1 --2- 172.21.15.72:0/1113422832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9d41075b0 0x7ff9d419c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:09.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.211+0000 7ff9da267700 1 -- 172.21.15.72:0/1113422832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9d4102f30 msgr2=0x7ff9d41984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:09.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.211+0000 7ff9da267700 1 --2- 172.21.15.72:0/1113422832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9d4102f30 0x7ff9d41984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:09.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.211+0000 7ff9da267700 1 -- 172.21.15.72:0/1113422832 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9d419cfc0 con 0x7ff9d4102580 2024-03-30T15:10:09.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.211+0000 7ff9d9a66700 1 --2- 172.21.15.72:0/1113422832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9d4102f30 0x7ff9d41984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T15:10:09.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.211+0000 7ff9da267700 1 --2- 172.21.15.72:0/1113422832 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9d4102580 0x7ff9d4197fb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0006010 tx=0x7ff9d00055f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:10:09.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.211+0000 7ff9cb7fe700 1 -- 172.21.15.72:0/1113422832 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d0026070 con 0x7ff9d4102580 2024-03-30T15:10:09.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.211+0000 7ff9dc4cb700 1 -- 172.21.15.72:0/1113422832 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9d419d250 con 0x7ff9d4102580 2024-03-30T15:10:09.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.211+0000 7ff9cb7fe700 1 -- 172.21.15.72:0/1113422832 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7ff9d0003e50 con 0x7ff9d4102580 2024-03-30T15:10:09.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.211+0000 7ff9cb7fe700 1 -- 172.21.15.72:0/1113422832 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d000fb00 con 0x7ff9d4102580 2024-03-30T15:10:09.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.211+0000 7ff9dc4cb700 1 -- 172.21.15.72:0/1113422832 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9d4074470 con 0x7ff9d4102580 2024-03-30T15:10:09.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.211+0000 7ff9dc4cb700 1 -- 172.21.15.72:0/1113422832 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9d404ff00 con 0x7ff9d4102580 2024-03-30T15:10:09.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.211+0000 7ff9cb7fe700 1 -- 172.21.15.72:0/1113422832 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 21) ==== 91831+0+0 (secure 0 0 0) 0x7ff9d0029070 con 0x7ff9d4102580 2024-03-30T15:10:09.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.211+0000 7ff9cb7fe700 1 --2- 172.21.15.72:0/1113422832 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7ff9c006dc40 0x7ff9c0070100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:10:09.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.211+0000 7ff9cb7fe700 1 -- 172.21.15.72:0/1113422832 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(74..74 src has 1..74) ==== 7537+0+0 (secure 0 0 0) 0x7ff9d008e9f0 con 0x7ff9d4102580 2024-03-30T15:10:09.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.211+0000 7ff9d9a66700 1 --2- 172.21.15.72:0/1113422832 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7ff9c006dc40 0x7ff9c0070100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:10:09.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.211+0000 7ff9d9a66700 1 --2- 172.21.15.72:0/1113422832 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7ff9c006dc40 0x7ff9c0070100 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4009680 tx=0x7ff9c4012040 comp rx=0 tx=0).ready entity=mgr.14526 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:10:09.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.219+0000 7ff9cb7fe700 1 -- 172.21.15.72:0/1113422832 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7ff9d0013070 con 0x7ff9d4102580 2024-03-30T15:10:09.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:08 smithi172 bash[23680]: cluster 2024-03-30T15:10:07.779574+0000 mgr.y (mgr.14526) 94 : cluster 0 pgmap v52: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:10:09.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.303+0000 7fea42777700 1 -- 172.21.15.72:0/3900337508 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea3c104e70 msgr2=0x7fea3c111330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:09.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.303+0000 7fea42777700 1 --2- 172.21.15.72:0/3900337508 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea3c104e70 0x7fea3c111330 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fea3400b0d0 tx=0x7fea3400b3e0 comp rx=0 tx=0).stop 2024-03-30T15:10:09.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.303+0000 7fea42777700 1 -- 172.21.15.72:0/3900337508 shutdown_connections 2024-03-30T15:10:09.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.303+0000 7fea42777700 1 --2- 172.21.15.72:0/3900337508 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea3c104e70 0x7fea3c111330 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:09.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.303+0000 7fea42777700 1 --2- 172.21.15.72:0/3900337508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea3c10a560 0x7fea3c10a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:09.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.303+0000 7fea42777700 1 --2- 172.21.15.72:0/3900337508 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea3c1044b0 0x7fea3c104930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:09.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.303+0000 7fea42777700 1 -- 172.21.15.72:0/3900337508 >> 172.21.15.72:0/3900337508 conn(0x7fea3c0fffa0 msgr2=0x7fea3c1023c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:10:09.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.303+0000 7fea42777700 1 -- 172.21.15.72:0/3900337508 shutdown_connections 2024-03-30T15:10:09.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.303+0000 7fea42777700 1 -- 172.21.15.72:0/3900337508 wait complete. 2024-03-30T15:10:09.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.303+0000 7fea42777700 1 Processor -- start 2024-03-30T15:10:09.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.303+0000 7fea42777700 1 -- start start 2024-03-30T15:10:09.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.303+0000 7fea42777700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea3c1044b0 0x7fea3c19a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:10:09.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.303+0000 7fea42777700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea3c104e70 0x7fea3c19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:10:09.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.303+0000 7fea42777700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea3c10a560 0x7fea3c19e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:10:09.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.303+0000 7fea42777700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fea3c113c80 con 0x7fea3c1044b0 2024-03-30T15:10:09.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.303+0000 7fea42777700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fea3c113b00 con 0x7fea3c104e70 2024-03-30T15:10:09.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.303+0000 7fea42777700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fea3c113e00 con 0x7fea3c10a560 2024-03-30T15:10:09.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.303+0000 7fea3bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea3c1044b0 0x7fea3c19a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:10:09.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.303+0000 7fea3bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea3c1044b0 0x7fea3c19a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57292/0 (socket says 172.21.15.72:57292) 2024-03-30T15:10:09.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.303+0000 7fea40d14700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea3c10a560 0x7fea3c19e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:10:09.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.303+0000 7fea3bfff700 1 -- 172.21.15.72:0/2107015442 learned_addr learned my addr 172.21.15.72:0/2107015442 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T15:10:09.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.303+0000 7fea3bfff700 1 -- 172.21.15.72:0/2107015442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea3c10a560 msgr2=0x7fea3c19e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:09.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.303+0000 7fea33fff700 1 --2- 172.21.15.72:0/2107015442 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea3c104e70 0x7fea3c19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:10:09.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.303+0000 7fea3bfff700 1 --2- 172.21.15.72:0/2107015442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea3c10a560 0x7fea3c19e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:09.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.303+0000 7fea3bfff700 1 -- 172.21.15.72:0/2107015442 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea3c104e70 msgr2=0x7fea3c19a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:09.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.303+0000 7fea3bfff700 1 --2- 172.21.15.72:0/2107015442 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea3c104e70 0x7fea3c19a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:09.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.303+0000 7fea3bfff700 1 -- 172.21.15.72:0/2107015442 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea3c19f0c0 con 0x7fea3c1044b0 2024-03-30T15:10:09.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.303+0000 7fea40d14700 1 --2- 172.21.15.72:0/2107015442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea3c10a560 0x7fea3c19e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T15:10:09.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.303+0000 7fea3bfff700 1 --2- 172.21.15.72:0/2107015442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea3c1044b0 0x7fea3c19a100 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fea2c00c920 tx=0x7fea2c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:10:09.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.303+0000 7fea39ffb700 1 -- 172.21.15.72:0/2107015442 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea2c007b00 con 0x7fea3c1044b0 2024-03-30T15:10:09.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.303+0000 7fea42777700 1 -- 172.21.15.72:0/2107015442 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea3c19f3b0 con 0x7fea3c1044b0 2024-03-30T15:10:09.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.303+0000 7fea39ffb700 1 -- 172.21.15.72:0/2107015442 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7fea2c004cb0 con 0x7fea3c1044b0 2024-03-30T15:10:09.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.303+0000 7fea39ffb700 1 -- 172.21.15.72:0/2107015442 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea2c0053c0 con 0x7fea3c1044b0 2024-03-30T15:10:09.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.303+0000 7fea42777700 1 -- 172.21.15.72:0/2107015442 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea3c1a6c30 con 0x7fea3c1044b0 2024-03-30T15:10:09.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.303+0000 7fea42777700 1 -- 172.21.15.72:0/2107015442 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea3c04ff00 con 0x7fea3c1044b0 2024-03-30T15:10:09.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.307+0000 7fea39ffb700 1 -- 172.21.15.72:0/2107015442 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 21) ==== 91831+0+0 (secure 0 0 0) 0x7fea2c004750 con 0x7fea3c1044b0 2024-03-30T15:10:09.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.307+0000 7fea39ffb700 1 --2- 172.21.15.72:0/2107015442 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fea2806dc40 0x7fea28070100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:10:09.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.307+0000 7fea39ffb700 1 -- 172.21.15.72:0/2107015442 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7537+0+0 (secure 0 0 0) 0x7fea2c08dca0 con 0x7fea3c1044b0 2024-03-30T15:10:09.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.307+0000 7fea33fff700 1 --2- 172.21.15.72:0/2107015442 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fea2806dc40 0x7fea28070100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:10:09.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.307+0000 7fea33fff700 1 --2- 172.21.15.72:0/2107015442 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fea2806dc40 0x7fea28070100 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fea3c114670 tx=0x7fea24009260 comp rx=0 tx=0).ready entity=mgr.14526 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:10:09.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.311+0000 7fea39ffb700 1 -- 172.21.15.72:0/2107015442 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fea2c014030 con 0x7fea3c1044b0 2024-03-30T15:10:09.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.463+0000 7ff9dc4cb700 1 -- 172.21.15.72:0/1113422832 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7ff9d40746d0 con 0x7ff9d4102580 2024-03-30T15:10:09.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.463+0000 7ff9cb7fe700 1 -- 172.21.15.72:0/1113422832 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff9d005bfd0 con 0x7ff9d4102580 2024-03-30T15:10:09.461 INFO:teuthology.orchestra.run.smithi072.stdout:55834574952 2024-03-30T15:10:09.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.463+0000 7ff9dc4cb700 1 -- 172.21.15.72:0/1113422832 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7ff9c006dc40 msgr2=0x7ff9c0070100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:09.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.463+0000 7ff9dc4cb700 1 --2- 172.21.15.72:0/1113422832 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7ff9c006dc40 0x7ff9c0070100 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4009680 tx=0x7ff9c4012040 comp rx=0 tx=0).stop 2024-03-30T15:10:09.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.463+0000 7ff9dc4cb700 1 -- 172.21.15.72:0/1113422832 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9d4102580 msgr2=0x7ff9d4197fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:09.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.463+0000 7ff9dc4cb700 1 --2- 172.21.15.72:0/1113422832 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9d4102580 0x7ff9d4197fb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0006010 tx=0x7ff9d00055f0 comp rx=0 tx=0).stop 2024-03-30T15:10:09.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.463+0000 7ff9dc4cb700 1 -- 172.21.15.72:0/1113422832 shutdown_connections 2024-03-30T15:10:09.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.463+0000 7ff9dc4cb700 1 --2- 172.21.15.72:0/1113422832 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7ff9c006dc40 0x7ff9c0070100 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:09.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.463+0000 7ff9dc4cb700 1 --2- 172.21.15.72:0/1113422832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9d41075b0 0x7ff9d419c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:09.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.463+0000 7ff9dc4cb700 1 --2- 172.21.15.72:0/1113422832 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9d4102580 0x7ff9d4197fb0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:09.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.463+0000 7ff9dc4cb700 1 --2- 172.21.15.72:0/1113422832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9d4102f30 0x7ff9d41984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:09.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.463+0000 7ff9dc4cb700 1 -- 172.21.15.72:0/1113422832 >> 172.21.15.72:0/1113422832 conn(0x7ff9d40793a0 msgr2=0x7ff9d4100190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:10:09.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.463+0000 7ff9dc4cb700 1 -- 172.21.15.72:0/1113422832 shutdown_connections 2024-03-30T15:10:09.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.463+0000 7ff9dc4cb700 1 -- 172.21.15.72:0/1113422832 wait complete. 2024-03-30T15:10:09.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.551+0000 7fea42777700 1 -- 172.21.15.72:0/2107015442 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fea3c19b410 con 0x7fea3c1044b0 2024-03-30T15:10:09.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.551+0000 7fea39ffb700 1 -- 172.21.15.72:0/2107015442 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fea2c05b220 con 0x7fea3c1044b0 2024-03-30T15:10:09.550 INFO:teuthology.orchestra.run.smithi072.stdout:34359738483 2024-03-30T15:10:09.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.555+0000 7fea42777700 1 -- 172.21.15.72:0/2107015442 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fea2806dc40 msgr2=0x7fea28070100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:09.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.555+0000 7fea42777700 1 --2- 172.21.15.72:0/2107015442 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fea2806dc40 0x7fea28070100 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fea3c114670 tx=0x7fea24009260 comp rx=0 tx=0).stop 2024-03-30T15:10:09.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.555+0000 7fea42777700 1 -- 172.21.15.72:0/2107015442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea3c1044b0 msgr2=0x7fea3c19a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:09.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.555+0000 7fea42777700 1 --2- 172.21.15.72:0/2107015442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea3c1044b0 0x7fea3c19a100 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fea2c00c920 tx=0x7fea2c00cc30 comp rx=0 tx=0).stop 2024-03-30T15:10:09.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.555+0000 7fea42777700 1 -- 172.21.15.72:0/2107015442 shutdown_connections 2024-03-30T15:10:09.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.555+0000 7fea42777700 1 --2- 172.21.15.72:0/2107015442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea3c10a560 0x7fea3c19e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:09.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.555+0000 7fea42777700 1 --2- 172.21.15.72:0/2107015442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea3c1044b0 0x7fea3c19a100 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:09.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.555+0000 7fea42777700 1 --2- 172.21.15.72:0/2107015442 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fea2806dc40 0x7fea28070100 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:09.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.555+0000 7fea42777700 1 --2- 172.21.15.72:0/2107015442 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea3c104e70 0x7fea3c19a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:09.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.555+0000 7fea42777700 1 -- 172.21.15.72:0/2107015442 >> 172.21.15.72:0/2107015442 conn(0x7fea3c0fffa0 msgr2=0x7fea3c108060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:10:09.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.555+0000 7fea42777700 1 -- 172.21.15.72:0/2107015442 shutdown_connections 2024-03-30T15:10:09.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.555+0000 7fea42777700 1 -- 172.21.15.72:0/2107015442 wait complete. 2024-03-30T15:10:09.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.775+0000 7f0124584700 1 -- 172.21.15.72:0/1710936970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f011c107260 msgr2=0x7f011c107640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:09.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.775+0000 7f0124584700 1 --2- 172.21.15.72:0/1710936970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f011c107260 0x7f011c107640 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f011400b0d0 tx=0x7f011400b3e0 comp rx=0 tx=0).stop 2024-03-30T15:10:09.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.775+0000 7f0124584700 1 -- 172.21.15.72:0/1710936970 shutdown_connections 2024-03-30T15:10:09.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.775+0000 7f0124584700 1 --2- 172.21.15.72:0/1710936970 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f011c101150 0x7f011c10f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:09.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.775+0000 7f0124584700 1 --2- 172.21.15.72:0/1710936970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f011c107260 0x7f011c107640 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:09.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.775+0000 7f0124584700 1 --2- 172.21.15.72:0/1710936970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f011c100790 0x7f011c100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:09.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.775+0000 7f0124584700 1 -- 172.21.15.72:0/1710936970 >> 172.21.15.72:0/1710936970 conn(0x7f011c077740 msgr2=0x7f011c0feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:10:09.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.775+0000 7f0124584700 1 -- 172.21.15.72:0/1710936970 shutdown_connections 2024-03-30T15:10:09.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.775+0000 7f0124584700 1 -- 172.21.15.72:0/1710936970 wait complete. 2024-03-30T15:10:09.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.775+0000 7f0124584700 1 Processor -- start 2024-03-30T15:10:09.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.775+0000 7f0124584700 1 -- start start 2024-03-30T15:10:09.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.775+0000 7f0124584700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f011c100790 0x7f011c198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:10:09.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.775+0000 7f0124584700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f011c101150 0x7f011c198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:10:09.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.775+0000 7f0124584700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f011c107260 0x7f011c19c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:10:09.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.775+0000 7f0124584700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f011c111b50 con 0x7f011c107260 2024-03-30T15:10:09.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.775+0000 7f0124584700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f011c1119d0 con 0x7f011c101150 2024-03-30T15:10:09.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.775+0000 7f0124584700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f011c111cd0 con 0x7f011c100790 2024-03-30T15:10:09.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.775+0000 7f0122320700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f011c100790 0x7f011c198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:10:09.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.775+0000 7f0122b21700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f011c107260 0x7f011c19c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:10:09.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.775+0000 7f0122320700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f011c100790 0x7f011c198030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:49174/0 (socket says 172.21.15.72:49174) 2024-03-30T15:10:09.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.775+0000 7f0122320700 1 -- 172.21.15.72:0/1936469521 learned_addr learned my addr 172.21.15.72:0/1936469521 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T15:10:09.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.775+0000 7f0122b21700 1 -- 172.21.15.72:0/1936469521 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f011c100790 msgr2=0x7f011c198030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:09.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.775+0000 7f0122b21700 1 --2- 172.21.15.72:0/1936469521 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f011c100790 0x7f011c198030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:09.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.775+0000 7f0122b21700 1 -- 172.21.15.72:0/1936469521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f011c101150 msgr2=0x7f011c198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:09.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.775+0000 7f0122b21700 1 --2- 172.21.15.72:0/1936469521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f011c101150 0x7f011c198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:09.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.775+0000 7f0122b21700 1 -- 172.21.15.72:0/1936469521 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f011c19d040 con 0x7f011c107260 2024-03-30T15:10:09.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.775+0000 7f0122320700 1 --2- 172.21.15.72:0/1936469521 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f011c100790 0x7f011c198030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T15:10:09.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.779+0000 7f0122b21700 1 --2- 172.21.15.72:0/1936469521 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f011c107260 0x7f011c19c900 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f011800e970 tx=0x7f011800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:10:09.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.779+0000 7f010f7fe700 1 -- 172.21.15.72:0/1936469521 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01180095c0 con 0x7f011c107260 2024-03-30T15:10:09.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.779+0000 7f010f7fe700 1 -- 172.21.15.72:0/1936469521 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f0118004830 con 0x7f011c107260 2024-03-30T15:10:09.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.779+0000 7f0124584700 1 -- 172.21.15.72:0/1936469521 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f011c19d330 con 0x7f011c107260 2024-03-30T15:10:09.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.779+0000 7f010f7fe700 1 -- 172.21.15.72:0/1936469521 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f011800cc30 con 0x7f011c107260 2024-03-30T15:10:09.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.779+0000 7f0124584700 1 -- 172.21.15.72:0/1936469521 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f011c1a4bb0 con 0x7f011c107260 2024-03-30T15:10:09.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.779+0000 7f010d7fa700 1 -- 172.21.15.72:0/1936469521 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0104005120 con 0x7f011c107260 2024-03-30T15:10:09.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.779+0000 7f010f7fe700 1 -- 172.21.15.72:0/1936469521 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 21) ==== 91831+0+0 (secure 0 0 0) 0x7f0118004220 con 0x7f011c107260 2024-03-30T15:10:09.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.779+0000 7f010f7fe700 1 --2- 172.21.15.72:0/1936469521 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f010806dc40 0x7f0108070100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:10:09.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.779+0000 7f010f7fe700 1 -- 172.21.15.72:0/1936469521 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7537+0+0 (secure 0 0 0) 0x7f011808dd90 con 0x7f011c107260 2024-03-30T15:10:09.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.779+0000 7f0122320700 1 --2- 172.21.15.72:0/1936469521 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f010806dc40 0x7f0108070100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:10:09.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.779+0000 7f0122320700 1 --2- 172.21.15.72:0/1936469521 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f010806dc40 0x7f0108070100 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0114009fd0 tx=0x7f011400b040 comp rx=0 tx=0).ready entity=mgr.14526 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:10:09.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.783+0000 7f010f7fe700 1 -- 172.21.15.72:0/1936469521 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f011805b370 con 0x7f011c107260 2024-03-30T15:10:09.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.987+0000 7f010d7fa700 1 -- 172.21.15.72:0/1936469521 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f01040056e0 con 0x7f011c107260 2024-03-30T15:10:09.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.987+0000 7f010f7fe700 1 -- 172.21.15.72:0/1936469521 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f011805edc0 con 0x7f011c107260 2024-03-30T15:10:09.987 INFO:teuthology.orchestra.run.smithi072.stdout:128849018951 2024-03-30T15:10:09.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.991+0000 7f010d7fa700 1 -- 172.21.15.72:0/1936469521 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f010806dc40 msgr2=0x7f0108070100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:09.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.991+0000 7f010d7fa700 1 --2- 172.21.15.72:0/1936469521 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f010806dc40 0x7f0108070100 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0114009fd0 tx=0x7f011400b040 comp rx=0 tx=0).stop 2024-03-30T15:10:09.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.991+0000 7f010d7fa700 1 -- 172.21.15.72:0/1936469521 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f011c107260 msgr2=0x7f011c19c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:09.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.991+0000 7f010d7fa700 1 --2- 172.21.15.72:0/1936469521 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f011c107260 0x7f011c19c900 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f011800e970 tx=0x7f011800ec80 comp rx=0 tx=0).stop 2024-03-30T15:10:09.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.991+0000 7f010d7fa700 1 -- 172.21.15.72:0/1936469521 shutdown_connections 2024-03-30T15:10:09.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.991+0000 7f010d7fa700 1 --2- 172.21.15.72:0/1936469521 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f011c107260 0x7f011c19c900 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:09.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.991+0000 7f010d7fa700 1 --2- 172.21.15.72:0/1936469521 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f011c100790 0x7f011c198030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:09.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.991+0000 7f010d7fa700 1 --2- 172.21.15.72:0/1936469521 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f010806dc40 0x7f0108070100 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:09.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.991+0000 7f010d7fa700 1 --2- 172.21.15.72:0/1936469521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f011c101150 0x7f011c198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:09.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.991+0000 7f010d7fa700 1 -- 172.21.15.72:0/1936469521 >> 172.21.15.72:0/1936469521 conn(0x7f011c077740 msgr2=0x7f011c104d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:10:09.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.991+0000 7f010d7fa700 1 -- 172.21.15.72:0/1936469521 shutdown_connections 2024-03-30T15:10:09.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:09.991+0000 7f010d7fa700 1 -- 172.21.15.72:0/1936469521 wait complete. 2024-03-30T15:10:10.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:09 smithi072 bash[21573]: audit 2024-03-30T15:10:08.979872+0000 mon.a (mon.0) 868 : audit 0 from='client.? 172.21.15.72:0/717773189' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-03-30T15:10:10.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:09 smithi072 bash[21573]: audit 2024-03-30T15:10:09.466019+0000 mon.c (mon.2) 78 : audit 0 from='client.? 172.21.15.72:0/1113422832' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-03-30T15:10:10.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:09 smithi072 bash[21573]: audit 2024-03-30T15:10:09.554866+0000 mon.a (mon.0) 869 : audit 0 from='client.? 172.21.15.72:0/2107015442' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-03-30T15:10:10.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:09 smithi072 bash[28946]: audit 2024-03-30T15:10:08.979872+0000 mon.a (mon.0) 868 : audit 0 from='client.? 172.21.15.72:0/717773189' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-03-30T15:10:10.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:09 smithi072 bash[28946]: audit 2024-03-30T15:10:09.466019+0000 mon.c (mon.2) 78 : audit 0 from='client.? 172.21.15.72:0/1113422832' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-03-30T15:10:10.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:09 smithi072 bash[28946]: audit 2024-03-30T15:10:09.554866+0000 mon.a (mon.0) 869 : audit 0 from='client.? 172.21.15.72:0/2107015442' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-03-30T15:10:10.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:09 smithi172 bash[23680]: audit 2024-03-30T15:10:08.979872+0000 mon.a (mon.0) 868 : audit 0 from='client.? 172.21.15.72:0/717773189' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-03-30T15:10:10.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:09 smithi172 bash[23680]: audit 2024-03-30T15:10:09.466019+0000 mon.c (mon.2) 78 : audit 0 from='client.? 172.21.15.72:0/1113422832' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-03-30T15:10:10.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:09 smithi172 bash[23680]: audit 2024-03-30T15:10:09.554866+0000 mon.a (mon.0) 869 : audit 0 from='client.? 172.21.15.72:0/2107015442' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-03-30T15:10:11.167 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:10:11 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:10:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:10:11.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:10 smithi072 bash[21573]: cluster 2024-03-30T15:10:09.779945+0000 mgr.y (mgr.14526) 95 : cluster 0 pgmap v53: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:10:11.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:10 smithi072 bash[21573]: audit 2024-03-30T15:10:09.992323+0000 mon.a (mon.0) 870 : audit 0 from='client.? 172.21.15.72:0/1936469521' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-03-30T15:10:11.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:10 smithi072 bash[28946]: cluster 2024-03-30T15:10:09.779945+0000 mgr.y (mgr.14526) 95 : cluster 0 pgmap v53: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:10:11.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:10 smithi072 bash[28946]: audit 2024-03-30T15:10:09.992323+0000 mon.a (mon.0) 870 : audit 0 from='client.? 172.21.15.72:0/1936469521' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-03-30T15:10:11.216 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:10:10 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:10:11.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:10 smithi172 bash[23680]: cluster 2024-03-30T15:10:09.779945+0000 mgr.y (mgr.14526) 95 : cluster 0 pgmap v53: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:10:11.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:10 smithi172 bash[23680]: audit 2024-03-30T15:10:09.992323+0000 mon.a (mon.0) 870 : audit 0 from='client.? 172.21.15.72:0/1936469521' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-03-30T15:10:12.128 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:11 smithi072 bash[21573]: audit 2024-03-30T15:10:10.831749+0000 mgr.y (mgr.14526) 96 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:10:12.128 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:12 smithi072 bash[28946]: audit 2024-03-30T15:10:10.831749+0000 mgr.y (mgr.14526) 96 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:10:12.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:11 smithi172 bash[23680]: audit 2024-03-30T15:10:10.831749+0000 mgr.y (mgr.14526) 96 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:10:12.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.287+0000 7f349b39b700 1 -- 172.21.15.72:0/2443231017 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f349410a550 msgr2=0x7f349410a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:12.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.287+0000 7f349b39b700 1 --2- 172.21.15.72:0/2443231017 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f349410a550 0x7f349410a930 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f34840098f0 tx=0x7f3484009c00 comp rx=0 tx=0).stop 2024-03-30T15:10:12.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.287+0000 7f349b39b700 1 -- 172.21.15.72:0/2443231017 shutdown_connections 2024-03-30T15:10:12.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.287+0000 7f349b39b700 1 --2- 172.21.15.72:0/2443231017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3494104e60 0x7f3494111320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:12.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.287+0000 7f349b39b700 1 --2- 172.21.15.72:0/2443231017 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f349410a550 0x7f349410a930 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:12.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.287+0000 7f349b39b700 1 --2- 172.21.15.72:0/2443231017 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34941044a0 0x7f3494104920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:12.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.287+0000 7f349b39b700 1 -- 172.21.15.72:0/2443231017 >> 172.21.15.72:0/2443231017 conn(0x7f34940fff70 msgr2=0x7f3494102390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:10:12.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.287+0000 7f349b39b700 1 -- 172.21.15.72:0/2443231017 shutdown_connections 2024-03-30T15:10:12.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.287+0000 7f349b39b700 1 -- 172.21.15.72:0/2443231017 wait complete. 2024-03-30T15:10:12.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.291+0000 7f349b39b700 1 Processor -- start 2024-03-30T15:10:12.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.291+0000 7f349b39b700 1 -- start start 2024-03-30T15:10:12.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.291+0000 7f349b39b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34941044a0 0x7f349419a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:10:12.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.291+0000 7f349b39b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3494104e60 0x7f349419a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:10:12.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.291+0000 7f349b39b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f349410a550 0x7f349419ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:10:12.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.291+0000 7f349b39b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f3494113c40 con 0x7f349410a550 2024-03-30T15:10:12.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.291+0000 7f3499137700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34941044a0 0x7f349419a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:10:12.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.291+0000 7f3499938700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f349410a550 0x7f349419ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:10:12.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.291+0000 7f3499938700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f349410a550 0x7f349419ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57344/0 (socket says 172.21.15.72:57344) 2024-03-30T15:10:12.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.291+0000 7f3499938700 1 -- 172.21.15.72:0/614122484 learned_addr learned my addr 172.21.15.72:0/614122484 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T15:10:12.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.291+0000 7f349b39b700 1 -- 172.21.15.72:0/614122484 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3494113ac0 con 0x7f3494104e60 2024-03-30T15:10:12.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.291+0000 7f349b39b700 1 -- 172.21.15.72:0/614122484 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f3494113dc0 con 0x7f34941044a0 2024-03-30T15:10:12.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.291+0000 7f3498936700 1 --2- 172.21.15.72:0/614122484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3494104e60 0x7f349419a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:10:12.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.291+0000 7f3499938700 1 -- 172.21.15.72:0/614122484 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34941044a0 msgr2=0x7f349419a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:12.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.291+0000 7f3499938700 1 --2- 172.21.15.72:0/614122484 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34941044a0 0x7f349419a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:12.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.291+0000 7f3499938700 1 -- 172.21.15.72:0/614122484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3494104e60 msgr2=0x7f349419a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:12.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.291+0000 7f3499938700 1 --2- 172.21.15.72:0/614122484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3494104e60 0x7f349419a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:12.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.291+0000 7f3499938700 1 -- 172.21.15.72:0/614122484 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f349419f1b0 con 0x7f349410a550 2024-03-30T15:10:12.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.291+0000 7f3499137700 1 --2- 172.21.15.72:0/614122484 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34941044a0 0x7f349419a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T15:10:12.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.291+0000 7f3499938700 1 --2- 172.21.15.72:0/614122484 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f349410a550 0x7f349419ea70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f348c00ada0 tx=0x7f348c00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:10:12.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.291+0000 7f34927fc700 1 -- 172.21.15.72:0/614122484 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348c017020 con 0x7f349410a550 2024-03-30T15:10:12.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.291+0000 7f34927fc700 1 -- 172.21.15.72:0/614122484 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f348c00ce00 con 0x7f349410a550 2024-03-30T15:10:12.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.291+0000 7f349b39b700 1 -- 172.21.15.72:0/614122484 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f349419f4a0 con 0x7f349410a550 2024-03-30T15:10:12.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.291+0000 7f34927fc700 1 -- 172.21.15.72:0/614122484 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348c005280 con 0x7f349410a550 2024-03-30T15:10:12.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.291+0000 7f349b39b700 1 -- 172.21.15.72:0/614122484 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34941a6d20 con 0x7f349410a550 2024-03-30T15:10:12.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.291+0000 7f349b39b700 1 -- 172.21.15.72:0/614122484 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f349404ff00 con 0x7f349410a550 2024-03-30T15:10:12.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.291+0000 7f34927fc700 1 -- 172.21.15.72:0/614122484 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 21) ==== 91831+0+0 (secure 0 0 0) 0x7f348c00c980 con 0x7f349410a550 2024-03-30T15:10:12.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.291+0000 7f34927fc700 1 --2- 172.21.15.72:0/614122484 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f347c06dc40 0x7f347c070100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:10:12.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.295+0000 7f34927fc700 1 -- 172.21.15.72:0/614122484 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7537+0+0 (secure 0 0 0) 0x7f348c08d810 con 0x7f349410a550 2024-03-30T15:10:12.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.295+0000 7f3499137700 1 --2- 172.21.15.72:0/614122484 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f347c06dc40 0x7f347c070100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:10:12.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.295+0000 7f3499137700 1 --2- 172.21.15.72:0/614122484 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f347c06dc40 0x7f347c070100 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3484005e90 tx=0x7f3484019040 comp rx=0 tx=0).ready entity=mgr.14526 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:10:12.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.299+0000 7f34927fc700 1 -- 172.21.15.72:0/614122484 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f348c021020 con 0x7f349410a550 2024-03-30T15:10:12.492 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495663 got 197568495667 for osd.6 2024-03-30T15:10:12.492 DEBUG:teuthology.parallel:result is None 2024-03-30T15:10:12.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.511+0000 7f349b39b700 1 -- 172.21.15.72:0/614122484 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f34941a6fb0 con 0x7f349410a550 2024-03-30T15:10:12.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.511+0000 7f34927fc700 1 -- 172.21.15.72:0/614122484 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f348c05ae70 con 0x7f349410a550 2024-03-30T15:10:12.511 INFO:teuthology.orchestra.run.smithi072.stdout:107374182484 2024-03-30T15:10:12.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.515+0000 7f349b39b700 1 -- 172.21.15.72:0/614122484 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f347c06dc40 msgr2=0x7f347c070100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:12.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.515+0000 7f349b39b700 1 --2- 172.21.15.72:0/614122484 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f347c06dc40 0x7f347c070100 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3484005e90 tx=0x7f3484019040 comp rx=0 tx=0).stop 2024-03-30T15:10:12.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.515+0000 7f349b39b700 1 -- 172.21.15.72:0/614122484 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f349410a550 msgr2=0x7f349419ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:12.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.515+0000 7f349b39b700 1 --2- 172.21.15.72:0/614122484 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f349410a550 0x7f349419ea70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f348c00ada0 tx=0x7f348c00c330 comp rx=0 tx=0).stop 2024-03-30T15:10:12.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.515+0000 7f349b39b700 1 -- 172.21.15.72:0/614122484 shutdown_connections 2024-03-30T15:10:12.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.515+0000 7f349b39b700 1 --2- 172.21.15.72:0/614122484 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f349410a550 0x7f349419ea70 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:12.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.515+0000 7f349b39b700 1 --2- 172.21.15.72:0/614122484 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34941044a0 0x7f349419a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:12.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.515+0000 7f349b39b700 1 --2- 172.21.15.72:0/614122484 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f347c06dc40 0x7f347c070100 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:12.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.515+0000 7f349b39b700 1 --2- 172.21.15.72:0/614122484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3494104e60 0x7f349419a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:12.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.515+0000 7f349b39b700 1 -- 172.21.15.72:0/614122484 >> 172.21.15.72:0/614122484 conn(0x7f34940fff70 msgr2=0x7f3494108050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:10:12.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.515+0000 7f349b39b700 1 -- 172.21.15.72:0/614122484 shutdown_connections 2024-03-30T15:10:12.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:12.515+0000 7f349b39b700 1 -- 172.21.15.72:0/614122484 wait complete. 2024-03-30T15:10:13.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:12 smithi072 bash[21573]: cluster 2024-03-30T15:10:11.780719+0000 mgr.y (mgr.14526) 97 : cluster 0 pgmap v54: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:10:13.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:12 smithi072 bash[21573]: audit 2024-03-30T15:10:12.516254+0000 mon.a (mon.0) 871 : audit 0 from='client.? 172.21.15.72:0/614122484' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-03-30T15:10:13.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:12 smithi072 bash[28946]: cluster 2024-03-30T15:10:11.780719+0000 mgr.y (mgr.14526) 97 : cluster 0 pgmap v54: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:10:13.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:12 smithi072 bash[28946]: audit 2024-03-30T15:10:12.516254+0000 mon.a (mon.0) 871 : audit 0 from='client.? 172.21.15.72:0/614122484' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-03-30T15:10:13.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:12 smithi172 bash[23680]: cluster 2024-03-30T15:10:11.780719+0000 mgr.y (mgr.14526) 97 : cluster 0 pgmap v54: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:10:13.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:12 smithi172 bash[23680]: audit 2024-03-30T15:10:12.516254+0000 mon.a (mon.0) 871 : audit 0 from='client.? 172.21.15.72:0/614122484' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-03-30T15:10:14.602 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738479 got 34359738483 for osd.0 2024-03-30T15:10:14.602 DEBUG:teuthology.parallel:result is None 2024-03-30T15:10:15.038 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:14 smithi072 bash[21573]: cluster 2024-03-30T15:10:13.781395+0000 mgr.y (mgr.14526) 98 : cluster 0 pgmap v55: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:10:15.038 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:14 smithi072 bash[28946]: cluster 2024-03-30T15:10:13.781395+0000 mgr.y (mgr.14526) 98 : cluster 0 pgmap v55: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:10:15.039 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574948 got 55834574952 for osd.1 2024-03-30T15:10:15.039 DEBUG:teuthology.parallel:result is None 2024-03-30T15:10:15.060 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018947 got 128849018951 for osd.4 2024-03-30T15:10:15.060 DEBUG:teuthology.parallel:result is None 2024-03-30T15:10:15.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:14 smithi172 bash[23680]: cluster 2024-03-30T15:10:13.781395+0000 mgr.y (mgr.14526) 98 : cluster 0 pgmap v55: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:10:16.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:15 smithi072 bash[21573]: audit 2024-03-30T15:10:15.065753+0000 mon.c (mon.2) 79 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:10:16.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:15 smithi072 bash[28946]: audit 2024-03-30T15:10:15.065753+0000 mon.c (mon.2) 79 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:10:16.198 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182479 got 107374182484 for osd.3 2024-03-30T15:10:16.198 DEBUG:teuthology.parallel:result is None 2024-03-30T15:10:16.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:15 smithi172 bash[23680]: audit 2024-03-30T15:10:15.065753+0000 mon.c (mon.2) 79 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:10:16.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.339+0000 7f3c5b3e1700 1 -- 172.21.15.72:0/833620170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c54101b60 msgr2=0x7f3c5410dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:16.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.339+0000 7f3c5b3e1700 1 --2- 172.21.15.72:0/833620170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c54101b60 0x7f3c5410dfd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c009f90 tx=0x7f3c4c00b330 comp rx=0 tx=0).stop 2024-03-30T15:10:16.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.339+0000 7f3c5b3e1700 1 -- 172.21.15.72:0/833620170 shutdown_connections 2024-03-30T15:10:16.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.339+0000 7f3c5b3e1700 1 --2- 172.21.15.72:0/833620170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c54101b60 0x7f3c5410dfd0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:16.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.339+0000 7f3c5b3e1700 1 --2- 172.21.15.72:0/833620170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c54107220 0x7f3c54107600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:16.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.339+0000 7f3c5b3e1700 1 --2- 172.21.15.72:0/833620170 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3c541011a0 0x7f3c54101620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:16.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.339+0000 7f3c5b3e1700 1 -- 172.21.15.72:0/833620170 >> 172.21.15.72:0/833620170 conn(0x7f3c540771e0 msgr2=0x7f3c540775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:10:16.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.339+0000 7f3c5b3e1700 1 -- 172.21.15.72:0/833620170 shutdown_connections 2024-03-30T15:10:16.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.339+0000 7f3c5b3e1700 1 -- 172.21.15.72:0/833620170 wait complete. 2024-03-30T15:10:16.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.339+0000 7f3c5b3e1700 1 Processor -- start 2024-03-30T15:10:16.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.339+0000 7f3c5b3e1700 1 -- start start 2024-03-30T15:10:16.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.339+0000 7f3c5b3e1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3c541011a0 0x7f3c5419a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:10:16.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.339+0000 7f3c5b3e1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c54101b60 0x7f3c5419a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:10:16.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.339+0000 7f3c5b3e1700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c54107220 0x7f3c5419e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:10:16.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.339+0000 7f3c5b3e1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f3c541108e0 con 0x7f3c54101b60 2024-03-30T15:10:16.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.339+0000 7f3c5b3e1700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3c54110760 con 0x7f3c54107220 2024-03-30T15:10:16.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.339+0000 7f3c5b3e1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f3c54110a60 con 0x7f3c541011a0 2024-03-30T15:10:16.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.339+0000 7f3c5897c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c54101b60 0x7f3c5419a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:10:16.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.339+0000 7f3c5897c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c54101b60 0x7f3c5419a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57362/0 (socket says 172.21.15.72:57362) 2024-03-30T15:10:16.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.339+0000 7f3c5897c700 1 -- 172.21.15.72:0/3452072329 learned_addr learned my addr 172.21.15.72:0/3452072329 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T15:10:16.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.339+0000 7f3c5917d700 1 --2- 172.21.15.72:0/3452072329 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3c541011a0 0x7f3c5419a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:10:16.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.339+0000 7f3c5897c700 1 -- 172.21.15.72:0/3452072329 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3c541011a0 msgr2=0x7f3c5419a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:16.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.339+0000 7f3c5897c700 1 --2- 172.21.15.72:0/3452072329 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3c541011a0 0x7f3c5419a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:16.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.339+0000 7f3c5897c700 1 -- 172.21.15.72:0/3452072329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c54107220 msgr2=0x7f3c5419e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:16.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.339+0000 7f3c5897c700 1 --2- 172.21.15.72:0/3452072329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c54107220 0x7f3c5419e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:16.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.339+0000 7f3c5897c700 1 -- 172.21.15.72:0/3452072329 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c5419f080 con 0x7f3c54101b60 2024-03-30T15:10:16.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.339+0000 7f3c5897c700 1 --2- 172.21.15.72:0/3452072329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c54101b60 0x7f3c5419a5b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3c4400ec10 tx=0x7f3c4400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:10:16.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.339+0000 7f3c4a7fc700 1 -- 172.21.15.72:0/3452072329 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c4400cd40 con 0x7f3c54101b60 2024-03-30T15:10:16.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.339+0000 7f3c4a7fc700 1 -- 172.21.15.72:0/3452072329 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f3c440044a0 con 0x7f3c54101b60 2024-03-30T15:10:16.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.339+0000 7f3c4a7fc700 1 -- 172.21.15.72:0/3452072329 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c44010430 con 0x7f3c54101b60 2024-03-30T15:10:16.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.339+0000 7f3c5b3e1700 1 -- 172.21.15.72:0/3452072329 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c5419f370 con 0x7f3c54101b60 2024-03-30T15:10:16.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.339+0000 7f3c5b3e1700 1 -- 172.21.15.72:0/3452072329 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c541a6bf0 con 0x7f3c54101b60 2024-03-30T15:10:16.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.339+0000 7f3c5b3e1700 1 -- 172.21.15.72:0/3452072329 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c5404ff00 con 0x7f3c54101b60 2024-03-30T15:10:16.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.343+0000 7f3c4a7fc700 1 -- 172.21.15.72:0/3452072329 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 21) ==== 91831+0+0 (secure 0 0 0) 0x7f3c44004020 con 0x7f3c54101b60 2024-03-30T15:10:16.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.343+0000 7f3c4a7fc700 1 --2- 172.21.15.72:0/3452072329 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f3c4006dc40 0x7f3c40070100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:10:16.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.343+0000 7f3c4a7fc700 1 -- 172.21.15.72:0/3452072329 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7537+0+0 (secure 0 0 0) 0x7f3c4408e400 con 0x7f3c54101b60 2024-03-30T15:10:16.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.343+0000 7f3c5917d700 1 --2- 172.21.15.72:0/3452072329 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f3c4006dc40 0x7f3c40070100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:10:16.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.343+0000 7f3c5917d700 1 --2- 172.21.15.72:0/3452072329 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f3c4006dc40 0x7f3c40070100 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3c50005950 tx=0x7f3c5000a300 comp rx=0 tx=0).ready entity=mgr.14526 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:10:16.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.347+0000 7f3c4a7fc700 1 -- 172.21.15.72:0/3452072329 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f3c4405ba00 con 0x7f3c54101b60 2024-03-30T15:10:16.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.363+0000 7f9496c7b700 1 -- 172.21.15.72:0/3397690839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9490106500 msgr2=0x7f949010e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:16.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.363+0000 7f9496c7b700 1 --2- 172.21.15.72:0/3397690839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9490106500 0x7f949010e0d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f948800b0d0 tx=0x7f948800b3e0 comp rx=0 tx=0).stop 2024-03-30T15:10:16.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.363+0000 7f9496c7b700 1 -- 172.21.15.72:0/3397690839 shutdown_connections 2024-03-30T15:10:16.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.363+0000 7f9496c7b700 1 --2- 172.21.15.72:0/3397690839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9490106500 0x7f949010e0d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:16.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.363+0000 7f9496c7b700 1 --2- 172.21.15.72:0/3397690839 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9490101420 0x7f9490101800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:16.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.363+0000 7f9496c7b700 1 --2- 172.21.15.72:0/3397690839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9490101dd0 0x7f9490105e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:16.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.363+0000 7f9496c7b700 1 -- 172.21.15.72:0/3397690839 >> 172.21.15.72:0/3397690839 conn(0x7f9490078240 msgr2=0x7f9490078650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:10:16.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.363+0000 7f9496c7b700 1 -- 172.21.15.72:0/3397690839 shutdown_connections 2024-03-30T15:10:16.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.363+0000 7f9496c7b700 1 -- 172.21.15.72:0/3397690839 wait complete. 2024-03-30T15:10:16.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.367+0000 7f9496c7b700 1 Processor -- start 2024-03-30T15:10:16.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.367+0000 7f9496c7b700 1 -- start start 2024-03-30T15:10:16.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.367+0000 7f9496c7b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9490101420 0x7f9490195ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:10:16.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.367+0000 7f9496c7b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9490101dd0 0x7f9490196410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:10:16.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.367+0000 7f9496c7b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9490106500 0x7f949019a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:10:16.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.367+0000 7f9496c7b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f949010f950 con 0x7f9490101dd0 2024-03-30T15:10:16.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.367+0000 7f9496c7b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f949010f7d0 con 0x7f9490106500 2024-03-30T15:10:16.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.367+0000 7f9496c7b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f949010fad0 con 0x7f9490101420 2024-03-30T15:10:16.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.367+0000 7f9494a17700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9490101420 0x7f9490195ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:10:16.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.367+0000 7f948ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9490101dd0 0x7f9490196410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:10:16.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.367+0000 7f948ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9490101dd0 0x7f9490196410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57380/0 (socket says 172.21.15.72:57380) 2024-03-30T15:10:16.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.367+0000 7f948ffff700 1 -- 172.21.15.72:0/3830072554 learned_addr learned my addr 172.21.15.72:0/3830072554 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T15:10:16.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.367+0000 7f9495218700 1 --2- 172.21.15.72:0/3830072554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9490106500 0x7f949019a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:10:16.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.367+0000 7f9494a17700 1 -- 172.21.15.72:0/3830072554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9490106500 msgr2=0x7f949019a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:16.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.367+0000 7f9494a17700 1 --2- 172.21.15.72:0/3830072554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9490106500 0x7f949019a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:16.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.367+0000 7f9494a17700 1 -- 172.21.15.72:0/3830072554 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9490101dd0 msgr2=0x7f9490196410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:16.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.367+0000 7f9494a17700 1 --2- 172.21.15.72:0/3830072554 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9490101dd0 0x7f9490196410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:16.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.367+0000 7f9494a17700 1 -- 172.21.15.72:0/3830072554 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f949019aee0 con 0x7f9490101420 2024-03-30T15:10:16.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.367+0000 7f9494a17700 1 --2- 172.21.15.72:0/3830072554 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9490101420 0x7f9490195ed0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f948400b450 tx=0x7f948400b760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:10:16.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.367+0000 7f948dffb700 1 -- 172.21.15.72:0/3830072554 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9484015020 con 0x7f9490101420 2024-03-30T15:10:16.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.367+0000 7f9496c7b700 1 -- 172.21.15.72:0/3830072554 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f949019b1d0 con 0x7f9490101420 2024-03-30T15:10:16.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.367+0000 7f9496c7b700 1 -- 172.21.15.72:0/3830072554 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f94901a2a50 con 0x7f9490101420 2024-03-30T15:10:16.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.367+0000 7f948dffb700 1 -- 172.21.15.72:0/3830072554 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f9484011cb0 con 0x7f9490101420 2024-03-30T15:10:16.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.367+0000 7f948dffb700 1 -- 172.21.15.72:0/3830072554 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9484010b90 con 0x7f9490101420 2024-03-30T15:10:16.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.367+0000 7f948ffff700 1 --2- 172.21.15.72:0/3830072554 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9490101dd0 0x7f9490196410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T15:10:16.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.367+0000 7f9496c7b700 1 -- 172.21.15.72:0/3830072554 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9474005120 con 0x7f9490101420 2024-03-30T15:10:16.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.371+0000 7f948dffb700 1 -- 172.21.15.72:0/3830072554 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 21) ==== 91831+0+0 (secure 0 0 0) 0x7f9484018020 con 0x7f9490101420 2024-03-30T15:10:16.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.371+0000 7f948dffb700 1 --2- 172.21.15.72:0/3830072554 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f94800720a0 0x7f9480074560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:10:16.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.371+0000 7f948dffb700 1 -- 172.21.15.72:0/3830072554 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(74..74 src has 1..74) ==== 7537+0+0 (secure 0 0 0) 0x7f948408d770 con 0x7f9490101420 2024-03-30T15:10:16.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.371+0000 7f948ffff700 1 --2- 172.21.15.72:0/3830072554 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f94800720a0 0x7f9480074560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:10:16.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.371+0000 7f948ffff700 1 --2- 172.21.15.72:0/3830072554 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f94800720a0 0x7f9480074560 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9490100e40 tx=0x7f947c00b480 comp rx=0 tx=0).ready entity=mgr.14526 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:10:16.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.375+0000 7f948dffb700 1 -- 172.21.15.72:0/3830072554 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f948401f020 con 0x7f9490101420 2024-03-30T15:10:16.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.499+0000 7efdedddb700 1 -- 172.21.15.72:0/1777393455 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efde8102520 msgr2=0x7efde8102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:16.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.499+0000 7efdedddb700 1 --2- 172.21.15.72:0/1777393455 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efde8102520 0x7efde8102900 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efdd80099c0 tx=0x7efdd8009cd0 comp rx=0 tx=0).stop 2024-03-30T15:10:16.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.499+0000 7efdedddb700 1 -- 172.21.15.72:0/1777393455 shutdown_connections 2024-03-30T15:10:16.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.499+0000 7efdedddb700 1 --2- 172.21.15.72:0/1777393455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efde81075a0 0x7efde810f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:16.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.499+0000 7efdedddb700 1 --2- 172.21.15.72:0/1777393455 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efde8102520 0x7efde8102900 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:16.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.499+0000 7efdedddb700 1 --2- 172.21.15.72:0/1777393455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efde8102ed0 0x7efde8106ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:16.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.499+0000 7efdedddb700 1 -- 172.21.15.72:0/1777393455 >> 172.21.15.72:0/1777393455 conn(0x7efde8079360 msgr2=0x7efde8079770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:10:16.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.499+0000 7efdedddb700 1 -- 172.21.15.72:0/1777393455 shutdown_connections 2024-03-30T15:10:16.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.499+0000 7efdedddb700 1 -- 172.21.15.72:0/1777393455 wait complete. 2024-03-30T15:10:16.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.499+0000 7efdedddb700 1 Processor -- start 2024-03-30T15:10:16.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.499+0000 7efdedddb700 1 -- start start 2024-03-30T15:10:16.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.499+0000 7efdedddb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efde8102520 0x7efde8074540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:10:16.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.499+0000 7efdedddb700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efde8102ed0 0x7efde8074a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:10:16.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.499+0000 7efdedddb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efde81075a0 0x7efde8074fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:10:16.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.499+0000 7efdedddb700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7efde8111a20 con 0x7efde81075a0 2024-03-30T15:10:16.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.499+0000 7efdedddb700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efde81118a0 con 0x7efde8102ed0 2024-03-30T15:10:16.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.499+0000 7efdedddb700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7efde8111ba0 con 0x7efde8102520 2024-03-30T15:10:16.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.499+0000 7efde77fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efde8102520 0x7efde8074540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:10:16.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.499+0000 7efde77fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efde8102520 0x7efde8074540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:49270/0 (socket says 172.21.15.72:49270) 2024-03-30T15:10:16.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.499+0000 7efde77fe700 1 -- 172.21.15.72:0/1404763086 learned_addr learned my addr 172.21.15.72:0/1404763086 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T15:10:16.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.503+0000 7efde6ffd700 1 --2- 172.21.15.72:0/1404763086 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efde8102ed0 0x7efde8074a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:10:16.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.503+0000 7efde7fff700 1 --2- 172.21.15.72:0/1404763086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efde81075a0 0x7efde8074fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:10:16.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.503+0000 7efde77fe700 1 -- 172.21.15.72:0/1404763086 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efde8102ed0 msgr2=0x7efde8074a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:16.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.503+0000 7efde77fe700 1 --2- 172.21.15.72:0/1404763086 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efde8102ed0 0x7efde8074a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:16.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.503+0000 7efde77fe700 1 -- 172.21.15.72:0/1404763086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efde81075a0 msgr2=0x7efde8074fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:16.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.503+0000 7efde77fe700 1 --2- 172.21.15.72:0/1404763086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efde81075a0 0x7efde8074fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:16.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.503+0000 7efde77fe700 1 -- 172.21.15.72:0/1404763086 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efde81a65f0 con 0x7efde8102520 2024-03-30T15:10:16.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.503+0000 7efde77fe700 1 --2- 172.21.15.72:0/1404763086 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efde8102520 0x7efde8074540 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efdd8006010 tx=0x7efdd80045e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:10:16.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.503+0000 7efde4ff9700 1 -- 172.21.15.72:0/1404763086 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd8026070 con 0x7efde8102520 2024-03-30T15:10:16.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.503+0000 7efde4ff9700 1 -- 172.21.15.72:0/1404763086 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7efdd8003e50 con 0x7efde8102520 2024-03-30T15:10:16.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.503+0000 7efde4ff9700 1 -- 172.21.15.72:0/1404763086 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd800fa50 con 0x7efde8102520 2024-03-30T15:10:16.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.503+0000 7efdedddb700 1 -- 172.21.15.72:0/1404763086 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efde81a6880 con 0x7efde8102520 2024-03-30T15:10:16.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.503+0000 7efdedddb700 1 -- 172.21.15.72:0/1404763086 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efde81a6c80 con 0x7efde8102520 2024-03-30T15:10:16.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.503+0000 7efdedddb700 1 -- 172.21.15.72:0/1404763086 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efde804ff00 con 0x7efde8102520 2024-03-30T15:10:16.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.503+0000 7efde4ff9700 1 -- 172.21.15.72:0/1404763086 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 21) ==== 91831+0+0 (secure 0 0 0) 0x7efdd80039d0 con 0x7efde8102520 2024-03-30T15:10:16.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.503+0000 7efde4ff9700 1 --2- 172.21.15.72:0/1404763086 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7efdd006dc40 0x7efdd0070100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:10:16.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.507+0000 7efde4ff9700 1 -- 172.21.15.72:0/1404763086 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(74..74 src has 1..74) ==== 7537+0+0 (secure 0 0 0) 0x7efdd808ec00 con 0x7efde8102520 2024-03-30T15:10:16.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.507+0000 7efde6ffd700 1 --2- 172.21.15.72:0/1404763086 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7efdd006dc40 0x7efdd0070100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:10:16.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.507+0000 7efde6ffd700 1 --2- 172.21.15.72:0/1404763086 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7efdd006dc40 0x7efdd0070100 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efde8108a20 tx=0x7efddc00a300 comp rx=0 tx=0).ready entity=mgr.14526 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:10:16.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.511+0000 7efde4ff9700 1 -- 172.21.15.72:0/1404763086 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7efdd8095080 con 0x7efde8102520 2024-03-30T15:10:16.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.571+0000 7f3c5b3e1700 1 -- 172.21.15.72:0/3452072329 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f3c541a6e80 con 0x7f3c54101b60 2024-03-30T15:10:16.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.571+0000 7f3c4a7fc700 1 -- 172.21.15.72:0/3452072329 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f3c4405f450 con 0x7f3c54101b60 2024-03-30T15:10:16.571 INFO:teuthology.orchestra.run.smithi072.stdout:163208757312 2024-03-30T15:10:16.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.575+0000 7f3c5b3e1700 1 -- 172.21.15.72:0/3452072329 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f3c4006dc40 msgr2=0x7f3c40070100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:16.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.575+0000 7f3c5b3e1700 1 --2- 172.21.15.72:0/3452072329 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f3c4006dc40 0x7f3c40070100 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3c50005950 tx=0x7f3c5000a300 comp rx=0 tx=0).stop 2024-03-30T15:10:16.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.575+0000 7f3c5b3e1700 1 -- 172.21.15.72:0/3452072329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c54101b60 msgr2=0x7f3c5419a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:16.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.575+0000 7f3c5b3e1700 1 --2- 172.21.15.72:0/3452072329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c54101b60 0x7f3c5419a5b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3c4400ec10 tx=0x7f3c4400ef20 comp rx=0 tx=0).stop 2024-03-30T15:10:16.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.575+0000 7f3c5b3e1700 1 -- 172.21.15.72:0/3452072329 shutdown_connections 2024-03-30T15:10:16.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.575+0000 7f3c5b3e1700 1 --2- 172.21.15.72:0/3452072329 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f3c4006dc40 0x7f3c40070100 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:16.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.575+0000 7f3c5b3e1700 1 --2- 172.21.15.72:0/3452072329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c54107220 0x7f3c5419e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:16.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.575+0000 7f3c5b3e1700 1 --2- 172.21.15.72:0/3452072329 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3c541011a0 0x7f3c5419a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:16.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.575+0000 7f3c5b3e1700 1 --2- 172.21.15.72:0/3452072329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c54101b60 0x7f3c5419a5b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:16.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.575+0000 7f3c5b3e1700 1 -- 172.21.15.72:0/3452072329 >> 172.21.15.72:0/3452072329 conn(0x7f3c540771e0 msgr2=0x7f3c540ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:10:16.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.575+0000 7f3c5b3e1700 1 -- 172.21.15.72:0/3452072329 shutdown_connections 2024-03-30T15:10:16.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.575+0000 7f3c5b3e1700 1 -- 172.21.15.72:0/3452072329 wait complete. 2024-03-30T15:10:16.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.607+0000 7f9496c7b700 1 -- 172.21.15.72:0/3830072554 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f9474005410 con 0x7f9490101420 2024-03-30T15:10:16.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.607+0000 7f948dffb700 1 -- 172.21.15.72:0/3830072554 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f948405ad30 con 0x7f9490101420 2024-03-30T15:10:16.607 INFO:teuthology.orchestra.run.smithi072.stdout:231928234026 2024-03-30T15:10:16.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.611+0000 7f9496c7b700 1 -- 172.21.15.72:0/3830072554 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f94800720a0 msgr2=0x7f9480074560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:16.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.611+0000 7f9496c7b700 1 --2- 172.21.15.72:0/3830072554 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f94800720a0 0x7f9480074560 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9490100e40 tx=0x7f947c00b480 comp rx=0 tx=0).stop 2024-03-30T15:10:16.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.611+0000 7f9496c7b700 1 -- 172.21.15.72:0/3830072554 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9490101420 msgr2=0x7f9490195ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:16.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.611+0000 7f9496c7b700 1 --2- 172.21.15.72:0/3830072554 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9490101420 0x7f9490195ed0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f948400b450 tx=0x7f948400b760 comp rx=0 tx=0).stop 2024-03-30T15:10:16.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.611+0000 7f9496c7b700 1 -- 172.21.15.72:0/3830072554 shutdown_connections 2024-03-30T15:10:16.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.611+0000 7f9496c7b700 1 --2- 172.21.15.72:0/3830072554 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f94800720a0 0x7f9480074560 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:16.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.611+0000 7f9496c7b700 1 --2- 172.21.15.72:0/3830072554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9490106500 0x7f949019a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:16.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.611+0000 7f9496c7b700 1 --2- 172.21.15.72:0/3830072554 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9490101420 0x7f9490195ed0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:16.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.611+0000 7f9496c7b700 1 --2- 172.21.15.72:0/3830072554 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9490101dd0 0x7f9490196410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:16.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.611+0000 7f9496c7b700 1 -- 172.21.15.72:0/3830072554 >> 172.21.15.72:0/3830072554 conn(0x7f9490078240 msgr2=0x7f94900fef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:10:16.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.611+0000 7f9496c7b700 1 -- 172.21.15.72:0/3830072554 shutdown_connections 2024-03-30T15:10:16.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.611+0000 7f9496c7b700 1 -- 172.21.15.72:0/3830072554 wait complete. 2024-03-30T15:10:16.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.723+0000 7efdedddb700 1 -- 172.21.15.72:0/1404763086 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7efde81a6f70 con 0x7efde8102520 2024-03-30T15:10:16.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.723+0000 7efde4ff9700 1 -- 172.21.15.72:0/1404763086 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efdd8013070 con 0x7efde8102520 2024-03-30T15:10:16.721 INFO:teuthology.orchestra.run.smithi072.stdout:77309411422 2024-03-30T15:10:16.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.723+0000 7efdedddb700 1 -- 172.21.15.72:0/1404763086 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7efdd006dc40 msgr2=0x7efdd0070100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:16.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.723+0000 7efdedddb700 1 --2- 172.21.15.72:0/1404763086 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7efdd006dc40 0x7efdd0070100 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efde8108a20 tx=0x7efddc00a300 comp rx=0 tx=0).stop 2024-03-30T15:10:16.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.723+0000 7efdedddb700 1 -- 172.21.15.72:0/1404763086 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efde8102520 msgr2=0x7efde8074540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:16.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.723+0000 7efdedddb700 1 --2- 172.21.15.72:0/1404763086 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efde8102520 0x7efde8074540 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efdd8006010 tx=0x7efdd80045e0 comp rx=0 tx=0).stop 2024-03-30T15:10:16.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.727+0000 7efdedddb700 1 -- 172.21.15.72:0/1404763086 shutdown_connections 2024-03-30T15:10:16.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.727+0000 7efdedddb700 1 --2- 172.21.15.72:0/1404763086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efde81075a0 0x7efde8074fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:16.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.727+0000 7efdedddb700 1 --2- 172.21.15.72:0/1404763086 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efde8102520 0x7efde8074540 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:16.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.727+0000 7efdedddb700 1 --2- 172.21.15.72:0/1404763086 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7efdd006dc40 0x7efdd0070100 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:16.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.727+0000 7efdedddb700 1 --2- 172.21.15.72:0/1404763086 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efde8102ed0 0x7efde8074a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:16.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.727+0000 7efdedddb700 1 -- 172.21.15.72:0/1404763086 >> 172.21.15.72:0/1404763086 conn(0x7efde8079360 msgr2=0x7efde8100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:10:16.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.727+0000 7efdedddb700 1 -- 172.21.15.72:0/1404763086 shutdown_connections 2024-03-30T15:10:16.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:16.727+0000 7efdedddb700 1 -- 172.21.15.72:0/1404763086 wait complete. 2024-03-30T15:10:17.188 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:16 smithi072 bash[21573]: cluster 2024-03-30T15:10:15.782791+0000 mgr.y (mgr.14526) 99 : cluster 0 pgmap v56: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:10:17.188 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:16 smithi072 bash[21573]: audit 2024-03-30T15:10:16.575696+0000 mon.a (mon.0) 872 : audit 0 from='client.? 172.21.15.72:0/3452072329' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-03-30T15:10:17.188 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:16 smithi072 bash[21573]: audit 2024-03-30T15:10:16.612444+0000 mon.c (mon.2) 80 : audit 0 from='client.? 172.21.15.72:0/3830072554' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-03-30T15:10:17.188 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:16 smithi072 bash[21573]: audit 2024-03-30T15:10:16.726239+0000 mon.c (mon.2) 81 : audit 0 from='client.? 172.21.15.72:0/1404763086' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-03-30T15:10:17.189 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:16 smithi072 bash[28946]: cluster 2024-03-30T15:10:15.782791+0000 mgr.y (mgr.14526) 99 : cluster 0 pgmap v56: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:10:17.189 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:16 smithi072 bash[28946]: audit 2024-03-30T15:10:16.575696+0000 mon.a (mon.0) 872 : audit 0 from='client.? 172.21.15.72:0/3452072329' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-03-30T15:10:17.189 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:16 smithi072 bash[28946]: audit 2024-03-30T15:10:16.612444+0000 mon.c (mon.2) 80 : audit 0 from='client.? 172.21.15.72:0/3830072554' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-03-30T15:10:17.189 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:16 smithi072 bash[28946]: audit 2024-03-30T15:10:16.726239+0000 mon.c (mon.2) 81 : audit 0 from='client.? 172.21.15.72:0/1404763086' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-03-30T15:10:17.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:16 smithi172 bash[23680]: cluster 2024-03-30T15:10:15.782791+0000 mgr.y (mgr.14526) 99 : cluster 0 pgmap v56: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:10:17.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:16 smithi172 bash[23680]: audit 2024-03-30T15:10:16.575696+0000 mon.a (mon.0) 872 : audit 0 from='client.? 172.21.15.72:0/3452072329' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-03-30T15:10:17.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:16 smithi172 bash[23680]: audit 2024-03-30T15:10:16.612444+0000 mon.c (mon.2) 80 : audit 0 from='client.? 172.21.15.72:0/3830072554' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-03-30T15:10:17.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:16 smithi172 bash[23680]: audit 2024-03-30T15:10:16.726239+0000 mon.c (mon.2) 81 : audit 0 from='client.? 172.21.15.72:0/1404763086' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-03-30T15:10:18.341 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757306 got 163208757312 for osd.5 2024-03-30T15:10:18.341 DEBUG:teuthology.parallel:result is None 2024-03-30T15:10:18.364 INFO:tasks.cephadm.ceph_manager.ceph:need seq 231928234020 got 231928234026 for osd.7 2024-03-30T15:10:18.364 DEBUG:teuthology.parallel:result is None 2024-03-30T15:10:18.409 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411417 got 77309411422 for osd.2 2024-03-30T15:10:18.409 DEBUG:teuthology.parallel:result is None 2024-03-30T15:10:18.409 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-03-30T15:10:18.409 DEBUG:teuthology.orchestra.run.smithi072:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T15:10:19.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:18 smithi072 bash[21573]: cluster 2024-03-30T15:10:17.783464+0000 mgr.y (mgr.14526) 100 : cluster 0 pgmap v57: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:10:19.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:18 smithi072 bash[28946]: cluster 2024-03-30T15:10:17.783464+0000 mgr.y (mgr.14526) 100 : cluster 0 pgmap v57: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:10:19.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:18 smithi172 bash[23680]: cluster 2024-03-30T15:10:17.783464+0000 mgr.y (mgr.14526) 100 : cluster 0 pgmap v57: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:10:21.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:20 smithi072 bash[21573]: cluster 2024-03-30T15:10:19.784148+0000 mgr.y (mgr.14526) 101 : cluster 0 pgmap v58: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T15:10:21.167 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:10:21 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:10:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:10:21.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:20 smithi072 bash[28946]: cluster 2024-03-30T15:10:19.784148+0000 mgr.y (mgr.14526) 101 : cluster 0 pgmap v58: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T15:10:21.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:10:20 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:10:21.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:20 smithi172 bash[23680]: cluster 2024-03-30T15:10:19.784148+0000 mgr.y (mgr.14526) 101 : cluster 0 pgmap v58: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T15:10:22.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:21 smithi072 bash[21573]: audit 2024-03-30T15:10:20.843154+0000 mgr.y (mgr.14526) 102 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:10:22.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:21 smithi072 bash[28946]: audit 2024-03-30T15:10:20.843154+0000 mgr.y (mgr.14526) 102 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:10:22.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:21 smithi172 bash[23680]: audit 2024-03-30T15:10:20.843154+0000 mgr.y (mgr.14526) 102 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:10:23.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:22 smithi072 bash[21573]: cluster 2024-03-30T15:10:21.785628+0000 mgr.y (mgr.14526) 103 : cluster 0 pgmap v59: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:10:23.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:22 smithi072 bash[28946]: cluster 2024-03-30T15:10:21.785628+0000 mgr.y (mgr.14526) 103 : cluster 0 pgmap v59: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:10:23.185 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T15:10:23.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:22 smithi172 bash[23680]: cluster 2024-03-30T15:10:21.785628+0000 mgr.y (mgr.14526) 103 : cluster 0 pgmap v59: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:10:25.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:24 smithi072 bash[21573]: cluster 2024-03-30T15:10:23.786324+0000 mgr.y (mgr.14526) 104 : cluster 0 pgmap v60: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:10:25.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:24 smithi072 bash[28946]: cluster 2024-03-30T15:10:23.786324+0000 mgr.y (mgr.14526) 104 : cluster 0 pgmap v60: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:10:25.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:24 smithi172 bash[23680]: cluster 2024-03-30T15:10:23.786324+0000 mgr.y (mgr.14526) 104 : cluster 0 pgmap v60: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:10:26.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.054+0000 7f9105f7a700 1 -- 172.21.15.72:0/2958205702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9100074470 msgr2=0x7f9100074850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:26.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.054+0000 7f9105f7a700 1 --2- 172.21.15.72:0/2958205702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9100074470 0x7f9100074850 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f90f4009990 tx=0x7f90f4009ca0 comp rx=0 tx=0).stop 2024-03-30T15:10:26.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.054+0000 7f9105f7a700 1 -- 172.21.15.72:0/2958205702 shutdown_connections 2024-03-30T15:10:26.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.054+0000 7f9105f7a700 1 --2- 172.21.15.72:0/2958205702 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f910010ecd0 0x7f91001110c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:26.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.054+0000 7f9105f7a700 1 --2- 172.21.15.72:0/2958205702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9100074470 0x7f9100074850 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:26.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.054+0000 7f9105f7a700 1 --2- 172.21.15.72:0/2958205702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9100074d90 0x7f910010e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:26.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.054+0000 7f9105f7a700 1 -- 172.21.15.72:0/2958205702 >> 172.21.15.72:0/2958205702 conn(0x7f9100079310 msgr2=0x7f9100079720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:10:26.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.054+0000 7f9105f7a700 1 -- 172.21.15.72:0/2958205702 shutdown_connections 2024-03-30T15:10:26.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.054+0000 7f9105f7a700 1 -- 172.21.15.72:0/2958205702 wait complete. 2024-03-30T15:10:26.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.054+0000 7f9105f7a700 1 Processor -- start 2024-03-30T15:10:26.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.054+0000 7f9105f7a700 1 -- start start 2024-03-30T15:10:26.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.054+0000 7f9105f7a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9100074470 0x7f910019a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:10:26.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.054+0000 7f9105f7a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9100074d90 0x7f910019a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:10:26.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.054+0000 7f9105f7a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f910010ecd0 0x7f910019ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:10:26.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.054+0000 7f9105f7a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9100113c00 con 0x7f9100074470 2024-03-30T15:10:26.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.054+0000 7f9105f7a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9100113a80 con 0x7f910010ecd0 2024-03-30T15:10:26.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.054+0000 7f9105f7a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f9100113d80 con 0x7f9100074d90 2024-03-30T15:10:26.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.054+0000 7f90ff7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9100074470 0x7f910019a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:10:26.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.054+0000 7f90ff7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9100074470 0x7f910019a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54070/0 (socket says 172.21.15.72:54070) 2024-03-30T15:10:26.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.054+0000 7f90ff7fe700 1 -- 172.21.15.72:0/525735397 learned_addr learned my addr 172.21.15.72:0/525735397 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T15:10:26.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.054+0000 7f90feffd700 1 --2- 172.21.15.72:0/525735397 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9100074d90 0x7f910019a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:10:26.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.054+0000 7f90fffff700 1 --2- 172.21.15.72:0/525735397 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f910010ecd0 0x7f910019ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:10:26.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.054+0000 7f90ff7fe700 1 -- 172.21.15.72:0/525735397 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9100074d90 msgr2=0x7f910019a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:26.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.054+0000 7f90ff7fe700 1 --2- 172.21.15.72:0/525735397 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9100074d90 0x7f910019a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:26.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.054+0000 7f90ff7fe700 1 -- 172.21.15.72:0/525735397 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f910010ecd0 msgr2=0x7f910019ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:26.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.054+0000 7f90ff7fe700 1 --2- 172.21.15.72:0/525735397 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f910010ecd0 0x7f910019ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:26.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.054+0000 7f90ff7fe700 1 -- 172.21.15.72:0/525735397 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f910019f1b0 con 0x7f9100074470 2024-03-30T15:10:26.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.054+0000 7f90ff7fe700 1 --2- 172.21.15.72:0/525735397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9100074470 0x7f910019a1f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f90f40057c0 tx=0x7f90f40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:10:26.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.054+0000 7f90fcff9700 1 -- 172.21.15.72:0/525735397 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f4026070 con 0x7f9100074470 2024-03-30T15:10:26.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.054+0000 7f90fcff9700 1 -- 172.21.15.72:0/525735397 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f90f4021410 con 0x7f9100074470 2024-03-30T15:10:26.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.054+0000 7f90fcff9700 1 -- 172.21.15.72:0/525735397 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f40173f0 con 0x7f9100074470 2024-03-30T15:10:26.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.054+0000 7f9105f7a700 1 -- 172.21.15.72:0/525735397 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f910019f440 con 0x7f9100074470 2024-03-30T15:10:26.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.054+0000 7f9105f7a700 1 -- 172.21.15.72:0/525735397 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91001a6d20 con 0x7f9100074470 2024-03-30T15:10:26.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.058+0000 7f9105f7a700 1 -- 172.21.15.72:0/525735397 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f910004ff00 con 0x7f9100074470 2024-03-30T15:10:26.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.058+0000 7f90fcff9700 1 -- 172.21.15.72:0/525735397 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 21) ==== 91831+0+0 (secure 0 0 0) 0x7f90f4029070 con 0x7f9100074470 2024-03-30T15:10:26.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.058+0000 7f90fcff9700 1 --2- 172.21.15.72:0/525735397 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f90e806dc40 0x7f90e8070100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:10:26.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.058+0000 7f90fcff9700 1 -- 172.21.15.72:0/525735397 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7537+0+0 (secure 0 0 0) 0x7f90f408eda0 con 0x7f9100074470 2024-03-30T15:10:26.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.058+0000 7f90feffd700 1 --2- 172.21.15.72:0/525735397 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f90e806dc40 0x7f90e8070100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:10:26.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.058+0000 7f90feffd700 1 --2- 172.21.15.72:0/525735397 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f90e806dc40 0x7f90e8070100 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9100102060 tx=0x7f90f000a300 comp rx=0 tx=0).ready entity=mgr.14526 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:10:26.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.062+0000 7f90fcff9700 1 -- 172.21.15.72:0/525735397 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f90f4013070 con 0x7f9100074470 2024-03-30T15:10:26.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.270+0000 7f9105f7a700 1 -- 172.21.15.72:0/525735397 --> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f910019b500 con 0x7f90e806dc40 2024-03-30T15:10:26.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.306+0000 7f90fcff9700 1 -- 172.21.15.72:0/525735397 <== mgr.14526 v2:172.21.15.72:6800/2033000132 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+346514 (secure 0 0 0) 0x7f910019b500 con 0x7f90e806dc40 2024-03-30T15:10:26.311 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-30T15:10:26.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.310+0000 7f9105f7a700 1 -- 172.21.15.72:0/525735397 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f90e806dc40 msgr2=0x7f90e8070100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:26.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.310+0000 7f9105f7a700 1 --2- 172.21.15.72:0/525735397 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f90e806dc40 0x7f90e8070100 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9100102060 tx=0x7f90f000a300 comp rx=0 tx=0).stop 2024-03-30T15:10:26.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.310+0000 7f9105f7a700 1 -- 172.21.15.72:0/525735397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9100074470 msgr2=0x7f910019a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:26.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.310+0000 7f9105f7a700 1 --2- 172.21.15.72:0/525735397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9100074470 0x7f910019a1f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f90f40057c0 tx=0x7f90f40057f0 comp rx=0 tx=0).stop 2024-03-30T15:10:26.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.310+0000 7f9105f7a700 1 -- 172.21.15.72:0/525735397 shutdown_connections 2024-03-30T15:10:26.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.310+0000 7f9105f7a700 1 --2- 172.21.15.72:0/525735397 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f90e806dc40 0x7f90e8070100 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:26.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.310+0000 7f9105f7a700 1 --2- 172.21.15.72:0/525735397 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f910010ecd0 0x7f910019ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:26.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.310+0000 7f9105f7a700 1 --2- 172.21.15.72:0/525735397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9100074470 0x7f910019a1f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:26.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.310+0000 7f9105f7a700 1 --2- 172.21.15.72:0/525735397 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9100074d90 0x7f910019a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:26.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.310+0000 7f9105f7a700 1 -- 172.21.15.72:0/525735397 >> 172.21.15.72:0/525735397 conn(0x7f9100079310 msgr2=0x7f9100106730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:10:26.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.310+0000 7f9105f7a700 1 -- 172.21.15.72:0/525735397 shutdown_connections 2024-03-30T15:10:26.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:26.310+0000 7f9105f7a700 1 -- 172.21.15.72:0/525735397 wait complete. 2024-03-30T15:10:26.315 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2024-03-30T15:10:27.021 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-03-30T15:10:25.786601+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596318,"num_objects":198,"num_object_clones":0,"num_object_copies":594,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":1101,"num_read_kb":947,"num_write":615,"num_write_kb":2461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":628,"ondisk_log_size":628,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":245232,"kb_used_data":8284,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":749715984,"statfs":{"total":767960285184,"available":767709167616,"internally_reserved":0,"allocated":8482816,"data_stored":4598122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005624"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.715341+0000","last_change":"2024-03-30T15:07:38.404394+0000","last_active":"2024-03-30T15:08:29.715341+0000","last_peered":"2024-03-30T15:08:29.715341+0000","last_clean":"2024-03-30T15:08:29.715341+0000","last_became_active":"2024-03-30T15:07:38.403671+0000","last_became_peered":"2024-03-30T15:07:38.403671+0000","last_unstale":"2024-03-30T15:08:29.715341+0000","last_undegraded":"2024-03-30T15:08:29.715341+0000","last_fullsized":"2024-03-30T15:08:29.715341+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:21:16.031259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.716248+0000","last_change":"2024-03-30T15:07:36.364975+0000","last_active":"2024-03-30T15:08:29.716248+0000","last_peered":"2024-03-30T15:08:29.716248+0000","last_clean":"2024-03-30T15:08:29.716248+0000","last_became_active":"2024-03-30T15:07:36.363172+0000","last_became_peered":"2024-03-30T15:07:36.363172+0000","last_unstale":"2024-03-30T15:08:29.716248+0000","last_undegraded":"2024-03-30T15:08:29.716248+0000","last_fullsized":"2024-03-30T15:08:29.716248+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T02:43:43.010846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"60'1","reported_seq":47,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.510502+0000","last_change":"2024-03-30T15:07:32.341754+0000","last_active":"2024-03-30T15:08:30.510502+0000","last_peered":"2024-03-30T15:08:30.510502+0000","last_clean":"2024-03-30T15:08:30.510502+0000","last_became_active":"2024-03-30T15:07:32.341382+0000","last_became_peered":"2024-03-30T15:07:32.341382+0000","last_unstale":"2024-03-30T15:08:30.510502+0000","last_undegraded":"2024-03-30T15:08:30.510502+0000","last_fullsized":"2024-03-30T15:08:30.510502+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:01.639200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"67'10","reported_seq":51,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.718734+0000","last_change":"2024-03-30T15:07:34.357651+0000","last_active":"2024-03-30T15:08:29.718734+0000","last_peered":"2024-03-30T15:08:29.718734+0000","last_clean":"2024-03-30T15:08:29.718734+0000","last_became_active":"2024-03-30T15:07:34.356962+0000","last_became_peered":"2024-03-30T15:07:34.356962+0000","last_unstale":"2024-03-30T15:08:29.718734+0000","last_undegraded":"2024-03-30T15:08:29.718734+0000","last_fullsized":"2024-03-30T15:08:29.718734+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:33:35.049995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.717877+0000","last_change":"2024-03-30T15:07:38.379462+0000","last_active":"2024-03-30T15:08:29.717877+0000","last_peered":"2024-03-30T15:08:29.717877+0000","last_clean":"2024-03-30T15:08:29.717877+0000","last_became_active":"2024-03-30T15:07:38.378006+0000","last_became_peered":"2024-03-30T15:07:38.378006+0000","last_unstale":"2024-03-30T15:08:29.717877+0000","last_undegraded":"2024-03-30T15:08:29.717877+0000","last_fullsized":"2024-03-30T15:08:29.717877+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:13:42.448880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.717648+0000","last_change":"2024-03-30T15:07:36.339968+0000","last_active":"2024-03-30T15:08:29.717648+0000","last_peered":"2024-03-30T15:08:29.717648+0000","last_clean":"2024-03-30T15:08:29.717648+0000","last_became_active":"2024-03-30T15:07:36.339613+0000","last_became_peered":"2024-03-30T15:07:36.339613+0000","last_unstale":"2024-03-30T15:08:29.717648+0000","last_undegraded":"2024-03-30T15:08:29.717648+0000","last_fullsized":"2024-03-30T15:08:29.717648+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:48:27.425580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.718383+0000","last_change":"2024-03-30T15:07:32.325458+0000","last_active":"2024-03-30T15:08:29.718383+0000","last_peered":"2024-03-30T15:08:29.718383+0000","last_clean":"2024-03-30T15:08:29.718383+0000","last_became_active":"2024-03-30T15:07:32.325113+0000","last_became_peered":"2024-03-30T15:07:32.325113+0000","last_unstale":"2024-03-30T15:08:29.718383+0000","last_undegraded":"2024-03-30T15:08:29.718383+0000","last_fullsized":"2024-03-30T15:08:29.718383+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:15.155788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"67'11","reported_seq":54,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.508925+0000","last_change":"2024-03-30T15:07:34.354718+0000","last_active":"2024-03-30T15:08:30.508925+0000","last_peered":"2024-03-30T15:08:30.508925+0000","last_clean":"2024-03-30T15:08:30.508925+0000","last_became_active":"2024-03-30T15:07:34.354161+0000","last_became_peered":"2024-03-30T15:07:34.354161+0000","last_unstale":"2024-03-30T15:08:30.508925+0000","last_undegraded":"2024-03-30T15:08:30.508925+0000","last_fullsized":"2024-03-30T15:08:30.508925+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:14:29.328078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.388980+0000","last_change":"2024-03-30T15:07:38.385687+0000","last_active":"2024-03-30T15:08:30.388980+0000","last_peered":"2024-03-30T15:08:30.388980+0000","last_clean":"2024-03-30T15:08:30.388980+0000","last_became_active":"2024-03-30T15:07:38.385008+0000","last_became_peered":"2024-03-30T15:07:38.385008+0000","last_unstale":"2024-03-30T15:08:30.388980+0000","last_undegraded":"2024-03-30T15:08:30.388980+0000","last_fullsized":"2024-03-30T15:08:30.388980+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:17.118904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.718181+0000","last_change":"2024-03-30T15:07:36.354709+0000","last_active":"2024-03-30T15:08:29.718181+0000","last_peered":"2024-03-30T15:08:29.718181+0000","last_clean":"2024-03-30T15:08:29.718181+0000","last_became_active":"2024-03-30T15:07:36.354322+0000","last_became_peered":"2024-03-30T15:07:36.354322+0000","last_unstale":"2024-03-30T15:08:29.718181+0000","last_undegraded":"2024-03-30T15:08:29.718181+0000","last_fullsized":"2024-03-30T15:08:29.718181+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:48:02.814689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.716507+0000","last_change":"2024-03-30T15:08:15.721899+0000","last_active":"2024-03-30T15:08:29.716507+0000","last_peered":"2024-03-30T15:08:29.716507+0000","last_clean":"2024-03-30T15:08:29.716507+0000","last_became_active":"2024-03-30T15:08:15.720919+0000","last_became_peered":"2024-03-30T15:08:15.720919+0000","last_unstale":"2024-03-30T15:08:29.716507+0000","last_undegraded":"2024-03-30T15:08:29.716507+0000","last_fullsized":"2024-03-30T15:08:29.716507+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:54.970723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"67'15","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.387473+0000","last_change":"2024-03-30T15:07:34.339086+0000","last_active":"2024-03-30T15:08:30.387473+0000","last_peered":"2024-03-30T15:08:30.387473+0000","last_clean":"2024-03-30T15:08:30.387473+0000","last_became_active":"2024-03-30T15:07:34.338800+0000","last_became_peered":"2024-03-30T15:07:34.338800+0000","last_unstale":"2024-03-30T15:08:30.387473+0000","last_undegraded":"2024-03-30T15:08:30.387473+0000","last_fullsized":"2024-03-30T15:08:30.387473+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:09:28.650531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.507247+0000","last_change":"2024-03-30T15:07:38.389806+0000","last_active":"2024-03-30T15:08:30.507247+0000","last_peered":"2024-03-30T15:08:30.507247+0000","last_clean":"2024-03-30T15:08:30.507247+0000","last_became_active":"2024-03-30T15:07:38.384123+0000","last_became_peered":"2024-03-30T15:07:38.384123+0000","last_unstale":"2024-03-30T15:08:30.507247+0000","last_undegraded":"2024-03-30T15:08:30.507247+0000","last_fullsized":"2024-03-30T15:08:30.507247+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:21:55.587790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.718304+0000","last_change":"2024-03-30T15:07:36.354824+0000","last_active":"2024-03-30T15:08:29.718304+0000","last_peered":"2024-03-30T15:08:29.718304+0000","last_clean":"2024-03-30T15:08:29.718304+0000","last_became_active":"2024-03-30T15:07:36.354460+0000","last_became_peered":"2024-03-30T15:07:36.354460+0000","last_unstale":"2024-03-30T15:08:29.718304+0000","last_undegraded":"2024-03-30T15:08:29.718304+0000","last_fullsized":"2024-03-30T15:08:29.718304+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:34:05.302974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.774895+0000","last_change":"2024-03-30T15:07:32.344175+0000","last_active":"2024-03-30T15:08:29.774895+0000","last_peered":"2024-03-30T15:08:29.774895+0000","last_clean":"2024-03-30T15:08:29.774895+0000","last_became_active":"2024-03-30T15:07:32.343299+0000","last_became_peered":"2024-03-30T15:07:32.343299+0000","last_unstale":"2024-03-30T15:08:29.774895+0000","last_undegraded":"2024-03-30T15:08:29.774895+0000","last_fullsized":"2024-03-30T15:08:29.774895+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:45:36.284556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"67'12","reported_seq":59,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.387847+0000","last_change":"2024-03-30T15:07:34.337708+0000","last_active":"2024-03-30T15:08:30.387847+0000","last_peered":"2024-03-30T15:08:30.387847+0000","last_clean":"2024-03-30T15:08:30.387847+0000","last_became_active":"2024-03-30T15:07:34.337175+0000","last_became_peered":"2024-03-30T15:07:34.337175+0000","last_unstale":"2024-03-30T15:08:30.387847+0000","last_undegraded":"2024-03-30T15:08:30.387847+0000","last_fullsized":"2024-03-30T15:08:30.387847+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:13.970499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.719705+0000","last_change":"2024-03-30T15:07:38.410395+0000","last_active":"2024-03-30T15:08:29.719705+0000","last_peered":"2024-03-30T15:08:29.719705+0000","last_clean":"2024-03-30T15:08:29.719705+0000","last_became_active":"2024-03-30T15:07:38.409906+0000","last_became_peered":"2024-03-30T15:07:38.409906+0000","last_unstale":"2024-03-30T15:08:29.719705+0000","last_undegraded":"2024-03-30T15:08:29.719705+0000","last_fullsized":"2024-03-30T15:08:29.719705+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:54:21.517389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.717945+0000","last_change":"2024-03-30T15:07:36.380598+0000","last_active":"2024-03-30T15:08:29.717945+0000","last_peered":"2024-03-30T15:08:29.717945+0000","last_clean":"2024-03-30T15:08:29.717945+0000","last_became_active":"2024-03-30T15:07:36.378092+0000","last_became_peered":"2024-03-30T15:07:36.378092+0000","last_unstale":"2024-03-30T15:08:29.717945+0000","last_undegraded":"2024-03-30T15:08:29.717945+0000","last_fullsized":"2024-03-30T15:08:29.717945+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:21:17.614175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.716801+0000","last_change":"2024-03-30T15:07:32.323228+0000","last_active":"2024-03-30T15:08:29.716801+0000","last_peered":"2024-03-30T15:08:29.716801+0000","last_clean":"2024-03-30T15:08:29.716801+0000","last_became_active":"2024-03-30T15:07:32.322894+0000","last_became_peered":"2024-03-30T15:07:32.322894+0000","last_unstale":"2024-03-30T15:08:29.716801+0000","last_undegraded":"2024-03-30T15:08:29.716801+0000","last_fullsized":"2024-03-30T15:08:29.716801+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:09:19.627344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"67'9","reported_seq":52,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.717776+0000","last_change":"2024-03-30T15:07:34.341018+0000","last_active":"2024-03-30T15:08:29.717776+0000","last_peered":"2024-03-30T15:08:29.717776+0000","last_clean":"2024-03-30T15:08:29.717776+0000","last_became_active":"2024-03-30T15:07:34.340675+0000","last_became_peered":"2024-03-30T15:07:34.340675+0000","last_unstale":"2024-03-30T15:08:29.717776+0000","last_undegraded":"2024-03-30T15:08:29.717776+0000","last_fullsized":"2024-03-30T15:08:29.717776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:19:27.585459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.720646+0000","last_change":"2024-03-30T15:07:38.400354+0000","last_active":"2024-03-30T15:08:29.720646+0000","last_peered":"2024-03-30T15:08:29.720646+0000","last_clean":"2024-03-30T15:08:29.720646+0000","last_became_active":"2024-03-30T15:07:38.399943+0000","last_became_peered":"2024-03-30T15:07:38.399943+0000","last_unstale":"2024-03-30T15:08:29.720646+0000","last_undegraded":"2024-03-30T15:08:29.720646+0000","last_fullsized":"2024-03-30T15:08:29.720646+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:57:58.990197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.718792+0000","last_change":"2024-03-30T15:07:36.360438+0000","last_active":"2024-03-30T15:08:29.718792+0000","last_peered":"2024-03-30T15:08:29.718792+0000","last_clean":"2024-03-30T15:08:29.718792+0000","last_became_active":"2024-03-30T15:07:36.359575+0000","last_became_peered":"2024-03-30T15:07:36.359575+0000","last_unstale":"2024-03-30T15:08:29.718792+0000","last_undegraded":"2024-03-30T15:08:29.718792+0000","last_fullsized":"2024-03-30T15:08:29.718792+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:19:45.984083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.859754+0000","last_change":"2024-03-30T15:07:32.336659+0000","last_active":"2024-03-30T15:08:29.859754+0000","last_peered":"2024-03-30T15:08:29.859754+0000","last_clean":"2024-03-30T15:08:29.859754+0000","last_became_active":"2024-03-30T15:07:32.335757+0000","last_became_peered":"2024-03-30T15:07:32.335757+0000","last_unstale":"2024-03-30T15:08:29.859754+0000","last_undegraded":"2024-03-30T15:08:29.859754+0000","last_fullsized":"2024-03-30T15:08:29.859754+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:38:03.242535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"67'5","reported_seq":45,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.508151+0000","last_change":"2024-03-30T15:07:34.341424+0000","last_active":"2024-03-30T15:08:30.508151+0000","last_peered":"2024-03-30T15:08:30.508151+0000","last_clean":"2024-03-30T15:08:30.508151+0000","last_became_active":"2024-03-30T15:07:34.340906+0000","last_became_peered":"2024-03-30T15:07:34.340906+0000","last_unstale":"2024-03-30T15:08:30.508151+0000","last_undegraded":"2024-03-30T15:08:30.508151+0000","last_fullsized":"2024-03-30T15:08:30.508151+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:33:38.868029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.509407+0000","last_change":"2024-03-30T15:07:38.383775+0000","last_active":"2024-03-30T15:08:30.509407+0000","last_peered":"2024-03-30T15:08:30.509407+0000","last_clean":"2024-03-30T15:08:30.509407+0000","last_became_active":"2024-03-30T15:07:38.382933+0000","last_became_peered":"2024-03-30T15:07:38.382933+0000","last_unstale":"2024-03-30T15:08:30.509407+0000","last_undegraded":"2024-03-30T15:08:30.509407+0000","last_fullsized":"2024-03-30T15:08:30.509407+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:07:50.761481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"73'12","reported_seq":91,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:10:17.562514+0000","last_change":"2024-03-30T15:08:15.731003+0000","last_active":"2024-03-30T15:10:17.562514+0000","last_peered":"2024-03-30T15:10:17.562514+0000","last_clean":"2024-03-30T15:10:17.562514+0000","last_became_active":"2024-03-30T15:08:15.722686+0000","last_became_peered":"2024-03-30T15:08:15.722686+0000","last_unstale":"2024-03-30T15:10:17.562514+0000","last_undegraded":"2024-03-30T15:10:17.562514+0000","last_fullsized":"2024-03-30T15:10:17.562514+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:53:59.650620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"60'1","reported_seq":41,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.716521+0000","last_change":"2024-03-30T15:07:32.321777+0000","last_active":"2024-03-30T15:08:29.716521+0000","last_peered":"2024-03-30T15:08:29.716521+0000","last_clean":"2024-03-30T15:08:29.716521+0000","last_became_active":"2024-03-30T15:07:32.321468+0000","last_became_peered":"2024-03-30T15:07:32.321468+0000","last_unstale":"2024-03-30T15:08:29.716521+0000","last_undegraded":"2024-03-30T15:08:29.716521+0000","last_fullsized":"2024-03-30T15:08:29.716521+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:02:19.949675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"67'9","reported_seq":52,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.715547+0000","last_change":"2024-03-30T15:07:34.347628+0000","last_active":"2024-03-30T15:08:29.715547+0000","last_peered":"2024-03-30T15:08:29.715547+0000","last_clean":"2024-03-30T15:08:29.715547+0000","last_became_active":"2024-03-30T15:07:34.346958+0000","last_became_peered":"2024-03-30T15:07:34.346958+0000","last_unstale":"2024-03-30T15:08:29.715547+0000","last_undegraded":"2024-03-30T15:08:29.715547+0000","last_fullsized":"2024-03-30T15:08:29.715547+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:58:05.038615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"67'1","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.774708+0000","last_change":"2024-03-30T15:07:38.391560+0000","last_active":"2024-03-30T15:08:29.774708+0000","last_peered":"2024-03-30T15:08:29.774708+0000","last_clean":"2024-03-30T15:08:29.774708+0000","last_became_active":"2024-03-30T15:07:38.391185+0000","last_became_peered":"2024-03-30T15:07:38.391185+0000","last_unstale":"2024-03-30T15:08:29.774708+0000","last_undegraded":"2024-03-30T15:08:29.774708+0000","last_fullsized":"2024-03-30T15:08:29.774708+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:02:52.182312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":370,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.510234+0000","last_change":"2024-03-30T15:07:36.366776+0000","last_active":"2024-03-30T15:08:30.510234+0000","last_peered":"2024-03-30T15:08:30.510234+0000","last_clean":"2024-03-30T15:08:30.510234+0000","last_became_active":"2024-03-30T15:07:36.365845+0000","last_became_peered":"2024-03-30T15:07:36.365845+0000","last_unstale":"2024-03-30T15:08:30.510234+0000","last_undegraded":"2024-03-30T15:08:30.510234+0000","last_fullsized":"2024-03-30T15:08:30.510234+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:28:09.369591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.388530+0000","last_change":"2024-03-30T15:07:32.337471+0000","last_active":"2024-03-30T15:08:30.388530+0000","last_peered":"2024-03-30T15:08:30.388530+0000","last_clean":"2024-03-30T15:08:30.388530+0000","last_became_active":"2024-03-30T15:07:32.336609+0000","last_became_peered":"2024-03-30T15:07:32.336609+0000","last_unstale":"2024-03-30T15:08:30.388530+0000","last_undegraded":"2024-03-30T15:08:30.388530+0000","last_fullsized":"2024-03-30T15:08:30.388530+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:43:37.576858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"67'15","reported_seq":60,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.505610+0000","last_change":"2024-03-30T15:07:34.346816+0000","last_active":"2024-03-30T15:08:30.505610+0000","last_peered":"2024-03-30T15:08:30.505610+0000","last_clean":"2024-03-30T15:08:30.505610+0000","last_became_active":"2024-03-30T15:07:34.346301+0000","last_became_peered":"2024-03-30T15:07:34.346301+0000","last_unstale":"2024-03-30T15:08:30.505610+0000","last_undegraded":"2024-03-30T15:08:30.505610+0000","last_fullsized":"2024-03-30T15:08:30.505610+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:03:27.740048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.717669+0000","last_change":"2024-03-30T15:07:38.409442+0000","last_active":"2024-03-30T15:08:29.717669+0000","last_peered":"2024-03-30T15:08:29.717669+0000","last_clean":"2024-03-30T15:08:29.717669+0000","last_became_active":"2024-03-30T15:07:38.408827+0000","last_became_peered":"2024-03-30T15:07:38.408827+0000","last_unstale":"2024-03-30T15:08:29.717669+0000","last_undegraded":"2024-03-30T15:08:29.717669+0000","last_fullsized":"2024-03-30T15:08:29.717669+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T02:02:33.582621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.718874+0000","last_change":"2024-03-30T15:07:36.367992+0000","last_active":"2024-03-30T15:08:29.718874+0000","last_peered":"2024-03-30T15:08:29.718874+0000","last_clean":"2024-03-30T15:08:29.718874+0000","last_became_active":"2024-03-30T15:07:36.365990+0000","last_became_peered":"2024-03-30T15:07:36.365990+0000","last_unstale":"2024-03-30T15:08:29.718874+0000","last_undegraded":"2024-03-30T15:08:29.718874+0000","last_fullsized":"2024-03-30T15:08:29.718874+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:46:50.691747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"60'1","reported_seq":48,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.860656+0000","last_change":"2024-03-30T15:07:32.349842+0000","last_active":"2024-03-30T15:08:29.860656+0000","last_peered":"2024-03-30T15:08:29.860656+0000","last_clean":"2024-03-30T15:08:29.860656+0000","last_became_active":"2024-03-30T15:07:32.338264+0000","last_became_peered":"2024-03-30T15:07:32.338264+0000","last_unstale":"2024-03-30T15:08:29.860656+0000","last_undegraded":"2024-03-30T15:08:29.860656+0000","last_fullsized":"2024-03-30T15:08:29.860656+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:20.177069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":875,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"67'9","reported_seq":52,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.387547+0000","last_change":"2024-03-30T15:07:34.338942+0000","last_active":"2024-03-30T15:08:30.387547+0000","last_peered":"2024-03-30T15:08:30.387547+0000","last_clean":"2024-03-30T15:08:30.387547+0000","last_became_active":"2024-03-30T15:07:34.338649+0000","last_became_peered":"2024-03-30T15:07:34.338649+0000","last_unstale":"2024-03-30T15:08:30.387547+0000","last_undegraded":"2024-03-30T15:08:30.387547+0000","last_fullsized":"2024-03-30T15:08:30.387547+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:07:59.903054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.774343+0000","last_change":"2024-03-30T15:07:38.390346+0000","last_active":"2024-03-30T15:08:29.774343+0000","last_peered":"2024-03-30T15:08:29.774343+0000","last_clean":"2024-03-30T15:08:29.774343+0000","last_became_active":"2024-03-30T15:07:38.389844+0000","last_became_peered":"2024-03-30T15:07:38.389844+0000","last_unstale":"2024-03-30T15:08:29.774343+0000","last_undegraded":"2024-03-30T15:08:29.774343+0000","last_fullsized":"2024-03-30T15:08:29.774343+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:03:07.174949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.715403+0000","last_change":"2024-03-30T15:07:36.379351+0000","last_active":"2024-03-30T15:08:29.715403+0000","last_peered":"2024-03-30T15:08:29.715403+0000","last_clean":"2024-03-30T15:08:29.715403+0000","last_became_active":"2024-03-30T15:07:36.378692+0000","last_became_peered":"2024-03-30T15:07:36.378692+0000","last_unstale":"2024-03-30T15:08:29.715403+0000","last_undegraded":"2024-03-30T15:08:29.715403+0000","last_fullsized":"2024-03-30T15:08:29.715403+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:54:12.093567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.389559+0000","last_change":"2024-03-30T15:07:32.332134+0000","last_active":"2024-03-30T15:08:30.389559+0000","last_peered":"2024-03-30T15:08:30.389559+0000","last_clean":"2024-03-30T15:08:30.389559+0000","last_became_active":"2024-03-30T15:07:32.331118+0000","last_became_peered":"2024-03-30T15:07:32.331118+0000","last_unstale":"2024-03-30T15:08:30.389559+0000","last_undegraded":"2024-03-30T15:08:30.389559+0000","last_fullsized":"2024-03-30T15:08:30.389559+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:03:37.897743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"67'6","reported_seq":44,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.508794+0000","last_change":"2024-03-30T15:07:34.349798+0000","last_active":"2024-03-30T15:08:30.508794+0000","last_peered":"2024-03-30T15:08:30.508794+0000","last_clean":"2024-03-30T15:08:30.508794+0000","last_became_active":"2024-03-30T15:07:34.348992+0000","last_became_peered":"2024-03-30T15:07:34.348992+0000","last_unstale":"2024-03-30T15:08:30.508794+0000","last_undegraded":"2024-03-30T15:08:30.508794+0000","last_fullsized":"2024-03-30T15:08:30.508794+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:21:50.708218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.715799+0000","last_change":"2024-03-30T15:07:38.409496+0000","last_active":"2024-03-30T15:08:29.715799+0000","last_peered":"2024-03-30T15:08:29.715799+0000","last_clean":"2024-03-30T15:08:29.715799+0000","last_became_active":"2024-03-30T15:07:38.408736+0000","last_became_peered":"2024-03-30T15:07:38.408736+0000","last_unstale":"2024-03-30T15:08:29.715799+0000","last_undegraded":"2024-03-30T15:08:29.715799+0000","last_fullsized":"2024-03-30T15:08:29.715799+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:40:50.847170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.718551+0000","last_change":"2024-03-30T15:07:36.346410+0000","last_active":"2024-03-30T15:08:29.718551+0000","last_peered":"2024-03-30T15:08:29.718551+0000","last_clean":"2024-03-30T15:08:29.718551+0000","last_became_active":"2024-03-30T15:07:36.345949+0000","last_became_peered":"2024-03-30T15:07:36.345949+0000","last_unstale":"2024-03-30T15:08:29.718551+0000","last_undegraded":"2024-03-30T15:08:29.718551+0000","last_fullsized":"2024-03-30T15:08:29.718551+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:09:19.546449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":39,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.509794+0000","last_change":"2024-03-30T15:07:32.329514+0000","last_active":"2024-03-30T15:08:30.509794+0000","last_peered":"2024-03-30T15:08:30.509794+0000","last_clean":"2024-03-30T15:08:30.509794+0000","last_became_active":"2024-03-30T15:07:32.329157+0000","last_became_peered":"2024-03-30T15:07:32.329157+0000","last_unstale":"2024-03-30T15:08:30.509794+0000","last_undegraded":"2024-03-30T15:08:30.509794+0000","last_fullsized":"2024-03-30T15:08:30.509794+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:51.609434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"67'10","reported_seq":51,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.718975+0000","last_change":"2024-03-30T15:07:34.340573+0000","last_active":"2024-03-30T15:08:29.718975+0000","last_peered":"2024-03-30T15:08:29.718975+0000","last_clean":"2024-03-30T15:08:29.718975+0000","last_became_active":"2024-03-30T15:07:34.340249+0000","last_became_peered":"2024-03-30T15:07:34.340249+0000","last_unstale":"2024-03-30T15:08:29.718975+0000","last_undegraded":"2024-03-30T15:08:29.718975+0000","last_fullsized":"2024-03-30T15:08:29.718975+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:22:20.352733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.507498+0000","last_change":"2024-03-30T15:07:38.378434+0000","last_active":"2024-03-30T15:08:30.507498+0000","last_peered":"2024-03-30T15:08:30.507498+0000","last_clean":"2024-03-30T15:08:30.507498+0000","last_became_active":"2024-03-30T15:07:38.377553+0000","last_became_peered":"2024-03-30T15:07:38.377553+0000","last_unstale":"2024-03-30T15:08:30.507498+0000","last_undegraded":"2024-03-30T15:08:30.507498+0000","last_fullsized":"2024-03-30T15:08:30.507498+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:36.438124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.506786+0000","last_change":"2024-03-30T15:07:36.357608+0000","last_active":"2024-03-30T15:08:30.506786+0000","last_peered":"2024-03-30T15:08:30.506786+0000","last_clean":"2024-03-30T15:08:30.506786+0000","last_became_active":"2024-03-30T15:07:36.356817+0000","last_became_peered":"2024-03-30T15:07:36.356817+0000","last_unstale":"2024-03-30T15:08:30.506786+0000","last_undegraded":"2024-03-30T15:08:30.506786+0000","last_fullsized":"2024-03-30T15:08:30.506786+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:36:10.280694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.860110+0000","last_change":"2024-03-30T15:07:32.334661+0000","last_active":"2024-03-30T15:08:29.860110+0000","last_peered":"2024-03-30T15:08:29.860110+0000","last_clean":"2024-03-30T15:08:29.860110+0000","last_became_active":"2024-03-30T15:07:32.333793+0000","last_became_peered":"2024-03-30T15:07:32.333793+0000","last_unstale":"2024-03-30T15:08:29.860110+0000","last_undegraded":"2024-03-30T15:08:29.860110+0000","last_fullsized":"2024-03-30T15:08:29.860110+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:51:09.486012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"67'9","reported_seq":52,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.775099+0000","last_change":"2024-03-30T15:07:34.332229+0000","last_active":"2024-03-30T15:08:29.775099+0000","last_peered":"2024-03-30T15:08:29.775099+0000","last_clean":"2024-03-30T15:08:29.775099+0000","last_became_active":"2024-03-30T15:07:34.331907+0000","last_became_peered":"2024-03-30T15:07:34.331907+0000","last_unstale":"2024-03-30T15:08:29.775099+0000","last_undegraded":"2024-03-30T15:08:29.775099+0000","last_fullsized":"2024-03-30T15:08:29.775099+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:49:35.018931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.720429+0000","last_change":"2024-03-30T15:07:38.390291+0000","last_active":"2024-03-30T15:08:29.720429+0000","last_peered":"2024-03-30T15:08:29.720429+0000","last_clean":"2024-03-30T15:08:29.720429+0000","last_became_active":"2024-03-30T15:07:38.389440+0000","last_became_peered":"2024-03-30T15:07:38.389440+0000","last_unstale":"2024-03-30T15:08:29.720429+0000","last_undegraded":"2024-03-30T15:08:29.720429+0000","last_fullsized":"2024-03-30T15:08:29.720429+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T02:25:36.734323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"67'11","reported_seq":80,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:10:17.562387+0000","last_change":"2024-03-30T15:07:36.362981+0000","last_active":"2024-03-30T15:10:17.562387+0000","last_peered":"2024-03-30T15:10:17.562387+0000","last_clean":"2024-03-30T15:10:17.562387+0000","last_became_active":"2024-03-30T15:07:36.362645+0000","last_became_peered":"2024-03-30T15:07:36.362645+0000","last_unstale":"2024-03-30T15:10:17.562387+0000","last_undegraded":"2024-03-30T15:10:17.562387+0000","last_fullsized":"2024-03-30T15:10:17.562387+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:25:01.195432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":39,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.509979+0000","last_change":"2024-03-30T15:07:32.349480+0000","last_active":"2024-03-30T15:08:30.509979+0000","last_peered":"2024-03-30T15:08:30.509979+0000","last_clean":"2024-03-30T15:08:30.509979+0000","last_became_active":"2024-03-30T15:07:32.348965+0000","last_became_peered":"2024-03-30T15:07:32.348965+0000","last_unstale":"2024-03-30T15:08:30.509979+0000","last_undegraded":"2024-03-30T15:08:30.509979+0000","last_fullsized":"2024-03-30T15:08:30.509979+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:14:45.672017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"67'9","reported_seq":51,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.506782+0000","last_change":"2024-03-30T15:07:34.349596+0000","last_active":"2024-03-30T15:08:30.506782+0000","last_peered":"2024-03-30T15:08:30.506782+0000","last_clean":"2024-03-30T15:08:30.506782+0000","last_became_active":"2024-03-30T15:07:34.348949+0000","last_became_peered":"2024-03-30T15:07:34.348949+0000","last_unstale":"2024-03-30T15:08:30.506782+0000","last_undegraded":"2024-03-30T15:08:30.506782+0000","last_fullsized":"2024-03-30T15:08:30.506782+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:40:14.169471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.509902+0000","last_change":"2024-03-30T15:07:38.382217+0000","last_active":"2024-03-30T15:08:30.509902+0000","last_peered":"2024-03-30T15:08:30.509902+0000","last_clean":"2024-03-30T15:08:30.509902+0000","last_became_active":"2024-03-30T15:07:38.380977+0000","last_became_peered":"2024-03-30T15:07:38.380977+0000","last_unstale":"2024-03-30T15:08:30.509902+0000","last_undegraded":"2024-03-30T15:08:30.509902+0000","last_fullsized":"2024-03-30T15:08:30.509902+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:01:33.302173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"67'11","reported_seq":77,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:10:17.562397+0000","last_change":"2024-03-30T15:07:36.381623+0000","last_active":"2024-03-30T15:10:17.562397+0000","last_peered":"2024-03-30T15:10:17.562397+0000","last_clean":"2024-03-30T15:10:17.562397+0000","last_became_active":"2024-03-30T15:07:36.377558+0000","last_became_peered":"2024-03-30T15:07:36.377558+0000","last_unstale":"2024-03-30T15:10:17.562397+0000","last_undegraded":"2024-03-30T15:10:17.562397+0000","last_fullsized":"2024-03-30T15:10:17.562397+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T02:23:05.954610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.388972+0000","last_change":"2024-03-30T15:07:32.333663+0000","last_active":"2024-03-30T15:08:30.388972+0000","last_peered":"2024-03-30T15:08:30.388972+0000","last_clean":"2024-03-30T15:08:30.388972+0000","last_became_active":"2024-03-30T15:07:32.332783+0000","last_became_peered":"2024-03-30T15:07:32.332783+0000","last_unstale":"2024-03-30T15:08:30.388972+0000","last_undegraded":"2024-03-30T15:08:30.388972+0000","last_fullsized":"2024-03-30T15:08:30.388972+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:16:52.983584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"67'11","reported_seq":55,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.774663+0000","last_change":"2024-03-30T15:07:34.345194+0000","last_active":"2024-03-30T15:08:29.774663+0000","last_peered":"2024-03-30T15:08:29.774663+0000","last_clean":"2024-03-30T15:08:29.774663+0000","last_became_active":"2024-03-30T15:07:34.344854+0000","last_became_peered":"2024-03-30T15:07:34.344854+0000","last_unstale":"2024-03-30T15:08:29.774663+0000","last_undegraded":"2024-03-30T15:08:29.774663+0000","last_fullsized":"2024-03-30T15:08:29.774663+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:34:32.090526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.774803+0000","last_change":"2024-03-30T15:07:38.402739+0000","last_active":"2024-03-30T15:08:29.774803+0000","last_peered":"2024-03-30T15:08:29.774803+0000","last_clean":"2024-03-30T15:08:29.774803+0000","last_became_active":"2024-03-30T15:07:38.402252+0000","last_became_peered":"2024-03-30T15:07:38.402252+0000","last_unstale":"2024-03-30T15:08:29.774803+0000","last_undegraded":"2024-03-30T15:08:29.774803+0000","last_fullsized":"2024-03-30T15:08:29.774803+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:36:47.769354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.719825+0000","last_change":"2024-03-30T15:07:36.381021+0000","last_active":"2024-03-30T15:08:29.719825+0000","last_peered":"2024-03-30T15:08:29.719825+0000","last_clean":"2024-03-30T15:08:29.719825+0000","last_became_active":"2024-03-30T15:07:36.378382+0000","last_became_peered":"2024-03-30T15:07:36.378382+0000","last_unstale":"2024-03-30T15:08:29.719825+0000","last_undegraded":"2024-03-30T15:08:29.719825+0000","last_fullsized":"2024-03-30T15:08:29.719825+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T02:52:02.029001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.859522+0000","last_change":"2024-03-30T15:07:32.333779+0000","last_active":"2024-03-30T15:08:29.859522+0000","last_peered":"2024-03-30T15:08:29.859522+0000","last_clean":"2024-03-30T15:08:29.859522+0000","last_became_active":"2024-03-30T15:07:32.332805+0000","last_became_peered":"2024-03-30T15:07:32.332805+0000","last_unstale":"2024-03-30T15:08:29.859522+0000","last_undegraded":"2024-03-30T15:08:29.859522+0000","last_fullsized":"2024-03-30T15:08:29.859522+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:14:43.927065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"67'4","reported_seq":42,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.859383+0000","last_change":"2024-03-30T15:07:34.344545+0000","last_active":"2024-03-30T15:08:29.859383+0000","last_peered":"2024-03-30T15:08:29.859383+0000","last_clean":"2024-03-30T15:08:29.859383+0000","last_became_active":"2024-03-30T15:07:34.344122+0000","last_became_peered":"2024-03-30T15:07:34.344122+0000","last_unstale":"2024-03-30T15:08:29.859383+0000","last_undegraded":"2024-03-30T15:08:29.859383+0000","last_fullsized":"2024-03-30T15:08:29.859383+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:45:02.553822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.718737+0000","last_change":"2024-03-30T15:07:38.386675+0000","last_active":"2024-03-30T15:08:29.718737+0000","last_peered":"2024-03-30T15:08:29.718737+0000","last_clean":"2024-03-30T15:08:29.718737+0000","last_became_active":"2024-03-30T15:07:38.385464+0000","last_became_peered":"2024-03-30T15:07:38.385464+0000","last_unstale":"2024-03-30T15:08:29.718737+0000","last_undegraded":"2024-03-30T15:08:29.718737+0000","last_fullsized":"2024-03-30T15:08:29.718737+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:33.627204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.509762+0000","last_change":"2024-03-30T15:07:36.368028+0000","last_active":"2024-03-30T15:08:30.509762+0000","last_peered":"2024-03-30T15:08:30.509762+0000","last_clean":"2024-03-30T15:08:30.509762+0000","last_became_active":"2024-03-30T15:07:36.365649+0000","last_became_peered":"2024-03-30T15:07:36.365649+0000","last_unstale":"2024-03-30T15:08:30.509762+0000","last_undegraded":"2024-03-30T15:08:30.509762+0000","last_fullsized":"2024-03-30T15:08:30.509762+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:48:13.402426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.715807+0000","last_change":"2024-03-30T15:07:32.328683+0000","last_active":"2024-03-30T15:08:29.715807+0000","last_peered":"2024-03-30T15:08:29.715807+0000","last_clean":"2024-03-30T15:08:29.715807+0000","last_became_active":"2024-03-30T15:07:32.327871+0000","last_became_peered":"2024-03-30T15:07:32.327871+0000","last_unstale":"2024-03-30T15:08:29.715807+0000","last_undegraded":"2024-03-30T15:08:29.715807+0000","last_fullsized":"2024-03-30T15:08:29.715807+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:50:37.292198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"67'11","reported_seq":55,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.774486+0000","last_change":"2024-03-30T15:07:34.341135+0000","last_active":"2024-03-30T15:08:29.774486+0000","last_peered":"2024-03-30T15:08:29.774486+0000","last_clean":"2024-03-30T15:08:29.774486+0000","last_became_active":"2024-03-30T15:07:34.340817+0000","last_became_peered":"2024-03-30T15:07:34.340817+0000","last_unstale":"2024-03-30T15:08:29.774486+0000","last_undegraded":"2024-03-30T15:08:29.774486+0000","last_fullsized":"2024-03-30T15:08:29.774486+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:02:51.534402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.717421+0000","last_change":"2024-03-30T15:07:38.403522+0000","last_active":"2024-03-30T15:08:29.717421+0000","last_peered":"2024-03-30T15:08:29.717421+0000","last_clean":"2024-03-30T15:08:29.717421+0000","last_became_active":"2024-03-30T15:07:38.402864+0000","last_became_peered":"2024-03-30T15:07:38.402864+0000","last_unstale":"2024-03-30T15:08:29.717421+0000","last_undegraded":"2024-03-30T15:08:29.717421+0000","last_fullsized":"2024-03-30T15:08:29.717421+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:52:45.455180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"60'2","reported_seq":56,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.720259+0000","last_change":"2024-03-30T15:07:32.347302+0000","last_active":"2024-03-30T15:08:29.720259+0000","last_peered":"2024-03-30T15:08:29.720259+0000","last_clean":"2024-03-30T15:08:29.720259+0000","last_became_active":"2024-03-30T15:07:32.344922+0000","last_became_peered":"2024-03-30T15:07:32.344922+0000","last_unstale":"2024-03-30T15:08:29.720259+0000","last_undegraded":"2024-03-30T15:08:29.720259+0000","last_fullsized":"2024-03-30T15:08:29.720259+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:09:39.260126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"67'11","reported_seq":55,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.775057+0000","last_change":"2024-03-30T15:07:34.339198+0000","last_active":"2024-03-30T15:08:29.775057+0000","last_peered":"2024-03-30T15:08:29.775057+0000","last_clean":"2024-03-30T15:08:29.775057+0000","last_became_active":"2024-03-30T15:07:34.338779+0000","last_became_peered":"2024-03-30T15:07:34.338779+0000","last_unstale":"2024-03-30T15:08:29.775057+0000","last_undegraded":"2024-03-30T15:08:29.775057+0000","last_fullsized":"2024-03-30T15:08:29.775057+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:44:13.762511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"67'11","reported_seq":77,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:10:17.562469+0000","last_change":"2024-03-30T15:07:36.366409+0000","last_active":"2024-03-30T15:10:17.562469+0000","last_peered":"2024-03-30T15:10:17.562469+0000","last_clean":"2024-03-30T15:10:17.562469+0000","last_became_active":"2024-03-30T15:07:36.366082+0000","last_became_peered":"2024-03-30T15:07:36.366082+0000","last_unstale":"2024-03-30T15:10:17.562469+0000","last_undegraded":"2024-03-30T15:10:17.562469+0000","last_fullsized":"2024-03-30T15:10:17.562469+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:12:25.822809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.507527+0000","last_change":"2024-03-30T15:07:38.389943+0000","last_active":"2024-03-30T15:08:30.507527+0000","last_peered":"2024-03-30T15:08:30.507527+0000","last_clean":"2024-03-30T15:08:30.507527+0000","last_became_active":"2024-03-30T15:07:38.389376+0000","last_became_peered":"2024-03-30T15:07:38.389376+0000","last_unstale":"2024-03-30T15:08:30.507527+0000","last_undegraded":"2024-03-30T15:08:30.507527+0000","last_fullsized":"2024-03-30T15:08:30.507527+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:42:30.068353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.511290+0000","last_change":"2024-03-30T15:07:32.337508+0000","last_active":"2024-03-30T15:08:30.511290+0000","last_peered":"2024-03-30T15:08:30.511290+0000","last_clean":"2024-03-30T15:08:30.511290+0000","last_became_active":"2024-03-30T15:07:32.337167+0000","last_became_peered":"2024-03-30T15:07:32.337167+0000","last_unstale":"2024-03-30T15:08:30.511290+0000","last_undegraded":"2024-03-30T15:08:30.511290+0000","last_fullsized":"2024-03-30T15:08:30.511290+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:33:45.573370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"67'16","reported_seq":93,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:10:17.562487+0000","last_change":"2024-03-30T15:07:34.355275+0000","last_active":"2024-03-30T15:10:17.562487+0000","last_peered":"2024-03-30T15:10:17.562487+0000","last_clean":"2024-03-30T15:10:17.562487+0000","last_became_active":"2024-03-30T15:07:34.354977+0000","last_became_peered":"2024-03-30T15:07:34.354977+0000","last_unstale":"2024-03-30T15:10:17.562487+0000","last_undegraded":"2024-03-30T15:10:17.562487+0000","last_fullsized":"2024-03-30T15:10:17.562487+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:46:35.266407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.509321+0000","last_change":"2024-03-30T15:07:36.347570+0000","last_active":"2024-03-30T15:08:30.509321+0000","last_peered":"2024-03-30T15:08:30.509321+0000","last_clean":"2024-03-30T15:08:30.509321+0000","last_became_active":"2024-03-30T15:07:36.346694+0000","last_became_peered":"2024-03-30T15:07:36.346694+0000","last_unstale":"2024-03-30T15:08:30.509321+0000","last_undegraded":"2024-03-30T15:08:30.509321+0000","last_fullsized":"2024-03-30T15:08:30.509321+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:52:06.377187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.716894+0000","last_change":"2024-03-30T15:07:38.403478+0000","last_active":"2024-03-30T15:08:29.716894+0000","last_peered":"2024-03-30T15:08:29.716894+0000","last_clean":"2024-03-30T15:08:29.716894+0000","last_became_active":"2024-03-30T15:07:38.402849+0000","last_became_peered":"2024-03-30T15:07:38.402849+0000","last_unstale":"2024-03-30T15:08:29.716894+0000","last_undegraded":"2024-03-30T15:08:29.716894+0000","last_fullsized":"2024-03-30T15:08:29.716894+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:36:31.832642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.389136+0000","last_change":"2024-03-30T15:07:32.334463+0000","last_active":"2024-03-30T15:08:30.389136+0000","last_peered":"2024-03-30T15:08:30.389136+0000","last_clean":"2024-03-30T15:08:30.389136+0000","last_became_active":"2024-03-30T15:07:32.333524+0000","last_became_peered":"2024-03-30T15:07:32.333524+0000","last_unstale":"2024-03-30T15:08:30.389136+0000","last_undegraded":"2024-03-30T15:08:30.389136+0000","last_fullsized":"2024-03-30T15:08:30.389136+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:52:47.940031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"67'19","reported_seq":72,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.720665+0000","last_change":"2024-03-30T15:07:34.344335+0000","last_active":"2024-03-30T15:08:29.720665+0000","last_peered":"2024-03-30T15:08:29.720665+0000","last_clean":"2024-03-30T15:08:29.720665+0000","last_became_active":"2024-03-30T15:07:34.344052+0000","last_became_peered":"2024-03-30T15:07:34.344052+0000","last_unstale":"2024-03-30T15:08:29.720665+0000","last_undegraded":"2024-03-30T15:08:29.720665+0000","last_fullsized":"2024-03-30T15:08:29.720665+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:34:38.663616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.511456+0000","last_change":"2024-03-30T15:07:36.376536+0000","last_active":"2024-03-30T15:08:30.511456+0000","last_peered":"2024-03-30T15:08:30.511456+0000","last_clean":"2024-03-30T15:08:30.511456+0000","last_became_active":"2024-03-30T15:07:36.375830+0000","last_became_peered":"2024-03-30T15:07:36.375830+0000","last_unstale":"2024-03-30T15:08:30.511456+0000","last_undegraded":"2024-03-30T15:08:30.511456+0000","last_fullsized":"2024-03-30T15:08:30.511456+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T02:10:41.398902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.774864+0000","last_change":"2024-03-30T15:07:38.405589+0000","last_active":"2024-03-30T15:08:29.774864+0000","last_peered":"2024-03-30T15:08:29.774864+0000","last_clean":"2024-03-30T15:08:29.774864+0000","last_became_active":"2024-03-30T15:07:38.404861+0000","last_became_peered":"2024-03-30T15:07:38.404861+0000","last_unstale":"2024-03-30T15:08:29.774864+0000","last_undegraded":"2024-03-30T15:08:29.774864+0000","last_fullsized":"2024-03-30T15:08:29.774864+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T02:06:37.920724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"67'18","reported_seq":67,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.505713+0000","last_change":"2024-03-30T15:07:34.351151+0000","last_active":"2024-03-30T15:08:30.505713+0000","last_peered":"2024-03-30T15:08:30.505713+0000","last_clean":"2024-03-30T15:08:30.505713+0000","last_became_active":"2024-03-30T15:07:34.350664+0000","last_became_peered":"2024-03-30T15:07:34.350664+0000","last_unstale":"2024-03-30T15:08:30.505713+0000","last_undegraded":"2024-03-30T15:08:30.505713+0000","last_fullsized":"2024-03-30T15:08:30.505713+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:32.138703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.716106+0000","last_change":"2024-03-30T15:07:32.321373+0000","last_active":"2024-03-30T15:08:29.716106+0000","last_peered":"2024-03-30T15:08:29.716106+0000","last_clean":"2024-03-30T15:08:29.716106+0000","last_became_active":"2024-03-30T15:07:32.320673+0000","last_became_peered":"2024-03-30T15:07:32.320673+0000","last_unstale":"2024-03-30T15:08:29.716106+0000","last_undegraded":"2024-03-30T15:08:29.716106+0000","last_fullsized":"2024-03-30T15:08:29.716106+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:37:24.827543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.509714+0000","last_change":"2024-03-30T15:07:36.369064+0000","last_active":"2024-03-30T15:08:30.509714+0000","last_peered":"2024-03-30T15:08:30.509714+0000","last_clean":"2024-03-30T15:08:30.509714+0000","last_became_active":"2024-03-30T15:07:36.368207+0000","last_became_peered":"2024-03-30T15:07:36.368207+0000","last_unstale":"2024-03-30T15:08:30.509714+0000","last_undegraded":"2024-03-30T15:08:30.509714+0000","last_fullsized":"2024-03-30T15:08:30.509714+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:30:12.502240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.390143+0000","last_change":"2024-03-30T15:07:38.382182+0000","last_active":"2024-03-30T15:08:30.390143+0000","last_peered":"2024-03-30T15:08:30.390143+0000","last_clean":"2024-03-30T15:08:30.390143+0000","last_became_active":"2024-03-30T15:07:38.381501+0000","last_became_peered":"2024-03-30T15:07:38.381501+0000","last_unstale":"2024-03-30T15:08:30.390143+0000","last_undegraded":"2024-03-30T15:08:30.390143+0000","last_fullsized":"2024-03-30T15:08:30.390143+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:13:49.200669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"67'10","reported_seq":51,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.715759+0000","last_change":"2024-03-30T15:07:34.354338+0000","last_active":"2024-03-30T15:08:29.715759+0000","last_peered":"2024-03-30T15:08:29.715759+0000","last_clean":"2024-03-30T15:08:29.715759+0000","last_became_active":"2024-03-30T15:07:34.353738+0000","last_became_peered":"2024-03-30T15:07:34.353738+0000","last_unstale":"2024-03-30T15:08:29.715759+0000","last_undegraded":"2024-03-30T15:08:29.715759+0000","last_fullsized":"2024-03-30T15:08:29.715759+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:02.723937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.388773+0000","last_change":"2024-03-30T15:07:32.337660+0000","last_active":"2024-03-30T15:08:30.388773+0000","last_peered":"2024-03-30T15:08:30.388773+0000","last_clean":"2024-03-30T15:08:30.388773+0000","last_became_active":"2024-03-30T15:07:32.336777+0000","last_became_peered":"2024-03-30T15:07:32.336777+0000","last_unstale":"2024-03-30T15:08:30.388773+0000","last_undegraded":"2024-03-30T15:08:30.388773+0000","last_fullsized":"2024-03-30T15:08:30.388773+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:00:31.043882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"74'128","reported_seq":283,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:31.871801+0000","last_change":"2024-03-30T15:06:54.950175+0000","last_active":"2024-03-30T15:08:31.871801+0000","last_peered":"2024-03-30T15:08:31.871801+0000","last_clean":"2024-03-30T15:08:31.871801+0000","last_became_active":"2024-03-30T15:06:54.949407+0000","last_became_peered":"2024-03-30T15:06:54.949407+0000","last_unstale":"2024-03-30T15:08:31.871801+0000","last_undegraded":"2024-03-30T15:08:31.871801+0000","last_fullsized":"2024-03-30T15:08:31.871801+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:02:34.263471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:02:34.263471+0000","last_clean_scrub_stamp":"2024-03-30T15:02:34.263471+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:26:50.424000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.860242+0000","last_change":"2024-03-30T15:07:36.361649+0000","last_active":"2024-03-30T15:08:29.860242+0000","last_peered":"2024-03-30T15:08:29.860242+0000","last_clean":"2024-03-30T15:08:29.860242+0000","last_became_active":"2024-03-30T15:07:36.361294+0000","last_became_peered":"2024-03-30T15:07:36.361294+0000","last_unstale":"2024-03-30T15:08:29.860242+0000","last_undegraded":"2024-03-30T15:08:29.860242+0000","last_fullsized":"2024-03-30T15:08:29.860242+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:04:04.127435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.511035+0000","last_change":"2024-03-30T15:07:38.403074+0000","last_active":"2024-03-30T15:08:30.511035+0000","last_peered":"2024-03-30T15:08:30.511035+0000","last_clean":"2024-03-30T15:08:30.511035+0000","last_became_active":"2024-03-30T15:07:38.402585+0000","last_became_peered":"2024-03-30T15:07:38.402585+0000","last_unstale":"2024-03-30T15:08:30.511035+0000","last_undegraded":"2024-03-30T15:08:30.511035+0000","last_fullsized":"2024-03-30T15:08:30.511035+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:08:52.964485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"67'14","reported_seq":56,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.506778+0000","last_change":"2024-03-30T15:07:34.350781+0000","last_active":"2024-03-30T15:08:30.506778+0000","last_peered":"2024-03-30T15:08:30.506778+0000","last_clean":"2024-03-30T15:08:30.506778+0000","last_became_active":"2024-03-30T15:07:34.349805+0000","last_became_peered":"2024-03-30T15:07:34.349805+0000","last_unstale":"2024-03-30T15:08:30.506778+0000","last_undegraded":"2024-03-30T15:08:30.506778+0000","last_fullsized":"2024-03-30T15:08:30.506778+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:01:09.419377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.774295+0000","last_change":"2024-03-30T15:07:32.338859+0000","last_active":"2024-03-30T15:08:29.774295+0000","last_peered":"2024-03-30T15:08:29.774295+0000","last_clean":"2024-03-30T15:08:29.774295+0000","last_became_active":"2024-03-30T15:07:32.333612+0000","last_became_peered":"2024-03-30T15:07:32.333612+0000","last_unstale":"2024-03-30T15:08:29.774295+0000","last_undegraded":"2024-03-30T15:08:29.774295+0000","last_fullsized":"2024-03-30T15:08:29.774295+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:17:12.141979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.510027+0000","last_change":"2024-03-30T15:07:36.379825+0000","last_active":"2024-03-30T15:08:30.510027+0000","last_peered":"2024-03-30T15:08:30.510027+0000","last_clean":"2024-03-30T15:08:30.510027+0000","last_became_active":"2024-03-30T15:07:36.378967+0000","last_became_peered":"2024-03-30T15:07:36.378967+0000","last_unstale":"2024-03-30T15:08:30.510027+0000","last_undegraded":"2024-03-30T15:08:30.510027+0000","last_fullsized":"2024-03-30T15:08:30.510027+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:24:35.402461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.506421+0000","last_change":"2024-03-30T15:07:38.399737+0000","last_active":"2024-03-30T15:08:30.506421+0000","last_peered":"2024-03-30T15:08:30.506421+0000","last_clean":"2024-03-30T15:08:30.506421+0000","last_became_active":"2024-03-30T15:07:38.399287+0000","last_became_peered":"2024-03-30T15:07:38.399287+0000","last_unstale":"2024-03-30T15:08:30.506421+0000","last_undegraded":"2024-03-30T15:08:30.506421+0000","last_fullsized":"2024-03-30T15:08:30.506421+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:35:44.406857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"70'2","reported_seq":41,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.859771+0000","last_change":"2024-03-30T15:07:46.731190+0000","last_active":"2024-03-30T15:08:29.859771+0000","last_peered":"2024-03-30T15:08:29.859771+0000","last_clean":"2024-03-30T15:08:29.859771+0000","last_became_active":"2024-03-30T15:07:36.347861+0000","last_became_peered":"2024-03-30T15:07:36.347861+0000","last_unstale":"2024-03-30T15:08:29.859771+0000","last_undegraded":"2024-03-30T15:08:29.859771+0000","last_fullsized":"2024-03-30T15:08:29.859771+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:33:01.740491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022480809999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.774988+0000","last_change":"2024-03-30T15:07:32.352247+0000","last_active":"2024-03-30T15:08:29.774988+0000","last_peered":"2024-03-30T15:08:29.774988+0000","last_clean":"2024-03-30T15:08:29.774988+0000","last_became_active":"2024-03-30T15:07:32.351844+0000","last_became_peered":"2024-03-30T15:07:32.351844+0000","last_unstale":"2024-03-30T15:08:29.774988+0000","last_undegraded":"2024-03-30T15:08:29.774988+0000","last_fullsized":"2024-03-30T15:08:29.774988+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:24:29.315750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"67'30","reported_seq":120,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:10:17.562167+0000","last_change":"2024-03-30T15:07:34.351198+0000","last_active":"2024-03-30T15:10:17.562167+0000","last_peered":"2024-03-30T15:10:17.562167+0000","last_clean":"2024-03-30T15:10:17.562167+0000","last_became_active":"2024-03-30T15:07:34.350624+0000","last_became_peered":"2024-03-30T15:07:34.350624+0000","last_unstale":"2024-03-30T15:10:17.562167+0000","last_undegraded":"2024-03-30T15:10:17.562167+0000","last_fullsized":"2024-03-30T15:10:17.562167+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:24:09.394014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":51,"num_read_kb":36,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"67'11","reported_seq":76,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:10:17.562177+0000","last_change":"2024-03-30T15:07:36.365970+0000","last_active":"2024-03-30T15:10:17.562177+0000","last_peered":"2024-03-30T15:10:17.562177+0000","last_clean":"2024-03-30T15:10:17.562177+0000","last_became_active":"2024-03-30T15:07:36.365046+0000","last_became_peered":"2024-03-30T15:07:36.365046+0000","last_unstale":"2024-03-30T15:10:17.562177+0000","last_undegraded":"2024-03-30T15:10:17.562177+0000","last_fullsized":"2024-03-30T15:10:17.562177+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:00:51.305859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"67'1","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.717917+0000","last_change":"2024-03-30T15:07:38.398606+0000","last_active":"2024-03-30T15:08:29.717917+0000","last_peered":"2024-03-30T15:08:29.717917+0000","last_clean":"2024-03-30T15:08:29.717917+0000","last_became_active":"2024-03-30T15:07:38.398187+0000","last_became_peered":"2024-03-30T15:07:38.398187+0000","last_unstale":"2024-03-30T15:08:29.717917+0000","last_undegraded":"2024-03-30T15:08:29.717917+0000","last_fullsized":"2024-03-30T15:08:29.717917+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:51.036443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.717613+0000","last_change":"2024-03-30T15:07:46.954219+0000","last_active":"2024-03-30T15:08:29.717613+0000","last_peered":"2024-03-30T15:08:29.717613+0000","last_clean":"2024-03-30T15:08:29.717613+0000","last_became_active":"2024-03-30T15:07:36.366177+0000","last_became_peered":"2024-03-30T15:07:36.366177+0000","last_unstale":"2024-03-30T15:08:29.717613+0000","last_undegraded":"2024-03-30T15:08:29.717613+0000","last_fullsized":"2024-03-30T15:08:29.717613+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:51:35.074800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012795160000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"60'1","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.513688+0000","last_change":"2024-03-30T15:07:32.340948+0000","last_active":"2024-03-30T15:08:30.513688+0000","last_peered":"2024-03-30T15:08:30.513688+0000","last_clean":"2024-03-30T15:08:30.513688+0000","last_became_active":"2024-03-30T15:07:32.340585+0000","last_became_peered":"2024-03-30T15:07:32.340585+0000","last_unstale":"2024-03-30T15:08:30.513688+0000","last_undegraded":"2024-03-30T15:08:30.513688+0000","last_fullsized":"2024-03-30T15:08:30.513688+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:36:13.725180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"67'13","reported_seq":63,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.719450+0000","last_change":"2024-03-30T15:07:34.349064+0000","last_active":"2024-03-30T15:08:29.719450+0000","last_peered":"2024-03-30T15:08:29.719450+0000","last_clean":"2024-03-30T15:08:29.719450+0000","last_became_active":"2024-03-30T15:07:34.348451+0000","last_became_peered":"2024-03-30T15:07:34.348451+0000","last_unstale":"2024-03-30T15:08:29.719450+0000","last_undegraded":"2024-03-30T15:08:29.719450+0000","last_fullsized":"2024-03-30T15:08:29.719450+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:31:33.971850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"67'11","reported_seq":77,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:10:17.562213+0000","last_change":"2024-03-30T15:07:36.371034+0000","last_active":"2024-03-30T15:10:17.562213+0000","last_peered":"2024-03-30T15:10:17.562213+0000","last_clean":"2024-03-30T15:10:17.562213+0000","last_became_active":"2024-03-30T15:07:36.370271+0000","last_became_peered":"2024-03-30T15:07:36.370271+0000","last_unstale":"2024-03-30T15:10:17.562213+0000","last_undegraded":"2024-03-30T15:10:17.562213+0000","last_fullsized":"2024-03-30T15:10:17.562213+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:30:54.736052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.774444+0000","last_change":"2024-03-30T15:07:38.400465+0000","last_active":"2024-03-30T15:08:29.774444+0000","last_peered":"2024-03-30T15:08:29.774444+0000","last_clean":"2024-03-30T15:08:29.774444+0000","last_became_active":"2024-03-30T15:07:38.400244+0000","last_became_peered":"2024-03-30T15:07:38.400244+0000","last_unstale":"2024-03-30T15:08:29.774444+0000","last_undegraded":"2024-03-30T15:08:29.774444+0000","last_fullsized":"2024-03-30T15:08:29.774444+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:40:42.770106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"71'5","reported_seq":193,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:10:24.751049+0000","last_change":"2024-03-30T15:07:46.951496+0000","last_active":"2024-03-30T15:10:24.751049+0000","last_peered":"2024-03-30T15:10:24.751049+0000","last_clean":"2024-03-30T15:10:24.751049+0000","last_became_active":"2024-03-30T15:07:36.381982+0000","last_became_peered":"2024-03-30T15:07:36.381982+0000","last_unstale":"2024-03-30T15:10:24.751049+0000","last_undegraded":"2024-03-30T15:10:24.751049+0000","last_fullsized":"2024-03-30T15:10:24.751049+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:30:53.850420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013708629999999999,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":151,"num_read_kb":146,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.860560+0000","last_change":"2024-03-30T15:07:32.350652+0000","last_active":"2024-03-30T15:08:29.860560+0000","last_peered":"2024-03-30T15:08:29.860560+0000","last_clean":"2024-03-30T15:08:29.860560+0000","last_became_active":"2024-03-30T15:07:32.350304+0000","last_became_peered":"2024-03-30T15:07:32.350304+0000","last_unstale":"2024-03-30T15:08:29.860560+0000","last_undegraded":"2024-03-30T15:08:29.860560+0000","last_fullsized":"2024-03-30T15:08:29.860560+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:52:57.947063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"67'12","reported_seq":53,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.508216+0000","last_change":"2024-03-30T15:07:34.342353+0000","last_active":"2024-03-30T15:08:30.508216+0000","last_peered":"2024-03-30T15:08:30.508216+0000","last_clean":"2024-03-30T15:08:30.508216+0000","last_became_active":"2024-03-30T15:07:34.341900+0000","last_became_peered":"2024-03-30T15:07:34.341900+0000","last_unstale":"2024-03-30T15:08:30.508216+0000","last_undegraded":"2024-03-30T15:08:30.508216+0000","last_fullsized":"2024-03-30T15:08:30.508216+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:46:56.863571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.718154+0000","last_change":"2024-03-30T15:07:36.333712+0000","last_active":"2024-03-30T15:08:29.718154+0000","last_peered":"2024-03-30T15:08:29.718154+0000","last_clean":"2024-03-30T15:08:29.718154+0000","last_became_active":"2024-03-30T15:07:36.333318+0000","last_became_peered":"2024-03-30T15:07:36.333318+0000","last_unstale":"2024-03-30T15:08:29.718154+0000","last_undegraded":"2024-03-30T15:08:29.718154+0000","last_fullsized":"2024-03-30T15:08:29.718154+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:49:58.374528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.717593+0000","last_change":"2024-03-30T15:07:38.402730+0000","last_active":"2024-03-30T15:08:29.717593+0000","last_peered":"2024-03-30T15:08:29.717593+0000","last_clean":"2024-03-30T15:08:29.717593+0000","last_became_active":"2024-03-30T15:07:38.402226+0000","last_became_peered":"2024-03-30T15:07:38.402226+0000","last_unstale":"2024-03-30T15:08:29.717593+0000","last_undegraded":"2024-03-30T15:08:29.717593+0000","last_fullsized":"2024-03-30T15:08:29.717593+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T02:30:20.845556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"73'12","reported_seq":88,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:10:17.562288+0000","last_change":"2024-03-30T15:08:15.729711+0000","last_active":"2024-03-30T15:10:17.562288+0000","last_peered":"2024-03-30T15:10:17.562288+0000","last_clean":"2024-03-30T15:10:17.562288+0000","last_became_active":"2024-03-30T15:08:15.720879+0000","last_became_peered":"2024-03-30T15:08:15.720879+0000","last_unstale":"2024-03-30T15:10:17.562288+0000","last_undegraded":"2024-03-30T15:10:17.562288+0000","last_fullsized":"2024-03-30T15:10:17.562288+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T02:19:06.966387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.774677+0000","last_change":"2024-03-30T15:07:32.330917+0000","last_active":"2024-03-30T15:08:29.774677+0000","last_peered":"2024-03-30T15:08:29.774677+0000","last_clean":"2024-03-30T15:08:29.774677+0000","last_became_active":"2024-03-30T15:07:32.329951+0000","last_became_peered":"2024-03-30T15:07:32.329951+0000","last_unstale":"2024-03-30T15:08:29.774677+0000","last_undegraded":"2024-03-30T15:08:29.774677+0000","last_fullsized":"2024-03-30T15:08:29.774677+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:04:23.601903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"67'12","reported_seq":59,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.717947+0000","last_change":"2024-03-30T15:07:34.339066+0000","last_active":"2024-03-30T15:08:29.717947+0000","last_peered":"2024-03-30T15:08:29.717947+0000","last_clean":"2024-03-30T15:08:29.717947+0000","last_became_active":"2024-03-30T15:07:34.338284+0000","last_became_peered":"2024-03-30T15:07:34.338284+0000","last_unstale":"2024-03-30T15:08:29.717947+0000","last_undegraded":"2024-03-30T15:08:29.717947+0000","last_fullsized":"2024-03-30T15:08:29.717947+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:50:12.291945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.389845+0000","last_change":"2024-03-30T15:07:38.386156+0000","last_active":"2024-03-30T15:08:30.389845+0000","last_peered":"2024-03-30T15:08:30.389845+0000","last_clean":"2024-03-30T15:08:30.389845+0000","last_became_active":"2024-03-30T15:07:38.385734+0000","last_became_peered":"2024-03-30T15:07:38.385734+0000","last_unstale":"2024-03-30T15:08:30.389845+0000","last_undegraded":"2024-03-30T15:08:30.389845+0000","last_fullsized":"2024-03-30T15:08:30.389845+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:34:43.342944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.509932+0000","last_change":"2024-03-30T15:07:36.375838+0000","last_active":"2024-03-30T15:08:30.509932+0000","last_peered":"2024-03-30T15:08:30.509932+0000","last_clean":"2024-03-30T15:08:30.509932+0000","last_became_active":"2024-03-30T15:07:36.374862+0000","last_became_peered":"2024-03-30T15:07:36.374862+0000","last_unstale":"2024-03-30T15:08:30.509932+0000","last_undegraded":"2024-03-30T15:08:30.509932+0000","last_fullsized":"2024-03-30T15:08:30.509932+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:20:54.492365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":39,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.506553+0000","last_change":"2024-03-30T15:07:32.338967+0000","last_active":"2024-03-30T15:08:30.506553+0000","last_peered":"2024-03-30T15:08:30.506553+0000","last_clean":"2024-03-30T15:08:30.506553+0000","last_became_active":"2024-03-30T15:07:32.338627+0000","last_became_peered":"2024-03-30T15:07:32.338627+0000","last_unstale":"2024-03-30T15:08:30.506553+0000","last_undegraded":"2024-03-30T15:08:30.506553+0000","last_fullsized":"2024-03-30T15:08:30.506553+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:52.664219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"67'15","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.715670+0000","last_change":"2024-03-30T15:07:34.344448+0000","last_active":"2024-03-30T15:08:29.715670+0000","last_peered":"2024-03-30T15:08:29.715670+0000","last_clean":"2024-03-30T15:08:29.715670+0000","last_became_active":"2024-03-30T15:07:34.343910+0000","last_became_peered":"2024-03-30T15:07:34.343910+0000","last_unstale":"2024-03-30T15:08:29.715670+0000","last_undegraded":"2024-03-30T15:08:29.715670+0000","last_fullsized":"2024-03-30T15:08:29.715670+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:34:48.376583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.720737+0000","last_change":"2024-03-30T15:07:38.389748+0000","last_active":"2024-03-30T15:08:29.720737+0000","last_peered":"2024-03-30T15:08:29.720737+0000","last_clean":"2024-03-30T15:08:29.720737+0000","last_became_active":"2024-03-30T15:07:38.389131+0000","last_became_peered":"2024-03-30T15:07:38.389131+0000","last_unstale":"2024-03-30T15:08:29.720737+0000","last_undegraded":"2024-03-30T15:08:29.720737+0000","last_fullsized":"2024-03-30T15:08:29.720737+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:56.400043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":39,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.509151+0000","last_change":"2024-03-30T15:07:32.330290+0000","last_active":"2024-03-30T15:08:30.509151+0000","last_peered":"2024-03-30T15:08:30.509151+0000","last_clean":"2024-03-30T15:08:30.509151+0000","last_became_active":"2024-03-30T15:07:32.329811+0000","last_became_peered":"2024-03-30T15:07:32.329811+0000","last_unstale":"2024-03-30T15:08:30.509151+0000","last_undegraded":"2024-03-30T15:08:30.509151+0000","last_fullsized":"2024-03-30T15:08:30.509151+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:18:57.267588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"67'9","reported_seq":52,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.717094+0000","last_change":"2024-03-30T15:07:34.347298+0000","last_active":"2024-03-30T15:08:29.717094+0000","last_peered":"2024-03-30T15:08:29.717094+0000","last_clean":"2024-03-30T15:08:29.717094+0000","last_became_active":"2024-03-30T15:07:34.346723+0000","last_became_peered":"2024-03-30T15:07:34.346723+0000","last_unstale":"2024-03-30T15:08:29.717094+0000","last_undegraded":"2024-03-30T15:08:29.717094+0000","last_fullsized":"2024-03-30T15:08:29.717094+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T03:03:14.285509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.718869+0000","last_change":"2024-03-30T15:07:36.354874+0000","last_active":"2024-03-30T15:08:29.718869+0000","last_peered":"2024-03-30T15:08:29.718869+0000","last_clean":"2024-03-30T15:08:29.718869+0000","last_became_active":"2024-03-30T15:07:36.354526+0000","last_became_peered":"2024-03-30T15:07:36.354526+0000","last_unstale":"2024-03-30T15:08:29.718869+0000","last_undegraded":"2024-03-30T15:08:29.718869+0000","last_fullsized":"2024-03-30T15:08:29.718869+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T02:11:48.598236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.718458+0000","last_change":"2024-03-30T15:07:38.387225+0000","last_active":"2024-03-30T15:08:29.718458+0000","last_peered":"2024-03-30T15:08:29.718458+0000","last_clean":"2024-03-30T15:08:29.718458+0000","last_became_active":"2024-03-30T15:07:38.386214+0000","last_became_peered":"2024-03-30T15:07:38.386214+0000","last_unstale":"2024-03-30T15:08:29.718458+0000","last_undegraded":"2024-03-30T15:08:29.718458+0000","last_fullsized":"2024-03-30T15:08:29.718458+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:48:16.564054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"67'11","reported_seq":77,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:10:17.562450+0000","last_change":"2024-03-30T15:07:36.351777+0000","last_active":"2024-03-30T15:10:17.562450+0000","last_peered":"2024-03-30T15:10:17.562450+0000","last_clean":"2024-03-30T15:10:17.562450+0000","last_became_active":"2024-03-30T15:07:36.351376+0000","last_became_peered":"2024-03-30T15:07:36.351376+0000","last_unstale":"2024-03-30T15:10:17.562450+0000","last_undegraded":"2024-03-30T15:10:17.562450+0000","last_fullsized":"2024-03-30T15:10:17.562450+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T02:52:06.347766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.774561+0000","last_change":"2024-03-30T15:07:32.352236+0000","last_active":"2024-03-30T15:08:29.774561+0000","last_peered":"2024-03-30T15:08:29.774561+0000","last_clean":"2024-03-30T15:08:29.774561+0000","last_became_active":"2024-03-30T15:07:32.350571+0000","last_became_peered":"2024-03-30T15:07:32.350571+0000","last_unstale":"2024-03-30T15:08:29.774561+0000","last_undegraded":"2024-03-30T15:08:29.774561+0000","last_fullsized":"2024-03-30T15:08:29.774561+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:06:23.655260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"67'19","reported_seq":67,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.859969+0000","last_change":"2024-03-30T15:07:34.342569+0000","last_active":"2024-03-30T15:08:29.859969+0000","last_peered":"2024-03-30T15:08:29.859969+0000","last_clean":"2024-03-30T15:08:29.859969+0000","last_became_active":"2024-03-30T15:07:34.342230+0000","last_became_peered":"2024-03-30T15:07:34.342230+0000","last_unstale":"2024-03-30T15:08:29.859969+0000","last_undegraded":"2024-03-30T15:08:29.859969+0000","last_fullsized":"2024-03-30T15:08:29.859969+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:50:25.276224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.774119+0000","last_change":"2024-03-30T15:07:38.405602+0000","last_active":"2024-03-30T15:08:29.774119+0000","last_peered":"2024-03-30T15:08:29.774119+0000","last_clean":"2024-03-30T15:08:29.774119+0000","last_became_active":"2024-03-30T15:07:38.404958+0000","last_became_peered":"2024-03-30T15:07:38.404958+0000","last_unstale":"2024-03-30T15:08:29.774119+0000","last_undegraded":"2024-03-30T15:08:29.774119+0000","last_fullsized":"2024-03-30T15:08:29.774119+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:50:15.482136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.718305+0000","last_change":"2024-03-30T15:07:32.331675+0000","last_active":"2024-03-30T15:08:29.718305+0000","last_peered":"2024-03-30T15:08:29.718305+0000","last_clean":"2024-03-30T15:08:29.718305+0000","last_became_active":"2024-03-30T15:07:32.331163+0000","last_became_peered":"2024-03-30T15:07:32.331163+0000","last_unstale":"2024-03-30T15:08:29.718305+0000","last_undegraded":"2024-03-30T15:08:29.718305+0000","last_fullsized":"2024-03-30T15:08:29.718305+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:46:47.254120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"67'17","reported_seq":64,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.775000+0000","last_change":"2024-03-30T15:07:34.337741+0000","last_active":"2024-03-30T15:08:29.775000+0000","last_peered":"2024-03-30T15:08:29.775000+0000","last_clean":"2024-03-30T15:08:29.775000+0000","last_became_active":"2024-03-30T15:07:34.337357+0000","last_became_peered":"2024-03-30T15:07:34.337357+0000","last_unstale":"2024-03-30T15:08:29.775000+0000","last_undegraded":"2024-03-30T15:08:29.775000+0000","last_fullsized":"2024-03-30T15:08:29.775000+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:19:21.556621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":38,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.859622+0000","last_change":"2024-03-30T15:08:16.510715+0000","last_active":"2024-03-30T15:08:29.859622+0000","last_peered":"2024-03-30T15:08:29.859622+0000","last_clean":"2024-03-30T15:08:29.859622+0000","last_became_active":"2024-03-30T15:08:16.510322+0000","last_became_peered":"2024-03-30T15:08:16.510322+0000","last_unstale":"2024-03-30T15:08:29.859622+0000","last_undegraded":"2024-03-30T15:08:29.859622+0000","last_fullsized":"2024-03-30T15:08:29.859622+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:39:53.736840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,7],"acting":[6,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.507278+0000","last_change":"2024-03-30T15:07:38.394884+0000","last_active":"2024-03-30T15:08:30.507278+0000","last_peered":"2024-03-30T15:08:30.507278+0000","last_clean":"2024-03-30T15:08:30.507278+0000","last_became_active":"2024-03-30T15:07:38.394021+0000","last_became_peered":"2024-03-30T15:07:38.394021+0000","last_unstale":"2024-03-30T15:08:30.507278+0000","last_undegraded":"2024-03-30T15:08:30.507278+0000","last_fullsized":"2024-03-30T15:08:30.507278+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:35:25.840517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":39,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.509630+0000","last_change":"2024-03-30T15:07:32.340848+0000","last_active":"2024-03-30T15:08:30.509630+0000","last_peered":"2024-03-30T15:08:30.509630+0000","last_clean":"2024-03-30T15:08:30.509630+0000","last_became_active":"2024-03-30T15:07:32.340488+0000","last_became_peered":"2024-03-30T15:07:32.340488+0000","last_unstale":"2024-03-30T15:08:30.509630+0000","last_undegraded":"2024-03-30T15:08:30.509630+0000","last_fullsized":"2024-03-30T15:08:30.509630+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:01:56.309218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"67'10","reported_seq":51,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.387492+0000","last_change":"2024-03-30T15:07:34.336404+0000","last_active":"2024-03-30T15:08:30.387492+0000","last_peered":"2024-03-30T15:08:30.387492+0000","last_clean":"2024-03-30T15:08:30.387492+0000","last_became_active":"2024-03-30T15:07:34.336037+0000","last_became_peered":"2024-03-30T15:07:34.336037+0000","last_unstale":"2024-03-30T15:08:30.387492+0000","last_undegraded":"2024-03-30T15:08:30.387492+0000","last_fullsized":"2024-03-30T15:08:30.387492+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:54:37.926017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.509707+0000","last_change":"2024-03-30T15:07:36.379834+0000","last_active":"2024-03-30T15:08:30.509707+0000","last_peered":"2024-03-30T15:08:30.509707+0000","last_clean":"2024-03-30T15:08:30.509707+0000","last_became_active":"2024-03-30T15:07:36.378951+0000","last_became_peered":"2024-03-30T15:07:36.378951+0000","last_unstale":"2024-03-30T15:08:30.509707+0000","last_undegraded":"2024-03-30T15:08:30.509707+0000","last_fullsized":"2024-03-30T15:08:30.509707+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:33:31.659134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.389525+0000","last_change":"2024-03-30T15:07:38.402366+0000","last_active":"2024-03-30T15:08:30.389525+0000","last_peered":"2024-03-30T15:08:30.389525+0000","last_clean":"2024-03-30T15:08:30.389525+0000","last_became_active":"2024-03-30T15:07:38.401820+0000","last_became_peered":"2024-03-30T15:07:38.401820+0000","last_unstale":"2024-03-30T15:08:30.389525+0000","last_undegraded":"2024-03-30T15:08:30.389525+0000","last_fullsized":"2024-03-30T15:08:30.389525+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:44:43.744390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.716946+0000","last_change":"2024-03-30T15:07:32.326966+0000","last_active":"2024-03-30T15:08:29.716946+0000","last_peered":"2024-03-30T15:08:29.716946+0000","last_clean":"2024-03-30T15:08:29.716946+0000","last_became_active":"2024-03-30T15:07:32.326662+0000","last_became_peered":"2024-03-30T15:07:32.326662+0000","last_unstale":"2024-03-30T15:08:29.716946+0000","last_undegraded":"2024-03-30T15:08:29.716946+0000","last_fullsized":"2024-03-30T15:08:29.716946+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:18.057060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"67'15","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.775080+0000","last_change":"2024-03-30T15:07:34.343848+0000","last_active":"2024-03-30T15:08:29.775080+0000","last_peered":"2024-03-30T15:08:29.775080+0000","last_clean":"2024-03-30T15:08:29.775080+0000","last_became_active":"2024-03-30T15:07:34.343515+0000","last_became_peered":"2024-03-30T15:07:34.343515+0000","last_unstale":"2024-03-30T15:08:29.775080+0000","last_undegraded":"2024-03-30T15:08:29.775080+0000","last_fullsized":"2024-03-30T15:08:29.775080+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:15:52.626541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.388331+0000","last_change":"2024-03-30T15:07:36.362365+0000","last_active":"2024-03-30T15:08:30.388331+0000","last_peered":"2024-03-30T15:08:30.388331+0000","last_clean":"2024-03-30T15:08:30.388331+0000","last_became_active":"2024-03-30T15:07:36.361989+0000","last_became_peered":"2024-03-30T15:07:36.361989+0000","last_unstale":"2024-03-30T15:08:30.388331+0000","last_undegraded":"2024-03-30T15:08:30.388331+0000","last_fullsized":"2024-03-30T15:08:30.388331+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:38:22.562034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":383,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":3,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":151,"num_read_kb":146,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":90,"ondisk_log_size":90,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":701,"num_read_kb":458,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":395,"ondisk_log_size":395,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1457,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":54,"seq":231928234028,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28424,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716728,"statfs":{"total":95995035648,"available":95965929472,"internally_reserved":0,"allocated":1441792,"data_stored":944024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495671,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28404,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716748,"statfs":{"total":95995035648,"available":95965949952,"internally_reserved":0,"allocated":1421312,"data_stored":943600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574956,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":835584,"data_stored":353039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738487,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32576,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712576,"statfs":{"total":95995035648,"available":95961677824,"internally_reserved":0,"allocated":1433600,"data_stored":943389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411424,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31992,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713160,"statfs":{"total":95995035648,"available":95962275840,"internally_reserved":0,"allocated":831488,"data_stored":353686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182487,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31984,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713168,"statfs":{"total":95995035648,"available":95962284032,"internally_reserved":0,"allocated":823296,"data_stored":352738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018955,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32028,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713124,"statfs":{"total":95995035648,"available":95962238976,"internally_reserved":0,"allocated":868352,"data_stored":354064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757314,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31988,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713164,"statfs":{"total":95995035648,"available":95962279936,"internally_reserved":0,"allocated":827392,"data_stored":353582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T15:10:27.028 DEBUG:teuthology.orchestra.run.smithi072:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T15:10:27.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:26 smithi072 bash[21573]: cluster 2024-03-30T15:10:25.787687+0000 mgr.y (mgr.14526) 105 : cluster 0 pgmap v61: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:10:27.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:26 smithi072 bash[21573]: audit 2024-03-30T15:10:26.276887+0000 mgr.y (mgr.14526) 106 : audit 0 from='client.14682 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T15:10:27.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:26 smithi072 bash[28946]: cluster 2024-03-30T15:10:25.787687+0000 mgr.y (mgr.14526) 105 : cluster 0 pgmap v61: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:10:27.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:26 smithi072 bash[28946]: audit 2024-03-30T15:10:26.276887+0000 mgr.y (mgr.14526) 106 : audit 0 from='client.14682 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T15:10:27.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:26 smithi172 bash[23680]: cluster 2024-03-30T15:10:25.787687+0000 mgr.y (mgr.14526) 105 : cluster 0 pgmap v61: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:10:27.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:26 smithi172 bash[23680]: audit 2024-03-30T15:10:26.276887+0000 mgr.y (mgr.14526) 106 : audit 0 from='client.14682 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T15:10:29.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:28 smithi072 bash[21573]: cluster 2024-03-30T15:10:27.788347+0000 mgr.y (mgr.14526) 107 : cluster 0 pgmap v62: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:10:29.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:28 smithi072 bash[28946]: cluster 2024-03-30T15:10:27.788347+0000 mgr.y (mgr.14526) 107 : cluster 0 pgmap v62: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:10:29.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:28 smithi172 bash[23680]: cluster 2024-03-30T15:10:27.788347+0000 mgr.y (mgr.14526) 107 : cluster 0 pgmap v62: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:10:31.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:30 smithi072 bash[21573]: cluster 2024-03-30T15:10:29.788873+0000 mgr.y (mgr.14526) 108 : cluster 0 pgmap v63: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:10:31.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:30 smithi072 bash[21573]: audit 2024-03-30T15:10:30.080226+0000 mon.c (mon.2) 82 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:10:31.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:30 smithi072 bash[28946]: cluster 2024-03-30T15:10:29.788873+0000 mgr.y (mgr.14526) 108 : cluster 0 pgmap v63: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:10:31.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:30 smithi072 bash[28946]: audit 2024-03-30T15:10:30.080226+0000 mon.c (mon.2) 82 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:10:31.168 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:10:31 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:10:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:10:31.216 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:10:30 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:10:31.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:30 smithi172 bash[23680]: cluster 2024-03-30T15:10:29.788873+0000 mgr.y (mgr.14526) 108 : cluster 0 pgmap v63: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:10:31.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:30 smithi172 bash[23680]: audit 2024-03-30T15:10:30.080226+0000 mon.c (mon.2) 82 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:10:31.809 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T15:10:32.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:31 smithi072 bash[21573]: audit 2024-03-30T15:10:30.854563+0000 mgr.y (mgr.14526) 109 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:10:32.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:31 smithi072 bash[28946]: audit 2024-03-30T15:10:30.854563+0000 mgr.y (mgr.14526) 109 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:10:32.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:31 smithi172 bash[23680]: audit 2024-03-30T15:10:30.854563+0000 mgr.y (mgr.14526) 109 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:10:33.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:32 smithi072 bash[21573]: cluster 2024-03-30T15:10:31.790255+0000 mgr.y (mgr.14526) 110 : cluster 0 pgmap v64: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:10:33.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:32 smithi072 bash[28946]: cluster 2024-03-30T15:10:31.790255+0000 mgr.y (mgr.14526) 110 : cluster 0 pgmap v64: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:10:33.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:32 smithi172 bash[23680]: cluster 2024-03-30T15:10:31.790255+0000 mgr.y (mgr.14526) 110 : cluster 0 pgmap v64: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:10:34.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:34.750+0000 7fe2bd3bc700 1 -- 172.21.15.72:0/2542653901 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2b81068e0 msgr2=0x7fe2b8106cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:34.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:34.750+0000 7fe2bd3bc700 1 --2- 172.21.15.72:0/2542653901 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2b81068e0 0x7fe2b8106cc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe2a80098f0 tx=0x7fe2a8009c00 comp rx=0 tx=0).stop 2024-03-30T15:10:34.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:34.750+0000 7fe2bd3bc700 1 -- 172.21.15.72:0/2542653901 shutdown_connections 2024-03-30T15:10:34.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:34.750+0000 7fe2bd3bc700 1 --2- 172.21.15.72:0/2542653901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2b81012a0 0x7fe2b810d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:34.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:34.750+0000 7fe2bd3bc700 1 --2- 172.21.15.72:0/2542653901 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2b81068e0 0x7fe2b8106cc0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:34.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:34.750+0000 7fe2bd3bc700 1 --2- 172.21.15.72:0/2542653901 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2b81008e0 0x7fe2b8100d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:34.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:34.750+0000 7fe2bd3bc700 1 -- 172.21.15.72:0/2542653901 >> 172.21.15.72:0/2542653901 conn(0x7fe2b8077740 msgr2=0x7fe2b80feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:10:34.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:34.750+0000 7fe2bd3bc700 1 -- 172.21.15.72:0/2542653901 shutdown_connections 2024-03-30T15:10:34.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:34.750+0000 7fe2bd3bc700 1 -- 172.21.15.72:0/2542653901 wait complete. 2024-03-30T15:10:34.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:34.750+0000 7fe2bd3bc700 1 Processor -- start 2024-03-30T15:10:34.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:34.750+0000 7fe2bd3bc700 1 -- start start 2024-03-30T15:10:34.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:34.750+0000 7fe2bd3bc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2b81008e0 0x7fe2b8197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:10:34.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:34.750+0000 7fe2bd3bc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2b81012a0 0x7fe2b8198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:10:34.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:34.750+0000 7fe2bd3bc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2b81068e0 0x7fe2b819c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:10:34.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:34.750+0000 7fe2bd3bc700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b810f850 con 0x7fe2b81068e0 2024-03-30T15:10:34.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:34.750+0000 7fe2bd3bc700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b810f6d0 con 0x7fe2b81008e0 2024-03-30T15:10:34.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:34.750+0000 7fe2bd3bc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fe2b810f9d0 con 0x7fe2b81012a0 2024-03-30T15:10:34.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:34.750+0000 7fe2b67fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2b81012a0 0x7fe2b8198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:10:34.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:34.750+0000 7fe2b67fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2b81012a0 0x7fe2b8198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44754/0 (socket says 172.21.15.72:44754) 2024-03-30T15:10:34.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:34.750+0000 7fe2b67fc700 1 -- 172.21.15.72:0/1158588685 learned_addr learned my addr 172.21.15.72:0/1158588685 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T15:10:34.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:34.750+0000 7fe2b77fe700 1 --2- 172.21.15.72:0/1158588685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2b81068e0 0x7fe2b819c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:10:34.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:34.750+0000 7fe2b6ffd700 1 --2- 172.21.15.72:0/1158588685 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2b81008e0 0x7fe2b8197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:10:34.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:34.750+0000 7fe2b67fc700 1 -- 172.21.15.72:0/1158588685 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2b81008e0 msgr2=0x7fe2b8197f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:34.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:34.750+0000 7fe2b67fc700 1 --2- 172.21.15.72:0/1158588685 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2b81008e0 0x7fe2b8197f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:34.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:34.750+0000 7fe2b67fc700 1 -- 172.21.15.72:0/1158588685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2b81068e0 msgr2=0x7fe2b819c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:34.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:34.750+0000 7fe2b67fc700 1 --2- 172.21.15.72:0/1158588685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2b81068e0 0x7fe2b819c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:34.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:34.750+0000 7fe2b67fc700 1 -- 172.21.15.72:0/1158588685 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2b819cf10 con 0x7fe2b81012a0 2024-03-30T15:10:34.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:34.750+0000 7fe2b77fe700 1 --2- 172.21.15.72:0/1158588685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2b81068e0 0x7fe2b819c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T15:10:34.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:34.750+0000 7fe2b67fc700 1 --2- 172.21.15.72:0/1158588685 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2b81012a0 0x7fe2b8198440 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00ed20 tx=0x7fe2ac00c6b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:10:34.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:34.754+0000 7fe29ffff700 1 -- 172.21.15.72:0/1158588685 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac004220 con 0x7fe2b81012a0 2024-03-30T15:10:34.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:34.754+0000 7fe2bd3bc700 1 -- 172.21.15.72:0/1158588685 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2b819d200 con 0x7fe2b81012a0 2024-03-30T15:10:34.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:34.754+0000 7fe29ffff700 1 -- 172.21.15.72:0/1158588685 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7fe2ac0043c0 con 0x7fe2b81012a0 2024-03-30T15:10:34.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:34.754+0000 7fe29ffff700 1 -- 172.21.15.72:0/1158588685 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac0156f0 con 0x7fe2b81012a0 2024-03-30T15:10:34.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:34.754+0000 7fe2bd3bc700 1 -- 172.21.15.72:0/1158588685 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2b81a4a80 con 0x7fe2b81012a0 2024-03-30T15:10:34.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:34.754+0000 7fe2bd3bc700 1 -- 172.21.15.72:0/1158588685 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2b804ff00 con 0x7fe2b81012a0 2024-03-30T15:10:34.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:34.754+0000 7fe29ffff700 1 -- 172.21.15.72:0/1158588685 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 21) ==== 91831+0+0 (secure 0 0 0) 0x7fe2ac003680 con 0x7fe2b81012a0 2024-03-30T15:10:34.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:34.754+0000 7fe29ffff700 1 --2- 172.21.15.72:0/1158588685 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fe2a006dc40 0x7fe2a0070100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:10:34.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:34.754+0000 7fe29ffff700 1 -- 172.21.15.72:0/1158588685 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(74..74 src has 1..74) ==== 7537+0+0 (secure 0 0 0) 0x7fe2ac08e1d0 con 0x7fe2b81012a0 2024-03-30T15:10:34.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:34.754+0000 7fe2b6ffd700 1 --2- 172.21.15.72:0/1158588685 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fe2a006dc40 0x7fe2a0070100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:10:34.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:34.754+0000 7fe2b6ffd700 1 --2- 172.21.15.72:0/1158588685 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fe2a006dc40 0x7fe2a0070100 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8009fd0 tx=0x7fe2a8019040 comp rx=0 tx=0).ready entity=mgr.14526 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:10:34.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:34.758+0000 7fe29ffff700 1 -- 172.21.15.72:0/1158588685 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fe2ac05b830 con 0x7fe2b81012a0 2024-03-30T15:10:34.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:34.966+0000 7fe2bd3bc700 1 -- 172.21.15.72:0/1158588685 --> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe2b8199260 con 0x7fe2a006dc40 2024-03-30T15:10:35.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:35.002+0000 7fe29ffff700 1 -- 172.21.15.72:0/1158588685 <== mgr.14526 v2:172.21.15.72:6800/2033000132 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+346512 (secure 0 0 0) 0x7fe2b8199260 con 0x7fe2a006dc40 2024-03-30T15:10:35.001 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-30T15:10:35.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:35.002+0000 7fe2bd3bc700 1 -- 172.21.15.72:0/1158588685 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fe2a006dc40 msgr2=0x7fe2a0070100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:35.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:35.002+0000 7fe2bd3bc700 1 --2- 172.21.15.72:0/1158588685 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fe2a006dc40 0x7fe2a0070100 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8009fd0 tx=0x7fe2a8019040 comp rx=0 tx=0).stop 2024-03-30T15:10:35.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:35.002+0000 7fe2bd3bc700 1 -- 172.21.15.72:0/1158588685 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2b81012a0 msgr2=0x7fe2b8198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:35.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:35.002+0000 7fe2bd3bc700 1 --2- 172.21.15.72:0/1158588685 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2b81012a0 0x7fe2b8198440 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00ed20 tx=0x7fe2ac00c6b0 comp rx=0 tx=0).stop 2024-03-30T15:10:35.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:35.006+0000 7fe2bd3bc700 1 -- 172.21.15.72:0/1158588685 shutdown_connections 2024-03-30T15:10:35.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:35.006+0000 7fe2bd3bc700 1 --2- 172.21.15.72:0/1158588685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2b81068e0 0x7fe2b819c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:35.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:35.006+0000 7fe2bd3bc700 1 --2- 172.21.15.72:0/1158588685 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fe2a006dc40 0x7fe2a0070100 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:35.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:35.006+0000 7fe2bd3bc700 1 --2- 172.21.15.72:0/1158588685 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2b81008e0 0x7fe2b8197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:35.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:35.006+0000 7fe2bd3bc700 1 --2- 172.21.15.72:0/1158588685 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2b81012a0 0x7fe2b8198440 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:35.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:35.006+0000 7fe2bd3bc700 1 -- 172.21.15.72:0/1158588685 >> 172.21.15.72:0/1158588685 conn(0x7fe2b8077740 msgr2=0x7fe2b80ff100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:10:35.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:35.006+0000 7fe2bd3bc700 1 -- 172.21.15.72:0/1158588685 shutdown_connections 2024-03-30T15:10:35.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:35.006+0000 7fe2bd3bc700 1 -- 172.21.15.72:0/1158588685 wait complete. 2024-03-30T15:10:35.008 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2024-03-30T15:10:35.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:34 smithi172 bash[23680]: cluster 2024-03-30T15:10:33.790720+0000 mgr.y (mgr.14526) 111 : cluster 0 pgmap v65: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T15:10:35.416 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:34 smithi072 bash[28946]: cluster 2024-03-30T15:10:33.790720+0000 mgr.y (mgr.14526) 111 : cluster 0 pgmap v65: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T15:10:35.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:34 smithi072 bash[21573]: cluster 2024-03-30T15:10:33.790720+0000 mgr.y (mgr.14526) 111 : cluster 0 pgmap v65: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T15:10:35.726 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2024-03-30T15:10:33.790493+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596318,"num_objects":198,"num_object_clones":0,"num_object_copies":594,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":1105,"num_read_kb":951,"num_write":615,"num_write_kb":2461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":628,"ondisk_log_size":628,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":245232,"kb_used_data":8284,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":749715984,"statfs":{"total":767960285184,"available":767709167616,"internally_reserved":0,"allocated":8482816,"data_stored":4598122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006036"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.715341+0000","last_change":"2024-03-30T15:07:38.404394+0000","last_active":"2024-03-30T15:08:29.715341+0000","last_peered":"2024-03-30T15:08:29.715341+0000","last_clean":"2024-03-30T15:08:29.715341+0000","last_became_active":"2024-03-30T15:07:38.403671+0000","last_became_peered":"2024-03-30T15:07:38.403671+0000","last_unstale":"2024-03-30T15:08:29.715341+0000","last_undegraded":"2024-03-30T15:08:29.715341+0000","last_fullsized":"2024-03-30T15:08:29.715341+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:21:16.031259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.716248+0000","last_change":"2024-03-30T15:07:36.364975+0000","last_active":"2024-03-30T15:08:29.716248+0000","last_peered":"2024-03-30T15:08:29.716248+0000","last_clean":"2024-03-30T15:08:29.716248+0000","last_became_active":"2024-03-30T15:07:36.363172+0000","last_became_peered":"2024-03-30T15:07:36.363172+0000","last_unstale":"2024-03-30T15:08:29.716248+0000","last_undegraded":"2024-03-30T15:08:29.716248+0000","last_fullsized":"2024-03-30T15:08:29.716248+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T02:43:43.010846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"60'1","reported_seq":47,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.510502+0000","last_change":"2024-03-30T15:07:32.341754+0000","last_active":"2024-03-30T15:08:30.510502+0000","last_peered":"2024-03-30T15:08:30.510502+0000","last_clean":"2024-03-30T15:08:30.510502+0000","last_became_active":"2024-03-30T15:07:32.341382+0000","last_became_peered":"2024-03-30T15:07:32.341382+0000","last_unstale":"2024-03-30T15:08:30.510502+0000","last_undegraded":"2024-03-30T15:08:30.510502+0000","last_fullsized":"2024-03-30T15:08:30.510502+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:58:01.639200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"67'10","reported_seq":51,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.718734+0000","last_change":"2024-03-30T15:07:34.357651+0000","last_active":"2024-03-30T15:08:29.718734+0000","last_peered":"2024-03-30T15:08:29.718734+0000","last_clean":"2024-03-30T15:08:29.718734+0000","last_became_active":"2024-03-30T15:07:34.356962+0000","last_became_peered":"2024-03-30T15:07:34.356962+0000","last_unstale":"2024-03-30T15:08:29.718734+0000","last_undegraded":"2024-03-30T15:08:29.718734+0000","last_fullsized":"2024-03-30T15:08:29.718734+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:33:35.049995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.717877+0000","last_change":"2024-03-30T15:07:38.379462+0000","last_active":"2024-03-30T15:08:29.717877+0000","last_peered":"2024-03-30T15:08:29.717877+0000","last_clean":"2024-03-30T15:08:29.717877+0000","last_became_active":"2024-03-30T15:07:38.378006+0000","last_became_peered":"2024-03-30T15:07:38.378006+0000","last_unstale":"2024-03-30T15:08:29.717877+0000","last_undegraded":"2024-03-30T15:08:29.717877+0000","last_fullsized":"2024-03-30T15:08:29.717877+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:13:42.448880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.717648+0000","last_change":"2024-03-30T15:07:36.339968+0000","last_active":"2024-03-30T15:08:29.717648+0000","last_peered":"2024-03-30T15:08:29.717648+0000","last_clean":"2024-03-30T15:08:29.717648+0000","last_became_active":"2024-03-30T15:07:36.339613+0000","last_became_peered":"2024-03-30T15:07:36.339613+0000","last_unstale":"2024-03-30T15:08:29.717648+0000","last_undegraded":"2024-03-30T15:08:29.717648+0000","last_fullsized":"2024-03-30T15:08:29.717648+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:48:27.425580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.718383+0000","last_change":"2024-03-30T15:07:32.325458+0000","last_active":"2024-03-30T15:08:29.718383+0000","last_peered":"2024-03-30T15:08:29.718383+0000","last_clean":"2024-03-30T15:08:29.718383+0000","last_became_active":"2024-03-30T15:07:32.325113+0000","last_became_peered":"2024-03-30T15:07:32.325113+0000","last_unstale":"2024-03-30T15:08:29.718383+0000","last_undegraded":"2024-03-30T15:08:29.718383+0000","last_fullsized":"2024-03-30T15:08:29.718383+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:11:15.155788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"67'11","reported_seq":54,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.508925+0000","last_change":"2024-03-30T15:07:34.354718+0000","last_active":"2024-03-30T15:08:30.508925+0000","last_peered":"2024-03-30T15:08:30.508925+0000","last_clean":"2024-03-30T15:08:30.508925+0000","last_became_active":"2024-03-30T15:07:34.354161+0000","last_became_peered":"2024-03-30T15:07:34.354161+0000","last_unstale":"2024-03-30T15:08:30.508925+0000","last_undegraded":"2024-03-30T15:08:30.508925+0000","last_fullsized":"2024-03-30T15:08:30.508925+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:14:29.328078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.388980+0000","last_change":"2024-03-30T15:07:38.385687+0000","last_active":"2024-03-30T15:08:30.388980+0000","last_peered":"2024-03-30T15:08:30.388980+0000","last_clean":"2024-03-30T15:08:30.388980+0000","last_became_active":"2024-03-30T15:07:38.385008+0000","last_became_peered":"2024-03-30T15:07:38.385008+0000","last_unstale":"2024-03-30T15:08:30.388980+0000","last_undegraded":"2024-03-30T15:08:30.388980+0000","last_fullsized":"2024-03-30T15:08:30.388980+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:17.118904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.718181+0000","last_change":"2024-03-30T15:07:36.354709+0000","last_active":"2024-03-30T15:08:29.718181+0000","last_peered":"2024-03-30T15:08:29.718181+0000","last_clean":"2024-03-30T15:08:29.718181+0000","last_became_active":"2024-03-30T15:07:36.354322+0000","last_became_peered":"2024-03-30T15:07:36.354322+0000","last_unstale":"2024-03-30T15:08:29.718181+0000","last_undegraded":"2024-03-30T15:08:29.718181+0000","last_fullsized":"2024-03-30T15:08:29.718181+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:48:02.814689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.716507+0000","last_change":"2024-03-30T15:08:15.721899+0000","last_active":"2024-03-30T15:08:29.716507+0000","last_peered":"2024-03-30T15:08:29.716507+0000","last_clean":"2024-03-30T15:08:29.716507+0000","last_became_active":"2024-03-30T15:08:15.720919+0000","last_became_peered":"2024-03-30T15:08:15.720919+0000","last_unstale":"2024-03-30T15:08:29.716507+0000","last_undegraded":"2024-03-30T15:08:29.716507+0000","last_fullsized":"2024-03-30T15:08:29.716507+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:12:54.970723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,0],"acting":[2,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"67'15","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.387473+0000","last_change":"2024-03-30T15:07:34.339086+0000","last_active":"2024-03-30T15:08:30.387473+0000","last_peered":"2024-03-30T15:08:30.387473+0000","last_clean":"2024-03-30T15:08:30.387473+0000","last_became_active":"2024-03-30T15:07:34.338800+0000","last_became_peered":"2024-03-30T15:07:34.338800+0000","last_unstale":"2024-03-30T15:08:30.387473+0000","last_undegraded":"2024-03-30T15:08:30.387473+0000","last_fullsized":"2024-03-30T15:08:30.387473+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:09:28.650531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.507247+0000","last_change":"2024-03-30T15:07:38.389806+0000","last_active":"2024-03-30T15:08:30.507247+0000","last_peered":"2024-03-30T15:08:30.507247+0000","last_clean":"2024-03-30T15:08:30.507247+0000","last_became_active":"2024-03-30T15:07:38.384123+0000","last_became_peered":"2024-03-30T15:07:38.384123+0000","last_unstale":"2024-03-30T15:08:30.507247+0000","last_undegraded":"2024-03-30T15:08:30.507247+0000","last_fullsized":"2024-03-30T15:08:30.507247+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:21:55.587790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.718304+0000","last_change":"2024-03-30T15:07:36.354824+0000","last_active":"2024-03-30T15:08:29.718304+0000","last_peered":"2024-03-30T15:08:29.718304+0000","last_clean":"2024-03-30T15:08:29.718304+0000","last_became_active":"2024-03-30T15:07:36.354460+0000","last_became_peered":"2024-03-30T15:07:36.354460+0000","last_unstale":"2024-03-30T15:08:29.718304+0000","last_undegraded":"2024-03-30T15:08:29.718304+0000","last_fullsized":"2024-03-30T15:08:29.718304+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:34:05.302974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.774895+0000","last_change":"2024-03-30T15:07:32.344175+0000","last_active":"2024-03-30T15:08:29.774895+0000","last_peered":"2024-03-30T15:08:29.774895+0000","last_clean":"2024-03-30T15:08:29.774895+0000","last_became_active":"2024-03-30T15:07:32.343299+0000","last_became_peered":"2024-03-30T15:07:32.343299+0000","last_unstale":"2024-03-30T15:08:29.774895+0000","last_undegraded":"2024-03-30T15:08:29.774895+0000","last_fullsized":"2024-03-30T15:08:29.774895+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:45:36.284556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"67'12","reported_seq":59,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.387847+0000","last_change":"2024-03-30T15:07:34.337708+0000","last_active":"2024-03-30T15:08:30.387847+0000","last_peered":"2024-03-30T15:08:30.387847+0000","last_clean":"2024-03-30T15:08:30.387847+0000","last_became_active":"2024-03-30T15:07:34.337175+0000","last_became_peered":"2024-03-30T15:07:34.337175+0000","last_unstale":"2024-03-30T15:08:30.387847+0000","last_undegraded":"2024-03-30T15:08:30.387847+0000","last_fullsized":"2024-03-30T15:08:30.387847+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:47:13.970499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.719705+0000","last_change":"2024-03-30T15:07:38.410395+0000","last_active":"2024-03-30T15:08:29.719705+0000","last_peered":"2024-03-30T15:08:29.719705+0000","last_clean":"2024-03-30T15:08:29.719705+0000","last_became_active":"2024-03-30T15:07:38.409906+0000","last_became_peered":"2024-03-30T15:07:38.409906+0000","last_unstale":"2024-03-30T15:08:29.719705+0000","last_undegraded":"2024-03-30T15:08:29.719705+0000","last_fullsized":"2024-03-30T15:08:29.719705+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:54:21.517389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.717945+0000","last_change":"2024-03-30T15:07:36.380598+0000","last_active":"2024-03-30T15:08:29.717945+0000","last_peered":"2024-03-30T15:08:29.717945+0000","last_clean":"2024-03-30T15:08:29.717945+0000","last_became_active":"2024-03-30T15:07:36.378092+0000","last_became_peered":"2024-03-30T15:07:36.378092+0000","last_unstale":"2024-03-30T15:08:29.717945+0000","last_undegraded":"2024-03-30T15:08:29.717945+0000","last_fullsized":"2024-03-30T15:08:29.717945+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:21:17.614175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.716801+0000","last_change":"2024-03-30T15:07:32.323228+0000","last_active":"2024-03-30T15:08:29.716801+0000","last_peered":"2024-03-30T15:08:29.716801+0000","last_clean":"2024-03-30T15:08:29.716801+0000","last_became_active":"2024-03-30T15:07:32.322894+0000","last_became_peered":"2024-03-30T15:07:32.322894+0000","last_unstale":"2024-03-30T15:08:29.716801+0000","last_undegraded":"2024-03-30T15:08:29.716801+0000","last_fullsized":"2024-03-30T15:08:29.716801+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:09:19.627344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"67'9","reported_seq":52,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.717776+0000","last_change":"2024-03-30T15:07:34.341018+0000","last_active":"2024-03-30T15:08:29.717776+0000","last_peered":"2024-03-30T15:08:29.717776+0000","last_clean":"2024-03-30T15:08:29.717776+0000","last_became_active":"2024-03-30T15:07:34.340675+0000","last_became_peered":"2024-03-30T15:07:34.340675+0000","last_unstale":"2024-03-30T15:08:29.717776+0000","last_undegraded":"2024-03-30T15:08:29.717776+0000","last_fullsized":"2024-03-30T15:08:29.717776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:19:27.585459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.720646+0000","last_change":"2024-03-30T15:07:38.400354+0000","last_active":"2024-03-30T15:08:29.720646+0000","last_peered":"2024-03-30T15:08:29.720646+0000","last_clean":"2024-03-30T15:08:29.720646+0000","last_became_active":"2024-03-30T15:07:38.399943+0000","last_became_peered":"2024-03-30T15:07:38.399943+0000","last_unstale":"2024-03-30T15:08:29.720646+0000","last_undegraded":"2024-03-30T15:08:29.720646+0000","last_fullsized":"2024-03-30T15:08:29.720646+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:57:58.990197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.718792+0000","last_change":"2024-03-30T15:07:36.360438+0000","last_active":"2024-03-30T15:08:29.718792+0000","last_peered":"2024-03-30T15:08:29.718792+0000","last_clean":"2024-03-30T15:08:29.718792+0000","last_became_active":"2024-03-30T15:07:36.359575+0000","last_became_peered":"2024-03-30T15:07:36.359575+0000","last_unstale":"2024-03-30T15:08:29.718792+0000","last_undegraded":"2024-03-30T15:08:29.718792+0000","last_fullsized":"2024-03-30T15:08:29.718792+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:19:45.984083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.859754+0000","last_change":"2024-03-30T15:07:32.336659+0000","last_active":"2024-03-30T15:08:29.859754+0000","last_peered":"2024-03-30T15:08:29.859754+0000","last_clean":"2024-03-30T15:08:29.859754+0000","last_became_active":"2024-03-30T15:07:32.335757+0000","last_became_peered":"2024-03-30T15:07:32.335757+0000","last_unstale":"2024-03-30T15:08:29.859754+0000","last_undegraded":"2024-03-30T15:08:29.859754+0000","last_fullsized":"2024-03-30T15:08:29.859754+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:38:03.242535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"67'5","reported_seq":45,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.508151+0000","last_change":"2024-03-30T15:07:34.341424+0000","last_active":"2024-03-30T15:08:30.508151+0000","last_peered":"2024-03-30T15:08:30.508151+0000","last_clean":"2024-03-30T15:08:30.508151+0000","last_became_active":"2024-03-30T15:07:34.340906+0000","last_became_peered":"2024-03-30T15:07:34.340906+0000","last_unstale":"2024-03-30T15:08:30.508151+0000","last_undegraded":"2024-03-30T15:08:30.508151+0000","last_fullsized":"2024-03-30T15:08:30.508151+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:33:38.868029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.509407+0000","last_change":"2024-03-30T15:07:38.383775+0000","last_active":"2024-03-30T15:08:30.509407+0000","last_peered":"2024-03-30T15:08:30.509407+0000","last_clean":"2024-03-30T15:08:30.509407+0000","last_became_active":"2024-03-30T15:07:38.382933+0000","last_became_peered":"2024-03-30T15:07:38.382933+0000","last_unstale":"2024-03-30T15:08:30.509407+0000","last_undegraded":"2024-03-30T15:08:30.509407+0000","last_fullsized":"2024-03-30T15:08:30.509407+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:07:50.761481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"73'12","reported_seq":92,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:10:22.566518+0000","last_change":"2024-03-30T15:08:15.731003+0000","last_active":"2024-03-30T15:10:22.566518+0000","last_peered":"2024-03-30T15:10:22.566518+0000","last_clean":"2024-03-30T15:10:22.566518+0000","last_became_active":"2024-03-30T15:08:15.722686+0000","last_became_peered":"2024-03-30T15:08:15.722686+0000","last_unstale":"2024-03-30T15:10:22.566518+0000","last_undegraded":"2024-03-30T15:10:22.566518+0000","last_fullsized":"2024-03-30T15:10:22.566518+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:53:59.650620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"60'1","reported_seq":41,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.716521+0000","last_change":"2024-03-30T15:07:32.321777+0000","last_active":"2024-03-30T15:08:29.716521+0000","last_peered":"2024-03-30T15:08:29.716521+0000","last_clean":"2024-03-30T15:08:29.716521+0000","last_became_active":"2024-03-30T15:07:32.321468+0000","last_became_peered":"2024-03-30T15:07:32.321468+0000","last_unstale":"2024-03-30T15:08:29.716521+0000","last_undegraded":"2024-03-30T15:08:29.716521+0000","last_fullsized":"2024-03-30T15:08:29.716521+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:02:19.949675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"67'9","reported_seq":52,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.715547+0000","last_change":"2024-03-30T15:07:34.347628+0000","last_active":"2024-03-30T15:08:29.715547+0000","last_peered":"2024-03-30T15:08:29.715547+0000","last_clean":"2024-03-30T15:08:29.715547+0000","last_became_active":"2024-03-30T15:07:34.346958+0000","last_became_peered":"2024-03-30T15:07:34.346958+0000","last_unstale":"2024-03-30T15:08:29.715547+0000","last_undegraded":"2024-03-30T15:08:29.715547+0000","last_fullsized":"2024-03-30T15:08:29.715547+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:58:05.038615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"67'1","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.774708+0000","last_change":"2024-03-30T15:07:38.391560+0000","last_active":"2024-03-30T15:08:29.774708+0000","last_peered":"2024-03-30T15:08:29.774708+0000","last_clean":"2024-03-30T15:08:29.774708+0000","last_became_active":"2024-03-30T15:07:38.391185+0000","last_became_peered":"2024-03-30T15:07:38.391185+0000","last_unstale":"2024-03-30T15:08:29.774708+0000","last_undegraded":"2024-03-30T15:08:29.774708+0000","last_fullsized":"2024-03-30T15:08:29.774708+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:02:52.182312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":370,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.510234+0000","last_change":"2024-03-30T15:07:36.366776+0000","last_active":"2024-03-30T15:08:30.510234+0000","last_peered":"2024-03-30T15:08:30.510234+0000","last_clean":"2024-03-30T15:08:30.510234+0000","last_became_active":"2024-03-30T15:07:36.365845+0000","last_became_peered":"2024-03-30T15:07:36.365845+0000","last_unstale":"2024-03-30T15:08:30.510234+0000","last_undegraded":"2024-03-30T15:08:30.510234+0000","last_fullsized":"2024-03-30T15:08:30.510234+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:28:09.369591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.388530+0000","last_change":"2024-03-30T15:07:32.337471+0000","last_active":"2024-03-30T15:08:30.388530+0000","last_peered":"2024-03-30T15:08:30.388530+0000","last_clean":"2024-03-30T15:08:30.388530+0000","last_became_active":"2024-03-30T15:07:32.336609+0000","last_became_peered":"2024-03-30T15:07:32.336609+0000","last_unstale":"2024-03-30T15:08:30.388530+0000","last_undegraded":"2024-03-30T15:08:30.388530+0000","last_fullsized":"2024-03-30T15:08:30.388530+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:43:37.576858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"67'15","reported_seq":60,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.505610+0000","last_change":"2024-03-30T15:07:34.346816+0000","last_active":"2024-03-30T15:08:30.505610+0000","last_peered":"2024-03-30T15:08:30.505610+0000","last_clean":"2024-03-30T15:08:30.505610+0000","last_became_active":"2024-03-30T15:07:34.346301+0000","last_became_peered":"2024-03-30T15:07:34.346301+0000","last_unstale":"2024-03-30T15:08:30.505610+0000","last_undegraded":"2024-03-30T15:08:30.505610+0000","last_fullsized":"2024-03-30T15:08:30.505610+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:03:27.740048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.717669+0000","last_change":"2024-03-30T15:07:38.409442+0000","last_active":"2024-03-30T15:08:29.717669+0000","last_peered":"2024-03-30T15:08:29.717669+0000","last_clean":"2024-03-30T15:08:29.717669+0000","last_became_active":"2024-03-30T15:07:38.408827+0000","last_became_peered":"2024-03-30T15:07:38.408827+0000","last_unstale":"2024-03-30T15:08:29.717669+0000","last_undegraded":"2024-03-30T15:08:29.717669+0000","last_fullsized":"2024-03-30T15:08:29.717669+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T02:02:33.582621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.718874+0000","last_change":"2024-03-30T15:07:36.367992+0000","last_active":"2024-03-30T15:08:29.718874+0000","last_peered":"2024-03-30T15:08:29.718874+0000","last_clean":"2024-03-30T15:08:29.718874+0000","last_became_active":"2024-03-30T15:07:36.365990+0000","last_became_peered":"2024-03-30T15:07:36.365990+0000","last_unstale":"2024-03-30T15:08:29.718874+0000","last_undegraded":"2024-03-30T15:08:29.718874+0000","last_fullsized":"2024-03-30T15:08:29.718874+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:46:50.691747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"60'1","reported_seq":48,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.860656+0000","last_change":"2024-03-30T15:07:32.349842+0000","last_active":"2024-03-30T15:08:29.860656+0000","last_peered":"2024-03-30T15:08:29.860656+0000","last_clean":"2024-03-30T15:08:29.860656+0000","last_became_active":"2024-03-30T15:07:32.338264+0000","last_became_peered":"2024-03-30T15:07:32.338264+0000","last_unstale":"2024-03-30T15:08:29.860656+0000","last_undegraded":"2024-03-30T15:08:29.860656+0000","last_fullsized":"2024-03-30T15:08:29.860656+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:20.177069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":875,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"67'9","reported_seq":52,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.387547+0000","last_change":"2024-03-30T15:07:34.338942+0000","last_active":"2024-03-30T15:08:30.387547+0000","last_peered":"2024-03-30T15:08:30.387547+0000","last_clean":"2024-03-30T15:08:30.387547+0000","last_became_active":"2024-03-30T15:07:34.338649+0000","last_became_peered":"2024-03-30T15:07:34.338649+0000","last_unstale":"2024-03-30T15:08:30.387547+0000","last_undegraded":"2024-03-30T15:08:30.387547+0000","last_fullsized":"2024-03-30T15:08:30.387547+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:07:59.903054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.774343+0000","last_change":"2024-03-30T15:07:38.390346+0000","last_active":"2024-03-30T15:08:29.774343+0000","last_peered":"2024-03-30T15:08:29.774343+0000","last_clean":"2024-03-30T15:08:29.774343+0000","last_became_active":"2024-03-30T15:07:38.389844+0000","last_became_peered":"2024-03-30T15:07:38.389844+0000","last_unstale":"2024-03-30T15:08:29.774343+0000","last_undegraded":"2024-03-30T15:08:29.774343+0000","last_fullsized":"2024-03-30T15:08:29.774343+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:03:07.174949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.715403+0000","last_change":"2024-03-30T15:07:36.379351+0000","last_active":"2024-03-30T15:08:29.715403+0000","last_peered":"2024-03-30T15:08:29.715403+0000","last_clean":"2024-03-30T15:08:29.715403+0000","last_became_active":"2024-03-30T15:07:36.378692+0000","last_became_peered":"2024-03-30T15:07:36.378692+0000","last_unstale":"2024-03-30T15:08:29.715403+0000","last_undegraded":"2024-03-30T15:08:29.715403+0000","last_fullsized":"2024-03-30T15:08:29.715403+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:54:12.093567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.389559+0000","last_change":"2024-03-30T15:07:32.332134+0000","last_active":"2024-03-30T15:08:30.389559+0000","last_peered":"2024-03-30T15:08:30.389559+0000","last_clean":"2024-03-30T15:08:30.389559+0000","last_became_active":"2024-03-30T15:07:32.331118+0000","last_became_peered":"2024-03-30T15:07:32.331118+0000","last_unstale":"2024-03-30T15:08:30.389559+0000","last_undegraded":"2024-03-30T15:08:30.389559+0000","last_fullsized":"2024-03-30T15:08:30.389559+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:03:37.897743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"67'6","reported_seq":44,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.508794+0000","last_change":"2024-03-30T15:07:34.349798+0000","last_active":"2024-03-30T15:08:30.508794+0000","last_peered":"2024-03-30T15:08:30.508794+0000","last_clean":"2024-03-30T15:08:30.508794+0000","last_became_active":"2024-03-30T15:07:34.348992+0000","last_became_peered":"2024-03-30T15:07:34.348992+0000","last_unstale":"2024-03-30T15:08:30.508794+0000","last_undegraded":"2024-03-30T15:08:30.508794+0000","last_fullsized":"2024-03-30T15:08:30.508794+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:21:50.708218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.715799+0000","last_change":"2024-03-30T15:07:38.409496+0000","last_active":"2024-03-30T15:08:29.715799+0000","last_peered":"2024-03-30T15:08:29.715799+0000","last_clean":"2024-03-30T15:08:29.715799+0000","last_became_active":"2024-03-30T15:07:38.408736+0000","last_became_peered":"2024-03-30T15:07:38.408736+0000","last_unstale":"2024-03-30T15:08:29.715799+0000","last_undegraded":"2024-03-30T15:08:29.715799+0000","last_fullsized":"2024-03-30T15:08:29.715799+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:40:50.847170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.718551+0000","last_change":"2024-03-30T15:07:36.346410+0000","last_active":"2024-03-30T15:08:29.718551+0000","last_peered":"2024-03-30T15:08:29.718551+0000","last_clean":"2024-03-30T15:08:29.718551+0000","last_became_active":"2024-03-30T15:07:36.345949+0000","last_became_peered":"2024-03-30T15:07:36.345949+0000","last_unstale":"2024-03-30T15:08:29.718551+0000","last_undegraded":"2024-03-30T15:08:29.718551+0000","last_fullsized":"2024-03-30T15:08:29.718551+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:09:19.546449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":39,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.509794+0000","last_change":"2024-03-30T15:07:32.329514+0000","last_active":"2024-03-30T15:08:30.509794+0000","last_peered":"2024-03-30T15:08:30.509794+0000","last_clean":"2024-03-30T15:08:30.509794+0000","last_became_active":"2024-03-30T15:07:32.329157+0000","last_became_peered":"2024-03-30T15:07:32.329157+0000","last_unstale":"2024-03-30T15:08:30.509794+0000","last_undegraded":"2024-03-30T15:08:30.509794+0000","last_fullsized":"2024-03-30T15:08:30.509794+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:34:51.609434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"67'10","reported_seq":51,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.718975+0000","last_change":"2024-03-30T15:07:34.340573+0000","last_active":"2024-03-30T15:08:29.718975+0000","last_peered":"2024-03-30T15:08:29.718975+0000","last_clean":"2024-03-30T15:08:29.718975+0000","last_became_active":"2024-03-30T15:07:34.340249+0000","last_became_peered":"2024-03-30T15:07:34.340249+0000","last_unstale":"2024-03-30T15:08:29.718975+0000","last_undegraded":"2024-03-30T15:08:29.718975+0000","last_fullsized":"2024-03-30T15:08:29.718975+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:22:20.352733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.507498+0000","last_change":"2024-03-30T15:07:38.378434+0000","last_active":"2024-03-30T15:08:30.507498+0000","last_peered":"2024-03-30T15:08:30.507498+0000","last_clean":"2024-03-30T15:08:30.507498+0000","last_became_active":"2024-03-30T15:07:38.377553+0000","last_became_peered":"2024-03-30T15:07:38.377553+0000","last_unstale":"2024-03-30T15:08:30.507498+0000","last_undegraded":"2024-03-30T15:08:30.507498+0000","last_fullsized":"2024-03-30T15:08:30.507498+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:48:36.438124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.506786+0000","last_change":"2024-03-30T15:07:36.357608+0000","last_active":"2024-03-30T15:08:30.506786+0000","last_peered":"2024-03-30T15:08:30.506786+0000","last_clean":"2024-03-30T15:08:30.506786+0000","last_became_active":"2024-03-30T15:07:36.356817+0000","last_became_peered":"2024-03-30T15:07:36.356817+0000","last_unstale":"2024-03-30T15:08:30.506786+0000","last_undegraded":"2024-03-30T15:08:30.506786+0000","last_fullsized":"2024-03-30T15:08:30.506786+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:36:10.280694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.860110+0000","last_change":"2024-03-30T15:07:32.334661+0000","last_active":"2024-03-30T15:08:29.860110+0000","last_peered":"2024-03-30T15:08:29.860110+0000","last_clean":"2024-03-30T15:08:29.860110+0000","last_became_active":"2024-03-30T15:07:32.333793+0000","last_became_peered":"2024-03-30T15:07:32.333793+0000","last_unstale":"2024-03-30T15:08:29.860110+0000","last_undegraded":"2024-03-30T15:08:29.860110+0000","last_fullsized":"2024-03-30T15:08:29.860110+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:51:09.486012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"67'9","reported_seq":52,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.775099+0000","last_change":"2024-03-30T15:07:34.332229+0000","last_active":"2024-03-30T15:08:29.775099+0000","last_peered":"2024-03-30T15:08:29.775099+0000","last_clean":"2024-03-30T15:08:29.775099+0000","last_became_active":"2024-03-30T15:07:34.331907+0000","last_became_peered":"2024-03-30T15:07:34.331907+0000","last_unstale":"2024-03-30T15:08:29.775099+0000","last_undegraded":"2024-03-30T15:08:29.775099+0000","last_fullsized":"2024-03-30T15:08:29.775099+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:49:35.018931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.720429+0000","last_change":"2024-03-30T15:07:38.390291+0000","last_active":"2024-03-30T15:08:29.720429+0000","last_peered":"2024-03-30T15:08:29.720429+0000","last_clean":"2024-03-30T15:08:29.720429+0000","last_became_active":"2024-03-30T15:07:38.389440+0000","last_became_peered":"2024-03-30T15:07:38.389440+0000","last_unstale":"2024-03-30T15:08:29.720429+0000","last_undegraded":"2024-03-30T15:08:29.720429+0000","last_fullsized":"2024-03-30T15:08:29.720429+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T02:25:36.734323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"67'11","reported_seq":81,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:10:22.566397+0000","last_change":"2024-03-30T15:07:36.362981+0000","last_active":"2024-03-30T15:10:22.566397+0000","last_peered":"2024-03-30T15:10:22.566397+0000","last_clean":"2024-03-30T15:10:22.566397+0000","last_became_active":"2024-03-30T15:07:36.362645+0000","last_became_peered":"2024-03-30T15:07:36.362645+0000","last_unstale":"2024-03-30T15:10:22.566397+0000","last_undegraded":"2024-03-30T15:10:22.566397+0000","last_fullsized":"2024-03-30T15:10:22.566397+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:25:01.195432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":39,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.509979+0000","last_change":"2024-03-30T15:07:32.349480+0000","last_active":"2024-03-30T15:08:30.509979+0000","last_peered":"2024-03-30T15:08:30.509979+0000","last_clean":"2024-03-30T15:08:30.509979+0000","last_became_active":"2024-03-30T15:07:32.348965+0000","last_became_peered":"2024-03-30T15:07:32.348965+0000","last_unstale":"2024-03-30T15:08:30.509979+0000","last_undegraded":"2024-03-30T15:08:30.509979+0000","last_fullsized":"2024-03-30T15:08:30.509979+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:14:45.672017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"67'9","reported_seq":51,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.506782+0000","last_change":"2024-03-30T15:07:34.349596+0000","last_active":"2024-03-30T15:08:30.506782+0000","last_peered":"2024-03-30T15:08:30.506782+0000","last_clean":"2024-03-30T15:08:30.506782+0000","last_became_active":"2024-03-30T15:07:34.348949+0000","last_became_peered":"2024-03-30T15:07:34.348949+0000","last_unstale":"2024-03-30T15:08:30.506782+0000","last_undegraded":"2024-03-30T15:08:30.506782+0000","last_fullsized":"2024-03-30T15:08:30.506782+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:40:14.169471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.509902+0000","last_change":"2024-03-30T15:07:38.382217+0000","last_active":"2024-03-30T15:08:30.509902+0000","last_peered":"2024-03-30T15:08:30.509902+0000","last_clean":"2024-03-30T15:08:30.509902+0000","last_became_active":"2024-03-30T15:07:38.380977+0000","last_became_peered":"2024-03-30T15:07:38.380977+0000","last_unstale":"2024-03-30T15:08:30.509902+0000","last_undegraded":"2024-03-30T15:08:30.509902+0000","last_fullsized":"2024-03-30T15:08:30.509902+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:01:33.302173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"67'11","reported_seq":78,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:10:22.566221+0000","last_change":"2024-03-30T15:07:36.381623+0000","last_active":"2024-03-30T15:10:22.566221+0000","last_peered":"2024-03-30T15:10:22.566221+0000","last_clean":"2024-03-30T15:10:22.566221+0000","last_became_active":"2024-03-30T15:07:36.377558+0000","last_became_peered":"2024-03-30T15:07:36.377558+0000","last_unstale":"2024-03-30T15:10:22.566221+0000","last_undegraded":"2024-03-30T15:10:22.566221+0000","last_fullsized":"2024-03-30T15:10:22.566221+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T02:23:05.954610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.388972+0000","last_change":"2024-03-30T15:07:32.333663+0000","last_active":"2024-03-30T15:08:30.388972+0000","last_peered":"2024-03-30T15:08:30.388972+0000","last_clean":"2024-03-30T15:08:30.388972+0000","last_became_active":"2024-03-30T15:07:32.332783+0000","last_became_peered":"2024-03-30T15:07:32.332783+0000","last_unstale":"2024-03-30T15:08:30.388972+0000","last_undegraded":"2024-03-30T15:08:30.388972+0000","last_fullsized":"2024-03-30T15:08:30.388972+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:16:52.983584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"67'11","reported_seq":55,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.774663+0000","last_change":"2024-03-30T15:07:34.345194+0000","last_active":"2024-03-30T15:08:29.774663+0000","last_peered":"2024-03-30T15:08:29.774663+0000","last_clean":"2024-03-30T15:08:29.774663+0000","last_became_active":"2024-03-30T15:07:34.344854+0000","last_became_peered":"2024-03-30T15:07:34.344854+0000","last_unstale":"2024-03-30T15:08:29.774663+0000","last_undegraded":"2024-03-30T15:08:29.774663+0000","last_fullsized":"2024-03-30T15:08:29.774663+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:34:32.090526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.774803+0000","last_change":"2024-03-30T15:07:38.402739+0000","last_active":"2024-03-30T15:08:29.774803+0000","last_peered":"2024-03-30T15:08:29.774803+0000","last_clean":"2024-03-30T15:08:29.774803+0000","last_became_active":"2024-03-30T15:07:38.402252+0000","last_became_peered":"2024-03-30T15:07:38.402252+0000","last_unstale":"2024-03-30T15:08:29.774803+0000","last_undegraded":"2024-03-30T15:08:29.774803+0000","last_fullsized":"2024-03-30T15:08:29.774803+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:36:47.769354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.719825+0000","last_change":"2024-03-30T15:07:36.381021+0000","last_active":"2024-03-30T15:08:29.719825+0000","last_peered":"2024-03-30T15:08:29.719825+0000","last_clean":"2024-03-30T15:08:29.719825+0000","last_became_active":"2024-03-30T15:07:36.378382+0000","last_became_peered":"2024-03-30T15:07:36.378382+0000","last_unstale":"2024-03-30T15:08:29.719825+0000","last_undegraded":"2024-03-30T15:08:29.719825+0000","last_fullsized":"2024-03-30T15:08:29.719825+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T02:52:02.029001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.859522+0000","last_change":"2024-03-30T15:07:32.333779+0000","last_active":"2024-03-30T15:08:29.859522+0000","last_peered":"2024-03-30T15:08:29.859522+0000","last_clean":"2024-03-30T15:08:29.859522+0000","last_became_active":"2024-03-30T15:07:32.332805+0000","last_became_peered":"2024-03-30T15:07:32.332805+0000","last_unstale":"2024-03-30T15:08:29.859522+0000","last_undegraded":"2024-03-30T15:08:29.859522+0000","last_fullsized":"2024-03-30T15:08:29.859522+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:14:43.927065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"67'4","reported_seq":42,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.859383+0000","last_change":"2024-03-30T15:07:34.344545+0000","last_active":"2024-03-30T15:08:29.859383+0000","last_peered":"2024-03-30T15:08:29.859383+0000","last_clean":"2024-03-30T15:08:29.859383+0000","last_became_active":"2024-03-30T15:07:34.344122+0000","last_became_peered":"2024-03-30T15:07:34.344122+0000","last_unstale":"2024-03-30T15:08:29.859383+0000","last_undegraded":"2024-03-30T15:08:29.859383+0000","last_fullsized":"2024-03-30T15:08:29.859383+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:45:02.553822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.718737+0000","last_change":"2024-03-30T15:07:38.386675+0000","last_active":"2024-03-30T15:08:29.718737+0000","last_peered":"2024-03-30T15:08:29.718737+0000","last_clean":"2024-03-30T15:08:29.718737+0000","last_became_active":"2024-03-30T15:07:38.385464+0000","last_became_peered":"2024-03-30T15:07:38.385464+0000","last_unstale":"2024-03-30T15:08:29.718737+0000","last_undegraded":"2024-03-30T15:08:29.718737+0000","last_fullsized":"2024-03-30T15:08:29.718737+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:45:33.627204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.509762+0000","last_change":"2024-03-30T15:07:36.368028+0000","last_active":"2024-03-30T15:08:30.509762+0000","last_peered":"2024-03-30T15:08:30.509762+0000","last_clean":"2024-03-30T15:08:30.509762+0000","last_became_active":"2024-03-30T15:07:36.365649+0000","last_became_peered":"2024-03-30T15:07:36.365649+0000","last_unstale":"2024-03-30T15:08:30.509762+0000","last_undegraded":"2024-03-30T15:08:30.509762+0000","last_fullsized":"2024-03-30T15:08:30.509762+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:48:13.402426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.715807+0000","last_change":"2024-03-30T15:07:32.328683+0000","last_active":"2024-03-30T15:08:29.715807+0000","last_peered":"2024-03-30T15:08:29.715807+0000","last_clean":"2024-03-30T15:08:29.715807+0000","last_became_active":"2024-03-30T15:07:32.327871+0000","last_became_peered":"2024-03-30T15:07:32.327871+0000","last_unstale":"2024-03-30T15:08:29.715807+0000","last_undegraded":"2024-03-30T15:08:29.715807+0000","last_fullsized":"2024-03-30T15:08:29.715807+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:50:37.292198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"67'11","reported_seq":55,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.774486+0000","last_change":"2024-03-30T15:07:34.341135+0000","last_active":"2024-03-30T15:08:29.774486+0000","last_peered":"2024-03-30T15:08:29.774486+0000","last_clean":"2024-03-30T15:08:29.774486+0000","last_became_active":"2024-03-30T15:07:34.340817+0000","last_became_peered":"2024-03-30T15:07:34.340817+0000","last_unstale":"2024-03-30T15:08:29.774486+0000","last_undegraded":"2024-03-30T15:08:29.774486+0000","last_fullsized":"2024-03-30T15:08:29.774486+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:02:51.534402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.717421+0000","last_change":"2024-03-30T15:07:38.403522+0000","last_active":"2024-03-30T15:08:29.717421+0000","last_peered":"2024-03-30T15:08:29.717421+0000","last_clean":"2024-03-30T15:08:29.717421+0000","last_became_active":"2024-03-30T15:07:38.402864+0000","last_became_peered":"2024-03-30T15:07:38.402864+0000","last_unstale":"2024-03-30T15:08:29.717421+0000","last_undegraded":"2024-03-30T15:08:29.717421+0000","last_fullsized":"2024-03-30T15:08:29.717421+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:52:45.455180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"60'2","reported_seq":56,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.720259+0000","last_change":"2024-03-30T15:07:32.347302+0000","last_active":"2024-03-30T15:08:29.720259+0000","last_peered":"2024-03-30T15:08:29.720259+0000","last_clean":"2024-03-30T15:08:29.720259+0000","last_became_active":"2024-03-30T15:07:32.344922+0000","last_became_peered":"2024-03-30T15:07:32.344922+0000","last_unstale":"2024-03-30T15:08:29.720259+0000","last_undegraded":"2024-03-30T15:08:29.720259+0000","last_fullsized":"2024-03-30T15:08:29.720259+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:09:39.260126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"67'11","reported_seq":55,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.775057+0000","last_change":"2024-03-30T15:07:34.339198+0000","last_active":"2024-03-30T15:08:29.775057+0000","last_peered":"2024-03-30T15:08:29.775057+0000","last_clean":"2024-03-30T15:08:29.775057+0000","last_became_active":"2024-03-30T15:07:34.338779+0000","last_became_peered":"2024-03-30T15:07:34.338779+0000","last_unstale":"2024-03-30T15:08:29.775057+0000","last_undegraded":"2024-03-30T15:08:29.775057+0000","last_fullsized":"2024-03-30T15:08:29.775057+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:44:13.762511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"67'11","reported_seq":78,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:10:22.566491+0000","last_change":"2024-03-30T15:07:36.366409+0000","last_active":"2024-03-30T15:10:22.566491+0000","last_peered":"2024-03-30T15:10:22.566491+0000","last_clean":"2024-03-30T15:10:22.566491+0000","last_became_active":"2024-03-30T15:07:36.366082+0000","last_became_peered":"2024-03-30T15:07:36.366082+0000","last_unstale":"2024-03-30T15:10:22.566491+0000","last_undegraded":"2024-03-30T15:10:22.566491+0000","last_fullsized":"2024-03-30T15:10:22.566491+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:12:25.822809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.507527+0000","last_change":"2024-03-30T15:07:38.389943+0000","last_active":"2024-03-30T15:08:30.507527+0000","last_peered":"2024-03-30T15:08:30.507527+0000","last_clean":"2024-03-30T15:08:30.507527+0000","last_became_active":"2024-03-30T15:07:38.389376+0000","last_became_peered":"2024-03-30T15:07:38.389376+0000","last_unstale":"2024-03-30T15:08:30.507527+0000","last_undegraded":"2024-03-30T15:08:30.507527+0000","last_fullsized":"2024-03-30T15:08:30.507527+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:42:30.068353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.511290+0000","last_change":"2024-03-30T15:07:32.337508+0000","last_active":"2024-03-30T15:08:30.511290+0000","last_peered":"2024-03-30T15:08:30.511290+0000","last_clean":"2024-03-30T15:08:30.511290+0000","last_became_active":"2024-03-30T15:07:32.337167+0000","last_became_peered":"2024-03-30T15:07:32.337167+0000","last_unstale":"2024-03-30T15:08:30.511290+0000","last_undegraded":"2024-03-30T15:08:30.511290+0000","last_fullsized":"2024-03-30T15:08:30.511290+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:33:45.573370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"67'16","reported_seq":94,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:10:22.566556+0000","last_change":"2024-03-30T15:07:34.355275+0000","last_active":"2024-03-30T15:10:22.566556+0000","last_peered":"2024-03-30T15:10:22.566556+0000","last_clean":"2024-03-30T15:10:22.566556+0000","last_became_active":"2024-03-30T15:07:34.354977+0000","last_became_peered":"2024-03-30T15:07:34.354977+0000","last_unstale":"2024-03-30T15:10:22.566556+0000","last_undegraded":"2024-03-30T15:10:22.566556+0000","last_fullsized":"2024-03-30T15:10:22.566556+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:46:35.266407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.509321+0000","last_change":"2024-03-30T15:07:36.347570+0000","last_active":"2024-03-30T15:08:30.509321+0000","last_peered":"2024-03-30T15:08:30.509321+0000","last_clean":"2024-03-30T15:08:30.509321+0000","last_became_active":"2024-03-30T15:07:36.346694+0000","last_became_peered":"2024-03-30T15:07:36.346694+0000","last_unstale":"2024-03-30T15:08:30.509321+0000","last_undegraded":"2024-03-30T15:08:30.509321+0000","last_fullsized":"2024-03-30T15:08:30.509321+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:52:06.377187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.716894+0000","last_change":"2024-03-30T15:07:38.403478+0000","last_active":"2024-03-30T15:08:29.716894+0000","last_peered":"2024-03-30T15:08:29.716894+0000","last_clean":"2024-03-30T15:08:29.716894+0000","last_became_active":"2024-03-30T15:07:38.402849+0000","last_became_peered":"2024-03-30T15:07:38.402849+0000","last_unstale":"2024-03-30T15:08:29.716894+0000","last_undegraded":"2024-03-30T15:08:29.716894+0000","last_fullsized":"2024-03-30T15:08:29.716894+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:36:31.832642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.389136+0000","last_change":"2024-03-30T15:07:32.334463+0000","last_active":"2024-03-30T15:08:30.389136+0000","last_peered":"2024-03-30T15:08:30.389136+0000","last_clean":"2024-03-30T15:08:30.389136+0000","last_became_active":"2024-03-30T15:07:32.333524+0000","last_became_peered":"2024-03-30T15:07:32.333524+0000","last_unstale":"2024-03-30T15:08:30.389136+0000","last_undegraded":"2024-03-30T15:08:30.389136+0000","last_fullsized":"2024-03-30T15:08:30.389136+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:52:47.940031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"67'19","reported_seq":72,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.720665+0000","last_change":"2024-03-30T15:07:34.344335+0000","last_active":"2024-03-30T15:08:29.720665+0000","last_peered":"2024-03-30T15:08:29.720665+0000","last_clean":"2024-03-30T15:08:29.720665+0000","last_became_active":"2024-03-30T15:07:34.344052+0000","last_became_peered":"2024-03-30T15:07:34.344052+0000","last_unstale":"2024-03-30T15:08:29.720665+0000","last_undegraded":"2024-03-30T15:08:29.720665+0000","last_fullsized":"2024-03-30T15:08:29.720665+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:34:38.663616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.511456+0000","last_change":"2024-03-30T15:07:36.376536+0000","last_active":"2024-03-30T15:08:30.511456+0000","last_peered":"2024-03-30T15:08:30.511456+0000","last_clean":"2024-03-30T15:08:30.511456+0000","last_became_active":"2024-03-30T15:07:36.375830+0000","last_became_peered":"2024-03-30T15:07:36.375830+0000","last_unstale":"2024-03-30T15:08:30.511456+0000","last_undegraded":"2024-03-30T15:08:30.511456+0000","last_fullsized":"2024-03-30T15:08:30.511456+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T02:10:41.398902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.774864+0000","last_change":"2024-03-30T15:07:38.405589+0000","last_active":"2024-03-30T15:08:29.774864+0000","last_peered":"2024-03-30T15:08:29.774864+0000","last_clean":"2024-03-30T15:08:29.774864+0000","last_became_active":"2024-03-30T15:07:38.404861+0000","last_became_peered":"2024-03-30T15:07:38.404861+0000","last_unstale":"2024-03-30T15:08:29.774864+0000","last_undegraded":"2024-03-30T15:08:29.774864+0000","last_fullsized":"2024-03-30T15:08:29.774864+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T02:06:37.920724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"67'18","reported_seq":67,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.505713+0000","last_change":"2024-03-30T15:07:34.351151+0000","last_active":"2024-03-30T15:08:30.505713+0000","last_peered":"2024-03-30T15:08:30.505713+0000","last_clean":"2024-03-30T15:08:30.505713+0000","last_became_active":"2024-03-30T15:07:34.350664+0000","last_became_peered":"2024-03-30T15:07:34.350664+0000","last_unstale":"2024-03-30T15:08:30.505713+0000","last_undegraded":"2024-03-30T15:08:30.505713+0000","last_fullsized":"2024-03-30T15:08:30.505713+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:53:32.138703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.716106+0000","last_change":"2024-03-30T15:07:32.321373+0000","last_active":"2024-03-30T15:08:29.716106+0000","last_peered":"2024-03-30T15:08:29.716106+0000","last_clean":"2024-03-30T15:08:29.716106+0000","last_became_active":"2024-03-30T15:07:32.320673+0000","last_became_peered":"2024-03-30T15:07:32.320673+0000","last_unstale":"2024-03-30T15:08:29.716106+0000","last_undegraded":"2024-03-30T15:08:29.716106+0000","last_fullsized":"2024-03-30T15:08:29.716106+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:37:24.827543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.509714+0000","last_change":"2024-03-30T15:07:36.369064+0000","last_active":"2024-03-30T15:08:30.509714+0000","last_peered":"2024-03-30T15:08:30.509714+0000","last_clean":"2024-03-30T15:08:30.509714+0000","last_became_active":"2024-03-30T15:07:36.368207+0000","last_became_peered":"2024-03-30T15:07:36.368207+0000","last_unstale":"2024-03-30T15:08:30.509714+0000","last_undegraded":"2024-03-30T15:08:30.509714+0000","last_fullsized":"2024-03-30T15:08:30.509714+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:30:12.502240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.390143+0000","last_change":"2024-03-30T15:07:38.382182+0000","last_active":"2024-03-30T15:08:30.390143+0000","last_peered":"2024-03-30T15:08:30.390143+0000","last_clean":"2024-03-30T15:08:30.390143+0000","last_became_active":"2024-03-30T15:07:38.381501+0000","last_became_peered":"2024-03-30T15:07:38.381501+0000","last_unstale":"2024-03-30T15:08:30.390143+0000","last_undegraded":"2024-03-30T15:08:30.390143+0000","last_fullsized":"2024-03-30T15:08:30.390143+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:13:49.200669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"67'10","reported_seq":51,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.715759+0000","last_change":"2024-03-30T15:07:34.354338+0000","last_active":"2024-03-30T15:08:29.715759+0000","last_peered":"2024-03-30T15:08:29.715759+0000","last_clean":"2024-03-30T15:08:29.715759+0000","last_became_active":"2024-03-30T15:07:34.353738+0000","last_became_peered":"2024-03-30T15:07:34.353738+0000","last_unstale":"2024-03-30T15:08:29.715759+0000","last_undegraded":"2024-03-30T15:08:29.715759+0000","last_fullsized":"2024-03-30T15:08:29.715759+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:02.723937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.388773+0000","last_change":"2024-03-30T15:07:32.337660+0000","last_active":"2024-03-30T15:08:30.388773+0000","last_peered":"2024-03-30T15:08:30.388773+0000","last_clean":"2024-03-30T15:08:30.388773+0000","last_became_active":"2024-03-30T15:07:32.336777+0000","last_became_peered":"2024-03-30T15:07:32.336777+0000","last_unstale":"2024-03-30T15:08:30.388773+0000","last_undegraded":"2024-03-30T15:08:30.388773+0000","last_fullsized":"2024-03-30T15:08:30.388773+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:00:31.043882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"74'128","reported_seq":283,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:31.871801+0000","last_change":"2024-03-30T15:06:54.950175+0000","last_active":"2024-03-30T15:08:31.871801+0000","last_peered":"2024-03-30T15:08:31.871801+0000","last_clean":"2024-03-30T15:08:31.871801+0000","last_became_active":"2024-03-30T15:06:54.949407+0000","last_became_peered":"2024-03-30T15:06:54.949407+0000","last_unstale":"2024-03-30T15:08:31.871801+0000","last_undegraded":"2024-03-30T15:08:31.871801+0000","last_fullsized":"2024-03-30T15:08:31.871801+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:02:34.263471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:02:34.263471+0000","last_clean_scrub_stamp":"2024-03-30T15:02:34.263471+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:26:50.424000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.860242+0000","last_change":"2024-03-30T15:07:36.361649+0000","last_active":"2024-03-30T15:08:29.860242+0000","last_peered":"2024-03-30T15:08:29.860242+0000","last_clean":"2024-03-30T15:08:29.860242+0000","last_became_active":"2024-03-30T15:07:36.361294+0000","last_became_peered":"2024-03-30T15:07:36.361294+0000","last_unstale":"2024-03-30T15:08:29.860242+0000","last_undegraded":"2024-03-30T15:08:29.860242+0000","last_fullsized":"2024-03-30T15:08:29.860242+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:04:04.127435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.511035+0000","last_change":"2024-03-30T15:07:38.403074+0000","last_active":"2024-03-30T15:08:30.511035+0000","last_peered":"2024-03-30T15:08:30.511035+0000","last_clean":"2024-03-30T15:08:30.511035+0000","last_became_active":"2024-03-30T15:07:38.402585+0000","last_became_peered":"2024-03-30T15:07:38.402585+0000","last_unstale":"2024-03-30T15:08:30.511035+0000","last_undegraded":"2024-03-30T15:08:30.511035+0000","last_fullsized":"2024-03-30T15:08:30.511035+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:08:52.964485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"67'14","reported_seq":56,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.506778+0000","last_change":"2024-03-30T15:07:34.350781+0000","last_active":"2024-03-30T15:08:30.506778+0000","last_peered":"2024-03-30T15:08:30.506778+0000","last_clean":"2024-03-30T15:08:30.506778+0000","last_became_active":"2024-03-30T15:07:34.349805+0000","last_became_peered":"2024-03-30T15:07:34.349805+0000","last_unstale":"2024-03-30T15:08:30.506778+0000","last_undegraded":"2024-03-30T15:08:30.506778+0000","last_fullsized":"2024-03-30T15:08:30.506778+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:01:09.419377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.774295+0000","last_change":"2024-03-30T15:07:32.338859+0000","last_active":"2024-03-30T15:08:29.774295+0000","last_peered":"2024-03-30T15:08:29.774295+0000","last_clean":"2024-03-30T15:08:29.774295+0000","last_became_active":"2024-03-30T15:07:32.333612+0000","last_became_peered":"2024-03-30T15:07:32.333612+0000","last_unstale":"2024-03-30T15:08:29.774295+0000","last_undegraded":"2024-03-30T15:08:29.774295+0000","last_fullsized":"2024-03-30T15:08:29.774295+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:17:12.141979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.510027+0000","last_change":"2024-03-30T15:07:36.379825+0000","last_active":"2024-03-30T15:08:30.510027+0000","last_peered":"2024-03-30T15:08:30.510027+0000","last_clean":"2024-03-30T15:08:30.510027+0000","last_became_active":"2024-03-30T15:07:36.378967+0000","last_became_peered":"2024-03-30T15:07:36.378967+0000","last_unstale":"2024-03-30T15:08:30.510027+0000","last_undegraded":"2024-03-30T15:08:30.510027+0000","last_fullsized":"2024-03-30T15:08:30.510027+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:24:35.402461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.506421+0000","last_change":"2024-03-30T15:07:38.399737+0000","last_active":"2024-03-30T15:08:30.506421+0000","last_peered":"2024-03-30T15:08:30.506421+0000","last_clean":"2024-03-30T15:08:30.506421+0000","last_became_active":"2024-03-30T15:07:38.399287+0000","last_became_peered":"2024-03-30T15:07:38.399287+0000","last_unstale":"2024-03-30T15:08:30.506421+0000","last_undegraded":"2024-03-30T15:08:30.506421+0000","last_fullsized":"2024-03-30T15:08:30.506421+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:35:44.406857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"70'2","reported_seq":41,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.859771+0000","last_change":"2024-03-30T15:07:46.731190+0000","last_active":"2024-03-30T15:08:29.859771+0000","last_peered":"2024-03-30T15:08:29.859771+0000","last_clean":"2024-03-30T15:08:29.859771+0000","last_became_active":"2024-03-30T15:07:36.347861+0000","last_became_peered":"2024-03-30T15:07:36.347861+0000","last_unstale":"2024-03-30T15:08:29.859771+0000","last_undegraded":"2024-03-30T15:08:29.859771+0000","last_fullsized":"2024-03-30T15:08:29.859771+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:33:01.740491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022480809999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.774988+0000","last_change":"2024-03-30T15:07:32.352247+0000","last_active":"2024-03-30T15:08:29.774988+0000","last_peered":"2024-03-30T15:08:29.774988+0000","last_clean":"2024-03-30T15:08:29.774988+0000","last_became_active":"2024-03-30T15:07:32.351844+0000","last_became_peered":"2024-03-30T15:07:32.351844+0000","last_unstale":"2024-03-30T15:08:29.774988+0000","last_undegraded":"2024-03-30T15:08:29.774988+0000","last_fullsized":"2024-03-30T15:08:29.774988+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:24:29.315750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"67'30","reported_seq":121,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:10:22.566114+0000","last_change":"2024-03-30T15:07:34.351198+0000","last_active":"2024-03-30T15:10:22.566114+0000","last_peered":"2024-03-30T15:10:22.566114+0000","last_clean":"2024-03-30T15:10:22.566114+0000","last_became_active":"2024-03-30T15:07:34.350624+0000","last_became_peered":"2024-03-30T15:07:34.350624+0000","last_unstale":"2024-03-30T15:10:22.566114+0000","last_undegraded":"2024-03-30T15:10:22.566114+0000","last_fullsized":"2024-03-30T15:10:22.566114+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:24:09.394014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":51,"num_read_kb":36,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"67'11","reported_seq":77,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:10:22.566131+0000","last_change":"2024-03-30T15:07:36.365970+0000","last_active":"2024-03-30T15:10:22.566131+0000","last_peered":"2024-03-30T15:10:22.566131+0000","last_clean":"2024-03-30T15:10:22.566131+0000","last_became_active":"2024-03-30T15:07:36.365046+0000","last_became_peered":"2024-03-30T15:07:36.365046+0000","last_unstale":"2024-03-30T15:10:22.566131+0000","last_undegraded":"2024-03-30T15:10:22.566131+0000","last_fullsized":"2024-03-30T15:10:22.566131+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:00:51.305859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"67'1","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.717917+0000","last_change":"2024-03-30T15:07:38.398606+0000","last_active":"2024-03-30T15:08:29.717917+0000","last_peered":"2024-03-30T15:08:29.717917+0000","last_clean":"2024-03-30T15:08:29.717917+0000","last_became_active":"2024-03-30T15:07:38.398187+0000","last_became_peered":"2024-03-30T15:07:38.398187+0000","last_unstale":"2024-03-30T15:08:29.717917+0000","last_undegraded":"2024-03-30T15:08:29.717917+0000","last_fullsized":"2024-03-30T15:08:29.717917+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:51.036443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.717613+0000","last_change":"2024-03-30T15:07:46.954219+0000","last_active":"2024-03-30T15:08:29.717613+0000","last_peered":"2024-03-30T15:08:29.717613+0000","last_clean":"2024-03-30T15:08:29.717613+0000","last_became_active":"2024-03-30T15:07:36.366177+0000","last_became_peered":"2024-03-30T15:07:36.366177+0000","last_unstale":"2024-03-30T15:08:29.717613+0000","last_undegraded":"2024-03-30T15:08:29.717613+0000","last_fullsized":"2024-03-30T15:08:29.717613+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:51:35.074800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012795160000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"60'1","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.513688+0000","last_change":"2024-03-30T15:07:32.340948+0000","last_active":"2024-03-30T15:08:30.513688+0000","last_peered":"2024-03-30T15:08:30.513688+0000","last_clean":"2024-03-30T15:08:30.513688+0000","last_became_active":"2024-03-30T15:07:32.340585+0000","last_became_peered":"2024-03-30T15:07:32.340585+0000","last_unstale":"2024-03-30T15:08:30.513688+0000","last_undegraded":"2024-03-30T15:08:30.513688+0000","last_fullsized":"2024-03-30T15:08:30.513688+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:36:13.725180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"67'13","reported_seq":63,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.719450+0000","last_change":"2024-03-30T15:07:34.349064+0000","last_active":"2024-03-30T15:08:29.719450+0000","last_peered":"2024-03-30T15:08:29.719450+0000","last_clean":"2024-03-30T15:08:29.719450+0000","last_became_active":"2024-03-30T15:07:34.348451+0000","last_became_peered":"2024-03-30T15:07:34.348451+0000","last_unstale":"2024-03-30T15:08:29.719450+0000","last_undegraded":"2024-03-30T15:08:29.719450+0000","last_fullsized":"2024-03-30T15:08:29.719450+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:31:33.971850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"67'11","reported_seq":78,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:10:22.566152+0000","last_change":"2024-03-30T15:07:36.371034+0000","last_active":"2024-03-30T15:10:22.566152+0000","last_peered":"2024-03-30T15:10:22.566152+0000","last_clean":"2024-03-30T15:10:22.566152+0000","last_became_active":"2024-03-30T15:07:36.370271+0000","last_became_peered":"2024-03-30T15:07:36.370271+0000","last_unstale":"2024-03-30T15:10:22.566152+0000","last_undegraded":"2024-03-30T15:10:22.566152+0000","last_fullsized":"2024-03-30T15:10:22.566152+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:30:54.736052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.774444+0000","last_change":"2024-03-30T15:07:38.400465+0000","last_active":"2024-03-30T15:08:29.774444+0000","last_peered":"2024-03-30T15:08:29.774444+0000","last_clean":"2024-03-30T15:08:29.774444+0000","last_became_active":"2024-03-30T15:07:38.400244+0000","last_became_peered":"2024-03-30T15:07:38.400244+0000","last_unstale":"2024-03-30T15:08:29.774444+0000","last_undegraded":"2024-03-30T15:08:29.774444+0000","last_fullsized":"2024-03-30T15:08:29.774444+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:40:42.770106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"71'5","reported_seq":197,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:10:28.760491+0000","last_change":"2024-03-30T15:07:46.951496+0000","last_active":"2024-03-30T15:10:28.760491+0000","last_peered":"2024-03-30T15:10:28.760491+0000","last_clean":"2024-03-30T15:10:28.760491+0000","last_became_active":"2024-03-30T15:07:36.381982+0000","last_became_peered":"2024-03-30T15:07:36.381982+0000","last_unstale":"2024-03-30T15:10:28.760491+0000","last_undegraded":"2024-03-30T15:10:28.760491+0000","last_fullsized":"2024-03-30T15:10:28.760491+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:30:53.850420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013708629999999999,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":155,"num_read_kb":150,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.860560+0000","last_change":"2024-03-30T15:07:32.350652+0000","last_active":"2024-03-30T15:08:29.860560+0000","last_peered":"2024-03-30T15:08:29.860560+0000","last_clean":"2024-03-30T15:08:29.860560+0000","last_became_active":"2024-03-30T15:07:32.350304+0000","last_became_peered":"2024-03-30T15:07:32.350304+0000","last_unstale":"2024-03-30T15:08:29.860560+0000","last_undegraded":"2024-03-30T15:08:29.860560+0000","last_fullsized":"2024-03-30T15:08:29.860560+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:52:57.947063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"67'12","reported_seq":53,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.508216+0000","last_change":"2024-03-30T15:07:34.342353+0000","last_active":"2024-03-30T15:08:30.508216+0000","last_peered":"2024-03-30T15:08:30.508216+0000","last_clean":"2024-03-30T15:08:30.508216+0000","last_became_active":"2024-03-30T15:07:34.341900+0000","last_became_peered":"2024-03-30T15:07:34.341900+0000","last_unstale":"2024-03-30T15:08:30.508216+0000","last_undegraded":"2024-03-30T15:08:30.508216+0000","last_fullsized":"2024-03-30T15:08:30.508216+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:46:56.863571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.718154+0000","last_change":"2024-03-30T15:07:36.333712+0000","last_active":"2024-03-30T15:08:29.718154+0000","last_peered":"2024-03-30T15:08:29.718154+0000","last_clean":"2024-03-30T15:08:29.718154+0000","last_became_active":"2024-03-30T15:07:36.333318+0000","last_became_peered":"2024-03-30T15:07:36.333318+0000","last_unstale":"2024-03-30T15:08:29.718154+0000","last_undegraded":"2024-03-30T15:08:29.718154+0000","last_fullsized":"2024-03-30T15:08:29.718154+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:49:58.374528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.717593+0000","last_change":"2024-03-30T15:07:38.402730+0000","last_active":"2024-03-30T15:08:29.717593+0000","last_peered":"2024-03-30T15:08:29.717593+0000","last_clean":"2024-03-30T15:08:29.717593+0000","last_became_active":"2024-03-30T15:07:38.402226+0000","last_became_peered":"2024-03-30T15:07:38.402226+0000","last_unstale":"2024-03-30T15:08:29.717593+0000","last_undegraded":"2024-03-30T15:08:29.717593+0000","last_fullsized":"2024-03-30T15:08:29.717593+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T02:30:20.845556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"73'12","reported_seq":89,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:10:22.566346+0000","last_change":"2024-03-30T15:08:15.729711+0000","last_active":"2024-03-30T15:10:22.566346+0000","last_peered":"2024-03-30T15:10:22.566346+0000","last_clean":"2024-03-30T15:10:22.566346+0000","last_became_active":"2024-03-30T15:08:15.720879+0000","last_became_peered":"2024-03-30T15:08:15.720879+0000","last_unstale":"2024-03-30T15:10:22.566346+0000","last_undegraded":"2024-03-30T15:10:22.566346+0000","last_fullsized":"2024-03-30T15:10:22.566346+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T02:19:06.966387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.774677+0000","last_change":"2024-03-30T15:07:32.330917+0000","last_active":"2024-03-30T15:08:29.774677+0000","last_peered":"2024-03-30T15:08:29.774677+0000","last_clean":"2024-03-30T15:08:29.774677+0000","last_became_active":"2024-03-30T15:07:32.329951+0000","last_became_peered":"2024-03-30T15:07:32.329951+0000","last_unstale":"2024-03-30T15:08:29.774677+0000","last_undegraded":"2024-03-30T15:08:29.774677+0000","last_fullsized":"2024-03-30T15:08:29.774677+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:04:23.601903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"67'12","reported_seq":59,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.717947+0000","last_change":"2024-03-30T15:07:34.339066+0000","last_active":"2024-03-30T15:08:29.717947+0000","last_peered":"2024-03-30T15:08:29.717947+0000","last_clean":"2024-03-30T15:08:29.717947+0000","last_became_active":"2024-03-30T15:07:34.338284+0000","last_became_peered":"2024-03-30T15:07:34.338284+0000","last_unstale":"2024-03-30T15:08:29.717947+0000","last_undegraded":"2024-03-30T15:08:29.717947+0000","last_fullsized":"2024-03-30T15:08:29.717947+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:50:12.291945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.389845+0000","last_change":"2024-03-30T15:07:38.386156+0000","last_active":"2024-03-30T15:08:30.389845+0000","last_peered":"2024-03-30T15:08:30.389845+0000","last_clean":"2024-03-30T15:08:30.389845+0000","last_became_active":"2024-03-30T15:07:38.385734+0000","last_became_peered":"2024-03-30T15:07:38.385734+0000","last_unstale":"2024-03-30T15:08:30.389845+0000","last_undegraded":"2024-03-30T15:08:30.389845+0000","last_fullsized":"2024-03-30T15:08:30.389845+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:34:43.342944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.509932+0000","last_change":"2024-03-30T15:07:36.375838+0000","last_active":"2024-03-30T15:08:30.509932+0000","last_peered":"2024-03-30T15:08:30.509932+0000","last_clean":"2024-03-30T15:08:30.509932+0000","last_became_active":"2024-03-30T15:07:36.374862+0000","last_became_peered":"2024-03-30T15:07:36.374862+0000","last_unstale":"2024-03-30T15:08:30.509932+0000","last_undegraded":"2024-03-30T15:08:30.509932+0000","last_fullsized":"2024-03-30T15:08:30.509932+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:20:54.492365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":39,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.506553+0000","last_change":"2024-03-30T15:07:32.338967+0000","last_active":"2024-03-30T15:08:30.506553+0000","last_peered":"2024-03-30T15:08:30.506553+0000","last_clean":"2024-03-30T15:08:30.506553+0000","last_became_active":"2024-03-30T15:07:32.338627+0000","last_became_peered":"2024-03-30T15:07:32.338627+0000","last_unstale":"2024-03-30T15:08:30.506553+0000","last_undegraded":"2024-03-30T15:08:30.506553+0000","last_fullsized":"2024-03-30T15:08:30.506553+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:39:52.664219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"67'15","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.715670+0000","last_change":"2024-03-30T15:07:34.344448+0000","last_active":"2024-03-30T15:08:29.715670+0000","last_peered":"2024-03-30T15:08:29.715670+0000","last_clean":"2024-03-30T15:08:29.715670+0000","last_became_active":"2024-03-30T15:07:34.343910+0000","last_became_peered":"2024-03-30T15:07:34.343910+0000","last_unstale":"2024-03-30T15:08:29.715670+0000","last_undegraded":"2024-03-30T15:08:29.715670+0000","last_fullsized":"2024-03-30T15:08:29.715670+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:34:48.376583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.720737+0000","last_change":"2024-03-30T15:07:38.389748+0000","last_active":"2024-03-30T15:08:29.720737+0000","last_peered":"2024-03-30T15:08:29.720737+0000","last_clean":"2024-03-30T15:08:29.720737+0000","last_became_active":"2024-03-30T15:07:38.389131+0000","last_became_peered":"2024-03-30T15:07:38.389131+0000","last_unstale":"2024-03-30T15:08:29.720737+0000","last_undegraded":"2024-03-30T15:08:29.720737+0000","last_fullsized":"2024-03-30T15:08:29.720737+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:56.400043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":39,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.509151+0000","last_change":"2024-03-30T15:07:32.330290+0000","last_active":"2024-03-30T15:08:30.509151+0000","last_peered":"2024-03-30T15:08:30.509151+0000","last_clean":"2024-03-30T15:08:30.509151+0000","last_became_active":"2024-03-30T15:07:32.329811+0000","last_became_peered":"2024-03-30T15:07:32.329811+0000","last_unstale":"2024-03-30T15:08:30.509151+0000","last_undegraded":"2024-03-30T15:08:30.509151+0000","last_fullsized":"2024-03-30T15:08:30.509151+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:18:57.267588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"67'9","reported_seq":52,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.717094+0000","last_change":"2024-03-30T15:07:34.347298+0000","last_active":"2024-03-30T15:08:29.717094+0000","last_peered":"2024-03-30T15:08:29.717094+0000","last_clean":"2024-03-30T15:08:29.717094+0000","last_became_active":"2024-03-30T15:07:34.346723+0000","last_became_peered":"2024-03-30T15:07:34.346723+0000","last_unstale":"2024-03-30T15:08:29.717094+0000","last_undegraded":"2024-03-30T15:08:29.717094+0000","last_fullsized":"2024-03-30T15:08:29.717094+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T03:03:14.285509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.718869+0000","last_change":"2024-03-30T15:07:36.354874+0000","last_active":"2024-03-30T15:08:29.718869+0000","last_peered":"2024-03-30T15:08:29.718869+0000","last_clean":"2024-03-30T15:08:29.718869+0000","last_became_active":"2024-03-30T15:07:36.354526+0000","last_became_peered":"2024-03-30T15:07:36.354526+0000","last_unstale":"2024-03-30T15:08:29.718869+0000","last_undegraded":"2024-03-30T15:08:29.718869+0000","last_fullsized":"2024-03-30T15:08:29.718869+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T02:11:48.598236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.718458+0000","last_change":"2024-03-30T15:07:38.387225+0000","last_active":"2024-03-30T15:08:29.718458+0000","last_peered":"2024-03-30T15:08:29.718458+0000","last_clean":"2024-03-30T15:08:29.718458+0000","last_became_active":"2024-03-30T15:07:38.386214+0000","last_became_peered":"2024-03-30T15:07:38.386214+0000","last_unstale":"2024-03-30T15:08:29.718458+0000","last_undegraded":"2024-03-30T15:08:29.718458+0000","last_fullsized":"2024-03-30T15:08:29.718458+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:48:16.564054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"67'11","reported_seq":78,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:10:22.566984+0000","last_change":"2024-03-30T15:07:36.351777+0000","last_active":"2024-03-30T15:10:22.566984+0000","last_peered":"2024-03-30T15:10:22.566984+0000","last_clean":"2024-03-30T15:10:22.566984+0000","last_became_active":"2024-03-30T15:07:36.351376+0000","last_became_peered":"2024-03-30T15:07:36.351376+0000","last_unstale":"2024-03-30T15:10:22.566984+0000","last_undegraded":"2024-03-30T15:10:22.566984+0000","last_fullsized":"2024-03-30T15:10:22.566984+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T02:52:06.347766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.774561+0000","last_change":"2024-03-30T15:07:32.352236+0000","last_active":"2024-03-30T15:08:29.774561+0000","last_peered":"2024-03-30T15:08:29.774561+0000","last_clean":"2024-03-30T15:08:29.774561+0000","last_became_active":"2024-03-30T15:07:32.350571+0000","last_became_peered":"2024-03-30T15:07:32.350571+0000","last_unstale":"2024-03-30T15:08:29.774561+0000","last_undegraded":"2024-03-30T15:08:29.774561+0000","last_fullsized":"2024-03-30T15:08:29.774561+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:06:23.655260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"67'19","reported_seq":67,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.859969+0000","last_change":"2024-03-30T15:07:34.342569+0000","last_active":"2024-03-30T15:08:29.859969+0000","last_peered":"2024-03-30T15:08:29.859969+0000","last_clean":"2024-03-30T15:08:29.859969+0000","last_became_active":"2024-03-30T15:07:34.342230+0000","last_became_peered":"2024-03-30T15:07:34.342230+0000","last_unstale":"2024-03-30T15:08:29.859969+0000","last_undegraded":"2024-03-30T15:08:29.859969+0000","last_fullsized":"2024-03-30T15:08:29.859969+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:50:25.276224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.774119+0000","last_change":"2024-03-30T15:07:38.405602+0000","last_active":"2024-03-30T15:08:29.774119+0000","last_peered":"2024-03-30T15:08:29.774119+0000","last_clean":"2024-03-30T15:08:29.774119+0000","last_became_active":"2024-03-30T15:07:38.404958+0000","last_became_peered":"2024-03-30T15:07:38.404958+0000","last_unstale":"2024-03-30T15:08:29.774119+0000","last_undegraded":"2024-03-30T15:08:29.774119+0000","last_fullsized":"2024-03-30T15:08:29.774119+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:50:15.482136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.718305+0000","last_change":"2024-03-30T15:07:32.331675+0000","last_active":"2024-03-30T15:08:29.718305+0000","last_peered":"2024-03-30T15:08:29.718305+0000","last_clean":"2024-03-30T15:08:29.718305+0000","last_became_active":"2024-03-30T15:07:32.331163+0000","last_became_peered":"2024-03-30T15:07:32.331163+0000","last_unstale":"2024-03-30T15:08:29.718305+0000","last_undegraded":"2024-03-30T15:08:29.718305+0000","last_fullsized":"2024-03-30T15:08:29.718305+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:46:47.254120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"67'17","reported_seq":64,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.775000+0000","last_change":"2024-03-30T15:07:34.337741+0000","last_active":"2024-03-30T15:08:29.775000+0000","last_peered":"2024-03-30T15:08:29.775000+0000","last_clean":"2024-03-30T15:08:29.775000+0000","last_became_active":"2024-03-30T15:07:34.337357+0000","last_became_peered":"2024-03-30T15:07:34.337357+0000","last_unstale":"2024-03-30T15:08:29.775000+0000","last_undegraded":"2024-03-30T15:08:29.775000+0000","last_fullsized":"2024-03-30T15:08:29.775000+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:19:21.556621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":38,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.859622+0000","last_change":"2024-03-30T15:08:16.510715+0000","last_active":"2024-03-30T15:08:29.859622+0000","last_peered":"2024-03-30T15:08:29.859622+0000","last_clean":"2024-03-30T15:08:29.859622+0000","last_became_active":"2024-03-30T15:08:16.510322+0000","last_became_peered":"2024-03-30T15:08:16.510322+0000","last_unstale":"2024-03-30T15:08:29.859622+0000","last_undegraded":"2024-03-30T15:08:29.859622+0000","last_fullsized":"2024-03-30T15:08:29.859622+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:39:53.736840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,7],"acting":[6,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.507278+0000","last_change":"2024-03-30T15:07:38.394884+0000","last_active":"2024-03-30T15:08:30.507278+0000","last_peered":"2024-03-30T15:08:30.507278+0000","last_clean":"2024-03-30T15:08:30.507278+0000","last_became_active":"2024-03-30T15:07:38.394021+0000","last_became_peered":"2024-03-30T15:07:38.394021+0000","last_unstale":"2024-03-30T15:08:30.507278+0000","last_undegraded":"2024-03-30T15:08:30.507278+0000","last_fullsized":"2024-03-30T15:08:30.507278+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:35:25.840517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":39,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.509630+0000","last_change":"2024-03-30T15:07:32.340848+0000","last_active":"2024-03-30T15:08:30.509630+0000","last_peered":"2024-03-30T15:08:30.509630+0000","last_clean":"2024-03-30T15:08:30.509630+0000","last_became_active":"2024-03-30T15:07:32.340488+0000","last_became_peered":"2024-03-30T15:07:32.340488+0000","last_unstale":"2024-03-30T15:08:30.509630+0000","last_undegraded":"2024-03-30T15:08:30.509630+0000","last_fullsized":"2024-03-30T15:08:30.509630+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:01:56.309218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"67'10","reported_seq":51,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.387492+0000","last_change":"2024-03-30T15:07:34.336404+0000","last_active":"2024-03-30T15:08:30.387492+0000","last_peered":"2024-03-30T15:08:30.387492+0000","last_clean":"2024-03-30T15:08:30.387492+0000","last_became_active":"2024-03-30T15:07:34.336037+0000","last_became_peered":"2024-03-30T15:07:34.336037+0000","last_unstale":"2024-03-30T15:08:30.387492+0000","last_undegraded":"2024-03-30T15:08:30.387492+0000","last_fullsized":"2024-03-30T15:08:30.387492+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:54:37.926017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.509707+0000","last_change":"2024-03-30T15:07:36.379834+0000","last_active":"2024-03-30T15:08:30.509707+0000","last_peered":"2024-03-30T15:08:30.509707+0000","last_clean":"2024-03-30T15:08:30.509707+0000","last_became_active":"2024-03-30T15:07:36.378951+0000","last_became_peered":"2024-03-30T15:07:36.378951+0000","last_unstale":"2024-03-30T15:08:30.509707+0000","last_undegraded":"2024-03-30T15:08:30.509707+0000","last_fullsized":"2024-03-30T15:08:30.509707+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:33:31.659134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.389525+0000","last_change":"2024-03-30T15:07:38.402366+0000","last_active":"2024-03-30T15:08:30.389525+0000","last_peered":"2024-03-30T15:08:30.389525+0000","last_clean":"2024-03-30T15:08:30.389525+0000","last_became_active":"2024-03-30T15:07:38.401820+0000","last_became_peered":"2024-03-30T15:07:38.401820+0000","last_unstale":"2024-03-30T15:08:30.389525+0000","last_undegraded":"2024-03-30T15:08:30.389525+0000","last_fullsized":"2024-03-30T15:08:30.389525+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:37.345697+0000","last_clean_scrub_stamp":"2024-03-30T15:07:37.345697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:44:43.744390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.716946+0000","last_change":"2024-03-30T15:07:32.326966+0000","last_active":"2024-03-30T15:08:29.716946+0000","last_peered":"2024-03-30T15:08:29.716946+0000","last_clean":"2024-03-30T15:08:29.716946+0000","last_became_active":"2024-03-30T15:07:32.326662+0000","last_became_peered":"2024-03-30T15:07:32.326662+0000","last_unstale":"2024-03-30T15:08:29.716946+0000","last_undegraded":"2024-03-30T15:08:29.716946+0000","last_fullsized":"2024-03-30T15:08:29.716946+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:31.286909+0000","last_clean_scrub_stamp":"2024-03-30T15:07:31.286909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:23:18.057060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"67'15","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:29.775080+0000","last_change":"2024-03-30T15:07:34.343848+0000","last_active":"2024-03-30T15:08:29.775080+0000","last_peered":"2024-03-30T15:08:29.775080+0000","last_clean":"2024-03-30T15:08:29.775080+0000","last_became_active":"2024-03-30T15:07:34.343515+0000","last_became_peered":"2024-03-30T15:07:34.343515+0000","last_unstale":"2024-03-30T15:08:29.775080+0000","last_undegraded":"2024-03-30T15:08:29.775080+0000","last_fullsized":"2024-03-30T15:08:29.775080+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:33.300017+0000","last_clean_scrub_stamp":"2024-03-30T15:07:33.300017+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:15:52.626541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-03-30T15:08:30.388331+0000","last_change":"2024-03-30T15:07:36.362365+0000","last_active":"2024-03-30T15:08:30.388331+0000","last_peered":"2024-03-30T15:08:30.388331+0000","last_clean":"2024-03-30T15:08:30.388331+0000","last_became_active":"2024-03-30T15:07:36.361989+0000","last_became_peered":"2024-03-30T15:07:36.361989+0000","last_unstale":"2024-03-30T15:08:30.388331+0000","last_undegraded":"2024-03-30T15:08:30.388331+0000","last_fullsized":"2024-03-30T15:08:30.388331+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T15:07:35.315208+0000","last_clean_scrub_stamp":"2024-03-30T15:07:35.315208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:38:22.562034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":383,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":3,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":155,"num_read_kb":150,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":90,"ondisk_log_size":90,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":701,"num_read_kb":458,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":395,"ondisk_log_size":395,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1457,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":54,"seq":231928234029,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28424,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716728,"statfs":{"total":95995035648,"available":95965929472,"internally_reserved":0,"allocated":1441792,"data_stored":944024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495672,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28404,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716748,"statfs":{"total":95995035648,"available":95965949952,"internally_reserved":0,"allocated":1421312,"data_stored":943600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574957,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":835584,"data_stored":353039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738488,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32576,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712576,"statfs":{"total":95995035648,"available":95961677824,"internally_reserved":0,"allocated":1433600,"data_stored":943389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411425,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31992,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713160,"statfs":{"total":95995035648,"available":95962275840,"internally_reserved":0,"allocated":831488,"data_stored":353686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182488,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31984,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713168,"statfs":{"total":95995035648,"available":95962284032,"internally_reserved":0,"allocated":823296,"data_stored":352738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018956,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32028,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713124,"statfs":{"total":95995035648,"available":95962238976,"internally_reserved":0,"allocated":868352,"data_stored":354064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757315,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31988,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713164,"statfs":{"total":95995035648,"available":95962279936,"internally_reserved":0,"allocated":827392,"data_stored":353582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T15:10:35.731 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-03-30T15:10:35.732 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-30T15:10:35.732 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-03-30T15:10:35.732 DEBUG:teuthology.orchestra.run.smithi072:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb shell --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 -- ceph health --format=json 2024-03-30T15:10:36.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:35 smithi072 bash[28946]: audit 2024-03-30T15:10:34.972070+0000 mgr.y (mgr.14526) 112 : audit 0 from='client.24572 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T15:10:36.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:35 smithi072 bash[21573]: audit 2024-03-30T15:10:34.972070+0000 mgr.y (mgr.14526) 112 : audit 0 from='client.24572 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T15:10:36.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:35 smithi172 bash[23680]: audit 2024-03-30T15:10:34.972070+0000 mgr.y (mgr.14526) 112 : audit 0 from='client.24572 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T15:10:37.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:36 smithi172 bash[23680]: cluster 2024-03-30T15:10:35.792109+0000 mgr.y (mgr.14526) 113 : cluster 0 pgmap v66: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:10:37.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:36 smithi072 bash[21573]: cluster 2024-03-30T15:10:35.792109+0000 mgr.y (mgr.14526) 113 : cluster 0 pgmap v66: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:10:37.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:36 smithi072 bash[28946]: cluster 2024-03-30T15:10:35.792109+0000 mgr.y (mgr.14526) 113 : cluster 0 pgmap v66: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:10:39.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:38 smithi172 bash[23680]: cluster 2024-03-30T15:10:37.792790+0000 mgr.y (mgr.14526) 114 : cluster 0 pgmap v67: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T15:10:39.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:38 smithi072 bash[21573]: cluster 2024-03-30T15:10:37.792790+0000 mgr.y (mgr.14526) 114 : cluster 0 pgmap v67: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T15:10:39.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:38 smithi072 bash[28946]: cluster 2024-03-30T15:10:37.792790+0000 mgr.y (mgr.14526) 114 : cluster 0 pgmap v67: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T15:10:40.552 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T15:10:41.216 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:10:40 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:10:41.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:40 smithi172 bash[23680]: cluster 2024-03-30T15:10:39.793495+0000 mgr.y (mgr.14526) 115 : cluster 0 pgmap v68: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T15:10:41.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:40 smithi072 bash[21573]: cluster 2024-03-30T15:10:39.793495+0000 mgr.y (mgr.14526) 115 : cluster 0 pgmap v68: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T15:10:41.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:40 smithi072 bash[28946]: cluster 2024-03-30T15:10:39.793495+0000 mgr.y (mgr.14526) 115 : cluster 0 pgmap v68: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T15:10:41.417 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:10:41 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:10:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:10:42.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:41 smithi072 bash[21573]: audit 2024-03-30T15:10:40.863688+0000 mgr.y (mgr.14526) 116 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:10:42.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:41 smithi072 bash[28946]: audit 2024-03-30T15:10:40.863688+0000 mgr.y (mgr.14526) 116 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:10:42.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:41 smithi172 bash[23680]: audit 2024-03-30T15:10:40.863688+0000 mgr.y (mgr.14526) 116 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:10:43.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:42 smithi172 bash[23680]: cluster 2024-03-30T15:10:41.794261+0000 mgr.y (mgr.14526) 117 : cluster 0 pgmap v69: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:10:43.316 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:42 smithi072 bash[21573]: cluster 2024-03-30T15:10:41.794261+0000 mgr.y (mgr.14526) 117 : cluster 0 pgmap v69: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:10:43.316 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:42 smithi072 bash[28946]: cluster 2024-03-30T15:10:41.794261+0000 mgr.y (mgr.14526) 117 : cluster 0 pgmap v69: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:10:43.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.478+0000 7f7b448e9700 1 -- 172.21.15.72:0/1992745053 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7b40107430 msgr2=0x7f7b40107810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:43.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.478+0000 7f7b448e9700 1 --2- 172.21.15.72:0/1992745053 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7b40107430 0x7f7b40107810 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7b30009990 tx=0x7f7b30009ca0 comp rx=0 tx=0).stop 2024-03-30T15:10:43.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.478+0000 7f7b448e9700 1 -- 172.21.15.72:0/1992745053 shutdown_connections 2024-03-30T15:10:43.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.478+0000 7f7b448e9700 1 --2- 172.21.15.72:0/1992745053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b401026d0 0x7f7b4010e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:43.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.478+0000 7f7b448e9700 1 --2- 172.21.15.72:0/1992745053 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7b40107430 0x7f7b40107810 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:43.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.478+0000 7f7b448e9700 1 --2- 172.21.15.72:0/1992745053 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b40101d10 0x7f7b40102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:43.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.478+0000 7f7b448e9700 1 -- 172.21.15.72:0/1992745053 >> 172.21.15.72:0/1992745053 conn(0x7f7b40076460 msgr2=0x7f7b40076870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:10:43.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.478+0000 7f7b448e9700 1 -- 172.21.15.72:0/1992745053 shutdown_connections 2024-03-30T15:10:43.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.478+0000 7f7b448e9700 1 -- 172.21.15.72:0/1992745053 wait complete. 2024-03-30T15:10:43.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.478+0000 7f7b448e9700 1 Processor -- start 2024-03-30T15:10:43.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.478+0000 7f7b448e9700 1 -- start start 2024-03-30T15:10:43.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.478+0000 7f7b448e9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b40101d10 0x7f7b401980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:10:43.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.478+0000 7f7b448e9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7b401026d0 0x7f7b401985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:10:43.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.478+0000 7f7b448e9700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b40107430 0x7f7b4019c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:10:43.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.478+0000 7f7b448e9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7b40111bc0 con 0x7f7b40101d10 2024-03-30T15:10:43.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.478+0000 7f7b448e9700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7b40111a40 con 0x7f7b40107430 2024-03-30T15:10:43.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.478+0000 7f7b448e9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f7b40111d40 con 0x7f7b401026d0 2024-03-30T15:10:43.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.478+0000 7f7b3e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b40101d10 0x7f7b401980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:10:43.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.478+0000 7f7b3dd9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7b401026d0 0x7f7b401985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:10:43.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.478+0000 7f7b3e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b40101d10 0x7f7b401980a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45384/0 (socket says 172.21.15.72:45384) 2024-03-30T15:10:43.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.478+0000 7f7b3e59c700 1 -- 172.21.15.72:0/1197882701 learned_addr learned my addr 172.21.15.72:0/1197882701 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T15:10:43.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.478+0000 7f7b3e59c700 1 -- 172.21.15.72:0/1197882701 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7b401026d0 msgr2=0x7f7b401985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:43.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.478+0000 7f7b3e59c700 1 --2- 172.21.15.72:0/1197882701 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7b401026d0 0x7f7b401985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:43.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.478+0000 7f7b3e59c700 1 -- 172.21.15.72:0/1197882701 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b40107430 msgr2=0x7f7b4019c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:43.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.478+0000 7f7b3e59c700 1 --2- 172.21.15.72:0/1197882701 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b40107430 0x7f7b4019c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:43.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.478+0000 7f7b3e59c700 1 -- 172.21.15.72:0/1197882701 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b4019d0b0 con 0x7f7b40101d10 2024-03-30T15:10:43.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.478+0000 7f7b3dd9b700 1 --2- 172.21.15.72:0/1197882701 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7b401026d0 0x7f7b401985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T15:10:43.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.478+0000 7f7b3e59c700 1 --2- 172.21.15.72:0/1197882701 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b40101d10 0x7f7b401980a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7b30000c00 tx=0x7f7b300047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:10:43.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.478+0000 7f7b2f7fe700 1 -- 172.21.15.72:0/1197882701 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b30027070 con 0x7f7b40101d10 2024-03-30T15:10:43.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.478+0000 7f7b448e9700 1 -- 172.21.15.72:0/1197882701 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b4019d340 con 0x7f7b40101d10 2024-03-30T15:10:43.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.478+0000 7f7b2f7fe700 1 -- 172.21.15.72:0/1197882701 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f7b30022470 con 0x7f7b40101d10 2024-03-30T15:10:43.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.478+0000 7f7b2f7fe700 1 -- 172.21.15.72:0/1197882701 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b30017650 con 0x7f7b40101d10 2024-03-30T15:10:43.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.478+0000 7f7b448e9700 1 -- 172.21.15.72:0/1197882701 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b4010e7a0 con 0x7f7b40101d10 2024-03-30T15:10:43.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.478+0000 7f7b448e9700 1 -- 172.21.15.72:0/1197882701 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b4004ff00 con 0x7f7b40101d10 2024-03-30T15:10:43.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.482+0000 7f7b2f7fe700 1 -- 172.21.15.72:0/1197882701 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 21) ==== 91831+0+0 (secure 0 0 0) 0x7f7b3002a070 con 0x7f7b40101d10 2024-03-30T15:10:43.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.482+0000 7f7b2f7fe700 1 --2- 172.21.15.72:0/1197882701 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f7b2806dc40 0x7f7b28070100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:10:43.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.482+0000 7f7b2f7fe700 1 -- 172.21.15.72:0/1197882701 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7537+0+0 (secure 0 0 0) 0x7f7b3008f330 con 0x7f7b40101d10 2024-03-30T15:10:43.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.482+0000 7f7b3dd9b700 1 --2- 172.21.15.72:0/1197882701 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f7b2806dc40 0x7f7b28070100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:10:43.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.482+0000 7f7b3dd9b700 1 --2- 172.21.15.72:0/1197882701 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f7b2806dc40 0x7f7b28070100 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7b401126a0 tx=0x7f7b34012040 comp rx=0 tx=0).ready entity=mgr.14526 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:10:43.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.486+0000 7f7b2f7fe700 1 -- 172.21.15.72:0/1197882701 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f7b30013070 con 0x7f7b40101d10 2024-03-30T15:10:43.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.742+0000 7f7b448e9700 1 -- 172.21.15.72:0/1197882701 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7b4010ea00 con 0x7f7b40101d10 2024-03-30T15:10:43.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.742+0000 7f7b2f7fe700 1 -- 172.21.15.72:0/1197882701 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f7b3005ca70 con 0x7f7b40101d10 2024-03-30T15:10:43.741 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-30T15:10:43.741 INFO:teuthology.orchestra.run.smithi072.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-30T15:10:43.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.746+0000 7f7b448e9700 1 -- 172.21.15.72:0/1197882701 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f7b2806dc40 msgr2=0x7f7b28070100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:43.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.746+0000 7f7b448e9700 1 --2- 172.21.15.72:0/1197882701 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f7b2806dc40 0x7f7b28070100 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7b401126a0 tx=0x7f7b34012040 comp rx=0 tx=0).stop 2024-03-30T15:10:43.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.746+0000 7f7b448e9700 1 -- 172.21.15.72:0/1197882701 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b40101d10 msgr2=0x7f7b401980a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:10:43.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.746+0000 7f7b448e9700 1 --2- 172.21.15.72:0/1197882701 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b40101d10 0x7f7b401980a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7b30000c00 tx=0x7f7b300047b0 comp rx=0 tx=0).stop 2024-03-30T15:10:43.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.746+0000 7f7b448e9700 1 -- 172.21.15.72:0/1197882701 shutdown_connections 2024-03-30T15:10:43.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.746+0000 7f7b448e9700 1 --2- 172.21.15.72:0/1197882701 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f7b2806dc40 0x7f7b28070100 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:43.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.746+0000 7f7b448e9700 1 --2- 172.21.15.72:0/1197882701 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b40107430 0x7f7b4019c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:43.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.746+0000 7f7b448e9700 1 --2- 172.21.15.72:0/1197882701 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b40101d10 0x7f7b401980a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:43.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.746+0000 7f7b448e9700 1 --2- 172.21.15.72:0/1197882701 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7b401026d0 0x7f7b401985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:10:43.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.746+0000 7f7b448e9700 1 -- 172.21.15.72:0/1197882701 >> 172.21.15.72:0/1197882701 conn(0x7f7b40076460 msgr2=0x7f7b40102dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:10:43.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.746+0000 7f7b448e9700 1 -- 172.21.15.72:0/1197882701 shutdown_connections 2024-03-30T15:10:43.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-30T15:10:43.746+0000 7f7b448e9700 1 -- 172.21.15.72:0/1197882701 wait complete. 2024-03-30T15:10:44.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:43 smithi072 bash[21573]: audit 2024-03-30T15:10:43.746208+0000 mon.a (mon.0) 873 : audit 0 from='client.? 172.21.15.72:0/1197882701' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-03-30T15:10:44.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:43 smithi072 bash[28946]: audit 2024-03-30T15:10:43.746208+0000 mon.a (mon.0) 873 : audit 0 from='client.? 172.21.15.72:0/1197882701' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-03-30T15:10:44.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:43 smithi172 bash[23680]: audit 2024-03-30T15:10:43.746208+0000 mon.a (mon.0) 873 : audit 0 from='client.? 172.21.15.72:0/1197882701' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-03-30T15:10:44.566 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-03-30T15:10:44.566 INFO:tasks.cephadm:Setup complete, yielding 2024-03-30T15:10:44.566 INFO:teuthology.run_tasks:Running task workunit... 2024-03-30T15:10:44.580 INFO:tasks.workunit:Pulling workunits from ref 5af0400050a123dc31f105425174f106e057276a 2024-03-30T15:10:44.580 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-30T15:10:44.581 DEBUG:teuthology.orchestra.run.smithi072:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-30T15:10:44.586 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T15:10:44.587 INFO:teuthology.orchestra.run.smithi072.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-03-30T15:10:44.587 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-03-30T15:10:44.636 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-03-30T15:10:44.636 DEBUG:teuthology.orchestra.run.smithi072:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-03-30T15:10:44.684 INFO:tasks.workunit:timeout=3h 2024-03-30T15:10:44.684 INFO:tasks.workunit:cleanup=True 2024-03-30T15:10:44.684 DEBUG:teuthology.orchestra.run.smithi072:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 5af0400050a123dc31f105425174f106e057276a 2024-03-30T15:10:44.733 INFO:tasks.workunit.client.0.smithi072.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-30T15:10:45.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:44 smithi072 bash[21573]: cluster 2024-03-30T15:10:43.794684+0000 mgr.y (mgr.14526) 118 : cluster 0 pgmap v70: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:10:45.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:44 smithi072 bash[28946]: cluster 2024-03-30T15:10:43.794684+0000 mgr.y (mgr.14526) 118 : cluster 0 pgmap v70: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:10:45.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:44 smithi172 bash[23680]: cluster 2024-03-30T15:10:43.794684+0000 mgr.y (mgr.14526) 118 : cluster 0 pgmap v70: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:10:46.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:45 smithi072 bash[21573]: audit 2024-03-30T15:10:45.110878+0000 mon.c (mon.2) 83 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:10:46.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:45 smithi072 bash[28946]: audit 2024-03-30T15:10:45.110878+0000 mon.c (mon.2) 83 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:10:46.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:45 smithi172 bash[23680]: audit 2024-03-30T15:10:45.110878+0000 mon.c (mon.2) 83 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:10:47.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:46 smithi072 bash[21573]: cluster 2024-03-30T15:10:45.796005+0000 mgr.y (mgr.14526) 119 : cluster 0 pgmap v71: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:10:47.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:46 smithi072 bash[28946]: cluster 2024-03-30T15:10:45.796005+0000 mgr.y (mgr.14526) 119 : cluster 0 pgmap v71: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:10:47.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:46 smithi172 bash[23680]: cluster 2024-03-30T15:10:45.796005+0000 mgr.y (mgr.14526) 119 : cluster 0 pgmap v71: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:10:49.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:49 smithi072 bash[21573]: cluster 2024-03-30T15:10:47.796675+0000 mgr.y (mgr.14526) 120 : cluster 0 pgmap v72: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:10:49.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:49 smithi072 bash[28946]: cluster 2024-03-30T15:10:47.796675+0000 mgr.y (mgr.14526) 120 : cluster 0 pgmap v72: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:10:49.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:49 smithi172 bash[23680]: cluster 2024-03-30T15:10:47.796675+0000 mgr.y (mgr.14526) 120 : cluster 0 pgmap v72: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:10:51.216 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:10:50 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:10:51.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:51 smithi172 bash[23680]: cluster 2024-03-30T15:10:49.797498+0000 mgr.y (mgr.14526) 121 : cluster 0 pgmap v73: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T15:10:51.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:51 smithi072 bash[21573]: cluster 2024-03-30T15:10:49.797498+0000 mgr.y (mgr.14526) 121 : cluster 0 pgmap v73: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T15:10:51.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:51 smithi072 bash[28946]: cluster 2024-03-30T15:10:49.797498+0000 mgr.y (mgr.14526) 121 : cluster 0 pgmap v73: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T15:10:51.417 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:10:51 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:10:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:10:52.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:52 smithi072 bash[21573]: audit 2024-03-30T15:10:50.872340+0000 mgr.y (mgr.14526) 122 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:10:52.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:52 smithi072 bash[28946]: audit 2024-03-30T15:10:50.872340+0000 mgr.y (mgr.14526) 122 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:10:52.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:52 smithi172 bash[23680]: audit 2024-03-30T15:10:50.872340+0000 mgr.y (mgr.14526) 122 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:10:53.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:53 smithi072 bash[21573]: cluster 2024-03-30T15:10:51.799028+0000 mgr.y (mgr.14526) 123 : cluster 0 pgmap v74: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:10:53.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:53 smithi072 bash[28946]: cluster 2024-03-30T15:10:51.799028+0000 mgr.y (mgr.14526) 123 : cluster 0 pgmap v74: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:10:53.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:53 smithi172 bash[23680]: cluster 2024-03-30T15:10:51.799028+0000 mgr.y (mgr.14526) 123 : cluster 0 pgmap v74: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:10:55.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:55 smithi072 bash[21573]: cluster 2024-03-30T15:10:53.799776+0000 mgr.y (mgr.14526) 124 : cluster 0 pgmap v75: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:10:55.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:55 smithi072 bash[28946]: cluster 2024-03-30T15:10:53.799776+0000 mgr.y (mgr.14526) 124 : cluster 0 pgmap v75: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:10:55.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:55 smithi172 bash[23680]: cluster 2024-03-30T15:10:53.799776+0000 mgr.y (mgr.14526) 124 : cluster 0 pgmap v75: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:10:57.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:57 smithi072 bash[21573]: cluster 2024-03-30T15:10:55.801254+0000 mgr.y (mgr.14526) 125 : cluster 0 pgmap v76: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:10:57.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:57 smithi072 bash[21573]: audit 2024-03-30T15:10:56.298708+0000 mon.c (mon.2) 84 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:10:57.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:57 smithi072 bash[28946]: cluster 2024-03-30T15:10:55.801254+0000 mgr.y (mgr.14526) 125 : cluster 0 pgmap v76: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:10:57.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:57 smithi072 bash[28946]: audit 2024-03-30T15:10:56.298708+0000 mon.c (mon.2) 84 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:10:57.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:57 smithi172 bash[23680]: cluster 2024-03-30T15:10:55.801254+0000 mgr.y (mgr.14526) 125 : cluster 0 pgmap v76: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:10:57.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:57 smithi172 bash[23680]: audit 2024-03-30T15:10:56.298708+0000 mon.c (mon.2) 84 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:10:58.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:58 smithi072 bash[21573]: audit 2024-03-30T15:10:57.028404+0000 mon.c (mon.2) 85 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:10:58.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:58 smithi072 bash[21573]: audit 2024-03-30T15:10:57.031715+0000 mon.c (mon.2) 86 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:10:58.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:58 smithi072 bash[21573]: audit 2024-03-30T15:10:57.041618+0000 mon.a (mon.0) 874 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:10:58.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:58 smithi072 bash[28946]: audit 2024-03-30T15:10:57.028404+0000 mon.c (mon.2) 85 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:10:58.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:58 smithi072 bash[28946]: audit 2024-03-30T15:10:57.031715+0000 mon.c (mon.2) 86 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:10:58.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:58 smithi072 bash[28946]: audit 2024-03-30T15:10:57.041618+0000 mon.a (mon.0) 874 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:10:58.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:58 smithi172 bash[23680]: audit 2024-03-30T15:10:57.028404+0000 mon.c (mon.2) 85 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:10:58.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:58 smithi172 bash[23680]: audit 2024-03-30T15:10:57.031715+0000 mon.c (mon.2) 86 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:10:58.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:58 smithi172 bash[23680]: audit 2024-03-30T15:10:57.041618+0000 mon.a (mon.0) 874 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:10:59.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:10:59 smithi072 bash[21573]: cluster 2024-03-30T15:10:57.802067+0000 mgr.y (mgr.14526) 126 : cluster 0 pgmap v77: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:10:59.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:10:59 smithi072 bash[28946]: cluster 2024-03-30T15:10:57.802067+0000 mgr.y (mgr.14526) 126 : cluster 0 pgmap v77: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:10:59.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:10:59 smithi172 bash[23680]: cluster 2024-03-30T15:10:57.802067+0000 mgr.y (mgr.14526) 126 : cluster 0 pgmap v77: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:11:01.216 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:11:00 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:11:01.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:11:01 smithi172 bash[23680]: cluster 2024-03-30T15:10:59.802746+0000 mgr.y (mgr.14526) 127 : cluster 0 pgmap v78: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:11:01.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:11:01 smithi172 bash[23680]: audit 2024-03-30T15:11:00.146319+0000 mon.c (mon.2) 87 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:11:01.416 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:11:01 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:11:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:11:01.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:11:01 smithi072 bash[21573]: cluster 2024-03-30T15:10:59.802746+0000 mgr.y (mgr.14526) 127 : cluster 0 pgmap v78: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:11:01.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:11:01 smithi072 bash[21573]: audit 2024-03-30T15:11:00.146319+0000 mon.c (mon.2) 87 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:11:01.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:11:01 smithi072 bash[28946]: cluster 2024-03-30T15:10:59.802746+0000 mgr.y (mgr.14526) 127 : cluster 0 pgmap v78: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:11:01.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:11:01 smithi072 bash[28946]: audit 2024-03-30T15:11:00.146319+0000 mon.c (mon.2) 87 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:11:02.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:11:02 smithi072 bash[21573]: audit 2024-03-30T15:11:00.883866+0000 mgr.y (mgr.14526) 128 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:11:02.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:11:02 smithi072 bash[28946]: audit 2024-03-30T15:11:00.883866+0000 mgr.y (mgr.14526) 128 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:11:02.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:11:02 smithi172 bash[23680]: audit 2024-03-30T15:11:00.883866+0000 mgr.y (mgr.14526) 128 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:11:03.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:11:03 smithi072 bash[21573]: cluster 2024-03-30T15:11:01.804197+0000 mgr.y (mgr.14526) 129 : cluster 0 pgmap v79: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:11:03.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:11:03 smithi072 bash[28946]: cluster 2024-03-30T15:11:01.804197+0000 mgr.y (mgr.14526) 129 : cluster 0 pgmap v79: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:11:03.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:11:03 smithi172 bash[23680]: cluster 2024-03-30T15:11:01.804197+0000 mgr.y (mgr.14526) 129 : cluster 0 pgmap v79: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:11:05.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:11:05 smithi072 bash[21573]: cluster 2024-03-30T15:11:03.804881+0000 mgr.y (mgr.14526) 130 : cluster 0 pgmap v80: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:11:05.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:11:05 smithi072 bash[28946]: cluster 2024-03-30T15:11:03.804881+0000 mgr.y (mgr.14526) 130 : cluster 0 pgmap v80: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:11:05.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:11:05 smithi172 bash[23680]: cluster 2024-03-30T15:11:03.804881+0000 mgr.y (mgr.14526) 130 : cluster 0 pgmap v80: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:11:07.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:11:07 smithi072 bash[21573]: cluster 2024-03-30T15:11:05.806369+0000 mgr.y (mgr.14526) 131 : cluster 0 pgmap v81: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:11:07.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:11:07 smithi072 bash[28946]: cluster 2024-03-30T15:11:05.806369+0000 mgr.y (mgr.14526) 131 : cluster 0 pgmap v81: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:11:07.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:11:07 smithi172 bash[23680]: cluster 2024-03-30T15:11:05.806369+0000 mgr.y (mgr.14526) 131 : cluster 0 pgmap v81: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:11:09.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:11:09 smithi072 bash[21573]: cluster 2024-03-30T15:11:07.807182+0000 mgr.y (mgr.14526) 132 : cluster 0 pgmap v82: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:11:09.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:11:09 smithi072 bash[28946]: cluster 2024-03-30T15:11:07.807182+0000 mgr.y (mgr.14526) 132 : cluster 0 pgmap v82: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:11:09.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:11:09 smithi172 bash[23680]: cluster 2024-03-30T15:11:07.807182+0000 mgr.y (mgr.14526) 132 : cluster 0 pgmap v82: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:11:11.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:11:11 smithi172 bash[23680]: cluster 2024-03-30T15:11:09.807988+0000 mgr.y (mgr.14526) 133 : cluster 0 pgmap v83: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:11:11.216 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:11:10 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:11:11.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:11:11 smithi072 bash[21573]: cluster 2024-03-30T15:11:09.807988+0000 mgr.y (mgr.14526) 133 : cluster 0 pgmap v83: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:11:11.416 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:11:11 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:11:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:11:11.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:11:11 smithi072 bash[28946]: cluster 2024-03-30T15:11:09.807988+0000 mgr.y (mgr.14526) 133 : cluster 0 pgmap v83: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:11:12.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:11:12 smithi072 bash[21573]: audit 2024-03-30T15:11:10.895279+0000 mgr.y (mgr.14526) 134 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:11:12.416 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:11:12 smithi072 bash[28946]: audit 2024-03-30T15:11:10.895279+0000 mgr.y (mgr.14526) 134 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:11:12.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:11:12 smithi172 bash[23680]: audit 2024-03-30T15:11:10.895279+0000 mgr.y (mgr.14526) 134 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:11:13.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:11:13 smithi072 bash[21573]: cluster 2024-03-30T15:11:11.809478+0000 mgr.y (mgr.14526) 135 : cluster 0 pgmap v84: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:11:13.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:11:13 smithi072 bash[28946]: cluster 2024-03-30T15:11:11.809478+0000 mgr.y (mgr.14526) 135 : cluster 0 pgmap v84: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:11:13.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:11:13 smithi172 bash[23680]: cluster 2024-03-30T15:11:11.809478+0000 mgr.y (mgr.14526) 135 : cluster 0 pgmap v84: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:11:15.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:11:15 smithi072 bash[21573]: cluster 2024-03-30T15:11:13.810126+0000 mgr.y (mgr.14526) 136 : cluster 0 pgmap v85: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:11:15.416 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:11:15 smithi072 bash[28946]: cluster 2024-03-30T15:11:13.810126+0000 mgr.y (mgr.14526) 136 : cluster 0 pgmap v85: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:11:15.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:11:15 smithi172 bash[23680]: cluster 2024-03-30T15:11:13.810126+0000 mgr.y (mgr.14526) 136 : cluster 0 pgmap v85: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:11:16.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:11:16 smithi072 bash[21573]: audit 2024-03-30T15:11:15.175520+0000 mon.c (mon.2) 88 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:11:16.416 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:11:16 smithi072 bash[28946]: audit 2024-03-30T15:11:15.175520+0000 mon.c (mon.2) 88 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:11:16.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:11:16 smithi172 bash[23680]: audit 2024-03-30T15:11:15.175520+0000 mon.c (mon.2) 88 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:11:17.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:11:17 smithi072 bash[21573]: cluster 2024-03-30T15:11:15.811479+0000 mgr.y (mgr.14526) 137 : cluster 0 pgmap v86: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:11:17.416 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:11:17 smithi072 bash[28946]: cluster 2024-03-30T15:11:15.811479+0000 mgr.y (mgr.14526) 137 : cluster 0 pgmap v86: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:11:17.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:11:17 smithi172 bash[23680]: cluster 2024-03-30T15:11:15.811479+0000 mgr.y (mgr.14526) 137 : cluster 0 pgmap v86: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:11:19.416 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:11:19 smithi072 bash[28946]: cluster 2024-03-30T15:11:17.812074+0000 mgr.y (mgr.14526) 138 : cluster 0 pgmap v87: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:11:19.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:11:19 smithi072 bash[21573]: cluster 2024-03-30T15:11:17.812074+0000 mgr.y (mgr.14526) 138 : cluster 0 pgmap v87: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:11:19.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:11:19 smithi172 bash[23680]: cluster 2024-03-30T15:11:17.812074+0000 mgr.y (mgr.14526) 138 : cluster 0 pgmap v87: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:11:21.216 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:11:20 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:11:21.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:11:21 smithi172 bash[23680]: cluster 2024-03-30T15:11:19.812816+0000 mgr.y (mgr.14526) 139 : cluster 0 pgmap v88: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:11:21.416 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:11:21 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:11:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:11:21.416 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:11:21 smithi072 bash[28946]: cluster 2024-03-30T15:11:19.812816+0000 mgr.y (mgr.14526) 139 : cluster 0 pgmap v88: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:11:21.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:11:21 smithi072 bash[21573]: cluster 2024-03-30T15:11:19.812816+0000 mgr.y (mgr.14526) 139 : cluster 0 pgmap v88: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:11:22.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:11:22 smithi072 bash[21573]: audit 2024-03-30T15:11:20.906664+0000 mgr.y (mgr.14526) 140 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:11:22.416 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:11:22 smithi072 bash[28946]: audit 2024-03-30T15:11:20.906664+0000 mgr.y (mgr.14526) 140 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:11:22.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:11:22 smithi172 bash[23680]: audit 2024-03-30T15:11:20.906664+0000 mgr.y (mgr.14526) 140 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:11:23.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:11:23 smithi072 bash[21573]: cluster 2024-03-30T15:11:21.814215+0000 mgr.y (mgr.14526) 141 : cluster 0 pgmap v89: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:11:23.416 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:11:23 smithi072 bash[28946]: cluster 2024-03-30T15:11:21.814215+0000 mgr.y (mgr.14526) 141 : cluster 0 pgmap v89: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:11:23.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:11:23 smithi172 bash[23680]: cluster 2024-03-30T15:11:21.814215+0000 mgr.y (mgr.14526) 141 : cluster 0 pgmap v89: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:11:25.416 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:11:25 smithi072 bash[28946]: cluster 2024-03-30T15:11:23.814830+0000 mgr.y (mgr.14526) 142 : cluster 0 pgmap v90: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:11:25.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:11:25 smithi072 bash[21573]: cluster 2024-03-30T15:11:23.814830+0000 mgr.y (mgr.14526) 142 : cluster 0 pgmap v90: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:11:25.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:11:25 smithi172 bash[23680]: cluster 2024-03-30T15:11:23.814830+0000 mgr.y (mgr.14526) 142 : cluster 0 pgmap v90: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:11:27.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:11:27 smithi072 bash[21573]: cluster 2024-03-30T15:11:25.816247+0000 mgr.y (mgr.14526) 143 : cluster 0 pgmap v91: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:11:27.416 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:11:27 smithi072 bash[28946]: cluster 2024-03-30T15:11:25.816247+0000 mgr.y (mgr.14526) 143 : cluster 0 pgmap v91: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:11:27.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:11:27 smithi172 bash[23680]: cluster 2024-03-30T15:11:25.816247+0000 mgr.y (mgr.14526) 143 : cluster 0 pgmap v91: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:11:29.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:11:29 smithi072 bash[21573]: cluster 2024-03-30T15:11:27.816886+0000 mgr.y (mgr.14526) 144 : cluster 0 pgmap v92: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:11:29.416 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:11:29 smithi072 bash[28946]: cluster 2024-03-30T15:11:27.816886+0000 mgr.y (mgr.14526) 144 : cluster 0 pgmap v92: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:11:29.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:11:29 smithi172 bash[23680]: cluster 2024-03-30T15:11:27.816886+0000 mgr.y (mgr.14526) 144 : cluster 0 pgmap v92: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:11:31.216 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:11:30 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:11:31.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:11:31 smithi172 bash[23680]: cluster 2024-03-30T15:11:29.817447+0000 mgr.y (mgr.14526) 145 : cluster 0 pgmap v93: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:11:31.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:11:31 smithi172 bash[23680]: audit 2024-03-30T15:11:30.205999+0000 mon.c (mon.2) 89 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:11:31.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:11:31 smithi072 bash[21573]: cluster 2024-03-30T15:11:29.817447+0000 mgr.y (mgr.14526) 145 : cluster 0 pgmap v93: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:11:31.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:11:31 smithi072 bash[21573]: audit 2024-03-30T15:11:30.205999+0000 mon.c (mon.2) 89 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:11:31.416 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:11:31 smithi072 bash[28946]: cluster 2024-03-30T15:11:29.817447+0000 mgr.y (mgr.14526) 145 : cluster 0 pgmap v93: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:11:31.416 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:11:31 smithi072 bash[28946]: audit 2024-03-30T15:11:30.205999+0000 mon.c (mon.2) 89 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:11:31.417 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:11:31 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:11:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:11:32.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:11:32 smithi072 bash[21573]: audit 2024-03-30T15:11:30.917896+0000 mgr.y (mgr.14526) 146 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:11:32.416 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:11:32 smithi072 bash[28946]: audit 2024-03-30T15:11:30.917896+0000 mgr.y (mgr.14526) 146 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:11:32.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:11:32 smithi172 bash[23680]: audit 2024-03-30T15:11:30.917896+0000 mgr.y (mgr.14526) 146 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:11:33.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:11:33 smithi072 bash[21573]: cluster 2024-03-30T15:11:31.818245+0000 mgr.y (mgr.14526) 147 : cluster 0 pgmap v94: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:11:33.416 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:11:33 smithi072 bash[28946]: cluster 2024-03-30T15:11:31.818245+0000 mgr.y (mgr.14526) 147 : cluster 0 pgmap v94: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:11:33.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:11:33 smithi172 bash[23680]: cluster 2024-03-30T15:11:31.818245+0000 mgr.y (mgr.14526) 147 : cluster 0 pgmap v94: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:11:35.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:11:35 smithi072 bash[21573]: cluster 2024-03-30T15:11:33.818653+0000 mgr.y (mgr.14526) 148 : cluster 0 pgmap v95: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:11:35.416 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:11:35 smithi072 bash[28946]: cluster 2024-03-30T15:11:33.818653+0000 mgr.y (mgr.14526) 148 : cluster 0 pgmap v95: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:11:35.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:11:35 smithi172 bash[23680]: cluster 2024-03-30T15:11:33.818653+0000 mgr.y (mgr.14526) 148 : cluster 0 pgmap v95: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:11:37.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:11:37 smithi072 bash[21573]: cluster 2024-03-30T15:11:35.819438+0000 mgr.y (mgr.14526) 149 : cluster 0 pgmap v96: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:11:37.416 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:11:37 smithi072 bash[28946]: cluster 2024-03-30T15:11:35.819438+0000 mgr.y (mgr.14526) 149 : cluster 0 pgmap v96: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:11:37.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:11:37 smithi172 bash[23680]: cluster 2024-03-30T15:11:35.819438+0000 mgr.y (mgr.14526) 149 : cluster 0 pgmap v96: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:11:39.416 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:11:39 smithi072 bash[28946]: cluster 2024-03-30T15:11:37.819855+0000 mgr.y (mgr.14526) 150 : cluster 0 pgmap v97: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T15:11:39.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:11:39 smithi072 bash[21573]: cluster 2024-03-30T15:11:37.819855+0000 mgr.y (mgr.14526) 150 : cluster 0 pgmap v97: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T15:11:39.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:11:39 smithi172 bash[23680]: cluster 2024-03-30T15:11:37.819855+0000 mgr.y (mgr.14526) 150 : cluster 0 pgmap v97: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T15:11:41.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:11:41 smithi172 bash[23680]: cluster 2024-03-30T15:11:39.820245+0000 mgr.y (mgr.14526) 151 : cluster 0 pgmap v98: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T15:11:41.216 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:11:40 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:11:41.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:11:41 smithi072 bash[21573]: cluster 2024-03-30T15:11:39.820245+0000 mgr.y (mgr.14526) 151 : cluster 0 pgmap v98: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T15:11:41.416 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:11:41 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:11:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:11:41.416 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:11:41 smithi072 bash[28946]: cluster 2024-03-30T15:11:39.820245+0000 mgr.y (mgr.14526) 151 : cluster 0 pgmap v98: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T15:11:42.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:11:42 smithi072 bash[21573]: audit 2024-03-30T15:11:40.928762+0000 mgr.y (mgr.14526) 152 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:11:42.416 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:11:42 smithi072 bash[28946]: audit 2024-03-30T15:11:40.928762+0000 mgr.y (mgr.14526) 152 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:11:42.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:11:42 smithi172 bash[23680]: audit 2024-03-30T15:11:40.928762+0000 mgr.y (mgr.14526) 152 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:11:43.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:11:43 smithi072 bash[21573]: cluster 2024-03-30T15:11:41.821009+0000 mgr.y (mgr.14526) 153 : cluster 0 pgmap v99: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:11:43.416 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:11:43 smithi072 bash[28946]: cluster 2024-03-30T15:11:41.821009+0000 mgr.y (mgr.14526) 153 : cluster 0 pgmap v99: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:11:43.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:11:43 smithi172 bash[23680]: cluster 2024-03-30T15:11:41.821009+0000 mgr.y (mgr.14526) 153 : cluster 0 pgmap v99: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:11:45.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:11:45 smithi072 bash[21573]: cluster 2024-03-30T15:11:43.821427+0000 mgr.y (mgr.14526) 154 : cluster 0 pgmap v100: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T15:11:45.416 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:11:45 smithi072 bash[28946]: cluster 2024-03-30T15:11:43.821427+0000 mgr.y (mgr.14526) 154 : cluster 0 pgmap v100: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T15:11:45.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:11:45 smithi172 bash[23680]: cluster 2024-03-30T15:11:43.821427+0000 mgr.y (mgr.14526) 154 : cluster 0 pgmap v100: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T15:11:46.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:11:46 smithi172 bash[23680]: audit 2024-03-30T15:11:45.218061+0000 mon.c (mon.2) 90 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:11:46.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:11:46 smithi072 bash[21573]: audit 2024-03-30T15:11:45.218061+0000 mon.c (mon.2) 90 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:11:46.666 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:11:46 smithi072 bash[28946]: audit 2024-03-30T15:11:45.218061+0000 mon.c (mon.2) 90 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:11:47.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:11:47 smithi172 bash[23680]: cluster 2024-03-30T15:11:45.822200+0000 mgr.y (mgr.14526) 155 : cluster 0 pgmap v101: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:11:47.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:11:47 smithi072 bash[21573]: cluster 2024-03-30T15:11:45.822200+0000 mgr.y (mgr.14526) 155 : cluster 0 pgmap v101: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:11:47.666 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:11:47 smithi072 bash[28946]: cluster 2024-03-30T15:11:45.822200+0000 mgr.y (mgr.14526) 155 : cluster 0 pgmap v101: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:11:49.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:11:49 smithi172 bash[23680]: cluster 2024-03-30T15:11:47.822877+0000 mgr.y (mgr.14526) 156 : cluster 0 pgmap v102: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T15:11:49.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:11:49 smithi072 bash[21573]: cluster 2024-03-30T15:11:47.822877+0000 mgr.y (mgr.14526) 156 : cluster 0 pgmap v102: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T15:11:49.666 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:11:49 smithi072 bash[28946]: cluster 2024-03-30T15:11:47.822877+0000 mgr.y (mgr.14526) 156 : cluster 0 pgmap v102: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T15:11:50.476 INFO:tasks.workunit.client.0.smithi072.stderr:Note: switching to '5af0400050a123dc31f105425174f106e057276a'. 2024-03-30T15:11:50.476 INFO:tasks.workunit.client.0.smithi072.stderr: 2024-03-30T15:11:50.476 INFO:tasks.workunit.client.0.smithi072.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-30T15:11:50.476 INFO:tasks.workunit.client.0.smithi072.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-30T15:11:50.476 INFO:tasks.workunit.client.0.smithi072.stderr:state without impacting any branches by switching back to a branch. 2024-03-30T15:11:50.476 INFO:tasks.workunit.client.0.smithi072.stderr: 2024-03-30T15:11:50.476 INFO:tasks.workunit.client.0.smithi072.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-30T15:11:50.476 INFO:tasks.workunit.client.0.smithi072.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-30T15:11:50.476 INFO:tasks.workunit.client.0.smithi072.stderr: 2024-03-30T15:11:50.476 INFO:tasks.workunit.client.0.smithi072.stderr: git switch -c 2024-03-30T15:11:50.476 INFO:tasks.workunit.client.0.smithi072.stderr: 2024-03-30T15:11:50.476 INFO:tasks.workunit.client.0.smithi072.stderr:Or undo this operation with: 2024-03-30T15:11:50.476 INFO:tasks.workunit.client.0.smithi072.stderr: 2024-03-30T15:11:50.476 INFO:tasks.workunit.client.0.smithi072.stderr: git switch - 2024-03-30T15:11:50.477 INFO:tasks.workunit.client.0.smithi072.stderr: 2024-03-30T15:11:50.477 INFO:tasks.workunit.client.0.smithi072.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-30T15:11:50.477 INFO:tasks.workunit.client.0.smithi072.stderr: 2024-03-30T15:11:50.477 INFO:tasks.workunit.client.0.smithi072.stderr:HEAD is now at 5af0400050a Merge pull request #56547 from rhcs-dashboard/wip-65193-squid 2024-03-30T15:11:50.481 DEBUG:teuthology.orchestra.run.smithi072:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-30T15:11:50.528 INFO:tasks.workunit.client.0.smithi072.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-30T15:11:50.531 INFO:tasks.workunit.client.0.smithi072.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-30T15:11:50.531 INFO:tasks.workunit.client.0.smithi072.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-30T15:11:51.216 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:11:50 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:11:51.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:11:51 smithi172 bash[23680]: cluster 2024-03-30T15:11:49.823364+0000 mgr.y (mgr.14526) 157 : cluster 0 pgmap v103: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T15:11:51.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:11:51 smithi072 bash[21573]: cluster 2024-03-30T15:11:49.823364+0000 mgr.y (mgr.14526) 157 : cluster 0 pgmap v103: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T15:11:51.416 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:11:51 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:11:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:11:51.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:11:51 smithi072 bash[28946]: cluster 2024-03-30T15:11:49.823364+0000 mgr.y (mgr.14526) 157 : cluster 0 pgmap v103: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T15:11:51.571 INFO:tasks.workunit.client.0.smithi072.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-30T15:11:51.692 INFO:tasks.workunit.client.0.smithi072.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-30T15:11:51.755 INFO:tasks.workunit.client.0.smithi072.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-30T15:11:51.757 INFO:tasks.workunit.client.0.smithi072.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-30T15:11:51.757 INFO:tasks.workunit.client.0.smithi072.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-30T15:11:51.807 INFO:tasks.workunit.client.0.smithi072.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-30T15:11:51.811 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-30T15:11:51.811 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-30T15:11:51.860 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2024-03-30T15:11:51.861 INFO:tasks.workunit:Running workunit rados/test.sh... 2024-03-30T15:11:51.861 DEBUG:teuthology.orchestra.run.smithi072:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5af0400050a123dc31f105425174f106e057276a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh 2024-03-30T15:11:51.913 INFO:tasks.workunit.client.0.smithi072.stderr:+ parallel=1 2024-03-30T15:11:51.913 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' '' = --serial ']' 2024-03-30T15:11:51.913 INFO:tasks.workunit.client.0.smithi072.stderr:+ crimson=0 2024-03-30T15:11:51.913 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' '' = --crimson ']' 2024-03-30T15:11:51.913 INFO:tasks.workunit.client.0.smithi072.stderr:+ color= 2024-03-30T15:11:51.913 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' -t 1 ']' 2024-03-30T15:11:51.913 INFO:tasks.workunit.client.0.smithi072.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2024-03-30T15:11:51.913 INFO:tasks.workunit.client.0.smithi072.stderr:+ GTEST_OUTPUT_DIR=/home/ubuntu/cephtest/archive/unit_test_xml_report 2024-03-30T15:11:51.913 INFO:tasks.workunit.client.0.smithi072.stderr:+ mkdir -p /home/ubuntu/cephtest/archive/unit_test_xml_report 2024-03-30T15:11:51.914 INFO:tasks.workunit.client.0.smithi072.stderr:+ declare -A pids 2024-03-30T15:11:51.914 INFO:tasks.workunit.client.0.smithi072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-30T15:11:51.914 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' 1 -eq 1 ']' 2024-03-30T15:11:51.914 INFO:tasks.workunit.client.0.smithi072.stderr:++ printf %25s api_aio 2024-03-30T15:11:51.915 INFO:tasks.workunit.client.0.smithi072.stderr:+ r=' api_aio' 2024-03-30T15:11:51.915 INFO:tasks.workunit.client.0.smithi072.stderr:++ echo api_aio 2024-03-30T15:11:51.915 INFO:tasks.workunit.client.0.smithi072.stderr:++ awk '{print $1}' 2024-03-30T15:11:51.917 INFO:tasks.workunit.client.0.smithi072.stderr:+ ff=api_aio 2024-03-30T15:11:51.917 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64158 2024-03-30T15:11:51.918 INFO:tasks.workunit.client.0.smithi072.stderr:+ echo 'test api_aio on pid 64158' 2024-03-30T15:11:51.918 INFO:tasks.workunit.client.0.smithi072.stdout:test api_aio on pid 64158 2024-03-30T15:11:51.919 INFO:tasks.workunit.client.0.smithi072.stderr:+ pids[$f]=64158 2024-03-30T15:11:51.919 INFO:tasks.workunit.client.0.smithi072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio.xml 2>&1 | tee ceph_test_rados_api_aio.log | sed "s/^/ api_aio: /"' 2024-03-30T15:11:51.919 INFO:tasks.workunit.client.0.smithi072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-30T15:11:51.919 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' 1 -eq 1 ']' 2024-03-30T15:11:51.920 INFO:tasks.workunit.client.0.smithi072.stderr:++ printf %25s api_aio_pp 2024-03-30T15:11:51.920 INFO:tasks.workunit.client.0.smithi072.stderr:+ r=' api_aio_pp' 2024-03-30T15:11:51.920 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' -z '' ']' 2024-03-30T15:11:51.920 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:51.920 INFO:tasks.workunit.client.0.smithi072.stderr:+ case $- in 2024-03-30T15:11:51.920 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:51.920 INFO:tasks.workunit.client.0.smithi072.stderr:++ echo api_aio_pp 2024-03-30T15:11:51.920 INFO:tasks.workunit.client.0.smithi072.stderr:++ awk '{print $1}' 2024-03-30T15:11:51.920 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio.xml 2024-03-30T15:11:51.920 INFO:tasks.workunit.client.0.smithi072.stderr:+ tee ceph_test_rados_api_aio.log 2024-03-30T15:11:51.920 INFO:tasks.workunit.client.0.smithi072.stderr:+ sed 's/^/ api_aio: /' 2024-03-30T15:11:51.921 INFO:tasks.workunit.client.0.smithi072.stderr:+ ff=api_aio_pp 2024-03-30T15:11:51.921 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64166 2024-03-30T15:11:51.921 INFO:tasks.workunit.client.0.smithi072.stderr:+ echo 'test api_aio_pp on pid 64166' 2024-03-30T15:11:51.921 INFO:tasks.workunit.client.0.smithi072.stdout:test api_aio_pp on pid 64166 2024-03-30T15:11:51.923 INFO:tasks.workunit.client.0.smithi072.stderr:+ pids[$f]=64166 2024-03-30T15:11:51.923 INFO:tasks.workunit.client.0.smithi072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-30T15:11:51.923 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' 1 -eq 1 ']' 2024-03-30T15:11:51.923 INFO:tasks.workunit.client.0.smithi072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio_pp.xml 2>&1 | tee ceph_test_rados_api_aio_pp.log | sed "s/^/ api_aio_pp: /"' 2024-03-30T15:11:51.923 INFO:tasks.workunit.client.0.smithi072.stderr:++ printf %25s api_io 2024-03-30T15:11:51.923 INFO:tasks.workunit.client.0.smithi072.stderr:+ r=' api_io' 2024-03-30T15:11:51.923 INFO:tasks.workunit.client.0.smithi072.stderr:++ echo api_io 2024-03-30T15:11:51.923 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' -z '' ']' 2024-03-30T15:11:51.923 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:51.923 INFO:tasks.workunit.client.0.smithi072.stderr:+ case $- in 2024-03-30T15:11:51.923 INFO:tasks.workunit.client.0.smithi072.stderr:++ awk '{print $1}' 2024-03-30T15:11:51.923 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:51.924 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio_pp.xml 2024-03-30T15:11:51.924 INFO:tasks.workunit.client.0.smithi072.stderr:+ tee ceph_test_rados_api_aio_pp.log 2024-03-30T15:11:51.924 INFO:tasks.workunit.client.0.smithi072.stderr:+ sed 's/^/ api_aio_pp: /' 2024-03-30T15:11:51.924 INFO:tasks.workunit.client.0.smithi072.stderr:+ ff=api_io 2024-03-30T15:11:51.924 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64174 2024-03-30T15:11:51.925 INFO:tasks.workunit.client.0.smithi072.stderr:+ echo 'test api_io on pid 64174' 2024-03-30T15:11:51.925 INFO:tasks.workunit.client.0.smithi072.stdout:test api_io on pid 64174 2024-03-30T15:11:51.926 INFO:tasks.workunit.client.0.smithi072.stderr:+ pids[$f]=64174 2024-03-30T15:11:51.926 INFO:tasks.workunit.client.0.smithi072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io.xml 2>&1 | tee ceph_test_rados_api_io.log | sed "s/^/ api_io: /"' 2024-03-30T15:11:51.926 INFO:tasks.workunit.client.0.smithi072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-30T15:11:51.926 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' 1 -eq 1 ']' 2024-03-30T15:11:51.926 INFO:tasks.workunit.client.0.smithi072.stderr:++ printf %25s api_io_pp 2024-03-30T15:11:51.926 INFO:tasks.workunit.client.0.smithi072.stderr:+ r=' api_io_pp' 2024-03-30T15:11:51.926 INFO:tasks.workunit.client.0.smithi072.stderr:++ echo api_io_pp 2024-03-30T15:11:51.926 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' -z '' ']' 2024-03-30T15:11:51.927 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:51.927 INFO:tasks.workunit.client.0.smithi072.stderr:+ case $- in 2024-03-30T15:11:51.927 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:51.927 INFO:tasks.workunit.client.0.smithi072.stderr:++ awk '{print $1}' 2024-03-30T15:11:51.927 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io.xml 2024-03-30T15:11:51.927 INFO:tasks.workunit.client.0.smithi072.stderr:+ tee ceph_test_rados_api_io.log 2024-03-30T15:11:51.927 INFO:tasks.workunit.client.0.smithi072.stderr:+ sed 's/^/ api_io: /' 2024-03-30T15:11:51.928 INFO:tasks.workunit.client.0.smithi072.stderr:+ ff=api_io_pp 2024-03-30T15:11:51.928 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64182 2024-03-30T15:11:51.928 INFO:tasks.workunit.client.0.smithi072.stderr:+ echo 'test api_io_pp on pid 64182' 2024-03-30T15:11:51.929 INFO:tasks.workunit.client.0.smithi072.stdout:test api_io_pp on pid 64182 2024-03-30T15:11:51.930 INFO:tasks.workunit.client.0.smithi072.stderr:+ pids[$f]=64182 2024-03-30T15:11:51.930 INFO:tasks.workunit.client.0.smithi072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-30T15:11:51.930 INFO:tasks.workunit.client.0.smithi072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io_pp.xml 2>&1 | tee ceph_test_rados_api_io_pp.log | sed "s/^/ api_io_pp: /"' 2024-03-30T15:11:51.930 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' 1 -eq 1 ']' 2024-03-30T15:11:51.930 INFO:tasks.workunit.client.0.smithi072.stderr:++ printf %25s api_asio 2024-03-30T15:11:51.930 INFO:tasks.workunit.client.0.smithi072.stderr:+ r=' api_asio' 2024-03-30T15:11:51.930 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' -z '' ']' 2024-03-30T15:11:51.930 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:51.930 INFO:tasks.workunit.client.0.smithi072.stderr:+ case $- in 2024-03-30T15:11:51.930 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:51.930 INFO:tasks.workunit.client.0.smithi072.stderr:++ echo api_asio 2024-03-30T15:11:51.931 INFO:tasks.workunit.client.0.smithi072.stderr:++ awk '{print $1}' 2024-03-30T15:11:51.931 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io_pp.xml 2024-03-30T15:11:51.931 INFO:tasks.workunit.client.0.smithi072.stderr:+ sed 's/^/ api_io_pp: /' 2024-03-30T15:11:51.931 INFO:tasks.workunit.client.0.smithi072.stderr:+ tee ceph_test_rados_api_io_pp.log 2024-03-30T15:11:51.932 INFO:tasks.workunit.client.0.smithi072.stderr:+ ff=api_asio 2024-03-30T15:11:51.933 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64190 2024-03-30T15:11:51.933 INFO:tasks.workunit.client.0.smithi072.stdout:test api_asio on pid 64190 2024-03-30T15:11:51.934 INFO:tasks.workunit.client.0.smithi072.stderr:+ echo 'test api_asio on pid 64190' 2024-03-30T15:11:51.934 INFO:tasks.workunit.client.0.smithi072.stderr:+ pids[$f]=64190 2024-03-30T15:11:51.934 INFO:tasks.workunit.client.0.smithi072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-30T15:11:51.934 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' 1 -eq 1 ']' 2024-03-30T15:11:51.934 INFO:tasks.workunit.client.0.smithi072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_asio.xml 2>&1 | tee ceph_test_rados_api_asio.log | sed "s/^/ api_asio: /"' 2024-03-30T15:11:51.934 INFO:tasks.workunit.client.0.smithi072.stderr:++ printf %25s api_list 2024-03-30T15:11:51.934 INFO:tasks.workunit.client.0.smithi072.stderr:+ r=' api_list' 2024-03-30T15:11:51.934 INFO:tasks.workunit.client.0.smithi072.stderr:++ echo api_list 2024-03-30T15:11:51.934 INFO:tasks.workunit.client.0.smithi072.stderr:++ awk '{print $1}' 2024-03-30T15:11:51.935 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' -z '' ']' 2024-03-30T15:11:51.935 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:51.935 INFO:tasks.workunit.client.0.smithi072.stderr:+ case $- in 2024-03-30T15:11:51.935 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:51.935 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_asio.xml 2024-03-30T15:11:51.935 INFO:tasks.workunit.client.0.smithi072.stderr:+ tee ceph_test_rados_api_asio.log 2024-03-30T15:11:51.935 INFO:tasks.workunit.client.0.smithi072.stderr:+ sed 's/^/ api_asio: /' 2024-03-30T15:11:51.936 INFO:tasks.workunit.client.0.smithi072.stderr:+ ff=api_list 2024-03-30T15:11:51.937 INFO:tasks.workunit.client.0.smithi072.stdout:test api_list on pid 64198 2024-03-30T15:11:51.937 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64198 2024-03-30T15:11:51.937 INFO:tasks.workunit.client.0.smithi072.stderr:+ echo 'test api_list on pid 64198' 2024-03-30T15:11:51.937 INFO:tasks.workunit.client.0.smithi072.stderr:+ pids[$f]=64198 2024-03-30T15:11:51.938 INFO:tasks.workunit.client.0.smithi072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-30T15:11:51.938 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' 1 -eq 1 ']' 2024-03-30T15:11:51.938 INFO:tasks.workunit.client.0.smithi072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_list.xml 2>&1 | tee ceph_test_rados_api_list.log | sed "s/^/ api_list: /"' 2024-03-30T15:11:51.938 INFO:tasks.workunit.client.0.smithi072.stderr:++ printf %25s api_lock 2024-03-30T15:11:51.938 INFO:tasks.workunit.client.0.smithi072.stderr:+ r=' api_lock' 2024-03-30T15:11:51.939 INFO:tasks.workunit.client.0.smithi072.stderr:++ echo api_lock 2024-03-30T15:11:51.939 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' -z '' ']' 2024-03-30T15:11:51.939 INFO:tasks.workunit.client.0.smithi072.stderr:++ awk '{print $1}' 2024-03-30T15:11:51.939 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:51.939 INFO:tasks.workunit.client.0.smithi072.stderr:+ case $- in 2024-03-30T15:11:51.939 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:51.939 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_list.xml 2024-03-30T15:11:51.939 INFO:tasks.workunit.client.0.smithi072.stderr:+ tee ceph_test_rados_api_list.log 2024-03-30T15:11:51.940 INFO:tasks.workunit.client.0.smithi072.stderr:+ sed 's/^/ api_list: /' 2024-03-30T15:11:51.941 INFO:tasks.workunit.client.0.smithi072.stdout:test api_lock on pid 64206 2024-03-30T15:11:51.941 INFO:tasks.workunit.client.0.smithi072.stderr:+ ff=api_lock 2024-03-30T15:11:51.942 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64206 2024-03-30T15:11:51.942 INFO:tasks.workunit.client.0.smithi072.stderr:+ echo 'test api_lock on pid 64206' 2024-03-30T15:11:51.942 INFO:tasks.workunit.client.0.smithi072.stderr:+ pids[$f]=64206 2024-03-30T15:11:51.942 INFO:tasks.workunit.client.0.smithi072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-30T15:11:51.942 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' 1 -eq 1 ']' 2024-03-30T15:11:51.942 INFO:tasks.workunit.client.0.smithi072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock.xml 2>&1 | tee ceph_test_rados_api_lock.log | sed "s/^/ api_lock: /"' 2024-03-30T15:11:51.942 INFO:tasks.workunit.client.0.smithi072.stderr:++ printf %25s api_lock_pp 2024-03-30T15:11:51.942 INFO:tasks.workunit.client.0.smithi072.stderr:+ r=' api_lock_pp' 2024-03-30T15:11:51.943 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' -z '' ']' 2024-03-30T15:11:51.943 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:51.943 INFO:tasks.workunit.client.0.smithi072.stderr:++ echo api_lock_pp 2024-03-30T15:11:51.943 INFO:tasks.workunit.client.0.smithi072.stderr:+ case $- in 2024-03-30T15:11:51.943 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:51.944 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock.xml 2024-03-30T15:11:51.944 INFO:tasks.workunit.client.0.smithi072.stderr:+ tee ceph_test_rados_api_lock.log 2024-03-30T15:11:51.959 INFO:tasks.workunit.client.0.smithi072.stderr:++ awk '{print $1}' 2024-03-30T15:11:51.959 INFO:tasks.workunit.client.0.smithi072.stderr:+ sed 's/^/ api_lock: /' 2024-03-30T15:11:51.961 INFO:tasks.workunit.client.0.smithi072.stderr:+ ff=api_lock_pp 2024-03-30T15:11:51.961 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64229 2024-03-30T15:11:51.961 INFO:tasks.workunit.client.0.smithi072.stdout:test api_lock_pp on pid 64229 2024-03-30T15:11:51.962 INFO:tasks.workunit.client.0.smithi072.stderr:+ echo 'test api_lock_pp on pid 64229' 2024-03-30T15:11:51.962 INFO:tasks.workunit.client.0.smithi072.stderr:+ pids[$f]=64229 2024-03-30T15:11:51.962 INFO:tasks.workunit.client.0.smithi072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-30T15:11:51.962 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' 1 -eq 1 ']' 2024-03-30T15:11:51.963 INFO:tasks.workunit.client.0.smithi072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock_pp.xml 2>&1 | tee ceph_test_rados_api_lock_pp.log | sed "s/^/ api_lock_pp: /"' 2024-03-30T15:11:51.967 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' -z '' ']' 2024-03-30T15:11:51.967 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:51.967 INFO:tasks.workunit.client.0.smithi072.stderr:+ case $- in 2024-03-30T15:11:51.967 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:51.967 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock_pp.xml 2024-03-30T15:11:51.967 INFO:tasks.workunit.client.0.smithi072.stderr:+ tee ceph_test_rados_api_lock_pp.log 2024-03-30T15:11:51.967 INFO:tasks.workunit.client.0.smithi072.stderr:+ sed 's/^/ api_lock_pp: /' 2024-03-30T15:11:51.973 INFO:tasks.workunit.client.0.smithi072.stderr:++ printf %25s api_misc 2024-03-30T15:11:51.974 INFO:tasks.workunit.client.0.smithi072.stderr:+ r=' api_misc' 2024-03-30T15:11:51.974 INFO:tasks.workunit.client.0.smithi072.stderr:++ echo api_misc 2024-03-30T15:11:51.975 INFO:tasks.workunit.client.0.smithi072.stderr:++ awk '{print $1}' 2024-03-30T15:11:51.977 INFO:tasks.workunit.client.0.smithi072.stdout:test api_misc on pid 64292 2024-03-30T15:11:51.978 INFO:tasks.workunit.client.0.smithi072.stderr:+ ff=api_misc 2024-03-30T15:11:51.978 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64292 2024-03-30T15:11:51.978 INFO:tasks.workunit.client.0.smithi072.stderr:+ echo 'test api_misc on pid 64292' 2024-03-30T15:11:51.978 INFO:tasks.workunit.client.0.smithi072.stderr:+ pids[$f]=64292 2024-03-30T15:11:51.978 INFO:tasks.workunit.client.0.smithi072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-30T15:11:51.978 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' 1 -eq 1 ']' 2024-03-30T15:11:51.978 INFO:tasks.workunit.client.0.smithi072.stderr:++ printf %25s api_misc_pp 2024-03-30T15:11:51.979 INFO:tasks.workunit.client.0.smithi072.stderr:+ r=' api_misc_pp' 2024-03-30T15:11:51.979 INFO:tasks.workunit.client.0.smithi072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc.xml 2>&1 | tee ceph_test_rados_api_misc.log | sed "s/^/ api_misc: /"' 2024-03-30T15:11:51.980 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' -z '' ']' 2024-03-30T15:11:51.980 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:51.980 INFO:tasks.workunit.client.0.smithi072.stderr:+ case $- in 2024-03-30T15:11:51.980 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:51.981 INFO:tasks.workunit.client.0.smithi072.stderr:+ sed 's/^/ api_misc: /' 2024-03-30T15:11:51.982 INFO:tasks.workunit.client.0.smithi072.stderr:+ tee ceph_test_rados_api_misc.log 2024-03-30T15:11:51.983 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc.xml 2024-03-30T15:11:51.983 INFO:tasks.workunit.client.0.smithi072.stderr:++ echo api_misc_pp 2024-03-30T15:11:51.984 INFO:tasks.workunit.client.0.smithi072.stderr:++ awk '{print $1}' 2024-03-30T15:11:51.986 INFO:tasks.workunit.client.0.smithi072.stdout:test api_misc_pp on pid 64309 2024-03-30T15:11:51.987 INFO:tasks.workunit.client.0.smithi072.stderr:+ ff=api_misc_pp 2024-03-30T15:11:51.987 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64309 2024-03-30T15:11:51.987 INFO:tasks.workunit.client.0.smithi072.stderr:+ echo 'test api_misc_pp on pid 64309' 2024-03-30T15:11:51.987 INFO:tasks.workunit.client.0.smithi072.stderr:+ pids[$f]=64309 2024-03-30T15:11:51.987 INFO:tasks.workunit.client.0.smithi072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-30T15:11:51.987 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' 1 -eq 1 ']' 2024-03-30T15:11:51.987 INFO:tasks.workunit.client.0.smithi072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc_pp.xml 2>&1 | tee ceph_test_rados_api_misc_pp.log | sed "s/^/ api_misc_pp: /"' 2024-03-30T15:11:51.987 INFO:tasks.workunit.client.0.smithi072.stderr:++ printf %25s api_tier_pp 2024-03-30T15:11:51.987 INFO:tasks.workunit.client.0.smithi072.stderr:+ r=' api_tier_pp' 2024-03-30T15:11:51.988 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' -z '' ']' 2024-03-30T15:11:51.989 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:51.989 INFO:tasks.workunit.client.0.smithi072.stderr:+ case $- in 2024-03-30T15:11:51.989 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:51.989 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc_pp.xml 2024-03-30T15:11:51.993 INFO:tasks.workunit.client.0.smithi072.stderr:+ tee ceph_test_rados_api_misc_pp.log 2024-03-30T15:11:52.002 INFO:tasks.workunit.client.0.smithi072.stderr:++ awk '{print $1}' 2024-03-30T15:11:52.003 INFO:tasks.workunit.client.0.smithi072.stderr:+ sed 's/^/ api_misc_pp: /' 2024-03-30T15:11:52.003 INFO:tasks.workunit.client.0.smithi072.stderr:++ echo api_tier_pp 2024-03-30T15:11:52.004 INFO:tasks.workunit.client.0.smithi072.stderr:+ ff=api_tier_pp 2024-03-30T15:11:52.004 INFO:tasks.workunit.client.0.smithi072.stdout:test api_tier_pp on pid 64339 2024-03-30T15:11:52.004 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64339 2024-03-30T15:11:52.004 INFO:tasks.workunit.client.0.smithi072.stderr:+ echo 'test api_tier_pp on pid 64339' 2024-03-30T15:11:52.004 INFO:tasks.workunit.client.0.smithi072.stderr:+ pids[$f]=64339 2024-03-30T15:11:52.004 INFO:tasks.workunit.client.0.smithi072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-30T15:11:52.004 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' 1 -eq 1 ']' 2024-03-30T15:11:52.005 INFO:tasks.workunit.client.0.smithi072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_tier_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_tier_pp.xml 2>&1 | tee ceph_test_rados_api_tier_pp.log | sed "s/^/ api_tier_pp: /"' 2024-03-30T15:11:52.006 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' -z '' ']' 2024-03-30T15:11:52.006 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.006 INFO:tasks.workunit.client.0.smithi072.stderr:+ case $- in 2024-03-30T15:11:52.006 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.006 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph_test_rados_api_tier_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_tier_pp.xml 2024-03-30T15:11:52.006 INFO:tasks.workunit.client.0.smithi072.stderr:+ tee ceph_test_rados_api_tier_pp.log 2024-03-30T15:11:52.006 INFO:tasks.workunit.client.0.smithi072.stderr:+ sed 's/^/ api_tier_pp: /' 2024-03-30T15:11:52.011 INFO:tasks.workunit.client.0.smithi072.stderr:++ printf %25s api_pool 2024-03-30T15:11:52.011 INFO:tasks.workunit.client.0.smithi072.stderr:+ r=' api_pool' 2024-03-30T15:11:52.012 INFO:tasks.workunit.client.0.smithi072.stderr:++ echo api_pool 2024-03-30T15:11:52.012 INFO:tasks.workunit.client.0.smithi072.stderr:++ awk '{print $1}' 2024-03-30T15:11:52.014 INFO:tasks.workunit.client.0.smithi072.stderr:+ ff=api_pool 2024-03-30T15:11:52.014 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64357 2024-03-30T15:11:52.014 INFO:tasks.workunit.client.0.smithi072.stderr:+ echo 'test api_pool on pid 64357' 2024-03-30T15:11:52.015 INFO:tasks.workunit.client.0.smithi072.stdout:test api_pool on pid 64357 2024-03-30T15:11:52.015 INFO:tasks.workunit.client.0.smithi072.stderr:+ pids[$f]=64357 2024-03-30T15:11:52.015 INFO:tasks.workunit.client.0.smithi072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-30T15:11:52.016 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' 1 -eq 1 ']' 2024-03-30T15:11:52.016 INFO:tasks.workunit.client.0.smithi072.stderr:++ printf %25s api_snapshots 2024-03-30T15:11:52.016 INFO:tasks.workunit.client.0.smithi072.stderr:+ r=' api_snapshots' 2024-03-30T15:11:52.016 INFO:tasks.workunit.client.0.smithi072.stderr:++ echo api_snapshots 2024-03-30T15:11:52.016 INFO:tasks.workunit.client.0.smithi072.stderr:++ awk '{print $1}' 2024-03-30T15:11:52.018 INFO:tasks.workunit.client.0.smithi072.stderr:+ ff=api_snapshots 2024-03-30T15:11:52.018 INFO:tasks.workunit.client.0.smithi072.stdout:test api_snapshots on pid 64371 2024-03-30T15:11:52.019 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64371 2024-03-30T15:11:52.019 INFO:tasks.workunit.client.0.smithi072.stderr:+ echo 'test api_snapshots on pid 64371' 2024-03-30T15:11:52.019 INFO:tasks.workunit.client.0.smithi072.stderr:+ pids[$f]=64371 2024-03-30T15:11:52.019 INFO:tasks.workunit.client.0.smithi072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-30T15:11:52.019 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' 1 -eq 1 ']' 2024-03-30T15:11:52.019 INFO:tasks.workunit.client.0.smithi072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots.xml 2>&1 | tee ceph_test_rados_api_snapshots.log | sed "s/^/ api_snapshots: /"' 2024-03-30T15:11:52.019 INFO:tasks.workunit.client.0.smithi072.stderr:++ printf %25s api_snapshots_pp 2024-03-30T15:11:52.019 INFO:tasks.workunit.client.0.smithi072.stderr:+ r=' api_snapshots_pp' 2024-03-30T15:11:52.020 INFO:tasks.workunit.client.0.smithi072.stderr:++ echo api_snapshots_pp 2024-03-30T15:11:52.021 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' -z '' ']' 2024-03-30T15:11:52.021 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.021 INFO:tasks.workunit.client.0.smithi072.stderr:+ case $- in 2024-03-30T15:11:52.021 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.021 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots.xml 2024-03-30T15:11:52.021 INFO:tasks.workunit.client.0.smithi072.stderr:+ tee ceph_test_rados_api_snapshots.log 2024-03-30T15:11:52.023 INFO:tasks.workunit.client.0.smithi072.stderr:++ awk '{print $1}' 2024-03-30T15:11:52.023 INFO:tasks.workunit.client.0.smithi072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_pool.xml 2>&1 | tee ceph_test_rados_api_pool.log | sed "s/^/ api_pool: /"' 2024-03-30T15:11:52.023 INFO:tasks.workunit.client.0.smithi072.stderr:+ sed 's/^/ api_snapshots: /' 2024-03-30T15:11:52.024 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' -z '' ']' 2024-03-30T15:11:52.024 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.025 INFO:tasks.workunit.client.0.smithi072.stderr:+ case $- in 2024-03-30T15:11:52.025 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.025 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_pool.xml 2024-03-30T15:11:52.025 INFO:tasks.workunit.client.0.smithi072.stderr:+ ff=api_snapshots_pp 2024-03-30T15:11:52.025 INFO:tasks.workunit.client.0.smithi072.stdout:test api_snapshots_pp on pid 64384 2024-03-30T15:11:52.026 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64384 2024-03-30T15:11:52.026 INFO:tasks.workunit.client.0.smithi072.stderr:+ echo 'test api_snapshots_pp on pid 64384' 2024-03-30T15:11:52.026 INFO:tasks.workunit.client.0.smithi072.stderr:+ pids[$f]=64384 2024-03-30T15:11:52.026 INFO:tasks.workunit.client.0.smithi072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-30T15:11:52.026 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' 1 -eq 1 ']' 2024-03-30T15:11:52.026 INFO:tasks.workunit.client.0.smithi072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots_pp.xml 2>&1 | tee ceph_test_rados_api_snapshots_pp.log | sed "s/^/ api_snapshots_pp: /"' 2024-03-30T15:11:52.027 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' -z '' ']' 2024-03-30T15:11:52.027 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.027 INFO:tasks.workunit.client.0.smithi072.stderr:+ case $- in 2024-03-30T15:11:52.027 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.027 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots_pp.xml 2024-03-30T15:11:52.027 INFO:tasks.workunit.client.0.smithi072.stderr:+ sed 's/^/ api_snapshots_pp: /' 2024-03-30T15:11:52.028 INFO:tasks.workunit.client.0.smithi072.stderr:+ tee ceph_test_rados_api_pool.log 2024-03-30T15:11:52.029 INFO:tasks.workunit.client.0.smithi072.stderr:+ tee ceph_test_rados_api_snapshots_pp.log 2024-03-30T15:11:52.030 INFO:tasks.workunit.client.0.smithi072.stderr:++ printf %25s api_stat 2024-03-30T15:11:52.030 INFO:tasks.workunit.client.0.smithi072.stderr:+ r=' api_stat' 2024-03-30T15:11:52.031 INFO:tasks.workunit.client.0.smithi072.stderr:++ echo api_stat 2024-03-30T15:11:52.031 INFO:tasks.workunit.client.0.smithi072.stderr:++ awk '{print $1}' 2024-03-30T15:11:52.032 INFO:tasks.workunit.client.0.smithi072.stderr:+ sed 's/^/ api_pool: /' 2024-03-30T15:11:52.033 INFO:tasks.workunit.client.0.smithi072.stderr:+ ff=api_stat 2024-03-30T15:11:52.034 INFO:tasks.workunit.client.0.smithi072.stdout:test api_stat on pid 64396 2024-03-30T15:11:52.034 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64396 2024-03-30T15:11:52.034 INFO:tasks.workunit.client.0.smithi072.stderr:+ echo 'test api_stat on pid 64396' 2024-03-30T15:11:52.034 INFO:tasks.workunit.client.0.smithi072.stderr:+ pids[$f]=64396 2024-03-30T15:11:52.034 INFO:tasks.workunit.client.0.smithi072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-30T15:11:52.034 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' 1 -eq 1 ']' 2024-03-30T15:11:52.034 INFO:tasks.workunit.client.0.smithi072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat.xml 2>&1 | tee ceph_test_rados_api_stat.log | sed "s/^/ api_stat: /"' 2024-03-30T15:11:52.035 INFO:tasks.workunit.client.0.smithi072.stderr:++ printf %25s api_stat_pp 2024-03-30T15:11:52.035 INFO:tasks.workunit.client.0.smithi072.stderr:+ r=' api_stat_pp' 2024-03-30T15:11:52.035 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' -z '' ']' 2024-03-30T15:11:52.035 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.036 INFO:tasks.workunit.client.0.smithi072.stderr:+ case $- in 2024-03-30T15:11:52.036 INFO:tasks.workunit.client.0.smithi072.stderr:++ echo api_stat_pp 2024-03-30T15:11:52.036 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.036 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat.xml 2024-03-30T15:11:52.036 INFO:tasks.workunit.client.0.smithi072.stderr:+ sed 's/^/ api_stat: /' 2024-03-30T15:11:52.038 INFO:tasks.workunit.client.0.smithi072.stderr:+ tee ceph_test_rados_api_stat.log 2024-03-30T15:11:52.039 INFO:tasks.workunit.client.0.smithi072.stderr:++ awk '{print $1}' 2024-03-30T15:11:52.048 INFO:tasks.workunit.client.0.smithi072.stderr:+ ff=api_stat_pp 2024-03-30T15:11:52.048 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64423 2024-03-30T15:11:52.049 INFO:tasks.workunit.client.0.smithi072.stdout:test api_stat_pp on pid 64423 2024-03-30T15:11:52.049 INFO:tasks.workunit.client.0.smithi072.stderr:+ echo 'test api_stat_pp on pid 64423' 2024-03-30T15:11:52.050 INFO:tasks.workunit.client.0.smithi072.stderr:+ pids[$f]=64423 2024-03-30T15:11:52.050 INFO:tasks.workunit.client.0.smithi072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat_pp.xml 2>&1 | tee ceph_test_rados_api_stat_pp.log | sed "s/^/ api_stat_pp: /"' 2024-03-30T15:11:52.050 INFO:tasks.workunit.client.0.smithi072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-30T15:11:52.050 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' 1 -eq 1 ']' 2024-03-30T15:11:52.050 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' -z '' ']' 2024-03-30T15:11:52.050 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.050 INFO:tasks.workunit.client.0.smithi072.stderr:+ case $- in 2024-03-30T15:11:52.051 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.051 INFO:tasks.workunit.client.0.smithi072.stderr:++ printf %25s api_watch_notify 2024-03-30T15:11:52.051 INFO:tasks.workunit.client.0.smithi072.stderr:+ r=' api_watch_notify' 2024-03-30T15:11:52.051 INFO:tasks.workunit.client.0.smithi072.stderr:++ echo api_watch_notify 2024-03-30T15:11:52.055 INFO:tasks.workunit.client.0.smithi072.stderr:++ awk '{print $1}' 2024-03-30T15:11:52.055 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat_pp.xml 2024-03-30T15:11:52.057 INFO:tasks.workunit.client.0.smithi072.stderr:+ ff=api_watch_notify 2024-03-30T15:11:52.057 INFO:tasks.workunit.client.0.smithi072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify.xml 2>&1 | tee ceph_test_rados_api_watch_notify.log | sed "s/^/ api_watch_notify: /"' 2024-03-30T15:11:52.057 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64442 2024-03-30T15:11:52.057 INFO:tasks.workunit.client.0.smithi072.stdout:test api_watch_notify on pid 64442 2024-03-30T15:11:52.058 INFO:tasks.workunit.client.0.smithi072.stderr:+ echo 'test api_watch_notify on pid 64442' 2024-03-30T15:11:52.058 INFO:tasks.workunit.client.0.smithi072.stderr:+ pids[$f]=64442 2024-03-30T15:11:52.058 INFO:tasks.workunit.client.0.smithi072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-30T15:11:52.058 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' 1 -eq 1 ']' 2024-03-30T15:11:52.059 INFO:tasks.workunit.client.0.smithi072.stderr:++ printf %25s api_watch_notify_pp 2024-03-30T15:11:52.059 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' -z '' ']' 2024-03-30T15:11:52.059 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.059 INFO:tasks.workunit.client.0.smithi072.stderr:+ case $- in 2024-03-30T15:11:52.059 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.059 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify.xml 2024-03-30T15:11:52.059 INFO:tasks.workunit.client.0.smithi072.stderr:+ r=' api_watch_notify_pp' 2024-03-30T15:11:52.060 INFO:tasks.workunit.client.0.smithi072.stderr:++ echo api_watch_notify_pp 2024-03-30T15:11:52.060 INFO:tasks.workunit.client.0.smithi072.stderr:+ sed 's/^/ api_watch_notify: /' 2024-03-30T15:11:52.061 INFO:tasks.workunit.client.0.smithi072.stderr:+ tee ceph_test_rados_api_stat_pp.log 2024-03-30T15:11:52.061 INFO:tasks.workunit.client.0.smithi072.stderr:+ sed 's/^/ api_stat_pp: /' 2024-03-30T15:11:52.065 INFO:tasks.workunit.client.0.smithi072.stderr:++ awk '{print $1}' 2024-03-30T15:11:52.068 INFO:tasks.workunit.client.0.smithi072.stdout:test api_watch_notify_pp on pid 64474 2024-03-30T15:11:52.068 INFO:tasks.workunit.client.0.smithi072.stderr:+ ff=api_watch_notify_pp 2024-03-30T15:11:52.068 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64474 2024-03-30T15:11:52.068 INFO:tasks.workunit.client.0.smithi072.stderr:+ echo 'test api_watch_notify_pp on pid 64474' 2024-03-30T15:11:52.068 INFO:tasks.workunit.client.0.smithi072.stderr:+ pids[$f]=64474 2024-03-30T15:11:52.068 INFO:tasks.workunit.client.0.smithi072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-30T15:11:52.068 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' 1 -eq 1 ']' 2024-03-30T15:11:52.068 INFO:tasks.workunit.client.0.smithi072.stderr:++ printf %25s api_cmd 2024-03-30T15:11:52.069 INFO:tasks.workunit.client.0.smithi072.stderr:+ r=' api_cmd' 2024-03-30T15:11:52.069 INFO:tasks.workunit.client.0.smithi072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify_pp.xml 2>&1 | tee ceph_test_rados_api_watch_notify_pp.log | sed "s/^/ api_watch_notify_pp: /"' 2024-03-30T15:11:52.071 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' -z '' ']' 2024-03-30T15:11:52.071 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.071 INFO:tasks.workunit.client.0.smithi072.stderr:+ case $- in 2024-03-30T15:11:52.071 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.071 INFO:tasks.workunit.client.0.smithi072.stderr:+ sed 's/^/ api_watch_notify_pp: /' 2024-03-30T15:11:52.072 INFO:tasks.workunit.client.0.smithi072.stderr:+ tee ceph_test_rados_api_watch_notify.log 2024-03-30T15:11:52.073 INFO:tasks.workunit.client.0.smithi072.stderr:+ tee ceph_test_rados_api_watch_notify_pp.log 2024-03-30T15:11:52.073 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify_pp.xml 2024-03-30T15:11:52.075 INFO:tasks.workunit.client.0.smithi072.stderr:++ echo api_cmd 2024-03-30T15:11:52.075 INFO:tasks.workunit.client.0.smithi072.stderr:++ awk '{print $1}' 2024-03-30T15:11:52.081 INFO:tasks.workunit.client.0.smithi072.stdout:test api_cmd on pid 64499 2024-03-30T15:11:52.082 INFO:tasks.workunit.client.0.smithi072.stderr:+ ff=api_cmd 2024-03-30T15:11:52.082 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64499 2024-03-30T15:11:52.082 INFO:tasks.workunit.client.0.smithi072.stderr:+ echo 'test api_cmd on pid 64499' 2024-03-30T15:11:52.082 INFO:tasks.workunit.client.0.smithi072.stderr:+ pids[$f]=64499 2024-03-30T15:11:52.082 INFO:tasks.workunit.client.0.smithi072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-30T15:11:52.082 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' 1 -eq 1 ']' 2024-03-30T15:11:52.082 INFO:tasks.workunit.client.0.smithi072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd.xml 2>&1 | tee ceph_test_rados_api_cmd.log | sed "s/^/ api_cmd: /"' 2024-03-30T15:11:52.082 INFO:tasks.workunit.client.0.smithi072.stderr:++ printf %25s api_cmd_pp 2024-03-30T15:11:52.082 INFO:tasks.workunit.client.0.smithi072.stderr:+ r=' api_cmd_pp' 2024-03-30T15:11:52.083 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' -z '' ']' 2024-03-30T15:11:52.083 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.083 INFO:tasks.workunit.client.0.smithi072.stderr:+ case $- in 2024-03-30T15:11:52.083 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.083 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd.xml 2024-03-30T15:11:52.083 INFO:tasks.workunit.client.0.smithi072.stderr:++ awk '{print $1}' 2024-03-30T15:11:52.084 INFO:tasks.workunit.client.0.smithi072.stderr:++ echo api_cmd_pp 2024-03-30T15:11:52.086 INFO:tasks.workunit.client.0.smithi072.stdout:test api_cmd_pp on pid 64514 2024-03-30T15:11:52.086 INFO:tasks.workunit.client.0.smithi072.stderr:+ ff=api_cmd_pp 2024-03-30T15:11:52.086 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64514 2024-03-30T15:11:52.087 INFO:tasks.workunit.client.0.smithi072.stderr:+ echo 'test api_cmd_pp on pid 64514' 2024-03-30T15:11:52.087 INFO:tasks.workunit.client.0.smithi072.stderr:+ pids[$f]=64514 2024-03-30T15:11:52.087 INFO:tasks.workunit.client.0.smithi072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-30T15:11:52.087 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' 1 -eq 1 ']' 2024-03-30T15:11:52.087 INFO:tasks.workunit.client.0.smithi072.stderr:++ printf %25s api_service 2024-03-30T15:11:52.087 INFO:tasks.workunit.client.0.smithi072.stderr:+ r=' api_service' 2024-03-30T15:11:52.087 INFO:tasks.workunit.client.0.smithi072.stderr:+ sed 's/^/ api_cmd: /' 2024-03-30T15:11:52.087 INFO:tasks.workunit.client.0.smithi072.stderr:++ echo api_service 2024-03-30T15:11:52.088 INFO:tasks.workunit.client.0.smithi072.stderr:++ awk '{print $1}' 2024-03-30T15:11:52.090 INFO:tasks.workunit.client.0.smithi072.stdout:test api_service on pid 64519 2024-03-30T15:11:52.091 INFO:tasks.workunit.client.0.smithi072.stderr:+ ff=api_service 2024-03-30T15:11:52.091 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64519 2024-03-30T15:11:52.091 INFO:tasks.workunit.client.0.smithi072.stderr:+ echo 'test api_service on pid 64519' 2024-03-30T15:11:52.091 INFO:tasks.workunit.client.0.smithi072.stderr:+ pids[$f]=64519 2024-03-30T15:11:52.091 INFO:tasks.workunit.client.0.smithi072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-30T15:11:52.091 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' 1 -eq 1 ']' 2024-03-30T15:11:52.092 INFO:tasks.workunit.client.0.smithi072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service.xml 2>&1 | tee ceph_test_rados_api_service.log | sed "s/^/ api_service: /"' 2024-03-30T15:11:52.092 INFO:tasks.workunit.client.0.smithi072.stderr:++ printf %25s api_service_pp 2024-03-30T15:11:52.092 INFO:tasks.workunit.client.0.smithi072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd_pp.xml 2>&1 | tee ceph_test_rados_api_cmd_pp.log | sed "s/^/ api_cmd_pp: /"' 2024-03-30T15:11:52.092 INFO:tasks.workunit.client.0.smithi072.stderr:+ tee ceph_test_rados_api_cmd.log 2024-03-30T15:11:52.092 INFO:tasks.workunit.client.0.smithi072.stderr:+ r=' api_service_pp' 2024-03-30T15:11:52.093 INFO:tasks.workunit.client.0.smithi072.stderr:++ awk '{print $1}' 2024-03-30T15:11:52.093 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' -z '' ']' 2024-03-30T15:11:52.093 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.093 INFO:tasks.workunit.client.0.smithi072.stderr:+ case $- in 2024-03-30T15:11:52.093 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.093 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' -z '' ']' 2024-03-30T15:11:52.094 INFO:tasks.workunit.client.0.smithi072.stderr:+ sed 's/^/ api_service: /' 2024-03-30T15:11:52.094 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.094 INFO:tasks.workunit.client.0.smithi072.stderr:+ case $- in 2024-03-30T15:11:52.094 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.095 INFO:tasks.workunit.client.0.smithi072.stderr:+ tee ceph_test_rados_api_service.log 2024-03-30T15:11:52.095 INFO:tasks.workunit.client.0.smithi072.stderr:+ sed 's/^/ api_cmd_pp: /' 2024-03-30T15:11:52.097 INFO:tasks.workunit.client.0.smithi072.stderr:++ echo api_service_pp 2024-03-30T15:11:52.097 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service.xml 2024-03-30T15:11:52.097 INFO:tasks.workunit.client.0.smithi072.stderr:+ ff=api_service_pp 2024-03-30T15:11:52.098 INFO:tasks.workunit.client.0.smithi072.stdout:test api_service_pp on pid 64545 2024-03-30T15:11:52.098 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64545 2024-03-30T15:11:52.098 INFO:tasks.workunit.client.0.smithi072.stderr:+ echo 'test api_service_pp on pid 64545' 2024-03-30T15:11:52.098 INFO:tasks.workunit.client.0.smithi072.stderr:+ pids[$f]=64545 2024-03-30T15:11:52.098 INFO:tasks.workunit.client.0.smithi072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-30T15:11:52.098 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' 1 -eq 1 ']' 2024-03-30T15:11:52.099 INFO:tasks.workunit.client.0.smithi072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service_pp.xml 2>&1 | tee ceph_test_rados_api_service_pp.log | sed "s/^/ api_service_pp: /"' 2024-03-30T15:11:52.100 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' -z '' ']' 2024-03-30T15:11:52.100 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.100 INFO:tasks.workunit.client.0.smithi072.stderr:+ case $- in 2024-03-30T15:11:52.100 INFO:tasks.workunit.client.0.smithi072.stderr:++ printf %25s api_c_write_operations 2024-03-30T15:11:52.100 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.100 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service_pp.xml 2024-03-30T15:11:52.101 INFO:tasks.workunit.client.0.smithi072.stderr:+ r=' api_c_write_operations' 2024-03-30T15:11:52.101 INFO:tasks.workunit.client.0.smithi072.stderr:+ sed 's/^/ api_service_pp: /' 2024-03-30T15:11:52.101 INFO:tasks.workunit.client.0.smithi072.stderr:++ awk '{print $1}' 2024-03-30T15:11:52.101 INFO:tasks.workunit.client.0.smithi072.stderr:++ echo api_c_write_operations 2024-03-30T15:11:52.103 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd_pp.xml 2024-03-30T15:11:52.103 INFO:tasks.workunit.client.0.smithi072.stderr:+ tee ceph_test_rados_api_cmd_pp.log 2024-03-30T15:11:52.105 INFO:tasks.workunit.client.0.smithi072.stdout:test api_c_write_operations on pid 64554 2024-03-30T15:11:52.105 INFO:tasks.workunit.client.0.smithi072.stderr:+ ff=api_c_write_operations 2024-03-30T15:11:52.106 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64554 2024-03-30T15:11:52.106 INFO:tasks.workunit.client.0.smithi072.stderr:+ echo 'test api_c_write_operations on pid 64554' 2024-03-30T15:11:52.106 INFO:tasks.workunit.client.0.smithi072.stderr:+ pids[$f]=64554 2024-03-30T15:11:52.106 INFO:tasks.workunit.client.0.smithi072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-30T15:11:52.106 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' 1 -eq 1 ']' 2024-03-30T15:11:52.106 INFO:tasks.workunit.client.0.smithi072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_write_operations.xml 2>&1 | tee ceph_test_rados_api_c_write_operations.log | sed "s/^/ api_c_write_operations: /"' 2024-03-30T15:11:52.106 INFO:tasks.workunit.client.0.smithi072.stderr:+ tee ceph_test_rados_api_service_pp.log 2024-03-30T15:11:52.106 INFO:tasks.workunit.client.0.smithi072.stderr:++ printf %25s api_c_read_operations 2024-03-30T15:11:52.106 INFO:tasks.workunit.client.0.smithi072.stderr:+ r=' api_c_read_operations' 2024-03-30T15:11:52.107 INFO:tasks.workunit.client.0.smithi072.stderr:++ awk '{print $1}' 2024-03-30T15:11:52.110 INFO:tasks.workunit.client.0.smithi072.stderr:++ echo api_c_read_operations 2024-03-30T15:11:52.111 INFO:tasks.workunit.client.0.smithi072.stdout:test api_c_read_operations on pid 64569 2024-03-30T15:11:52.112 INFO:tasks.workunit.client.0.smithi072.stderr:+ ff=api_c_read_operations 2024-03-30T15:11:52.112 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64569 2024-03-30T15:11:52.112 INFO:tasks.workunit.client.0.smithi072.stderr:+ echo 'test api_c_read_operations on pid 64569' 2024-03-30T15:11:52.112 INFO:tasks.workunit.client.0.smithi072.stderr:+ pids[$f]=64569 2024-03-30T15:11:52.112 INFO:tasks.workunit.client.0.smithi072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-30T15:11:52.112 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' 1 -eq 1 ']' 2024-03-30T15:11:52.112 INFO:tasks.workunit.client.0.smithi072.stderr:++ printf %25s api_cls_remote_reads 2024-03-30T15:11:52.112 INFO:tasks.workunit.client.0.smithi072.stderr:+ r=' api_cls_remote_reads' 2024-03-30T15:11:52.113 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' -z '' ']' 2024-03-30T15:11:52.113 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.113 INFO:tasks.workunit.client.0.smithi072.stderr:+ case $- in 2024-03-30T15:11:52.113 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.113 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_write_operations.xml 2024-03-30T15:11:52.114 INFO:tasks.workunit.client.0.smithi072.stderr:+ sed 's/^/ api_c_write_operations: /' 2024-03-30T15:11:52.116 INFO:tasks.workunit.client.0.smithi072.stderr:+ tee ceph_test_rados_api_c_write_operations.log 2024-03-30T15:11:52.118 INFO:tasks.workunit.client.0.smithi072.stderr:++ awk '{print $1}' 2024-03-30T15:11:52.118 INFO:tasks.workunit.client.0.smithi072.stderr:++ echo api_cls_remote_reads 2024-03-30T15:11:52.120 INFO:tasks.workunit.client.0.smithi072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_read_operations.xml 2>&1 | tee ceph_test_rados_api_c_read_operations.log | sed "s/^/ api_c_read_operations: /"' 2024-03-30T15:11:52.122 INFO:tasks.workunit.client.0.smithi072.stderr:+ ff=api_cls_remote_reads 2024-03-30T15:11:52.122 INFO:tasks.workunit.client.0.smithi072.stdout:test api_cls_remote_reads on pid 64594 2024-03-30T15:11:52.123 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64594 2024-03-30T15:11:52.123 INFO:tasks.workunit.client.0.smithi072.stderr:+ echo 'test api_cls_remote_reads on pid 64594' 2024-03-30T15:11:52.123 INFO:tasks.workunit.client.0.smithi072.stderr:+ pids[$f]=64594 2024-03-30T15:11:52.123 INFO:tasks.workunit.client.0.smithi072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-30T15:11:52.123 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' 1 -eq 1 ']' 2024-03-30T15:11:52.123 INFO:tasks.workunit.client.0.smithi072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cls_remote_reads --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cls_remote_reads.xml 2>&1 | tee ceph_test_rados_api_cls_remote_reads.log | sed "s/^/ api_cls_remote_reads: /"' 2024-03-30T15:11:52.123 INFO:tasks.workunit.client.0.smithi072.stderr:++ printf %25s list_parallel 2024-03-30T15:11:52.123 INFO:tasks.workunit.client.0.smithi072.stderr:+ r=' list_parallel' 2024-03-30T15:11:52.124 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' -z '' ']' 2024-03-30T15:11:52.124 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.124 INFO:tasks.workunit.client.0.smithi072.stderr:+ case $- in 2024-03-30T15:11:52.124 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.124 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph_test_rados_api_cls_remote_reads --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cls_remote_reads.xml 2024-03-30T15:11:52.125 INFO:tasks.workunit.client.0.smithi072.stderr:+ tee ceph_test_rados_api_cls_remote_reads.log 2024-03-30T15:11:52.125 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' -z '' ']' 2024-03-30T15:11:52.126 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.126 INFO:tasks.workunit.client.0.smithi072.stderr:+ case $- in 2024-03-30T15:11:52.126 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.126 INFO:tasks.workunit.client.0.smithi072.stderr:+ tee ceph_test_rados_api_c_read_operations.log 2024-03-30T15:11:52.127 INFO:tasks.workunit.client.0.smithi072.stderr:+ sed 's/^/ api_c_read_operations: /' 2024-03-30T15:11:52.127 INFO:tasks.workunit.client.0.smithi072.stderr:++ echo list_parallel 2024-03-30T15:11:52.132 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_read_operations.xml 2024-03-30T15:11:52.137 INFO:tasks.workunit.client.0.smithi072.stderr:+ sed 's/^/ api_cls_remote_reads: /' 2024-03-30T15:11:52.138 INFO:tasks.workunit.client.0.smithi072.stderr:++ awk '{print $1}' 2024-03-30T15:11:52.140 INFO:tasks.workunit.client.0.smithi072.stdout:test list_parallel on pid 64618 2024-03-30T15:11:52.141 INFO:tasks.workunit.client.0.smithi072.stderr:+ ff=list_parallel 2024-03-30T15:11:52.141 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64618 2024-03-30T15:11:52.141 INFO:tasks.workunit.client.0.smithi072.stderr:+ echo 'test list_parallel on pid 64618' 2024-03-30T15:11:52.141 INFO:tasks.workunit.client.0.smithi072.stderr:+ pids[$f]=64618 2024-03-30T15:11:52.141 INFO:tasks.workunit.client.0.smithi072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-30T15:11:52.141 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' 1 -eq 1 ']' 2024-03-30T15:11:52.143 INFO:tasks.workunit.client.0.smithi072.stderr:++ printf %25s open_pools_parallel 2024-03-30T15:11:52.143 INFO:tasks.workunit.client.0.smithi072.stderr:+ r=' open_pools_parallel' 2024-03-30T15:11:52.146 INFO:tasks.workunit.client.0.smithi072.stderr:++ echo open_pools_parallel 2024-03-30T15:11:52.146 INFO:tasks.workunit.client.0.smithi072.stderr:++ awk '{print $1}' 2024-03-30T15:11:52.149 INFO:tasks.workunit.client.0.smithi072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/list_parallel.xml 2>&1 | tee ceph_test_rados_list_parallel.log | sed "s/^/ list_parallel: /"' 2024-03-30T15:11:52.150 INFO:tasks.workunit.client.0.smithi072.stderr:+ ff=open_pools_parallel 2024-03-30T15:11:52.150 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64631 2024-03-30T15:11:52.150 INFO:tasks.workunit.client.0.smithi072.stdout:test open_pools_parallel on pid 64631 2024-03-30T15:11:52.151 INFO:tasks.workunit.client.0.smithi072.stderr:+ echo 'test open_pools_parallel on pid 64631' 2024-03-30T15:11:52.151 INFO:tasks.workunit.client.0.smithi072.stderr:+ pids[$f]=64631 2024-03-30T15:11:52.151 INFO:tasks.workunit.client.0.smithi072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-03-30T15:11:52.152 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' 1 -eq 1 ']' 2024-03-30T15:11:52.152 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' -z '' ']' 2024-03-30T15:11:52.152 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.152 INFO:tasks.workunit.client.0.smithi072.stderr:+ case $- in 2024-03-30T15:11:52.152 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.152 INFO:tasks.workunit.client.0.smithi072.stderr:+ tee ceph_test_rados_list_parallel.log 2024-03-30T15:11:52.152 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/list_parallel.xml 2024-03-30T15:11:52.153 INFO:tasks.workunit.client.0.smithi072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/open_pools_parallel.xml 2>&1 | tee ceph_test_rados_open_pools_parallel.log | sed "s/^/ open_pools_parallel: /"' 2024-03-30T15:11:52.154 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' -z '' ']' 2024-03-30T15:11:52.154 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.155 INFO:tasks.workunit.client.0.smithi072.stderr:+ case $- in 2024-03-30T15:11:52.155 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.155 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/open_pools_parallel.xml 2024-03-30T15:11:52.155 INFO:tasks.workunit.client.0.smithi072.stderr:+ tee ceph_test_rados_open_pools_parallel.log 2024-03-30T15:11:52.157 INFO:tasks.workunit.client.0.smithi072.stderr:+ sed 's/^/ list_parallel: /' 2024-03-30T15:11:52.159 INFO:tasks.workunit.client.0.smithi072.stderr:++ printf %25s delete_pools_parallel 2024-03-30T15:11:52.159 INFO:tasks.workunit.client.0.smithi072.stderr:+ r=' delete_pools_parallel' 2024-03-30T15:11:52.163 INFO:tasks.workunit.client.0.smithi072.stderr:+ sed 's/^/ open_pools_parallel: /' 2024-03-30T15:11:52.170 INFO:tasks.workunit.client.0.smithi072.stderr:++ echo delete_pools_parallel 2024-03-30T15:11:52.171 INFO:tasks.workunit.client.0.smithi072.stderr:++ awk '{print $1}' 2024-03-30T15:11:52.176 INFO:tasks.workunit.client.0.smithi072.stdout:test delete_pools_parallel on pid 64681 2024-03-30T15:11:52.176 INFO:tasks.workunit.client.0.smithi072.stderr:+ ff=delete_pools_parallel 2024-03-30T15:11:52.176 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64681 2024-03-30T15:11:52.176 INFO:tasks.workunit.client.0.smithi072.stderr:+ echo 'test delete_pools_parallel on pid 64681' 2024-03-30T15:11:52.176 INFO:tasks.workunit.client.0.smithi072.stderr:+ pids[$f]=64681 2024-03-30T15:11:52.177 INFO:tasks.workunit.client.0.smithi072.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-03-30T15:11:52.177 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' 1 -eq 1 ']' 2024-03-30T15:11:52.177 INFO:tasks.workunit.client.0.smithi072.stderr:++ printf %25s cls 2024-03-30T15:11:52.177 INFO:tasks.workunit.client.0.smithi072.stderr:+ r=' cls' 2024-03-30T15:11:52.177 INFO:tasks.workunit.client.0.smithi072.stderr:++ awk '{print $1}' 2024-03-30T15:11:52.179 INFO:tasks.workunit.client.0.smithi072.stderr:++ echo cls 2024-03-30T15:11:52.179 INFO:tasks.workunit.client.0.smithi072.stderr:+ ff=cls 2024-03-30T15:11:52.180 INFO:tasks.workunit.client.0.smithi072.stdout:test cls on pid 64692 2024-03-30T15:11:52.180 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64692 2024-03-30T15:11:52.180 INFO:tasks.workunit.client.0.smithi072.stderr:+ echo 'test cls on pid 64692' 2024-03-30T15:11:52.180 INFO:tasks.workunit.client.0.smithi072.stderr:+ pids[$f]=64692 2024-03-30T15:11:52.180 INFO:tasks.workunit.client.0.smithi072.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-03-30T15:11:52.180 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' 1 -eq 1 ']' 2024-03-30T15:11:52.180 INFO:tasks.workunit.client.0.smithi072.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_cls 2>&1 | tee ceph_test_neorados_cls.log | sed "s/^/ cls: /"' 2024-03-30T15:11:52.181 INFO:tasks.workunit.client.0.smithi072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/delete_pools_parallel.xml 2>&1 | tee ceph_test_rados_delete_pools_parallel.log | sed "s/^/ delete_pools_parallel: /"' 2024-03-30T15:11:52.182 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' -z '' ']' 2024-03-30T15:11:52.182 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.182 INFO:tasks.workunit.client.0.smithi072.stderr:+ case $- in 2024-03-30T15:11:52.182 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.183 INFO:tasks.workunit.client.0.smithi072.stderr:+ tee ceph_test_rados_delete_pools_parallel.log 2024-03-30T15:11:52.184 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' -z '' ']' 2024-03-30T15:11:52.184 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.184 INFO:tasks.workunit.client.0.smithi072.stderr:+ case $- in 2024-03-30T15:11:52.184 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.185 INFO:tasks.workunit.client.0.smithi072.stderr:++ printf %25s cmd 2024-03-30T15:11:52.185 INFO:tasks.workunit.client.0.smithi072.stderr:+ r=' cmd' 2024-03-30T15:11:52.185 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph_test_neorados_cls 2024-03-30T15:11:52.187 INFO:tasks.workunit.client.0.smithi072.stderr:++ echo cmd 2024-03-30T15:11:52.189 INFO:tasks.workunit.client.0.smithi072.stderr:+ sed 's/^/ delete_pools_parallel: /' 2024-03-30T15:11:52.190 INFO:tasks.workunit.client.0.smithi072.stderr:++ awk '{print $1}' 2024-03-30T15:11:52.190 INFO:tasks.workunit.client.0.smithi072.stderr:+ tee ceph_test_neorados_cls.log 2024-03-30T15:11:52.190 INFO:tasks.workunit.client.0.smithi072.stderr:+ sed 's/^/ cls: /' 2024-03-30T15:11:52.194 INFO:tasks.workunit.client.0.smithi072.stderr:+ ff=cmd 2024-03-30T15:11:52.194 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64715 2024-03-30T15:11:52.194 INFO:tasks.workunit.client.0.smithi072.stderr:+ echo 'test cmd on pid 64715' 2024-03-30T15:11:52.194 INFO:tasks.workunit.client.0.smithi072.stdout:test cmd on pid 64715 2024-03-30T15:11:52.195 INFO:tasks.workunit.client.0.smithi072.stderr:+ pids[$f]=64715 2024-03-30T15:11:52.195 INFO:tasks.workunit.client.0.smithi072.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-03-30T15:11:52.195 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' 1 -eq 1 ']' 2024-03-30T15:11:52.196 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/delete_pools_parallel.xml 2024-03-30T15:11:52.201 INFO:tasks.workunit.client.0.smithi072.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_cmd 2>&1 | tee ceph_test_neorados_cmd.log | sed "s/^/ cmd: /"' 2024-03-30T15:11:52.202 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' -z '' ']' 2024-03-30T15:11:52.202 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.203 INFO:tasks.workunit.client.0.smithi072.stderr:+ case $- in 2024-03-30T15:11:52.203 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.203 INFO:tasks.workunit.client.0.smithi072.stderr:+ sed 's/^/ cmd: /' 2024-03-30T15:11:52.204 INFO:tasks.workunit.client.0.smithi072.stderr:+ tee ceph_test_neorados_cmd.log 2024-03-30T15:11:52.204 INFO:tasks.workunit.client.0.smithi072.stderr:++ printf %25s handler_error 2024-03-30T15:11:52.205 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph_test_neorados_cmd 2024-03-30T15:11:52.207 INFO:tasks.workunit.client.0.smithi072.stderr:+ r=' handler_error' 2024-03-30T15:11:52.211 INFO:tasks.workunit.client.0.smithi072.stderr:++ awk '{print $1}' 2024-03-30T15:11:52.213 INFO:tasks.workunit.client.0.smithi072.stderr:++ echo handler_error 2024-03-30T15:11:52.214 INFO:tasks.workunit.client.0.smithi072.stdout:test handler_error on pid 64768 2024-03-30T15:11:52.215 INFO:tasks.workunit.client.0.smithi072.stderr:+ ff=handler_error 2024-03-30T15:11:52.215 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64768 2024-03-30T15:11:52.215 INFO:tasks.workunit.client.0.smithi072.stderr:+ echo 'test handler_error on pid 64768' 2024-03-30T15:11:52.215 INFO:tasks.workunit.client.0.smithi072.stderr:+ pids[$f]=64768 2024-03-30T15:11:52.215 INFO:tasks.workunit.client.0.smithi072.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-03-30T15:11:52.215 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' 1 -eq 1 ']' 2024-03-30T15:11:52.215 INFO:tasks.workunit.client.0.smithi072.stderr:++ printf %25s io 2024-03-30T15:11:52.215 INFO:tasks.workunit.client.0.smithi072.stderr:+ r=' io' 2024-03-30T15:11:52.216 INFO:tasks.workunit.client.0.smithi072.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_handler_error 2>&1 | tee ceph_test_neorados_handler_error.log | sed "s/^/ handler_error: /"' 2024-03-30T15:11:52.217 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' -z '' ']' 2024-03-30T15:11:52.217 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.217 INFO:tasks.workunit.client.0.smithi072.stderr:+ case $- in 2024-03-30T15:11:52.217 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.219 INFO:tasks.workunit.client.0.smithi072.stderr:+ sed 's/^/ handler_error: /' 2024-03-30T15:11:52.220 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph_test_neorados_handler_error 2024-03-30T15:11:52.220 INFO:tasks.workunit.client.0.smithi072.stderr:++ awk '{print $1}' 2024-03-30T15:11:52.222 INFO:tasks.workunit.client.0.smithi072.stderr:++ echo io 2024-03-30T15:11:52.227 INFO:tasks.workunit.client.0.smithi072.stdout:test io on pid 64808 2024-03-30T15:11:52.227 INFO:tasks.workunit.client.0.smithi072.stderr:+ ff=io 2024-03-30T15:11:52.227 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64808 2024-03-30T15:11:52.227 INFO:tasks.workunit.client.0.smithi072.stderr:+ echo 'test io on pid 64808' 2024-03-30T15:11:52.227 INFO:tasks.workunit.client.0.smithi072.stderr:+ pids[$f]=64808 2024-03-30T15:11:52.227 INFO:tasks.workunit.client.0.smithi072.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-03-30T15:11:52.227 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' 1 -eq 1 ']' 2024-03-30T15:11:52.229 INFO:tasks.workunit.client.0.smithi072.stderr:+ tee ceph_test_neorados_handler_error.log 2024-03-30T15:11:52.230 INFO:tasks.workunit.client.0.smithi072.stderr:++ printf %25s ec_io 2024-03-30T15:11:52.230 INFO:tasks.workunit.client.0.smithi072.stderr:+ r=' ec_io' 2024-03-30T15:11:52.231 INFO:tasks.workunit.client.0.smithi072.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_io 2>&1 | tee ceph_test_neorados_io.log | sed "s/^/ io: /"' 2024-03-30T15:11:52.232 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' -z '' ']' 2024-03-30T15:11:52.232 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.233 INFO:tasks.workunit.client.0.smithi072.stderr:+ case $- in 2024-03-30T15:11:52.233 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.233 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph_test_neorados_io 2024-03-30T15:11:52.233 INFO:tasks.workunit.client.0.smithi072.stderr:+ sed 's/^/ io: /' 2024-03-30T15:11:52.233 INFO:tasks.workunit.client.0.smithi072.stderr:++ echo ec_io 2024-03-30T15:11:52.233 INFO:tasks.workunit.client.0.smithi072.stderr:++ awk '{print $1}' 2024-03-30T15:11:52.234 INFO:tasks.workunit.client.0.smithi072.stderr:+ tee ceph_test_neorados_io.log 2024-03-30T15:11:52.236 INFO:tasks.workunit.client.0.smithi072.stdout:test ec_io on pid 64823 2024-03-30T15:11:52.236 INFO:tasks.workunit.client.0.smithi072.stderr:+ ff=ec_io 2024-03-30T15:11:52.237 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64823 2024-03-30T15:11:52.237 INFO:tasks.workunit.client.0.smithi072.stderr:+ echo 'test ec_io on pid 64823' 2024-03-30T15:11:52.237 INFO:tasks.workunit.client.0.smithi072.stderr:+ pids[$f]=64823 2024-03-30T15:11:52.237 INFO:tasks.workunit.client.0.smithi072.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-03-30T15:11:52.237 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' 1 -eq 1 ']' 2024-03-30T15:11:52.237 INFO:tasks.workunit.client.0.smithi072.stderr:++ printf %25s list 2024-03-30T15:11:52.237 INFO:tasks.workunit.client.0.smithi072.stderr:+ r=' list' 2024-03-30T15:11:52.238 INFO:tasks.workunit.client.0.smithi072.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_ec_io 2>&1 | tee ceph_test_neorados_ec_io.log | sed "s/^/ ec_io: /"' 2024-03-30T15:11:52.238 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' -z '' ']' 2024-03-30T15:11:52.238 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.238 INFO:tasks.workunit.client.0.smithi072.stderr:+ case $- in 2024-03-30T15:11:52.239 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.239 INFO:tasks.workunit.client.0.smithi072.stderr:+ sed 's/^/ ec_io: /' 2024-03-30T15:11:52.240 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph_test_neorados_ec_io 2024-03-30T15:11:52.247 INFO:tasks.workunit.client.0.smithi072.stderr:++ echo list 2024-03-30T15:11:52.247 INFO:tasks.workunit.client.0.smithi072.stderr:+ tee ceph_test_neorados_ec_io.log 2024-03-30T15:11:52.248 INFO:tasks.workunit.client.0.smithi072.stderr:++ awk '{print $1}' 2024-03-30T15:11:52.252 INFO:tasks.workunit.client.0.smithi072.stdout:test list on pid 64853 2024-03-30T15:11:52.252 INFO:tasks.workunit.client.0.smithi072.stderr:+ ff=list 2024-03-30T15:11:52.252 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64853 2024-03-30T15:11:52.253 INFO:tasks.workunit.client.0.smithi072.stderr:+ echo 'test list on pid 64853' 2024-03-30T15:11:52.253 INFO:tasks.workunit.client.0.smithi072.stderr:+ pids[$f]=64853 2024-03-30T15:11:52.253 INFO:tasks.workunit.client.0.smithi072.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-03-30T15:11:52.253 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' 1 -eq 1 ']' 2024-03-30T15:11:52.253 INFO:tasks.workunit.client.0.smithi072.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_list 2>&1 | tee ceph_test_neorados_list.log | sed "s/^/ list: /"' 2024-03-30T15:11:52.253 INFO:tasks.workunit.client.0.smithi072.stderr:++ printf %25s ec_list 2024-03-30T15:11:52.254 INFO:tasks.workunit.client.0.smithi072.stderr:+ r=' ec_list' 2024-03-30T15:11:52.254 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' -z '' ']' 2024-03-30T15:11:52.254 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.254 INFO:tasks.workunit.client.0.smithi072.stderr:+ case $- in 2024-03-30T15:11:52.254 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.254 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph_test_neorados_list 2024-03-30T15:11:52.254 INFO:tasks.workunit.client.0.smithi072.stderr:+ tee ceph_test_neorados_list.log 2024-03-30T15:11:52.254 INFO:tasks.workunit.client.0.smithi072.stderr:++ awk '{print $1}' 2024-03-30T15:11:52.255 INFO:tasks.workunit.client.0.smithi072.stderr:+ sed 's/^/ list: /' 2024-03-30T15:11:52.256 INFO:tasks.workunit.client.0.smithi072.stderr:++ echo ec_list 2024-03-30T15:11:52.257 INFO:tasks.workunit.client.0.smithi072.stdout:test ec_list on pid 64863 2024-03-30T15:11:52.257 INFO:tasks.workunit.client.0.smithi072.stderr:+ ff=ec_list 2024-03-30T15:11:52.257 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64863 2024-03-30T15:11:52.258 INFO:tasks.workunit.client.0.smithi072.stderr:+ echo 'test ec_list on pid 64863' 2024-03-30T15:11:52.258 INFO:tasks.workunit.client.0.smithi072.stderr:+ pids[$f]=64863 2024-03-30T15:11:52.258 INFO:tasks.workunit.client.0.smithi072.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-03-30T15:11:52.258 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' 1 -eq 1 ']' 2024-03-30T15:11:52.258 INFO:tasks.workunit.client.0.smithi072.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_ec_list 2>&1 | tee ceph_test_neorados_ec_list.log | sed "s/^/ ec_list: /"' 2024-03-30T15:11:52.258 INFO:tasks.workunit.client.0.smithi072.stderr:++ printf %25s misc 2024-03-30T15:11:52.258 INFO:tasks.workunit.client.0.smithi072.stderr:+ r=' misc' 2024-03-30T15:11:52.259 INFO:tasks.workunit.client.0.smithi072.stderr:++ echo misc 2024-03-30T15:11:52.259 INFO:tasks.workunit.client.0.smithi072.stderr:++ awk '{print $1}' 2024-03-30T15:11:52.261 INFO:tasks.workunit.client.0.smithi072.stderr:+ ff=misc 2024-03-30T15:11:52.261 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' -z '' ']' 2024-03-30T15:11:52.261 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64876 2024-03-30T15:11:52.261 INFO:tasks.workunit.client.0.smithi072.stdout:test misc on pid 64876 2024-03-30T15:11:52.262 INFO:tasks.workunit.client.0.smithi072.stderr:+ echo 'test misc on pid 64876' 2024-03-30T15:11:52.262 INFO:tasks.workunit.client.0.smithi072.stderr:+ pids[$f]=64876 2024-03-30T15:11:52.262 INFO:tasks.workunit.client.0.smithi072.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-03-30T15:11:52.262 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' 1 -eq 1 ']' 2024-03-30T15:11:52.262 INFO:tasks.workunit.client.0.smithi072.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_misc 2>&1 | tee ceph_test_neorados_misc.log | sed "s/^/ misc: /"' 2024-03-30T15:11:52.262 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.262 INFO:tasks.workunit.client.0.smithi072.stderr:++ printf %25s pool 2024-03-30T15:11:52.263 INFO:tasks.workunit.client.0.smithi072.stderr:+ case $- in 2024-03-30T15:11:52.263 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.263 INFO:tasks.workunit.client.0.smithi072.stderr:+ r=' pool' 2024-03-30T15:11:52.263 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph_test_neorados_ec_list 2024-03-30T15:11:52.263 INFO:tasks.workunit.client.0.smithi072.stderr:+ sed 's/^/ ec_list: /' 2024-03-30T15:11:52.264 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' -z '' ']' 2024-03-30T15:11:52.265 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.265 INFO:tasks.workunit.client.0.smithi072.stderr:+ case $- in 2024-03-30T15:11:52.265 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.265 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph_test_neorados_misc 2024-03-30T15:11:52.265 INFO:tasks.workunit.client.0.smithi072.stderr:+ sed 's/^/ misc: /' 2024-03-30T15:11:52.266 INFO:tasks.workunit.client.0.smithi072.stderr:++ echo pool 2024-03-30T15:11:52.266 INFO:tasks.workunit.client.0.smithi072.stderr:+ tee ceph_test_neorados_ec_list.log 2024-03-30T15:11:52.266 INFO:tasks.workunit.client.0.smithi072.stderr:++ awk '{print $1}' 2024-03-30T15:11:52.269 INFO:tasks.workunit.client.0.smithi072.stdout:test pool on pid 64905 2024-03-30T15:11:52.270 INFO:tasks.workunit.client.0.smithi072.stderr:+ ff=pool 2024-03-30T15:11:52.270 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64905 2024-03-30T15:11:52.270 INFO:tasks.workunit.client.0.smithi072.stderr:+ echo 'test pool on pid 64905' 2024-03-30T15:11:52.270 INFO:tasks.workunit.client.0.smithi072.stderr:+ pids[$f]=64905 2024-03-30T15:11:52.270 INFO:tasks.workunit.client.0.smithi072.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-03-30T15:11:52.270 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' 1 -eq 1 ']' 2024-03-30T15:11:52.270 INFO:tasks.workunit.client.0.smithi072.stderr:++ printf %25s read_operations 2024-03-30T15:11:52.270 INFO:tasks.workunit.client.0.smithi072.stderr:+ r=' read_operations' 2024-03-30T15:11:52.272 INFO:tasks.workunit.client.0.smithi072.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_pool 2>&1 | tee ceph_test_neorados_pool.log | sed "s/^/ pool: /"' 2024-03-30T15:11:52.272 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' -z '' ']' 2024-03-30T15:11:52.273 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.273 INFO:tasks.workunit.client.0.smithi072.stderr:+ case $- in 2024-03-30T15:11:52.273 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.273 INFO:tasks.workunit.client.0.smithi072.stderr:+ sed 's/^/ pool: /' 2024-03-30T15:11:52.273 INFO:tasks.workunit.client.0.smithi072.stderr:+ tee ceph_test_neorados_pool.log 2024-03-30T15:11:52.273 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph_test_neorados_pool 2024-03-30T15:11:52.275 INFO:tasks.workunit.client.0.smithi072.stderr:+ tee ceph_test_neorados_misc.log 2024-03-30T15:11:52.280 INFO:tasks.workunit.client.0.smithi072.stderr:++ echo read_operations 2024-03-30T15:11:52.282 INFO:tasks.workunit.client.0.smithi072.stderr:++ awk '{print $1}' 2024-03-30T15:11:52.284 INFO:tasks.workunit.client.0.smithi072.stdout:test read_operations on pid 64935 2024-03-30T15:11:52.285 INFO:tasks.workunit.client.0.smithi072.stderr:+ ff=read_operations 2024-03-30T15:11:52.285 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64935 2024-03-30T15:11:52.285 INFO:tasks.workunit.client.0.smithi072.stderr:+ echo 'test read_operations on pid 64935' 2024-03-30T15:11:52.285 INFO:tasks.workunit.client.0.smithi072.stderr:+ pids[$f]=64935 2024-03-30T15:11:52.285 INFO:tasks.workunit.client.0.smithi072.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-03-30T15:11:52.285 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' 1 -eq 1 ']' 2024-03-30T15:11:52.285 INFO:tasks.workunit.client.0.smithi072.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_read_operations 2>&1 | tee ceph_test_neorados_read_operations.log | sed "s/^/ read_operations: /"' 2024-03-30T15:11:52.285 INFO:tasks.workunit.client.0.smithi072.stderr:++ printf %25s snapshots 2024-03-30T15:11:52.285 INFO:tasks.workunit.client.0.smithi072.stderr:+ r=' snapshots' 2024-03-30T15:11:52.286 INFO:tasks.workunit.client.0.smithi072.stderr:++ echo snapshots 2024-03-30T15:11:52.286 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' -z '' ']' 2024-03-30T15:11:52.286 INFO:tasks.workunit.client.0.smithi072.stderr:++ awk '{print $1}' 2024-03-30T15:11:52.286 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.286 INFO:tasks.workunit.client.0.smithi072.stderr:+ case $- in 2024-03-30T15:11:52.286 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.286 INFO:tasks.workunit.client.0.smithi072.stderr:+ tee ceph_test_neorados_read_operations.log 2024-03-30T15:11:52.287 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph_test_neorados_read_operations 2024-03-30T15:11:52.287 INFO:tasks.workunit.client.0.smithi072.stdout:test snapshots on pid 64944 2024-03-30T15:11:52.288 INFO:tasks.workunit.client.0.smithi072.stderr:+ ff=snapshots 2024-03-30T15:11:52.288 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64944 2024-03-30T15:11:52.288 INFO:tasks.workunit.client.0.smithi072.stderr:+ echo 'test snapshots on pid 64944' 2024-03-30T15:11:52.288 INFO:tasks.workunit.client.0.smithi072.stderr:+ pids[$f]=64944 2024-03-30T15:11:52.288 INFO:tasks.workunit.client.0.smithi072.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-03-30T15:11:52.288 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' 1 -eq 1 ']' 2024-03-30T15:11:52.288 INFO:tasks.workunit.client.0.smithi072.stderr:+ sed 's/^/ read_operations: /' 2024-03-30T15:11:52.288 INFO:tasks.workunit.client.0.smithi072.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_snapshots 2>&1 | tee ceph_test_neorados_snapshots.log | sed "s/^/ snapshots: /"' 2024-03-30T15:11:52.290 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' -z '' ']' 2024-03-30T15:11:52.290 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.290 INFO:tasks.workunit.client.0.smithi072.stderr:+ case $- in 2024-03-30T15:11:52.290 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.290 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph_test_neorados_snapshots 2024-03-30T15:11:52.290 INFO:tasks.workunit.client.0.smithi072.stderr:+ tee ceph_test_neorados_snapshots.log 2024-03-30T15:11:52.290 INFO:tasks.workunit.client.0.smithi072.stderr:+ sed 's/^/ snapshots: /' 2024-03-30T15:11:52.292 INFO:tasks.workunit.client.0.smithi072.stderr:++ printf %25s watch_notify 2024-03-30T15:11:52.292 INFO:tasks.workunit.client.0.smithi072.stderr:+ r=' watch_notify' 2024-03-30T15:11:52.292 INFO:tasks.workunit.client.0.smithi072.stderr:++ echo watch_notify 2024-03-30T15:11:52.293 INFO:tasks.workunit.client.0.smithi072.stderr:++ awk '{print $1}' 2024-03-30T15:11:52.296 INFO:tasks.workunit.client.0.smithi072.stderr:+ ff=watch_notify 2024-03-30T15:11:52.297 INFO:tasks.workunit.client.0.smithi072.stdout:test watch_notify on pid 64967 2024-03-30T15:11:52.297 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64967 2024-03-30T15:11:52.297 INFO:tasks.workunit.client.0.smithi072.stderr:+ echo 'test watch_notify on pid 64967' 2024-03-30T15:11:52.297 INFO:tasks.workunit.client.0.smithi072.stderr:+ pids[$f]=64967 2024-03-30T15:11:52.298 INFO:tasks.workunit.client.0.smithi072.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-03-30T15:11:52.298 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' 1 -eq 1 ']' 2024-03-30T15:11:52.298 INFO:tasks.workunit.client.0.smithi072.stderr:++ printf %25s write_operations 2024-03-30T15:11:52.298 INFO:tasks.workunit.client.0.smithi072.stderr:+ r=' write_operations' 2024-03-30T15:11:52.298 INFO:tasks.workunit.client.0.smithi072.stderr:++ awk '{print $1}' 2024-03-30T15:11:52.298 INFO:tasks.workunit.client.0.smithi072.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_watch_notify 2>&1 | tee ceph_test_neorados_watch_notify.log | sed "s/^/ watch_notify: /"' 2024-03-30T15:11:52.300 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' -z '' ']' 2024-03-30T15:11:52.300 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.300 INFO:tasks.workunit.client.0.smithi072.stderr:+ case $- in 2024-03-30T15:11:52.300 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.300 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph_test_neorados_watch_notify 2024-03-30T15:11:52.300 INFO:tasks.workunit.client.0.smithi072.stderr:+ tee ceph_test_neorados_watch_notify.log 2024-03-30T15:11:52.300 INFO:tasks.workunit.client.0.smithi072.stderr:+ sed 's/^/ watch_notify: /' 2024-03-30T15:11:52.301 INFO:tasks.workunit.client.0.smithi072.stderr:++ echo write_operations 2024-03-30T15:11:52.306 INFO:tasks.workunit.client.0.smithi072.stderr:+ ff=write_operations 2024-03-30T15:11:52.307 INFO:tasks.workunit.client.0.smithi072.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_write_operations 2>&1 | tee ceph_test_neorados_write_operations.log | sed "s/^/ write_operations: /"' 2024-03-30T15:11:52.307 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=65000 2024-03-30T15:11:52.307 INFO:tasks.workunit.client.0.smithi072.stdout:test write_operations on pid 65000 2024-03-30T15:11:52.307 INFO:tasks.workunit.client.0.smithi072.stderr:+ echo 'test write_operations on pid 65000' 2024-03-30T15:11:52.307 INFO:tasks.workunit.client.0.smithi072.stderr:+ pids[$f]=65000 2024-03-30T15:11:52.307 INFO:tasks.workunit.client.0.smithi072.stderr:+ ret=0 2024-03-30T15:11:52.308 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' 1 -eq 1 ']' 2024-03-30T15:11:52.308 INFO:tasks.workunit.client.0.smithi072.stderr:+ for t in "${!pids[@]}" 2024-03-30T15:11:52.308 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64339 2024-03-30T15:11:52.308 INFO:tasks.workunit.client.0.smithi072.stderr:+ wait 64339 2024-03-30T15:11:52.308 INFO:tasks.workunit.client.0.smithi072.stderr:+ '[' -z '' ']' 2024-03-30T15:11:52.309 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.309 INFO:tasks.workunit.client.0.smithi072.stderr:+ case $- in 2024-03-30T15:11:52.309 INFO:tasks.workunit.client.0.smithi072.stderr:+ return 2024-03-30T15:11:52.309 INFO:tasks.workunit.client.0.smithi072.stderr:+ sed 's/^/ write_operations: /' 2024-03-30T15:11:52.313 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph_test_neorados_write_operations 2024-03-30T15:11:52.313 INFO:tasks.workunit.client.0.smithi072.stderr:+ tee ceph_test_neorados_write_operations.log 2024-03-30T15:11:53.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:11:52 smithi072 bash[21573]: audit 2024-03-30T15:11:50.938300+0000 mgr.y (mgr.14526) 158 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:11:53.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:11:52 smithi072 bash[28946]: audit 2024-03-30T15:11:50.938300+0000 mgr.y (mgr.14526) 158 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:11:53.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:11:52 smithi172 bash[23680]: audit 2024-03-30T15:11:50.938300+0000 mgr.y (mgr.14526) 158 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:11:54.916 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:11:54 smithi072 bash[28946]: audit 2024-03-30T15:11:52.136759+0000 mon.c (mon.2) 91 : audit 1 from='client.? 172.21.15.72:0/4159181360' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi072-64478-1"}]: dispatch 2024-03-30T15:11:54.916 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:11:54 smithi072 bash[28946]: audit 2024-03-30T15:11:52.155098+0000 mon.c (mon.2) 92 : audit 0 from='client.? 172.21.15.72:0/3807581202' entity='client.admin' cmd=[{"prefix":"quorum_status"}]: dispatch 2024-03-30T15:11:54.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:11:54 smithi072 bash[28946]: audit 2024-03-30T15:11:52.293130+0000 mon.c (mon.2) 93 : audit 1 from='client.? 172.21.15.72:0/3753102855' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi072-64841-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:11:54.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:11:54 smithi072 bash[28946]: audit 2024-03-30T15:11:52.318020+0000 mon.c (mon.2) 94 : audit 1 from='client.? 172.21.15.72:0/1501181106' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi072-64882-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:11:54.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:11:54 smithi072 bash[21573]: audit 2024-03-30T15:11:52.136759+0000 mon.c (mon.2) 91 : audit 1 from='client.? 172.21.15.72:0/4159181360' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi072-64478-1"}]: dispatch 2024-03-30T15:11:54.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:11:54 smithi072 bash[21573]: audit 2024-03-30T15:11:52.155098+0000 mon.c (mon.2) 92 : audit 0 from='client.? 172.21.15.72:0/3807581202' entity='client.admin' cmd=[{"prefix":"quorum_status"}]: dispatch 2024-03-30T15:11:54.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:11:54 smithi072 bash[21573]: audit 2024-03-30T15:11:52.293130+0000 mon.c (mon.2) 93 : audit 1 from='client.? 172.21.15.72:0/3753102855' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi072-64841-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:11:54.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:11:54 smithi072 bash[21573]: audit 2024-03-30T15:11:52.318020+0000 mon.c (mon.2) 94 : audit 1 from='client.? 172.21.15.72:0/1501181106' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi072-64882-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:11:54.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:11:54 smithi172 bash[23680]: audit 2024-03-30T15:11:52.136759+0000 mon.c (mon.2) 91 : audit 1 from='client.? 172.21.15.72:0/4159181360' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi072-64478-1"}]: dispatch 2024-03-30T15:11:54.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:11:54 smithi172 bash[23680]: audit 2024-03-30T15:11:52.155098+0000 mon.c (mon.2) 92 : audit 0 from='client.? 172.21.15.72:0/3807581202' entity='client.admin' cmd=[{"prefix":"quorum_status"}]: dispatch 2024-03-30T15:11:54.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:11:54 smithi172 bash[23680]: audit 2024-03-30T15:11:52.293130+0000 mon.c (mon.2) 93 : audit 1 from='client.? 172.21.15.72:0/3753102855' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi072-64841-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:11:54.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:11:54 smithi172 bash[23680]: audit 2024-03-30T15:11:52.318020+0000 mon.c (mon.2) 94 : audit 1 from='client.? 172.21.15.72:0/1501181106' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi072-64882-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:11:56.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:11:56 smithi172 bash[23680]: audit 2024-03-30T15:11:52.898104+0000 mon.c (mon.2) 95 : audit 1 from='client.? 172.21.15.72:0/3888524740' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi072-64171-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:11:56.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:11:56 smithi172 bash[23680]: cluster 2024-03-30T15:11:54.563297+0000 mon.a (mon.0) 875 : cluster 0 osdmap e75: 8 total, 8 up, 8 in 2024-03-30T15:11:57.166 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:11:56 smithi072 bash[28946]: audit 2024-03-30T15:11:52.898104+0000 mon.c (mon.2) 95 : audit 1 from='client.? 172.21.15.72:0/3888524740' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi072-64171-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:11:57.166 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:11:56 smithi072 bash[28946]: cluster 2024-03-30T15:11:54.563297+0000 mon.a (mon.0) 875 : cluster 0 osdmap e75: 8 total, 8 up, 8 in 2024-03-30T15:11:57.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:11:56 smithi072 bash[21573]: audit 2024-03-30T15:11:52.898104+0000 mon.c (mon.2) 95 : audit 1 from='client.? 172.21.15.72:0/3888524740' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi072-64171-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:11:57.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:11:56 smithi072 bash[21573]: cluster 2024-03-30T15:11:54.563297+0000 mon.a (mon.0) 875 : cluster 0 osdmap e75: 8 total, 8 up, 8 in 2024-03-30T15:12:01.216 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:12:00 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:12:01.416 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:12:01 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:12:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:12:02.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:01 smithi072 bash[21573]: cluster 2024-03-30T15:11:51.824422+0000 mgr.y (mgr.14526) 159 : cluster 0 pgmap v104: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:12:02.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:01 smithi072 bash[21573]: audit 2024-03-30T15:11:54.596409+0000 mon.c (mon.2) 96 : audit 1 from='client.? 172.21.15.72:0/1192655902' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi072-64179-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:02.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:01 smithi072 bash[21573]: audit 2024-03-30T15:11:54.596687+0000 mon.c (mon.2) 97 : audit 1 from='client.? 172.21.15.72:0/3136228998' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi072-64163-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:02.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:01 smithi072 bash[21573]: audit 2024-03-30T15:11:54.610285+0000 mon.b (mon.1) 34 : audit 1 from='client.? 172.21.15.72:0/828491431' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi072-64403-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:02.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:01 smithi072 bash[21573]: cluster 2024-03-30T15:11:56.696352+0000 mon.a (mon.0) 876 : cluster 0 osdmap e76: 8 total, 8 up, 8 in 2024-03-30T15:12:02.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:01 smithi072 bash[21573]: audit 2024-03-30T15:11:56.707289+0000 mon.a (mon.0) 877 : audit 1 from='client.? 172.21.15.72:0/2557261120' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi072-64187-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:02.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:01 smithi072 bash[21573]: audit 2024-03-30T15:11:56.715730+0000 mon.a (mon.0) 878 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi072-64478-1"}]: dispatch 2024-03-30T15:12:02.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:01 smithi072 bash[21573]: audit 2024-03-30T15:11:56.716391+0000 mon.a (mon.0) 879 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi072-64841-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:02.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:01 smithi072 bash[21573]: audit 2024-03-30T15:11:56.716693+0000 mon.a (mon.0) 880 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi072-64403-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:02.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:01 smithi072 bash[21573]: audit 2024-03-30T15:11:56.717379+0000 mon.a (mon.0) 881 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi072-64882-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:02.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:01 smithi072 bash[21573]: audit 2024-03-30T15:11:56.718203+0000 mon.a (mon.0) 882 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi072-64171-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:02.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:01 smithi072 bash[28946]: cluster 2024-03-30T15:11:51.824422+0000 mgr.y (mgr.14526) 159 : cluster 0 pgmap v104: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:12:02.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:01 smithi072 bash[28946]: audit 2024-03-30T15:11:54.596409+0000 mon.c (mon.2) 96 : audit 1 from='client.? 172.21.15.72:0/1192655902' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi072-64179-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:02.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:01 smithi072 bash[28946]: audit 2024-03-30T15:11:54.596687+0000 mon.c (mon.2) 97 : audit 1 from='client.? 172.21.15.72:0/3136228998' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi072-64163-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:02.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:01 smithi072 bash[28946]: audit 2024-03-30T15:11:54.610285+0000 mon.b (mon.1) 34 : audit 1 from='client.? 172.21.15.72:0/828491431' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi072-64403-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:02.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:01 smithi072 bash[28946]: cluster 2024-03-30T15:11:56.696352+0000 mon.a (mon.0) 876 : cluster 0 osdmap e76: 8 total, 8 up, 8 in 2024-03-30T15:12:02.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:01 smithi072 bash[28946]: audit 2024-03-30T15:11:56.707289+0000 mon.a (mon.0) 877 : audit 1 from='client.? 172.21.15.72:0/2557261120' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi072-64187-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:02.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:01 smithi072 bash[28946]: audit 2024-03-30T15:11:56.715730+0000 mon.a (mon.0) 878 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi072-64478-1"}]: dispatch 2024-03-30T15:12:02.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:01 smithi072 bash[28946]: audit 2024-03-30T15:11:56.716391+0000 mon.a (mon.0) 879 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi072-64841-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:02.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:01 smithi072 bash[28946]: audit 2024-03-30T15:11:56.716693+0000 mon.a (mon.0) 880 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi072-64403-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:02.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:01 smithi072 bash[28946]: audit 2024-03-30T15:11:56.717379+0000 mon.a (mon.0) 881 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi072-64882-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:02.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:01 smithi072 bash[28946]: audit 2024-03-30T15:11:56.718203+0000 mon.a (mon.0) 882 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi072-64171-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:02.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:01 smithi172 bash[23680]: cluster 2024-03-30T15:11:51.824422+0000 mgr.y (mgr.14526) 159 : cluster 0 pgmap v104: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:12:02.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:01 smithi172 bash[23680]: audit 2024-03-30T15:11:54.596409+0000 mon.c (mon.2) 96 : audit 1 from='client.? 172.21.15.72:0/1192655902' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi072-64179-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:02.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:01 smithi172 bash[23680]: audit 2024-03-30T15:11:54.596687+0000 mon.c (mon.2) 97 : audit 1 from='client.? 172.21.15.72:0/3136228998' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi072-64163-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:02.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:01 smithi172 bash[23680]: audit 2024-03-30T15:11:54.610285+0000 mon.b (mon.1) 34 : audit 1 from='client.? 172.21.15.72:0/828491431' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi072-64403-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:02.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:01 smithi172 bash[23680]: cluster 2024-03-30T15:11:56.696352+0000 mon.a (mon.0) 876 : cluster 0 osdmap e76: 8 total, 8 up, 8 in 2024-03-30T15:12:02.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:01 smithi172 bash[23680]: audit 2024-03-30T15:11:56.707289+0000 mon.a (mon.0) 877 : audit 1 from='client.? 172.21.15.72:0/2557261120' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi072-64187-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:02.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:01 smithi172 bash[23680]: audit 2024-03-30T15:11:56.715730+0000 mon.a (mon.0) 878 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi072-64478-1"}]: dispatch 2024-03-30T15:12:02.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:01 smithi172 bash[23680]: audit 2024-03-30T15:11:56.716391+0000 mon.a (mon.0) 879 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi072-64841-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:02.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:01 smithi172 bash[23680]: audit 2024-03-30T15:11:56.716693+0000 mon.a (mon.0) 880 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi072-64403-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:02.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:01 smithi172 bash[23680]: audit 2024-03-30T15:11:56.717379+0000 mon.a (mon.0) 881 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi072-64882-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:02.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:01 smithi172 bash[23680]: audit 2024-03-30T15:11:56.718203+0000 mon.a (mon.0) 882 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi072-64171-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:07.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:07 smithi072 bash[21573]: cluster 2024-03-30T15:11:53.825311+0000 mgr.y (mgr.14526) 160 : cluster 0 pgmap v106: 196 pgs: 64 unknown, 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T15:12:07.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:07 smithi072 bash[21573]: cluster 2024-03-30T15:11:55.827649+0000 mgr.y (mgr.14526) 161 : cluster 0 pgmap v108: 324 pgs: 162 creating+peering, 132 active+clean, 30 unknown; 582 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:12:07.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:07 smithi072 bash[21573]: audit 2024-03-30T15:11:56.733210+0000 mon.c (mon.2) 98 : audit 1 from='client.? 172.21.15.72:0/315489187' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi072-64211-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:07.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:07 smithi072 bash[21573]: audit 2024-03-30T15:11:56.733571+0000 mon.c (mon.2) 99 : audit 1 from='client.? 172.21.15.72:0/1197155236' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi072-64344-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:07.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:07 smithi072 bash[21573]: audit 2024-03-30T15:11:57.134097+0000 mon.c (mon.2) 100 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:12:07.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:07 smithi072 bash[21573]: audit 2024-03-30T15:11:57.809803+0000 mon.c (mon.2) 101 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:12:07.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:07 smithi072 bash[21573]: audit 2024-03-30T15:11:57.810955+0000 mon.c (mon.2) 102 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:12:07.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:07 smithi072 bash[21573]: audit 2024-03-30T15:12:00.235394+0000 mon.c (mon.2) 103 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:12:07.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:07 smithi072 bash[21573]: audit 2024-03-30T15:12:00.583990+0000 mon.c (mon.2) 104 : audit 1 from='client.? 172.21.15.72:0/4159181360' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi072-64478-1"}]: dispatch 2024-03-30T15:12:07.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:07 smithi072 bash[21573]: cluster 2024-03-30T15:12:01.894922+0000 mon.a (mon.0) 883 : cluster 0 osdmap e77: 8 total, 8 up, 8 in 2024-03-30T15:12:07.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:07 smithi072 bash[21573]: audit 2024-03-30T15:12:01.916538+0000 mon.a (mon.0) 884 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi072-64179-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:07.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:07 smithi072 bash[21573]: audit 2024-03-30T15:12:01.918157+0000 mon.a (mon.0) 885 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi072-64163-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:07.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:07 smithi072 bash[28946]: cluster 2024-03-30T15:11:53.825311+0000 mgr.y (mgr.14526) 160 : cluster 0 pgmap v106: 196 pgs: 64 unknown, 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T15:12:07.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:07 smithi072 bash[28946]: cluster 2024-03-30T15:11:55.827649+0000 mgr.y (mgr.14526) 161 : cluster 0 pgmap v108: 324 pgs: 162 creating+peering, 132 active+clean, 30 unknown; 582 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:12:07.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:07 smithi072 bash[28946]: audit 2024-03-30T15:11:56.733210+0000 mon.c (mon.2) 98 : audit 1 from='client.? 172.21.15.72:0/315489187' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi072-64211-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:07.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:07 smithi072 bash[28946]: audit 2024-03-30T15:11:56.733571+0000 mon.c (mon.2) 99 : audit 1 from='client.? 172.21.15.72:0/1197155236' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi072-64344-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:07.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:07 smithi072 bash[28946]: audit 2024-03-30T15:11:57.134097+0000 mon.c (mon.2) 100 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:12:07.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:07 smithi072 bash[28946]: audit 2024-03-30T15:11:57.809803+0000 mon.c (mon.2) 101 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:12:07.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:07 smithi072 bash[28946]: audit 2024-03-30T15:11:57.810955+0000 mon.c (mon.2) 102 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:12:07.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:07 smithi072 bash[28946]: audit 2024-03-30T15:12:00.235394+0000 mon.c (mon.2) 103 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:12:07.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:07 smithi072 bash[28946]: audit 2024-03-30T15:12:00.583990+0000 mon.c (mon.2) 104 : audit 1 from='client.? 172.21.15.72:0/4159181360' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi072-64478-1"}]: dispatch 2024-03-30T15:12:07.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:07 smithi072 bash[28946]: cluster 2024-03-30T15:12:01.894922+0000 mon.a (mon.0) 883 : cluster 0 osdmap e77: 8 total, 8 up, 8 in 2024-03-30T15:12:07.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:07 smithi072 bash[28946]: audit 2024-03-30T15:12:01.916538+0000 mon.a (mon.0) 884 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi072-64179-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:07.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:07 smithi072 bash[28946]: audit 2024-03-30T15:12:01.918157+0000 mon.a (mon.0) 885 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi072-64163-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:07.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:07 smithi172 bash[23680]: cluster 2024-03-30T15:11:53.825311+0000 mgr.y (mgr.14526) 160 : cluster 0 pgmap v106: 196 pgs: 64 unknown, 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T15:12:07.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:07 smithi172 bash[23680]: cluster 2024-03-30T15:11:55.827649+0000 mgr.y (mgr.14526) 161 : cluster 0 pgmap v108: 324 pgs: 162 creating+peering, 132 active+clean, 30 unknown; 582 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:12:07.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:07 smithi172 bash[23680]: audit 2024-03-30T15:11:56.733210+0000 mon.c (mon.2) 98 : audit 1 from='client.? 172.21.15.72:0/315489187' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi072-64211-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:07.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:07 smithi172 bash[23680]: audit 2024-03-30T15:11:56.733571+0000 mon.c (mon.2) 99 : audit 1 from='client.? 172.21.15.72:0/1197155236' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi072-64344-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:07.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:07 smithi172 bash[23680]: audit 2024-03-30T15:11:57.134097+0000 mon.c (mon.2) 100 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:12:07.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:07 smithi172 bash[23680]: audit 2024-03-30T15:11:57.809803+0000 mon.c (mon.2) 101 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:12:07.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:07 smithi172 bash[23680]: audit 2024-03-30T15:11:57.810955+0000 mon.c (mon.2) 102 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:12:07.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:07 smithi172 bash[23680]: audit 2024-03-30T15:12:00.235394+0000 mon.c (mon.2) 103 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:12:07.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:07 smithi172 bash[23680]: audit 2024-03-30T15:12:00.583990+0000 mon.c (mon.2) 104 : audit 1 from='client.? 172.21.15.72:0/4159181360' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi072-64478-1"}]: dispatch 2024-03-30T15:12:07.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:07 smithi172 bash[23680]: cluster 2024-03-30T15:12:01.894922+0000 mon.a (mon.0) 883 : cluster 0 osdmap e77: 8 total, 8 up, 8 in 2024-03-30T15:12:07.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:07 smithi172 bash[23680]: audit 2024-03-30T15:12:01.916538+0000 mon.a (mon.0) 884 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi072-64179-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:07.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:07 smithi172 bash[23680]: audit 2024-03-30T15:12:01.918157+0000 mon.a (mon.0) 885 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi072-64163-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:08.473 INFO:tasks.workunit.client.0.smithi072.stdout: api_asio: [==========] Running 12 tests from 1 test suite. 2024-03-30T15:12:08.474 INFO:tasks.workunit.client.0.smithi072.stdout: api_asio: [----------] Global test environment set-up. 2024-03-30T15:12:08.474 INFO:tasks.workunit.client.0.smithi072.stdout: api_asio: [----------] 12 tests from AsioRados 2024-03-30T15:12:08.474 INFO:tasks.workunit.client.0.smithi072.stdout: api_asio: [ RUN ] AsioRados.AsyncReadCallback 2024-03-30T15:12:08.474 INFO:tasks.workunit.client.0.smithi072.stdout: api_asio: [ OK ] AsioRados.AsyncReadCallback (1 ms) 2024-03-30T15:12:08.474 INFO:tasks.workunit.client.0.smithi072.stdout: api_asio: [ RUN ] AsioRados.AsyncReadFuture 2024-03-30T15:12:08.474 INFO:tasks.workunit.client.0.smithi072.stdout: api_asio: [ OK ] AsioRados.AsyncReadFuture (0 ms) 2024-03-30T15:12:08.474 INFO:tasks.workunit.client.0.smithi072.stdout: api_asio: [ RUN ] AsioRados.AsyncReadYield 2024-03-30T15:12:08.474 INFO:tasks.workunit.client.0.smithi072.stdout: api_asio: [ OK ] AsioRados.AsyncReadYield (1 ms) 2024-03-30T15:12:08.474 INFO:tasks.workunit.client.0.smithi072.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteCallback 2024-03-30T15:12:08.474 INFO:tasks.workunit.client.0.smithi072.stdout: api_asio: [ OK ] AsioRados.AsyncWriteCallback (10 ms) 2024-03-30T15:12:08.474 INFO:tasks.workunit.client.0.smithi072.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteFuture 2024-03-30T15:12:08.474 INFO:tasks.workunit.client.0.smithi072.stdout: api_asio: [ OK ] AsioRados.AsyncWriteFuture (2 ms) 2024-03-30T15:12:08.475 INFO:tasks.workunit.client.0.smithi072.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteYield 2024-03-30T15:12:08.475 INFO:tasks.workunit.client.0.smithi072.stdout: api_asio: [ OK ] AsioRados.AsyncWriteYield (4 ms) 2024-03-30T15:12:08.475 INFO:tasks.workunit.client.0.smithi072.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCallback 2024-03-30T15:12:08.475 INFO:tasks.workunit.client.0.smithi072.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCallback (0 ms) 2024-03-30T15:12:08.475 INFO:tasks.workunit.client.0.smithi072.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationFuture 2024-03-30T15:12:08.475 INFO:tasks.workunit.client.0.smithi072.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationFuture (0 ms) 2024-03-30T15:12:08.475 INFO:tasks.workunit.client.0.smithi072.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationYield 2024-03-30T15:12:08.475 INFO:tasks.workunit.client.0.smithi072.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationYield (1 ms) 2024-03-30T15:12:08.475 INFO:tasks.workunit.client.0.smithi072.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCallback 2024-03-30T15:12:08.475 INFO:tasks.workunit.client.0.smithi072.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCallback (1 ms) 2024-03-30T15:12:08.475 INFO:tasks.workunit.client.0.smithi072.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationFuture 2024-03-30T15:12:08.475 INFO:tasks.workunit.client.0.smithi072.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationFuture (4 ms) 2024-03-30T15:12:08.475 INFO:tasks.workunit.client.0.smithi072.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationYield 2024-03-30T15:12:08.476 INFO:tasks.workunit.client.0.smithi072.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationYield (2 ms) 2024-03-30T15:12:08.476 INFO:tasks.workunit.client.0.smithi072.stdout: api_asio: [----------] 12 tests from AsioRados (26 ms total) 2024-03-30T15:12:08.476 INFO:tasks.workunit.client.0.smithi072.stdout: api_asio: 2024-03-30T15:12:08.476 INFO:tasks.workunit.client.0.smithi072.stdout: api_asio: [----------] Global test environment tear-down 2024-03-30T15:12:08.476 INFO:tasks.workunit.client.0.smithi072.stdout: api_asio: [==========] 12 tests from 1 test suite ran. (16483 ms total) 2024-03-30T15:12:08.476 INFO:tasks.workunit.client.0.smithi072.stdout: api_asio: [ PASSED ] 12 tests. 2024-03-30T15:12:09.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: cluster 2024-03-30T15:11:57.813050+0000 mgr.y (mgr.14526) 162 : cluster 0 pgmap v110: 484 pgs: 162 creating+peering, 132 active+clean, 190 unknown; 582 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 854 B/s rd, 0 op/s 2024-03-30T15:12:09.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: cluster 2024-03-30T15:11:59.814055+0000 mgr.y (mgr.14526) 163 : cluster 0 pgmap v111: 484 pgs: 162 creating+peering, 132 active+clean, 190 unknown; 582 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 739 B/s rd, 0 op/s 2024-03-30T15:12:09.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: audit 2024-03-30T15:12:00.949576+0000 mgr.y (mgr.14526) 164 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:12:09.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: cluster 2024-03-30T15:12:01.817913+0000 mgr.y (mgr.14526) 165 : cluster 0 pgmap v112: 484 pgs: 285 creating+peering, 164 active+clean, 35 unknown; 582 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T15:12:09.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: audit 2024-03-30T15:12:01.931967+0000 mon.a (mon.0) 886 : audit 1 from='client.? 172.21.15.72:0/2557261120' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi072-64187-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:09.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: audit 2024-03-30T15:12:01.932052+0000 mon.a (mon.0) 887 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi072-64841-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:12:09.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: audit 2024-03-30T15:12:01.932130+0000 mon.a (mon.0) 888 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi072-64403-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:09.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: audit 2024-03-30T15:12:01.943373+0000 mon.c (mon.2) 105 : audit 1 from='client.? 172.21.15.72:0/219341856' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: audit 2024-03-30T15:12:01.947372+0000 mon.c (mon.2) 106 : audit 1 from='client.? 172.21.15.72:0/3753102855' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritesmithi072-64841-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi072-64841-1"}]: dispatch 2024-03-30T15:12:09.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: audit 2024-03-30T15:12:01.948663+0000 mon.c (mon.2) 107 : audit 1 from='client.? 172.21.15.72:0/3540524828' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi072-64378-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: audit 2024-03-30T15:12:01.948892+0000 mon.c (mon.2) 108 : audit 1 from='client.? 172.21.15.72:0/2189445623' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64502-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: cluster 2024-03-30T15:12:03.819494+0000 mgr.y (mgr.14526) 166 : cluster 0 pgmap v114: 868 pgs: 285 creating+peering, 164 active+clean, 419 unknown; 582 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 640 B/s rd, 0 op/s 2024-03-30T15:12:09.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: cluster 2024-03-30T15:12:05.825486+0000 mgr.y (mgr.14526) 167 : cluster 0 pgmap v115: 868 pgs: 548 creating+peering, 211 active+clean, 109 unknown; 582 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 112 B/s wr, 1 op/s 2024-03-30T15:12:09.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: cluster 2024-03-30T15:12:06.937229+0000 mon.a (mon.0) 889 : cluster 0 osdmap e78: 8 total, 8 up, 8 in 2024-03-30T15:12:09.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: cluster 2024-03-30T15:12:06.938401+0000 mon.a (mon.0) 890 : cluster 3 Health check failed: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:12:09.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: audit 2024-03-30T15:12:06.953102+0000 mon.a (mon.0) 891 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi072-64211-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: audit 2024-03-30T15:12:06.956067+0000 mon.a (mon.0) 892 : audit 1 from='client.? 172.21.15.72:0/686948711' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi072-64256-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: audit 2024-03-30T15:12:06.956663+0000 mon.a (mon.0) 893 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi072-64344-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: audit 2024-03-30T15:12:06.957073+0000 mon.a (mon.0) 894 : audit 1 from='client.? 172.21.15.72:0/805668547' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64597-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: audit 2024-03-30T15:12:06.957434+0000 mon.a (mon.0) 895 : audit 1 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi072-64203-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: audit 2024-03-30T15:12:06.960728+0000 mon.a (mon.0) 896 : audit 1 from='client.? 172.21.15.72:0/2700228879' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi072-64386-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: audit 2024-03-30T15:12:06.996440+0000 mon.a (mon.0) 897 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi072-64179-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:09.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: audit 2024-03-30T15:12:06.996526+0000 mon.a (mon.0) 898 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBig_smithi072-64163-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:09.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: audit 2024-03-30T15:12:06.996615+0000 mon.a (mon.0) 899 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi072-64882-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:12:09.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: audit 2024-03-30T15:12:06.996698+0000 mon.a (mon.0) 900 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi072-64171-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:09.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: audit 2024-03-30T15:12:07.004612+0000 mon.a (mon.0) 901 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:12:09.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: audit 2024-03-30T15:12:07.019858+0000 mon.c (mon.2) 109 : audit 1 from='client.? 172.21.15.72:0/1501181106' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectssmithi072-64882-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi072-64882-1"}]: dispatch 2024-03-30T15:12:09.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: audit 2024-03-30T15:12:07.021499+0000 mon.c (mon.2) 110 : audit 1 from='client.? 172.21.15.72:0/3306144535' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64541-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: cluster 2024-03-30T15:11:57.813050+0000 mgr.y (mgr.14526) 162 : cluster 0 pgmap v110: 484 pgs: 162 creating+peering, 132 active+clean, 190 unknown; 582 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 854 B/s rd, 0 op/s 2024-03-30T15:12:09.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: cluster 2024-03-30T15:11:59.814055+0000 mgr.y (mgr.14526) 163 : cluster 0 pgmap v111: 484 pgs: 162 creating+peering, 132 active+clean, 190 unknown; 582 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 739 B/s rd, 0 op/s 2024-03-30T15:12:09.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: audit 2024-03-30T15:12:00.949576+0000 mgr.y (mgr.14526) 164 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:12:09.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: cluster 2024-03-30T15:12:01.817913+0000 mgr.y (mgr.14526) 165 : cluster 0 pgmap v112: 484 pgs: 285 creating+peering, 164 active+clean, 35 unknown; 582 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T15:12:09.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: audit 2024-03-30T15:12:01.931967+0000 mon.a (mon.0) 886 : audit 1 from='client.? 172.21.15.72:0/2557261120' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi072-64187-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:09.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: audit 2024-03-30T15:12:01.932052+0000 mon.a (mon.0) 887 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi072-64841-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:12:09.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: audit 2024-03-30T15:12:01.932130+0000 mon.a (mon.0) 888 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi072-64403-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:09.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: audit 2024-03-30T15:12:01.943373+0000 mon.c (mon.2) 105 : audit 1 from='client.? 172.21.15.72:0/219341856' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: audit 2024-03-30T15:12:01.947372+0000 mon.c (mon.2) 106 : audit 1 from='client.? 172.21.15.72:0/3753102855' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritesmithi072-64841-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi072-64841-1"}]: dispatch 2024-03-30T15:12:09.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: audit 2024-03-30T15:12:01.948663+0000 mon.c (mon.2) 107 : audit 1 from='client.? 172.21.15.72:0/3540524828' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi072-64378-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: audit 2024-03-30T15:12:01.948892+0000 mon.c (mon.2) 108 : audit 1 from='client.? 172.21.15.72:0/2189445623' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64502-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: cluster 2024-03-30T15:12:03.819494+0000 mgr.y (mgr.14526) 166 : cluster 0 pgmap v114: 868 pgs: 285 creating+peering, 164 active+clean, 419 unknown; 582 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 640 B/s rd, 0 op/s 2024-03-30T15:12:09.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: cluster 2024-03-30T15:12:05.825486+0000 mgr.y (mgr.14526) 167 : cluster 0 pgmap v115: 868 pgs: 548 creating+peering, 211 active+clean, 109 unknown; 582 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 112 B/s wr, 1 op/s 2024-03-30T15:12:09.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: cluster 2024-03-30T15:12:06.937229+0000 mon.a (mon.0) 889 : cluster 0 osdmap e78: 8 total, 8 up, 8 in 2024-03-30T15:12:09.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: audit 2024-03-30T15:12:07.024321+0000 mon.c (mon.2) 111 : audit 1 from='client.? 172.21.15.72:0/2927380824' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi072-64425-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: audit 2024-03-30T15:12:07.024522+0000 mon.c (mon.2) 112 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi072-64321-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: audit 2024-03-30T15:12:07.026229+0000 mon.c (mon.2) 113 : audit 1 from='client.? 172.21.15.72:0/2858726016' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: cluster 2024-03-30T15:12:07.450310+0000 mon.a (mon.0) 902 : cluster 0 osdmap e79: 8 total, 8 up, 8 in 2024-03-30T15:12:09.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: audit 2024-03-30T15:12:07.454978+0000 mon.a (mon.0) 903 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi072-64478-1"}]: dispatch 2024-03-30T15:12:09.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: audit 2024-03-30T15:12:07.456235+0000 mon.c (mon.2) 114 : audit 1 from='client.? 172.21.15.72:0/4159181360' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi072-64478-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:09.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: audit 2024-03-30T15:12:07.458124+0000 mon.a (mon.0) 904 : audit 1 from='client.? 172.21.15.72:0/4261885491' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi072-64444-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: audit 2024-03-30T15:12:07.458456+0000 mon.a (mon.0) 905 : audit 1 from='client.? 172.21.15.72:0/3509351110' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi072-64600-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: audit 2024-03-30T15:12:07.458710+0000 mon.a (mon.0) 906 : audit 0 from='client.? 172.21.15.72:0/1198903700' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-03-30T15:12:09.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: audit 2024-03-30T15:12:07.464023+0000 mon.a (mon.0) 907 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: audit 2024-03-30T15:12:07.464654+0000 mon.a (mon.0) 908 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritesmithi072-64841-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi072-64841-1"}]: dispatch 2024-03-30T15:12:09.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: audit 2024-03-30T15:12:07.465389+0000 mon.a (mon.0) 909 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi072-64378-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: audit 2024-03-30T15:12:07.466124+0000 mon.a (mon.0) 910 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64502-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: audit 2024-03-30T15:12:07.476379+0000 mon.a (mon.0) 911 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectssmithi072-64882-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi072-64882-1"}]: dispatch 2024-03-30T15:12:09.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: audit 2024-03-30T15:12:07.476943+0000 mon.a (mon.0) 912 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64541-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: audit 2024-03-30T15:12:07.477527+0000 mon.a (mon.0) 913 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi072-64425-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: audit 2024-03-30T15:12:07.478286+0000 mon.a (mon.0) 914 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi072-64321-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: audit 2024-03-30T15:12:07.479325+0000 mon.a (mon.0) 915 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: audit 2024-03-30T15:12:07.490081+0000 mon.a (mon.0) 916 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi072-64478-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:09.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[21573]: cluster 2024-03-30T15:12:07.986696+0000 mon.a (mon.0) 917 : cluster 3 Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-03-30T15:12:09.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: cluster 2024-03-30T15:12:06.938401+0000 mon.a (mon.0) 890 : cluster 3 Health check failed: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:12:09.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: audit 2024-03-30T15:12:06.953102+0000 mon.a (mon.0) 891 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi072-64211-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: audit 2024-03-30T15:12:06.956067+0000 mon.a (mon.0) 892 : audit 1 from='client.? 172.21.15.72:0/686948711' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi072-64256-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: audit 2024-03-30T15:12:06.956663+0000 mon.a (mon.0) 893 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi072-64344-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: audit 2024-03-30T15:12:06.957073+0000 mon.a (mon.0) 894 : audit 1 from='client.? 172.21.15.72:0/805668547' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64597-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: audit 2024-03-30T15:12:06.957434+0000 mon.a (mon.0) 895 : audit 1 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi072-64203-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: audit 2024-03-30T15:12:06.960728+0000 mon.a (mon.0) 896 : audit 1 from='client.? 172.21.15.72:0/2700228879' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi072-64386-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: audit 2024-03-30T15:12:06.996440+0000 mon.a (mon.0) 897 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi072-64179-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:09.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: audit 2024-03-30T15:12:06.996526+0000 mon.a (mon.0) 898 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBig_smithi072-64163-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:09.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: audit 2024-03-30T15:12:06.996615+0000 mon.a (mon.0) 899 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi072-64882-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:12:09.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: audit 2024-03-30T15:12:06.996698+0000 mon.a (mon.0) 900 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi072-64171-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:09.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: audit 2024-03-30T15:12:07.004612+0000 mon.a (mon.0) 901 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:12:09.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: audit 2024-03-30T15:12:07.019858+0000 mon.c (mon.2) 109 : audit 1 from='client.? 172.21.15.72:0/1501181106' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectssmithi072-64882-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi072-64882-1"}]: dispatch 2024-03-30T15:12:09.424 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: audit 2024-03-30T15:12:07.021499+0000 mon.c (mon.2) 110 : audit 1 from='client.? 172.21.15.72:0/3306144535' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64541-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.424 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: audit 2024-03-30T15:12:07.024321+0000 mon.c (mon.2) 111 : audit 1 from='client.? 172.21.15.72:0/2927380824' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi072-64425-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.424 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: audit 2024-03-30T15:12:07.024522+0000 mon.c (mon.2) 112 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi072-64321-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.424 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: audit 2024-03-30T15:12:07.026229+0000 mon.c (mon.2) 113 : audit 1 from='client.? 172.21.15.72:0/2858726016' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.424 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: cluster 2024-03-30T15:12:07.450310+0000 mon.a (mon.0) 902 : cluster 0 osdmap e79: 8 total, 8 up, 8 in 2024-03-30T15:12:09.424 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: audit 2024-03-30T15:12:07.454978+0000 mon.a (mon.0) 903 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi072-64478-1"}]: dispatch 2024-03-30T15:12:09.424 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: audit 2024-03-30T15:12:07.456235+0000 mon.c (mon.2) 114 : audit 1 from='client.? 172.21.15.72:0/4159181360' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi072-64478-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:09.424 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: audit 2024-03-30T15:12:07.458124+0000 mon.a (mon.0) 904 : audit 1 from='client.? 172.21.15.72:0/4261885491' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi072-64444-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.424 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: audit 2024-03-30T15:12:07.458456+0000 mon.a (mon.0) 905 : audit 1 from='client.? 172.21.15.72:0/3509351110' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi072-64600-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.424 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: audit 2024-03-30T15:12:07.458710+0000 mon.a (mon.0) 906 : audit 0 from='client.? 172.21.15.72:0/1198903700' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-03-30T15:12:09.424 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: audit 2024-03-30T15:12:07.464023+0000 mon.a (mon.0) 907 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.424 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: audit 2024-03-30T15:12:07.464654+0000 mon.a (mon.0) 908 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritesmithi072-64841-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi072-64841-1"}]: dispatch 2024-03-30T15:12:09.424 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: audit 2024-03-30T15:12:07.465389+0000 mon.a (mon.0) 909 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi072-64378-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.424 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: audit 2024-03-30T15:12:07.466124+0000 mon.a (mon.0) 910 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64502-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.424 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: audit 2024-03-30T15:12:07.476379+0000 mon.a (mon.0) 911 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectssmithi072-64882-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi072-64882-1"}]: dispatch 2024-03-30T15:12:09.425 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: audit 2024-03-30T15:12:07.476943+0000 mon.a (mon.0) 912 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64541-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.425 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: audit 2024-03-30T15:12:07.477527+0000 mon.a (mon.0) 913 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi072-64425-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.425 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: audit 2024-03-30T15:12:07.478286+0000 mon.a (mon.0) 914 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi072-64321-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.425 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: audit 2024-03-30T15:12:07.479325+0000 mon.a (mon.0) 915 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.425 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: audit 2024-03-30T15:12:07.490081+0000 mon.a (mon.0) 916 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi072-64478-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:09.425 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:09 smithi072 bash[28946]: cluster 2024-03-30T15:12:07.986696+0000 mon.a (mon.0) 917 : cluster 3 Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-03-30T15:12:09.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: cluster 2024-03-30T15:11:57.813050+0000 mgr.y (mgr.14526) 162 : cluster 0 pgmap v110: 484 pgs: 162 creating+peering, 132 active+clean, 190 unknown; 582 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 854 B/s rd, 0 op/s 2024-03-30T15:12:09.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: cluster 2024-03-30T15:11:59.814055+0000 mgr.y (mgr.14526) 163 : cluster 0 pgmap v111: 484 pgs: 162 creating+peering, 132 active+clean, 190 unknown; 582 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 739 B/s rd, 0 op/s 2024-03-30T15:12:09.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: audit 2024-03-30T15:12:00.949576+0000 mgr.y (mgr.14526) 164 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:12:09.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: cluster 2024-03-30T15:12:01.817913+0000 mgr.y (mgr.14526) 165 : cluster 0 pgmap v112: 484 pgs: 285 creating+peering, 164 active+clean, 35 unknown; 582 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T15:12:09.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: audit 2024-03-30T15:12:01.931967+0000 mon.a (mon.0) 886 : audit 1 from='client.? 172.21.15.72:0/2557261120' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi072-64187-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:09.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: audit 2024-03-30T15:12:01.932052+0000 mon.a (mon.0) 887 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi072-64841-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:12:09.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: audit 2024-03-30T15:12:01.932130+0000 mon.a (mon.0) 888 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi072-64403-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:09.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: audit 2024-03-30T15:12:01.943373+0000 mon.c (mon.2) 105 : audit 1 from='client.? 172.21.15.72:0/219341856' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: audit 2024-03-30T15:12:01.947372+0000 mon.c (mon.2) 106 : audit 1 from='client.? 172.21.15.72:0/3753102855' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritesmithi072-64841-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi072-64841-1"}]: dispatch 2024-03-30T15:12:09.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: audit 2024-03-30T15:12:01.948663+0000 mon.c (mon.2) 107 : audit 1 from='client.? 172.21.15.72:0/3540524828' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi072-64378-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: audit 2024-03-30T15:12:01.948892+0000 mon.c (mon.2) 108 : audit 1 from='client.? 172.21.15.72:0/2189445623' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64502-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: cluster 2024-03-30T15:12:03.819494+0000 mgr.y (mgr.14526) 166 : cluster 0 pgmap v114: 868 pgs: 285 creating+peering, 164 active+clean, 419 unknown; 582 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 640 B/s rd, 0 op/s 2024-03-30T15:12:09.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: cluster 2024-03-30T15:12:05.825486+0000 mgr.y (mgr.14526) 167 : cluster 0 pgmap v115: 868 pgs: 548 creating+peering, 211 active+clean, 109 unknown; 582 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 112 B/s wr, 1 op/s 2024-03-30T15:12:09.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: cluster 2024-03-30T15:12:06.937229+0000 mon.a (mon.0) 889 : cluster 0 osdmap e78: 8 total, 8 up, 8 in 2024-03-30T15:12:09.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: cluster 2024-03-30T15:12:06.938401+0000 mon.a (mon.0) 890 : cluster 3 Health check failed: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:12:09.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: audit 2024-03-30T15:12:06.953102+0000 mon.a (mon.0) 891 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi072-64211-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: audit 2024-03-30T15:12:06.956067+0000 mon.a (mon.0) 892 : audit 1 from='client.? 172.21.15.72:0/686948711' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi072-64256-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: audit 2024-03-30T15:12:06.956663+0000 mon.a (mon.0) 893 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi072-64344-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: audit 2024-03-30T15:12:06.957073+0000 mon.a (mon.0) 894 : audit 1 from='client.? 172.21.15.72:0/805668547' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64597-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: audit 2024-03-30T15:12:06.957434+0000 mon.a (mon.0) 895 : audit 1 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi072-64203-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: audit 2024-03-30T15:12:06.960728+0000 mon.a (mon.0) 896 : audit 1 from='client.? 172.21.15.72:0/2700228879' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi072-64386-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: audit 2024-03-30T15:12:06.996440+0000 mon.a (mon.0) 897 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi072-64179-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:09.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: audit 2024-03-30T15:12:06.996526+0000 mon.a (mon.0) 898 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBig_smithi072-64163-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:09.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: audit 2024-03-30T15:12:06.996615+0000 mon.a (mon.0) 899 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi072-64882-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:12:09.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: audit 2024-03-30T15:12:06.996698+0000 mon.a (mon.0) 900 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi072-64171-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:09.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: audit 2024-03-30T15:12:07.004612+0000 mon.a (mon.0) 901 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:12:09.469 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: audit 2024-03-30T15:12:07.019858+0000 mon.c (mon.2) 109 : audit 1 from='client.? 172.21.15.72:0/1501181106' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectssmithi072-64882-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi072-64882-1"}]: dispatch 2024-03-30T15:12:09.469 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: audit 2024-03-30T15:12:07.021499+0000 mon.c (mon.2) 110 : audit 1 from='client.? 172.21.15.72:0/3306144535' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64541-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.469 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: audit 2024-03-30T15:12:07.024321+0000 mon.c (mon.2) 111 : audit 1 from='client.? 172.21.15.72:0/2927380824' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi072-64425-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.469 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: audit 2024-03-30T15:12:07.024522+0000 mon.c (mon.2) 112 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi072-64321-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.469 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: audit 2024-03-30T15:12:07.026229+0000 mon.c (mon.2) 113 : audit 1 from='client.? 172.21.15.72:0/2858726016' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.469 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: cluster 2024-03-30T15:12:07.450310+0000 mon.a (mon.0) 902 : cluster 0 osdmap e79: 8 total, 8 up, 8 in 2024-03-30T15:12:09.469 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: audit 2024-03-30T15:12:07.454978+0000 mon.a (mon.0) 903 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi072-64478-1"}]: dispatch 2024-03-30T15:12:09.469 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: audit 2024-03-30T15:12:07.456235+0000 mon.c (mon.2) 114 : audit 1 from='client.? 172.21.15.72:0/4159181360' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi072-64478-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:09.469 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: audit 2024-03-30T15:12:07.458124+0000 mon.a (mon.0) 904 : audit 1 from='client.? 172.21.15.72:0/4261885491' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi072-64444-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.469 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: audit 2024-03-30T15:12:07.458456+0000 mon.a (mon.0) 905 : audit 1 from='client.? 172.21.15.72:0/3509351110' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi072-64600-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.469 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: audit 2024-03-30T15:12:07.458710+0000 mon.a (mon.0) 906 : audit 0 from='client.? 172.21.15.72:0/1198903700' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-03-30T15:12:09.469 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: audit 2024-03-30T15:12:07.464023+0000 mon.a (mon.0) 907 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.469 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: audit 2024-03-30T15:12:07.464654+0000 mon.a (mon.0) 908 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritesmithi072-64841-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi072-64841-1"}]: dispatch 2024-03-30T15:12:09.469 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: audit 2024-03-30T15:12:07.465389+0000 mon.a (mon.0) 909 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi072-64378-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.469 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: audit 2024-03-30T15:12:07.466124+0000 mon.a (mon.0) 910 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64502-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.469 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: audit 2024-03-30T15:12:07.476379+0000 mon.a (mon.0) 911 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectssmithi072-64882-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi072-64882-1"}]: dispatch 2024-03-30T15:12:09.470 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: audit 2024-03-30T15:12:07.476943+0000 mon.a (mon.0) 912 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64541-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.470 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: audit 2024-03-30T15:12:07.477527+0000 mon.a (mon.0) 913 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi072-64425-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.470 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: audit 2024-03-30T15:12:07.478286+0000 mon.a (mon.0) 914 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi072-64321-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.470 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: audit 2024-03-30T15:12:07.479325+0000 mon.a (mon.0) 915 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:09.470 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: audit 2024-03-30T15:12:07.490081+0000 mon.a (mon.0) 916 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi072-64478-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:09.470 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:09 smithi172 bash[23680]: cluster 2024-03-30T15:12:07.986696+0000 mon.a (mon.0) 917 : cluster 3 Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-03-30T15:12:09.478 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: [==========] Running 11 tests from 3 test suites. 2024-03-30T15:12:09.478 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: [----------] Global test environment set-up. 2024-03-30T15:12:09.478 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: [----------] 7 tests from LibRadosList 2024-03-30T15:12:09.478 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: [ RUN ] LibRadosList.ListObjects 2024-03-30T15:12:09.478 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: [ OK ] LibRadosList.ListObjects (133 ms) 2024-03-30T15:12:09.478 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: [ RUN ] LibRadosList.ListObjectsZeroInName 2024-03-30T15:12:09.478 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: [ OK ] LibRadosList.ListObjectsZeroInName (30 ms) 2024-03-30T15:12:09.478 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: [ RUN ] LibRadosList.ListObjectsNS 2024-03-30T15:12:09.478 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: myset foo1,foo2,foo3 2024-03-30T15:12:09.478 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: foo1 2024-03-30T15:12:09.478 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: foo2 2024-03-30T15:12:09.478 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: foo3 2024-03-30T15:12:09.479 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: myset foo1,foo4,foo5 2024-03-30T15:12:09.479 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: foo4 2024-03-30T15:12:09.479 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: foo5 2024-03-30T15:12:09.479 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: foo1 2024-03-30T15:12:09.479 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: myset foo6,foo7 2024-03-30T15:12:09.479 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: foo7 2024-03-30T15:12:09.479 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: foo6 2024-03-30T15:12:09.479 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-03-30T15:12:09.479 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: ns1:foo4 2024-03-30T15:12:09.479 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: ns1:foo5 2024-03-30T15:12:09.479 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: ns2:foo7 2024-03-30T15:12:09.479 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: ns2:foo6 2024-03-30T15:12:09.479 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: ns1:foo1 2024-03-30T15:12:09.479 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: :foo1 2024-03-30T15:12:09.479 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: :foo2 2024-03-30T15:12:09.479 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: :foo3 2024-03-30T15:12:09.480 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: [ OK ] LibRadosList.ListObjectsNS (92 ms) 2024-03-30T15:12:09.480 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: [ RUN ] LibRadosList.ListObjectsStart 2024-03-30T15:12:09.480 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: 1 0 2024-03-30T15:12:09.480 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: 10 0 2024-03-30T15:12:09.480 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: 13 0 2024-03-30T15:12:09.480 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: 7 0 2024-03-30T15:12:09.480 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: 14 0 2024-03-30T15:12:09.480 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: 0 0 2024-03-30T15:12:09.480 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: 15 0 2024-03-30T15:12:09.480 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: 11 0 2024-03-30T15:12:09.480 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: 5 0 2024-03-30T15:12:09.480 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: 8 0 2024-03-30T15:12:09.480 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: 6 0 2024-03-30T15:12:09.480 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: 3 0 2024-03-30T15:12:09.480 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: 4 0 2024-03-30T15:12:09.480 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: 12 0 2024-03-30T15:12:09.481 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: 9 0 2024-03-30T15:12:09.481 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: 2 0 2024-03-30T15:12:09.481 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-03-30T15:12:09.481 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: [ OK ] LibRadosList.ListObjectsStart (79 ms) 2024-03-30T15:12:09.481 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: [ RUN ] LibRadosList.ListObjectsCursor 2024-03-30T15:12:09.481 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: x cursor=MIN 2024-03-30T15:12:09.481 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > oid=1 cursor=25:02547ec2:::1:head 2024-03-30T15:12:09.481 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > oid=10 cursor=25:52ea6a34:::10:head 2024-03-30T15:12:09.481 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > oid=13 cursor=25:566253c9:::13:head 2024-03-30T15:12:09.481 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > oid=7 cursor=25:5c6b0b28:::7:head 2024-03-30T15:12:09.481 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > oid=14 cursor=25:62a1935d:::14:head 2024-03-30T15:12:09.481 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > oid=0 cursor=25:6cac518f:::0:head 2024-03-30T15:12:09.481 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > oid=15 cursor=25:863748b0:::15:head 2024-03-30T15:12:09.481 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > oid=11 cursor=25:89d3ae78:::11:head 2024-03-30T15:12:09.481 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > oid=5 cursor=25:b29083e3:::5:head 2024-03-30T15:12:09.481 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > oid=8 cursor=25:bd63b0f1:::8:head 2024-03-30T15:12:09.482 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > oid=6 cursor=25:c4fdafeb:::6:head 2024-03-30T15:12:09.482 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > oid=3 cursor=25:cfc208b3:::3:head 2024-03-30T15:12:09.482 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > oid=4 cursor=25:d83876eb:::4:head 2024-03-30T15:12:09.482 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > oid=12 cursor=25:de5d7c5f:::12:head 2024-03-30T15:12:09.482 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > oid=9 cursor=25:e960b815:::9:head 2024-03-30T15:12:09.482 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > oid=2 cursor=25:f905c69b:::2:head 2024-03-30T15:12:09.482 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: FIRST> seek to MIN oid=1 2024-03-30T15:12:09.482 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : oid=1 cursor=25:02547ec2:::1:head 2024-03-30T15:12:09.482 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : seek to 25:02547ec2:::1:head 2024-03-30T15:12:09.482 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > 25:02547ec2:::1:head -> 1 2024-03-30T15:12:09.482 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : oid=10 cursor=25:52ea6a34:::10:head 2024-03-30T15:12:09.482 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : seek to 25:52ea6a34:::10:head 2024-03-30T15:12:09.482 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > 25:52ea6a34:::10:head -> 10 2024-03-30T15:12:09.482 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : oid=13 cursor=25:566253c9:::13:head 2024-03-30T15:12:09.483 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : seek to 25:566253c9:::13:head 2024-03-30T15:12:09.483 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > 25:566253c9:::13:head -> 13 2024-03-30T15:12:09.483 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : oid=7 cursor=25:5c6b0b28:::7:head 2024-03-30T15:12:09.483 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : seek to 25:5c6b0b28:::7:head 2024-03-30T15:12:09.483 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > 25:5c6b0b28:::7:head -> 7 2024-03-30T15:12:09.547 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : oid=14 cursor=25:62a1935d:::14:head 2024-03-30T15:12:09.548 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : seek to 25:62a1935d:::14:head 2024-03-30T15:12:09.548 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > 25:62a1935d:::14:head -> 14 2024-03-30T15:12:09.548 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : oid=0 cursor=25:6cac518f:::0:head 2024-03-30T15:12:09.548 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : seek to 25:6cac518f:::0:head 2024-03-30T15:12:09.548 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > 25:6cac518f:::0:head -> 0 2024-03-30T15:12:09.548 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : oid=15 cursor=25:863748b0:::15:head 2024-03-30T15:12:09.548 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : seek to 25:863748b0:::15:head 2024-03-30T15:12:09.548 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > 25:863748b0:::15:head -> 15 2024-03-30T15:12:09.548 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : oid=11 cursor=25:89d3ae78:::11:head 2024-03-30T15:12:09.548 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : seek to 25:89d3ae78:::11:head 2024-03-30T15:12:09.548 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > 25:89d3ae78:::11:head -> 11 2024-03-30T15:12:09.548 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : oid=5 cursor=25:b29083e3:::5:head 2024-03-30T15:12:09.548 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : seek to 25:b29083e3:::5:head 2024-03-30T15:12:09.548 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > 25:b29083e3:::5:head -> 5 2024-03-30T15:12:09.548 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : oid=8 cursor=25:bd63b0f1:::8:head 2024-03-30T15:12:09.549 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : seek to 25:bd63b0f1:::8:head 2024-03-30T15:12:09.549 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > 25:bd63b0f1:::8:head -> 8 2024-03-30T15:12:09.549 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : oid=6 cursor=25:c4fdafeb:::6:head 2024-03-30T15:12:09.549 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : seek to 25:c4fdafeb:::6:head 2024-03-30T15:12:09.549 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > 25:c4fdafeb:::6:head -> 6 2024-03-30T15:12:09.549 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : oid=3 cursor=25:cfc208b3:::3:head 2024-03-30T15:12:09.549 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : seek to 25:cfc208b3:::3:head 2024-03-30T15:12:09.549 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > 25:cfc208b3:::3:head -> 3 2024-03-30T15:12:09.549 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : oid=4 cursor=25:d83876eb:::4:head 2024-03-30T15:12:09.549 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : seek to 25:d83876eb:::4:head 2024-03-30T15:12:09.549 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > 25:d83876eb:::4:head -> 4 2024-03-30T15:12:09.549 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : oid=12 cursor=25:de5d7c5f:::12:head 2024-03-30T15:12:09.549 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : seek to 25:de5d7c5f:::12:head 2024-03-30T15:12:09.549 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > 25:de5d7c5f:::12:head -> 12 2024-03-30T15:12:09.549 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : oid=9 cursor=25:e960b815:::9:head 2024-03-30T15:12:09.550 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : seek to 25:e960b815:::9:head 2024-03-30T15:12:09.550 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > 25:e960b815:::9:head -> 9 2024-03-30T15:12:09.550 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : oid=2 cursor=25:f905c69b:::2:head 2024-03-30T15:12:09.550 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : seek to 25:f905c69b:::2:head 2024-03-30T15:12:09.550 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > 25:f905c69b:::2:head -> 2 2024-03-30T15:12:09.550 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : seek to 25:52ea6a34:::10:head 2024-03-30T15:12:09.550 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : cursor()=25:52ea6a34:::10:head expected=25:52ea6a34:::10:head 2024-03-30T15:12:09.550 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > 25:52ea6a34:::10:head -> 10 2024-03-30T15:12:09.550 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : entry=10 expected=10 2024-03-30T15:12:09.550 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : seek to 25:d83876eb:::4:head 2024-03-30T15:12:09.550 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : cursor()=25:d83876eb:::4:head expected=25:d83876eb:::4:head 2024-03-30T15:12:09.550 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > 25:d83876eb:::4:head -> 4 2024-03-30T15:12:09.550 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : entry=4 expected=4 2024-03-30T15:12:09.550 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : seek to 25:b29083e3:::5:head 2024-03-30T15:12:09.551 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : cursor()=25:b29083e3:::5:head expected=25:b29083e3:::5:head 2024-03-30T15:12:09.551 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > 25:b29083e3:::5:head -> 5 2024-03-30T15:12:09.551 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : entry=5 expected=5 2024-03-30T15:12:09.551 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : seek to 25:f905c69b:::2:head 2024-03-30T15:12:09.551 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : cursor()=25:f905c69b:::2:head expected=25:f905c69b:::2:head 2024-03-30T15:12:09.551 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > 25:f905c69b:::2:head -> 2 2024-03-30T15:12:09.551 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : entry=2 expected=2 2024-03-30T15:12:09.551 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : seek to 25:e960b815:::9:head 2024-03-30T15:12:09.551 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : cursor()=25:e960b815:::9:head expected=25:e960b815:::9:head 2024-03-30T15:12:09.551 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > 25:e960b815:::9:head -> 9 2024-03-30T15:12:09.551 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : entry=9 expected=9 2024-03-30T15:12:09.551 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : seek to 25:de5d7c5f:::12:head 2024-03-30T15:12:09.551 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : cursor()=25:de5d7c5f:::12:head expected=25:de5d7c5f:::12:head 2024-03-30T15:12:09.551 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > 25:de5d7c5f:::12:head -> 12 2024-03-30T15:12:09.551 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : entry=12 expected=12 2024-03-30T15:12:09.551 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : seek to 25:89d3ae78:::11:head 2024-03-30T15:12:09.551 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : cursor()=25:89d3ae78:::11:head expected=25:89d3ae78:::11:head 2024-03-30T15:12:09.552 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > 25:89d3ae78:::11:head -> 11 2024-03-30T15:12:09.552 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : entry=11 expected=11 2024-03-30T15:12:09.552 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : seek to 25:863748b0:::15:head 2024-03-30T15:12:09.552 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : cursor()=25:863748b0:::15:head expected=25:863748b0:::15:head 2024-03-30T15:12:09.552 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > 25:863748b0:::15:head -> 15 2024-03-30T15:12:10.388 INFO:tasks.workunit.client.0.smithi072.stdout: api_list list_parallel: process_1_[64662]: starting. 2024-03-30T15:12:10.388 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_1_[64662]: creating pool ceph_test_rados_list_parallel.smithi072-64639 2024-03-30T15:12:10.388 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_1_[64662]: created object 0... 2024-03-30T15:12:10.388 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_1_[64662]: created object 25... 2024-03-30T15:12:10.388 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_1_[64662]: created object 49... 2024-03-30T15:12:10.388 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_1_[64662]: finishing. 2024-03-30T15:12:10.388 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_1_[64662]: shutting down. 2024-03-30T15:12:10.388 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_2_[64664]: starting. 2024-03-30T15:12:10.388 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_2_[64664]: listing objects. 2024-03-30T15:12:10.388 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_2_[64664]: listed object 0... 2024-03-30T15:12:10.389 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_2_[64664]: listed object 25... 2024-03-30T15:12:10.389 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_2_[64664]: saw 50 objects 2024-03-30T15:12:10.389 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_2_[64664]: shutting down. 2024-03-30T15:12:10.389 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: ******************************* 2024-03-30T15:12:10.389 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_3_[65700]: starting. 2024-03-30T15:12:10.389 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_3_[65700]: creating pool ceph_test_rados_list_parallel.smithi072-64639 2024-03-30T15:12:10.389 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_3_[65700]: created object 0... 2024-03-30T15:12:10.389 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_3_[65700]: created object 25... 2024-03-30T15:12:10.389 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_3_[65700]: created object 49... 2024-03-30T15:12:10.389 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_3_[65700]: finishing. 2024-03-30T15:12:10.389 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_3_[65700]: shutting down. 2024-03-30T15:12:10.389 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: ******************************* 2024-03-30T15:12:10.389 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_4_[65701]: starting. 2024-03-30T15:12:10.390 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_4_[65701]: listing objects. 2024-03-30T15:12:10.390 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_4_[65701]: listed object 0... 2024-03-30T15:12:10.390 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_4_[65701]: listed object 25... 2024-03-30T15:12:10.390 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_4_[65701]: saw 41 objects 2024-03-30T15:12:10.390 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_4_[65701]: shutting down. 2024-03-30T15:12:10.390 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: ******************************* 2024-03-30T15:12:10.390 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_5_[65702]: starting. 2024-03-30T15:12:10.390 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_5_[65702]: removed 25 objects... 2024-03-30T15:12:10.390 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_5_[65702]: removed half of the objects 2024-03-30T15:12:10.390 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_5_[65702]: removed 50 objects... 2024-03-30T15:12:10.390 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_5_[65702]: removed 50 objects 2024-03-30T15:12:10.390 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_5_[65702]: shutting down. 2024-03-30T15:12:10.390 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: ******************************* 2024-03-30T15:12:10.390 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: ******************************* 2024-03-30T15:12:10.390 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_6_[65864]: starting. 2024-03-30T15:12:10.391 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_6_[65864]: creating pool ceph_test_rados_list_parallel.smithi072-64639 2024-03-30T15:12:10.391 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_6_[65864]: created object 0... 2024-03-30T15:12:10.391 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_6_[65864]: created object 25... 2024-03-30T15:12:10.391 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_6_[65864]: created object 49... 2024-03-30T15:12:10.391 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_6_[65864]: finishing. 2024-03-30T15:12:10.391 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_6_[65864]: shutting down. 2024-03-30T15:12:10.391 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: ******************************* 2024-03-30T15:12:10.391 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: ******************************* 2024-03-30T15:12:10.391 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_7_[65865]: starting. 2024-03-30T15:12:10.391 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_7_[65865]: listing objects. 2024-03-30T15:12:10.391 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_7_[65865]: listed object 0... 2024-03-30T15:12:10.391 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_7_[65865]: listed object 25... 2024-03-30T15:12:10.391 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_7_[65865]: listed object 50... 2024-03-30T15:12:10.391 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_7_[65865]: saw 54 objects 2024-03-30T15:12:10.391 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_7_[65865]: shutting down. 2024-03-30T15:12:10.391 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: ******************************* 2024-03-30T15:12:10.391 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: ******************************* 2024-03-30T15:12:10.392 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_8_[65866]: starting. 2024-03-30T15:12:10.392 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_8_[65866]: added 25 objects... 2024-03-30T15:12:10.392 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_8_[65866]: added half of the objects 2024-03-30T15:12:10.392 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_8_[65866]: added 50 objects... 2024-03-30T15:12:10.392 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_8_[65866]: added 50 objects 2024-03-30T15:12:10.392 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_8_[65866]: shutting down. 2024-03-30T15:12:10.392 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: ******************************* 2024-03-30T15:12:10.392 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: ******************************* 2024-03-30T15:12:10.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[21573]: audit 2024-03-30T15:12:08.013199+0000 mon.a (mon.0) 918 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi072-64211-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:10.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[21573]: audit 2024-03-30T15:12:08.013443+0000 mon.a (mon.0) 919 : audit 1 from='client.? 172.21.15.72:0/686948711' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi072-64256-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:10.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[21573]: audit 2024-03-30T15:12:08.013654+0000 mon.a (mon.0) 920 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi072-64344-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:10.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[21573]: audit 2024-03-30T15:12:08.013881+0000 mon.a (mon.0) 921 : audit 1 from='client.? 172.21.15.72:0/805668547' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64597-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:10.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[21573]: audit 2024-03-30T15:12:08.014042+0000 mon.a (mon.0) 922 : audit 1 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi072-64203-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:10.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[21573]: audit 2024-03-30T15:12:08.014207+0000 mon.a (mon.0) 923 : audit 1 from='client.? 172.21.15.72:0/2700228879' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi072-64386-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:10.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[21573]: audit 2024-03-30T15:12:08.014400+0000 mon.a (mon.0) 924 : audit 1 from='client.? 172.21.15.72:0/4261885491' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi072-64444-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:10.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[21573]: audit 2024-03-30T15:12:08.014587+0000 mon.a (mon.0) 925 : audit 1 from='client.? 172.21.15.72:0/3509351110' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi072-64600-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:10.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[21573]: audit 2024-03-30T15:12:08.014769+0000 mon.a (mon.0) 926 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:10.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[21573]: audit 2024-03-30T15:12:08.014961+0000 mon.a (mon.0) 927 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi072-64378-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:10.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[21573]: audit 2024-03-30T15:12:08.015164+0000 mon.a (mon.0) 928 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64502-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:10.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[21573]: audit 2024-03-30T15:12:08.015287+0000 mon.a (mon.0) 929 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64541-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:10.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[21573]: audit 2024-03-30T15:12:08.015478+0000 mon.a (mon.0) 930 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi072-64425-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:10.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[28946]: audit 2024-03-30T15:12:08.013199+0000 mon.a (mon.0) 918 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi072-64211-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:10.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[28946]: audit 2024-03-30T15:12:08.013443+0000 mon.a (mon.0) 919 : audit 1 from='client.? 172.21.15.72:0/686948711' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi072-64256-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:10.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[28946]: audit 2024-03-30T15:12:08.013654+0000 mon.a (mon.0) 920 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi072-64344-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:10.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[28946]: audit 2024-03-30T15:12:08.013881+0000 mon.a (mon.0) 921 : audit 1 from='client.? 172.21.15.72:0/805668547' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64597-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:10.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[28946]: audit 2024-03-30T15:12:08.014042+0000 mon.a (mon.0) 922 : audit 1 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi072-64203-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:10.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[28946]: audit 2024-03-30T15:12:08.014207+0000 mon.a (mon.0) 923 : audit 1 from='client.? 172.21.15.72:0/2700228879' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi072-64386-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:10.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[28946]: audit 2024-03-30T15:12:08.014400+0000 mon.a (mon.0) 924 : audit 1 from='client.? 172.21.15.72:0/4261885491' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi072-64444-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:10.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[28946]: audit 2024-03-30T15:12:08.014587+0000 mon.a (mon.0) 925 : audit 1 from='client.? 172.21.15.72:0/3509351110' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi072-64600-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:10.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[28946]: audit 2024-03-30T15:12:08.014769+0000 mon.a (mon.0) 926 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:10.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[28946]: audit 2024-03-30T15:12:08.014961+0000 mon.a (mon.0) 927 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi072-64378-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:10.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[28946]: audit 2024-03-30T15:12:08.015164+0000 mon.a (mon.0) 928 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64502-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:10.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[28946]: audit 2024-03-30T15:12:08.015287+0000 mon.a (mon.0) 929 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64541-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:10.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[28946]: audit 2024-03-30T15:12:08.015478+0000 mon.a (mon.0) 930 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi072-64425-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:10.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[21573]: audit 2024-03-30T15:12:08.015662+0000 mon.a (mon.0) 931 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi072-64321-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:10.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[21573]: audit 2024-03-30T15:12:08.015830+0000 mon.a (mon.0) 932 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:10.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[21573]: audit 2024-03-30T15:12:08.016021+0000 mon.a (mon.0) 933 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi072-64478-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:12:10.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[21573]: audit 2024-03-30T15:12:08.051284+0000 mon.c (mon.2) 115 : audit 1 from='client.? 172.21.15.72:0/4159181360' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi072-64478-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi072-64478-1"}]: dispatch 2024-03-30T15:12:10.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[21573]: cluster 2024-03-30T15:12:09.021579+0000 mon.a (mon.0) 934 : cluster 0 osdmap e80: 8 total, 8 up, 8 in 2024-03-30T15:12:10.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[21573]: audit 2024-03-30T15:12:09.046174+0000 mon.a (mon.0) 935 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi072-64478-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi072-64478-1"}]: dispatch 2024-03-30T15:12:10.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[21573]: audit 2024-03-30T15:12:09.071739+0000 mon.c (mon.2) 116 : audit 1 from='client.? 172.21.15.72:0/634351624' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi072-64403-7"}]: dispatch 2024-03-30T15:12:10.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[21573]: audit 2024-03-30T15:12:09.083212+0000 mon.a (mon.0) 936 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritesmithi072-64841-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi072-64841-1"}]': finished 2024-03-30T15:12:10.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[21573]: audit 2024-03-30T15:12:09.083340+0000 mon.a (mon.0) 937 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectssmithi072-64882-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi072-64882-1"}]': finished 2024-03-30T15:12:10.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[21573]: audit 2024-03-30T15:12:09.106079+0000 mon.c (mon.2) 117 : audit 1 from='client.? 172.21.15.72:0/2459281314' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi072-64179-16"}]: dispatch 2024-03-30T15:12:10.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[21573]: cluster 2024-03-30T15:12:10.013924+0000 mon.a (mon.0) 938 : cluster 0 osdmap e81: 8 total, 8 up, 8 in 2024-03-30T15:12:10.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[21573]: audit 2024-03-30T15:12:10.015399+0000 mon.a (mon.0) 939 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:10.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[21573]: audit 2024-03-30T15:12:10.019772+0000 mon.a (mon.0) 940 : audit 1 from='client.? 172.21.15.72:0/855800261' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi072-64187-22"}]: dispatch 2024-03-30T15:12:10.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[21573]: audit 2024-03-30T15:12:10.022494+0000 mon.a (mon.0) 941 : audit 1 from='client.? 172.21.15.72:0/855800261' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi072-64187-22"}]: dispatch 2024-03-30T15:12:10.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[21573]: audit 2024-03-30T15:12:10.026206+0000 mon.c (mon.2) 118 : audit 0 from='client.? 172.21.15.72:0/799895403' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-03-30T15:12:10.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[21573]: audit 2024-03-30T15:12:10.026884+0000 mon.a (mon.0) 942 : audit 1 from='client.? 172.21.15.72:0/855800261' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi072-64187-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:10.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[28946]: audit 2024-03-30T15:12:08.015662+0000 mon.a (mon.0) 931 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi072-64321-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:10.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[28946]: audit 2024-03-30T15:12:08.015830+0000 mon.a (mon.0) 932 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:10.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[28946]: audit 2024-03-30T15:12:08.016021+0000 mon.a (mon.0) 933 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi072-64478-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:12:10.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[28946]: audit 2024-03-30T15:12:08.051284+0000 mon.c (mon.2) 115 : audit 1 from='client.? 172.21.15.72:0/4159181360' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi072-64478-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi072-64478-1"}]: dispatch 2024-03-30T15:12:10.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[28946]: cluster 2024-03-30T15:12:09.021579+0000 mon.a (mon.0) 934 : cluster 0 osdmap e80: 8 total, 8 up, 8 in 2024-03-30T15:12:10.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[28946]: audit 2024-03-30T15:12:09.046174+0000 mon.a (mon.0) 935 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi072-64478-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi072-64478-1"}]: dispatch 2024-03-30T15:12:10.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[28946]: audit 2024-03-30T15:12:09.071739+0000 mon.c (mon.2) 116 : audit 1 from='client.? 172.21.15.72:0/634351624' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi072-64403-7"}]: dispatch 2024-03-30T15:12:10.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[28946]: audit 2024-03-30T15:12:09.083212+0000 mon.a (mon.0) 936 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritesmithi072-64841-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi072-64841-1"}]': finished 2024-03-30T15:12:10.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[28946]: audit 2024-03-30T15:12:09.083340+0000 mon.a (mon.0) 937 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectssmithi072-64882-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi072-64882-1"}]': finished 2024-03-30T15:12:10.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[28946]: audit 2024-03-30T15:12:09.106079+0000 mon.c (mon.2) 117 : audit 1 from='client.? 172.21.15.72:0/2459281314' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi072-64179-16"}]: dispatch 2024-03-30T15:12:10.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[28946]: cluster 2024-03-30T15:12:10.013924+0000 mon.a (mon.0) 938 : cluster 0 osdmap e81: 8 total, 8 up, 8 in 2024-03-30T15:12:10.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[28946]: audit 2024-03-30T15:12:10.015399+0000 mon.a (mon.0) 939 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:10.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[28946]: audit 2024-03-30T15:12:10.019772+0000 mon.a (mon.0) 940 : audit 1 from='client.? 172.21.15.72:0/855800261' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi072-64187-22"}]: dispatch 2024-03-30T15:12:10.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[28946]: audit 2024-03-30T15:12:10.022494+0000 mon.a (mon.0) 941 : audit 1 from='client.? 172.21.15.72:0/855800261' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi072-64187-22"}]: dispatch 2024-03-30T15:12:10.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[28946]: audit 2024-03-30T15:12:10.026206+0000 mon.c (mon.2) 118 : audit 0 from='client.? 172.21.15.72:0/799895403' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-03-30T15:12:10.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:10 smithi072 bash[28946]: audit 2024-03-30T15:12:10.026884+0000 mon.a (mon.0) 942 : audit 1 from='client.? 172.21.15.72:0/855800261' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi072-64187-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:10.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:10 smithi172 bash[23680]: audit 2024-03-30T15:12:08.013199+0000 mon.a (mon.0) 918 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi072-64211-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:10.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:10 smithi172 bash[23680]: audit 2024-03-30T15:12:08.013443+0000 mon.a (mon.0) 919 : audit 1 from='client.? 172.21.15.72:0/686948711' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi072-64256-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:10.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:10 smithi172 bash[23680]: audit 2024-03-30T15:12:08.013654+0000 mon.a (mon.0) 920 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi072-64344-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:10.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:10 smithi172 bash[23680]: audit 2024-03-30T15:12:08.013881+0000 mon.a (mon.0) 921 : audit 1 from='client.? 172.21.15.72:0/805668547' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64597-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:10.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:10 smithi172 bash[23680]: audit 2024-03-30T15:12:08.014042+0000 mon.a (mon.0) 922 : audit 1 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi072-64203-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:10.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:10 smithi172 bash[23680]: audit 2024-03-30T15:12:08.014207+0000 mon.a (mon.0) 923 : audit 1 from='client.? 172.21.15.72:0/2700228879' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi072-64386-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:10.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:10 smithi172 bash[23680]: audit 2024-03-30T15:12:08.014400+0000 mon.a (mon.0) 924 : audit 1 from='client.? 172.21.15.72:0/4261885491' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi072-64444-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:10.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:10 smithi172 bash[23680]: audit 2024-03-30T15:12:08.014587+0000 mon.a (mon.0) 925 : audit 1 from='client.? 172.21.15.72:0/3509351110' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi072-64600-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:10.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:10 smithi172 bash[23680]: audit 2024-03-30T15:12:08.014769+0000 mon.a (mon.0) 926 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:10.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:10 smithi172 bash[23680]: audit 2024-03-30T15:12:08.014961+0000 mon.a (mon.0) 927 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi072-64378-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:10.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:10 smithi172 bash[23680]: audit 2024-03-30T15:12:08.015164+0000 mon.a (mon.0) 928 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64502-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:10.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:10 smithi172 bash[23680]: audit 2024-03-30T15:12:08.015287+0000 mon.a (mon.0) 929 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64541-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:10.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:10 smithi172 bash[23680]: audit 2024-03-30T15:12:08.015478+0000 mon.a (mon.0) 930 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi072-64425-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:10.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:10 smithi172 bash[23680]: audit 2024-03-30T15:12:08.015662+0000 mon.a (mon.0) 931 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi072-64321-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:10.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:10 smithi172 bash[23680]: audit 2024-03-30T15:12:08.015830+0000 mon.a (mon.0) 932 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:10.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:10 smithi172 bash[23680]: audit 2024-03-30T15:12:08.016021+0000 mon.a (mon.0) 933 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi072-64478-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:12:10.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:10 smithi172 bash[23680]: audit 2024-03-30T15:12:08.051284+0000 mon.c (mon.2) 115 : audit 1 from='client.? 172.21.15.72:0/4159181360' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi072-64478-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi072-64478-1"}]: dispatch 2024-03-30T15:12:10.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:10 smithi172 bash[23680]: cluster 2024-03-30T15:12:09.021579+0000 mon.a (mon.0) 934 : cluster 0 osdmap e80: 8 total, 8 up, 8 in 2024-03-30T15:12:10.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:10 smithi172 bash[23680]: audit 2024-03-30T15:12:09.046174+0000 mon.a (mon.0) 935 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi072-64478-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi072-64478-1"}]: dispatch 2024-03-30T15:12:10.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:10 smithi172 bash[23680]: audit 2024-03-30T15:12:09.071739+0000 mon.c (mon.2) 116 : audit 1 from='client.? 172.21.15.72:0/634351624' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi072-64403-7"}]: dispatch 2024-03-30T15:12:10.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:10 smithi172 bash[23680]: audit 2024-03-30T15:12:09.083212+0000 mon.a (mon.0) 936 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritesmithi072-64841-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi072-64841-1"}]': finished 2024-03-30T15:12:10.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:10 smithi172 bash[23680]: audit 2024-03-30T15:12:09.083340+0000 mon.a (mon.0) 937 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectssmithi072-64882-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi072-64882-1"}]': finished 2024-03-30T15:12:10.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:10 smithi172 bash[23680]: audit 2024-03-30T15:12:09.106079+0000 mon.c (mon.2) 117 : audit 1 from='client.? 172.21.15.72:0/2459281314' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi072-64179-16"}]: dispatch 2024-03-30T15:12:10.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:10 smithi172 bash[23680]: cluster 2024-03-30T15:12:10.013924+0000 mon.a (mon.0) 938 : cluster 0 osdmap e81: 8 total, 8 up, 8 in 2024-03-30T15:12:10.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:10 smithi172 bash[23680]: audit 2024-03-30T15:12:10.015399+0000 mon.a (mon.0) 939 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:10.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:10 smithi172 bash[23680]: audit 2024-03-30T15:12:10.019772+0000 mon.a (mon.0) 940 : audit 1 from='client.? 172.21.15.72:0/855800261' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi072-64187-22"}]: dispatch 2024-03-30T15:12:10.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:10 smithi172 bash[23680]: audit 2024-03-30T15:12:10.022494+0000 mon.a (mon.0) 941 : audit 1 from='client.? 172.21.15.72:0/855800261' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi072-64187-22"}]: dispatch 2024-03-30T15:12:10.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:10 smithi172 bash[23680]: audit 2024-03-30T15:12:10.026206+0000 mon.c (mon.2) 118 : audit 0 from='client.? 172.21.15.72:0/799895403' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-03-30T15:12:10.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:10 smithi172 bash[23680]: audit 2024-03-30T15:12:10.026884+0000 mon.a (mon.0) 942 : audit 1 from='client.? 172.21.15.72:0/855800261' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi072-64187-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:11.202 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: ******************************* 2024-03-30T15:12:11.202 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_9_[65947]: starting. 2024-03-30T15:12:11.203 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_9_[65947]: creating pool ceph_test_rados_list_parallel.smithi072-64639 2024-03-30T15:12:11.203 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_9_[65947]: created object 0... 2024-03-30T15:12:11.203 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_9_[65947]: created object 25... 2024-03-30T15:12:11.203 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_9_[65947]: created object 49... 2024-03-30T15:12:11.203 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_9_[65947]: finishing. 2024-03-30T15:12:11.203 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_9_[65947]: shutting down. 2024-03-30T15:12:11.203 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: ******************************* 2024-03-30T15:12:11.203 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: ******************************* 2024-03-30T15:12:11.203 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: ******************************* 2024-03-30T15:12:11.203 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_10_[65948]: starting. 2024-03-30T15:12:11.203 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_10_[65948]: listing objects. 2024-03-30T15:12:11.203 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_10_[65948]: listed object 0... 2024-03-30T15:12:11.204 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_10_[65948]: listed object 25... 2024-03-30T15:12:11.204 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_10_[65948]: listed object 50... 2024-03-30T15:12:11.204 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_10_[65948]: listed object 75... 2024-03-30T15:12:11.204 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_10_[65948]: saw 97 objects 2024-03-30T15:12:11.204 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_10_[65948]: shutting down. 2024-03-30T15:12:11.204 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: ******************************* 2024-03-30T15:12:11.204 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: ******************************* 2024-03-30T15:12:11.204 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: ******************************* 2024-03-30T15:12:11.204 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_13_[65951]: starting. 2024-03-30T15:12:11.204 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_13_[65951]: removed 25 objects... 2024-03-30T15:12:11.204 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_13_[65951]: removed half of the objects 2024-03-30T15:12:11.204 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_13_[65951]: removed 50 objects... 2024-03-30T15:12:11.204 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_13_[65951]: removed 50 objects 2024-03-30T15:12:11.204 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_13_[65951]: shutting down. 2024-03-30T15:12:11.204 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: ******************************* 2024-03-30T15:12:11.204 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: ******************************* 2024-03-30T15:12:11.205 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: ******************************* 2024-03-30T15:12:11.205 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_12_[65950]: starting. 2024-03-30T15:12:11.205 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_12_[65950]: added 25 objects... 2024-03-30T15:12:11.205 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_12_[65950]: added half of the objects 2024-03-30T15:12:11.205 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_12_[65950]: added 50 objects... 2024-03-30T15:12:11.205 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_12_[65950]: added 50 objects 2024-03-30T15:12:11.205 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_12_[65950]: shutting down. 2024-03-30T15:12:11.205 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: ******************************* 2024-03-30T15:12:11.205 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: ******************************* 2024-03-30T15:12:11.205 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: ******************************* 2024-03-30T15:12:11.205 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_11_[65949]: starting. 2024-03-30T15:12:11.205 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_11_[65949]: added 25 objects... 2024-03-30T15:12:11.205 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_11_[65949]: added half of the objects 2024-03-30T15:12:11.205 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_11_[65949]: added 50 objects... 2024-03-30T15:12:11.205 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_11_[65949]: added 50 objects 2024-03-30T15:12:11.205 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_11_[65949]: shutting down. 2024-03-30T15:12:11.206 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: ******************************* 2024-03-30T15:12:11.206 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: ******************************* 2024-03-30T15:12:11.206 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: ******************************* 2024-03-30T15:12:11.206 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: ******************************* 2024-03-30T15:12:11.206 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_14_[66029]: starting. 2024-03-30T15:12:11.206 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_14_[66029]: creating pool ceph_test_rados_list_parallel.smithi072-64639 2024-03-30T15:12:11.206 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_14_[66029]: created object 0... 2024-03-30T15:12:11.206 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_14_[66029]: created object 25... 2024-03-30T15:12:11.206 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_14_[66029]: created object 49... 2024-03-30T15:12:11.206 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_14_[66029]: finishing. 2024-03-30T15:12:11.206 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_14_[66029]: shutting down. 2024-03-30T15:12:11.206 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: ******************************* 2024-03-30T15:12:11.206 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: ******************************* 2024-03-30T15:12:11.206 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: ******************************* 2024-03-30T15:12:11.206 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: ******************************* 2024-03-30T15:12:11.207 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_16_[66031]: starting. 2024-03-30T15:12:11.207 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_16_[66031]: added 25 objects... 2024-03-30T15:12:11.207 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_16_[66031]: added half of the objects 2024-03-30T15:12:11.216 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:12:10 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:12:11.416 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:12:11 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:12:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:12:12.372 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_16_[66031]: added api_c_read_operations: Running main() from gmock_main.cc 2024-03-30T15:12:12.372 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_read_operations: [==========] Running 17 tests from 1 test suite. 2024-03-30T15:12:12.372 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_read_operations: [----------] Global test environment set-up. 2024-03-30T15:12:12.372 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest 2024-03-30T15:12:12.372 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.NewDelete 2024-03-30T15:12:12.372 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_read_operations: [ OK ] CReadOpsTest.NewDelete (0 ms) 2024-03-30T15:12:12.372 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.SetOpFlags 2024-03-30T15:12:12.372 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_read_operations: [ OK ] CReadOpsTest.SetOpFlags (16 ms) 2024-03-30T15:12:12.372 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertExists 2024-03-30T15:12:12.372 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertExists (51 ms) 2024-03-30T15:12:12.372 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertVersion 2024-03-30T15:12:12.372 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertVersion (28 ms) 2024-03-30T15:12:12.373 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpXattr 2024-03-30T15:12:12.373 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpXattr (23 ms) 2024-03-30T15:12:12.373 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Read 2024-03-30T15:12:12.373 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Read (9 ms) 2024-03-30T15:12:12.373 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Checksum 2024-03-30T15:12:12.373 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Checksum (8 ms) 2024-03-30T15:12:12.373 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.RWOrderedRead 2024-03-30T15:12:12.373 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_read_operations: [ OK ] CReadOpsTest.RWOrderedRead (4 ms) 2024-03-30T15:12:12.373 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ShortRead 2024-03-30T15:12:12.373 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ShortRead (6 ms) 2024-03-30T15:12:12.373 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Exec 2024-03-30T15:12:12.373 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Exec (4 ms) 2024-03-30T15:12:12.373 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ExecUserBuf 2024-03-30T15:12:12.373 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ExecUserBuf (9 ms) 2024-03-30T15:12:12.373 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat 2024-03-30T15:12:12.374 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat (8 ms) 2024-03-30T15:12:12.374 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat2 2024-03-30T15:12:12.374 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat2 (5 ms) 2024-03-30T15:12:12.374 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Omap 2024-03-30T15:12:12.374 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Omap (18 ms) 2024-03-30T15:12:12.374 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.OmapNuls 2024-03-30T15:12:12.374 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_read_operations: [ OK ] CReadOpsTest.OmapNuls (13 ms) 2024-03-30T15:12:12.374 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.GetXattrs 2024-03-30T15:12:12.374 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_read_operations: [ OK ] CReadOpsTest.GetXattrs (19 ms) 2024-03-30T15:12:12.374 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpExt 2024-03-30T15:12:12.374 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpExt (4 ms) 2024-03-30T15:12:12.374 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest (225 ms total) 2024-03-30T15:12:12.374 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_read_operations: 2024-03-30T15:12:12.375 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_read_operations: [----------] Global test environment tear-down 2024-03-30T15:12:12.375 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_read_operations: [==========] 17 tests from 1 test suite ran. (20219 ms total) 2024-03-30T15:12:12.375 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_read_operations: [ PASSED ] 17 tests. 2024-03-30T15:12:12.407 INFO:tasks.workunit.client.0.smithi072.stdout: api_cls_remote_reads: [==========] Running 1 test from 1 test suite. 2024-03-30T15:12:12.407 INFO:tasks.workunit.client.0.smithi072.stdout: api_cls_remote_reads: [----------] Global test environment set-up. 2024-03-30T15:12:12.407 INFO:tasks.workunit.client.0.smithi072.stdout: api_cls_remote_reads: [----------] 1 test from ClsTestRemoteReads 2024-03-30T15:12:12.407 INFO:tasks.workunit.client.0.smithi072.stdout: api_cls_remote_reads: [ RUN ] ClsTestRemoteReads.TestGather 2024-03-30T15:12:12.407 INFO:tasks.workunit.client.0.smithi072.stdout: api_cls_remote_reads: [ OK ] ClsTestRemoteReads.TestGather (20185 ms) 2024-03-30T15:12:12.407 INFO:tasks.workunit.client.0.smithi072.stdout: api_cls_remote_reads: [----------] 1 test from ClsTestRemoteReads (20185 ms total) 2024-03-30T15:12:12.407 INFO:tasks.workunit.client.0.smithi072.stdout: api_cls_remote_reads: 2024-03-30T15:12:12.407 INFO:tasks.workunit.client.0.smithi072.stdout: api_cls_remote_reads: [----------] Global test environment tear-down 2024-03-30T15:12:12.407 INFO:tasks.workunit.client.0.smithi072.stdout: api_cls_remote_reads: [==========] 1 test from 1 test suite ran. (20185 ms total) 2024-03-30T15:12:12.407 INFO:tasks.workunit.client.0.smithi072.stdout: api_cls_remote_reads: [ PASSED ] 1 test. 2024-03-30T15:12:12.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:12 smithi072 bash[21573]: cluster 2024-03-30T15:12:07.827580+0000 mgr.y (mgr.14526) 168 : cluster 0 pgmap v117: 1252 pgs: 548 creating+peering, 211 active+clean, 493 unknown; 582 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 127 B/s wr, 1 op/s 2024-03-30T15:12:12.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:12 smithi072 bash[21573]: audit 2024-03-30T15:12:10.533189+0000 mon.a (mon.0) 943 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi072-64403-7"}]: dispatch 2024-03-30T15:12:12.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:12 smithi072 bash[21573]: audit 2024-03-30T15:12:10.533830+0000 mon.a (mon.0) 944 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi072-64179-16"}]: dispatch 2024-03-30T15:12:12.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:12 smithi072 bash[28946]: cluster 2024-03-30T15:12:07.827580+0000 mgr.y (mgr.14526) 168 : cluster 0 pgmap v117: 1252 pgs: 548 creating+peering, 211 active+clean, 493 unknown; 582 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 127 B/s wr, 1 op/s 2024-03-30T15:12:12.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:12 smithi072 bash[28946]: audit 2024-03-30T15:12:10.533189+0000 mon.a (mon.0) 943 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi072-64403-7"}]: dispatch 2024-03-30T15:12:12.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:12 smithi072 bash[28946]: audit 2024-03-30T15:12:10.533830+0000 mon.a (mon.0) 944 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi072-64179-16"}]: dispatch 2024-03-30T15:12:12.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:12 smithi172 bash[23680]: cluster 2024-03-30T15:12:07.827580+0000 mgr.y (mgr.14526) 168 : cluster 0 pgmap v117: 1252 pgs: 548 creating+peering, 211 active+clean, 493 unknown; 582 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 127 B/s wr, 1 op/s 2024-03-30T15:12:12.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:12 smithi172 bash[23680]: audit 2024-03-30T15:12:10.533189+0000 mon.a (mon.0) 943 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi072-64403-7"}]: dispatch 2024-03-30T15:12:12.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:12 smithi172 bash[23680]: audit 2024-03-30T15:12:10.533830+0000 mon.a (mon.0) 944 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi072-64179-16"}]: dispatch 2024-03-30T15:12:13.689 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: Running main() from gmock_main.cc 2024-03-30T15:12:13.689 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: [==========] Running 4 tests from 1 test suite. 2024-03-30T15:12:13.689 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: [----------] Global test environment set-up. 2024-03-30T15:12:13.689 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: [----------] 4 tests from LibRadosCmd 2024-03-30T15:12:13.689 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: [ RUN ] LibRadosCmd.MonDescribe 2024-03-30T15:12:13.689 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: [ OK ] LibRadosCmd.MonDescribe (54 ms) 2024-03-30T15:12:13.689 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: [ RUN ] LibRadosCmd.OSDCmd 2024-03-30T15:12:13.689 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: [ OK ] LibRadosCmd.OSDCmd (88 ms) 2024-03-30T15:12:13.689 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: [ RUN ] LibRadosCmd.PGCmd 2024-03-30T15:12:13.689 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: [ OK ] LibRadosCmd.PGCmd (18813 ms) 2024-03-30T15:12:13.689 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: [ RUN ] LibRadosCmd.WatchLog 2024-03-30T15:12:13.689 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:10.533189+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi072-64403-7"}]: dispatch 2024-03-30T15:12:13.689 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:10.533830+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi072-64179-16"}]: dispatch 2024-03-30T15:12:13.690 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:10.534180+0000 mon.a [INF] from='client.? 172.21.15.72:0/855800261' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi072-64187-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:12:13.690 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:11.052656+0000 mon.c [INF] from='client.? 172.21.15.72:0/634351624' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi072-64403-7"}]: dispatch 2024-03-30T15:12:13.690 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:11.796044+0000 mon.c [INF] from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.0"}]: dispatch 2024-03-30T15:12:13.690 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:11.797324+0000 mon.c [INF] from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.1"}]: dispatch 2024-03-30T15:12:13.690 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:11.798473+0000 mon.c [INF] from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.2"}]: dispatch 2024-03-30T15:12:13.690 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:11.799672+0000 mon.c [INF] from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.3"}]: dispatch 2024-03-30T15:12:13.690 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:11.800778+0000 mon.c [INF] from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.4"}]: dispatch 2024-03-30T15:12:13.690 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:11.801924+0000 mon.c [INF] from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.5"}]: dispatch 2024-03-30T15:12:13.690 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:11.802989+0000 mon.c [INF] from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.6"}]: dispatch 2024-03-30T15:12:13.690 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:11.804322+0000 mon.c [INF] from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.7"}]: dispatch 2024-03-30T15:12:13.691 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:11.805506+0000 mon.c [INF] from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.8"}]: dispatch 2024-03-30T15:12:13.691 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:11.806654+0000 mon.c [INF] from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.9"}]: dispatch 2024-03-30T15:12:13.691 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:11.930496+0000 mon.c [INF] from='client.? 172.21.15.72:0/2459281314' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi072-64179-16"}]: dispatch 2024-03-30T15:12:13.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:13 smithi172 bash[23680]: cluster 2024-03-30T15:12:09.828399+0000 mgr.y (mgr.14526) 169 : cluster 0 pgmap v120: 1012 pgs: 410 creating+peering, 132 active+clean, 470 unknown; 582 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 851 B/s rd, 0 op/s 2024-03-30T15:12:13.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:13 smithi172 bash[23680]: audit 2024-03-30T15:12:10.534180+0000 mon.a (mon.0) 945 : audit 1 from='client.? 172.21.15.72:0/855800261' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi072-64187-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:12:13.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:13 smithi172 bash[23680]: audit 2024-03-30T15:12:11.052656+0000 mon.c (mon.2) 119 : audit 1 from='client.? 172.21.15.72:0/634351624' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi072-64403-7"}]: dispatch 2024-03-30T15:12:13.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:13 smithi172 bash[23680]: audit 2024-03-30T15:12:11.796044+0000 mon.c (mon.2) 120 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.0"}]: dispatch 2024-03-30T15:12:13.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:13 smithi172 bash[23680]: audit 2024-03-30T15:12:11.797324+0000 mon.c (mon.2) 121 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.1"}]: dispatch 2024-03-30T15:12:13.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:13 smithi172 bash[23680]: audit 2024-03-30T15:12:11.798473+0000 mon.c (mon.2) 122 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.2"}]: dispatch 2024-03-30T15:12:13.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:13 smithi172 bash[23680]: audit 2024-03-30T15:12:11.799672+0000 mon.c (mon.2) 123 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.3"}]: dispatch 2024-03-30T15:12:13.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:13 smithi172 bash[23680]: audit 2024-03-30T15:12:11.800778+0000 mon.c (mon.2) 124 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.4"}]: dispatch 2024-03-30T15:12:13.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:13 smithi172 bash[23680]: audit 2024-03-30T15:12:11.801924+0000 mon.c (mon.2) 125 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.5"}]: dispatch 2024-03-30T15:12:13.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:13 smithi172 bash[23680]: audit 2024-03-30T15:12:11.802989+0000 mon.c (mon.2) 126 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.6"}]: dispatch 2024-03-30T15:12:13.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:13 smithi172 bash[23680]: audit 2024-03-30T15:12:11.804322+0000 mon.c (mon.2) 127 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.7"}]: dispatch 2024-03-30T15:12:13.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:13 smithi172 bash[23680]: audit 2024-03-30T15:12:11.805506+0000 mon.c (mon.2) 128 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.8"}]: dispatch 2024-03-30T15:12:13.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:13 smithi172 bash[23680]: audit 2024-03-30T15:12:11.806654+0000 mon.c (mon.2) 129 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.9"}]: dispatch 2024-03-30T15:12:13.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:13 smithi172 bash[23680]: cluster 2024-03-30T15:12:11.904897+0000 osd.3 (osd.3) 3 : cluster 0 38.9 deep-scrub starts 2024-03-30T15:12:13.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:13 smithi172 bash[23680]: cluster 2024-03-30T15:12:11.908686+0000 osd.3 (osd.3) 4 : cluster 0 38.9 deep-scrub ok 2024-03-30T15:12:13.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:13 smithi172 bash[23680]: cluster 2024-03-30T15:12:11.929457+0000 mon.a (mon.0) 946 : cluster 0 osdmap e82: 8 total, 8 up, 8 in 2024-03-30T15:12:13.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:13 smithi172 bash[23680]: audit 2024-03-30T15:12:11.930496+0000 mon.c (mon.2) 130 : audit 1 from='client.? 172.21.15.72:0/2459281314' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi072-64179-16"}]: dispatch 2024-03-30T15:12:13.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:13 smithi172 bash[23680]: cluster 2024-03-30T15:12:12.348298+0000 mon.a (mon.0) 947 : cluster 3 Health check update: 30 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:12:13.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:13 smithi172 bash[23680]: audit 2024-03-30T15:12:12.364591+0000 mon.a (mon.0) 948 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:13.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:13 smithi172 bash[23680]: audit 2024-03-30T15:12:12.367598+0000 mon.a (mon.0) 949 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi072-64478-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi072-64478-1"}]': finished 2024-03-30T15:12:13.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:13 smithi172 bash[23680]: cluster 2024-03-30T15:12:12.372339+0000 mon.a (mon.0) 950 : cluster 0 osdmap e83: 8 total, 8 up, 8 in 2024-03-30T15:12:13.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:13 smithi172 bash[23680]: audit 2024-03-30T15:12:12.377238+0000 mon.a (mon.0) 951 : audit 1 from='client.? 172.21.15.72:0/855800261' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi072-64187-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi072-64187-22"}]: dispatch 2024-03-30T15:12:13.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:13 smithi172 bash[23680]: audit 2024-03-30T15:12:12.386574+0000 mon.c (mon.2) 131 : audit 1 from='client.? 172.21.15.72:0/1253490719' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi072-64171-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:13.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:13 smithi172 bash[23680]: audit 2024-03-30T15:12:12.391391+0000 mon.c (mon.2) 132 : audit 1 from='client.? 172.21.15.72:0/2697785571' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi072-64163-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:13.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:13 smithi172 bash[23680]: cluster 2024-03-30T15:12:12.393870+0000 client.admin (client.?) 0 : cluster 1 onexx 2024-03-30T15:12:13.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:13 smithi172 bash[23680]: audit 2024-03-30T15:12:12.396847+0000 mon.a (mon.0) 952 : audit 1 from='client.? 172.21.15.72:0/2829404995' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:13.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:13 smithi172 bash[23680]: audit 2024-03-30T15:12:12.398777+0000 mon.a (mon.0) 953 : audit 1 from='client.? 172.21.15.72:0/4044327810' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-03-30T15:12:13.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:13 smithi172 bash[23680]: audit 2024-03-30T15:12:12.407554+0000 mon.a (mon.0) 954 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi072-64403-7"}]: dispatch 2024-03-30T15:12:13.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:13 smithi172 bash[23680]: audit 2024-03-30T15:12:12.409455+0000 mon.c (mon.2) 133 : audit 1 from='client.? 172.21.15.72:0/634351624' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi072-64403-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:13.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:13 smithi172 bash[23680]: cluster 2024-03-30T15:12:12.865717+0000 osd.3 (osd.3) 5 : cluster 0 38.2 deep-scrub starts 2024-03-30T15:12:13.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:13 smithi172 bash[23680]: cluster 2024-03-30T15:12:12.917427+0000 osd.3 (osd.3) 6 : cluster 0 38.2 deep-scrub ok 2024-03-30T15:12:14.157 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:12.348298+0000 mon.a [WRN] Health check update: 30 pool(s) do not have an application enabled api_cmd_pp: Running main() from gmock_main.cc 2024-03-30T15:12:14.157 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd_pp: [==========] Running 3 tests from 1 test suite. 2024-03-30T15:12:14.157 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd_pp: [----------] Global test environment set-up. 2024-03-30T15:12:14.157 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd 2024-03-30T15:12:14.157 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.MonDescribePP 2024-03-30T15:12:14.157 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd_pp: [ OK ] LibRadosCmd.MonDescribePP (64 ms) 2024-03-30T15:12:14.157 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.OSDCmdPP 2024-03-30T15:12:14.157 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd_pp: [ OK ] LibRadosCmd.OSDCmdPP (727 ms) 2024-03-30T15:12:14.158 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.PGCmdPP 2024-03-30T15:12:14.158 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd_pp: [ OK ] LibRadosCmd.PGCmdPP (21242 ms) 2024-03-30T15:12:14.158 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd (22033 ms total) 2024-03-30T15:12:14.158 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd_pp: 2024-03-30T15:12:14.158 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd_pp: [----------] Global test environment tear-down 2024-03-30T15:12:14.158 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd_pp: [==========] 3 tests from 1 test suite ran. (22033 ms total) 2024-03-30T15:12:14.158 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd_pp: [ PASSED ] 3 tests. 2024-03-30T15:12:14.158 INFO:tasks.workunit.client.0.smithi072.stdout: handler_error: Running main() from gmock_main.cc 2024-03-30T15:12:14.158 INFO:tasks.workunit.client.0.smithi072.stdout: handler_error: [==========] Running 1 test from 1 test suite. 2024-03-30T15:12:14.158 INFO:tasks.workunit.client.0.smithi072.stdout: handler_error: [----------] Global test environment set-up. 2024-03-30T15:12:14.159 INFO:tasks.workunit.client.0.smithi072.stdout: handler_error: [----------] 1 test from neocls_handler_error 2024-03-30T15:12:14.159 INFO:tasks.workunit.client.0.smithi072.stdout: handler_error: [ RUN ] neocls_handler_error.test_handler_error 2024-03-30T15:12:14.159 INFO:tasks.workunit.client.0.smithi072.stdout: handler_error: [ OK ] neocls_handler_error.test_handler_error (21912 ms) 2024-03-30T15:12:14.159 INFO:tasks.workunit.client.0.smithi072.stdout: handler_error: [----------] 1 test from neocls_handler_error (21912 ms total) 2024-03-30T15:12:14.159 INFO:tasks.workunit.client.0.smithi072.stdout: handler_error: 2024-03-30T15:12:14.159 INFO:tasks.workunit.client.0.smithi072.stdout: handler_error: [----------] Global test environment tear-down 2024-03-30T15:12:14.159 INFO:tasks.workunit.client.0.smithi072.stdout: handler_error: [==========] 1 test from 1 test suite ran. (21912 ms total) 2024-03-30T15:12:14.159 INFO:tasks.workunit.client.0.smithi072.stdout: handler_error: [ PASSED ] 1 test. 2024-03-30T15:12:14.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[21573]: cluster 2024-03-30T15:12:09.828399+0000 mgr.y (mgr.14526) 169 : cluster 0 pgmap v120: 1012 pgs: 410 creating+peering, 132 active+clean, 470 unknown; 582 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 851 B/s rd, 0 op/s 2024-03-30T15:12:14.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[21573]: audit 2024-03-30T15:12:10.534180+0000 mon.a (mon.0) 945 : audit 1 from='client.? 172.21.15.72:0/855800261' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi072-64187-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:12:14.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[21573]: audit 2024-03-30T15:12:11.052656+0000 mon.c (mon.2) 119 : audit 1 from='client.? 172.21.15.72:0/634351624' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi072-64403-7"}]: dispatch 2024-03-30T15:12:14.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[21573]: audit 2024-03-30T15:12:11.796044+0000 mon.c (mon.2) 120 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.0"}]: dispatch 2024-03-30T15:12:14.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[21573]: audit 2024-03-30T15:12:11.797324+0000 mon.c (mon.2) 121 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.1"}]: dispatch 2024-03-30T15:12:14.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[21573]: audit 2024-03-30T15:12:11.798473+0000 mon.c (mon.2) 122 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.2"}]: dispatch 2024-03-30T15:12:14.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[21573]: audit 2024-03-30T15:12:11.799672+0000 mon.c (mon.2) 123 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.3"}]: dispatch 2024-03-30T15:12:14.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[21573]: audit 2024-03-30T15:12:11.800778+0000 mon.c (mon.2) 124 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.4"}]: dispatch 2024-03-30T15:12:14.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[21573]: audit 2024-03-30T15:12:11.801924+0000 mon.c (mon.2) 125 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.5"}]: dispatch 2024-03-30T15:12:14.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[21573]: audit 2024-03-30T15:12:11.802989+0000 mon.c (mon.2) 126 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.6"}]: dispatch 2024-03-30T15:12:14.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[21573]: audit 2024-03-30T15:12:11.804322+0000 mon.c (mon.2) 127 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.7"}]: dispatch 2024-03-30T15:12:14.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[21573]: audit 2024-03-30T15:12:11.805506+0000 mon.c (mon.2) 128 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.8"}]: dispatch 2024-03-30T15:12:14.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[21573]: audit 2024-03-30T15:12:11.806654+0000 mon.c (mon.2) 129 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.9"}]: dispatch 2024-03-30T15:12:14.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[21573]: cluster 2024-03-30T15:12:11.904897+0000 osd.3 (osd.3) 3 : cluster 0 38.9 deep-scrub starts 2024-03-30T15:12:14.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[21573]: cluster 2024-03-30T15:12:11.908686+0000 osd.3 (osd.3) 4 : cluster 0 38.9 deep-scrub ok 2024-03-30T15:12:14.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[21573]: cluster 2024-03-30T15:12:11.929457+0000 mon.a (mon.0) 946 : cluster 0 osdmap e82: 8 total, 8 up, 8 in 2024-03-30T15:12:14.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[21573]: audit 2024-03-30T15:12:11.930496+0000 mon.c (mon.2) 130 : audit 1 from='client.? 172.21.15.72:0/2459281314' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi072-64179-16"}]: dispatch 2024-03-30T15:12:14.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[21573]: cluster 2024-03-30T15:12:12.348298+0000 mon.a (mon.0) 947 : cluster 3 Health check update: 30 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:12:14.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[21573]: audit 2024-03-30T15:12:12.364591+0000 mon.a (mon.0) 948 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:14.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[21573]: audit 2024-03-30T15:12:12.367598+0000 mon.a (mon.0) 949 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi072-64478-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi072-64478-1"}]': finished 2024-03-30T15:12:14.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[21573]: cluster 2024-03-30T15:12:12.372339+0000 mon.a (mon.0) 950 : cluster 0 osdmap e83: 8 total, 8 up, 8 in 2024-03-30T15:12:14.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[21573]: audit 2024-03-30T15:12:12.377238+0000 mon.a (mon.0) 951 : audit 1 from='client.? 172.21.15.72:0/855800261' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi072-64187-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi072-64187-22"}]: dispatch 2024-03-30T15:12:14.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[21573]: audit 2024-03-30T15:12:12.386574+0000 mon.c (mon.2) 131 : audit 1 from='client.? 172.21.15.72:0/1253490719' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi072-64171-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:14.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[21573]: audit 2024-03-30T15:12:12.391391+0000 mon.c (mon.2) 132 : audit 1 from='client.? 172.21.15.72:0/2697785571' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi072-64163-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:14.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[21573]: cluster 2024-03-30T15:12:12.393870+0000 client.admin (client.?) 0 : cluster 1 onexx 2024-03-30T15:12:14.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[21573]: audit 2024-03-30T15:12:12.396847+0000 mon.a (mon.0) 952 : audit 1 from='client.? 172.21.15.72:0/2829404995' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:14.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[21573]: audit 2024-03-30T15:12:12.398777+0000 mon.a (mon.0) 953 : audit 1 from='client.? 172.21.15.72:0/4044327810' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-03-30T15:12:14.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[21573]: audit 2024-03-30T15:12:12.407554+0000 mon.a (mon.0) 954 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi072-64403-7"}]: dispatch 2024-03-30T15:12:14.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[21573]: audit 2024-03-30T15:12:12.409455+0000 mon.c (mon.2) 133 : audit 1 from='client.? 172.21.15.72:0/634351624' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi072-64403-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:14.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[21573]: cluster 2024-03-30T15:12:12.865717+0000 osd.3 (osd.3) 5 : cluster 0 38.2 deep-scrub starts 2024-03-30T15:12:14.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[21573]: cluster 2024-03-30T15:12:12.917427+0000 osd.3 (osd.3) 6 : cluster 0 38.2 deep-scrub ok 2024-03-30T15:12:14.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[28946]: cluster 2024-03-30T15:12:09.828399+0000 mgr.y (mgr.14526) 169 : cluster 0 pgmap v120: 1012 pgs: 410 creating+peering, 132 active+clean, 470 unknown; 582 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 851 B/s rd, 0 op/s 2024-03-30T15:12:14.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[28946]: audit 2024-03-30T15:12:10.534180+0000 mon.a (mon.0) 945 : audit 1 from='client.? 172.21.15.72:0/855800261' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi072-64187-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:12:14.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[28946]: audit 2024-03-30T15:12:11.052656+0000 mon.c (mon.2) 119 : audit 1 from='client.? 172.21.15.72:0/634351624' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi072-64403-7"}]: dispatch 2024-03-30T15:12:14.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[28946]: audit 2024-03-30T15:12:11.796044+0000 mon.c (mon.2) 120 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.0"}]: dispatch 2024-03-30T15:12:14.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[28946]: audit 2024-03-30T15:12:11.797324+0000 mon.c (mon.2) 121 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.1"}]: dispatch 2024-03-30T15:12:14.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[28946]: audit 2024-03-30T15:12:11.798473+0000 mon.c (mon.2) 122 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.2"}]: dispatch 2024-03-30T15:12:14.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[28946]: audit 2024-03-30T15:12:11.799672+0000 mon.c (mon.2) 123 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.3"}]: dispatch 2024-03-30T15:12:14.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[28946]: audit 2024-03-30T15:12:11.800778+0000 mon.c (mon.2) 124 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.4"}]: dispatch 2024-03-30T15:12:14.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[28946]: audit 2024-03-30T15:12:11.801924+0000 mon.c (mon.2) 125 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.5"}]: dispatch 2024-03-30T15:12:14.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[28946]: audit 2024-03-30T15:12:11.802989+0000 mon.c (mon.2) 126 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.6"}]: dispatch 2024-03-30T15:12:14.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[28946]: audit 2024-03-30T15:12:11.804322+0000 mon.c (mon.2) 127 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.7"}]: dispatch 2024-03-30T15:12:14.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[28946]: audit 2024-03-30T15:12:11.805506+0000 mon.c (mon.2) 128 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.8"}]: dispatch 2024-03-30T15:12:14.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[28946]: audit 2024-03-30T15:12:11.806654+0000 mon.c (mon.2) 129 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.9"}]: dispatch 2024-03-30T15:12:14.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[28946]: cluster 2024-03-30T15:12:11.904897+0000 osd.3 (osd.3) 3 : cluster 0 38.9 deep-scrub starts 2024-03-30T15:12:14.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[28946]: cluster 2024-03-30T15:12:11.908686+0000 osd.3 (osd.3) 4 : cluster 0 38.9 deep-scrub ok 2024-03-30T15:12:14.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[28946]: cluster 2024-03-30T15:12:11.929457+0000 mon.a (mon.0) 946 : cluster 0 osdmap e82: 8 total, 8 up, 8 in 2024-03-30T15:12:14.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[28946]: audit 2024-03-30T15:12:11.930496+0000 mon.c (mon.2) 130 : audit 1 from='client.? 172.21.15.72:0/2459281314' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi072-64179-16"}]: dispatch 2024-03-30T15:12:14.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[28946]: cluster 2024-03-30T15:12:12.348298+0000 mon.a (mon.0) 947 : cluster 3 Health check update: 30 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:12:14.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[28946]: audit 2024-03-30T15:12:12.364591+0000 mon.a (mon.0) 948 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:14.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[28946]: audit 2024-03-30T15:12:12.367598+0000 mon.a (mon.0) 949 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi072-64478-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi072-64478-1"}]': finished 2024-03-30T15:12:14.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[28946]: cluster 2024-03-30T15:12:12.372339+0000 mon.a (mon.0) 950 : cluster 0 osdmap e83: 8 total, 8 up, 8 in 2024-03-30T15:12:14.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[28946]: audit 2024-03-30T15:12:12.377238+0000 mon.a (mon.0) 951 : audit 1 from='client.? 172.21.15.72:0/855800261' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi072-64187-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi072-64187-22"}]: dispatch 2024-03-30T15:12:14.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[28946]: audit 2024-03-30T15:12:12.386574+0000 mon.c (mon.2) 131 : audit 1 from='client.? 172.21.15.72:0/1253490719' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi072-64171-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:14.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[28946]: audit 2024-03-30T15:12:12.391391+0000 mon.c (mon.2) 132 : audit 1 from='client.? 172.21.15.72:0/2697785571' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi072-64163-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:14.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[28946]: cluster 2024-03-30T15:12:12.393870+0000 client.admin (client.?) 0 : cluster 1 onexx 2024-03-30T15:12:14.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[28946]: audit 2024-03-30T15:12:12.396847+0000 mon.a (mon.0) 952 : audit 1 from='client.? 172.21.15.72:0/2829404995' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:14.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[28946]: audit 2024-03-30T15:12:12.398777+0000 mon.a (mon.0) 953 : audit 1 from='client.? 172.21.15.72:0/4044327810' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-03-30T15:12:14.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[28946]: audit 2024-03-30T15:12:12.407554+0000 mon.a (mon.0) 954 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi072-64403-7"}]: dispatch 2024-03-30T15:12:14.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[28946]: audit 2024-03-30T15:12:12.409455+0000 mon.c (mon.2) 133 : audit 1 from='client.? 172.21.15.72:0/634351624' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi072-64403-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:14.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[28946]: cluster 2024-03-30T15:12:12.865717+0000 osd.3 (osd.3) 5 : cluster 0 38.2 deep-scrub starts 2024-03-30T15:12:14.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:13 smithi072 bash[28946]: cluster 2024-03-30T15:12:12.917427+0000 osd.3 (osd.3) 6 : cluster 0 38.2 deep-scrub ok 2024-03-30T15:12:15.459 INFO:tasks.workunit.client.0.smithi072.stdout: 50 objects... 2024-03-30T15:12:15.459 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_16_[66031]: added 50 objects 2024-03-30T15:12:15.459 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_16_[66031]: shutting down. 2024-03-30T15:12:15.459 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: ******************************* 2024-03-30T15:12:15.459 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: ******************************* 2024-03-30T15:12:15.460 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: ******************************* 2024-03-30T15:12:15.460 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: ******************************* 2024-03-30T15:12:15.460 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_15_[66030]: starting. 2024-03-30T15:12:15.460 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_15_[66030]: listing objects. 2024-03-30T15:12:15.460 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_15_[66030]: listed object 0... 2024-03-30T15:12:15.460 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_15_[66030]: listed object 25... 2024-03-30T15:12:15.460 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_15_[66030]: listed object 50... 2024-03-30T15:12:15.460 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_15_[66030]: listed object 75... 2024-03-30T15:12:15.460 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_15_[66030]: listed object 100... 2024-03-30T15:12:15.460 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_15_[66030]: listed object 125... 2024-03-30T15:12:15.460 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_15_[66030]: saw 150 objects 2024-03-30T15:12:15.460 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: process_15_[66030]: shutting down. 2024-03-30T15:12:15.460 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: ******************************* 2024-03-30T15:12:15.460 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: ******************************* 2024-03-30T15:12:15.461 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: ******************************* 2024-03-30T15:12:15.461 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: ******************************* 2024-03-30T15:12:15.461 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: ******************************* 2024-03-30T15:12:15.461 INFO:tasks.workunit.client.0.smithi072.stdout: list_parallel: ******* SUCCESS ********** 2024-03-30T15:12:15.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:15 smithi172 bash[23680]: audit 2024-03-30T15:12:10.957791+0000 mgr.y (mgr.14526) 170 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:12:15.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:15 smithi172 bash[23680]: audit 2024-03-30T15:12:11.796410+0000 mgr.y (mgr.14526) 171 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.0"}]: dispatch 2024-03-30T15:12:15.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:15 smithi172 bash[23680]: audit 2024-03-30T15:12:11.797580+0000 mgr.y (mgr.14526) 172 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.1"}]: dispatch 2024-03-30T15:12:15.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:15 smithi172 bash[23680]: audit 2024-03-30T15:12:11.798745+0000 mgr.y (mgr.14526) 173 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.2"}]: dispatch 2024-03-30T15:12:15.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:15 smithi172 bash[23680]: audit 2024-03-30T15:12:11.799946+0000 mgr.y (mgr.14526) 174 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.3"}]: dispatch 2024-03-30T15:12:15.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:15 smithi172 bash[23680]: audit 2024-03-30T15:12:11.801055+0000 mgr.y (mgr.14526) 175 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.4"}]: dispatch 2024-03-30T15:12:15.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:15 smithi172 bash[23680]: audit 2024-03-30T15:12:11.802189+0000 mgr.y (mgr.14526) 176 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.5"}]: dispatch 2024-03-30T15:12:15.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:15 smithi172 bash[23680]: audit 2024-03-30T15:12:11.803244+0000 mgr.y (mgr.14526) 177 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.6"}]: dispatch 2024-03-30T15:12:15.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:15 smithi172 bash[23680]: audit 2024-03-30T15:12:11.804591+0000 mgr.y (mgr.14526) 178 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.7"}]: dispatch 2024-03-30T15:12:15.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:15 smithi172 bash[23680]: audit 2024-03-30T15:12:11.805795+0000 mgr.y (mgr.14526) 179 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.8"}]: dispatch 2024-03-30T15:12:15.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:15 smithi172 bash[23680]: audit 2024-03-30T15:12:11.806925+0000 mgr.y (mgr.14526) 180 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.9"}]: dispatch 2024-03-30T15:12:15.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:15 smithi172 bash[23680]: cluster 2024-03-30T15:12:11.833697+0000 mgr.y (mgr.14526) 181 : cluster 0 pgmap v122: 788 pgs: 80 creating+peering, 680 active+clean, 28 unknown; 607 KiB data, 280 MiB used, 715 GiB / 715 GiB avail; 5.2 KiB/s rd, 96 KiB/s wr, 537 op/s 2024-03-30T15:12:15.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:15 smithi172 bash[23680]: cluster 2024-03-30T15:12:12.053132+0000 osd.0 (osd.0) 3 : cluster 0 38.6 deep-scrub starts 2024-03-30T15:12:15.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:15 smithi172 bash[23680]: cluster 2024-03-30T15:12:12.055907+0000 osd.0 (osd.0) 4 : cluster 0 38.6 deep-scrub ok 2024-03-30T15:12:15.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:15 smithi172 bash[23680]: audit 2024-03-30T15:12:13.692005+0000 mon.a (mon.0) 955 : audit 1 from='client.? 172.21.15.72:0/4044327810' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2024-03-30T15:12:15.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:15 smithi172 bash[23680]: audit 2024-03-30T15:12:13.698659+0000 mon.a (mon.0) 956 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:15.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:15 smithi172 bash[23680]: audit 2024-03-30T15:12:13.700709+0000 mon.a (mon.0) 957 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi072-64179-16"}]: dispatch 2024-03-30T15:12:15.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:15 smithi172 bash[23680]: audit 2024-03-30T15:12:13.701102+0000 mon.a (mon.0) 958 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi072-64171-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:15.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:15 smithi172 bash[23680]: audit 2024-03-30T15:12:13.701612+0000 mon.a (mon.0) 959 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi072-64163-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:15.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:15 smithi172 bash[23680]: audit 2024-03-30T15:12:13.702119+0000 mon.a (mon.0) 960 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi072-64403-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:15.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:15 smithi072 bash[21573]: audit 2024-03-30T15:12:10.957791+0000 mgr.y (mgr.14526) 170 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:12:15.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:15 smithi072 bash[21573]: audit 2024-03-30T15:12:11.796410+0000 mgr.y (mgr.14526) 171 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.0"}]: dispatch 2024-03-30T15:12:15.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:15 smithi072 bash[21573]: audit 2024-03-30T15:12:11.797580+0000 mgr.y (mgr.14526) 172 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.1"}]: dispatch 2024-03-30T15:12:15.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:15 smithi072 bash[21573]: audit 2024-03-30T15:12:11.798745+0000 mgr.y (mgr.14526) 173 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.2"}]: dispatch 2024-03-30T15:12:15.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:15 smithi072 bash[21573]: audit 2024-03-30T15:12:11.799946+0000 mgr.y (mgr.14526) 174 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.3"}]: dispatch 2024-03-30T15:12:15.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:15 smithi072 bash[21573]: audit 2024-03-30T15:12:11.801055+0000 mgr.y (mgr.14526) 175 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.4"}]: dispatch 2024-03-30T15:12:15.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:15 smithi072 bash[21573]: audit 2024-03-30T15:12:11.802189+0000 mgr.y (mgr.14526) 176 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.5"}]: dispatch 2024-03-30T15:12:15.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:15 smithi072 bash[21573]: audit 2024-03-30T15:12:11.803244+0000 mgr.y (mgr.14526) 177 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.6"}]: dispatch 2024-03-30T15:12:15.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:15 smithi072 bash[21573]: audit 2024-03-30T15:12:11.804591+0000 mgr.y (mgr.14526) 178 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.7"}]: dispatch 2024-03-30T15:12:15.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:15 smithi072 bash[21573]: audit 2024-03-30T15:12:11.805795+0000 mgr.y (mgr.14526) 179 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.8"}]: dispatch 2024-03-30T15:12:15.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:15 smithi072 bash[21573]: audit 2024-03-30T15:12:11.806925+0000 mgr.y (mgr.14526) 180 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.9"}]: dispatch 2024-03-30T15:12:15.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:15 smithi072 bash[21573]: cluster 2024-03-30T15:12:11.833697+0000 mgr.y (mgr.14526) 181 : cluster 0 pgmap v122: 788 pgs: 80 creating+peering, 680 active+clean, 28 unknown; 607 KiB data, 280 MiB used, 715 GiB / 715 GiB avail; 5.2 KiB/s rd, 96 KiB/s wr, 537 op/s 2024-03-30T15:12:15.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:15 smithi072 bash[21573]: cluster 2024-03-30T15:12:12.053132+0000 osd.0 (osd.0) 3 : cluster 0 38.6 deep-scrub starts 2024-03-30T15:12:15.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:15 smithi072 bash[21573]: cluster 2024-03-30T15:12:12.055907+0000 osd.0 (osd.0) 4 : cluster 0 38.6 deep-scrub ok 2024-03-30T15:12:15.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:15 smithi072 bash[21573]: audit 2024-03-30T15:12:13.692005+0000 mon.a (mon.0) 955 : audit 1 from='client.? 172.21.15.72:0/4044327810' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2024-03-30T15:12:15.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:15 smithi072 bash[21573]: audit 2024-03-30T15:12:13.698659+0000 mon.a (mon.0) 956 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:15.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:15 smithi072 bash[21573]: audit 2024-03-30T15:12:13.700709+0000 mon.a (mon.0) 957 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi072-64179-16"}]: dispatch 2024-03-30T15:12:15.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:15 smithi072 bash[21573]: audit 2024-03-30T15:12:13.701102+0000 mon.a (mon.0) 958 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi072-64171-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:15.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:15 smithi072 bash[21573]: audit 2024-03-30T15:12:13.701612+0000 mon.a (mon.0) 959 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi072-64163-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:15.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:15 smithi072 bash[21573]: audit 2024-03-30T15:12:13.702119+0000 mon.a (mon.0) 960 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi072-64403-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:15.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:15 smithi072 bash[28946]: audit 2024-03-30T15:12:10.957791+0000 mgr.y (mgr.14526) 170 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:12:15.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:15 smithi072 bash[28946]: audit 2024-03-30T15:12:11.796410+0000 mgr.y (mgr.14526) 171 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.0"}]: dispatch 2024-03-30T15:12:15.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:15 smithi072 bash[28946]: audit 2024-03-30T15:12:11.797580+0000 mgr.y (mgr.14526) 172 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.1"}]: dispatch 2024-03-30T15:12:15.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:15 smithi072 bash[28946]: audit 2024-03-30T15:12:11.798745+0000 mgr.y (mgr.14526) 173 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.2"}]: dispatch 2024-03-30T15:12:15.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:15 smithi072 bash[28946]: audit 2024-03-30T15:12:11.799946+0000 mgr.y (mgr.14526) 174 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.3"}]: dispatch 2024-03-30T15:12:15.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:15 smithi072 bash[28946]: audit 2024-03-30T15:12:11.801055+0000 mgr.y (mgr.14526) 175 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.4"}]: dispatch 2024-03-30T15:12:15.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:15 smithi072 bash[28946]: audit 2024-03-30T15:12:11.802189+0000 mgr.y (mgr.14526) 176 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.5"}]: dispatch 2024-03-30T15:12:15.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:15 smithi072 bash[28946]: audit 2024-03-30T15:12:11.803244+0000 mgr.y (mgr.14526) 177 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.6"}]: dispatch 2024-03-30T15:12:15.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:15 smithi072 bash[28946]: audit 2024-03-30T15:12:11.804591+0000 mgr.y (mgr.14526) 178 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.7"}]: dispatch 2024-03-30T15:12:15.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:15 smithi072 bash[28946]: audit 2024-03-30T15:12:11.805795+0000 mgr.y (mgr.14526) 179 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.8"}]: dispatch 2024-03-30T15:12:15.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:15 smithi072 bash[28946]: audit 2024-03-30T15:12:11.806925+0000 mgr.y (mgr.14526) 180 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.9"}]: dispatch 2024-03-30T15:12:15.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:15 smithi072 bash[28946]: cluster 2024-03-30T15:12:11.833697+0000 mgr.y (mgr.14526) 181 : cluster 0 pgmap v122: 788 pgs: 80 creating+peering, 680 active+clean, 28 unknown; 607 KiB data, 280 MiB used, 715 GiB / 715 GiB avail; 5.2 KiB/s rd, 96 KiB/s wr, 537 op/s 2024-03-30T15:12:15.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:15 smithi072 bash[28946]: cluster 2024-03-30T15:12:12.053132+0000 osd.0 (osd.0) 3 : cluster 0 38.6 deep-scrub starts 2024-03-30T15:12:15.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:15 smithi072 bash[28946]: cluster 2024-03-30T15:12:12.055907+0000 osd.0 (osd.0) 4 : cluster 0 38.6 deep-scrub ok 2024-03-30T15:12:15.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:15 smithi072 bash[28946]: audit 2024-03-30T15:12:13.692005+0000 mon.a (mon.0) 955 : audit 1 from='client.? 172.21.15.72:0/4044327810' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2024-03-30T15:12:15.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:15 smithi072 bash[28946]: audit 2024-03-30T15:12:13.698659+0000 mon.a (mon.0) 956 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:15.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:15 smithi072 bash[28946]: audit 2024-03-30T15:12:13.700709+0000 mon.a (mon.0) 957 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi072-64179-16"}]: dispatch 2024-03-30T15:12:15.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:15 smithi072 bash[28946]: audit 2024-03-30T15:12:13.701102+0000 mon.a (mon.0) 958 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi072-64171-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:15.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:15 smithi072 bash[28946]: audit 2024-03-30T15:12:13.701612+0000 mon.a (mon.0) 959 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi072-64163-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:15.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:15 smithi072 bash[28946]: audit 2024-03-30T15:12:13.702119+0000 mon.a (mon.0) 960 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi072-64403-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:17.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:16 smithi072 bash[21573]: audit 2024-03-30T15:12:13.705296+0000 mon.a (mon.0) 961 : audit 1 from='client.? 172.21.15.72:0/2829404995' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:17.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:16 smithi072 bash[21573]: audit 2024-03-30T15:12:13.717553+0000 mon.c (mon.2) 134 : audit 1 from='client.? 172.21.15.72:0/3753102855' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi072-64841-1"}]: dispatch 2024-03-30T15:12:17.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:16 smithi072 bash[21573]: audit 2024-03-30T15:12:14.153934+0000 mon.c (mon.2) 135 : audit 1 from='client.? 172.21.15.72:0/2459281314' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi072-64179-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:17.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:16 smithi072 bash[21573]: audit 2024-03-30T15:12:14.158400+0000 mon.c (mon.2) 136 : audit 1 from='client.? 172.21.15.72:0/2688702264' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:17.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:16 smithi072 bash[21573]: audit 2024-03-30T15:12:14.188720+0000 mon.c (mon.2) 137 : audit 1 from='client.? 172.21.15.72:0/459372695' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi072-64425-7"}]: dispatch 2024-03-30T15:12:17.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:16 smithi072 bash[21573]: audit 2024-03-30T15:12:14.189680+0000 mon.c (mon.2) 138 : audit 1 from='client.? 172.21.15.72:0/2935772551' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi072-64211-10"}]: dispatch 2024-03-30T15:12:17.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:16 smithi072 bash[21573]: cluster 2024-03-30T15:12:14.693080+0000 client.admin (client.?) 0 : cluster 1 twoxx 2024-03-30T15:12:17.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:16 smithi072 bash[21573]: cluster 2024-03-30T15:12:15.414168+0000 mon.a (mon.0) 962 : cluster 0 osdmap e84: 8 total, 8 up, 8 in 2024-03-30T15:12:17.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:16 smithi072 bash[21573]: audit 2024-03-30T15:12:15.421076+0000 mon.a (mon.0) 963 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi072-64841-1"}]: dispatch 2024-03-30T15:12:17.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:16 smithi072 bash[21573]: audit 2024-03-30T15:12:15.421543+0000 mon.a (mon.0) 964 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:17.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:16 smithi072 bash[21573]: audit 2024-03-30T15:12:15.422853+0000 mon.a (mon.0) 965 : audit 1 from='client.? 172.21.15.72:0/4044327810' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-03-30T15:12:17.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:16 smithi072 bash[28946]: audit 2024-03-30T15:12:13.705296+0000 mon.a (mon.0) 961 : audit 1 from='client.? 172.21.15.72:0/2829404995' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:17.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:16 smithi072 bash[28946]: audit 2024-03-30T15:12:13.717553+0000 mon.c (mon.2) 134 : audit 1 from='client.? 172.21.15.72:0/3753102855' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi072-64841-1"}]: dispatch 2024-03-30T15:12:17.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:16 smithi072 bash[28946]: audit 2024-03-30T15:12:14.153934+0000 mon.c (mon.2) 135 : audit 1 from='client.? 172.21.15.72:0/2459281314' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi072-64179-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:17.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:16 smithi072 bash[28946]: audit 2024-03-30T15:12:14.158400+0000 mon.c (mon.2) 136 : audit 1 from='client.? 172.21.15.72:0/2688702264' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:17.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:16 smithi072 bash[28946]: audit 2024-03-30T15:12:14.188720+0000 mon.c (mon.2) 137 : audit 1 from='client.? 172.21.15.72:0/459372695' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi072-64425-7"}]: dispatch 2024-03-30T15:12:17.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:16 smithi072 bash[28946]: audit 2024-03-30T15:12:14.189680+0000 mon.c (mon.2) 138 : audit 1 from='client.? 172.21.15.72:0/2935772551' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi072-64211-10"}]: dispatch 2024-03-30T15:12:17.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:16 smithi072 bash[28946]: cluster 2024-03-30T15:12:14.693080+0000 client.admin (client.?) 0 : cluster 1 twoxx 2024-03-30T15:12:17.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:16 smithi072 bash[28946]: cluster 2024-03-30T15:12:15.414168+0000 mon.a (mon.0) 962 : cluster 0 osdmap e84: 8 total, 8 up, 8 in 2024-03-30T15:12:17.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:16 smithi072 bash[28946]: audit 2024-03-30T15:12:15.421076+0000 mon.a (mon.0) 963 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi072-64841-1"}]: dispatch 2024-03-30T15:12:17.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:16 smithi072 bash[28946]: audit 2024-03-30T15:12:15.421543+0000 mon.a (mon.0) 964 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:17.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:16 smithi072 bash[28946]: audit 2024-03-30T15:12:15.422853+0000 mon.a (mon.0) 965 : audit 1 from='client.? 172.21.15.72:0/4044327810' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-03-30T15:12:17.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:16 smithi172 bash[23680]: audit 2024-03-30T15:12:13.705296+0000 mon.a (mon.0) 961 : audit 1 from='client.? 172.21.15.72:0/2829404995' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:17.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:16 smithi172 bash[23680]: audit 2024-03-30T15:12:13.717553+0000 mon.c (mon.2) 134 : audit 1 from='client.? 172.21.15.72:0/3753102855' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi072-64841-1"}]: dispatch 2024-03-30T15:12:17.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:16 smithi172 bash[23680]: audit 2024-03-30T15:12:14.153934+0000 mon.c (mon.2) 135 : audit 1 from='client.? 172.21.15.72:0/2459281314' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi072-64179-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:17.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:16 smithi172 bash[23680]: audit 2024-03-30T15:12:14.158400+0000 mon.c (mon.2) 136 : audit 1 from='client.? 172.21.15.72:0/2688702264' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:17.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:16 smithi172 bash[23680]: audit 2024-03-30T15:12:14.188720+0000 mon.c (mon.2) 137 : audit 1 from='client.? 172.21.15.72:0/459372695' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi072-64425-7"}]: dispatch 2024-03-30T15:12:17.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:16 smithi172 bash[23680]: audit 2024-03-30T15:12:14.189680+0000 mon.c (mon.2) 138 : audit 1 from='client.? 172.21.15.72:0/2935772551' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi072-64211-10"}]: dispatch 2024-03-30T15:12:17.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:16 smithi172 bash[23680]: cluster 2024-03-30T15:12:14.693080+0000 client.admin (client.?) 0 : cluster 1 twoxx 2024-03-30T15:12:17.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:16 smithi172 bash[23680]: cluster 2024-03-30T15:12:15.414168+0000 mon.a (mon.0) 962 : cluster 0 osdmap e84: 8 total, 8 up, 8 in 2024-03-30T15:12:17.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:16 smithi172 bash[23680]: audit 2024-03-30T15:12:15.421076+0000 mon.a (mon.0) 963 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi072-64841-1"}]: dispatch 2024-03-30T15:12:17.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:16 smithi172 bash[23680]: audit 2024-03-30T15:12:15.421543+0000 mon.a (mon.0) 964 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:17.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:16 smithi172 bash[23680]: audit 2024-03-30T15:12:15.422853+0000 mon.a (mon.0) 965 : audit 1 from='client.? 172.21.15.72:0/4044327810' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-03-30T15:12:19.461 INFO:tasks.workunit.client.0.smithi072.stdout:(POOL_APP_NOT_ENABLED) 2024-03-30T15:12:19.462 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:12.367598+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi072-64478-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi072-64478-1"}]': finished 2024-03-30T15:12:19.462 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:12.377238+0000 mon.a [INF] from='client.? 172.21.15.72:0/855800261' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi072-64187-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi072-64187-22"}]: dispatch 2024-03-30T15:12:19.462 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:12.386574+0000 mon.c [INF] from='client.? 172.21.15.72:0/1253490719' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi072-64171-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:19.462 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:12.391391+0000 mon.c [INF] from='client.? 172.21.15.72:0/2697785571' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi072-64163-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:19.462 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:12.393870+0000 client.admin [INF] onexx 2024-03-30T15:12:19.462 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:12.396847+0000 mon.a [INF] from='client.? 172.21.15.72:0/2829404995' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:19.462 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:12.398777+0000 mon.a [INF] from='client.? 172.21.15.72:0/4044327810' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-03-30T15:12:19.462 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:12.407554+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi072-64403-7"}]: dispatch 2024-03-30T15:12:19.462 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:12.409455+0000 mon.c [INF] from='client.? 172.21.15.72:0/634351624' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi072-64403-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:19.462 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:15.436676+0000 mon.a [INF] from='client.? 172.21.15.72:0/855800261' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi072-64187-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi072-64187-22"}]': finished 2024-03-30T15:12:19.462 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:15.436772+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi072-64171-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:19.463 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:15.436850+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi072-64163-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:19.463 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:15.436923+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi072-64403-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:12:19.463 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:15.448068+0000 mon.c [INF] from='client.? 172.21.15.72:0/634351624' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi072-64403-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi072-64403-7"}]: dispatch 2024-03-30T15:12:19.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:19 smithi172 bash[23680]: cluster 2024-03-30T15:12:13.032092+0000 osd.0 (osd.0) 5 : cluster 0 38.1 deep-scrub starts 2024-03-30T15:12:19.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:19 smithi172 bash[23680]: cluster 2024-03-30T15:12:13.035414+0000 osd.0 (osd.0) 6 : cluster 0 38.1 deep-scrub ok 2024-03-30T15:12:19.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:19 smithi172 bash[23680]: cluster 2024-03-30T15:12:13.834607+0000 mgr.y (mgr.14526) 182 : cluster 0 pgmap v125: 756 pgs: 52 creating+peering, 486 active+clean, 218 unknown; 607 KiB data, 280 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 97 KiB/s wr, 534 op/s 2024-03-30T15:12:19.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:19 smithi172 bash[23680]: cluster 2024-03-30T15:12:13.880055+0000 osd.3 (osd.3) 7 : cluster 0 38.7 deep-scrub starts 2024-03-30T15:12:19.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:19 smithi172 bash[23680]: cluster 2024-03-30T15:12:13.881288+0000 osd.3 (osd.3) 8 : cluster 0 38.7 deep-scrub ok 2024-03-30T15:12:19.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:19 smithi172 bash[23680]: audit 2024-03-30T15:12:15.436676+0000 mon.a (mon.0) 966 : audit 1 from='client.? 172.21.15.72:0/855800261' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi072-64187-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi072-64187-22"}]': finished 2024-03-30T15:12:19.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:19 smithi172 bash[23680]: audit 2024-03-30T15:12:15.436772+0000 mon.a (mon.0) 967 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi072-64171-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:19.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:19 smithi172 bash[23680]: audit 2024-03-30T15:12:15.436850+0000 mon.a (mon.0) 968 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi072-64163-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:19.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:19 smithi172 bash[23680]: audit 2024-03-30T15:12:15.436923+0000 mon.a (mon.0) 969 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi072-64403-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:12:19.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:19 smithi172 bash[23680]: audit 2024-03-30T15:12:15.448068+0000 mon.c (mon.2) 139 : audit 1 from='client.? 172.21.15.72:0/634351624' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi072-64403-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi072-64403-7"}]: dispatch 2024-03-30T15:12:19.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:19 smithi172 bash[23680]: cluster 2024-03-30T15:12:16.746114+0000 mon.a (mon.0) 970 : cluster 0 osdmap e85: 8 total, 8 up, 8 in 2024-03-30T15:12:19.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:19 smithi172 bash[23680]: audit 2024-03-30T15:12:16.753851+0000 mon.a (mon.0) 971 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:19.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:19 smithi172 bash[23680]: audit 2024-03-30T15:12:16.757934+0000 mon.a (mon.0) 972 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi072-64179-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:19.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:19 smithi172 bash[23680]: audit 2024-03-30T15:12:16.759281+0000 mon.a (mon.0) 973 : audit 1 from='client.? 172.21.15.72:0/3101006435' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi072-64256-10"}]: dispatch 2024-03-30T15:12:19.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:19 smithi172 bash[23680]: audit 2024-03-30T15:12:16.759897+0000 mon.a (mon.0) 974 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:19.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:19 smithi172 bash[23680]: audit 2024-03-30T15:12:16.761032+0000 mon.a (mon.0) 975 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi072-64425-7"}]: dispatch 2024-03-30T15:12:19.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:19 smithi172 bash[23680]: audit 2024-03-30T15:12:16.761499+0000 mon.a (mon.0) 976 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi072-64211-10"}]: dispatch 2024-03-30T15:12:19.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:19 smithi172 bash[23680]: audit 2024-03-30T15:12:16.762783+0000 mon.a (mon.0) 977 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi072-64403-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi072-64403-7"}]: dispatch 2024-03-30T15:12:19.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:19 smithi072 bash[21573]: cluster 2024-03-30T15:12:13.032092+0000 osd.0 (osd.0) 5 : cluster 0 38.1 deep-scrub starts 2024-03-30T15:12:19.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:19 smithi072 bash[21573]: cluster 2024-03-30T15:12:13.035414+0000 osd.0 (osd.0) 6 : cluster 0 38.1 deep-scrub ok 2024-03-30T15:12:19.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:19 smithi072 bash[21573]: cluster 2024-03-30T15:12:13.834607+0000 mgr.y (mgr.14526) 182 : cluster 0 pgmap v125: 756 pgs: 52 creating+peering, 486 active+clean, 218 unknown; 607 KiB data, 280 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 97 KiB/s wr, 534 op/s 2024-03-30T15:12:19.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:19 smithi072 bash[21573]: cluster 2024-03-30T15:12:13.880055+0000 osd.3 (osd.3) 7 : cluster 0 38.7 deep-scrub starts 2024-03-30T15:12:19.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:19 smithi072 bash[21573]: cluster 2024-03-30T15:12:13.881288+0000 osd.3 (osd.3) 8 : cluster 0 38.7 deep-scrub ok 2024-03-30T15:12:19.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:19 smithi072 bash[21573]: audit 2024-03-30T15:12:15.436676+0000 mon.a (mon.0) 966 : audit 1 from='client.? 172.21.15.72:0/855800261' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi072-64187-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi072-64187-22"}]': finished 2024-03-30T15:12:19.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:19 smithi072 bash[21573]: audit 2024-03-30T15:12:15.436772+0000 mon.a (mon.0) 967 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi072-64171-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:19.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:19 smithi072 bash[21573]: audit 2024-03-30T15:12:15.436850+0000 mon.a (mon.0) 968 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi072-64163-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:19.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:19 smithi072 bash[21573]: audit 2024-03-30T15:12:15.436923+0000 mon.a (mon.0) 969 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi072-64403-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:12:19.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:19 smithi072 bash[21573]: audit 2024-03-30T15:12:15.448068+0000 mon.c (mon.2) 139 : audit 1 from='client.? 172.21.15.72:0/634351624' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi072-64403-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi072-64403-7"}]: dispatch 2024-03-30T15:12:19.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:19 smithi072 bash[21573]: cluster 2024-03-30T15:12:16.746114+0000 mon.a (mon.0) 970 : cluster 0 osdmap e85: 8 total, 8 up, 8 in 2024-03-30T15:12:19.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:19 smithi072 bash[21573]: audit 2024-03-30T15:12:16.753851+0000 mon.a (mon.0) 971 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:19.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:19 smithi072 bash[21573]: audit 2024-03-30T15:12:16.757934+0000 mon.a (mon.0) 972 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi072-64179-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:19.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:19 smithi072 bash[21573]: audit 2024-03-30T15:12:16.759281+0000 mon.a (mon.0) 973 : audit 1 from='client.? 172.21.15.72:0/3101006435' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi072-64256-10"}]: dispatch 2024-03-30T15:12:19.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:19 smithi072 bash[21573]: audit 2024-03-30T15:12:16.759897+0000 mon.a (mon.0) 974 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:19.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:19 smithi072 bash[21573]: audit 2024-03-30T15:12:16.761032+0000 mon.a (mon.0) 975 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi072-64425-7"}]: dispatch 2024-03-30T15:12:19.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:19 smithi072 bash[21573]: audit 2024-03-30T15:12:16.761499+0000 mon.a (mon.0) 976 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi072-64211-10"}]: dispatch 2024-03-30T15:12:19.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:19 smithi072 bash[21573]: audit 2024-03-30T15:12:16.762783+0000 mon.a (mon.0) 977 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi072-64403-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi072-64403-7"}]: dispatch 2024-03-30T15:12:19.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:19 smithi072 bash[28946]: cluster 2024-03-30T15:12:13.032092+0000 osd.0 (osd.0) 5 : cluster 0 38.1 deep-scrub starts 2024-03-30T15:12:19.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:19 smithi072 bash[28946]: cluster 2024-03-30T15:12:13.035414+0000 osd.0 (osd.0) 6 : cluster 0 38.1 deep-scrub ok 2024-03-30T15:12:19.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:19 smithi072 bash[28946]: cluster 2024-03-30T15:12:13.834607+0000 mgr.y (mgr.14526) 182 : cluster 0 pgmap v125: 756 pgs: 52 creating+peering, 486 active+clean, 218 unknown; 607 KiB data, 280 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 97 KiB/s wr, 534 op/s 2024-03-30T15:12:19.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:19 smithi072 bash[28946]: cluster 2024-03-30T15:12:13.880055+0000 osd.3 (osd.3) 7 : cluster 0 38.7 deep-scrub starts 2024-03-30T15:12:19.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:19 smithi072 bash[28946]: cluster 2024-03-30T15:12:13.881288+0000 osd.3 (osd.3) 8 : cluster 0 38.7 deep-scrub ok 2024-03-30T15:12:19.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:19 smithi072 bash[28946]: audit 2024-03-30T15:12:15.436676+0000 mon.a (mon.0) 966 : audit 1 from='client.? 172.21.15.72:0/855800261' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi072-64187-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi072-64187-22"}]': finished 2024-03-30T15:12:19.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:19 smithi072 bash[28946]: audit 2024-03-30T15:12:15.436772+0000 mon.a (mon.0) 967 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi072-64171-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:19.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:19 smithi072 bash[28946]: audit 2024-03-30T15:12:15.436850+0000 mon.a (mon.0) 968 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi072-64163-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:19.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:19 smithi072 bash[28946]: audit 2024-03-30T15:12:15.436923+0000 mon.a (mon.0) 969 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi072-64403-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:12:19.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:19 smithi072 bash[28946]: audit 2024-03-30T15:12:15.448068+0000 mon.c (mon.2) 139 : audit 1 from='client.? 172.21.15.72:0/634351624' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi072-64403-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi072-64403-7"}]: dispatch 2024-03-30T15:12:19.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:19 smithi072 bash[28946]: cluster 2024-03-30T15:12:16.746114+0000 mon.a (mon.0) 970 : cluster 0 osdmap e85: 8 total, 8 up, 8 in 2024-03-30T15:12:19.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:19 smithi072 bash[28946]: audit 2024-03-30T15:12:16.753851+0000 mon.a (mon.0) 971 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:19.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:19 smithi072 bash[28946]: audit 2024-03-30T15:12:16.757934+0000 mon.a (mon.0) 972 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi072-64179-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:19.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:19 smithi072 bash[28946]: audit 2024-03-30T15:12:16.759281+0000 mon.a (mon.0) 973 : audit 1 from='client.? 172.21.15.72:0/3101006435' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi072-64256-10"}]: dispatch 2024-03-30T15:12:19.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:19 smithi072 bash[28946]: audit 2024-03-30T15:12:16.759897+0000 mon.a (mon.0) 974 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:19.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:19 smithi072 bash[28946]: audit 2024-03-30T15:12:16.761032+0000 mon.a (mon.0) 975 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi072-64425-7"}]: dispatch 2024-03-30T15:12:19.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:19 smithi072 bash[28946]: audit 2024-03-30T15:12:16.761499+0000 mon.a (mon.0) 976 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi072-64211-10"}]: dispatch 2024-03-30T15:12:19.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:19 smithi072 bash[28946]: audit 2024-03-30T15:12:16.762783+0000 mon.a (mon.0) 977 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi072-64403-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi072-64403-7"}]: dispatch 2024-03-30T15:12:20.782 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:16.757934+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi072-64179-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:20.783 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:16.759281+0000 mon.a [INF] from='client.? 172.21.15.72:0/3101006435' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi072-64256-10"}]: dispatch 2024-03-30T15:12:20.783 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:16.759897+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:20.783 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:16.761032+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi072-64425-7"}]: dispatch 2024-03-30T15:12:20.783 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:16.761499+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi072-64211-10"}]: dispatch 2024-03-30T15:12:20.783 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:16.762783+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi072-64403-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi072-64403-7"}]: dispatch 2024-03-30T15:12:20.783 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:16.771353+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi072-64841-1"}]': finished 2024-03-30T15:12:20.783 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:16.772738+0000 mon.a [INF] from='client.? 172.21.15.72:0/4044327810' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-03-30T15:12:20.783 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:16.778213+0000 mon.a [INF] from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:12:20.783 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:16.788801+0000 mon.c [INF] from='client.? 172.21.15.72:0/3753102855' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi072-64841-1"}]: dispatch 2024-03-30T15:12:20.783 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:17.255412+0000 mon.c [INF] from='client.? 172.21.15.72:0/459372695' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi072-64425-7"}]: dispatch 2024-03-30T15:12:20.783 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:17.255623+0000 mon.c [INF] from='client.? 172.21.15.72:0/2935772551' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi072-64211-10"}]: dispatch 2024-03-30T15:12:20.784 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:18.106600+0000 mon.a [WRN] Health check update: 14 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:12:20.784 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:18.118492+0000 mon.a [INF] from='client.? 172.21.15.72:0/3101006435' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi072-64256-10"}]: dispatch 2024-03-30T15:12:20.784 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:18.119031+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi072-64841-1"}]: dispatch 2024-03-30T15:12:20.784 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:18.120060+0000 mon.a [INF] from='client.? 172.21.15.72:0/2829404995' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:20.784 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:18.122966+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi072-64425-7"}]: dispatch 2024-03-30T15:12:20.784 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:18.123501+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi072-64179-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:12:20.784 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:18.124106+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:20.784 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:18.128878+0000 mon.c [INF] from='client.? 172.21.15.72:0/2459281314' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi072-64179-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi072-64179-16"}]: dispatch 2024-03-30T15:12:20.784 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:18.137496+0000 mon.c [INF] from='client.? 172.21.15.72:0/900532841' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:20.784 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:18.568999+0000 mon.c [INF] from='client.? 172.21.15.72:0/1253490719' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi072-64171-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:20.784 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:18.773378+0000 client.admin [INF] threexx 2024-03-30T15:12:20.784 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:19.441254+0000 mon.c [INF] from='client.? 172.21.15.72:0/459372695' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi072-64425-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:20.784 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:19.441405+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi072-64211-10"}]: dispatch 2024-03-30T15:12:20.784 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:19.443234+0000 mon.c [INF] from='client.? 172.21.15.72:0/2935772551' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi072-64211-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:20.785 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:19.467475+0000 mon.a [INF] from='client.? 172.21.15.72:0/3101006435' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi072-64256-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:20.785 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:19.468054+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi072-64179-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi072-64179-16"}]: dispatch 2024-03-30T15:12:20.785 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:19.468494+0000 mon.a [INF] from='client.? 172.21.15.72:0/4044327810' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-03-30T15:12:20.785 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:19.469278+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:20.785 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:19.469540+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi072-64403-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi072-64403-7"}]': finished 2024-03-30T15:12:20.785 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:19.469638+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi072-64841-1"}]': finished 2024-03-30T15:12:20.785 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:19.469699+0000 mon.a [INF] from='client.? 172.21.15.72:0/2829404995' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:20.999 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:19.488113+0000 mon.c [INF] from='client.? 172.21.15.72:0/1501181106' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofil api_io_pp: Running main() from gmock_main.cc 2024-03-30T15:12:20.999 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [==========] Running 37 tests from 2 test suites. 2024-03-30T15:12:20.999 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [----------] Global test environment set-up. 2024-03-30T15:12:20.999 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [----------] 20 tests from LibRadosIoPP 2024-03-30T15:12:20.999 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: seed 64187 2024-03-30T15:12:20.999 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TooBigPP 2024-03-30T15:12:20.999 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ OK ] LibRadosIoPP.TooBigPP (0 ms) 2024-03-30T15:12:20.999 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SimpleWritePP 2024-03-30T15:12:21.000 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ OK ] LibRadosIoPP.SimpleWritePP (7 ms) 2024-03-30T15:12:21.000 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadOpPP 2024-03-30T15:12:21.000 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadOpPP (21 ms) 2024-03-30T15:12:21.000 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadOpPP 2024-03-30T15:12:21.000 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadOpPP (16 ms) 2024-03-30T15:12:21.000 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP 2024-03-30T15:12:21.000 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP (3 ms) 2024-03-30T15:12:21.000 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP2 2024-03-30T15:12:21.000 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP2 (3 ms) 2024-03-30T15:12:21.000 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ RUN ] LibRadosIoPP.Checksum 2024-03-30T15:12:21.000 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ OK ] LibRadosIoPP.Checksum (6 ms) 2024-03-30T15:12:21.000 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadIntoBufferlist 2024-03-30T15:12:21.001 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadIntoBufferlist (5 ms) 2024-03-30T15:12:21.001 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2024-03-30T15:12:21.001 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (8 ms) 2024-03-30T15:12:21.001 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2024-03-30T15:12:21.001 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP (3 ms) 2024-03-30T15:12:21.001 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2024-03-30T15:12:21.001 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (3 ms) 2024-03-30T15:12:21.001 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ RUN ] LibRadosIoPP.AppendRoundTripPP 2024-03-30T15:12:21.001 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ OK ] LibRadosIoPP.AppendRoundTripPP (9 ms) 2024-03-30T15:12:21.001 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TruncTestPP 2024-03-30T15:12:21.001 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ OK ] LibRadosIoPP.TruncTestPP (7 ms) 2024-03-30T15:12:21.001 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RemoveTestPP 2024-03-30T15:12:21.002 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ OK ] LibRadosIoPP.RemoveTestPP (3 ms) 2024-03-30T15:12:21.002 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrsRoundTripPP 2024-03-30T15:12:21.002 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrsRoundTripPP (6 ms) 2024-03-30T15:12:21.002 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RmXattrPP 2024-03-30T15:12:21.002 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ OK ] LibRadosIoPP.RmXattrPP (19 ms) 2024-03-30T15:12:21.002 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrListPP 2024-03-30T15:12:21.002 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrListPP (8 ms) 2024-03-30T15:12:21.002 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtPP 2024-03-30T15:12:21.002 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtPP (5 ms) 2024-03-30T15:12:21.002 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtDNEPP 2024-03-30T15:12:21.002 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtDNEPP (6 ms) 2024-03-30T15:12:21.003 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtMismatchPP 2024-03-30T15:12:21.003 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtMismatchPP (5 ms) 2024-03-30T15:12:21.003 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [----------] 20 tests from LibRadosIoPP (144 ms total) 2024-03-30T15:12:21.003 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: 2024-03-30T15:12:21.003 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP 2024-03-30T15:12:21.003 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SimpleWritePP 2024-03-30T15:12:21.003 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SimpleWritePP (4223 ms) 2024-03-30T15:12:21.003 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.ReadOpPP 2024-03-30T15:12:21.003 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ OK ] LibRadosIoECPP.ReadOpPP (13 ms) 2024-03-30T15:12:21.003 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SparseReadOpPP 2024-03-30T15:12:21.003 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SparseReadOpPP (4 ms) 2024-03-30T15:12:21.003 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP 2024-03-30T15:12:21.004 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP (3 ms) 2024-03-30T15:12:21.004 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP2 2024-03-30T15:12:21.004 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP2 (3 ms) 2024-03-30T15:12:21.028 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: cluster 2024-03-30T15:12:12.227661+0000 osd.7 (osd.7) 3 : cluster 0 38.4 deep-scrub starts 2024-03-30T15:12:21.028 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: cluster 2024-03-30T15:12:12.228593+0000 osd.6 (osd.6) 3 : cluster 0 38.3 deep-scrub starts 2024-03-30T15:12:21.029 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: cluster 2024-03-30T15:12:12.230804+0000 osd.7 (osd.7) 4 : cluster 0 38.4 deep-scrub ok 2024-03-30T15:12:21.029 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: cluster 2024-03-30T15:12:12.234657+0000 osd.6 (osd.6) 4 : cluster 0 38.3 deep-scrub ok 2024-03-30T15:12:21.029 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: cluster 2024-03-30T15:12:12.723906+0000 osd.4 (osd.4) 3 : cluster 0 38.0 deep-scrub starts 2024-03-30T15:12:21.029 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: cluster 2024-03-30T15:12:12.727416+0000 osd.4 (osd.4) 4 : cluster 0 38.0 deep-scrub ok 2024-03-30T15:12:21.029 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: cluster 2024-03-30T15:12:13.207142+0000 osd.7 (osd.7) 5 : cluster 0 38.8 deep-scrub starts 2024-03-30T15:12:21.029 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: cluster 2024-03-30T15:12:13.209557+0000 osd.7 (osd.7) 6 : cluster 0 38.8 deep-scrub ok 2024-03-30T15:12:21.029 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: cluster 2024-03-30T15:12:13.274611+0000 osd.6 (osd.6) 5 : cluster 0 38.5 deep-scrub starts 2024-03-30T15:12:21.029 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: cluster 2024-03-30T15:12:13.276871+0000 osd.6 (osd.6) 6 : cluster 0 38.5 deep-scrub ok 2024-03-30T15:12:21.029 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: cluster 2024-03-30T15:12:15.839905+0000 mgr.y (mgr.14526) 183 : cluster 0 pgmap v127: 764 pgs: 244 creating+peering, 490 active+clean, 30 unknown; 145 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 9.1 MiB/s rd, 28 MiB/s wr, 424 op/s 2024-03-30T15:12:21.029 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: audit 2024-03-30T15:12:16.771353+0000 mon.a (mon.0) 978 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi072-64841-1"}]': finished 2024-03-30T15:12:21.029 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: audit 2024-03-30T15:12:16.772738+0000 mon.a (mon.0) 979 : audit 1 from='client.? 172.21.15.72:0/4044327810' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-03-30T15:12:21.029 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: audit 2024-03-30T15:12:16.778213+0000 mon.a (mon.0) 980 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:12:21.029 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: audit 2024-03-30T15:12:16.781576+0000 mon.c (mon.2) 140 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:12:21.030 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: audit 2024-03-30T15:12:16.788801+0000 mon.c (mon.2) 141 : audit 1 from='client.? 172.21.15.72:0/3753102855' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi072-64841-1"}]: dispatch 2024-03-30T15:12:21.030 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: audit 2024-03-30T15:12:17.255412+0000 mon.c (mon.2) 142 : audit 1 from='client.? 172.21.15.72:0/459372695' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi072-64425-7"}]: dispatch 2024-03-30T15:12:21.030 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: audit 2024-03-30T15:12:17.255623+0000 mon.c (mon.2) 143 : audit 1 from='client.? 172.21.15.72:0/2935772551' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi072-64211-10"}]: dispatch 2024-03-30T15:12:21.030 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: cluster 2024-03-30T15:12:18.106103+0000 mon.a (mon.0) 981 : cluster 0 osdmap e86: 8 total, 8 up, 8 in 2024-03-30T15:12:21.030 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: cluster 2024-03-30T15:12:18.106600+0000 mon.a (mon.0) 982 : cluster 3 Health check update: 14 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:12:21.030 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: audit 2024-03-30T15:12:18.118055+0000 mon.a (mon.0) 983 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:21.030 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: audit 2024-03-30T15:12:18.118492+0000 mon.a (mon.0) 984 : audit 1 from='client.? 172.21.15.72:0/3101006435' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi072-64256-10"}]: dispatch 2024-03-30T15:12:21.030 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: audit 2024-03-30T15:12:18.119031+0000 mon.a (mon.0) 985 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi072-64841-1"}]: dispatch 2024-03-30T15:12:21.030 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: audit 2024-03-30T15:12:18.120060+0000 mon.a (mon.0) 986 : audit 1 from='client.? 172.21.15.72:0/2829404995' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:21.030 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: audit 2024-03-30T15:12:18.122966+0000 mon.a (mon.0) 987 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi072-64425-7"}]: dispatch 2024-03-30T15:12:21.030 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: audit 2024-03-30T15:12:18.123501+0000 mon.a (mon.0) 988 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi072-64179-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:12:21.030 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: audit 2024-03-30T15:12:18.124106+0000 mon.a (mon.0) 989 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:21.030 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: audit 2024-03-30T15:12:18.128878+0000 mon.c (mon.2) 144 : audit 1 from='client.? 172.21.15.72:0/2459281314' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi072-64179-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi072-64179-16"}]: dispatch 2024-03-30T15:12:21.031 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: audit 2024-03-30T15:12:18.137496+0000 mon.c (mon.2) 145 : audit 1 from='client.? 172.21.15.72:0/900532841' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:21.031 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: audit 2024-03-30T15:12:18.568999+0000 mon.c (mon.2) 146 : audit 1 from='client.? 172.21.15.72:0/1253490719' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi072-64171-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:21.031 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: cluster 2024-03-30T15:12:18.773378+0000 client.admin (client.?) 0 : cluster 1 threexx 2024-03-30T15:12:21.031 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: cluster 2024-03-30T15:12:19.440042+0000 mon.a (mon.0) 990 : cluster 0 osdmap e87: 8 total, 8 up, 8 in 2024-03-30T15:12:21.031 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: audit 2024-03-30T15:12:19.441254+0000 mon.c (mon.2) 147 : audit 1 from='client.? 172.21.15.72:0/459372695' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi072-64425-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:21.031 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: audit 2024-03-30T15:12:19.441405+0000 mon.a (mon.0) 991 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi072-64211-10"}]: dispatch 2024-03-30T15:12:21.031 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: audit 2024-03-30T15:12:19.443234+0000 mon.c (mon.2) 148 : audit 1 from='client.? 172.21.15.72:0/2935772551' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi072-64211-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:21.031 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: audit 2024-03-30T15:12:19.465869+0000 mon.a (mon.0) 992 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:21.031 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: audit 2024-03-30T15:12:19.467475+0000 mon.a (mon.0) 993 : audit 1 from='client.? 172.21.15.72:0/3101006435' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi072-64256-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:21.031 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: audit 2024-03-30T15:12:19.468054+0000 mon.a (mon.0) 994 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi072-64179-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi072-64179-16"}]: dispatch 2024-03-30T15:12:21.032 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: audit 2024-03-30T15:12:19.468494+0000 mon.a (mon.0) 995 : audit 1 from='client.? 172.21.15.72:0/4044327810' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-03-30T15:12:21.032 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: audit 2024-03-30T15:12:19.469278+0000 mon.a (mon.0) 996 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:21.032 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: audit 2024-03-30T15:12:19.469540+0000 mon.a (mon.0) 997 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi072-64403-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi072-64403-7"}]': finished 2024-03-30T15:12:21.032 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: audit 2024-03-30T15:12:19.469638+0000 mon.a (mon.0) 998 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi072-64841-1"}]': finished 2024-03-30T15:12:21.032 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: audit 2024-03-30T15:12:19.469699+0000 mon.a (mon.0) 999 : audit 1 from='client.? 172.21.15.72:0/2829404995' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:21.032 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: audit 2024-03-30T15:12:19.488113+0000 mon.c (mon.2) 149 : audit 1 from='client.? 172.21.15.72:0/1501181106' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi072-64882-1"}]: dispatch 2024-03-30T15:12:21.032 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: cluster 2024-03-30T15:12:19.900325+0000 mon.a (mon.0) 1000 : cluster 0 osdmap e88: 8 total, 8 up, 8 in 2024-03-30T15:12:21.032 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: audit 2024-03-30T15:12:20.313592+0000 mon.a (mon.0) 1001 : audit 1 from='client.? 172.21.15.72:0/2829404995' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-4", "tierpool": "test-rados-api-smithi072-64344-4-cache"}]: dispatch 2024-03-30T15:12:21.032 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: audit 2024-03-30T15:12:20.319548+0000 mon.a (mon.0) 1002 : audit 1 from='client.? 172.21.15.72:0/1633994099' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi072-64841-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:21.032 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[21573]: audit 2024-03-30T15:12:20.329677+0000 mon.a (mon.0) 1003 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi072-64171-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:21.033 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: cluster 2024-03-30T15:12:12.227661+0000 osd.7 (osd.7) 3 : cluster 0 38.4 deep-scrub starts 2024-03-30T15:12:21.033 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: cluster 2024-03-30T15:12:12.228593+0000 osd.6 (osd.6) 3 : cluster 0 38.3 deep-scrub starts 2024-03-30T15:12:21.033 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: cluster 2024-03-30T15:12:12.230804+0000 osd.7 (osd.7) 4 : cluster 0 38.4 deep-scrub ok 2024-03-30T15:12:21.033 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: cluster 2024-03-30T15:12:12.234657+0000 osd.6 (osd.6) 4 : cluster 0 38.3 deep-scrub ok 2024-03-30T15:12:21.033 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: cluster 2024-03-30T15:12:12.723906+0000 osd.4 (osd.4) 3 : cluster 0 38.0 deep-scrub starts 2024-03-30T15:12:21.033 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: cluster 2024-03-30T15:12:12.727416+0000 osd.4 (osd.4) 4 : cluster 0 38.0 deep-scrub ok 2024-03-30T15:12:21.033 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: cluster 2024-03-30T15:12:13.207142+0000 osd.7 (osd.7) 5 : cluster 0 38.8 deep-scrub starts 2024-03-30T15:12:21.033 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: cluster 2024-03-30T15:12:13.209557+0000 osd.7 (osd.7) 6 : cluster 0 38.8 deep-scrub ok 2024-03-30T15:12:21.033 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: cluster 2024-03-30T15:12:13.274611+0000 osd.6 (osd.6) 5 : cluster 0 38.5 deep-scrub starts 2024-03-30T15:12:21.033 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: cluster 2024-03-30T15:12:13.276871+0000 osd.6 (osd.6) 6 : cluster 0 38.5 deep-scrub ok 2024-03-30T15:12:21.033 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: cluster 2024-03-30T15:12:15.839905+0000 mgr.y (mgr.14526) 183 : cluster 0 pgmap v127: 764 pgs: 244 creating+peering, 490 active+clean, 30 unknown; 145 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 9.1 MiB/s rd, 28 MiB/s wr, 424 op/s 2024-03-30T15:12:21.034 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: audit 2024-03-30T15:12:16.771353+0000 mon.a (mon.0) 978 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi072-64841-1"}]': finished 2024-03-30T15:12:21.034 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: audit 2024-03-30T15:12:16.772738+0000 mon.a (mon.0) 979 : audit 1 from='client.? 172.21.15.72:0/4044327810' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-03-30T15:12:21.034 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: audit 2024-03-30T15:12:16.778213+0000 mon.a (mon.0) 980 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:12:21.034 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: audit 2024-03-30T15:12:16.781576+0000 mon.c (mon.2) 140 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:12:21.034 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: audit 2024-03-30T15:12:16.788801+0000 mon.c (mon.2) 141 : audit 1 from='client.? 172.21.15.72:0/3753102855' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi072-64841-1"}]: dispatch 2024-03-30T15:12:21.034 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: audit 2024-03-30T15:12:17.255412+0000 mon.c (mon.2) 142 : audit 1 from='client.? 172.21.15.72:0/459372695' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi072-64425-7"}]: dispatch 2024-03-30T15:12:21.034 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: audit 2024-03-30T15:12:17.255623+0000 mon.c (mon.2) 143 : audit 1 from='client.? 172.21.15.72:0/2935772551' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi072-64211-10"}]: dispatch 2024-03-30T15:12:21.034 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: cluster 2024-03-30T15:12:18.106103+0000 mon.a (mon.0) 981 : cluster 0 osdmap e86: 8 total, 8 up, 8 in 2024-03-30T15:12:21.034 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: cluster 2024-03-30T15:12:18.106600+0000 mon.a (mon.0) 982 : cluster 3 Health check update: 14 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:12:21.034 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: audit 2024-03-30T15:12:18.118055+0000 mon.a (mon.0) 983 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:21.034 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: audit 2024-03-30T15:12:18.118492+0000 mon.a (mon.0) 984 : audit 1 from='client.? 172.21.15.72:0/3101006435' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi072-64256-10"}]: dispatch 2024-03-30T15:12:21.034 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: audit 2024-03-30T15:12:18.119031+0000 mon.a (mon.0) 985 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi072-64841-1"}]: dispatch 2024-03-30T15:12:21.034 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: audit 2024-03-30T15:12:18.120060+0000 mon.a (mon.0) 986 : audit 1 from='client.? 172.21.15.72:0/2829404995' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:21.035 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: audit 2024-03-30T15:12:18.122966+0000 mon.a (mon.0) 987 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi072-64425-7"}]: dispatch 2024-03-30T15:12:21.035 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: audit 2024-03-30T15:12:18.123501+0000 mon.a (mon.0) 988 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi072-64179-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:12:21.035 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: audit 2024-03-30T15:12:18.124106+0000 mon.a (mon.0) 989 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:21.035 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: audit 2024-03-30T15:12:18.128878+0000 mon.c (mon.2) 144 : audit 1 from='client.? 172.21.15.72:0/2459281314' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi072-64179-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi072-64179-16"}]: dispatch 2024-03-30T15:12:21.035 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: audit 2024-03-30T15:12:18.137496+0000 mon.c (mon.2) 145 : audit 1 from='client.? 172.21.15.72:0/900532841' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:21.035 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: audit 2024-03-30T15:12:18.568999+0000 mon.c (mon.2) 146 : audit 1 from='client.? 172.21.15.72:0/1253490719' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi072-64171-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:21.035 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: cluster 2024-03-30T15:12:18.773378+0000 client.admin (client.?) 0 : cluster 1 threexx 2024-03-30T15:12:21.035 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: cluster 2024-03-30T15:12:19.440042+0000 mon.a (mon.0) 990 : cluster 0 osdmap e87: 8 total, 8 up, 8 in 2024-03-30T15:12:21.035 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: audit 2024-03-30T15:12:19.441254+0000 mon.c (mon.2) 147 : audit 1 from='client.? 172.21.15.72:0/459372695' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi072-64425-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:21.035 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: audit 2024-03-30T15:12:19.441405+0000 mon.a (mon.0) 991 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi072-64211-10"}]: dispatch 2024-03-30T15:12:21.035 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: audit 2024-03-30T15:12:19.443234+0000 mon.c (mon.2) 148 : audit 1 from='client.? 172.21.15.72:0/2935772551' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi072-64211-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:21.035 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: audit 2024-03-30T15:12:19.465869+0000 mon.a (mon.0) 992 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:21.035 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: audit 2024-03-30T15:12:19.467475+0000 mon.a (mon.0) 993 : audit 1 from='client.? 172.21.15.72:0/3101006435' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi072-64256-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:21.036 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: audit 2024-03-30T15:12:19.468054+0000 mon.a (mon.0) 994 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi072-64179-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi072-64179-16"}]: dispatch 2024-03-30T15:12:21.036 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: audit 2024-03-30T15:12:19.468494+0000 mon.a (mon.0) 995 : audit 1 from='client.? 172.21.15.72:0/4044327810' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-03-30T15:12:21.036 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: audit 2024-03-30T15:12:19.469278+0000 mon.a (mon.0) 996 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:21.036 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: audit 2024-03-30T15:12:19.469540+0000 mon.a (mon.0) 997 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi072-64403-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi072-64403-7"}]': finished 2024-03-30T15:12:21.036 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: audit 2024-03-30T15:12:19.469638+0000 mon.a (mon.0) 998 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi072-64841-1"}]': finished 2024-03-30T15:12:21.036 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: audit 2024-03-30T15:12:19.469699+0000 mon.a (mon.0) 999 : audit 1 from='client.? 172.21.15.72:0/2829404995' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:21.036 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: audit 2024-03-30T15:12:19.488113+0000 mon.c (mon.2) 149 : audit 1 from='client.? 172.21.15.72:0/1501181106' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi072-64882-1"}]: dispatch 2024-03-30T15:12:21.036 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: cluster 2024-03-30T15:12:19.900325+0000 mon.a (mon.0) 1000 : cluster 0 osdmap e88: 8 total, 8 up, 8 in 2024-03-30T15:12:21.036 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: audit 2024-03-30T15:12:20.313592+0000 mon.a (mon.0) 1001 : audit 1 from='client.? 172.21.15.72:0/2829404995' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-4", "tierpool": "test-rados-api-smithi072-64344-4-cache"}]: dispatch 2024-03-30T15:12:21.036 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: audit 2024-03-30T15:12:20.319548+0000 mon.a (mon.0) 1002 : audit 1 from='client.? 172.21.15.72:0/1633994099' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi072-64841-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:21.036 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:20 smithi072 bash[28946]: audit 2024-03-30T15:12:20.329677+0000 mon.a (mon.0) 1003 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi072-64171-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:21.216 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:12:21.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: cluster 2024-03-30T15:12:12.227661+0000 osd.7 (osd.7) 3 : cluster 0 38.4 deep-scrub starts 2024-03-30T15:12:21.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: cluster 2024-03-30T15:12:12.228593+0000 osd.6 (osd.6) 3 : cluster 0 38.3 deep-scrub starts 2024-03-30T15:12:21.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: cluster 2024-03-30T15:12:12.230804+0000 osd.7 (osd.7) 4 : cluster 0 38.4 deep-scrub ok 2024-03-30T15:12:21.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: cluster 2024-03-30T15:12:12.234657+0000 osd.6 (osd.6) 4 : cluster 0 38.3 deep-scrub ok 2024-03-30T15:12:21.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: cluster 2024-03-30T15:12:12.723906+0000 osd.4 (osd.4) 3 : cluster 0 38.0 deep-scrub starts 2024-03-30T15:12:21.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: cluster 2024-03-30T15:12:12.727416+0000 osd.4 (osd.4) 4 : cluster 0 38.0 deep-scrub ok 2024-03-30T15:12:21.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: cluster 2024-03-30T15:12:13.207142+0000 osd.7 (osd.7) 5 : cluster 0 38.8 deep-scrub starts 2024-03-30T15:12:21.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: cluster 2024-03-30T15:12:13.209557+0000 osd.7 (osd.7) 6 : cluster 0 38.8 deep-scrub ok 2024-03-30T15:12:21.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: cluster 2024-03-30T15:12:13.274611+0000 osd.6 (osd.6) 5 : cluster 0 38.5 deep-scrub starts 2024-03-30T15:12:21.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: cluster 2024-03-30T15:12:13.276871+0000 osd.6 (osd.6) 6 : cluster 0 38.5 deep-scrub ok 2024-03-30T15:12:21.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: cluster 2024-03-30T15:12:15.839905+0000 mgr.y (mgr.14526) 183 : cluster 0 pgmap v127: 764 pgs: 244 creating+peering, 490 active+clean, 30 unknown; 145 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 9.1 MiB/s rd, 28 MiB/s wr, 424 op/s 2024-03-30T15:12:21.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: audit 2024-03-30T15:12:16.771353+0000 mon.a (mon.0) 978 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi072-64841-1"}]': finished 2024-03-30T15:12:21.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: audit 2024-03-30T15:12:16.772738+0000 mon.a (mon.0) 979 : audit 1 from='client.? 172.21.15.72:0/4044327810' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-03-30T15:12:21.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: audit 2024-03-30T15:12:16.778213+0000 mon.a (mon.0) 980 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:12:21.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: audit 2024-03-30T15:12:16.781576+0000 mon.c (mon.2) 140 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:12:21.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: audit 2024-03-30T15:12:16.788801+0000 mon.c (mon.2) 141 : audit 1 from='client.? 172.21.15.72:0/3753102855' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi072-64841-1"}]: dispatch 2024-03-30T15:12:21.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: audit 2024-03-30T15:12:17.255412+0000 mon.c (mon.2) 142 : audit 1 from='client.? 172.21.15.72:0/459372695' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi072-64425-7"}]: dispatch 2024-03-30T15:12:21.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: audit 2024-03-30T15:12:17.255623+0000 mon.c (mon.2) 143 : audit 1 from='client.? 172.21.15.72:0/2935772551' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi072-64211-10"}]: dispatch 2024-03-30T15:12:21.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: cluster 2024-03-30T15:12:18.106103+0000 mon.a (mon.0) 981 : cluster 0 osdmap e86: 8 total, 8 up, 8 in 2024-03-30T15:12:21.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: cluster 2024-03-30T15:12:18.106600+0000 mon.a (mon.0) 982 : cluster 3 Health check update: 14 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:12:21.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: audit 2024-03-30T15:12:18.118055+0000 mon.a (mon.0) 983 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:21.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: audit 2024-03-30T15:12:18.118492+0000 mon.a (mon.0) 984 : audit 1 from='client.? 172.21.15.72:0/3101006435' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi072-64256-10"}]: dispatch 2024-03-30T15:12:21.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: audit 2024-03-30T15:12:18.119031+0000 mon.a (mon.0) 985 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi072-64841-1"}]: dispatch 2024-03-30T15:12:21.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: audit 2024-03-30T15:12:18.120060+0000 mon.a (mon.0) 986 : audit 1 from='client.? 172.21.15.72:0/2829404995' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:21.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: audit 2024-03-30T15:12:18.122966+0000 mon.a (mon.0) 987 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi072-64425-7"}]: dispatch 2024-03-30T15:12:21.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: audit 2024-03-30T15:12:18.123501+0000 mon.a (mon.0) 988 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi072-64179-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:12:21.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: audit 2024-03-30T15:12:18.124106+0000 mon.a (mon.0) 989 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:21.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: audit 2024-03-30T15:12:18.128878+0000 mon.c (mon.2) 144 : audit 1 from='client.? 172.21.15.72:0/2459281314' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi072-64179-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi072-64179-16"}]: dispatch 2024-03-30T15:12:21.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: audit 2024-03-30T15:12:18.137496+0000 mon.c (mon.2) 145 : audit 1 from='client.? 172.21.15.72:0/900532841' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:21.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: audit 2024-03-30T15:12:18.568999+0000 mon.c (mon.2) 146 : audit 1 from='client.? 172.21.15.72:0/1253490719' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi072-64171-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:21.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: cluster 2024-03-30T15:12:18.773378+0000 client.admin (client.?) 0 : cluster 1 threexx 2024-03-30T15:12:21.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: cluster 2024-03-30T15:12:19.440042+0000 mon.a (mon.0) 990 : cluster 0 osdmap e87: 8 total, 8 up, 8 in 2024-03-30T15:12:21.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: audit 2024-03-30T15:12:19.441254+0000 mon.c (mon.2) 147 : audit 1 from='client.? 172.21.15.72:0/459372695' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi072-64425-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:21.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: audit 2024-03-30T15:12:19.441405+0000 mon.a (mon.0) 991 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi072-64211-10"}]: dispatch 2024-03-30T15:12:21.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: audit 2024-03-30T15:12:19.443234+0000 mon.c (mon.2) 148 : audit 1 from='client.? 172.21.15.72:0/2935772551' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi072-64211-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:21.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: audit 2024-03-30T15:12:19.465869+0000 mon.a (mon.0) 992 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:21.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: audit 2024-03-30T15:12:19.467475+0000 mon.a (mon.0) 993 : audit 1 from='client.? 172.21.15.72:0/3101006435' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi072-64256-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:21.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: audit 2024-03-30T15:12:19.468054+0000 mon.a (mon.0) 994 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi072-64179-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi072-64179-16"}]: dispatch 2024-03-30T15:12:21.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: audit 2024-03-30T15:12:19.468494+0000 mon.a (mon.0) 995 : audit 1 from='client.? 172.21.15.72:0/4044327810' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-03-30T15:12:21.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: audit 2024-03-30T15:12:19.469278+0000 mon.a (mon.0) 996 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:21.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: audit 2024-03-30T15:12:19.469540+0000 mon.a (mon.0) 997 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi072-64403-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi072-64403-7"}]': finished 2024-03-30T15:12:21.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: audit 2024-03-30T15:12:19.469638+0000 mon.a (mon.0) 998 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi072-64841-1"}]': finished 2024-03-30T15:12:21.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: audit 2024-03-30T15:12:19.469699+0000 mon.a (mon.0) 999 : audit 1 from='client.? 172.21.15.72:0/2829404995' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:21.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: audit 2024-03-30T15:12:19.488113+0000 mon.c (mon.2) 149 : audit 1 from='client.? 172.21.15.72:0/1501181106' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi072-64882-1"}]: dispatch 2024-03-30T15:12:21.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: cluster 2024-03-30T15:12:19.900325+0000 mon.a (mon.0) 1000 : cluster 0 osdmap e88: 8 total, 8 up, 8 in 2024-03-30T15:12:21.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: audit 2024-03-30T15:12:20.313592+0000 mon.a (mon.0) 1001 : audit 1 from='client.? 172.21.15.72:0/2829404995' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-4", "tierpool": "test-rados-api-smithi072-64344-4-cache"}]: dispatch 2024-03-30T15:12:21.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: audit 2024-03-30T15:12:20.319548+0000 mon.a (mon.0) 1002 : audit 1 from='client.? 172.21.15.72:0/1633994099' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi072-64841-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:21.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:20 smithi172 bash[23680]: audit 2024-03-30T15:12:20.329677+0000 mon.a (mon.0) 1003 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi072-64171-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:21.416 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:12:21 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:12:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:12:22.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:22 smithi072 bash[21573]: cluster 2024-03-30T15:12:17.841666+0000 mgr.y (mgr.14526) 184 : cluster 0 pgmap v129: 796 pgs: 244 creating+peering, 426 active+clean, 126 unknown; 145 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 8.8 MiB/s rd, 5 op/s 2024-03-30T15:12:22.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:22 smithi072 bash[21573]: cluster 2024-03-30T15:12:19.843303+0000 mgr.y (mgr.14526) 185 : cluster 0 pgmap v132: 924 pgs: 226 creating+peering, 404 active+clean, 294 unknown; 145 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 11 MiB/s rd, 34 MiB/s wr, 18 op/s 2024-03-30T15:12:22.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:22 smithi072 bash[21573]: audit 2024-03-30T15:12:20.780002+0000 mon.a (mon.0) 1004 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:22.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:22 smithi072 bash[21573]: audit 2024-03-30T15:12:20.782736+0000 mon.a (mon.0) 1005 : audit 1 from='client.? 172.21.15.72:0/4044327810' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2024-03-30T15:12:22.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:22 smithi072 bash[21573]: audit 2024-03-30T15:12:20.792939+0000 mon.a (mon.0) 1006 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi072-64425-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:22.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:22 smithi072 bash[21573]: audit 2024-03-30T15:12:20.793249+0000 mon.a (mon.0) 1007 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi072-64211-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:22.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:22 smithi072 bash[21573]: audit 2024-03-30T15:12:20.793463+0000 mon.a (mon.0) 1008 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi072-64882-1"}]: dispatch 2024-03-30T15:12:22.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:22 smithi072 bash[21573]: audit 2024-03-30T15:12:20.795280+0000 mon.a (mon.0) 1009 : audit 1 from='client.? 172.21.15.72:0/3101006435' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi072-64256-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:12:22.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:22 smithi072 bash[21573]: audit 2024-03-30T15:12:20.795362+0000 mon.a (mon.0) 1010 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:22.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:22 smithi072 bash[21573]: audit 2024-03-30T15:12:20.795420+0000 mon.a (mon.0) 1011 : audit 1 from='client.? 172.21.15.72:0/2829404995' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-4", "tierpool": "test-rados-api-smithi072-64344-4-cache"}]': finished 2024-03-30T15:12:22.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:22 smithi072 bash[21573]: audit 2024-03-30T15:12:20.795468+0000 mon.a (mon.0) 1012 : audit 1 from='client.? 172.21.15.72:0/1633994099' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi072-64841-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:12:22.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:22 smithi072 bash[21573]: audit 2024-03-30T15:12:20.795537+0000 mon.a (mon.0) 1013 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi072-64171-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:22.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:22 smithi072 bash[21573]: audit 2024-03-30T15:12:20.810454+0000 mon.c (mon.2) 150 : audit 1 from='client.? 172.21.15.72:0/1253490719' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi072-64171-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-03-30T15:12:22.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:22 smithi072 bash[21573]: cluster 2024-03-30T15:12:21.260612+0000 mon.a (mon.0) 1014 : cluster 0 osdmap e89: 8 total, 8 up, 8 in 2024-03-30T15:12:22.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:22 smithi072 bash[21573]: audit 2024-03-30T15:12:21.261266+0000 mon.c (mon.2) 151 : audit 1 from='client.? 172.21.15.72:0/1833987253' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi072-64300-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:22.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:22 smithi072 bash[21573]: audit 2024-03-30T15:12:21.262190+0000 mon.a (mon.0) 1015 : audit 1 from='client.? 172.21.15.72:0/2829404995' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-4", "overlaypool": "test-rados-api-smithi072-64344-4-cache"}]: dispatch 2024-03-30T15:12:22.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:22 smithi072 bash[21573]: audit 2024-03-30T15:12:21.262734+0000 mon.a (mon.0) 1016 : audit 1 from='client.? 172.21.15.72:0/3101006435' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi072-64256-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi072-64256-10"}]: dispatch 2024-03-30T15:12:22.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:22 smithi072 bash[21573]: audit 2024-03-30T15:12:21.263008+0000 mon.a (mon.0) 1017 : audit 1 from='client.? 172.21.15.72:0/1633994099' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReadOpsmithi072-64841-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi072-64841-2"}]: dispatch 2024-03-30T15:12:22.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:22 smithi072 bash[21573]: audit 2024-03-30T15:12:21.276493+0000 mon.a (mon.0) 1018 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi072-64171-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-03-30T15:12:22.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:22 smithi072 bash[21573]: audit 2024-03-30T15:12:21.283296+0000 mon.a (mon.0) 1019 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi072-64300-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:22.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:22 smithi072 bash[21573]: audit 2024-03-30T15:12:21.298029+0000 mon.b (mon.1) 35 : audit 1 from='client.? 172.21.15.72:0/4132408751' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi072-64444-12"}]: dispatch 2024-03-30T15:12:22.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:22 smithi072 bash[21573]: audit 2024-03-30T15:12:21.704072+0000 mon.a (mon.0) 1020 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi072-64444-12"}]: dispatch 2024-03-30T15:12:22.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:22 smithi072 bash[28946]: cluster 2024-03-30T15:12:17.841666+0000 mgr.y (mgr.14526) 184 : cluster 0 pgmap v129: 796 pgs: 244 creating+peering, 426 active+clean, 126 unknown; 145 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 8.8 MiB/s rd, 5 op/s 2024-03-30T15:12:22.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:22 smithi072 bash[28946]: cluster 2024-03-30T15:12:19.843303+0000 mgr.y (mgr.14526) 185 : cluster 0 pgmap v132: 924 pgs: 226 creating+peering, 404 active+clean, 294 unknown; 145 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 11 MiB/s rd, 34 MiB/s wr, 18 op/s 2024-03-30T15:12:22.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:22 smithi072 bash[28946]: audit 2024-03-30T15:12:20.780002+0000 mon.a (mon.0) 1004 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:22.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:22 smithi072 bash[28946]: audit 2024-03-30T15:12:20.782736+0000 mon.a (mon.0) 1005 : audit 1 from='client.? 172.21.15.72:0/4044327810' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2024-03-30T15:12:22.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:22 smithi072 bash[28946]: audit 2024-03-30T15:12:20.792939+0000 mon.a (mon.0) 1006 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi072-64425-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:22.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:22 smithi072 bash[28946]: audit 2024-03-30T15:12:20.793249+0000 mon.a (mon.0) 1007 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi072-64211-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:22.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:22 smithi072 bash[28946]: audit 2024-03-30T15:12:20.793463+0000 mon.a (mon.0) 1008 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi072-64882-1"}]: dispatch 2024-03-30T15:12:22.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:22 smithi072 bash[28946]: audit 2024-03-30T15:12:20.795280+0000 mon.a (mon.0) 1009 : audit 1 from='client.? 172.21.15.72:0/3101006435' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi072-64256-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:12:22.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:22 smithi072 bash[28946]: audit 2024-03-30T15:12:20.795362+0000 mon.a (mon.0) 1010 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:22.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:22 smithi072 bash[28946]: audit 2024-03-30T15:12:20.795420+0000 mon.a (mon.0) 1011 : audit 1 from='client.? 172.21.15.72:0/2829404995' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-4", "tierpool": "test-rados-api-smithi072-64344-4-cache"}]': finished 2024-03-30T15:12:22.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:22 smithi072 bash[28946]: audit 2024-03-30T15:12:20.795468+0000 mon.a (mon.0) 1012 : audit 1 from='client.? 172.21.15.72:0/1633994099' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi072-64841-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:12:22.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:22 smithi072 bash[28946]: audit 2024-03-30T15:12:20.795537+0000 mon.a (mon.0) 1013 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi072-64171-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:22.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:22 smithi072 bash[28946]: audit 2024-03-30T15:12:20.810454+0000 mon.c (mon.2) 150 : audit 1 from='client.? 172.21.15.72:0/1253490719' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi072-64171-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-03-30T15:12:22.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:22 smithi072 bash[28946]: cluster 2024-03-30T15:12:21.260612+0000 mon.a (mon.0) 1014 : cluster 0 osdmap e89: 8 total, 8 up, 8 in 2024-03-30T15:12:22.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:22 smithi072 bash[28946]: audit 2024-03-30T15:12:21.261266+0000 mon.c (mon.2) 151 : audit 1 from='client.? 172.21.15.72:0/1833987253' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi072-64300-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:22.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:22 smithi072 bash[28946]: audit 2024-03-30T15:12:21.262190+0000 mon.a (mon.0) 1015 : audit 1 from='client.? 172.21.15.72:0/2829404995' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-4", "overlaypool": "test-rados-api-smithi072-64344-4-cache"}]: dispatch 2024-03-30T15:12:22.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:22 smithi072 bash[28946]: audit 2024-03-30T15:12:21.262734+0000 mon.a (mon.0) 1016 : audit 1 from='client.? 172.21.15.72:0/3101006435' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi072-64256-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi072-64256-10"}]: dispatch 2024-03-30T15:12:22.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:22 smithi072 bash[28946]: audit 2024-03-30T15:12:21.263008+0000 mon.a (mon.0) 1017 : audit 1 from='client.? 172.21.15.72:0/1633994099' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReadOpsmithi072-64841-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi072-64841-2"}]: dispatch 2024-03-30T15:12:22.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:22 smithi072 bash[28946]: audit 2024-03-30T15:12:21.276493+0000 mon.a (mon.0) 1018 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi072-64171-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-03-30T15:12:22.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:22 smithi072 bash[28946]: audit 2024-03-30T15:12:21.283296+0000 mon.a (mon.0) 1019 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi072-64300-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:22.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:22 smithi072 bash[28946]: audit 2024-03-30T15:12:21.298029+0000 mon.b (mon.1) 35 : audit 1 from='client.? 172.21.15.72:0/4132408751' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi072-64444-12"}]: dispatch 2024-03-30T15:12:22.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:22 smithi072 bash[28946]: audit 2024-03-30T15:12:21.704072+0000 mon.a (mon.0) 1020 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi072-64444-12"}]: dispatch 2024-03-30T15:12:22.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:22 smithi172 bash[23680]: cluster 2024-03-30T15:12:17.841666+0000 mgr.y (mgr.14526) 184 : cluster 0 pgmap v129: 796 pgs: 244 creating+peering, 426 active+clean, 126 unknown; 145 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 8.8 MiB/s rd, 5 op/s 2024-03-30T15:12:22.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:22 smithi172 bash[23680]: cluster 2024-03-30T15:12:19.843303+0000 mgr.y (mgr.14526) 185 : cluster 0 pgmap v132: 924 pgs: 226 creating+peering, 404 active+clean, 294 unknown; 145 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 11 MiB/s rd, 34 MiB/s wr, 18 op/s 2024-03-30T15:12:22.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:22 smithi172 bash[23680]: audit 2024-03-30T15:12:20.780002+0000 mon.a (mon.0) 1004 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:22.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:22 smithi172 bash[23680]: audit 2024-03-30T15:12:20.782736+0000 mon.a (mon.0) 1005 : audit 1 from='client.? 172.21.15.72:0/4044327810' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2024-03-30T15:12:22.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:22 smithi172 bash[23680]: audit 2024-03-30T15:12:20.792939+0000 mon.a (mon.0) 1006 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi072-64425-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:22.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:22 smithi172 bash[23680]: audit 2024-03-30T15:12:20.793249+0000 mon.a (mon.0) 1007 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi072-64211-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:22.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:22 smithi172 bash[23680]: audit 2024-03-30T15:12:20.793463+0000 mon.a (mon.0) 1008 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi072-64882-1"}]: dispatch 2024-03-30T15:12:22.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:22 smithi172 bash[23680]: audit 2024-03-30T15:12:20.795280+0000 mon.a (mon.0) 1009 : audit 1 from='client.? 172.21.15.72:0/3101006435' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi072-64256-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:12:22.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:22 smithi172 bash[23680]: audit 2024-03-30T15:12:20.795362+0000 mon.a (mon.0) 1010 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:22.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:22 smithi172 bash[23680]: audit 2024-03-30T15:12:20.795420+0000 mon.a (mon.0) 1011 : audit 1 from='client.? 172.21.15.72:0/2829404995' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-4", "tierpool": "test-rados-api-smithi072-64344-4-cache"}]': finished 2024-03-30T15:12:22.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:22 smithi172 bash[23680]: audit 2024-03-30T15:12:20.795468+0000 mon.a (mon.0) 1012 : audit 1 from='client.? 172.21.15.72:0/1633994099' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi072-64841-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:12:22.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:22 smithi172 bash[23680]: audit 2024-03-30T15:12:20.795537+0000 mon.a (mon.0) 1013 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi072-64171-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:22.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:22 smithi172 bash[23680]: audit 2024-03-30T15:12:20.810454+0000 mon.c (mon.2) 150 : audit 1 from='client.? 172.21.15.72:0/1253490719' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi072-64171-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-03-30T15:12:22.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:22 smithi172 bash[23680]: cluster 2024-03-30T15:12:21.260612+0000 mon.a (mon.0) 1014 : cluster 0 osdmap e89: 8 total, 8 up, 8 in 2024-03-30T15:12:22.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:22 smithi172 bash[23680]: audit 2024-03-30T15:12:21.261266+0000 mon.c (mon.2) 151 : audit 1 from='client.? 172.21.15.72:0/1833987253' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi072-64300-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:22.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:22 smithi172 bash[23680]: audit 2024-03-30T15:12:21.262190+0000 mon.a (mon.0) 1015 : audit 1 from='client.? 172.21.15.72:0/2829404995' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-4", "overlaypool": "test-rados-api-smithi072-64344-4-cache"}]: dispatch 2024-03-30T15:12:22.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:22 smithi172 bash[23680]: audit 2024-03-30T15:12:21.262734+0000 mon.a (mon.0) 1016 : audit 1 from='client.? 172.21.15.72:0/3101006435' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi072-64256-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi072-64256-10"}]: dispatch 2024-03-30T15:12:22.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:22 smithi172 bash[23680]: audit 2024-03-30T15:12:21.263008+0000 mon.a (mon.0) 1017 : audit 1 from='client.? 172.21.15.72:0/1633994099' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReadOpsmithi072-64841-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi072-64841-2"}]: dispatch 2024-03-30T15:12:22.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:22 smithi172 bash[23680]: audit 2024-03-30T15:12:21.276493+0000 mon.a (mon.0) 1018 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi072-64171-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-03-30T15:12:22.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:22 smithi172 bash[23680]: audit 2024-03-30T15:12:21.283296+0000 mon.a (mon.0) 1019 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi072-64300-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:22.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:22 smithi172 bash[23680]: audit 2024-03-30T15:12:21.298029+0000 mon.b (mon.1) 35 : audit 1 from='client.? 172.21.15.72:0/4132408751' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi072-64444-12"}]: dispatch 2024-03-30T15:12:22.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:22 smithi172 bash[23680]: audit 2024-03-30T15:12:21.704072+0000 mon.a (mon.0) 1020 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi072-64444-12"}]: dispatch 2024-03-30T15:12:23.037 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ RUN ] cls: Running main() from gmock_main.cc 2024-03-30T15:12:23.037 INFO:tasks.workunit.client.0.smithi072.stdout: cls: [==========] Running 2 tests from 1 test suite. 2024-03-30T15:12:23.037 INFO:tasks.workunit.client.0.smithi072.stdout: cls: [----------] Global test environment set-up. 2024-03-30T15:12:23.037 INFO:tasks.workunit.client.0.smithi072.stdout: cls: [----------] 2 tests from NeoRadosCls 2024-03-30T15:12:23.037 INFO:tasks.workunit.client.0.smithi072.stdout: cls: [ RUN ] NeoRadosCls.DNE 2024-03-30T15:12:23.037 INFO:tasks.workunit.client.0.smithi072.stdout: cls: [ OK ] NeoRadosCls.DNE (16821 ms) 2024-03-30T15:12:23.037 INFO:tasks.workunit.client.0.smithi072.stdout: cls: [ RUN ] NeoRadosCls.RemoteReads 2024-03-30T15:12:23.037 INFO:tasks.workunit.client.0.smithi072.stdout: cls: [ OK ] NeoRadosCls.RemoteReads (14013 ms) 2024-03-30T15:12:23.037 INFO:tasks.workunit.client.0.smithi072.stdout: cls: [----------] 2 tests from NeoRadosCls (30834 ms total) 2024-03-30T15:12:23.037 INFO:tasks.workunit.client.0.smithi072.stdout: cls: 2024-03-30T15:12:23.037 INFO:tasks.workunit.client.0.smithi072.stdout: cls: [----------] Global test environment tear-down 2024-03-30T15:12:23.038 INFO:tasks.workunit.client.0.smithi072.stdout: cls: [==========] 2 tests from 1 test suite ran. (30834 ms total) 2024-03-30T15:12:23.038 INFO:tasks.workunit.client.0.smithi072.stdout: cls: [ PASSED ] 2 tests. 2024-03-30T15:12:23.491 INFO:tasks.workunit.client.0.smithi072.stdout: cmd: Running main() from gmock_main.cc 2024-03-30T15:12:23.491 INFO:tasks.workunit.client.0.smithi072.stdout: cmd: [==========] Running 3 tests from 1 test suite. 2024-03-30T15:12:23.491 INFO:tasks.workunit.client.0.smithi072.stdout: cmd: [----------] Global test environment set-up. 2024-03-30T15:12:23.491 INFO:tasks.workunit.client.0.smithi072.stdout: cmd: [----------] 3 tests from NeoRadosCmd 2024-03-30T15:12:23.491 INFO:tasks.workunit.client.0.smithi072.stdout: cmd: [ RUN ] NeoRadosCmd.MonDescribe 2024-03-30T15:12:23.491 INFO:tasks.workunit.client.0.smithi072.stdout: cmd: [ OK ] NeoRadosCmd.MonDescribe (16823 ms) 2024-03-30T15:12:23.492 INFO:tasks.workunit.client.0.smithi072.stdout: cmd: [ RUN ] NeoRadosCmd.OSDCmd 2024-03-30T15:12:23.492 INFO:tasks.workunit.client.0.smithi072.stdout: cmd: [ OK ] NeoRadosCmd.OSDCmd (6433 ms) 2024-03-30T15:12:23.492 INFO:tasks.workunit.client.0.smithi072.stdout: cmd: [ RUN ] NeoRadosCmd.PGCmd 2024-03-30T15:12:23.492 INFO:tasks.workunit.client.0.smithi072.stdout: cmd: [ OK ] NeoRadosCmd.PGCmd (8009 ms) 2024-03-30T15:12:23.492 INFO:tasks.workunit.client.0.smithi072.stdout: cmd: [----------] 3 tests from NeoRadosCmd (31265 ms total) 2024-03-30T15:12:23.492 INFO:tasks.workunit.client.0.smithi072.stdout: cmd: 2024-03-30T15:12:23.492 INFO:tasks.workunit.client.0.smithi072.stdout: cmd: [----------] Global test environment tear-down 2024-03-30T15:12:23.492 INFO:tasks.workunit.client.0.smithi072.stdout: cmd: [==========] 3 tests from 1 test suite ran. (31265 ms total) 2024-03-30T15:12:23.492 INFO:tasks.workunit.client.0.smithi072.stdout: cmd: [ PASSED ] 3 tests. 2024-03-30T15:12:23.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:23 smithi072 bash[21573]: audit 2024-03-30T15:12:20.965480+0000 mgr.y (mgr.14526) 186 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:12:23.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:23 smithi072 bash[21573]: audit 2024-03-30T15:12:21.705682+0000 mon.b (mon.1) 36 : audit 1 from='client.? 172.21.15.72:0/4132408751' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi072-64444-12"}]: dispatch 2024-03-30T15:12:23.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:23 smithi072 bash[21573]: cluster 2024-03-30T15:12:21.783838+0000 client.admin (client.?) 0 : cluster 1 fourxx 2024-03-30T15:12:23.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:23 smithi072 bash[21573]: audit 2024-03-30T15:12:22.148439+0000 mon.a (mon.0) 1021 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi072-64444-12"}]: dispatch 2024-03-30T15:12:23.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:23 smithi072 bash[21573]: audit 2024-03-30T15:12:22.154181+0000 mon.a (mon.0) 1022 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:23.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:23 smithi072 bash[21573]: audit 2024-03-30T15:12:22.155127+0000 mon.a (mon.0) 1023 : audit 1 from='client.? 172.21.15.72:0/4044327810' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-03-30T15:12:23.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:23 smithi072 bash[21573]: audit 2024-03-30T15:12:22.158690+0000 mon.a (mon.0) 1024 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi072-64179-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi072-64179-16"}]': finished 2024-03-30T15:12:23.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:23 smithi072 bash[21573]: audit 2024-03-30T15:12:22.158803+0000 mon.a (mon.0) 1025 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi072-64425-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:12:23.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:23 smithi072 bash[21573]: audit 2024-03-30T15:12:22.158893+0000 mon.a (mon.0) 1026 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi072-64211-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:12:23.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:23 smithi072 bash[21573]: audit 2024-03-30T15:12:22.158979+0000 mon.a (mon.0) 1027 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi072-64882-1"}]': finished 2024-03-30T15:12:23.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:23 smithi072 bash[21573]: audit 2024-03-30T15:12:22.159064+0000 mon.a (mon.0) 1028 : audit 1 from='client.? 172.21.15.72:0/2829404995' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-4", "overlaypool": "test-rados-api-smithi072-64344-4-cache"}]': finished 2024-03-30T15:12:23.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:23 smithi072 bash[21573]: audit 2024-03-30T15:12:22.159148+0000 mon.a (mon.0) 1029 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi072-64171-3", "field": "max_bytes", "val": "4096"}]': finished 2024-03-30T15:12:23.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:23 smithi072 bash[21573]: audit 2024-03-30T15:12:22.159228+0000 mon.a (mon.0) 1030 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi072-64300-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:23.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:23 smithi072 bash[21573]: audit 2024-03-30T15:12:22.166723+0000 mon.c (mon.2) 152 : audit 1 from='client.? 172.21.15.72:0/459372695' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi072-64425-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi072-64425-7"}]: dispatch 2024-03-30T15:12:23.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:23 smithi072 bash[28946]: audit 2024-03-30T15:12:20.965480+0000 mgr.y (mgr.14526) 186 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:12:23.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:23 smithi072 bash[28946]: audit 2024-03-30T15:12:21.705682+0000 mon.b (mon.1) 36 : audit 1 from='client.? 172.21.15.72:0/4132408751' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi072-64444-12"}]: dispatch 2024-03-30T15:12:23.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:23 smithi072 bash[28946]: cluster 2024-03-30T15:12:21.783838+0000 client.admin (client.?) 0 : cluster 1 fourxx 2024-03-30T15:12:23.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:23 smithi072 bash[28946]: audit 2024-03-30T15:12:22.148439+0000 mon.a (mon.0) 1021 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi072-64444-12"}]: dispatch 2024-03-30T15:12:23.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:23 smithi072 bash[28946]: audit 2024-03-30T15:12:22.154181+0000 mon.a (mon.0) 1022 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:23.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:23 smithi072 bash[28946]: audit 2024-03-30T15:12:22.155127+0000 mon.a (mon.0) 1023 : audit 1 from='client.? 172.21.15.72:0/4044327810' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-03-30T15:12:23.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:23 smithi072 bash[28946]: audit 2024-03-30T15:12:22.158690+0000 mon.a (mon.0) 1024 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi072-64179-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi072-64179-16"}]': finished 2024-03-30T15:12:23.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:23 smithi072 bash[28946]: audit 2024-03-30T15:12:22.158803+0000 mon.a (mon.0) 1025 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi072-64425-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:12:23.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:23 smithi072 bash[28946]: audit 2024-03-30T15:12:22.158893+0000 mon.a (mon.0) 1026 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi072-64211-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:12:23.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:23 smithi072 bash[28946]: audit 2024-03-30T15:12:22.158979+0000 mon.a (mon.0) 1027 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi072-64882-1"}]': finished 2024-03-30T15:12:23.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:23 smithi072 bash[28946]: audit 2024-03-30T15:12:22.159064+0000 mon.a (mon.0) 1028 : audit 1 from='client.? 172.21.15.72:0/2829404995' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-4", "overlaypool": "test-rados-api-smithi072-64344-4-cache"}]': finished 2024-03-30T15:12:23.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:23 smithi072 bash[28946]: audit 2024-03-30T15:12:22.159148+0000 mon.a (mon.0) 1029 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi072-64171-3", "field": "max_bytes", "val": "4096"}]': finished 2024-03-30T15:12:23.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:23 smithi072 bash[28946]: audit 2024-03-30T15:12:22.159228+0000 mon.a (mon.0) 1030 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi072-64300-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:23.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:23 smithi072 bash[28946]: audit 2024-03-30T15:12:22.166723+0000 mon.c (mon.2) 152 : audit 1 from='client.? 172.21.15.72:0/459372695' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi072-64425-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi072-64425-7"}]: dispatch 2024-03-30T15:12:23.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:23 smithi072 bash[21573]: audit 2024-03-30T15:12:22.167936+0000 mon.c (mon.2) 153 : audit 1 from='client.? 172.21.15.72:0/2935772551' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi072-64211-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi072-64211-10"}]: dispatch 2024-03-30T15:12:23.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:23 smithi072 bash[21573]: audit 2024-03-30T15:12:22.168237+0000 mon.c (mon.2) 154 : audit 1 from='client.? 172.21.15.72:0/1501181106' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi072-64882-1"}]: dispatch 2024-03-30T15:12:23.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:23 smithi072 bash[21573]: audit 2024-03-30T15:12:22.371527+0000 mon.c (mon.2) 155 : audit 0 from='client.? 172.21.15.72:0/1833987253' entity='client.admin' cmd=[{"prefix":"osd dump"}]: dispatch 2024-03-30T15:12:23.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:23 smithi072 bash[21573]: audit 2024-03-30T15:12:22.377492+0000 mon.c (mon.2) 156 : audit 1 from='client.? 172.21.15.72:0/1833987253' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi072-64300-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:23.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:23 smithi072 bash[21573]: cluster 2024-03-30T15:12:23.033837+0000 mon.a (mon.0) 1031 : cluster 0 osdmap e90: 8 total, 8 up, 8 in 2024-03-30T15:12:23.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:23 smithi072 bash[21573]: audit 2024-03-30T15:12:23.034751+0000 mon.c (mon.2) 157 : audit 1 from='client.? 172.21.15.72:0/4159181360' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi072-64478-1"}]: dispatch 2024-03-30T15:12:23.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:23 smithi072 bash[21573]: audit 2024-03-30T15:12:23.035371+0000 mon.b (mon.1) 37 : audit 1 from='client.? 172.21.15.72:0/4132408751' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi072-64444-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:23.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:23 smithi072 bash[21573]: audit 2024-03-30T15:12:23.037511+0000 mon.c (mon.2) 158 : audit 1 from='client.? 172.21.15.72:0/869561204' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:23.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:23 smithi072 bash[21573]: audit 2024-03-30T15:12:23.041431+0000 mon.a (mon.0) 1032 : audit 1 from='client.? 172.21.15.72:0/2829404995' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-4-cache", "mode": "writeback"}]: dispatch 2024-03-30T15:12:23.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:23 smithi072 bash[28946]: audit 2024-03-30T15:12:22.167936+0000 mon.c (mon.2) 153 : audit 1 from='client.? 172.21.15.72:0/2935772551' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi072-64211-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi072-64211-10"}]: dispatch 2024-03-30T15:12:23.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:23 smithi072 bash[28946]: audit 2024-03-30T15:12:22.168237+0000 mon.c (mon.2) 154 : audit 1 from='client.? 172.21.15.72:0/1501181106' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi072-64882-1"}]: dispatch 2024-03-30T15:12:23.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:23 smithi072 bash[28946]: audit 2024-03-30T15:12:22.371527+0000 mon.c (mon.2) 155 : audit 0 from='client.? 172.21.15.72:0/1833987253' entity='client.admin' cmd=[{"prefix":"osd dump"}]: dispatch 2024-03-30T15:12:23.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:23 smithi072 bash[28946]: audit 2024-03-30T15:12:22.377492+0000 mon.c (mon.2) 156 : audit 1 from='client.? 172.21.15.72:0/1833987253' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi072-64300-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:23.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:23 smithi072 bash[28946]: cluster 2024-03-30T15:12:23.033837+0000 mon.a (mon.0) 1031 : cluster 0 osdmap e90: 8 total, 8 up, 8 in 2024-03-30T15:12:23.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:23 smithi072 bash[28946]: audit 2024-03-30T15:12:23.034751+0000 mon.c (mon.2) 157 : audit 1 from='client.? 172.21.15.72:0/4159181360' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi072-64478-1"}]: dispatch 2024-03-30T15:12:23.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:23 smithi072 bash[28946]: audit 2024-03-30T15:12:23.035371+0000 mon.b (mon.1) 37 : audit 1 from='client.? 172.21.15.72:0/4132408751' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi072-64444-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:23.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:23 smithi072 bash[28946]: audit 2024-03-30T15:12:23.037511+0000 mon.c (mon.2) 158 : audit 1 from='client.? 172.21.15.72:0/869561204' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:23.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:23 smithi072 bash[28946]: audit 2024-03-30T15:12:23.041431+0000 mon.a (mon.0) 1032 : audit 1 from='client.? 172.21.15.72:0/2829404995' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-4-cache", "mode": "writeback"}]: dispatch 2024-03-30T15:12:23.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:23 smithi172 bash[23680]: audit 2024-03-30T15:12:20.965480+0000 mgr.y (mgr.14526) 186 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:12:23.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:23 smithi172 bash[23680]: audit 2024-03-30T15:12:21.705682+0000 mon.b (mon.1) 36 : audit 1 from='client.? 172.21.15.72:0/4132408751' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi072-64444-12"}]: dispatch 2024-03-30T15:12:23.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:23 smithi172 bash[23680]: cluster 2024-03-30T15:12:21.783838+0000 client.admin (client.?) 0 : cluster 1 fourxx 2024-03-30T15:12:23.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:23 smithi172 bash[23680]: audit 2024-03-30T15:12:22.148439+0000 mon.a (mon.0) 1021 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi072-64444-12"}]: dispatch 2024-03-30T15:12:23.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:23 smithi172 bash[23680]: audit 2024-03-30T15:12:22.154181+0000 mon.a (mon.0) 1022 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:23.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:23 smithi172 bash[23680]: audit 2024-03-30T15:12:22.155127+0000 mon.a (mon.0) 1023 : audit 1 from='client.? 172.21.15.72:0/4044327810' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-03-30T15:12:23.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:23 smithi172 bash[23680]: audit 2024-03-30T15:12:22.158690+0000 mon.a (mon.0) 1024 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi072-64179-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi072-64179-16"}]': finished 2024-03-30T15:12:23.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:23 smithi172 bash[23680]: audit 2024-03-30T15:12:22.158803+0000 mon.a (mon.0) 1025 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi072-64425-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:12:23.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:23 smithi172 bash[23680]: audit 2024-03-30T15:12:22.158893+0000 mon.a (mon.0) 1026 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi072-64211-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:12:23.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:23 smithi172 bash[23680]: audit 2024-03-30T15:12:22.158979+0000 mon.a (mon.0) 1027 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi072-64882-1"}]': finished 2024-03-30T15:12:23.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:23 smithi172 bash[23680]: audit 2024-03-30T15:12:22.159064+0000 mon.a (mon.0) 1028 : audit 1 from='client.? 172.21.15.72:0/2829404995' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-4", "overlaypool": "test-rados-api-smithi072-64344-4-cache"}]': finished 2024-03-30T15:12:23.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:23 smithi172 bash[23680]: audit 2024-03-30T15:12:22.159148+0000 mon.a (mon.0) 1029 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi072-64171-3", "field": "max_bytes", "val": "4096"}]': finished 2024-03-30T15:12:23.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:23 smithi172 bash[23680]: audit 2024-03-30T15:12:22.159228+0000 mon.a (mon.0) 1030 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi072-64300-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:23.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:23 smithi172 bash[23680]: audit 2024-03-30T15:12:22.166723+0000 mon.c (mon.2) 152 : audit 1 from='client.? 172.21.15.72:0/459372695' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi072-64425-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi072-64425-7"}]: dispatch 2024-03-30T15:12:23.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:23 smithi172 bash[23680]: audit 2024-03-30T15:12:22.167936+0000 mon.c (mon.2) 153 : audit 1 from='client.? 172.21.15.72:0/2935772551' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi072-64211-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi072-64211-10"}]: dispatch 2024-03-30T15:12:23.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:23 smithi172 bash[23680]: audit 2024-03-30T15:12:22.168237+0000 mon.c (mon.2) 154 : audit 1 from='client.? 172.21.15.72:0/1501181106' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi072-64882-1"}]: dispatch 2024-03-30T15:12:23.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:23 smithi172 bash[23680]: audit 2024-03-30T15:12:22.371527+0000 mon.c (mon.2) 155 : audit 0 from='client.? 172.21.15.72:0/1833987253' entity='client.admin' cmd=[{"prefix":"osd dump"}]: dispatch 2024-03-30T15:12:23.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:23 smithi172 bash[23680]: audit 2024-03-30T15:12:22.377492+0000 mon.c (mon.2) 156 : audit 1 from='client.? 172.21.15.72:0/1833987253' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi072-64300-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:23.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:23 smithi172 bash[23680]: cluster 2024-03-30T15:12:23.033837+0000 mon.a (mon.0) 1031 : cluster 0 osdmap e90: 8 total, 8 up, 8 in 2024-03-30T15:12:23.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:23 smithi172 bash[23680]: audit 2024-03-30T15:12:23.034751+0000 mon.c (mon.2) 157 : audit 1 from='client.? 172.21.15.72:0/4159181360' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi072-64478-1"}]: dispatch 2024-03-30T15:12:23.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:23 smithi172 bash[23680]: audit 2024-03-30T15:12:23.035371+0000 mon.b (mon.1) 37 : audit 1 from='client.? 172.21.15.72:0/4132408751' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi072-64444-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:23.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:23 smithi172 bash[23680]: audit 2024-03-30T15:12:23.037511+0000 mon.c (mon.2) 158 : audit 1 from='client.? 172.21.15.72:0/869561204' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:23.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:23 smithi172 bash[23680]: audit 2024-03-30T15:12:23.041431+0000 mon.a (mon.0) 1032 : audit 1 from='client.? 172.21.15.72:0/2829404995' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-4-cache", "mode": "writeback"}]: dispatch 2024-03-30T15:12:25.504 INFO:tasks.workunit.client.0.smithi072.stdout:e-ListObjectssmithi072-64882-1"}]: dispatch 2024-03-30T15:12:25.505 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:20.313592+0000 mon.a [INF] from='client.? 172.21.15.72:0/2829404995' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-4", "tierpool": "test-rados-api-smithi072-64344-4-cache"}]: dispatch 2024-03-30T15:12:25.505 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:20.319548+0000 mon.a [INF] from='client.? 172.21.15.72:0/1633994099' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi072-64841-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:25.505 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: got: 2024-03-30T15:12:20.329677+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi072-64171-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:25.505 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: [ OK ] LibRadosCmd.WatchLog (14447 ms) 2024-03-30T15:12:25.505 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: [----------] 4 tests from LibRadosCmd (33402 ms total) 2024-03-30T15:12:25.505 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: 2024-03-30T15:12:25.505 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: [----------] Global test environment tear-down 2024-03-30T15:12:25.505 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: [==========] 4 tests from 1 test suite ran. (33402 ms total) 2024-03-30T15:12:25.505 INFO:tasks.workunit.client.0.smithi072.stdout: api_cmd: [ PASSED ] 4 tests. 2024-03-30T15:12:25.724 INFO:tasks.workunit.client.0.smithi072.stdout: delete_pools_parallel: process_1_[64748]: starting. 2024-03-30T15:12:25.724 INFO:tasks.workunit.client.0.smithi072.stdout: delete_pools_parallel: process_1_[64748]: creating pool ceph_test_rados_delete_pools_parallel.smithi072-64701 2024-03-30T15:12:25.724 INFO:tasks.workunit.client.0.smithi072.stdout: delete_pools_parallel: process_1_[64748]: created object 0... 2024-03-30T15:12:25.724 INFO:tasks.workunit.client.0.smithi072.stdout: delete_pools_parallel: process_1_[64748]: created object 25... 2024-03-30T15:12:25.724 INFO:tasks.workunit.client.0.smithi072.stdout: delete_pools_parallel: process_1_[64748]: created object 49... 2024-03-30T15:12:25.724 INFO:tasks.workunit.client.0.smithi072.stdout: delete_pools_parallel: process_1_[64748]: finishing. 2024-03-30T15:12:25.724 INFO:tasks.workunit.client.0.smithi072.stdout: delete_pools_parallel: process_1_[64748]: shutting down. 2024-03-30T15:12:25.724 INFO:tasks.workunit.client.0.smithi072.stdout: delete_pools_parallel: process_2_[64749]: starting. 2024-03-30T15:12:25.724 INFO:tasks.workunit.client.0.smithi072.stdout: delete_pools_parallel: process_2_[64749]: deleting pool ceph_test_rados_delete_pools_parallel.smithi072-64701 2024-03-30T15:12:25.725 INFO:tasks.workunit.client.0.smithi072.stdout: delete_pools_parallel: process_2_[64749]: shutting down. 2024-03-30T15:12:25.725 INFO:tasks.workunit.client.0.smithi072.stdout: delete_pools_parallel: ******************************* 2024-03-30T15:12:25.725 INFO:tasks.workunit.client.0.smithi072.stdout: delete_pools_parallel: process_3_[66145]: starting. 2024-03-30T15:12:25.725 INFO:tasks.workunit.client.0.smithi072.stdout: delete_pools_parallel: process_3_[66145]: creating pool ceph_test_rados_delete_pools_parallel.smithi072-64701 2024-03-30T15:12:25.725 INFO:tasks.workunit.client.0.smithi072.stdout: delete_pools_parallel: process_3_[66145]: created object 0... 2024-03-30T15:12:25.725 INFO:tasks.workunit.client.0.smithi072.stdout: delete_pools_parallel: process_3_[66145]: created object 25... 2024-03-30T15:12:25.725 INFO:tasks.workunit.client.0.smithi072.stdout: delete_pools_parallel: process_3_[66145]: created object 49... 2024-03-30T15:12:25.725 INFO:tasks.workunit.client.0.smithi072.stdout: delete_pools_parallel: process_3_[66145]: finishing. 2024-03-30T15:12:25.725 INFO:tasks.workunit.client.0.smithi072.stdout: delete_pools_parallel: process_3_[66145]: shutting down. 2024-03-30T15:12:25.725 INFO:tasks.workunit.client.0.smithi072.stdout: delete_pools_parallel: ******************************* 2024-03-30T15:12:25.725 INFO:tasks.workunit.client.0.smithi072.stdout: delete_pools_parallel: process_5_[66147]: starting. 2024-03-30T15:12:25.725 INFO:tasks.workunit.client.0.smithi072.stdout: delete_pools_parallel: process_5_[66147]: listing objects. 2024-03-30T15:12:25.725 INFO:tasks.workunit.client.0.smithi072.stdout: delete_pools_parallel: process_5_[66147]: listed object 0... 2024-03-30T15:12:25.725 INFO:tasks.workunit.client.0.smithi072.stdout: delete_pools_parallel: process_5_[66147]: listed object 25... 2024-03-30T15:12:25.726 INFO:tasks.workunit.client.0.smithi072.stdout: delete_pools_parallel: process_5_[66147]: saw 50 objects 2024-03-30T15:12:25.726 INFO:tasks.workunit.client.0.smithi072.stdout: delete_pools_parallel: process_5_[66147]: shutting down. 2024-03-30T15:12:25.726 INFO:tasks.workunit.client.0.smithi072.stdout: delete_pools_parallel: ******************************* 2024-03-30T15:12:25.726 INFO:tasks.workunit.client.0.smithi072.stdout: delete_pools_parallel: process_4_[66146]: starting. 2024-03-30T15:12:25.726 INFO:tasks.workunit.client.0.smithi072.stdout: delete_pools_parallel: process_4_[66146]: deleting pool ceph_test_rados_delete_pools_parallel.smithi072-64701 2024-03-30T15:12:25.726 INFO:tasks.workunit.client.0.smithi072.stdout: delete_pools_parallel: process_4_[66146]: shutting down. 2024-03-30T15:12:25.726 INFO:tasks.workunit.client.0.smithi072.stdout: delete_pools_parallel: ******************************* 2024-03-30T15:12:25.726 INFO:tasks.workunit.client.0.smithi072.stdout: delete_pools_parallel: ******************************* 2024-03-30T15:12:25.726 INFO:tasks.workunit.client.0.smithi072.stdout: delete_pools_parallel: ******* SUCCESS ********** 2024-03-30T15:12:25.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:25 smithi172 bash[23680]: cluster 2024-03-30T15:12:23.458634+0000 mon.a (mon.0) 1033 : cluster 3 Health check update: 16 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:12:25.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:25 smithi172 bash[23680]: cluster 2024-03-30T15:12:23.463244+0000 mon.a (mon.0) 1034 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:12:25.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:25 smithi172 bash[23680]: audit 2024-03-30T15:12:23.467469+0000 mon.a (mon.0) 1035 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi072-64425-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi072-64425-7"}]: dispatch 2024-03-30T15:12:25.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:25 smithi172 bash[23680]: audit 2024-03-30T15:12:23.467787+0000 mon.a (mon.0) 1036 : audit 1 from='client.? 172.21.15.72:0/3101006435' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi072-64256-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi072-64256-10"}]': finished 2024-03-30T15:12:25.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:25 smithi172 bash[23680]: audit 2024-03-30T15:12:23.467878+0000 mon.a (mon.0) 1037 : audit 1 from='client.? 172.21.15.72:0/1633994099' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReadOpsmithi072-64841-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi072-64841-2"}]': finished 2024-03-30T15:12:25.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:25 smithi172 bash[23680]: audit 2024-03-30T15:12:23.467962+0000 mon.a (mon.0) 1038 : audit 1 from='client.? 172.21.15.72:0/2829404995' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-4-cache", "mode": "writeback"}]': finished 2024-03-30T15:12:25.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:25 smithi172 bash[23680]: cluster 2024-03-30T15:12:23.471708+0000 mon.a (mon.0) 1039 : cluster 0 osdmap e91: 8 total, 8 up, 8 in 2024-03-30T15:12:25.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:25 smithi172 bash[23680]: audit 2024-03-30T15:12:23.473281+0000 mon.a (mon.0) 1040 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:25.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:25 smithi172 bash[23680]: audit 2024-03-30T15:12:23.474587+0000 mon.a (mon.0) 1041 : audit 1 from='client.? 172.21.15.72:0/855800261' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi072-64187-22"}]: dispatch 2024-03-30T15:12:25.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:25 smithi172 bash[23680]: audit 2024-03-30T15:12:23.489535+0000 mon.a (mon.0) 1042 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi072-64211-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi072-64211-10"}]: dispatch 2024-03-30T15:12:25.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:25 smithi172 bash[23680]: audit 2024-03-30T15:12:23.494144+0000 mon.a (mon.0) 1043 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi072-64882-1"}]: dispatch 2024-03-30T15:12:25.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:25 smithi172 bash[23680]: audit 2024-03-30T15:12:23.502642+0000 mon.a (mon.0) 1044 : audit 1 from='client.? 172.21.15.72:0/4044327810' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2024-03-30T15:12:25.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:25 smithi172 bash[23680]: audit 2024-03-30T15:12:23.950389+0000 mon.a (mon.0) 1045 : audit 1 from='client.? 172.21.15.72:0/2829404995' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-4"}]: dispatch 2024-03-30T15:12:26.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:25 smithi072 bash[21573]: cluster 2024-03-30T15:12:23.458634+0000 mon.a (mon.0) 1033 : cluster 3 Health check update: 16 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:12:26.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:25 smithi072 bash[21573]: cluster 2024-03-30T15:12:23.463244+0000 mon.a (mon.0) 1034 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:12:26.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:25 smithi072 bash[21573]: audit 2024-03-30T15:12:23.467469+0000 mon.a (mon.0) 1035 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi072-64425-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi072-64425-7"}]: dispatch 2024-03-30T15:12:26.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:25 smithi072 bash[21573]: audit 2024-03-30T15:12:23.467787+0000 mon.a (mon.0) 1036 : audit 1 from='client.? 172.21.15.72:0/3101006435' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi072-64256-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi072-64256-10"}]': finished 2024-03-30T15:12:26.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:25 smithi072 bash[21573]: audit 2024-03-30T15:12:23.467878+0000 mon.a (mon.0) 1037 : audit 1 from='client.? 172.21.15.72:0/1633994099' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReadOpsmithi072-64841-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi072-64841-2"}]': finished 2024-03-30T15:12:26.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:25 smithi072 bash[21573]: audit 2024-03-30T15:12:23.467962+0000 mon.a (mon.0) 1038 : audit 1 from='client.? 172.21.15.72:0/2829404995' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-4-cache", "mode": "writeback"}]': finished 2024-03-30T15:12:26.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:25 smithi072 bash[21573]: cluster 2024-03-30T15:12:23.471708+0000 mon.a (mon.0) 1039 : cluster 0 osdmap e91: 8 total, 8 up, 8 in 2024-03-30T15:12:26.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:25 smithi072 bash[21573]: audit 2024-03-30T15:12:23.473281+0000 mon.a (mon.0) 1040 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:26.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:25 smithi072 bash[21573]: audit 2024-03-30T15:12:23.474587+0000 mon.a (mon.0) 1041 : audit 1 from='client.? 172.21.15.72:0/855800261' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi072-64187-22"}]: dispatch 2024-03-30T15:12:26.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:25 smithi072 bash[21573]: audit 2024-03-30T15:12:23.489535+0000 mon.a (mon.0) 1042 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi072-64211-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi072-64211-10"}]: dispatch 2024-03-30T15:12:26.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:25 smithi072 bash[21573]: audit 2024-03-30T15:12:23.494144+0000 mon.a (mon.0) 1043 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi072-64882-1"}]: dispatch 2024-03-30T15:12:26.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:25 smithi072 bash[21573]: audit 2024-03-30T15:12:23.502642+0000 mon.a (mon.0) 1044 : audit 1 from='client.? 172.21.15.72:0/4044327810' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2024-03-30T15:12:26.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:25 smithi072 bash[21573]: audit 2024-03-30T15:12:23.950389+0000 mon.a (mon.0) 1045 : audit 1 from='client.? 172.21.15.72:0/2829404995' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-4"}]: dispatch 2024-03-30T15:12:26.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:25 smithi072 bash[28946]: cluster 2024-03-30T15:12:23.458634+0000 mon.a (mon.0) 1033 : cluster 3 Health check update: 16 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:12:26.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:25 smithi072 bash[28946]: cluster 2024-03-30T15:12:23.463244+0000 mon.a (mon.0) 1034 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:12:26.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:25 smithi072 bash[28946]: audit 2024-03-30T15:12:23.467469+0000 mon.a (mon.0) 1035 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi072-64425-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi072-64425-7"}]: dispatch 2024-03-30T15:12:26.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:25 smithi072 bash[28946]: audit 2024-03-30T15:12:23.467787+0000 mon.a (mon.0) 1036 : audit 1 from='client.? 172.21.15.72:0/3101006435' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi072-64256-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi072-64256-10"}]': finished 2024-03-30T15:12:26.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:25 smithi072 bash[28946]: audit 2024-03-30T15:12:23.467878+0000 mon.a (mon.0) 1037 : audit 1 from='client.? 172.21.15.72:0/1633994099' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReadOpsmithi072-64841-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi072-64841-2"}]': finished 2024-03-30T15:12:26.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:25 smithi072 bash[28946]: audit 2024-03-30T15:12:23.467962+0000 mon.a (mon.0) 1038 : audit 1 from='client.? 172.21.15.72:0/2829404995' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-4-cache", "mode": "writeback"}]': finished 2024-03-30T15:12:26.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:25 smithi072 bash[28946]: cluster 2024-03-30T15:12:23.471708+0000 mon.a (mon.0) 1039 : cluster 0 osdmap e91: 8 total, 8 up, 8 in 2024-03-30T15:12:26.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:25 smithi072 bash[28946]: audit 2024-03-30T15:12:23.473281+0000 mon.a (mon.0) 1040 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:26.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:25 smithi072 bash[28946]: audit 2024-03-30T15:12:23.474587+0000 mon.a (mon.0) 1041 : audit 1 from='client.? 172.21.15.72:0/855800261' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi072-64187-22"}]: dispatch 2024-03-30T15:12:26.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:25 smithi072 bash[28946]: audit 2024-03-30T15:12:23.489535+0000 mon.a (mon.0) 1042 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi072-64211-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi072-64211-10"}]: dispatch 2024-03-30T15:12:26.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:25 smithi072 bash[28946]: audit 2024-03-30T15:12:23.494144+0000 mon.a (mon.0) 1043 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi072-64882-1"}]: dispatch 2024-03-30T15:12:26.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:25 smithi072 bash[28946]: audit 2024-03-30T15:12:23.502642+0000 mon.a (mon.0) 1044 : audit 1 from='client.? 172.21.15.72:0/4044327810' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2024-03-30T15:12:26.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:25 smithi072 bash[28946]: audit 2024-03-30T15:12:23.950389+0000 mon.a (mon.0) 1045 : audit 1 from='client.? 172.21.15.72:0/2829404995' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-4"}]: dispatch 2024-03-30T15:12:26.176 INFO:tasks.workunit.client.0.smithi072.stdout: open_pools_parallel: process_1_[64658]: starting. 2024-03-30T15:12:26.176 INFO:tasks.workunit.client.0.smithi072.stdout: open_pools_parallel: process_1_[64658]: creating pool ceph_test_rados_open_pools_parallel.smithi072-64646 2024-03-30T15:12:26.176 INFO:tasks.workunit.client.0.smithi072.stdout: open_pools_parallel: process_1_[64658]: created object 0... 2024-03-30T15:12:26.176 INFO:tasks.workunit.client.0.smithi072.stdout: open_pools_parallel: process_1_[64658]: created object 25... 2024-03-30T15:12:26.177 INFO:tasks.workunit.client.0.smithi072.stdout: open_pools_parallel: process_1_[64658]: created object 49... 2024-03-30T15:12:26.177 INFO:tasks.workunit.client.0.smithi072.stdout: open_pools_parallel: process_1_[64658]: finishing. 2024-03-30T15:12:26.177 INFO:tasks.workunit.client.0.smithi072.stdout: open_pools_parallel: process_1_[64658]: shutting down. 2024-03-30T15:12:26.177 INFO:tasks.workunit.client.0.smithi072.stdout: open_pools_parallel: process_2_[64663]: starting. 2024-03-30T15:12:26.177 INFO:tasks.workunit.client.0.smithi072.stdout: open_pools_parallel: process_2_[64663]: rados_pool_create. 2024-03-30T15:12:26.177 INFO:tasks.workunit.client.0.smithi072.stdout: open_pools_parallel: process_2_[64663]: rados_ioctx_create. 2024-03-30T15:12:26.177 INFO:tasks.workunit.client.0.smithi072.stdout: open_pools_parallel: process_2_[64663]: shutting down. 2024-03-30T15:12:26.177 INFO:tasks.workunit.client.0.smithi072.stdout: open_pools_parallel: ******************************* 2024-03-30T15:12:26.177 INFO:tasks.workunit.client.0.smithi072.stdout: open_pools_parallel: process_3_[66349]: starting. 2024-03-30T15:12:26.177 INFO:tasks.workunit.client.0.smithi072.stdout: open_pools_parallel: process_3_[66349]: creating pool ceph_test_rados_open_pools_parallel.smithi072-64646 2024-03-30T15:12:26.177 INFO:tasks.workunit.client.0.smithi072.stdout: open_pools_parallel: process_3_[66349]: created object 0... 2024-03-30T15:12:26.177 INFO:tasks.workunit.client.0.smithi072.stdout: open_pools_parallel: process_3_[66349]: created object 25... 2024-03-30T15:12:26.177 INFO:tasks.workunit.client.0.smithi072.stdout: open_pools_parallel: process_3_[66349]: created object 49... 2024-03-30T15:12:26.177 INFO:tasks.workunit.client.0.smithi072.stdout: open_pools_parallel: process_3_[66349]: finishing. 2024-03-30T15:12:26.177 INFO:tasks.workunit.client.0.smithi072.stdout: open_pools_parallel: process_3_[66349]: shutting down. 2024-03-30T15:12:26.178 INFO:tasks.workunit.client.0.smithi072.stdout: open_pools_parallel: ******************************* 2024-03-30T15:12:26.178 INFO:tasks.workunit.client.0.smithi072.stdout: open_pools_parallel: process_4_[66350]: starting. 2024-03-30T15:12:26.178 INFO:tasks.workunit.client.0.smithi072.stdout: open_pools_parallel: process_4_[66350]: rados_pool_create. 2024-03-30T15:12:26.178 INFO:tasks.workunit.client.0.smithi072.stdout: open_pools_parallel: process_4_[66350]: rados_ioctx_create. 2024-03-30T15:12:26.178 INFO:tasks.workunit.client.0.smithi072.stdout: open_pools_parallel: process_4_[66350]: shutting down. 2024-03-30T15:12:26.178 INFO:tasks.workunit.client.0.smithi072.stdout: open_pools_parallel: ******************************* 2024-03-30T15:12:26.178 INFO:tasks.workunit.client.0.smithi072.stdout: open_pools_parallel: ******************************* 2024-03-30T15:12:26.178 INFO:tasks.workunit.client.0.smithi072.stdout: open_pools_parallel: ******* SUCCESS ********** 2024-03-30T15:12:26.638 INFO:tasks.workunit.client.0.smithi072.stdout:LibRadosIoECPP.OverlappingWriteRoundTripPP 2024-03-30T15:12:26.638 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ OK ] LibRadosIoECPP.OverlappingWriteRoundTripPP (6 ms) 2024-03-30T15:12:26.638 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2024-03-30T15:12:26.638 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP (6 ms) 2024-03-30T15:12:26.638 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2024-03-30T15:12:26.639 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP2 (3 ms) 2024-03-30T15:12:26.639 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.AppendRoundTripPP 2024-03-30T15:12:26.639 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ OK ] LibRadosIoECPP.AppendRoundTripPP (5 ms) 2024-03-30T15:12:26.639 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.TruncTestPP 2024-03-30T15:12:26.639 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ OK ] LibRadosIoECPP.TruncTestPP (4 ms) 2024-03-30T15:12:26.639 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RemoveTestPP 2024-03-30T15:12:26.639 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RemoveTestPP (3 ms) 2024-03-30T15:12:26.639 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2024-03-30T15:12:26.639 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrsRoundTripPP (5 ms) 2024-03-30T15:12:26.639 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RmXattrPP 2024-03-30T15:12:26.639 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RmXattrPP (9 ms) 2024-03-30T15:12:26.639 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrListPP 2024-03-30T15:12:26.639 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrListPP (4 ms) 2024-03-30T15:12:26.639 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtPP 2024-03-30T15:12:26.639 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtPP (7 ms) 2024-03-30T15:12:26.640 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtDNEPP 2024-03-30T15:12:26.640 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtDNEPP (5 ms) 2024-03-30T15:12:26.640 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2024-03-30T15:12:26.640 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtMismatchPP (5 ms) 2024-03-30T15:12:26.640 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP (4308 ms total) 2024-03-30T15:12:26.640 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: 2024-03-30T15:12:26.640 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [----------] Global test environment tear-down 2024-03-30T15:12:26.640 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [==========] 37 tests from 2 test suites ran. (34686 ms total) 2024-03-30T15:12:26.640 INFO:tasks.workunit.client.0.smithi072.stdout: api_io_pp: [ PASSED ] 37 tests. 2024-03-30T15:12:27.021 INFO:tasks.workunit.client.0.smithi072.stdout: api_service_pp: [==========] Running 4 tests from 1 test suite. 2024-03-30T15:12:27.021 INFO:tasks.workunit.client.0.smithi072.stdout: api_service_pp: [----------] Global test environment set-up. 2024-03-30T15:12:27.021 INFO:tasks.workunit.client.0.smithi072.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP 2024-03-30T15:12:27.021 INFO:tasks.workunit.client.0.smithi072.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterEarly 2024-03-30T15:12:27.021 INFO:tasks.workunit.client.0.smithi072.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterEarly (5063 ms) 2024-03-30T15:12:27.022 INFO:tasks.workunit.client.0.smithi072.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterLate 2024-03-30T15:12:27.022 INFO:tasks.workunit.client.0.smithi072.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterLate (60 ms) 2024-03-30T15:12:27.022 INFO:tasks.workunit.client.0.smithi072.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Status 2024-03-30T15:12:27.022 INFO:tasks.workunit.client.0.smithi072.stdout: api_service_pp: [ OK ] LibRadosServicePP.Status (24673 ms) 2024-03-30T15:12:27.022 INFO:tasks.workunit.client.0.smithi072.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Close 2024-03-30T15:12:27.022 INFO:tasks.workunit.client.0.smithi072.stdout: api_service_pp: attempt 0 of 20 2024-03-30T15:12:27.022 INFO:tasks.workunit.client.0.smithi072.stdout: api_service_pp: [ OK ] LibRadosServicePP.Close (5092 ms) 2024-03-30T15:12:27.022 INFO:tasks.workunit.client.0.smithi072.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP (34888 ms total) 2024-03-30T15:12:27.022 INFO:tasks.workunit.client.0.smithi072.stdout: api_service_pp: 2024-03-30T15:12:27.022 INFO:tasks.workunit.client.0.smithi072.stdout: api_service_pp: [----------] Global test environment tear-down 2024-03-30T15:12:27.022 INFO:tasks.workunit.client.0.smithi072.stdout: api_service_pp: [==========] 4 tests from 1 test suite ran. (34888 ms total) 2024-03-30T15:12:27.022 INFO:tasks.workunit.client.0.smithi072.stdout: api_service_pp: [ PASSED ] 4 tests. 2024-03-30T15:12:27.514 INFO:tasks.workunit.client.0.smithi072.stdout: watch_notify: Running main() from gmock_main.cc 2024-03-30T15:12:27.514 INFO:tasks.workunit.client.0.smithi072.stdout: watch_notify: [==========] Running 2 tests from 1 test suite. 2024-03-30T15:12:27.514 INFO:tasks.workunit.client.0.smithi072.stdout: watch_notify: [----------] Global test environment set-up. 2024-03-30T15:12:27.515 INFO:tasks.workunit.client.0.smithi072.stdout: watch_notify: [----------] 2 tests from NeoRadosWatchNotify 2024-03-30T15:12:27.515 INFO:tasks.workunit.client.0.smithi072.stdout: watch_notify: [ RUN ] NeoRadosWatchNotify.WatchNotify 2024-03-30T15:12:27.515 INFO:tasks.workunit.client.0.smithi072.stdout: watch_notify: handle_notify cookie 94845170996448 notify_id 343597383681 notifier_gid 14841 2024-03-30T15:12:27.515 INFO:tasks.workunit.client.0.smithi072.stdout: watch_notify: [ OK ] NeoRadosWatchNotify.WatchNotify (20037 ms) 2024-03-30T15:12:27.515 INFO:tasks.workunit.client.0.smithi072.stdout: watch_notify: [ RUN ] NeoRadosWatchNotify.WatchNotifyTimeout 2024-03-30T15:12:27.515 INFO:tasks.workunit.client.0.smithi072.stdout: watch_notify: Trying... 2024-03-30T15:12:27.515 INFO:tasks.workunit.client.0.smithi072.stdout: watch_notify: handle_notify cookie 94845183692400 notify_id 382252089347 notifier_gid 25088 2024-03-30T15:12:27.515 INFO:tasks.workunit.client.0.smithi072.stdout: watch_notify: Waiting for 3.000000000s 2024-03-30T15:12:27.515 INFO:tasks.workunit.client.0.smithi072.stdout: watch_notify: Timed out. 2024-03-30T15:12:27.515 INFO:tasks.workunit.client.0.smithi072.stdout: watch_notify: Flushing... 2024-03-30T15:12:27.515 INFO:tasks.workunit.client.0.smithi072.stdout: watch_notify: Flushed... 2024-03-30T15:12:27.515 INFO:tasks.workunit.client.0.smithi072.stdout: watch_notify: [ OK ] NeoRadosWatchNotify.WatchNotifyTimeout (15150 ms) 2024-03-30T15:12:27.515 INFO:tasks.workunit.client.0.smithi072.stdout: watch_notify: [----------] 2 tests from NeoRadosWatchNotify (35188 ms total) 2024-03-30T15:12:27.515 INFO:tasks.workunit.client.0.smithi072.stdout: watch_notify: 2024-03-30T15:12:27.516 INFO:tasks.workunit.client.0.smithi072.stdout: watch_notify: [----------] Global test environment tear-down 2024-03-30T15:12:27.516 INFO:tasks.workunit.client.0.smithi072.stdout: watch_notify: [==========] 2 tests from 1 test suite ran. (35188 ms total) 2024-03-30T15:12:27.516 INFO:tasks.workunit.client.0.smithi072.stdout: watch_notify: [ PASSED ] 2 tests. 2024-03-30T15:12:27.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[21573]: cluster 2024-03-30T15:12:21.844805+0000 mgr.y (mgr.14526) 187 : cluster 0 pgmap v134: 892 pgs: 277 creating+peering, 519 active+clean, 96 unknown; 145 MiB data, 746 MiB used, 714 GiB / 715 GiB avail; 1009 B/s rd, 1 op/s 2024-03-30T15:12:27.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[21573]: cluster 2024-03-30T15:12:23.846454+0000 mgr.y (mgr.14526) 188 : cluster 0 pgmap v137: 804 pgs: 171 creating+peering, 417 active+clean, 216 unknown; 145 MiB data, 746 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T15:12:27.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[21573]: audit 2024-03-30T15:12:24.779637+0000 mon.a (mon.0) 1046 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:27.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[21573]: audit 2024-03-30T15:12:24.781691+0000 mon.a (mon.0) 1047 : audit 1 from='client.? 172.21.15.72:0/855800261' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi072-64187-22"}]': finished 2024-03-30T15:12:27.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[21573]: audit 2024-03-30T15:12:24.781843+0000 mon.a (mon.0) 1048 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi072-64882-1"}]': finished 2024-03-30T15:12:27.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[21573]: audit 2024-03-30T15:12:24.782029+0000 mon.a (mon.0) 1049 : audit 1 from='client.? 172.21.15.72:0/2829404995' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-4"}]': finished 2024-03-30T15:12:27.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[21573]: cluster 2024-03-30T15:12:25.701250+0000 mon.a (mon.0) 1050 : cluster 0 osdmap e92: 8 total, 8 up, 8 in 2024-03-30T15:12:27.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[21573]: audit 2024-03-30T15:12:25.721101+0000 mon.a (mon.0) 1051 : audit 1 from='client.? 172.21.15.72:0/2829404995' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-4", "tierpool": "test-rados-api-smithi072-64344-4-cache"}]: dispatch 2024-03-30T15:12:27.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[21573]: audit 2024-03-30T15:12:25.721474+0000 mon.a (mon.0) 1052 : audit 1 from='client.? 172.21.15.72:0/855800261' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi072-64187-22"}]: dispatch 2024-03-30T15:12:27.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[21573]: audit 2024-03-30T15:12:25.726136+0000 mon.a (mon.0) 1053 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi072-64300-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:27.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[21573]: audit 2024-03-30T15:12:25.727063+0000 mon.a (mon.0) 1054 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi072-64478-1"}]: dispatch 2024-03-30T15:12:27.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[21573]: audit 2024-03-30T15:12:25.727388+0000 mon.a (mon.0) 1055 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:27.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[21573]: cluster 2024-03-30T15:12:26.153802+0000 mon.a (mon.0) 1056 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:12:27.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[21573]: audit 2024-03-30T15:12:26.155930+0000 mon.a (mon.0) 1057 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:27.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[21573]: audit 2024-03-30T15:12:26.157304+0000 mon.a (mon.0) 1058 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi072-64425-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi072-64425-7"}]': finished 2024-03-30T15:12:27.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[28946]: cluster 2024-03-30T15:12:21.844805+0000 mgr.y (mgr.14526) 187 : cluster 0 pgmap v134: 892 pgs: 277 creating+peering, 519 active+clean, 96 unknown; 145 MiB data, 746 MiB used, 714 GiB / 715 GiB avail; 1009 B/s rd, 1 op/s 2024-03-30T15:12:27.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[28946]: cluster 2024-03-30T15:12:23.846454+0000 mgr.y (mgr.14526) 188 : cluster 0 pgmap v137: 804 pgs: 171 creating+peering, 417 active+clean, 216 unknown; 145 MiB data, 746 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T15:12:27.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[28946]: audit 2024-03-30T15:12:24.779637+0000 mon.a (mon.0) 1046 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:27.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[28946]: audit 2024-03-30T15:12:24.781691+0000 mon.a (mon.0) 1047 : audit 1 from='client.? 172.21.15.72:0/855800261' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi072-64187-22"}]': finished 2024-03-30T15:12:27.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[28946]: audit 2024-03-30T15:12:24.781843+0000 mon.a (mon.0) 1048 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi072-64882-1"}]': finished 2024-03-30T15:12:27.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[28946]: audit 2024-03-30T15:12:24.782029+0000 mon.a (mon.0) 1049 : audit 1 from='client.? 172.21.15.72:0/2829404995' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-4"}]': finished 2024-03-30T15:12:27.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[28946]: cluster 2024-03-30T15:12:25.701250+0000 mon.a (mon.0) 1050 : cluster 0 osdmap e92: 8 total, 8 up, 8 in 2024-03-30T15:12:27.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[28946]: audit 2024-03-30T15:12:25.721101+0000 mon.a (mon.0) 1051 : audit 1 from='client.? 172.21.15.72:0/2829404995' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-4", "tierpool": "test-rados-api-smithi072-64344-4-cache"}]: dispatch 2024-03-30T15:12:27.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[28946]: audit 2024-03-30T15:12:25.721474+0000 mon.a (mon.0) 1052 : audit 1 from='client.? 172.21.15.72:0/855800261' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi072-64187-22"}]: dispatch 2024-03-30T15:12:27.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[28946]: audit 2024-03-30T15:12:25.726136+0000 mon.a (mon.0) 1053 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi072-64300-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:27.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[28946]: audit 2024-03-30T15:12:25.727063+0000 mon.a (mon.0) 1054 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi072-64478-1"}]: dispatch 2024-03-30T15:12:27.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[28946]: audit 2024-03-30T15:12:25.727388+0000 mon.a (mon.0) 1055 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:27.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[28946]: cluster 2024-03-30T15:12:26.153802+0000 mon.a (mon.0) 1056 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:12:27.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[28946]: audit 2024-03-30T15:12:26.155930+0000 mon.a (mon.0) 1057 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:27.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[28946]: audit 2024-03-30T15:12:26.157304+0000 mon.a (mon.0) 1058 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi072-64425-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi072-64425-7"}]': finished 2024-03-30T15:12:27.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[28946]: audit 2024-03-30T15:12:26.157377+0000 mon.a (mon.0) 1059 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi072-64211-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi072-64211-10"}]': finished 2024-03-30T15:12:27.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[28946]: audit 2024-03-30T15:12:26.157441+0000 mon.a (mon.0) 1060 : audit 1 from='client.? 172.21.15.72:0/2829404995' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-4", "tierpool": "test-rados-api-smithi072-64344-4-cache"}]': finished 2024-03-30T15:12:27.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[28946]: audit 2024-03-30T15:12:26.157507+0000 mon.a (mon.0) 1061 : audit 1 from='client.? 172.21.15.72:0/855800261' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi072-64187-22"}]': finished 2024-03-30T15:12:27.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[28946]: audit 2024-03-30T15:12:26.157570+0000 mon.a (mon.0) 1062 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi072-64300-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:27.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[28946]: audit 2024-03-30T15:12:26.157628+0000 mon.a (mon.0) 1063 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi072-64478-1"}]': finished 2024-03-30T15:12:27.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[28946]: audit 2024-03-30T15:12:26.157680+0000 mon.a (mon.0) 1064 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:27.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[28946]: cluster 2024-03-30T15:12:26.161466+0000 mon.a (mon.0) 1065 : cluster 0 osdmap e93: 8 total, 8 up, 8 in 2024-03-30T15:12:27.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[28946]: audit 2024-03-30T15:12:26.172635+0000 mon.c (mon.2) 159 : audit 1 from='client.? 172.21.15.72:0/4159181360' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi072-64478-1"}]: dispatch 2024-03-30T15:12:27.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[28946]: audit 2024-03-30T15:12:26.177888+0000 mon.c (mon.2) 160 : audit 1 from='client.? 172.21.15.72:0/1833987253' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi072-64300-1","app": "app2"}]: dispatch 2024-03-30T15:12:27.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[28946]: audit 2024-03-30T15:12:26.178613+0000 mon.c (mon.2) 161 : audit 1 from='client.? 172.21.15.72:0/1833987253' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi072-64300-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:27.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[28946]: audit 2024-03-30T15:12:26.189941+0000 mon.c (mon.2) 162 : audit 1 from='client.? 172.21.15.72:0/634351624' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi072-64403-7"}]: dispatch 2024-03-30T15:12:27.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[28946]: audit 2024-03-30T15:12:26.196464+0000 mon.a (mon.0) 1066 : audit 1 from='client.? 172.21.15.72:0/2345721524' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi072-64882-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:27.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[28946]: audit 2024-03-30T15:12:26.197317+0000 mon.c (mon.2) 163 : audit 1 from='client.? 172.21.15.72:0/2843763890' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi072-64163-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:27.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[28946]: audit 2024-03-30T15:12:26.634772+0000 mon.a (mon.0) 1067 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi072-64478-1"}]: dispatch 2024-03-30T15:12:27.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[28946]: audit 2024-03-30T15:12:26.635733+0000 mon.a (mon.0) 1068 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi072-64300-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:27.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[21573]: audit 2024-03-30T15:12:26.157377+0000 mon.a (mon.0) 1059 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi072-64211-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi072-64211-10"}]': finished 2024-03-30T15:12:27.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[21573]: audit 2024-03-30T15:12:26.157441+0000 mon.a (mon.0) 1060 : audit 1 from='client.? 172.21.15.72:0/2829404995' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-4", "tierpool": "test-rados-api-smithi072-64344-4-cache"}]': finished 2024-03-30T15:12:27.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[21573]: audit 2024-03-30T15:12:26.157507+0000 mon.a (mon.0) 1061 : audit 1 from='client.? 172.21.15.72:0/855800261' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi072-64187-22"}]': finished 2024-03-30T15:12:27.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[21573]: audit 2024-03-30T15:12:26.157570+0000 mon.a (mon.0) 1062 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi072-64300-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:27.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[21573]: audit 2024-03-30T15:12:26.157628+0000 mon.a (mon.0) 1063 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi072-64478-1"}]': finished 2024-03-30T15:12:27.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[21573]: audit 2024-03-30T15:12:26.157680+0000 mon.a (mon.0) 1064 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:27.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[21573]: cluster 2024-03-30T15:12:26.161466+0000 mon.a (mon.0) 1065 : cluster 0 osdmap e93: 8 total, 8 up, 8 in 2024-03-30T15:12:27.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[21573]: audit 2024-03-30T15:12:26.172635+0000 mon.c (mon.2) 159 : audit 1 from='client.? 172.21.15.72:0/4159181360' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi072-64478-1"}]: dispatch 2024-03-30T15:12:27.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[21573]: audit 2024-03-30T15:12:26.177888+0000 mon.c (mon.2) 160 : audit 1 from='client.? 172.21.15.72:0/1833987253' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi072-64300-1","app": "app2"}]: dispatch 2024-03-30T15:12:27.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[21573]: audit 2024-03-30T15:12:26.178613+0000 mon.c (mon.2) 161 : audit 1 from='client.? 172.21.15.72:0/1833987253' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi072-64300-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:27.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[21573]: audit 2024-03-30T15:12:26.189941+0000 mon.c (mon.2) 162 : audit 1 from='client.? 172.21.15.72:0/634351624' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi072-64403-7"}]: dispatch 2024-03-30T15:12:27.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[21573]: audit 2024-03-30T15:12:26.196464+0000 mon.a (mon.0) 1066 : audit 1 from='client.? 172.21.15.72:0/2345721524' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi072-64882-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:27.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[21573]: audit 2024-03-30T15:12:26.197317+0000 mon.c (mon.2) 163 : audit 1 from='client.? 172.21.15.72:0/2843763890' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi072-64163-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:27.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[21573]: audit 2024-03-30T15:12:26.634772+0000 mon.a (mon.0) 1067 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi072-64478-1"}]: dispatch 2024-03-30T15:12:27.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[21573]: audit 2024-03-30T15:12:26.635733+0000 mon.a (mon.0) 1068 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi072-64300-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:27.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[28946]: audit 2024-03-30T15:12:26.636241+0000 mon.a (mon.0) 1069 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi072-64403-7"}]: dispatch 2024-03-30T15:12:27.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[28946]: audit 2024-03-30T15:12:26.636772+0000 mon.a (mon.0) 1070 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi072-64163-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:27.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[28946]: audit 2024-03-30T15:12:26.640169+0000 mon.a (mon.0) 1071 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi072-64444-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:27.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[21573]: audit 2024-03-30T15:12:26.636241+0000 mon.a (mon.0) 1069 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi072-64403-7"}]: dispatch 2024-03-30T15:12:27.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[21573]: audit 2024-03-30T15:12:26.636772+0000 mon.a (mon.0) 1070 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi072-64163-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:27.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:27 smithi072 bash[21573]: audit 2024-03-30T15:12:26.640169+0000 mon.a (mon.0) 1071 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi072-64444-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:27.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:27 smithi172 bash[23680]: cluster 2024-03-30T15:12:21.844805+0000 mgr.y (mgr.14526) 187 : cluster 0 pgmap v134: 892 pgs: 277 creating+peering, 519 active+clean, 96 unknown; 145 MiB data, 746 MiB used, 714 GiB / 715 GiB avail; 1009 B/s rd, 1 op/s 2024-03-30T15:12:27.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:27 smithi172 bash[23680]: cluster 2024-03-30T15:12:23.846454+0000 mgr.y (mgr.14526) 188 : cluster 0 pgmap v137: 804 pgs: 171 creating+peering, 417 active+clean, 216 unknown; 145 MiB data, 746 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T15:12:27.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:27 smithi172 bash[23680]: audit 2024-03-30T15:12:24.779637+0000 mon.a (mon.0) 1046 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:27.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:27 smithi172 bash[23680]: audit 2024-03-30T15:12:24.781691+0000 mon.a (mon.0) 1047 : audit 1 from='client.? 172.21.15.72:0/855800261' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi072-64187-22"}]': finished 2024-03-30T15:12:27.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:27 smithi172 bash[23680]: audit 2024-03-30T15:12:24.781843+0000 mon.a (mon.0) 1048 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi072-64882-1"}]': finished 2024-03-30T15:12:27.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:27 smithi172 bash[23680]: audit 2024-03-30T15:12:24.782029+0000 mon.a (mon.0) 1049 : audit 1 from='client.? 172.21.15.72:0/2829404995' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-4"}]': finished 2024-03-30T15:12:27.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:27 smithi172 bash[23680]: cluster 2024-03-30T15:12:25.701250+0000 mon.a (mon.0) 1050 : cluster 0 osdmap e92: 8 total, 8 up, 8 in 2024-03-30T15:12:27.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:27 smithi172 bash[23680]: audit 2024-03-30T15:12:25.721101+0000 mon.a (mon.0) 1051 : audit 1 from='client.? 172.21.15.72:0/2829404995' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-4", "tierpool": "test-rados-api-smithi072-64344-4-cache"}]: dispatch 2024-03-30T15:12:27.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:27 smithi172 bash[23680]: audit 2024-03-30T15:12:25.721474+0000 mon.a (mon.0) 1052 : audit 1 from='client.? 172.21.15.72:0/855800261' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi072-64187-22"}]: dispatch 2024-03-30T15:12:27.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:27 smithi172 bash[23680]: audit 2024-03-30T15:12:25.726136+0000 mon.a (mon.0) 1053 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi072-64300-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:27.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:27 smithi172 bash[23680]: audit 2024-03-30T15:12:25.727063+0000 mon.a (mon.0) 1054 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi072-64478-1"}]: dispatch 2024-03-30T15:12:27.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:27 smithi172 bash[23680]: audit 2024-03-30T15:12:25.727388+0000 mon.a (mon.0) 1055 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:27.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:27 smithi172 bash[23680]: cluster 2024-03-30T15:12:26.153802+0000 mon.a (mon.0) 1056 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:12:27.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:27 smithi172 bash[23680]: audit 2024-03-30T15:12:26.155930+0000 mon.a (mon.0) 1057 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:27.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:27 smithi172 bash[23680]: audit 2024-03-30T15:12:26.157304+0000 mon.a (mon.0) 1058 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi072-64425-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi072-64425-7"}]': finished 2024-03-30T15:12:27.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:27 smithi172 bash[23680]: audit 2024-03-30T15:12:26.157377+0000 mon.a (mon.0) 1059 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi072-64211-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi072-64211-10"}]': finished 2024-03-30T15:12:27.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:27 smithi172 bash[23680]: audit 2024-03-30T15:12:26.157441+0000 mon.a (mon.0) 1060 : audit 1 from='client.? 172.21.15.72:0/2829404995' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-4", "tierpool": "test-rados-api-smithi072-64344-4-cache"}]': finished 2024-03-30T15:12:27.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:27 smithi172 bash[23680]: audit 2024-03-30T15:12:26.157507+0000 mon.a (mon.0) 1061 : audit 1 from='client.? 172.21.15.72:0/855800261' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi072-64187-22"}]': finished 2024-03-30T15:12:27.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:27 smithi172 bash[23680]: audit 2024-03-30T15:12:26.157570+0000 mon.a (mon.0) 1062 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi072-64300-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:27.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:27 smithi172 bash[23680]: audit 2024-03-30T15:12:26.157628+0000 mon.a (mon.0) 1063 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi072-64478-1"}]': finished 2024-03-30T15:12:27.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:27 smithi172 bash[23680]: audit 2024-03-30T15:12:26.157680+0000 mon.a (mon.0) 1064 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:27.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:27 smithi172 bash[23680]: cluster 2024-03-30T15:12:26.161466+0000 mon.a (mon.0) 1065 : cluster 0 osdmap e93: 8 total, 8 up, 8 in 2024-03-30T15:12:27.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:27 smithi172 bash[23680]: audit 2024-03-30T15:12:26.172635+0000 mon.c (mon.2) 159 : audit 1 from='client.? 172.21.15.72:0/4159181360' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi072-64478-1"}]: dispatch 2024-03-30T15:12:27.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:27 smithi172 bash[23680]: audit 2024-03-30T15:12:26.177888+0000 mon.c (mon.2) 160 : audit 1 from='client.? 172.21.15.72:0/1833987253' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi072-64300-1","app": "app2"}]: dispatch 2024-03-30T15:12:27.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:27 smithi172 bash[23680]: audit 2024-03-30T15:12:26.178613+0000 mon.c (mon.2) 161 : audit 1 from='client.? 172.21.15.72:0/1833987253' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi072-64300-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:27.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:27 smithi172 bash[23680]: audit 2024-03-30T15:12:26.189941+0000 mon.c (mon.2) 162 : audit 1 from='client.? 172.21.15.72:0/634351624' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi072-64403-7"}]: dispatch 2024-03-30T15:12:27.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:27 smithi172 bash[23680]: audit 2024-03-30T15:12:26.196464+0000 mon.a (mon.0) 1066 : audit 1 from='client.? 172.21.15.72:0/2345721524' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi072-64882-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:27.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:27 smithi172 bash[23680]: audit 2024-03-30T15:12:26.197317+0000 mon.c (mon.2) 163 : audit 1 from='client.? 172.21.15.72:0/2843763890' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi072-64163-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:27.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:27 smithi172 bash[23680]: audit 2024-03-30T15:12:26.634772+0000 mon.a (mon.0) 1067 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi072-64478-1"}]: dispatch 2024-03-30T15:12:27.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:27 smithi172 bash[23680]: audit 2024-03-30T15:12:26.635733+0000 mon.a (mon.0) 1068 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi072-64300-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:27.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:27 smithi172 bash[23680]: audit 2024-03-30T15:12:26.636241+0000 mon.a (mon.0) 1069 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi072-64403-7"}]: dispatch 2024-03-30T15:12:27.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:27 smithi172 bash[23680]: audit 2024-03-30T15:12:26.636772+0000 mon.a (mon.0) 1070 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi072-64163-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:27.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:27 smithi172 bash[23680]: audit 2024-03-30T15:12:26.640169+0000 mon.a (mon.0) 1071 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi072-64444-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:28.494 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat: Running main() from gmock_main.cc 2024-03-30T15:12:28.494 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat: [==========] Running 9 tests from 2 test suites. 2024-03-30T15:12:28.494 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat: [----------] Global test environment set-up. 2024-03-30T15:12:28.495 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat: [----------] 5 tests from LibRadosStat 2024-03-30T15:12:28.495 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat: [ RUN ] LibRadosStat.Stat 2024-03-30T15:12:28.495 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat: [ OK ] LibRadosStat.Stat (69 ms) 2024-03-30T15:12:28.495 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat: [ RUN ] LibRadosStat.Stat2 2024-03-30T15:12:28.495 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat: [ OK ] LibRadosStat.Stat2 (5138 ms) 2024-03-30T15:12:28.495 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat: [ RUN ] LibRadosStat.StatNS 2024-03-30T15:12:28.495 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat: [ OK ] LibRadosStat.StatNS (7 ms) 2024-03-30T15:12:28.495 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat: [ RUN ] LibRadosStat.ClusterStat 2024-03-30T15:12:28.495 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat: [ OK ] LibRadosStat.ClusterStat (0 ms) 2024-03-30T15:12:28.495 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat: [ RUN ] LibRadosStat.PoolStat 2024-03-30T15:12:28.495 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat: [ OK ] LibRadosStat.PoolStat (2 ms) 2024-03-30T15:12:28.495 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat: [----------] 5 tests from LibRadosStat (5216 ms total) 2024-03-30T15:12:28.495 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat: 2024-03-30T15:12:28.495 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat: [----------] 4 tests from LibRadosStatEC 2024-03-30T15:12:28.496 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat: [ RUN ] LibRadosStatEC.Stat 2024-03-30T15:12:28.496 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat: [ OK ] LibRadosStatEC.Stat (2871 ms) 2024-03-30T15:12:28.496 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat: [ RUN ] LibRadosStatEC.StatNS 2024-03-30T15:12:28.496 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat: [ OK ] LibRadosStatEC.StatNS (17 ms) 2024-03-30T15:12:28.496 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat: [ RUN ] LibRadosStatEC.ClusterStat 2024-03-30T15:12:28.496 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat: [ OK ] LibRadosStatEC.ClusterStat (2 ms) 2024-03-30T15:12:28.496 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat: [ RUN ] LibRadosStatEC.PoolStat 2024-03-30T15:12:28.496 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat: [ OK ] LibRadosStatEC.PoolStat (3 ms) 2024-03-30T15:12:28.496 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat: [----------] 4 tests from LibRadosStatEC (2893 ms total) 2024-03-30T15:12:28.496 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat: 2024-03-30T15:12:28.496 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat: [----------] Global test environment tear-down 2024-03-30T15:12:28.496 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat: [==========] 9 tests from 2 test suites ran. (36442 ms total) 2024-03-30T15:12:28.496 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat: [ PASSED ] 9 tests. 2024-03-30T15:12:29.849 INFO:tasks.workunit.client.0.smithi072.stdout: list: Running main() from gmock_main.cc 2024-03-30T15:12:29.849 INFO:tasks.workunit.client.0.smithi072.stdout: list: [==========] Running 3 tests from 1 test suite. 2024-03-30T15:12:29.849 INFO:tasks.workunit.client.0.smithi072.stdout: list: [----------] Global test environment set-up. 2024-03-30T15:12:29.849 INFO:tasks.workunit.client.0.smithi072.stdout: list: [----------] 3 tests from NeoradosList 2024-03-30T15:12:29.849 INFO:tasks.workunit.client.0.smithi072.stdout: list: [ RUN ] NeoradosList.ListObjects 2024-03-30T15:12:29.849 INFO:tasks.workunit.client.0.smithi072.stdout: list: [ OK ] NeoradosList.ListObjects (18780 ms) 2024-03-30T15:12:29.849 INFO:tasks.workunit.client.0.smithi072.stdout: list: [ RUN ] NeoradosList.ListObjectsNS 2024-03-30T15:12:29.849 INFO:tasks.workunit.client.0.smithi072.stdout: list: [ OK ] NeoradosList.ListObjectsNS (11981 ms) 2024-03-30T15:12:29.849 INFO:tasks.workunit.client.0.smithi072.stdout: list: [ RUN ] NeoradosList.ListObjectsMany 2024-03-30T15:12:29.849 INFO:tasks.workunit.client.0.smithi072.stdout: list: [ OK ] NeoradosList.ListObjectsMany (6805 ms) 2024-03-30T15:12:29.850 INFO:tasks.workunit.client.0.smithi072.stdout: list: [----------] 3 tests from NeoradosList (37566 ms total) 2024-03-30T15:12:29.850 INFO:tasks.workunit.client.0.smithi072.stdout: list: 2024-03-30T15:12:29.850 INFO:tasks.workunit.client.0.smithi072.stdout: list: [----------] Global test environment tear-down 2024-03-30T15:12:29.850 INFO:tasks.workunit.client.0.smithi072.stdout: list: [==========] 3 tests from 1 test suite ran. (37566 ms total) 2024-03-30T15:12:29.850 INFO:tasks.workunit.client.0.smithi072.stdout: list: [ PASSED ] 3 tests. 2024-03-30T15:12:30.118 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: [==========] Running 4 tests from 1 test suite. 2024-03-30T15:12:30.119 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: [----------] Global test environment set-up. 2024-03-30T15:12:30.119 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: [----------] 4 tests from LibRadosService 2024-03-30T15:12:30.119 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: [ RUN ] LibRadosService.RegisterEarly 2024-03-30T15:12:30.119 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: [ OK ] LibRadosService.RegisterEarly (7460 ms) 2024-03-30T15:12:30.119 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: [ RUN ] LibRadosService.RegisterLate 2024-03-30T15:12:30.119 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: [ OK ] LibRadosService.RegisterLate (55 ms) 2024-03-30T15:12:30.119 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: [ RUN ] LibRadosService.StatusFormat 2024-03-30T15:12:30.119 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: cluster: 2024-03-30T15:12:30.119 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: id: 97f8e564-eea5-11ee-b647-cb9ed24678a4 2024-03-30T15:12:30.119 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: health: HEALTH_WARN 2024-03-30T15:12:30.119 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: 6 pool(s) do not have an application enabled 2024-03-30T15:12:30.119 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: 2024-03-30T15:12:30.119 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: services: 2024-03-30T15:12:30.120 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 12m) 2024-03-30T15:12:30.120 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: mgr: y(active, since 3m), standbys: x 2024-03-30T15:12:30.120 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: osd: 8 osds: 8 up (since 5m), 8 in (since 5m) 2024-03-30T15:12:30.120 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: laundry: 1 daemon active (1 hosts) 2024-03-30T15:12:30.120 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: rgw: 1 daemon active (1 hosts, 1 zones) 2024-03-30T15:12:30.120 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: 2024-03-30T15:12:30.120 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: data: 2024-03-30T15:12:30.120 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: pools: 12 pools, 324 pgs 2024-03-30T15:12:30.120 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: objects: 198 objects, 582 KiB 2024-03-30T15:12:30.120 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: usage: 240 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:12:30.120 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: pgs: 9.259% pgs unknown 2024-03-30T15:12:30.120 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: 50.000% pgs not active 2024-03-30T15:12:30.120 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: 162 creating+peering 2024-03-30T15:12:30.120 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: 132 active+clean 2024-03-30T15:12:30.120 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: 30 unknown 2024-03-30T15:12:30.121 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: 2024-03-30T15:12:30.121 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: io: 2024-03-30T15:12:30.121 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: client: 1.2 KiB/s rd, 1 op/s rd, 0 op/s wr 2024-03-30T15:12:30.121 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: 2024-03-30T15:12:30.121 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: 2024-03-30T15:12:30.121 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: cluster: 2024-03-30T15:12:30.121 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: id: 97f8e564-eea5-11ee-b647-cb9ed24678a4 2024-03-30T15:12:30.121 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: health: HEALTH_WARN 2024-03-30T15:12:30.121 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: 1 stray daemon(s) not managed by cephadm 2024-03-30T15:12:30.121 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: 30 pool(s) do not have an application enabled 2024-03-30T15:12:30.121 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: 2024-03-30T15:12:30.121 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: services: 2024-03-30T15:12:30.121 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 12m) 2024-03-30T15:12:30.121 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: mgr: y(active, since 3m), standbys: x 2024-03-30T15:12:30.122 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: osd: 8 osds: 8 up (since 5m), 8 in (since 5m) 2024-03-30T15:12:30.122 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: foo: 16 portals active (1 hosts, 3 zones) 2024-03-30T15:12:30.122 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: laundry: 1 daemon active (1 hosts) 2024-03-30T15:12:30.122 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: rgw: 1 daemon active (1 hosts, 1 zones) 2024-03-30T15:12:30.122 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: 2024-03-30T15:12:30.122 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: data: 2024-03-30T15:12:30.122 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: pools: 41 pools, 1252 pgs 2024-03-30T15:12:30.122 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: objects: 199 objects, 582 KiB 2024-03-30T15:12:30.122 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: usage: 240 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:12:30.122 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: pgs: 39.377% pgs unknown 2024-03-30T15:12:30.122 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: 43.770% pgs not active 2024-03-30T15:12:30.122 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: 548 creating+peering 2024-03-30T15:12:30.122 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: 493 unknown 2024-03-30T15:12:30.122 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: 211 active+clean 2024-03-30T15:12:30.122 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: 2024-03-30T15:12:30.123 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: io: 2024-03-30T15:12:30.123 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: client: 1.2 KiB/s rd, 127 B/s wr, 1 op/s rd, 0 op/s wr 2024-03-30T15:12:30.123 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: 2024-03-30T15:12:30.123 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: 2024-03-30T15:12:30.123 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: [ OK ] LibRadosService.StatusFormat (10430 ms) 2024-03-30T15:12:30.123 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: [ RUN ] LibRadosService.Status 2024-03-30T15:12:30.123 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: [ OK ] LibRadosService.Status (20047 ms) 2024-03-30T15:12:30.123 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: [----------] 4 tests from LibRadosService (37992 ms total) 2024-03-30T15:12:30.123 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: 2024-03-30T15:12:30.123 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: [----------] Global test environment tear-down 2024-03-30T15:12:30.127 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: [==========] 4 tests from 1 test suite ran. (37992 ms total) 2024-03-30T15:12:30.127 INFO:tasks.workunit.client.0.smithi072.stdout: api_service: [ PASSED ] 4 tests. 2024-03-30T15:12:30.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[21573]: cluster 2024-03-30T15:12:25.852507+0000 mgr.y (mgr.14526) 189 : cluster 0 pgmap v139: 836 pgs: 108 creating+peering, 728 active+clean; 145 MiB data, 740 MiB used, 714 GiB / 715 GiB avail; 9.3 KiB/s rd, 26 KiB/s wr, 23 op/s 2024-03-30T15:12:30.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[21573]: audit 2024-03-30T15:12:27.022849+0000 mon.c (mon.2) 164 : audit 0 from='client.? 172.21.15.72:0/3620299298' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2024-03-30T15:12:30.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[21573]: audit 2024-03-30T15:12:27.505101+0000 mon.a (mon.0) 1072 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:30.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[21573]: audit 2024-03-30T15:12:27.506750+0000 mon.a (mon.0) 1073 : audit 1 from='client.? 172.21.15.72:0/2345721524' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi072-64882-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:12:30.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[21573]: audit 2024-03-30T15:12:27.506801+0000 mon.a (mon.0) 1074 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi072-64478-1"}]': finished 2024-03-30T15:12:30.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[21573]: audit 2024-03-30T15:12:27.506853+0000 mon.a (mon.0) 1075 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi072-64300-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:30.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[21573]: audit 2024-03-30T15:12:27.506911+0000 mon.a (mon.0) 1076 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi072-64403-7"}]': finished 2024-03-30T15:12:30.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[21573]: audit 2024-03-30T15:12:27.506964+0000 mon.a (mon.0) 1077 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi072-64163-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:30.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[21573]: audit 2024-03-30T15:12:27.507041+0000 mon.a (mon.0) 1078 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi072-64444-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:12:30.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[21573]: cluster 2024-03-30T15:12:27.510458+0000 mon.a (mon.0) 1079 : cluster 0 osdmap e94: 8 total, 8 up, 8 in 2024-03-30T15:12:30.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[21573]: audit 2024-03-30T15:12:27.514076+0000 mon.a (mon.0) 1080 : audit 1 from='client.? 172.21.15.72:0/2345721524' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi072-64882-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi072-64882-2"}]: dispatch 2024-03-30T15:12:30.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[21573]: audit 2024-03-30T15:12:27.519637+0000 mon.b (mon.1) 38 : audit 1 from='client.? 172.21.15.72:0/4132408751' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi072-64444-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi072-64444-12"}]: dispatch 2024-03-30T15:12:30.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[21573]: audit 2024-03-30T15:12:27.525182+0000 mon.c (mon.2) 165 : audit 1 from='client.? 172.21.15.72:0/634351624' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi072-64403-7"}]: dispatch 2024-03-30T15:12:30.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[21573]: audit 2024-03-30T15:12:27.525439+0000 mon.c (mon.2) 166 : audit 1 from='client.? 172.21.15.72:0/1833987253' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi072-64300-1","app":"dne","key":"key","value":"value"}]: dispatch 2024-03-30T15:12:30.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[28946]: cluster 2024-03-30T15:12:25.852507+0000 mgr.y (mgr.14526) 189 : cluster 0 pgmap v139: 836 pgs: 108 creating+peering, 728 active+clean; 145 MiB data, 740 MiB used, 714 GiB / 715 GiB avail; 9.3 KiB/s rd, 26 KiB/s wr, 23 op/s 2024-03-30T15:12:30.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[28946]: audit 2024-03-30T15:12:27.022849+0000 mon.c (mon.2) 164 : audit 0 from='client.? 172.21.15.72:0/3620299298' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2024-03-30T15:12:30.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[28946]: audit 2024-03-30T15:12:27.505101+0000 mon.a (mon.0) 1072 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:30.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[28946]: audit 2024-03-30T15:12:27.506750+0000 mon.a (mon.0) 1073 : audit 1 from='client.? 172.21.15.72:0/2345721524' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi072-64882-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:12:30.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[28946]: audit 2024-03-30T15:12:27.506801+0000 mon.a (mon.0) 1074 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi072-64478-1"}]': finished 2024-03-30T15:12:30.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[28946]: audit 2024-03-30T15:12:27.506853+0000 mon.a (mon.0) 1075 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi072-64300-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:30.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[28946]: audit 2024-03-30T15:12:27.506911+0000 mon.a (mon.0) 1076 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi072-64403-7"}]': finished 2024-03-30T15:12:30.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[28946]: audit 2024-03-30T15:12:27.506964+0000 mon.a (mon.0) 1077 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi072-64163-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:30.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[28946]: audit 2024-03-30T15:12:27.507041+0000 mon.a (mon.0) 1078 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi072-64444-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:12:30.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[28946]: cluster 2024-03-30T15:12:27.510458+0000 mon.a (mon.0) 1079 : cluster 0 osdmap e94: 8 total, 8 up, 8 in 2024-03-30T15:12:30.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[28946]: audit 2024-03-30T15:12:27.514076+0000 mon.a (mon.0) 1080 : audit 1 from='client.? 172.21.15.72:0/2345721524' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi072-64882-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi072-64882-2"}]: dispatch 2024-03-30T15:12:30.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[28946]: audit 2024-03-30T15:12:27.519637+0000 mon.b (mon.1) 38 : audit 1 from='client.? 172.21.15.72:0/4132408751' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi072-64444-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi072-64444-12"}]: dispatch 2024-03-30T15:12:30.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[28946]: audit 2024-03-30T15:12:27.525182+0000 mon.c (mon.2) 165 : audit 1 from='client.? 172.21.15.72:0/634351624' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi072-64403-7"}]: dispatch 2024-03-30T15:12:30.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[28946]: audit 2024-03-30T15:12:27.525439+0000 mon.c (mon.2) 166 : audit 1 from='client.? 172.21.15.72:0/1833987253' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi072-64300-1","app":"dne","key":"key","value":"value"}]: dispatch 2024-03-30T15:12:30.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[21573]: audit 2024-03-30T15:12:27.526244+0000 mon.c (mon.2) 167 : audit 1 from='client.? 172.21.15.72:0/1833987253' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi072-64300-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-03-30T15:12:30.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[21573]: audit 2024-03-30T15:12:27.528494+0000 mon.c (mon.2) 168 : audit 1 from='client.? 172.21.15.72:0/2459281314' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi072-64179-16"}]: dispatch 2024-03-30T15:12:30.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[21573]: audit 2024-03-30T15:12:27.528819+0000 mon.a (mon.0) 1081 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi072-64444-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi072-64444-12"}]: dispatch 2024-03-30T15:12:30.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[21573]: audit 2024-03-30T15:12:27.529415+0000 mon.a (mon.0) 1082 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi072-64403-7"}]: dispatch 2024-03-30T15:12:30.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[21573]: audit 2024-03-30T15:12:27.529800+0000 mon.a (mon.0) 1083 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi072-64300-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-03-30T15:12:30.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[21573]: audit 2024-03-30T15:12:27.531192+0000 mon.b (mon.1) 39 : audit 1 from='client.? 172.21.15.72:0/3627454620' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:30.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[21573]: audit 2024-03-30T15:12:27.537359+0000 mon.a (mon.0) 1084 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi072-64179-16"}]: dispatch 2024-03-30T15:12:30.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[21573]: audit 2024-03-30T15:12:27.545729+0000 mon.a (mon.0) 1085 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:30.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[21573]: cluster 2024-03-30T15:12:28.470590+0000 mon.a (mon.0) 1086 : cluster 3 Health check update: 14 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:12:30.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[21573]: cluster 2024-03-30T15:12:28.471440+0000 mon.a (mon.0) 1087 : cluster 3 pool 'PoolQuotaPP_smithi072-64171-3' is full (reached quota's max_bytes: 4 KiB) 2024-03-30T15:12:30.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[21573]: cluster 2024-03-30T15:12:28.475472+0000 mon.a (mon.0) 1088 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-03-30T15:12:30.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[28946]: audit 2024-03-30T15:12:27.526244+0000 mon.c (mon.2) 167 : audit 1 from='client.? 172.21.15.72:0/1833987253' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi072-64300-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-03-30T15:12:30.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[28946]: audit 2024-03-30T15:12:27.528494+0000 mon.c (mon.2) 168 : audit 1 from='client.? 172.21.15.72:0/2459281314' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi072-64179-16"}]: dispatch 2024-03-30T15:12:30.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[28946]: audit 2024-03-30T15:12:27.528819+0000 mon.a (mon.0) 1081 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi072-64444-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi072-64444-12"}]: dispatch 2024-03-30T15:12:30.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[28946]: audit 2024-03-30T15:12:27.529415+0000 mon.a (mon.0) 1082 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi072-64403-7"}]: dispatch 2024-03-30T15:12:30.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[28946]: audit 2024-03-30T15:12:27.529800+0000 mon.a (mon.0) 1083 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi072-64300-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-03-30T15:12:30.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[28946]: audit 2024-03-30T15:12:27.531192+0000 mon.b (mon.1) 39 : audit 1 from='client.? 172.21.15.72:0/3627454620' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:30.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[28946]: audit 2024-03-30T15:12:27.537359+0000 mon.a (mon.0) 1084 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi072-64179-16"}]: dispatch 2024-03-30T15:12:30.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[28946]: audit 2024-03-30T15:12:27.545729+0000 mon.a (mon.0) 1085 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:30.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[28946]: cluster 2024-03-30T15:12:28.470590+0000 mon.a (mon.0) 1086 : cluster 3 Health check update: 14 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:12:30.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[28946]: cluster 2024-03-30T15:12:28.471440+0000 mon.a (mon.0) 1087 : cluster 3 pool 'PoolQuotaPP_smithi072-64171-3' is full (reached quota's max_bytes: 4 KiB) 2024-03-30T15:12:30.172 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:29 smithi072 bash[28946]: cluster 2024-03-30T15:12:28.475472+0000 mon.a (mon.0) 1088 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-03-30T15:12:30.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:29 smithi172 bash[23680]: cluster 2024-03-30T15:12:25.852507+0000 mgr.y (mgr.14526) 189 : cluster 0 pgmap v139: 836 pgs: 108 creating+peering, 728 active+clean; 145 MiB data, 740 MiB used, 714 GiB / 715 GiB avail; 9.3 KiB/s rd, 26 KiB/s wr, 23 op/s 2024-03-30T15:12:30.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:29 smithi172 bash[23680]: audit 2024-03-30T15:12:27.022849+0000 mon.c (mon.2) 164 : audit 0 from='client.? 172.21.15.72:0/3620299298' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2024-03-30T15:12:30.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:29 smithi172 bash[23680]: audit 2024-03-30T15:12:27.505101+0000 mon.a (mon.0) 1072 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:30.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:29 smithi172 bash[23680]: audit 2024-03-30T15:12:27.506750+0000 mon.a (mon.0) 1073 : audit 1 from='client.? 172.21.15.72:0/2345721524' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi072-64882-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:12:30.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:29 smithi172 bash[23680]: audit 2024-03-30T15:12:27.506801+0000 mon.a (mon.0) 1074 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi072-64478-1"}]': finished 2024-03-30T15:12:30.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:29 smithi172 bash[23680]: audit 2024-03-30T15:12:27.506853+0000 mon.a (mon.0) 1075 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi072-64300-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:30.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:29 smithi172 bash[23680]: audit 2024-03-30T15:12:27.506911+0000 mon.a (mon.0) 1076 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi072-64403-7"}]': finished 2024-03-30T15:12:30.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:29 smithi172 bash[23680]: audit 2024-03-30T15:12:27.506964+0000 mon.a (mon.0) 1077 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi072-64163-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:30.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:29 smithi172 bash[23680]: audit 2024-03-30T15:12:27.507041+0000 mon.a (mon.0) 1078 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi072-64444-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:12:30.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:29 smithi172 bash[23680]: cluster 2024-03-30T15:12:27.510458+0000 mon.a (mon.0) 1079 : cluster 0 osdmap e94: 8 total, 8 up, 8 in 2024-03-30T15:12:30.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:29 smithi172 bash[23680]: audit 2024-03-30T15:12:27.514076+0000 mon.a (mon.0) 1080 : audit 1 from='client.? 172.21.15.72:0/2345721524' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi072-64882-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi072-64882-2"}]: dispatch 2024-03-30T15:12:30.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:29 smithi172 bash[23680]: audit 2024-03-30T15:12:27.519637+0000 mon.b (mon.1) 38 : audit 1 from='client.? 172.21.15.72:0/4132408751' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi072-64444-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi072-64444-12"}]: dispatch 2024-03-30T15:12:30.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:29 smithi172 bash[23680]: audit 2024-03-30T15:12:27.525182+0000 mon.c (mon.2) 165 : audit 1 from='client.? 172.21.15.72:0/634351624' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi072-64403-7"}]: dispatch 2024-03-30T15:12:30.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:29 smithi172 bash[23680]: audit 2024-03-30T15:12:27.525439+0000 mon.c (mon.2) 166 : audit 1 from='client.? 172.21.15.72:0/1833987253' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi072-64300-1","app":"dne","key":"key","value":"value"}]: dispatch 2024-03-30T15:12:30.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:29 smithi172 bash[23680]: audit 2024-03-30T15:12:27.526244+0000 mon.c (mon.2) 167 : audit 1 from='client.? 172.21.15.72:0/1833987253' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi072-64300-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-03-30T15:12:30.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:29 smithi172 bash[23680]: audit 2024-03-30T15:12:27.528494+0000 mon.c (mon.2) 168 : audit 1 from='client.? 172.21.15.72:0/2459281314' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi072-64179-16"}]: dispatch 2024-03-30T15:12:30.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:29 smithi172 bash[23680]: audit 2024-03-30T15:12:27.528819+0000 mon.a (mon.0) 1081 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi072-64444-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi072-64444-12"}]: dispatch 2024-03-30T15:12:30.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:29 smithi172 bash[23680]: audit 2024-03-30T15:12:27.529415+0000 mon.a (mon.0) 1082 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi072-64403-7"}]: dispatch 2024-03-30T15:12:30.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:29 smithi172 bash[23680]: audit 2024-03-30T15:12:27.529800+0000 mon.a (mon.0) 1083 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi072-64300-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-03-30T15:12:30.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:29 smithi172 bash[23680]: audit 2024-03-30T15:12:27.531192+0000 mon.b (mon.1) 39 : audit 1 from='client.? 172.21.15.72:0/3627454620' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:30.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:29 smithi172 bash[23680]: audit 2024-03-30T15:12:27.537359+0000 mon.a (mon.0) 1084 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi072-64179-16"}]: dispatch 2024-03-30T15:12:30.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:29 smithi172 bash[23680]: audit 2024-03-30T15:12:27.545729+0000 mon.a (mon.0) 1085 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:30.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:29 smithi172 bash[23680]: cluster 2024-03-30T15:12:28.470590+0000 mon.a (mon.0) 1086 : cluster 3 Health check update: 14 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:12:30.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:29 smithi172 bash[23680]: cluster 2024-03-30T15:12:28.471440+0000 mon.a (mon.0) 1087 : cluster 3 pool 'PoolQuotaPP_smithi072-64171-3' is full (reached quota's max_bytes: 4 KiB) 2024-03-30T15:12:30.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:29 smithi172 bash[23680]: cluster 2024-03-30T15:12:28.475472+0000 mon.a (mon.0) 1088 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-03-30T15:12:31.416 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:12:31 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:12:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:12:31.466 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:12:30 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:12:31.609 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: Running main() from gmock_main.cc 2024-03-30T15:12:31.609 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [==========] Running 24 tests from 2 test suites. 2024-03-30T15:12:31.609 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [----------] Global test environment set-up. 2024-03-30T15:12:31.609 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [----------] 14 tests from LibRadosIo 2024-03-30T15:12:31.609 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ RUN ] LibRadosIo.SimpleWrite 2024-03-30T15:12:31.610 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ OK ] LibRadosIo.SimpleWrite (98 ms) 2024-03-30T15:12:31.610 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ RUN ] LibRadosIo.TooBig 2024-03-30T15:12:31.610 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ OK ] LibRadosIo.TooBig (0 ms) 2024-03-30T15:12:31.610 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ RUN ] LibRadosIo.ReadTimeout 2024-03-30T15:12:31.610 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: no timeout :/ 2024-03-30T15:12:31.610 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: no timeout :/ 2024-03-30T15:12:31.610 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: no timeout :/ 2024-03-30T15:12:31.610 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: no timeout :/ 2024-03-30T15:12:31.610 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: no timeout :/ 2024-03-30T15:12:31.610 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ OK ] LibRadosIo.ReadTimeout (65 ms) 2024-03-30T15:12:31.610 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ RUN ] LibRadosIo.RoundTrip 2024-03-30T15:12:31.611 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ OK ] LibRadosIo.RoundTrip (5 ms) 2024-03-30T15:12:31.611 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ RUN ] LibRadosIo.Checksum 2024-03-30T15:12:31.611 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ OK ] LibRadosIo.Checksum (5 ms) 2024-03-30T15:12:31.611 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2024-03-30T15:12:31.611 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ OK ] LibRadosIo.OverlappingWriteRoundTrip (6 ms) 2024-03-30T15:12:31.611 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ RUN ] LibRadosIo.WriteFullRoundTrip 2024-03-30T15:12:31.611 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ OK ] LibRadosIo.WriteFullRoundTrip (2 ms) 2024-03-30T15:12:31.611 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ RUN ] LibRadosIo.AppendRoundTrip 2024-03-30T15:12:31.611 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ OK ] LibRadosIo.AppendRoundTrip (5 ms) 2024-03-30T15:12:31.611 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ RUN ] LibRadosIo.ZeroLenZero 2024-03-30T15:12:31.611 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ OK ] LibRadosIo.ZeroLenZero (1 ms) 2024-03-30T15:12:31.611 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ RUN ] LibRadosIo.TruncTest 2024-03-30T15:12:31.611 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ OK ] LibRadosIo.TruncTest (4 ms) 2024-03-30T15:12:31.611 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ RUN ] LibRadosIo.RemoveTest 2024-03-30T15:12:31.611 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ OK ] LibRadosIo.RemoveTest (3 ms) 2024-03-30T15:12:31.612 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ RUN ] LibRadosIo.XattrsRoundTrip 2024-03-30T15:12:31.612 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ OK ] LibRadosIo.XattrsRoundTrip (2 ms) 2024-03-30T15:12:31.612 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ RUN ] LibRadosIo.RmXattr 2024-03-30T15:12:31.612 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ OK ] LibRadosIo.RmXattr (8 ms) 2024-03-30T15:12:31.612 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ RUN ] LibRadosIo.XattrIter 2024-03-30T15:12:31.612 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ OK ] LibRadosIo.XattrIter (3 ms) 2024-03-30T15:12:31.612 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [----------] 14 tests from LibRadosIo (207 ms total) 2024-03-30T15:12:31.612 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: 2024-03-30T15:12:31.612 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [----------] 10 tests from LibRadosIoEC 2024-03-30T15:12:31.612 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ RUN ] LibRadosIoEC.SimpleWrite 2024-03-30T15:12:31.612 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ OK ] LibRadosIoEC.SimpleWrite (2722 ms) 2024-03-30T15:12:31.612 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ RUN ] LibRadosIoEC.RoundTrip 2024-03-30T15:12:31.612 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ OK ] LibRadosIoEC.RoundTrip (20 ms) 2024-03-30T15:12:31.612 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2024-03-30T15:12:31.612 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ OK ] LibRadosIoEC.OverlappingWriteRoundTrip (4 ms) 2024-03-30T15:12:31.613 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ RUN ] LibRadosIoEC.WriteFullRoundTrip 2024-03-30T15:12:31.613 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ OK ] LibRadosIoEC.WriteFullRoundTrip (6 ms) 2024-03-30T15:12:31.613 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ RUN ] LibRadosIoEC.AppendRoundTrip 2024-03-30T15:12:31.613 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ OK ] LibRadosIoEC.AppendRoundTrip (9 ms) 2024-03-30T15:12:31.613 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ RUN ] LibRadosIoEC.TruncTest 2024-03-30T15:12:31.613 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ OK ] LibRadosIoEC.TruncTest (4 ms) 2024-03-30T15:12:31.613 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ RUN ] LibRadosIoEC.RemoveTest 2024-03-30T15:12:31.613 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ OK ] LibRadosIoEC.RemoveTest (3 ms) 2024-03-30T15:12:31.613 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ RUN ] LibRadosIoEC.XattrsRoundTrip 2024-03-30T15:12:31.613 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ OK ] LibRadosIoEC.XattrsRoundTrip (4 ms) 2024-03-30T15:12:31.613 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ RUN ] LibRadosIoEC.RmXattr 2024-03-30T15:12:31.613 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ OK ] LibRadosIoEC.RmXattr (8 ms) 2024-03-30T15:12:31.613 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ RUN ] LibRadosIoEC.XattrIter 2024-03-30T15:12:31.613 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ OK ] LibRadosIoEC.XattrIter (4 ms) 2024-03-30T15:12:31.614 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [----------] 10 tests from LibRadosIoEC (2784 ms total) 2024-03-30T15:12:31.614 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: 2024-03-30T15:12:31.614 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [----------] Global test environment tear-down 2024-03-30T15:12:31.614 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [==========] 24 tests from 2 test suites ran. (39667 ms total) 2024-03-30T15:12:31.614 INFO:tasks.workunit.client.0.smithi072.stdout: api_io: [ PASSED ] 24 tests. 2024-03-30T15:12:31.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:31 smithi072 bash[21573]: audit 2024-03-30T15:12:27.023062+0000 mgr.y (mgr.14526) 190 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-03-30T15:12:31.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:31 smithi072 bash[21573]: cluster 2024-03-30T15:12:27.853314+0000 mgr.y (mgr.14526) 191 : cluster 0 pgmap v142: 708 pgs: 144 unknown, 76 creating+peering, 488 active+clean; 145 MiB data, 740 MiB used, 714 GiB / 715 GiB avail; 2.1 KiB/s rd, 6.2 KiB/s wr, 5 op/s 2024-03-30T15:12:31.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:31 smithi072 bash[21573]: audit 2024-03-30T15:12:28.479128+0000 mon.a (mon.0) 1089 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi072-64403-7"}]': finished 2024-03-30T15:12:31.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:31 smithi072 bash[21573]: audit 2024-03-30T15:12:28.479260+0000 mon.a (mon.0) 1090 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi072-64300-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-03-30T15:12:31.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:31 smithi072 bash[21573]: audit 2024-03-30T15:12:28.479377+0000 mon.a (mon.0) 1091 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi072-64179-16"}]': finished 2024-03-30T15:12:31.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:31 smithi072 bash[21573]: audit 2024-03-30T15:12:28.479476+0000 mon.a (mon.0) 1092 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:31.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:31 smithi072 bash[21573]: audit 2024-03-30T15:12:28.495769+0000 mon.c (mon.2) 169 : audit 1 from='client.? 172.21.15.72:0/2459281314' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi072-64179-16"}]: dispatch 2024-03-30T15:12:31.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:31 smithi072 bash[21573]: audit 2024-03-30T15:12:28.505862+0000 mon.c (mon.2) 170 : audit 1 from='client.? 172.21.15.72:0/1833987253' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi072-64300-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-03-30T15:12:31.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:31 smithi072 bash[21573]: cluster 2024-03-30T15:12:29.796669+0000 mon.a (mon.0) 1093 : cluster 0 osdmap e95: 8 total, 8 up, 8 in 2024-03-30T15:12:31.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:31 smithi072 bash[21573]: audit 2024-03-30T15:12:29.802915+0000 mon.a (mon.0) 1094 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:31.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:31 smithi072 bash[21573]: audit 2024-03-30T15:12:29.815025+0000 mon.a (mon.0) 1095 : audit 1 from='client.? 172.21.15.72:0/1633994099' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi072-64841-2"}]: dispatch 2024-03-30T15:12:31.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:31 smithi072 bash[21573]: audit 2024-03-30T15:12:29.818870+0000 mon.a (mon.0) 1096 : audit 1 from='client.? 172.21.15.72:0/2345721524' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi072-64882-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi072-64882-2"}]': finished 2024-03-30T15:12:31.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:31 smithi072 bash[21573]: audit 2024-03-30T15:12:29.818938+0000 mon.a (mon.0) 1097 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi072-64444-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi072-64444-12"}]': finished 2024-03-30T15:12:31.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:31 smithi072 bash[21573]: cluster 2024-03-30T15:12:29.826909+0000 mon.a (mon.0) 1098 : cluster 0 osdmap e96: 8 total, 8 up, 8 in 2024-03-30T15:12:31.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:31 smithi072 bash[21573]: audit 2024-03-30T15:12:29.829378+0000 mon.c (mon.2) 171 : audit 1 from='client.? 172.21.15.72:0/4226267530' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi072-64478-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:31.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:31 smithi072 bash[21573]: audit 2024-03-30T15:12:29.842150+0000 mon.a (mon.0) 1099 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi072-64179-16"}]: dispatch 2024-03-30T15:12:31.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:31 smithi072 bash[21573]: audit 2024-03-30T15:12:29.842551+0000 mon.a (mon.0) 1100 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi072-64300-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-03-30T15:12:31.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:31 smithi072 bash[28946]: audit 2024-03-30T15:12:27.023062+0000 mgr.y (mgr.14526) 190 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-03-30T15:12:31.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:31 smithi072 bash[28946]: cluster 2024-03-30T15:12:27.853314+0000 mgr.y (mgr.14526) 191 : cluster 0 pgmap v142: 708 pgs: 144 unknown, 76 creating+peering, 488 active+clean; 145 MiB data, 740 MiB used, 714 GiB / 715 GiB avail; 2.1 KiB/s rd, 6.2 KiB/s wr, 5 op/s 2024-03-30T15:12:31.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:31 smithi072 bash[28946]: audit 2024-03-30T15:12:28.479128+0000 mon.a (mon.0) 1089 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi072-64403-7"}]': finished 2024-03-30T15:12:31.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:31 smithi072 bash[28946]: audit 2024-03-30T15:12:28.479260+0000 mon.a (mon.0) 1090 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi072-64300-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-03-30T15:12:31.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:31 smithi072 bash[28946]: audit 2024-03-30T15:12:28.479377+0000 mon.a (mon.0) 1091 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi072-64179-16"}]': finished 2024-03-30T15:12:31.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:31 smithi072 bash[28946]: audit 2024-03-30T15:12:28.479476+0000 mon.a (mon.0) 1092 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:31.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:31 smithi072 bash[28946]: audit 2024-03-30T15:12:28.495769+0000 mon.c (mon.2) 169 : audit 1 from='client.? 172.21.15.72:0/2459281314' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi072-64179-16"}]: dispatch 2024-03-30T15:12:31.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:31 smithi072 bash[28946]: audit 2024-03-30T15:12:28.505862+0000 mon.c (mon.2) 170 : audit 1 from='client.? 172.21.15.72:0/1833987253' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi072-64300-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-03-30T15:12:31.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:31 smithi072 bash[28946]: cluster 2024-03-30T15:12:29.796669+0000 mon.a (mon.0) 1093 : cluster 0 osdmap e95: 8 total, 8 up, 8 in 2024-03-30T15:12:31.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:31 smithi072 bash[28946]: audit 2024-03-30T15:12:29.802915+0000 mon.a (mon.0) 1094 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:31.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:31 smithi072 bash[28946]: audit 2024-03-30T15:12:29.815025+0000 mon.a (mon.0) 1095 : audit 1 from='client.? 172.21.15.72:0/1633994099' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi072-64841-2"}]: dispatch 2024-03-30T15:12:31.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:31 smithi072 bash[28946]: audit 2024-03-30T15:12:29.818870+0000 mon.a (mon.0) 1096 : audit 1 from='client.? 172.21.15.72:0/2345721524' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi072-64882-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi072-64882-2"}]': finished 2024-03-30T15:12:31.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:31 smithi072 bash[28946]: audit 2024-03-30T15:12:29.818938+0000 mon.a (mon.0) 1097 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi072-64444-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi072-64444-12"}]': finished 2024-03-30T15:12:31.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:31 smithi072 bash[28946]: cluster 2024-03-30T15:12:29.826909+0000 mon.a (mon.0) 1098 : cluster 0 osdmap e96: 8 total, 8 up, 8 in 2024-03-30T15:12:31.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:31 smithi072 bash[28946]: audit 2024-03-30T15:12:29.829378+0000 mon.c (mon.2) 171 : audit 1 from='client.? 172.21.15.72:0/4226267530' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi072-64478-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:31.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:31 smithi072 bash[28946]: audit 2024-03-30T15:12:29.842150+0000 mon.a (mon.0) 1099 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi072-64179-16"}]: dispatch 2024-03-30T15:12:31.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:31 smithi072 bash[28946]: audit 2024-03-30T15:12:29.842551+0000 mon.a (mon.0) 1100 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi072-64300-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-03-30T15:12:31.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:31 smithi172 bash[23680]: audit 2024-03-30T15:12:27.023062+0000 mgr.y (mgr.14526) 190 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-03-30T15:12:31.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:31 smithi172 bash[23680]: cluster 2024-03-30T15:12:27.853314+0000 mgr.y (mgr.14526) 191 : cluster 0 pgmap v142: 708 pgs: 144 unknown, 76 creating+peering, 488 active+clean; 145 MiB data, 740 MiB used, 714 GiB / 715 GiB avail; 2.1 KiB/s rd, 6.2 KiB/s wr, 5 op/s 2024-03-30T15:12:31.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:31 smithi172 bash[23680]: audit 2024-03-30T15:12:28.479128+0000 mon.a (mon.0) 1089 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi072-64403-7"}]': finished 2024-03-30T15:12:31.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:31 smithi172 bash[23680]: audit 2024-03-30T15:12:28.479260+0000 mon.a (mon.0) 1090 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi072-64300-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-03-30T15:12:31.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:31 smithi172 bash[23680]: audit 2024-03-30T15:12:28.479377+0000 mon.a (mon.0) 1091 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi072-64179-16"}]': finished 2024-03-30T15:12:31.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:31 smithi172 bash[23680]: audit 2024-03-30T15:12:28.479476+0000 mon.a (mon.0) 1092 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:31.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:31 smithi172 bash[23680]: audit 2024-03-30T15:12:28.495769+0000 mon.c (mon.2) 169 : audit 1 from='client.? 172.21.15.72:0/2459281314' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi072-64179-16"}]: dispatch 2024-03-30T15:12:31.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:31 smithi172 bash[23680]: audit 2024-03-30T15:12:28.505862+0000 mon.c (mon.2) 170 : audit 1 from='client.? 172.21.15.72:0/1833987253' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi072-64300-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-03-30T15:12:31.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:31 smithi172 bash[23680]: cluster 2024-03-30T15:12:29.796669+0000 mon.a (mon.0) 1093 : cluster 0 osdmap e95: 8 total, 8 up, 8 in 2024-03-30T15:12:31.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:31 smithi172 bash[23680]: audit 2024-03-30T15:12:29.802915+0000 mon.a (mon.0) 1094 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:31.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:31 smithi172 bash[23680]: audit 2024-03-30T15:12:29.815025+0000 mon.a (mon.0) 1095 : audit 1 from='client.? 172.21.15.72:0/1633994099' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi072-64841-2"}]: dispatch 2024-03-30T15:12:31.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:31 smithi172 bash[23680]: audit 2024-03-30T15:12:29.818870+0000 mon.a (mon.0) 1096 : audit 1 from='client.? 172.21.15.72:0/2345721524' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi072-64882-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi072-64882-2"}]': finished 2024-03-30T15:12:31.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:31 smithi172 bash[23680]: audit 2024-03-30T15:12:29.818938+0000 mon.a (mon.0) 1097 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi072-64444-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi072-64444-12"}]': finished 2024-03-30T15:12:31.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:31 smithi172 bash[23680]: cluster 2024-03-30T15:12:29.826909+0000 mon.a (mon.0) 1098 : cluster 0 osdmap e96: 8 total, 8 up, 8 in 2024-03-30T15:12:31.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:31 smithi172 bash[23680]: audit 2024-03-30T15:12:29.829378+0000 mon.c (mon.2) 171 : audit 1 from='client.? 172.21.15.72:0/4226267530' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi072-64478-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:31.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:31 smithi172 bash[23680]: audit 2024-03-30T15:12:29.842150+0000 mon.a (mon.0) 1099 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi072-64179-16"}]: dispatch 2024-03-30T15:12:31.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:31 smithi172 bash[23680]: audit 2024-03-30T15:12:29.842551+0000 mon.a (mon.0) 1100 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi072-64300-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-03-30T15:12:32.592 INFO:tasks.workunit.client.0.smithi072.stdout: ec_io: Running main() from gmock_main.cc 2024-03-30T15:12:32.592 INFO:tasks.workunit.client.0.smithi072.stdout: ec_io: [==========] Running 2 tests from 1 test suite. 2024-03-30T15:12:32.593 INFO:tasks.workunit.client.0.smithi072.stdout: ec_io: [----------] Global test environment set-up. 2024-03-30T15:12:32.593 INFO:tasks.workunit.client.0.smithi072.stdout: ec_io: [----------] 2 tests from NeoRadosECIo 2024-03-30T15:12:32.593 INFO:tasks.workunit.client.0.smithi072.stdout: ec_io: [ RUN ] NeoRadosECIo.SimpleWrite 2024-03-30T15:12:32.593 INFO:tasks.workunit.client.0.smithi072.stdout: ec_io: [ OK ] NeoRadosECIo.SimpleWrite (27226 ms) 2024-03-30T15:12:32.593 INFO:tasks.workunit.client.0.smithi072.stdout: ec_io: [ RUN ] NeoRadosECIo.ReadOp 2024-03-30T15:12:32.593 INFO:tasks.workunit.client.0.smithi072.stdout: ec_io: [ OK ] NeoRadosECIo.ReadOp (13106 ms) 2024-03-30T15:12:32.593 INFO:tasks.workunit.client.0.smithi072.stdout: ec_io: [----------] 2 tests from NeoRadosECIo (40332 ms total) 2024-03-30T15:12:32.593 INFO:tasks.workunit.client.0.smithi072.stdout: ec_io: 2024-03-30T15:12:32.593 INFO:tasks.workunit.client.0.smithi072.stdout: ec_io: [----------] Global test environment tear-down 2024-03-30T15:12:32.593 INFO:tasks.workunit.client.0.smithi072.stdout: ec_io: [==========] 2 tests from 1 test suite ran. (40333 ms total) 2024-03-30T15:12:32.593 INFO:tasks.workunit.client.0.smithi072.stdout: ec_io: [ PASSED ] 2 tests. 2024-03-30T15:12:32.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:32 smithi072 bash[21573]: cluster 2024-03-30T15:12:29.860049+0000 mgr.y (mgr.14526) 192 : cluster 0 pgmap v145: 652 pgs: 224 unknown, 7 creating+peering, 421 active+clean; 145 MiB data, 740 MiB used, 714 GiB / 715 GiB avail 2024-03-30T15:12:32.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:32 smithi072 bash[21573]: audit 2024-03-30T15:12:30.973569+0000 mgr.y (mgr.14526) 193 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:12:32.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:32 smithi072 bash[21573]: audit 2024-03-30T15:12:31.573375+0000 mon.a (mon.0) 1101 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:32.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:32 smithi072 bash[21573]: audit 2024-03-30T15:12:31.576026+0000 mon.a (mon.0) 1102 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi072-64478-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:32.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:32 smithi072 bash[21573]: audit 2024-03-30T15:12:31.576596+0000 mon.a (mon.0) 1103 : audit 1 from='client.? 172.21.15.72:0/1633994099' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi072-64841-2"}]': finished 2024-03-30T15:12:32.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:32 smithi072 bash[21573]: audit 2024-03-30T15:12:31.576738+0000 mon.a (mon.0) 1104 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi072-64179-16"}]': finished 2024-03-30T15:12:32.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:32 smithi072 bash[21573]: audit 2024-03-30T15:12:31.576911+0000 mon.a (mon.0) 1105 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi072-64300-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-03-30T15:12:32.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:32 smithi072 bash[21573]: cluster 2024-03-30T15:12:31.588104+0000 mon.a (mon.0) 1106 : cluster 0 osdmap e97: 8 total, 8 up, 8 in 2024-03-30T15:12:32.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:32 smithi072 bash[21573]: audit 2024-03-30T15:12:31.596639+0000 mon.a (mon.0) 1107 : audit 1 from='client.? 172.21.15.72:0/1633994099' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi072-64841-2"}]: dispatch 2024-03-30T15:12:32.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:32 smithi072 bash[21573]: audit 2024-03-30T15:12:31.606274+0000 mon.a (mon.0) 1108 : audit 1 from='client.? 172.21.15.72:0/3101006435' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi072-64256-10"}]: dispatch 2024-03-30T15:12:32.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:32 smithi072 bash[21573]: audit 2024-03-30T15:12:31.606669+0000 mon.a (mon.0) 1109 : audit 1 from='client.? 172.21.15.72:0/1523337604' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:32.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:32 smithi072 bash[21573]: audit 2024-03-30T15:12:31.608778+0000 mon.c (mon.2) 172 : audit 1 from='client.? 172.21.15.72:0/1833987253' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi072-64300-1","app":"app1","key":"key1"}]: dispatch 2024-03-30T15:12:32.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:32 smithi072 bash[21573]: audit 2024-03-30T15:12:31.609620+0000 mon.c (mon.2) 173 : audit 1 from='client.? 172.21.15.72:0/459372695' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi072-64425-7"}]: dispatch 2024-03-30T15:12:32.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:32 smithi072 bash[21573]: audit 2024-03-30T15:12:31.611727+0000 mon.a (mon.0) 1110 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi072-64300-1","app":"app1","key":"key1"}]: dispatch 2024-03-30T15:12:32.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:32 smithi072 bash[21573]: audit 2024-03-30T15:12:31.612179+0000 mon.a (mon.0) 1111 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi072-64425-7"}]: dispatch 2024-03-30T15:12:32.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:32 smithi072 bash[21573]: audit 2024-03-30T15:12:32.527521+0000 mon.a (mon.0) 1112 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:12:32.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:32 smithi072 bash[21573]: audit 2024-03-30T15:12:32.529818+0000 mon.c (mon.2) 174 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:12:32.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:32 smithi072 bash[28946]: cluster 2024-03-30T15:12:29.860049+0000 mgr.y (mgr.14526) 192 : cluster 0 pgmap v145: 652 pgs: 224 unknown, 7 creating+peering, 421 active+clean; 145 MiB data, 740 MiB used, 714 GiB / 715 GiB avail 2024-03-30T15:12:32.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:32 smithi072 bash[28946]: audit 2024-03-30T15:12:30.973569+0000 mgr.y (mgr.14526) 193 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:12:32.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:32 smithi072 bash[28946]: audit 2024-03-30T15:12:31.573375+0000 mon.a (mon.0) 1101 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:32.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:32 smithi072 bash[28946]: audit 2024-03-30T15:12:31.576026+0000 mon.a (mon.0) 1102 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi072-64478-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:32.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:32 smithi072 bash[28946]: audit 2024-03-30T15:12:31.576596+0000 mon.a (mon.0) 1103 : audit 1 from='client.? 172.21.15.72:0/1633994099' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi072-64841-2"}]': finished 2024-03-30T15:12:32.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:32 smithi072 bash[28946]: audit 2024-03-30T15:12:31.576738+0000 mon.a (mon.0) 1104 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi072-64179-16"}]': finished 2024-03-30T15:12:32.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:32 smithi072 bash[28946]: audit 2024-03-30T15:12:31.576911+0000 mon.a (mon.0) 1105 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi072-64300-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-03-30T15:12:32.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:32 smithi072 bash[28946]: cluster 2024-03-30T15:12:31.588104+0000 mon.a (mon.0) 1106 : cluster 0 osdmap e97: 8 total, 8 up, 8 in 2024-03-30T15:12:32.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:32 smithi072 bash[28946]: audit 2024-03-30T15:12:31.596639+0000 mon.a (mon.0) 1107 : audit 1 from='client.? 172.21.15.72:0/1633994099' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi072-64841-2"}]: dispatch 2024-03-30T15:12:32.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:32 smithi072 bash[28946]: audit 2024-03-30T15:12:31.606274+0000 mon.a (mon.0) 1108 : audit 1 from='client.? 172.21.15.72:0/3101006435' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi072-64256-10"}]: dispatch 2024-03-30T15:12:32.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:32 smithi072 bash[28946]: audit 2024-03-30T15:12:31.606669+0000 mon.a (mon.0) 1109 : audit 1 from='client.? 172.21.15.72:0/1523337604' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:32.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:32 smithi072 bash[28946]: audit 2024-03-30T15:12:31.608778+0000 mon.c (mon.2) 172 : audit 1 from='client.? 172.21.15.72:0/1833987253' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi072-64300-1","app":"app1","key":"key1"}]: dispatch 2024-03-30T15:12:32.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:32 smithi072 bash[28946]: audit 2024-03-30T15:12:31.609620+0000 mon.c (mon.2) 173 : audit 1 from='client.? 172.21.15.72:0/459372695' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi072-64425-7"}]: dispatch 2024-03-30T15:12:32.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:32 smithi072 bash[28946]: audit 2024-03-30T15:12:31.611727+0000 mon.a (mon.0) 1110 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi072-64300-1","app":"app1","key":"key1"}]: dispatch 2024-03-30T15:12:32.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:32 smithi072 bash[28946]: audit 2024-03-30T15:12:31.612179+0000 mon.a (mon.0) 1111 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi072-64425-7"}]: dispatch 2024-03-30T15:12:32.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:32 smithi072 bash[28946]: audit 2024-03-30T15:12:32.527521+0000 mon.a (mon.0) 1112 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:12:32.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:32 smithi072 bash[28946]: audit 2024-03-30T15:12:32.529818+0000 mon.c (mon.2) 174 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:12:32.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:32 smithi172 bash[23680]: cluster 2024-03-30T15:12:29.860049+0000 mgr.y (mgr.14526) 192 : cluster 0 pgmap v145: 652 pgs: 224 unknown, 7 creating+peering, 421 active+clean; 145 MiB data, 740 MiB used, 714 GiB / 715 GiB avail 2024-03-30T15:12:32.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:32 smithi172 bash[23680]: audit 2024-03-30T15:12:30.973569+0000 mgr.y (mgr.14526) 193 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:12:32.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:32 smithi172 bash[23680]: audit 2024-03-30T15:12:31.573375+0000 mon.a (mon.0) 1101 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:32.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:32 smithi172 bash[23680]: audit 2024-03-30T15:12:31.576026+0000 mon.a (mon.0) 1102 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi072-64478-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:32.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:32 smithi172 bash[23680]: audit 2024-03-30T15:12:31.576596+0000 mon.a (mon.0) 1103 : audit 1 from='client.? 172.21.15.72:0/1633994099' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi072-64841-2"}]': finished 2024-03-30T15:12:32.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:32 smithi172 bash[23680]: audit 2024-03-30T15:12:31.576738+0000 mon.a (mon.0) 1104 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi072-64179-16"}]': finished 2024-03-30T15:12:32.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:32 smithi172 bash[23680]: audit 2024-03-30T15:12:31.576911+0000 mon.a (mon.0) 1105 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi072-64300-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-03-30T15:12:32.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:32 smithi172 bash[23680]: cluster 2024-03-30T15:12:31.588104+0000 mon.a (mon.0) 1106 : cluster 0 osdmap e97: 8 total, 8 up, 8 in 2024-03-30T15:12:32.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:32 smithi172 bash[23680]: audit 2024-03-30T15:12:31.596639+0000 mon.a (mon.0) 1107 : audit 1 from='client.? 172.21.15.72:0/1633994099' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi072-64841-2"}]: dispatch 2024-03-30T15:12:32.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:32 smithi172 bash[23680]: audit 2024-03-30T15:12:31.606274+0000 mon.a (mon.0) 1108 : audit 1 from='client.? 172.21.15.72:0/3101006435' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi072-64256-10"}]: dispatch 2024-03-30T15:12:32.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:32 smithi172 bash[23680]: audit 2024-03-30T15:12:31.606669+0000 mon.a (mon.0) 1109 : audit 1 from='client.? 172.21.15.72:0/1523337604' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:32.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:32 smithi172 bash[23680]: audit 2024-03-30T15:12:31.608778+0000 mon.c (mon.2) 172 : audit 1 from='client.? 172.21.15.72:0/1833987253' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi072-64300-1","app":"app1","key":"key1"}]: dispatch 2024-03-30T15:12:32.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:32 smithi172 bash[23680]: audit 2024-03-30T15:12:31.609620+0000 mon.c (mon.2) 173 : audit 1 from='client.? 172.21.15.72:0/459372695' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi072-64425-7"}]: dispatch 2024-03-30T15:12:32.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:32 smithi172 bash[23680]: audit 2024-03-30T15:12:31.611727+0000 mon.a (mon.0) 1110 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi072-64300-1","app":"app1","key":"key1"}]: dispatch 2024-03-30T15:12:32.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:32 smithi172 bash[23680]: audit 2024-03-30T15:12:31.612179+0000 mon.a (mon.0) 1111 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi072-64425-7"}]: dispatch 2024-03-30T15:12:32.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:32 smithi172 bash[23680]: audit 2024-03-30T15:12:32.527521+0000 mon.a (mon.0) 1112 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:12:32.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:32 smithi172 bash[23680]: audit 2024-03-30T15:12:32.529818+0000 mon.c (mon.2) 174 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:12:33.747 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock_pp: Running main() from gmock_main.cc 2024-03-30T15:12:33.747 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock_pp: [==========] Running 16 tests from 2 test suites. 2024-03-30T15:12:33.747 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock_pp: [----------] Global test environment set-up. 2024-03-30T15:12:33.747 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP 2024-03-30T15:12:33.747 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock_pp: seed 64256 2024-03-30T15:12:33.748 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusivePP 2024-03-30T15:12:33.748 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusivePP (15 ms) 2024-03-30T15:12:33.748 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedPP 2024-03-30T15:12:33.748 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedPP (54 ms) 2024-03-30T15:12:33.748 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusiveDurPP 2024-03-30T15:12:33.748 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusiveDurPP (1032 ms) 2024-03-30T15:12:33.748 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedDurPP 2024-03-30T15:12:33.748 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedDurPP (1014 ms) 2024-03-30T15:12:33.748 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockMayRenewPP 2024-03-30T15:12:33.748 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockMayRenewPP (6 ms) 2024-03-30T15:12:33.748 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.UnlockPP 2024-03-30T15:12:33.748 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock_pp: [ OK ] LibRadosLockPP.UnlockPP (10 ms) 2024-03-30T15:12:33.748 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.ListLockersPP 2024-03-30T15:12:33.748 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock_pp: [ OK ] LibRadosLockPP.ListLockersPP (8 ms) 2024-03-30T15:12:33.748 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.BreakLockPP 2024-03-30T15:12:33.748 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock_pp: [ OK ] LibRadosLockPP.BreakLockPP (12 ms) 2024-03-30T15:12:33.748 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP (2151 ms total) 2024-03-30T15:12:33.749 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock_pp: 2024-03-30T15:12:33.749 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP 2024-03-30T15:12:33.749 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusivePP 2024-03-30T15:12:33.749 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusivePP (4166 ms) 2024-03-30T15:12:33.749 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedPP 2024-03-30T15:12:33.749 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedPP (5 ms) 2024-03-30T15:12:33.749 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2024-03-30T15:12:33.749 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusiveDurPP (1018 ms) 2024-03-30T15:12:33.749 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedDurPP 2024-03-30T15:12:33.749 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedDurPP (1010 ms) 2024-03-30T15:12:33.749 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockMayRenewPP 2024-03-30T15:12:33.749 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockMayRenewPP (11 ms) 2024-03-30T15:12:33.749 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.UnlockPP 2024-03-30T15:12:33.749 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.UnlockPP (11 ms) 2024-03-30T15:12:33.749 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.ListLockersPP 2024-03-30T15:12:33.750 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.ListLockersPP (12 ms) 2024-03-30T15:12:33.750 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.BreakLockPP 2024-03-30T15:12:33.750 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.BreakLockPP (8 ms) 2024-03-30T15:12:33.750 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP (6241 ms total) 2024-03-30T15:12:33.750 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock_pp: 2024-03-30T15:12:33.750 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock_pp: [----------] Global test environment tear-down 2024-03-30T15:12:33.750 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock_pp: [==========] 16 tests from 2 test suites ran. (41751 ms total) 2024-03-30T15:12:33.750 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock_pp: [ PASSED ] 16 tests. 2024-03-30T15:12:34.802 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat_pp: Running main() from gmock_main.cc 2024-03-30T15:12:34.803 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat_pp: [==========] Running 9 tests from 2 test suites. 2024-03-30T15:12:34.803 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat_pp: [----------] Global test environment set-up. 2024-03-30T15:12:34.803 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP 2024-03-30T15:12:34.803 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat_pp: seed 64425 2024-03-30T15:12:34.803 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPP 2024-03-30T15:12:34.803 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPP (2657 ms) 2024-03-30T15:12:34.803 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.Stat2Mtime2PP 2024-03-30T15:12:34.803 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat_pp: [ OK ] LibRadosStatPP.Stat2Mtime2PP (6 ms) 2024-03-30T15:12:34.803 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.ClusterStatPP 2024-03-30T15:12:34.803 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat_pp: [ OK ] LibRadosStatPP.ClusterStatPP (0 ms) 2024-03-30T15:12:34.803 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.PoolStatPP 2024-03-30T15:12:34.804 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat_pp: [ OK ] LibRadosStatPP.PoolStatPP (3 ms) 2024-03-30T15:12:34.804 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPPNS 2024-03-30T15:12:34.804 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPPNS (11 ms) 2024-03-30T15:12:34.804 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP (2678 ms total) 2024-03-30T15:12:34.804 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat_pp: 2024-03-30T15:12:34.804 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP 2024-03-30T15:12:34.804 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPP 2024-03-30T15:12:34.804 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPP (1501 ms) 2024-03-30T15:12:34.804 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.ClusterStatPP 2024-03-30T15:12:34.804 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.ClusterStatPP (1 ms) 2024-03-30T15:12:34.804 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.PoolStatPP 2024-03-30T15:12:34.804 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.PoolStatPP (3 ms) 2024-03-30T15:12:34.804 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPPNS 2024-03-30T15:12:34.804 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPPNS (10 ms) 2024-03-30T15:12:34.804 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP (1515 ms total) 2024-03-30T15:12:34.804 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat_pp: 2024-03-30T15:12:34.805 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat_pp: [----------] Global test environment tear-down 2024-03-30T15:12:34.805 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat_pp: [==========] 9 tests from 2 test suites ran. (42723 ms total) 2024-03-30T15:12:34.805 INFO:tasks.workunit.client.0.smithi072.stdout: api_stat_pp: [ PASSED ] 9 tests. 2024-03-30T15:12:35.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:34 smithi072 bash[21573]: cluster 2024-03-30T15:12:31.861580+0000 mgr.y (mgr.14526) 194 : cluster 0 pgmap v147: 700 pgs: 128 unknown, 119 creating+peering, 453 active+clean; 145 MiB data, 749 MiB used, 714 GiB / 715 GiB avail; 3.9 KiB/s rd, 2.1 KiB/s wr, 10 op/s 2024-03-30T15:12:35.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:34 smithi072 bash[21573]: audit 2024-03-30T15:12:32.574990+0000 mon.a (mon.0) 1113 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:35.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:34 smithi072 bash[21573]: audit 2024-03-30T15:12:32.591053+0000 mon.a (mon.0) 1114 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi072-64478-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:35.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:34 smithi072 bash[21573]: audit 2024-03-30T15:12:32.591261+0000 mon.a (mon.0) 1115 : audit 1 from='client.? 172.21.15.72:0/1633994099' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi072-64841-2"}]': finished 2024-03-30T15:12:35.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:34 smithi072 bash[21573]: audit 2024-03-30T15:12:32.591401+0000 mon.a (mon.0) 1116 : audit 1 from='client.? 172.21.15.72:0/3101006435' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi072-64256-10"}]': finished 2024-03-30T15:12:35.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:34 smithi072 bash[21573]: audit 2024-03-30T15:12:32.591575+0000 mon.a (mon.0) 1117 : audit 1 from='client.? 172.21.15.72:0/1523337604' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:35.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:34 smithi072 bash[21573]: audit 2024-03-30T15:12:32.591764+0000 mon.a (mon.0) 1118 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi072-64300-1","app":"app1","key":"key1"}]': finished 2024-03-30T15:12:35.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:34 smithi072 bash[21573]: audit 2024-03-30T15:12:32.591965+0000 mon.a (mon.0) 1119 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi072-64425-7"}]': finished 2024-03-30T15:12:35.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:34 smithi072 bash[21573]: cluster 2024-03-30T15:12:32.601257+0000 mon.a (mon.0) 1120 : cluster 0 osdmap e98: 8 total, 8 up, 8 in 2024-03-30T15:12:35.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:34 smithi072 bash[21573]: audit 2024-03-30T15:12:32.605770+0000 mon.a (mon.0) 1121 : audit 1 from='client.? 172.21.15.72:0/3101006435' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi072-64256-10"}]: dispatch 2024-03-30T15:12:35.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:34 smithi072 bash[21573]: audit 2024-03-30T15:12:32.606845+0000 mon.a (mon.0) 1122 : audit 1 from='client.? 172.21.15.72:0/3676344992' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi072-64163-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:35.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:34 smithi072 bash[21573]: audit 2024-03-30T15:12:32.608266+0000 mon.c (mon.2) 175 : audit 1 from='client.? 172.21.15.72:0/459372695' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi072-64425-7"}]: dispatch 2024-03-30T15:12:35.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:34 smithi072 bash[21573]: audit 2024-03-30T15:12:32.612665+0000 mon.a (mon.0) 1123 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi072-64425-7"}]: dispatch 2024-03-30T15:12:35.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:34 smithi072 bash[21573]: audit 2024-03-30T15:12:32.617311+0000 mon.c (mon.2) 176 : audit 1 from='client.? 172.21.15.72:0/2935772551' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi072-64211-10"}]: dispatch 2024-03-30T15:12:35.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:34 smithi072 bash[21573]: audit 2024-03-30T15:12:32.617764+0000 mon.c (mon.2) 177 : audit 1 from='client.? 172.21.15.72:0/224908076' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi072-64378-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:35.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:34 smithi072 bash[21573]: audit 2024-03-30T15:12:32.618592+0000 mon.a (mon.0) 1124 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi072-64211-10"}]: dispatch 2024-03-30T15:12:35.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:34 smithi072 bash[21573]: audit 2024-03-30T15:12:32.619121+0000 mon.a (mon.0) 1125 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi072-64378-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:35.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:34 smithi072 bash[21573]: audit 2024-03-30T15:12:32.796590+0000 mon.c (mon.2) 178 : audit 1 from='client.? 172.21.15.72:0/4226267530' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi072-64478-6", "pg_num": 4}]: dispatch 2024-03-30T15:12:35.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:34 smithi072 bash[21573]: audit 2024-03-30T15:12:33.683031+0000 mon.a (mon.0) 1126 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:35.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:34 smithi072 bash[28946]: cluster 2024-03-30T15:12:31.861580+0000 mgr.y (mgr.14526) 194 : cluster 0 pgmap v147: 700 pgs: 128 unknown, 119 creating+peering, 453 active+clean; 145 MiB data, 749 MiB used, 714 GiB / 715 GiB avail; 3.9 KiB/s rd, 2.1 KiB/s wr, 10 op/s 2024-03-30T15:12:35.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:34 smithi072 bash[28946]: audit 2024-03-30T15:12:32.574990+0000 mon.a (mon.0) 1113 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:35.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:34 smithi072 bash[28946]: audit 2024-03-30T15:12:32.591053+0000 mon.a (mon.0) 1114 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi072-64478-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:35.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:34 smithi072 bash[28946]: audit 2024-03-30T15:12:32.591261+0000 mon.a (mon.0) 1115 : audit 1 from='client.? 172.21.15.72:0/1633994099' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi072-64841-2"}]': finished 2024-03-30T15:12:35.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:34 smithi072 bash[28946]: audit 2024-03-30T15:12:32.591401+0000 mon.a (mon.0) 1116 : audit 1 from='client.? 172.21.15.72:0/3101006435' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi072-64256-10"}]': finished 2024-03-30T15:12:35.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:34 smithi072 bash[28946]: audit 2024-03-30T15:12:32.591575+0000 mon.a (mon.0) 1117 : audit 1 from='client.? 172.21.15.72:0/1523337604' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:35.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:34 smithi072 bash[28946]: audit 2024-03-30T15:12:32.591764+0000 mon.a (mon.0) 1118 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi072-64300-1","app":"app1","key":"key1"}]': finished 2024-03-30T15:12:35.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:34 smithi072 bash[28946]: audit 2024-03-30T15:12:32.591965+0000 mon.a (mon.0) 1119 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi072-64425-7"}]': finished 2024-03-30T15:12:35.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:34 smithi072 bash[28946]: cluster 2024-03-30T15:12:32.601257+0000 mon.a (mon.0) 1120 : cluster 0 osdmap e98: 8 total, 8 up, 8 in 2024-03-30T15:12:35.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:34 smithi072 bash[28946]: audit 2024-03-30T15:12:32.605770+0000 mon.a (mon.0) 1121 : audit 1 from='client.? 172.21.15.72:0/3101006435' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi072-64256-10"}]: dispatch 2024-03-30T15:12:35.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:34 smithi072 bash[28946]: audit 2024-03-30T15:12:32.606845+0000 mon.a (mon.0) 1122 : audit 1 from='client.? 172.21.15.72:0/3676344992' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi072-64163-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:35.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:34 smithi072 bash[28946]: audit 2024-03-30T15:12:32.608266+0000 mon.c (mon.2) 175 : audit 1 from='client.? 172.21.15.72:0/459372695' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi072-64425-7"}]: dispatch 2024-03-30T15:12:35.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:34 smithi072 bash[28946]: audit 2024-03-30T15:12:32.612665+0000 mon.a (mon.0) 1123 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi072-64425-7"}]: dispatch 2024-03-30T15:12:35.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:34 smithi072 bash[28946]: audit 2024-03-30T15:12:32.617311+0000 mon.c (mon.2) 176 : audit 1 from='client.? 172.21.15.72:0/2935772551' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi072-64211-10"}]: dispatch 2024-03-30T15:12:35.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:34 smithi072 bash[28946]: audit 2024-03-30T15:12:32.617764+0000 mon.c (mon.2) 177 : audit 1 from='client.? 172.21.15.72:0/224908076' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi072-64378-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:35.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:34 smithi072 bash[28946]: audit 2024-03-30T15:12:32.618592+0000 mon.a (mon.0) 1124 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi072-64211-10"}]: dispatch 2024-03-30T15:12:35.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:34 smithi072 bash[28946]: audit 2024-03-30T15:12:32.619121+0000 mon.a (mon.0) 1125 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi072-64378-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:35.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:34 smithi072 bash[28946]: audit 2024-03-30T15:12:32.796590+0000 mon.c (mon.2) 178 : audit 1 from='client.? 172.21.15.72:0/4226267530' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi072-64478-6", "pg_num": 4}]: dispatch 2024-03-30T15:12:35.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:34 smithi072 bash[28946]: audit 2024-03-30T15:12:33.683031+0000 mon.a (mon.0) 1126 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:35.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:34 smithi172 bash[23680]: cluster 2024-03-30T15:12:31.861580+0000 mgr.y (mgr.14526) 194 : cluster 0 pgmap v147: 700 pgs: 128 unknown, 119 creating+peering, 453 active+clean; 145 MiB data, 749 MiB used, 714 GiB / 715 GiB avail; 3.9 KiB/s rd, 2.1 KiB/s wr, 10 op/s 2024-03-30T15:12:35.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:34 smithi172 bash[23680]: audit 2024-03-30T15:12:32.574990+0000 mon.a (mon.0) 1113 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:35.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:34 smithi172 bash[23680]: audit 2024-03-30T15:12:32.591053+0000 mon.a (mon.0) 1114 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi072-64478-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:35.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:34 smithi172 bash[23680]: audit 2024-03-30T15:12:32.591261+0000 mon.a (mon.0) 1115 : audit 1 from='client.? 172.21.15.72:0/1633994099' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi072-64841-2"}]': finished 2024-03-30T15:12:35.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:34 smithi172 bash[23680]: audit 2024-03-30T15:12:32.591401+0000 mon.a (mon.0) 1116 : audit 1 from='client.? 172.21.15.72:0/3101006435' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi072-64256-10"}]': finished 2024-03-30T15:12:35.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:34 smithi172 bash[23680]: audit 2024-03-30T15:12:32.591575+0000 mon.a (mon.0) 1117 : audit 1 from='client.? 172.21.15.72:0/1523337604' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:35.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:34 smithi172 bash[23680]: audit 2024-03-30T15:12:32.591764+0000 mon.a (mon.0) 1118 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi072-64300-1","app":"app1","key":"key1"}]': finished 2024-03-30T15:12:35.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:34 smithi172 bash[23680]: audit 2024-03-30T15:12:32.591965+0000 mon.a (mon.0) 1119 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi072-64425-7"}]': finished 2024-03-30T15:12:35.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:34 smithi172 bash[23680]: cluster 2024-03-30T15:12:32.601257+0000 mon.a (mon.0) 1120 : cluster 0 osdmap e98: 8 total, 8 up, 8 in 2024-03-30T15:12:35.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:34 smithi172 bash[23680]: audit 2024-03-30T15:12:32.605770+0000 mon.a (mon.0) 1121 : audit 1 from='client.? 172.21.15.72:0/3101006435' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi072-64256-10"}]: dispatch 2024-03-30T15:12:35.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:34 smithi172 bash[23680]: audit 2024-03-30T15:12:32.606845+0000 mon.a (mon.0) 1122 : audit 1 from='client.? 172.21.15.72:0/3676344992' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi072-64163-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:35.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:34 smithi172 bash[23680]: audit 2024-03-30T15:12:32.608266+0000 mon.c (mon.2) 175 : audit 1 from='client.? 172.21.15.72:0/459372695' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi072-64425-7"}]: dispatch 2024-03-30T15:12:35.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:34 smithi172 bash[23680]: audit 2024-03-30T15:12:32.612665+0000 mon.a (mon.0) 1123 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi072-64425-7"}]: dispatch 2024-03-30T15:12:35.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:34 smithi172 bash[23680]: audit 2024-03-30T15:12:32.617311+0000 mon.c (mon.2) 176 : audit 1 from='client.? 172.21.15.72:0/2935772551' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi072-64211-10"}]: dispatch 2024-03-30T15:12:35.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:34 smithi172 bash[23680]: audit 2024-03-30T15:12:32.617764+0000 mon.c (mon.2) 177 : audit 1 from='client.? 172.21.15.72:0/224908076' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi072-64378-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:35.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:34 smithi172 bash[23680]: audit 2024-03-30T15:12:32.618592+0000 mon.a (mon.0) 1124 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi072-64211-10"}]: dispatch 2024-03-30T15:12:35.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:34 smithi172 bash[23680]: audit 2024-03-30T15:12:32.619121+0000 mon.a (mon.0) 1125 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi072-64378-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:35.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:34 smithi172 bash[23680]: audit 2024-03-30T15:12:32.796590+0000 mon.c (mon.2) 178 : audit 1 from='client.? 172.21.15.72:0/4226267530' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi072-64478-6", "pg_num": 4}]: dispatch 2024-03-30T15:12:35.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:34 smithi172 bash[23680]: audit 2024-03-30T15:12:33.683031+0000 mon.a (mon.0) 1126 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:36.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:35 smithi172 bash[23680]: cluster 2024-03-30T15:12:33.687089+0000 mon.a (mon.0) 1127 : cluster 3 Health check update: 12 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:12:36.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:35 smithi172 bash[23680]: audit 2024-03-30T15:12:33.694915+0000 mon.a (mon.0) 1128 : audit 1 from='client.? 172.21.15.72:0/3101006435' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi072-64256-10"}]': finished 2024-03-30T15:12:36.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:35 smithi172 bash[23680]: audit 2024-03-30T15:12:33.694974+0000 mon.a (mon.0) 1129 : audit 1 from='client.? 172.21.15.72:0/3676344992' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi072-64163-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:36.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:35 smithi172 bash[23680]: audit 2024-03-30T15:12:33.695061+0000 mon.a (mon.0) 1130 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi072-64425-7"}]': finished 2024-03-30T15:12:36.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:35 smithi172 bash[23680]: audit 2024-03-30T15:12:33.695132+0000 mon.a (mon.0) 1131 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi072-64211-10"}]': finished 2024-03-30T15:12:36.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:35 smithi172 bash[23680]: audit 2024-03-30T15:12:33.695178+0000 mon.a (mon.0) 1132 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi072-64378-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:36.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:35 smithi172 bash[23680]: cluster 2024-03-30T15:12:33.700377+0000 mon.a (mon.0) 1133 : cluster 0 osdmap e99: 8 total, 8 up, 8 in 2024-03-30T15:12:36.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:35 smithi172 bash[23680]: audit 2024-03-30T15:12:33.722068+0000 mon.a (mon.0) 1134 : audit 1 from='client.? 172.21.15.72:0/2345721524' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi072-64882-2"}]: dispatch 2024-03-30T15:12:36.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:35 smithi172 bash[23680]: audit 2024-03-30T15:12:33.733790+0000 mon.c (mon.2) 179 : audit 1 from='client.? 172.21.15.72:0/346679937' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:36.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:35 smithi172 bash[23680]: audit 2024-03-30T15:12:33.734102+0000 mon.c (mon.2) 180 : audit 1 from='client.? 172.21.15.72:0/2935772551' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi072-64211-10"}]: dispatch 2024-03-30T15:12:36.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:35 smithi172 bash[23680]: audit 2024-03-30T15:12:34.797462+0000 mon.a (mon.0) 1135 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:36.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:35 smithi172 bash[23680]: audit 2024-03-30T15:12:34.822149+0000 mon.a (mon.0) 1136 : audit 1 from='client.? 172.21.15.72:0/2345721524' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi072-64882-2"}]': finished 2024-03-30T15:12:36.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:35 smithi172 bash[23680]: cluster 2024-03-30T15:12:35.375372+0000 mon.a (mon.0) 1137 : cluster 0 osdmap e100: 8 total, 8 up, 8 in 2024-03-30T15:12:36.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:35 smithi172 bash[23680]: audit 2024-03-30T15:12:35.385557+0000 mon.a (mon.0) 1138 : audit 1 from='client.? 172.21.15.72:0/2345721524' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi072-64882-2"}]: dispatch 2024-03-30T15:12:36.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:35 smithi172 bash[23680]: audit 2024-03-30T15:12:35.386576+0000 mon.a (mon.0) 1139 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:36.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:35 smithi072 bash[21573]: cluster 2024-03-30T15:12:33.687089+0000 mon.a (mon.0) 1127 : cluster 3 Health check update: 12 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:12:36.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:35 smithi072 bash[21573]: audit 2024-03-30T15:12:33.694915+0000 mon.a (mon.0) 1128 : audit 1 from='client.? 172.21.15.72:0/3101006435' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi072-64256-10"}]': finished 2024-03-30T15:12:36.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:35 smithi072 bash[21573]: audit 2024-03-30T15:12:33.694974+0000 mon.a (mon.0) 1129 : audit 1 from='client.? 172.21.15.72:0/3676344992' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi072-64163-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:36.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:35 smithi072 bash[21573]: audit 2024-03-30T15:12:33.695061+0000 mon.a (mon.0) 1130 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi072-64425-7"}]': finished 2024-03-30T15:12:36.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:35 smithi072 bash[21573]: audit 2024-03-30T15:12:33.695132+0000 mon.a (mon.0) 1131 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi072-64211-10"}]': finished 2024-03-30T15:12:36.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:35 smithi072 bash[21573]: audit 2024-03-30T15:12:33.695178+0000 mon.a (mon.0) 1132 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi072-64378-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:36.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:35 smithi072 bash[21573]: cluster 2024-03-30T15:12:33.700377+0000 mon.a (mon.0) 1133 : cluster 0 osdmap e99: 8 total, 8 up, 8 in 2024-03-30T15:12:36.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:35 smithi072 bash[21573]: audit 2024-03-30T15:12:33.722068+0000 mon.a (mon.0) 1134 : audit 1 from='client.? 172.21.15.72:0/2345721524' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi072-64882-2"}]: dispatch 2024-03-30T15:12:36.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:35 smithi072 bash[21573]: audit 2024-03-30T15:12:33.733790+0000 mon.c (mon.2) 179 : audit 1 from='client.? 172.21.15.72:0/346679937' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:36.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:35 smithi072 bash[21573]: audit 2024-03-30T15:12:33.734102+0000 mon.c (mon.2) 180 : audit 1 from='client.? 172.21.15.72:0/2935772551' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi072-64211-10"}]: dispatch 2024-03-30T15:12:36.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:35 smithi072 bash[21573]: audit 2024-03-30T15:12:34.797462+0000 mon.a (mon.0) 1135 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:36.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:35 smithi072 bash[21573]: audit 2024-03-30T15:12:34.822149+0000 mon.a (mon.0) 1136 : audit 1 from='client.? 172.21.15.72:0/2345721524' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi072-64882-2"}]': finished 2024-03-30T15:12:36.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:35 smithi072 bash[21573]: cluster 2024-03-30T15:12:35.375372+0000 mon.a (mon.0) 1137 : cluster 0 osdmap e100: 8 total, 8 up, 8 in 2024-03-30T15:12:36.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:35 smithi072 bash[21573]: audit 2024-03-30T15:12:35.385557+0000 mon.a (mon.0) 1138 : audit 1 from='client.? 172.21.15.72:0/2345721524' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi072-64882-2"}]: dispatch 2024-03-30T15:12:36.422 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:35 smithi072 bash[21573]: audit 2024-03-30T15:12:35.386576+0000 mon.a (mon.0) 1139 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:36.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:35 smithi072 bash[28946]: cluster 2024-03-30T15:12:33.687089+0000 mon.a (mon.0) 1127 : cluster 3 Health check update: 12 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:12:36.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:35 smithi072 bash[28946]: audit 2024-03-30T15:12:33.694915+0000 mon.a (mon.0) 1128 : audit 1 from='client.? 172.21.15.72:0/3101006435' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi072-64256-10"}]': finished 2024-03-30T15:12:36.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:35 smithi072 bash[28946]: audit 2024-03-30T15:12:33.694974+0000 mon.a (mon.0) 1129 : audit 1 from='client.? 172.21.15.72:0/3676344992' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi072-64163-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:36.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:35 smithi072 bash[28946]: audit 2024-03-30T15:12:33.695061+0000 mon.a (mon.0) 1130 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi072-64425-7"}]': finished 2024-03-30T15:12:36.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:35 smithi072 bash[28946]: audit 2024-03-30T15:12:33.695132+0000 mon.a (mon.0) 1131 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi072-64211-10"}]': finished 2024-03-30T15:12:36.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:35 smithi072 bash[28946]: audit 2024-03-30T15:12:33.695178+0000 mon.a (mon.0) 1132 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi072-64378-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:36.423 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:35 smithi072 bash[28946]: cluster 2024-03-30T15:12:33.700377+0000 mon.a (mon.0) 1133 : cluster 0 osdmap e99: 8 total, 8 up, 8 in 2024-03-30T15:12:36.424 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:35 smithi072 bash[28946]: audit 2024-03-30T15:12:33.722068+0000 mon.a (mon.0) 1134 : audit 1 from='client.? 172.21.15.72:0/2345721524' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi072-64882-2"}]: dispatch 2024-03-30T15:12:36.424 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:35 smithi072 bash[28946]: audit 2024-03-30T15:12:33.733790+0000 mon.c (mon.2) 179 : audit 1 from='client.? 172.21.15.72:0/346679937' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:36.424 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:35 smithi072 bash[28946]: audit 2024-03-30T15:12:33.734102+0000 mon.c (mon.2) 180 : audit 1 from='client.? 172.21.15.72:0/2935772551' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi072-64211-10"}]: dispatch 2024-03-30T15:12:36.424 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:35 smithi072 bash[28946]: audit 2024-03-30T15:12:34.797462+0000 mon.a (mon.0) 1135 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:36.424 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:35 smithi072 bash[28946]: audit 2024-03-30T15:12:34.822149+0000 mon.a (mon.0) 1136 : audit 1 from='client.? 172.21.15.72:0/2345721524' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi072-64882-2"}]': finished 2024-03-30T15:12:36.424 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:35 smithi072 bash[28946]: cluster 2024-03-30T15:12:35.375372+0000 mon.a (mon.0) 1137 : cluster 0 osdmap e100: 8 total, 8 up, 8 in 2024-03-30T15:12:36.424 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:35 smithi072 bash[28946]: audit 2024-03-30T15:12:35.385557+0000 mon.a (mon.0) 1138 : audit 1 from='client.? 172.21.15.72:0/2345721524' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi072-64882-2"}]: dispatch 2024-03-30T15:12:36.424 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:35 smithi072 bash[28946]: audit 2024-03-30T15:12:35.386576+0000 mon.a (mon.0) 1139 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:37.126 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock: Running main() from gmock_main.cc 2024-03-30T15:12:37.126 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock: [==========] Running 16 tests from 2 test suites. 2024-03-30T15:12:37.126 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock: [----------] Global test environment set-up. 2024-03-30T15:12:37.126 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock: [----------] 8 tests from LibRadosLock 2024-03-30T15:12:37.126 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusive 2024-03-30T15:12:37.126 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock: [ OK ] LibRadosLock.LockExclusive (421 ms) 2024-03-30T15:12:37.126 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock: [ RUN ] LibRadosLock.LockShared 2024-03-30T15:12:37.126 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock: [ OK ] LibRadosLock.LockShared (4 ms) 2024-03-30T15:12:37.126 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusiveDur 2024-03-30T15:12:37.126 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock: [ OK ] LibRadosLock.LockExclusiveDur (1005 ms) 2024-03-30T15:12:37.126 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock: [ RUN ] LibRadosLock.LockSharedDur 2024-03-30T15:12:37.127 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock: [ OK ] LibRadosLock.LockSharedDur (1005 ms) 2024-03-30T15:12:37.127 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock: [ RUN ] LibRadosLock.LockMayRenew 2024-03-30T15:12:37.127 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock: [ OK ] LibRadosLock.LockMayRenew (5 ms) 2024-03-30T15:12:37.127 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock: [ RUN ] LibRadosLock.Unlock 2024-03-30T15:12:37.127 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock: [ OK ] LibRadosLock.Unlock (6 ms) 2024-03-30T15:12:37.127 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock: [ RUN ] LibRadosLock.ListLockers 2024-03-30T15:12:37.127 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock: [ OK ] LibRadosLock.ListLockers (5 ms) 2024-03-30T15:12:37.127 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock: [ RUN ] LibRadosLock.BreakLock 2024-03-30T15:12:37.127 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock: [ OK ] LibRadosLock.BreakLock (3 ms) 2024-03-30T15:12:37.127 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock: [----------] 8 tests from LibRadosLock (2455 ms total) 2024-03-30T15:12:37.127 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock: 2024-03-30T15:12:37.127 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock: [----------] 8 tests from LibRadosLockEC 2024-03-30T15:12:37.127 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusive 2024-03-30T15:12:37.127 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusive (1486 ms) 2024-03-30T15:12:37.128 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock: [ RUN ] LibRadosLockEC.LockShared 2024-03-30T15:12:37.128 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock: [ OK ] LibRadosLockEC.LockShared (7 ms) 2024-03-30T15:12:37.128 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusiveDur 2024-03-30T15:12:37.128 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusiveDur (1008 ms) 2024-03-30T15:12:37.128 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock: [ RUN ] LibRadosLockEC.LockSharedDur 2024-03-30T15:12:37.128 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock: [ OK ] LibRadosLockEC.LockSharedDur (1009 ms) 2024-03-30T15:12:37.128 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock: [ RUN ] LibRadosLockEC.LockMayRenew 2024-03-30T15:12:37.128 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock: [ OK ] LibRadosLockEC.LockMayRenew (9 ms) 2024-03-30T15:12:37.128 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock: [ RUN ] LibRadosLockEC.Unlock 2024-03-30T15:12:37.128 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock: [ OK ] LibRadosLockEC.Unlock (11 ms) 2024-03-30T15:12:37.128 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock: [ RUN ] LibRadosLockEC.ListLockers 2024-03-30T15:12:37.128 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock: [ OK ] LibRadosLockEC.ListLockers (16 ms) 2024-03-30T15:12:37.128 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock: [ RUN ] LibRadosLockEC.BreakLock 2024-03-30T15:12:37.128 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock: [ OK ] LibRadosLockEC.BreakLock (7 ms) 2024-03-30T15:12:37.129 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock: [----------] 8 tests from LibRadosLockEC (3553 ms total) 2024-03-30T15:12:37.129 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock: 2024-03-30T15:12:37.129 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock: [----------] Global test environment tear-down 2024-03-30T15:12:37.129 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock: [==========] 16 tests from 2 test suites ran. (45153 ms total) 2024-03-30T15:12:37.129 INFO:tasks.workunit.client.0.smithi072.stdout: api_lock: [ PASSED ] 16 tests. 2024-03-30T15:12:37.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:37 smithi072 bash[21573]: cluster 2024-03-30T15:12:33.862316+0000 mgr.y (mgr.14526) 195 : cluster 0 pgmap v150: 556 pgs: 160 unknown, 40 creating+peering, 356 active+clean; 145 MiB data, 749 MiB used, 714 GiB / 715 GiB avail; 1013 B/s rd, 0 op/s 2024-03-30T15:12:37.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:37 smithi072 bash[21573]: audit 2024-03-30T15:12:35.403834+0000 mon.a (mon.0) 1140 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi072-64478-6", "pg_num": 4}]: dispatch 2024-03-30T15:12:37.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:37 smithi072 bash[21573]: audit 2024-03-30T15:12:35.917873+0000 mon.a (mon.0) 1141 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:37.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:37 smithi072 bash[21573]: audit 2024-03-30T15:12:35.918003+0000 mon.a (mon.0) 1142 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:37.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:37 smithi072 bash[21573]: audit 2024-03-30T15:12:35.919774+0000 mon.a (mon.0) 1143 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi072-64211-10"}]: dispatch 2024-03-30T15:12:37.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:37 smithi072 bash[21573]: audit 2024-03-30T15:12:35.935762+0000 mon.a (mon.0) 1144 : audit 1 from='client.? 172.21.15.72:0/2345721524' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi072-64882-2"}]': finished 2024-03-30T15:12:37.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:37 smithi072 bash[21573]: audit 2024-03-30T15:12:35.935856+0000 mon.a (mon.0) 1145 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:37.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:37 smithi072 bash[21573]: audit 2024-03-30T15:12:35.935927+0000 mon.a (mon.0) 1146 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi072-64478-6", "pg_num": 4}]': finished 2024-03-30T15:12:37.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:37 smithi072 bash[21573]: audit 2024-03-30T15:12:35.949579+0000 mon.c (mon.2) 181 : audit 1 from='client.? 172.21.15.72:0/4226267530' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi072-64478-4", "tierpool": "test-rados-api-smithi072-64478-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:12:37.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:37 smithi072 bash[21573]: cluster 2024-03-30T15:12:35.950391+0000 mon.a (mon.0) 1147 : cluster 0 osdmap e101: 8 total, 8 up, 8 in 2024-03-30T15:12:37.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:37 smithi072 bash[21573]: audit 2024-03-30T15:12:36.024825+0000 mon.c (mon.2) 182 : audit 1 from='client.? 172.21.15.72:0/2538109740' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi072-64882-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:37.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:37 smithi072 bash[28946]: cluster 2024-03-30T15:12:33.862316+0000 mgr.y (mgr.14526) 195 : cluster 0 pgmap v150: 556 pgs: 160 unknown, 40 creating+peering, 356 active+clean; 145 MiB data, 749 MiB used, 714 GiB / 715 GiB avail; 1013 B/s rd, 0 op/s 2024-03-30T15:12:37.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:37 smithi072 bash[28946]: audit 2024-03-30T15:12:35.403834+0000 mon.a (mon.0) 1140 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi072-64478-6", "pg_num": 4}]: dispatch 2024-03-30T15:12:37.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:37 smithi072 bash[28946]: audit 2024-03-30T15:12:35.917873+0000 mon.a (mon.0) 1141 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:37.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:37 smithi072 bash[28946]: audit 2024-03-30T15:12:35.918003+0000 mon.a (mon.0) 1142 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:37.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:37 smithi072 bash[28946]: audit 2024-03-30T15:12:35.919774+0000 mon.a (mon.0) 1143 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi072-64211-10"}]: dispatch 2024-03-30T15:12:37.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:37 smithi072 bash[28946]: audit 2024-03-30T15:12:35.935762+0000 mon.a (mon.0) 1144 : audit 1 from='client.? 172.21.15.72:0/2345721524' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi072-64882-2"}]': finished 2024-03-30T15:12:37.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:37 smithi072 bash[28946]: audit 2024-03-30T15:12:35.935856+0000 mon.a (mon.0) 1145 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:37.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:37 smithi072 bash[28946]: audit 2024-03-30T15:12:35.935927+0000 mon.a (mon.0) 1146 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi072-64478-6", "pg_num": 4}]': finished 2024-03-30T15:12:37.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:37 smithi072 bash[28946]: audit 2024-03-30T15:12:35.949579+0000 mon.c (mon.2) 181 : audit 1 from='client.? 172.21.15.72:0/4226267530' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi072-64478-4", "tierpool": "test-rados-api-smithi072-64478-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:12:37.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:37 smithi072 bash[28946]: cluster 2024-03-30T15:12:35.950391+0000 mon.a (mon.0) 1147 : cluster 0 osdmap e101: 8 total, 8 up, 8 in 2024-03-30T15:12:37.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:37 smithi072 bash[28946]: audit 2024-03-30T15:12:36.024825+0000 mon.c (mon.2) 182 : audit 1 from='client.? 172.21.15.72:0/2538109740' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi072-64882-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:37.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:37 smithi172 bash[23680]: cluster 2024-03-30T15:12:33.862316+0000 mgr.y (mgr.14526) 195 : cluster 0 pgmap v150: 556 pgs: 160 unknown, 40 creating+peering, 356 active+clean; 145 MiB data, 749 MiB used, 714 GiB / 715 GiB avail; 1013 B/s rd, 0 op/s 2024-03-30T15:12:37.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:37 smithi172 bash[23680]: audit 2024-03-30T15:12:35.403834+0000 mon.a (mon.0) 1140 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi072-64478-6", "pg_num": 4}]: dispatch 2024-03-30T15:12:37.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:37 smithi172 bash[23680]: audit 2024-03-30T15:12:35.917873+0000 mon.a (mon.0) 1141 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:37.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:37 smithi172 bash[23680]: audit 2024-03-30T15:12:35.918003+0000 mon.a (mon.0) 1142 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:37.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:37 smithi172 bash[23680]: audit 2024-03-30T15:12:35.919774+0000 mon.a (mon.0) 1143 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi072-64211-10"}]: dispatch 2024-03-30T15:12:37.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:37 smithi172 bash[23680]: audit 2024-03-30T15:12:35.935762+0000 mon.a (mon.0) 1144 : audit 1 from='client.? 172.21.15.72:0/2345721524' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi072-64882-2"}]': finished 2024-03-30T15:12:37.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:37 smithi172 bash[23680]: audit 2024-03-30T15:12:35.935856+0000 mon.a (mon.0) 1145 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:37.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:37 smithi172 bash[23680]: audit 2024-03-30T15:12:35.935927+0000 mon.a (mon.0) 1146 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi072-64478-6", "pg_num": 4}]': finished 2024-03-30T15:12:37.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:37 smithi172 bash[23680]: audit 2024-03-30T15:12:35.949579+0000 mon.c (mon.2) 181 : audit 1 from='client.? 172.21.15.72:0/4226267530' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi072-64478-4", "tierpool": "test-rados-api-smithi072-64478-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:12:37.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:37 smithi172 bash[23680]: cluster 2024-03-30T15:12:35.950391+0000 mon.a (mon.0) 1147 : cluster 0 osdmap e101: 8 total, 8 up, 8 in 2024-03-30T15:12:37.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:37 smithi172 bash[23680]: audit 2024-03-30T15:12:36.024825+0000 mon.c (mon.2) 182 : audit 1 from='client.? 172.21.15.72:0/2538109740' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi072-64882-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:38.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:38 smithi072 bash[21573]: cluster 2024-03-30T15:12:35.864865+0000 mgr.y (mgr.14526) 196 : cluster 0 pgmap v152: 620 pgs: 128 creating+peering, 492 active+clean; 145 MiB data, 772 MiB used, 714 GiB / 715 GiB avail 2024-03-30T15:12:38.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:38 smithi072 bash[21573]: cluster 2024-03-30T15:12:37.062085+0000 mon.a (mon.0) 1148 : cluster 1 Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-03-30T15:12:38.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:38 smithi072 bash[21573]: audit 2024-03-30T15:12:37.064403+0000 mon.a (mon.0) 1149 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:38.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:38 smithi072 bash[21573]: audit 2024-03-30T15:12:37.074861+0000 mon.a (mon.0) 1150 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:38.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:38 smithi072 bash[21573]: audit 2024-03-30T15:12:37.074980+0000 mon.a (mon.0) 1151 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi072-64211-10"}]': finished 2024-03-30T15:12:38.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:38 smithi072 bash[21573]: cluster 2024-03-30T15:12:37.079298+0000 mon.a (mon.0) 1152 : cluster 0 osdmap e102: 8 total, 8 up, 8 in 2024-03-30T15:12:38.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:38 smithi072 bash[21573]: audit 2024-03-30T15:12:37.102725+0000 mon.a (mon.0) 1153 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi072-64478-4", "tierpool": "test-rados-api-smithi072-64478-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:12:38.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:38 smithi072 bash[21573]: audit 2024-03-30T15:12:37.103060+0000 mon.a (mon.0) 1154 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:38.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:38 smithi072 bash[21573]: audit 2024-03-30T15:12:37.125154+0000 mon.c (mon.2) 183 : audit 1 from='client.? 172.21.15.72:0/3121056367' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:38.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:38 smithi072 bash[21573]: audit 2024-03-30T15:12:37.150047+0000 mon.a (mon.0) 1155 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi072-64882-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:38.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:38 smithi072 bash[21573]: audit 2024-03-30T15:12:37.705478+0000 mon.a (mon.0) 1156 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:38.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:38 smithi072 bash[28946]: cluster 2024-03-30T15:12:35.864865+0000 mgr.y (mgr.14526) 196 : cluster 0 pgmap v152: 620 pgs: 128 creating+peering, 492 active+clean; 145 MiB data, 772 MiB used, 714 GiB / 715 GiB avail 2024-03-30T15:12:38.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:38 smithi072 bash[28946]: cluster 2024-03-30T15:12:37.062085+0000 mon.a (mon.0) 1148 : cluster 1 Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-03-30T15:12:38.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:38 smithi072 bash[28946]: audit 2024-03-30T15:12:37.064403+0000 mon.a (mon.0) 1149 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:38.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:38 smithi072 bash[28946]: audit 2024-03-30T15:12:37.074861+0000 mon.a (mon.0) 1150 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:38.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:38 smithi072 bash[28946]: audit 2024-03-30T15:12:37.074980+0000 mon.a (mon.0) 1151 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi072-64211-10"}]': finished 2024-03-30T15:12:38.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:38 smithi072 bash[28946]: cluster 2024-03-30T15:12:37.079298+0000 mon.a (mon.0) 1152 : cluster 0 osdmap e102: 8 total, 8 up, 8 in 2024-03-30T15:12:38.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:38 smithi072 bash[28946]: audit 2024-03-30T15:12:37.102725+0000 mon.a (mon.0) 1153 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi072-64478-4", "tierpool": "test-rados-api-smithi072-64478-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:12:38.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:38 smithi072 bash[28946]: audit 2024-03-30T15:12:37.103060+0000 mon.a (mon.0) 1154 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:38.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:38 smithi072 bash[28946]: audit 2024-03-30T15:12:37.125154+0000 mon.c (mon.2) 183 : audit 1 from='client.? 172.21.15.72:0/3121056367' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:38.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:38 smithi072 bash[28946]: audit 2024-03-30T15:12:37.150047+0000 mon.a (mon.0) 1155 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi072-64882-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:38.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:38 smithi072 bash[28946]: audit 2024-03-30T15:12:37.705478+0000 mon.a (mon.0) 1156 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:38.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:38 smithi172 bash[23680]: cluster 2024-03-30T15:12:35.864865+0000 mgr.y (mgr.14526) 196 : cluster 0 pgmap v152: 620 pgs: 128 creating+peering, 492 active+clean; 145 MiB data, 772 MiB used, 714 GiB / 715 GiB avail 2024-03-30T15:12:38.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:38 smithi172 bash[23680]: cluster 2024-03-30T15:12:37.062085+0000 mon.a (mon.0) 1148 : cluster 1 Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-03-30T15:12:38.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:38 smithi172 bash[23680]: audit 2024-03-30T15:12:37.064403+0000 mon.a (mon.0) 1149 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:38.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:38 smithi172 bash[23680]: audit 2024-03-30T15:12:37.074861+0000 mon.a (mon.0) 1150 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:38.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:38 smithi172 bash[23680]: audit 2024-03-30T15:12:37.074980+0000 mon.a (mon.0) 1151 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi072-64211-10"}]': finished 2024-03-30T15:12:38.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:38 smithi172 bash[23680]: cluster 2024-03-30T15:12:37.079298+0000 mon.a (mon.0) 1152 : cluster 0 osdmap e102: 8 total, 8 up, 8 in 2024-03-30T15:12:38.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:38 smithi172 bash[23680]: audit 2024-03-30T15:12:37.102725+0000 mon.a (mon.0) 1153 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi072-64478-4", "tierpool": "test-rados-api-smithi072-64478-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:12:38.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:38 smithi172 bash[23680]: audit 2024-03-30T15:12:37.103060+0000 mon.a (mon.0) 1154 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:38.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:38 smithi172 bash[23680]: audit 2024-03-30T15:12:37.125154+0000 mon.c (mon.2) 183 : audit 1 from='client.? 172.21.15.72:0/3121056367' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:38.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:38 smithi172 bash[23680]: audit 2024-03-30T15:12:37.150047+0000 mon.a (mon.0) 1155 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi072-64882-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:12:38.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:38 smithi172 bash[23680]: audit 2024-03-30T15:12:37.705478+0000 mon.a (mon.0) 1156 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:39.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:39 smithi072 bash[21573]: audit 2024-03-30T15:12:38.217019+0000 mon.a (mon.0) 1157 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:39.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:39 smithi072 bash[21573]: audit 2024-03-30T15:12:38.230614+0000 mon.a (mon.0) 1158 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi072-64478-4", "tierpool": "test-rados-api-smithi072-64478-6", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:12:39.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:39 smithi072 bash[21573]: audit 2024-03-30T15:12:38.230720+0000 mon.a (mon.0) 1159 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:39.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:39 smithi072 bash[21573]: audit 2024-03-30T15:12:38.230789+0000 mon.a (mon.0) 1160 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi072-64882-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:12:39.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:39 smithi072 bash[21573]: audit 2024-03-30T15:12:38.230871+0000 mon.a (mon.0) 1161 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:39.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:39 smithi072 bash[21573]: audit 2024-03-30T15:12:38.244541+0000 mon.c (mon.2) 184 : audit 1 from='client.? 172.21.15.72:0/2538109740' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi072-64882-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi072-64882-3"}]: dispatch 2024-03-30T15:12:39.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:39 smithi072 bash[21573]: audit 2024-03-30T15:12:38.248319+0000 mon.c (mon.2) 185 : audit 1 from='client.? 172.21.15.72:0/4226267530' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi072-64478-4", "overlaypool": "test-rados-api-smithi072-64478-6"}]: dispatch 2024-03-30T15:12:39.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:39 smithi072 bash[21573]: audit 2024-03-30T15:12:38.264356+0000 mon.b (mon.1) 40 : audit 1 from='client.? 172.21.15.72:0/4132408751' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi072-64444-12"}]: dispatch 2024-03-30T15:12:39.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:39 smithi072 bash[21573]: audit 2024-03-30T15:12:38.270375+0000 mon.c (mon.2) 186 : audit 1 from='client.? 172.21.15.72:0/1438685747' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi072-64386-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:39.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:39 smithi072 bash[21573]: cluster 2024-03-30T15:12:38.859867+0000 mon.a (mon.0) 1162 : cluster 0 osdmap e103: 8 total, 8 up, 8 in 2024-03-30T15:12:39.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:39 smithi072 bash[21573]: cluster 2024-03-30T15:12:38.861294+0000 mon.a (mon.0) 1163 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:12:39.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:39 smithi072 bash[28946]: audit 2024-03-30T15:12:38.217019+0000 mon.a (mon.0) 1157 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:39.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:39 smithi072 bash[28946]: audit 2024-03-30T15:12:38.230614+0000 mon.a (mon.0) 1158 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi072-64478-4", "tierpool": "test-rados-api-smithi072-64478-6", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:12:39.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:39 smithi072 bash[28946]: audit 2024-03-30T15:12:38.230720+0000 mon.a (mon.0) 1159 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:39.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:39 smithi072 bash[28946]: audit 2024-03-30T15:12:38.230789+0000 mon.a (mon.0) 1160 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi072-64882-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:12:39.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:39 smithi072 bash[28946]: audit 2024-03-30T15:12:38.230871+0000 mon.a (mon.0) 1161 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:39.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:39 smithi072 bash[28946]: audit 2024-03-30T15:12:38.244541+0000 mon.c (mon.2) 184 : audit 1 from='client.? 172.21.15.72:0/2538109740' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi072-64882-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi072-64882-3"}]: dispatch 2024-03-30T15:12:39.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:39 smithi072 bash[28946]: audit 2024-03-30T15:12:38.248319+0000 mon.c (mon.2) 185 : audit 1 from='client.? 172.21.15.72:0/4226267530' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi072-64478-4", "overlaypool": "test-rados-api-smithi072-64478-6"}]: dispatch 2024-03-30T15:12:39.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:39 smithi072 bash[28946]: audit 2024-03-30T15:12:38.264356+0000 mon.b (mon.1) 40 : audit 1 from='client.? 172.21.15.72:0/4132408751' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi072-64444-12"}]: dispatch 2024-03-30T15:12:39.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:39 smithi072 bash[28946]: audit 2024-03-30T15:12:38.270375+0000 mon.c (mon.2) 186 : audit 1 from='client.? 172.21.15.72:0/1438685747' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi072-64386-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:39.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:39 smithi072 bash[28946]: cluster 2024-03-30T15:12:38.859867+0000 mon.a (mon.0) 1162 : cluster 0 osdmap e103: 8 total, 8 up, 8 in 2024-03-30T15:12:39.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:39 smithi072 bash[28946]: cluster 2024-03-30T15:12:38.861294+0000 mon.a (mon.0) 1163 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:12:39.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:39 smithi172 bash[23680]: audit 2024-03-30T15:12:38.217019+0000 mon.a (mon.0) 1157 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:39.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:39 smithi172 bash[23680]: audit 2024-03-30T15:12:38.230614+0000 mon.a (mon.0) 1158 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi072-64478-4", "tierpool": "test-rados-api-smithi072-64478-6", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:12:39.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:39 smithi172 bash[23680]: audit 2024-03-30T15:12:38.230720+0000 mon.a (mon.0) 1159 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:39.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:39 smithi172 bash[23680]: audit 2024-03-30T15:12:38.230789+0000 mon.a (mon.0) 1160 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi072-64882-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:12:39.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:39 smithi172 bash[23680]: audit 2024-03-30T15:12:38.230871+0000 mon.a (mon.0) 1161 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:39.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:39 smithi172 bash[23680]: audit 2024-03-30T15:12:38.244541+0000 mon.c (mon.2) 184 : audit 1 from='client.? 172.21.15.72:0/2538109740' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi072-64882-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi072-64882-3"}]: dispatch 2024-03-30T15:12:39.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:39 smithi172 bash[23680]: audit 2024-03-30T15:12:38.248319+0000 mon.c (mon.2) 185 : audit 1 from='client.? 172.21.15.72:0/4226267530' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi072-64478-4", "overlaypool": "test-rados-api-smithi072-64478-6"}]: dispatch 2024-03-30T15:12:39.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:39 smithi172 bash[23680]: audit 2024-03-30T15:12:38.264356+0000 mon.b (mon.1) 40 : audit 1 from='client.? 172.21.15.72:0/4132408751' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi072-64444-12"}]: dispatch 2024-03-30T15:12:39.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:39 smithi172 bash[23680]: audit 2024-03-30T15:12:38.270375+0000 mon.c (mon.2) 186 : audit 1 from='client.? 172.21.15.72:0/1438685747' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi072-64386-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:39.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:39 smithi172 bash[23680]: cluster 2024-03-30T15:12:38.859867+0000 mon.a (mon.0) 1162 : cluster 0 osdmap e103: 8 total, 8 up, 8 in 2024-03-30T15:12:39.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:39 smithi172 bash[23680]: cluster 2024-03-30T15:12:38.861294+0000 mon.a (mon.0) 1163 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:12:41.029 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:40 smithi072 bash[21573]: audit 2024-03-30T15:12:39.577666+0000 mon.a (mon.0) 1164 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:41.029 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:40 smithi072 bash[28946]: audit 2024-03-30T15:12:39.577666+0000 mon.a (mon.0) 1164 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:41.215 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:12:40 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:12:41.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:40 smithi172 bash[23680]: audit 2024-03-30T15:12:39.577666+0000 mon.a (mon.0) 1164 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:41.416 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:12:41 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:12:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:12:42.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:41 smithi072 bash[21573]: cluster 2024-03-30T15:12:37.865712+0000 mgr.y (mgr.14526) 197 : cluster 0 pgmap v155: 560 pgs: 68 unknown, 96 creating+peering, 396 active+clean; 145 MiB data, 772 MiB used, 714 GiB / 715 GiB avail; 988 B/s rd, 1 op/s 2024-03-30T15:12:42.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:41 smithi072 bash[21573]: cluster 2024-03-30T15:12:39.866456+0000 mgr.y (mgr.14526) 198 : cluster 0 pgmap v158: 616 pgs: 196 unknown, 96 creating+peering, 324 active+clean; 145 MiB data, 772 MiB used, 714 GiB / 715 GiB avail 2024-03-30T15:12:42.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:41 smithi072 bash[21573]: cluster 2024-03-30T15:12:40.713472+0000 mon.a (mon.0) 1165 : cluster 0 osdmap e104: 8 total, 8 up, 8 in 2024-03-30T15:12:42.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:41 smithi072 bash[21573]: audit 2024-03-30T15:12:40.728784+0000 mon.a (mon.0) 1166 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi072-64882-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi072-64882-3"}]: dispatch 2024-03-30T15:12:42.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:41 smithi072 bash[21573]: audit 2024-03-30T15:12:40.729021+0000 mon.a (mon.0) 1167 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:42.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:41 smithi072 bash[21573]: audit 2024-03-30T15:12:40.746435+0000 mon.a (mon.0) 1168 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi072-64478-4", "overlaypool": "test-rados-api-smithi072-64478-6"}]: dispatch 2024-03-30T15:12:42.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:41 smithi072 bash[21573]: cluster 2024-03-30T15:12:40.781251+0000 mon.a (mon.0) 1169 : cluster 0 osdmap e105: 8 total, 8 up, 8 in 2024-03-30T15:12:42.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:41 smithi072 bash[21573]: audit 2024-03-30T15:12:40.789410+0000 mon.a (mon.0) 1170 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi072-64386-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:42.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:41 smithi072 bash[21573]: audit 2024-03-30T15:12:41.344723+0000 mon.a (mon.0) 1171 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi072-64444-12"}]: dispatch 2024-03-30T15:12:42.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:41 smithi072 bash[28946]: cluster 2024-03-30T15:12:37.865712+0000 mgr.y (mgr.14526) 197 : cluster 0 pgmap v155: 560 pgs: 68 unknown, 96 creating+peering, 396 active+clean; 145 MiB data, 772 MiB used, 714 GiB / 715 GiB avail; 988 B/s rd, 1 op/s 2024-03-30T15:12:42.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:41 smithi072 bash[28946]: cluster 2024-03-30T15:12:39.866456+0000 mgr.y (mgr.14526) 198 : cluster 0 pgmap v158: 616 pgs: 196 unknown, 96 creating+peering, 324 active+clean; 145 MiB data, 772 MiB used, 714 GiB / 715 GiB avail 2024-03-30T15:12:42.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:41 smithi072 bash[28946]: cluster 2024-03-30T15:12:40.713472+0000 mon.a (mon.0) 1165 : cluster 0 osdmap e104: 8 total, 8 up, 8 in 2024-03-30T15:12:42.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:41 smithi072 bash[28946]: audit 2024-03-30T15:12:40.728784+0000 mon.a (mon.0) 1166 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi072-64882-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi072-64882-3"}]: dispatch 2024-03-30T15:12:42.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:41 smithi072 bash[28946]: audit 2024-03-30T15:12:40.729021+0000 mon.a (mon.0) 1167 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:42.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:41 smithi072 bash[28946]: audit 2024-03-30T15:12:40.746435+0000 mon.a (mon.0) 1168 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi072-64478-4", "overlaypool": "test-rados-api-smithi072-64478-6"}]: dispatch 2024-03-30T15:12:42.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:41 smithi072 bash[28946]: cluster 2024-03-30T15:12:40.781251+0000 mon.a (mon.0) 1169 : cluster 0 osdmap e105: 8 total, 8 up, 8 in 2024-03-30T15:12:42.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:41 smithi072 bash[28946]: audit 2024-03-30T15:12:40.789410+0000 mon.a (mon.0) 1170 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi072-64386-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:42.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:41 smithi072 bash[28946]: audit 2024-03-30T15:12:41.344723+0000 mon.a (mon.0) 1171 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi072-64444-12"}]: dispatch 2024-03-30T15:12:42.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:41 smithi172 bash[23680]: cluster 2024-03-30T15:12:37.865712+0000 mgr.y (mgr.14526) 197 : cluster 0 pgmap v155: 560 pgs: 68 unknown, 96 creating+peering, 396 active+clean; 145 MiB data, 772 MiB used, 714 GiB / 715 GiB avail; 988 B/s rd, 1 op/s 2024-03-30T15:12:42.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:41 smithi172 bash[23680]: cluster 2024-03-30T15:12:39.866456+0000 mgr.y (mgr.14526) 198 : cluster 0 pgmap v158: 616 pgs: 196 unknown, 96 creating+peering, 324 active+clean; 145 MiB data, 772 MiB used, 714 GiB / 715 GiB avail 2024-03-30T15:12:42.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:41 smithi172 bash[23680]: cluster 2024-03-30T15:12:40.713472+0000 mon.a (mon.0) 1165 : cluster 0 osdmap e104: 8 total, 8 up, 8 in 2024-03-30T15:12:42.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:41 smithi172 bash[23680]: audit 2024-03-30T15:12:40.728784+0000 mon.a (mon.0) 1166 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi072-64882-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi072-64882-3"}]: dispatch 2024-03-30T15:12:42.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:41 smithi172 bash[23680]: audit 2024-03-30T15:12:40.729021+0000 mon.a (mon.0) 1167 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:42.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:41 smithi172 bash[23680]: audit 2024-03-30T15:12:40.746435+0000 mon.a (mon.0) 1168 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi072-64478-4", "overlaypool": "test-rados-api-smithi072-64478-6"}]: dispatch 2024-03-30T15:12:42.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:41 smithi172 bash[23680]: cluster 2024-03-30T15:12:40.781251+0000 mon.a (mon.0) 1169 : cluster 0 osdmap e105: 8 total, 8 up, 8 in 2024-03-30T15:12:42.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:41 smithi172 bash[23680]: audit 2024-03-30T15:12:40.789410+0000 mon.a (mon.0) 1170 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi072-64386-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:42.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:41 smithi172 bash[23680]: audit 2024-03-30T15:12:41.344723+0000 mon.a (mon.0) 1171 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi072-64444-12"}]: dispatch 2024-03-30T15:12:42.593 INFO:tasks.workunit.client.0.smithi072.stdout: pool: Running main() from gmock_main.cc 2024-03-30T15:12:42.594 INFO:tasks.workunit.client.0.smithi072.stdout: pool: [==========] Running 6 tests from 1 test suite. 2024-03-30T15:12:42.594 INFO:tasks.workunit.client.0.smithi072.stdout: pool: [----------] Global test environment set-up. 2024-03-30T15:12:42.594 INFO:tasks.workunit.client.0.smithi072.stdout: pool: [----------] 6 tests from NeoRadosPools 2024-03-30T15:12:42.594 INFO:tasks.workunit.client.0.smithi072.stdout: pool: [ RUN ] NeoRadosPools.PoolList 2024-03-30T15:12:42.594 INFO:tasks.workunit.client.0.smithi072.stdout: pool: [ OK ] NeoRadosPools.PoolList (16737 ms) 2024-03-30T15:12:42.594 INFO:tasks.workunit.client.0.smithi072.stdout: pool: [ RUN ] NeoRadosPools.PoolLookup 2024-03-30T15:12:42.594 INFO:tasks.workunit.client.0.smithi072.stdout: pool: [ OK ] NeoRadosPools.PoolLookup (12233 ms) 2024-03-30T15:12:42.594 INFO:tasks.workunit.client.0.smithi072.stdout: pool: [ RUN ] NeoRadosPools.PoolLookupOtherInstance 2024-03-30T15:12:42.594 INFO:tasks.workunit.client.0.smithi072.stdout: pool: [ OK ] NeoRadosPools.PoolLookupOtherInstance (4461 ms) 2024-03-30T15:12:42.594 INFO:tasks.workunit.client.0.smithi072.stdout: pool: [ RUN ] NeoRadosPools.PoolDelete 2024-03-30T15:12:42.594 INFO:tasks.workunit.client.0.smithi072.stdout: pool: [ OK ] NeoRadosPools.PoolDelete (6888 ms) 2024-03-30T15:12:42.594 INFO:tasks.workunit.client.0.smithi072.stdout: pool: [ RUN ] NeoRadosPools.PoolCreateDelete 2024-03-30T15:12:42.594 INFO:tasks.workunit.client.0.smithi072.stdout: pool: [ OK ] NeoRadosPools.PoolCreateDelete (4500 ms) 2024-03-30T15:12:42.595 INFO:tasks.workunit.client.0.smithi072.stdout: pool: [ RUN ] NeoRadosPools.PoolCreateWithCrushRule 2024-03-30T15:12:42.595 INFO:tasks.workunit.client.0.smithi072.stdout: pool: [ OK ] NeoRadosPools.PoolCreateWithCrushRule (5469 ms) 2024-03-30T15:12:42.595 INFO:tasks.workunit.client.0.smithi072.stdout: pool: [----------] 6 tests from NeoRadosPools (50288 ms total) 2024-03-30T15:12:42.595 INFO:tasks.workunit.client.0.smithi072.stdout: pool: 2024-03-30T15:12:42.595 INFO:tasks.workunit.client.0.smithi072.stdout: pool: [----------] Global test environment tear-down 2024-03-30T15:12:42.595 INFO:tasks.workunit.client.0.smithi072.stdout: pool: [==========] 6 tests from 1 test suite ran. (50289 ms total) 2024-03-30T15:12:42.595 INFO:tasks.workunit.client.0.smithi072.stdout: pool: [ PASSED ] 6 tests. 2024-03-30T15:12:43.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:43 smithi072 bash[21573]: audit 2024-03-30T15:12:40.984006+0000 mgr.y (mgr.14526) 199 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:12:43.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:43 smithi072 bash[21573]: audit 2024-03-30T15:12:41.873924+0000 mon.a (mon.0) 1172 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:43.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:43 smithi072 bash[21573]: audit 2024-03-30T15:12:41.924011+0000 mon.a (mon.0) 1173 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi072-64478-4", "overlaypool": "test-rados-api-smithi072-64478-6"}]': finished 2024-03-30T15:12:43.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:43 smithi072 bash[21573]: audit 2024-03-30T15:12:41.924100+0000 mon.a (mon.0) 1174 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi072-64386-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:43.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:43 smithi072 bash[21573]: audit 2024-03-30T15:12:41.924162+0000 mon.a (mon.0) 1175 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi072-64444-12"}]': finished 2024-03-30T15:12:43.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:43 smithi072 bash[21573]: audit 2024-03-30T15:12:41.937582+0000 mon.b (mon.1) 41 : audit 1 from='client.? 172.21.15.72:0/4132408751' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi072-64444-12"}]: dispatch 2024-03-30T15:12:43.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:43 smithi072 bash[21573]: audit 2024-03-30T15:12:41.972485+0000 mon.c (mon.2) 187 : audit 1 from='client.? 172.21.15.72:0/4226267530' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64478-6", "mode": "writeback"}]: dispatch 2024-03-30T15:12:43.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:43 smithi072 bash[21573]: audit 2024-03-30T15:12:42.297751+0000 mon.c (mon.2) 188 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.0"}]: dispatch 2024-03-30T15:12:43.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:43 smithi072 bash[21573]: audit 2024-03-30T15:12:42.307512+0000 mon.c (mon.2) 189 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.1"}]: dispatch 2024-03-30T15:12:43.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:43 smithi072 bash[21573]: audit 2024-03-30T15:12:42.311170+0000 mon.c (mon.2) 190 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.2"}]: dispatch 2024-03-30T15:12:43.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:43 smithi072 bash[21573]: audit 2024-03-30T15:12:42.315000+0000 mon.c (mon.2) 191 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.3"}]: dispatch 2024-03-30T15:12:43.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:43 smithi072 bash[21573]: audit 2024-03-30T15:12:42.327475+0000 mon.c (mon.2) 192 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.4"}]: dispatch 2024-03-30T15:12:43.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:43 smithi072 bash[21573]: audit 2024-03-30T15:12:42.338275+0000 mon.c (mon.2) 193 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.5"}]: dispatch 2024-03-30T15:12:43.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:43 smithi072 bash[21573]: audit 2024-03-30T15:12:42.343096+0000 mon.c (mon.2) 194 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.6"}]: dispatch 2024-03-30T15:12:43.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:43 smithi072 bash[21573]: audit 2024-03-30T15:12:42.349526+0000 mon.c (mon.2) 195 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.7"}]: dispatch 2024-03-30T15:12:43.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:43 smithi072 bash[21573]: audit 2024-03-30T15:12:42.355085+0000 mon.c (mon.2) 196 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.8"}]: dispatch 2024-03-30T15:12:43.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:43 smithi072 bash[21573]: audit 2024-03-30T15:12:42.357265+0000 mon.c (mon.2) 197 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.9"}]: dispatch 2024-03-30T15:12:43.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:43 smithi072 bash[21573]: cluster 2024-03-30T15:12:42.545373+0000 mon.a (mon.0) 1176 : cluster 0 osdmap e106: 8 total, 8 up, 8 in 2024-03-30T15:12:43.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:43 smithi072 bash[21573]: audit 2024-03-30T15:12:42.547528+0000 mon.b (mon.1) 42 : audit 1 from='client.? 172.21.15.72:0/520779460' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi072-64163-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:43.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:43 smithi072 bash[21573]: audit 2024-03-30T15:12:42.557410+0000 mon.a (mon.0) 1177 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:12:43.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:43 smithi072 bash[21573]: audit 2024-03-30T15:12:42.572801+0000 mon.a (mon.0) 1178 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64478-6", "mode": "writeback"}]: dispatch 2024-03-30T15:12:43.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:43 smithi072 bash[28946]: audit 2024-03-30T15:12:40.984006+0000 mgr.y (mgr.14526) 199 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:12:43.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:43 smithi072 bash[28946]: audit 2024-03-30T15:12:41.873924+0000 mon.a (mon.0) 1172 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:43.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:43 smithi072 bash[28946]: audit 2024-03-30T15:12:41.924011+0000 mon.a (mon.0) 1173 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi072-64478-4", "overlaypool": "test-rados-api-smithi072-64478-6"}]': finished 2024-03-30T15:12:43.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:43 smithi072 bash[28946]: audit 2024-03-30T15:12:41.924100+0000 mon.a (mon.0) 1174 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi072-64386-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:43.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:43 smithi072 bash[28946]: audit 2024-03-30T15:12:41.924162+0000 mon.a (mon.0) 1175 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi072-64444-12"}]': finished 2024-03-30T15:12:43.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:43 smithi072 bash[28946]: audit 2024-03-30T15:12:41.937582+0000 mon.b (mon.1) 41 : audit 1 from='client.? 172.21.15.72:0/4132408751' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi072-64444-12"}]: dispatch 2024-03-30T15:12:43.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:43 smithi072 bash[28946]: audit 2024-03-30T15:12:41.972485+0000 mon.c (mon.2) 187 : audit 1 from='client.? 172.21.15.72:0/4226267530' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64478-6", "mode": "writeback"}]: dispatch 2024-03-30T15:12:43.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:43 smithi072 bash[28946]: audit 2024-03-30T15:12:42.297751+0000 mon.c (mon.2) 188 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.0"}]: dispatch 2024-03-30T15:12:43.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:43 smithi072 bash[28946]: audit 2024-03-30T15:12:42.307512+0000 mon.c (mon.2) 189 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.1"}]: dispatch 2024-03-30T15:12:43.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:43 smithi072 bash[28946]: audit 2024-03-30T15:12:42.311170+0000 mon.c (mon.2) 190 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.2"}]: dispatch 2024-03-30T15:12:43.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:43 smithi072 bash[28946]: audit 2024-03-30T15:12:42.315000+0000 mon.c (mon.2) 191 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.3"}]: dispatch 2024-03-30T15:12:43.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:43 smithi072 bash[28946]: audit 2024-03-30T15:12:42.327475+0000 mon.c (mon.2) 192 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.4"}]: dispatch 2024-03-30T15:12:43.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:43 smithi072 bash[28946]: audit 2024-03-30T15:12:42.338275+0000 mon.c (mon.2) 193 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.5"}]: dispatch 2024-03-30T15:12:43.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:43 smithi072 bash[28946]: audit 2024-03-30T15:12:42.343096+0000 mon.c (mon.2) 194 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.6"}]: dispatch 2024-03-30T15:12:43.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:43 smithi072 bash[28946]: audit 2024-03-30T15:12:42.349526+0000 mon.c (mon.2) 195 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.7"}]: dispatch 2024-03-30T15:12:43.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:43 smithi072 bash[28946]: audit 2024-03-30T15:12:42.355085+0000 mon.c (mon.2) 196 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.8"}]: dispatch 2024-03-30T15:12:43.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:43 smithi072 bash[28946]: audit 2024-03-30T15:12:42.357265+0000 mon.c (mon.2) 197 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.9"}]: dispatch 2024-03-30T15:12:43.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:43 smithi072 bash[28946]: cluster 2024-03-30T15:12:42.545373+0000 mon.a (mon.0) 1176 : cluster 0 osdmap e106: 8 total, 8 up, 8 in 2024-03-30T15:12:43.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:43 smithi072 bash[28946]: audit 2024-03-30T15:12:42.547528+0000 mon.b (mon.1) 42 : audit 1 from='client.? 172.21.15.72:0/520779460' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi072-64163-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:43.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:43 smithi072 bash[28946]: audit 2024-03-30T15:12:42.557410+0000 mon.a (mon.0) 1177 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:12:43.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:43 smithi072 bash[28946]: audit 2024-03-30T15:12:42.572801+0000 mon.a (mon.0) 1178 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64478-6", "mode": "writeback"}]: dispatch 2024-03-30T15:12:43.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:43 smithi172 bash[23680]: audit 2024-03-30T15:12:40.984006+0000 mgr.y (mgr.14526) 199 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:12:43.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:43 smithi172 bash[23680]: audit 2024-03-30T15:12:41.873924+0000 mon.a (mon.0) 1172 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:43.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:43 smithi172 bash[23680]: audit 2024-03-30T15:12:41.924011+0000 mon.a (mon.0) 1173 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi072-64478-4", "overlaypool": "test-rados-api-smithi072-64478-6"}]': finished 2024-03-30T15:12:43.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:43 smithi172 bash[23680]: audit 2024-03-30T15:12:41.924100+0000 mon.a (mon.0) 1174 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi072-64386-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:43.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:43 smithi172 bash[23680]: audit 2024-03-30T15:12:41.924162+0000 mon.a (mon.0) 1175 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi072-64444-12"}]': finished 2024-03-30T15:12:43.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:43 smithi172 bash[23680]: audit 2024-03-30T15:12:41.937582+0000 mon.b (mon.1) 41 : audit 1 from='client.? 172.21.15.72:0/4132408751' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi072-64444-12"}]: dispatch 2024-03-30T15:12:43.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:43 smithi172 bash[23680]: audit 2024-03-30T15:12:41.972485+0000 mon.c (mon.2) 187 : audit 1 from='client.? 172.21.15.72:0/4226267530' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64478-6", "mode": "writeback"}]: dispatch 2024-03-30T15:12:43.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:43 smithi172 bash[23680]: audit 2024-03-30T15:12:42.297751+0000 mon.c (mon.2) 188 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.0"}]: dispatch 2024-03-30T15:12:43.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:43 smithi172 bash[23680]: audit 2024-03-30T15:12:42.307512+0000 mon.c (mon.2) 189 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.1"}]: dispatch 2024-03-30T15:12:43.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:43 smithi172 bash[23680]: audit 2024-03-30T15:12:42.311170+0000 mon.c (mon.2) 190 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.2"}]: dispatch 2024-03-30T15:12:43.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:43 smithi172 bash[23680]: audit 2024-03-30T15:12:42.315000+0000 mon.c (mon.2) 191 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.3"}]: dispatch 2024-03-30T15:12:43.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:43 smithi172 bash[23680]: audit 2024-03-30T15:12:42.327475+0000 mon.c (mon.2) 192 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.4"}]: dispatch 2024-03-30T15:12:43.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:43 smithi172 bash[23680]: audit 2024-03-30T15:12:42.338275+0000 mon.c (mon.2) 193 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.5"}]: dispatch 2024-03-30T15:12:43.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:43 smithi172 bash[23680]: audit 2024-03-30T15:12:42.343096+0000 mon.c (mon.2) 194 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.6"}]: dispatch 2024-03-30T15:12:43.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:43 smithi172 bash[23680]: audit 2024-03-30T15:12:42.349526+0000 mon.c (mon.2) 195 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.7"}]: dispatch 2024-03-30T15:12:43.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:43 smithi172 bash[23680]: audit 2024-03-30T15:12:42.355085+0000 mon.c (mon.2) 196 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.8"}]: dispatch 2024-03-30T15:12:43.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:43 smithi172 bash[23680]: audit 2024-03-30T15:12:42.357265+0000 mon.c (mon.2) 197 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.9"}]: dispatch 2024-03-30T15:12:43.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:43 smithi172 bash[23680]: cluster 2024-03-30T15:12:42.545373+0000 mon.a (mon.0) 1176 : cluster 0 osdmap e106: 8 total, 8 up, 8 in 2024-03-30T15:12:43.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:43 smithi172 bash[23680]: audit 2024-03-30T15:12:42.547528+0000 mon.b (mon.1) 42 : audit 1 from='client.? 172.21.15.72:0/520779460' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi072-64163-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:43.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:43 smithi172 bash[23680]: audit 2024-03-30T15:12:42.557410+0000 mon.a (mon.0) 1177 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:12:43.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:43 smithi172 bash[23680]: audit 2024-03-30T15:12:42.572801+0000 mon.a (mon.0) 1178 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64478-6", "mode": "writeback"}]: dispatch 2024-03-30T15:12:44.354 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: Running main() from gmock_main.cc 2024-03-30T15:12:44.354 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: [==========] Running 11 tests from 2 test suites. 2024-03-30T15:12:44.354 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: [----------] Global test environment set-up. 2024-03-30T15:12:44.354 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify 2024-03-30T15:12:44.354 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify 2024-03-30T15:12:44.354 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: watch_notify_test_cb 2024-03-30T15:12:44.354 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify (96 ms) 2024-03-30T15:12:44.354 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch2Delete 2024-03-30T15:12:44.354 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94062996299952 err -107 2024-03-30T15:12:44.354 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2024-03-30T15:12:44.354 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch2Delete (6 ms) 2024-03-30T15:12:44.355 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete 2024-03-30T15:12:44.355 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94062996319888 err -107 2024-03-30T15:12:44.355 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2024-03-30T15:12:44.355 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete (8 ms) 2024-03-30T15:12:44.355 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2 2024-03-30T15:12:44.355 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: watch_notify2_test_cb from 14844 notify_id 347892350976 cookie 94062996334064 2024-03-30T15:12:44.355 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2 (8 ms) 2024-03-30T15:12:44.355 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchNotify2 2024-03-30T15:12:44.355 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: watch_notify2_test_cb from 14844 notify_id 347892350976 cookie 94062996334064 2024-03-30T15:12:44.355 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchNotify2 (10 ms) 2024-03-30T15:12:44.355 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioNotify 2024-03-30T15:12:44.355 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: watch_notify2_test_cb from 14844 notify_id 347892350978 cookie 94062996334064 2024-03-30T15:12:44.355 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioNotify (7 ms) 2024-03-30T15:12:44.356 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2024-03-30T15:12:44.356 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: watch_notify2_test_cb from 14844 notify_id 347892350976 cookie 94062996369472 2024-03-30T15:12:44.356 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: watch_notify2_test_cb from 14844 notify_id 347892350976 cookie 94062996388208 2024-03-30T15:12:44.356 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Multi (13 ms) 2024-03-30T15:12:44.356 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2024-03-30T15:12:44.356 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: watch_notify2_test_cb from 14844 notify_id 347892350978 cookie 94062996388208 2024-03-30T15:12:44.356 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: watch_notify2_test_cb from 14844 notify_id 347892350979 cookie 94062996388208 2024-03-30T15:12:44.356 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Timeout (3010 ms) 2024-03-30T15:12:44.356 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch3Timeout 2024-03-30T15:12:44.356 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: waiting up to 1024 for osd to time us out ... 2024-03-30T15:12:44.356 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94062996388208 err -107 2024-03-30T15:12:44.356 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: watch_notify2_test_cb from 14844 notify_id 369367187457 cookie 94062996388208 2024-03-30T15:12:44.356 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch3Timeout (5016 ms) 2024-03-30T15:12:44.356 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete2 2024-03-30T15:12:44.357 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: waiting up to 30 for disconnect notification ... 2024-03-30T15:12:44.357 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94062996388208 err -107 2024-03-30T15:12:44.357 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete2 (1009 ms) 2024-03-30T15:12:44.357 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify (9183 ms total) 2024-03-30T15:12:44.357 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: 2024-03-30T15:12:44.357 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC 2024-03-30T15:12:44.357 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotifyEC.WatchNotify 2024-03-30T15:12:44.357 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: watch_notify_test_cb 2024-03-30T15:12:44.357 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: [ OK ] LibRadosWatchNotifyEC.WatchNotify (2922 ms) 2024-03-30T15:12:44.357 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC (2923 ms total) 2024-03-30T15:12:44.357 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: 2024-03-30T15:12:44.357 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: [----------] Global test environment tear-down 2024-03-30T15:12:44.357 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: [==========] 11 tests from 2 test suites ran. (52271 ms total) 2024-03-30T15:12:44.357 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify: [ PASSED ] 11 tests. 2024-03-30T15:12:44.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[21573]: cluster 2024-03-30T15:12:41.868771+0000 mgr.y (mgr.14526) 200 : cluster 0 pgmap v160: 648 pgs: 57 unknown, 187 creating+peering, 404 active+clean; 145 MiB data, 798 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 641 B/s wr, 1 op/s 2024-03-30T15:12:44.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[21573]: audit 2024-03-30T15:12:42.301132+0000 mgr.y (mgr.14526) 201 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.0"}]: dispatch 2024-03-30T15:12:44.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[21573]: audit 2024-03-30T15:12:42.309378+0000 mgr.y (mgr.14526) 202 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.1"}]: dispatch 2024-03-30T15:12:44.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[21573]: audit 2024-03-30T15:12:42.313322+0000 mgr.y (mgr.14526) 203 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.2"}]: dispatch 2024-03-30T15:12:44.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[21573]: audit 2024-03-30T15:12:42.315270+0000 mgr.y (mgr.14526) 204 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.3"}]: dispatch 2024-03-30T15:12:44.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[21573]: audit 2024-03-30T15:12:42.333124+0000 mgr.y (mgr.14526) 205 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.4"}]: dispatch 2024-03-30T15:12:44.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[21573]: audit 2024-03-30T15:12:42.339598+0000 mgr.y (mgr.14526) 206 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.5"}]: dispatch 2024-03-30T15:12:44.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[21573]: audit 2024-03-30T15:12:42.344476+0000 mgr.y (mgr.14526) 207 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.6"}]: dispatch 2024-03-30T15:12:44.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[21573]: audit 2024-03-30T15:12:42.350841+0000 mgr.y (mgr.14526) 208 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.7"}]: dispatch 2024-03-30T15:12:44.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[21573]: audit 2024-03-30T15:12:42.355404+0000 mgr.y (mgr.14526) 209 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.8"}]: dispatch 2024-03-30T15:12:44.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[21573]: audit 2024-03-30T15:12:42.359751+0000 mgr.y (mgr.14526) 210 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.9"}]: dispatch 2024-03-30T15:12:44.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[21573]: audit 2024-03-30T15:12:42.567888+0000 mon.c (mon.2) 198 : audit 1 from='client.? 172.21.15.72:0/3186597845' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:44.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[21573]: cluster 2024-03-30T15:12:42.871111+0000 osd.3 (osd.3) 9 : cluster 0 38.9 deep-scrub starts 2024-03-30T15:12:44.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[21573]: cluster 2024-03-30T15:12:42.876317+0000 osd.3 (osd.3) 10 : cluster 0 38.9 deep-scrub ok 2024-03-30T15:12:44.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[21573]: cluster 2024-03-30T15:12:43.102602+0000 mon.a (mon.0) 1179 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:12:44.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[21573]: audit 2024-03-30T15:12:43.124124+0000 mon.a (mon.0) 1180 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:44.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[21573]: audit 2024-03-30T15:12:43.125610+0000 mon.a (mon.0) 1181 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi072-64882-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi072-64882-3"}]': finished 2024-03-30T15:12:44.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[21573]: audit 2024-03-30T15:12:43.125744+0000 mon.a (mon.0) 1182 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-7", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:12:44.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[21573]: audit 2024-03-30T15:12:43.125814+0000 mon.a (mon.0) 1183 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64478-6", "mode": "writeback"}]': finished 2024-03-30T15:12:44.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[21573]: cluster 2024-03-30T15:12:43.134527+0000 mon.a (mon.0) 1184 : cluster 0 osdmap e107: 8 total, 8 up, 8 in 2024-03-30T15:12:44.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[21573]: audit 2024-03-30T15:12:43.139658+0000 mon.b (mon.1) 43 : audit 1 from='client.? 172.21.15.72:0/196193379' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi072-64171-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:44.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[21573]: audit 2024-03-30T15:12:43.149794+0000 mon.a (mon.0) 1185 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-7"}]: dispatch 2024-03-30T15:12:44.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[21573]: audit 2024-03-30T15:12:43.753470+0000 mon.a (mon.0) 1186 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi072-64444-12"}]: dispatch 2024-03-30T15:12:44.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[21573]: audit 2024-03-30T15:12:43.760386+0000 mon.a (mon.0) 1187 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:44.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[28946]: cluster 2024-03-30T15:12:41.868771+0000 mgr.y (mgr.14526) 200 : cluster 0 pgmap v160: 648 pgs: 57 unknown, 187 creating+peering, 404 active+clean; 145 MiB data, 798 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 641 B/s wr, 1 op/s 2024-03-30T15:12:44.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[28946]: audit 2024-03-30T15:12:42.301132+0000 mgr.y (mgr.14526) 201 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.0"}]: dispatch 2024-03-30T15:12:44.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[28946]: audit 2024-03-30T15:12:42.309378+0000 mgr.y (mgr.14526) 202 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.1"}]: dispatch 2024-03-30T15:12:44.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[28946]: audit 2024-03-30T15:12:42.313322+0000 mgr.y (mgr.14526) 203 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.2"}]: dispatch 2024-03-30T15:12:44.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[28946]: audit 2024-03-30T15:12:42.315270+0000 mgr.y (mgr.14526) 204 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.3"}]: dispatch 2024-03-30T15:12:44.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[28946]: audit 2024-03-30T15:12:42.333124+0000 mgr.y (mgr.14526) 205 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.4"}]: dispatch 2024-03-30T15:12:44.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[28946]: audit 2024-03-30T15:12:42.339598+0000 mgr.y (mgr.14526) 206 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.5"}]: dispatch 2024-03-30T15:12:44.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[28946]: audit 2024-03-30T15:12:42.344476+0000 mgr.y (mgr.14526) 207 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.6"}]: dispatch 2024-03-30T15:12:44.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[28946]: audit 2024-03-30T15:12:42.350841+0000 mgr.y (mgr.14526) 208 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.7"}]: dispatch 2024-03-30T15:12:44.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[28946]: audit 2024-03-30T15:12:42.355404+0000 mgr.y (mgr.14526) 209 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.8"}]: dispatch 2024-03-30T15:12:44.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[28946]: audit 2024-03-30T15:12:42.359751+0000 mgr.y (mgr.14526) 210 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.9"}]: dispatch 2024-03-30T15:12:44.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[28946]: audit 2024-03-30T15:12:42.567888+0000 mon.c (mon.2) 198 : audit 1 from='client.? 172.21.15.72:0/3186597845' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:44.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[28946]: cluster 2024-03-30T15:12:42.871111+0000 osd.3 (osd.3) 9 : cluster 0 38.9 deep-scrub starts 2024-03-30T15:12:44.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[28946]: cluster 2024-03-30T15:12:42.876317+0000 osd.3 (osd.3) 10 : cluster 0 38.9 deep-scrub ok 2024-03-30T15:12:44.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[28946]: cluster 2024-03-30T15:12:43.102602+0000 mon.a (mon.0) 1179 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:12:44.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[28946]: audit 2024-03-30T15:12:43.124124+0000 mon.a (mon.0) 1180 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:44.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[28946]: audit 2024-03-30T15:12:43.125610+0000 mon.a (mon.0) 1181 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi072-64882-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi072-64882-3"}]': finished 2024-03-30T15:12:44.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[28946]: audit 2024-03-30T15:12:43.125744+0000 mon.a (mon.0) 1182 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-7", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:12:44.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[28946]: audit 2024-03-30T15:12:43.125814+0000 mon.a (mon.0) 1183 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64478-6", "mode": "writeback"}]': finished 2024-03-30T15:12:44.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[28946]: cluster 2024-03-30T15:12:43.134527+0000 mon.a (mon.0) 1184 : cluster 0 osdmap e107: 8 total, 8 up, 8 in 2024-03-30T15:12:44.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[28946]: audit 2024-03-30T15:12:43.139658+0000 mon.b (mon.1) 43 : audit 1 from='client.? 172.21.15.72:0/196193379' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi072-64171-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:44.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[28946]: audit 2024-03-30T15:12:43.149794+0000 mon.a (mon.0) 1185 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-7"}]: dispatch 2024-03-30T15:12:44.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[28946]: audit 2024-03-30T15:12:43.753470+0000 mon.a (mon.0) 1186 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi072-64444-12"}]: dispatch 2024-03-30T15:12:44.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:44 smithi072 bash[28946]: audit 2024-03-30T15:12:43.760386+0000 mon.a (mon.0) 1187 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:44.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:44 smithi172 bash[23680]: cluster 2024-03-30T15:12:41.868771+0000 mgr.y (mgr.14526) 200 : cluster 0 pgmap v160: 648 pgs: 57 unknown, 187 creating+peering, 404 active+clean; 145 MiB data, 798 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 641 B/s wr, 1 op/s 2024-03-30T15:12:44.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:44 smithi172 bash[23680]: audit 2024-03-30T15:12:42.301132+0000 mgr.y (mgr.14526) 201 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.0"}]: dispatch 2024-03-30T15:12:44.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:44 smithi172 bash[23680]: audit 2024-03-30T15:12:42.309378+0000 mgr.y (mgr.14526) 202 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.1"}]: dispatch 2024-03-30T15:12:44.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:44 smithi172 bash[23680]: audit 2024-03-30T15:12:42.313322+0000 mgr.y (mgr.14526) 203 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.2"}]: dispatch 2024-03-30T15:12:44.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:44 smithi172 bash[23680]: audit 2024-03-30T15:12:42.315270+0000 mgr.y (mgr.14526) 204 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.3"}]: dispatch 2024-03-30T15:12:44.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:44 smithi172 bash[23680]: audit 2024-03-30T15:12:42.333124+0000 mgr.y (mgr.14526) 205 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.4"}]: dispatch 2024-03-30T15:12:44.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:44 smithi172 bash[23680]: audit 2024-03-30T15:12:42.339598+0000 mgr.y (mgr.14526) 206 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.5"}]: dispatch 2024-03-30T15:12:44.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:44 smithi172 bash[23680]: audit 2024-03-30T15:12:42.344476+0000 mgr.y (mgr.14526) 207 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.6"}]: dispatch 2024-03-30T15:12:44.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:44 smithi172 bash[23680]: audit 2024-03-30T15:12:42.350841+0000 mgr.y (mgr.14526) 208 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.7"}]: dispatch 2024-03-30T15:12:44.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:44 smithi172 bash[23680]: audit 2024-03-30T15:12:42.355404+0000 mgr.y (mgr.14526) 209 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.8"}]: dispatch 2024-03-30T15:12:44.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:44 smithi172 bash[23680]: audit 2024-03-30T15:12:42.359751+0000 mgr.y (mgr.14526) 210 : audit 0 from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "38.9"}]: dispatch 2024-03-30T15:12:44.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:44 smithi172 bash[23680]: audit 2024-03-30T15:12:42.567888+0000 mon.c (mon.2) 198 : audit 1 from='client.? 172.21.15.72:0/3186597845' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:44.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:44 smithi172 bash[23680]: cluster 2024-03-30T15:12:42.871111+0000 osd.3 (osd.3) 9 : cluster 0 38.9 deep-scrub starts 2024-03-30T15:12:44.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:44 smithi172 bash[23680]: cluster 2024-03-30T15:12:42.876317+0000 osd.3 (osd.3) 10 : cluster 0 38.9 deep-scrub ok 2024-03-30T15:12:44.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:44 smithi172 bash[23680]: cluster 2024-03-30T15:12:43.102602+0000 mon.a (mon.0) 1179 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:12:44.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:44 smithi172 bash[23680]: audit 2024-03-30T15:12:43.124124+0000 mon.a (mon.0) 1180 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:44.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:44 smithi172 bash[23680]: audit 2024-03-30T15:12:43.125610+0000 mon.a (mon.0) 1181 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi072-64882-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi072-64882-3"}]': finished 2024-03-30T15:12:44.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:44 smithi172 bash[23680]: audit 2024-03-30T15:12:43.125744+0000 mon.a (mon.0) 1182 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-7", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:12:44.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:44 smithi172 bash[23680]: audit 2024-03-30T15:12:43.125814+0000 mon.a (mon.0) 1183 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64478-6", "mode": "writeback"}]': finished 2024-03-30T15:12:44.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:44 smithi172 bash[23680]: cluster 2024-03-30T15:12:43.134527+0000 mon.a (mon.0) 1184 : cluster 0 osdmap e107: 8 total, 8 up, 8 in 2024-03-30T15:12:44.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:44 smithi172 bash[23680]: audit 2024-03-30T15:12:43.139658+0000 mon.b (mon.1) 43 : audit 1 from='client.? 172.21.15.72:0/196193379' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi072-64171-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:44.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:44 smithi172 bash[23680]: audit 2024-03-30T15:12:43.149794+0000 mon.a (mon.0) 1185 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-7"}]: dispatch 2024-03-30T15:12:44.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:44 smithi172 bash[23680]: audit 2024-03-30T15:12:43.753470+0000 mon.a (mon.0) 1186 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi072-64444-12"}]: dispatch 2024-03-30T15:12:44.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:44 smithi172 bash[23680]: audit 2024-03-30T15:12:43.760386+0000 mon.a (mon.0) 1187 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:45.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[21573]: cluster 2024-03-30T15:12:42.857245+0000 osd.4 (osd.4) 5 : cluster 0 38.0 deep-scrub starts 2024-03-30T15:12:45.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[21573]: cluster 2024-03-30T15:12:42.862559+0000 osd.4 (osd.4) 6 : cluster 0 38.0 deep-scrub ok 2024-03-30T15:12:45.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[21573]: cluster 2024-03-30T15:12:43.111152+0000 osd.0 (osd.0) 7 : cluster 0 38.6 deep-scrub starts 2024-03-30T15:12:45.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[21573]: cluster 2024-03-30T15:12:43.118547+0000 osd.0 (osd.0) 8 : cluster 0 38.6 deep-scrub ok 2024-03-30T15:12:45.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[21573]: cluster 2024-03-30T15:12:43.140081+0000 osd.7 (osd.7) 7 : cluster 0 38.8 deep-scrub starts 2024-03-30T15:12:45.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[21573]: cluster 2024-03-30T15:12:43.191009+0000 osd.7 (osd.7) 8 : cluster 0 38.8 deep-scrub ok 2024-03-30T15:12:45.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[21573]: cluster 2024-03-30T15:12:43.274830+0000 osd.6 (osd.6) 7 : cluster 0 38.3 deep-scrub starts 2024-03-30T15:12:45.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[21573]: cluster 2024-03-30T15:12:43.286146+0000 osd.6 (osd.6) 8 : cluster 0 38.3 deep-scrub ok 2024-03-30T15:12:45.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[21573]: cluster 2024-03-30T15:12:43.869933+0000 mgr.y (mgr.14526) 211 : cluster 0 pgmap v163: 656 pgs: 161 unknown, 123 creating+peering, 372 active+clean; 145 MiB data, 798 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 478 B/s wr, 1 op/s 2024-03-30T15:12:45.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[21573]: cluster 2024-03-30T15:12:43.889983+0000 osd.3 (osd.3) 11 : cluster 0 38.2 deep-scrub starts 2024-03-30T15:12:45.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[21573]: cluster 2024-03-30T15:12:43.944746+0000 osd.3 (osd.3) 12 : cluster 0 38.2 deep-scrub ok 2024-03-30T15:12:45.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[21573]: cluster 2024-03-30T15:12:44.148135+0000 osd.0 (osd.0) 9 : cluster 0 38.1 deep-scrub starts 2024-03-30T15:12:45.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[21573]: cluster 2024-03-30T15:12:44.153252+0000 osd.0 (osd.0) 10 : cluster 0 38.1 deep-scrub ok 2024-03-30T15:12:45.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[21573]: cluster 2024-03-30T15:12:44.236136+0000 osd.6 (osd.6) 9 : cluster 0 38.5 deep-scrub starts 2024-03-30T15:12:45.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[21573]: cluster 2024-03-30T15:12:44.238797+0000 osd.6 (osd.6) 10 : cluster 0 38.5 deep-scrub ok 2024-03-30T15:12:45.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[21573]: cluster 2024-03-30T15:12:44.282976+0000 mon.a (mon.0) 1188 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:12:45.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[21573]: audit 2024-03-30T15:12:44.300916+0000 mon.a (mon.0) 1189 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:45.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[21573]: audit 2024-03-30T15:12:44.303911+0000 mon.a (mon.0) 1190 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-7"}]': finished 2024-03-30T15:12:45.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[21573]: audit 2024-03-30T15:12:44.304014+0000 mon.a (mon.0) 1191 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi072-64444-12"}]': finished 2024-03-30T15:12:45.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[21573]: audit 2024-03-30T15:12:44.304099+0000 mon.a (mon.0) 1192 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:45.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[21573]: cluster 2024-03-30T15:12:44.309974+0000 mon.a (mon.0) 1193 : cluster 0 osdmap e108: 8 total, 8 up, 8 in 2024-03-30T15:12:45.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[21573]: audit 2024-03-30T15:12:44.352348+0000 mon.a (mon.0) 1194 : audit 1 from='client.? 172.21.15.72:0/2830464926' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:45.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[21573]: audit 2024-03-30T15:12:44.357149+0000 mon.a (mon.0) 1195 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi072-64163-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:45.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[21573]: audit 2024-03-30T15:12:44.361443+0000 mon.a (mon.0) 1196 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi072-64171-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:45.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[21573]: audit 2024-03-30T15:12:44.461035+0000 mon.a (mon.0) 1197 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:12:45.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[21573]: cluster 2024-03-30T15:12:44.935537+0000 osd.3 (osd.3) 13 : cluster 0 38.7 deep-scrub starts 2024-03-30T15:12:45.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[21573]: cluster 2024-03-30T15:12:44.937592+0000 osd.3 (osd.3) 14 : cluster 0 38.7 deep-scrub ok 2024-03-30T15:12:45.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[28946]: cluster 2024-03-30T15:12:42.857245+0000 osd.4 (osd.4) 5 : cluster 0 38.0 deep-scrub starts 2024-03-30T15:12:45.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[28946]: cluster 2024-03-30T15:12:42.862559+0000 osd.4 (osd.4) 6 : cluster 0 38.0 deep-scrub ok 2024-03-30T15:12:45.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[28946]: cluster 2024-03-30T15:12:43.111152+0000 osd.0 (osd.0) 7 : cluster 0 38.6 deep-scrub starts 2024-03-30T15:12:45.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[28946]: cluster 2024-03-30T15:12:43.118547+0000 osd.0 (osd.0) 8 : cluster 0 38.6 deep-scrub ok 2024-03-30T15:12:45.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[28946]: cluster 2024-03-30T15:12:43.140081+0000 osd.7 (osd.7) 7 : cluster 0 38.8 deep-scrub starts 2024-03-30T15:12:45.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[28946]: cluster 2024-03-30T15:12:43.191009+0000 osd.7 (osd.7) 8 : cluster 0 38.8 deep-scrub ok 2024-03-30T15:12:45.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[28946]: cluster 2024-03-30T15:12:43.274830+0000 osd.6 (osd.6) 7 : cluster 0 38.3 deep-scrub starts 2024-03-30T15:12:45.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[28946]: cluster 2024-03-30T15:12:43.286146+0000 osd.6 (osd.6) 8 : cluster 0 38.3 deep-scrub ok 2024-03-30T15:12:45.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[28946]: cluster 2024-03-30T15:12:43.869933+0000 mgr.y (mgr.14526) 211 : cluster 0 pgmap v163: 656 pgs: 161 unknown, 123 creating+peering, 372 active+clean; 145 MiB data, 798 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 478 B/s wr, 1 op/s 2024-03-30T15:12:45.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[28946]: cluster 2024-03-30T15:12:43.889983+0000 osd.3 (osd.3) 11 : cluster 0 38.2 deep-scrub starts 2024-03-30T15:12:45.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[28946]: cluster 2024-03-30T15:12:43.944746+0000 osd.3 (osd.3) 12 : cluster 0 38.2 deep-scrub ok 2024-03-30T15:12:45.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[28946]: cluster 2024-03-30T15:12:44.148135+0000 osd.0 (osd.0) 9 : cluster 0 38.1 deep-scrub starts 2024-03-30T15:12:45.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[28946]: cluster 2024-03-30T15:12:44.153252+0000 osd.0 (osd.0) 10 : cluster 0 38.1 deep-scrub ok 2024-03-30T15:12:45.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[28946]: cluster 2024-03-30T15:12:44.236136+0000 osd.6 (osd.6) 9 : cluster 0 38.5 deep-scrub starts 2024-03-30T15:12:45.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[28946]: cluster 2024-03-30T15:12:44.238797+0000 osd.6 (osd.6) 10 : cluster 0 38.5 deep-scrub ok 2024-03-30T15:12:45.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[28946]: cluster 2024-03-30T15:12:44.282976+0000 mon.a (mon.0) 1188 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:12:45.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[28946]: audit 2024-03-30T15:12:44.300916+0000 mon.a (mon.0) 1189 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:45.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[28946]: audit 2024-03-30T15:12:44.303911+0000 mon.a (mon.0) 1190 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-7"}]': finished 2024-03-30T15:12:45.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[28946]: audit 2024-03-30T15:12:44.304014+0000 mon.a (mon.0) 1191 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi072-64444-12"}]': finished 2024-03-30T15:12:45.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[28946]: audit 2024-03-30T15:12:44.304099+0000 mon.a (mon.0) 1192 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:45.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[28946]: cluster 2024-03-30T15:12:44.309974+0000 mon.a (mon.0) 1193 : cluster 0 osdmap e108: 8 total, 8 up, 8 in 2024-03-30T15:12:45.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[28946]: audit 2024-03-30T15:12:44.352348+0000 mon.a (mon.0) 1194 : audit 1 from='client.? 172.21.15.72:0/2830464926' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:45.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[28946]: audit 2024-03-30T15:12:44.357149+0000 mon.a (mon.0) 1195 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi072-64163-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:45.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[28946]: audit 2024-03-30T15:12:44.361443+0000 mon.a (mon.0) 1196 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi072-64171-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:45.672 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[28946]: audit 2024-03-30T15:12:44.461035+0000 mon.a (mon.0) 1197 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:12:45.672 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[28946]: cluster 2024-03-30T15:12:44.935537+0000 osd.3 (osd.3) 13 : cluster 0 38.7 deep-scrub starts 2024-03-30T15:12:45.672 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:45 smithi072 bash[28946]: cluster 2024-03-30T15:12:44.937592+0000 osd.3 (osd.3) 14 : cluster 0 38.7 deep-scrub ok 2024-03-30T15:12:45.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:45 smithi172 bash[23680]: cluster 2024-03-30T15:12:42.857245+0000 osd.4 (osd.4) 5 : cluster 0 38.0 deep-scrub starts 2024-03-30T15:12:45.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:45 smithi172 bash[23680]: cluster 2024-03-30T15:12:42.862559+0000 osd.4 (osd.4) 6 : cluster 0 38.0 deep-scrub ok 2024-03-30T15:12:45.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:45 smithi172 bash[23680]: cluster 2024-03-30T15:12:43.111152+0000 osd.0 (osd.0) 7 : cluster 0 38.6 deep-scrub starts 2024-03-30T15:12:45.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:45 smithi172 bash[23680]: cluster 2024-03-30T15:12:43.118547+0000 osd.0 (osd.0) 8 : cluster 0 38.6 deep-scrub ok 2024-03-30T15:12:45.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:45 smithi172 bash[23680]: cluster 2024-03-30T15:12:43.140081+0000 osd.7 (osd.7) 7 : cluster 0 38.8 deep-scrub starts 2024-03-30T15:12:45.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:45 smithi172 bash[23680]: cluster 2024-03-30T15:12:43.191009+0000 osd.7 (osd.7) 8 : cluster 0 38.8 deep-scrub ok 2024-03-30T15:12:45.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:45 smithi172 bash[23680]: cluster 2024-03-30T15:12:43.274830+0000 osd.6 (osd.6) 7 : cluster 0 38.3 deep-scrub starts 2024-03-30T15:12:45.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:45 smithi172 bash[23680]: cluster 2024-03-30T15:12:43.286146+0000 osd.6 (osd.6) 8 : cluster 0 38.3 deep-scrub ok 2024-03-30T15:12:45.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:45 smithi172 bash[23680]: cluster 2024-03-30T15:12:43.869933+0000 mgr.y (mgr.14526) 211 : cluster 0 pgmap v163: 656 pgs: 161 unknown, 123 creating+peering, 372 active+clean; 145 MiB data, 798 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 478 B/s wr, 1 op/s 2024-03-30T15:12:45.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:45 smithi172 bash[23680]: cluster 2024-03-30T15:12:43.889983+0000 osd.3 (osd.3) 11 : cluster 0 38.2 deep-scrub starts 2024-03-30T15:12:45.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:45 smithi172 bash[23680]: cluster 2024-03-30T15:12:43.944746+0000 osd.3 (osd.3) 12 : cluster 0 38.2 deep-scrub ok 2024-03-30T15:12:45.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:45 smithi172 bash[23680]: cluster 2024-03-30T15:12:44.148135+0000 osd.0 (osd.0) 9 : cluster 0 38.1 deep-scrub starts 2024-03-30T15:12:45.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:45 smithi172 bash[23680]: cluster 2024-03-30T15:12:44.153252+0000 osd.0 (osd.0) 10 : cluster 0 38.1 deep-scrub ok 2024-03-30T15:12:45.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:45 smithi172 bash[23680]: cluster 2024-03-30T15:12:44.236136+0000 osd.6 (osd.6) 9 : cluster 0 38.5 deep-scrub starts 2024-03-30T15:12:45.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:45 smithi172 bash[23680]: cluster 2024-03-30T15:12:44.238797+0000 osd.6 (osd.6) 10 : cluster 0 38.5 deep-scrub ok 2024-03-30T15:12:45.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:45 smithi172 bash[23680]: cluster 2024-03-30T15:12:44.282976+0000 mon.a (mon.0) 1188 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:12:45.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:45 smithi172 bash[23680]: audit 2024-03-30T15:12:44.300916+0000 mon.a (mon.0) 1189 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:45.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:45 smithi172 bash[23680]: audit 2024-03-30T15:12:44.303911+0000 mon.a (mon.0) 1190 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-7"}]': finished 2024-03-30T15:12:45.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:45 smithi172 bash[23680]: audit 2024-03-30T15:12:44.304014+0000 mon.a (mon.0) 1191 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi072-64444-12"}]': finished 2024-03-30T15:12:45.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:45 smithi172 bash[23680]: audit 2024-03-30T15:12:44.304099+0000 mon.a (mon.0) 1192 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:45.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:45 smithi172 bash[23680]: cluster 2024-03-30T15:12:44.309974+0000 mon.a (mon.0) 1193 : cluster 0 osdmap e108: 8 total, 8 up, 8 in 2024-03-30T15:12:45.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:45 smithi172 bash[23680]: audit 2024-03-30T15:12:44.352348+0000 mon.a (mon.0) 1194 : audit 1 from='client.? 172.21.15.72:0/2830464926' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:45.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:45 smithi172 bash[23680]: audit 2024-03-30T15:12:44.357149+0000 mon.a (mon.0) 1195 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi072-64163-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:45.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:45 smithi172 bash[23680]: audit 2024-03-30T15:12:44.361443+0000 mon.a (mon.0) 1196 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi072-64171-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:45.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:45 smithi172 bash[23680]: audit 2024-03-30T15:12:44.461035+0000 mon.a (mon.0) 1197 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:12:45.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:45 smithi172 bash[23680]: cluster 2024-03-30T15:12:44.935537+0000 osd.3 (osd.3) 13 : cluster 0 38.7 deep-scrub starts 2024-03-30T15:12:45.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:45 smithi172 bash[23680]: cluster 2024-03-30T15:12:44.937592+0000 osd.3 (osd.3) 14 : cluster 0 38.7 deep-scrub ok 2024-03-30T15:12:46.384 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: Running main() from gmock_main.cc 2024-03-30T15:12:46.384 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: [==========] Running 16 tests from 2 test suites. 2024-03-30T15:12:46.384 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: [----------] Global test environment set-up. 2024-03-30T15:12:46.384 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP 2024-03-30T15:12:46.384 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2024-03-30T15:12:46.385 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: notify 2024-03-30T15:12:46.385 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotify (7206 ms) 2024-03-30T15:12:46.385 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2024-03-30T15:12:46.385 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (4 ms) 2024-03-30T15:12:46.385 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP (7210 ms total) 2024-03-30T15:12:46.385 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: 2024-03-30T15:12:46.385 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2024-03-30T15:12:46.385 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2024-03-30T15:12:46.385 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: notify 2024-03-30T15:12:46.385 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (177 ms) 2024-03-30T15:12:46.385 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2024-03-30T15:12:46.385 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: notify 2024-03-30T15:12:46.385 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (10435 ms) 2024-03-30T15:12:46.385 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2024-03-30T15:12:46.386 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (8 ms) 2024-03-30T15:12:46.386 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2024-03-30T15:12:46.386 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (23 ms) 2024-03-30T15:12:46.386 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2024-03-30T15:12:46.386 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: handle_notify cookie 94363808553488 notify_id 459561500672 notifier_gid 25256 2024-03-30T15:12:46.386 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (26 ms) 2024-03-30T15:12:46.386 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2024-03-30T15:12:46.386 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: handle_notify cookie 94363809288384 notify_id 459561500679 notifier_gid 25256 2024-03-30T15:12:46.386 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (14 ms) 2024-03-30T15:12:46.386 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2024-03-30T15:12:46.386 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: handle_notify cookie 94363808553488 notify_id 459561500674 notifier_gid 25256 2024-03-30T15:12:46.386 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (14 ms) 2024-03-30T15:12:46.386 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2024-03-30T15:12:46.387 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: handle_notify cookie 94363809290784 notify_id 459561500680 notifier_gid 25256 2024-03-30T15:12:46.387 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (27 ms) 2024-03-30T15:12:46.387 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2024-03-30T15:12:46.387 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: handle_notify cookie 94363809290784 notify_id 459561500675 notifier_gid 25256 2024-03-30T15:12:46.387 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (14 ms) 2024-03-30T15:12:46.387 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2024-03-30T15:12:46.387 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: handle_notify cookie 94363809290784 notify_id 459561500681 notifier_gid 25256 2024-03-30T15:12:46.387 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (7 ms) 2024-03-30T15:12:46.387 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2024-03-30T15:12:46.387 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: trying... 2024-03-30T15:12:46.387 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: handle_notify cookie 94363809290784 notify_id 459561500676 notifier_gid 25256 2024-03-30T15:12:46.387 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: timed out 2024-03-30T15:12:46.387 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: flushing 2024-03-30T15:12:46.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:46 smithi072 bash[21573]: audit 2024-03-30T15:12:45.302327+0000 mon.a (mon.0) 1198 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:46.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:46 smithi072 bash[21573]: audit 2024-03-30T15:12:45.307901+0000 mon.a (mon.0) 1199 : audit 1 from='client.? 172.21.15.72:0/2830464926' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:46.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:46 smithi072 bash[21573]: audit 2024-03-30T15:12:45.307979+0000 mon.a (mon.0) 1200 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi072-64163-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:46.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:46 smithi072 bash[21573]: audit 2024-03-30T15:12:45.308186+0000 mon.a (mon.0) 1201 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi072-64171-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:46.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:46 smithi072 bash[21573]: audit 2024-03-30T15:12:45.308255+0000 mon.a (mon.0) 1202 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:12:46.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:46 smithi072 bash[21573]: cluster 2024-03-30T15:12:45.314136+0000 mon.a (mon.0) 1203 : cluster 0 osdmap e109: 8 total, 8 up, 8 in 2024-03-30T15:12:46.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:46 smithi072 bash[21573]: audit 2024-03-30T15:12:45.314866+0000 mon.a (mon.0) 1204 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-7"}]: dispatch 2024-03-30T15:12:46.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:46 smithi072 bash[28946]: audit 2024-03-30T15:12:45.302327+0000 mon.a (mon.0) 1198 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:46.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:46 smithi072 bash[28946]: audit 2024-03-30T15:12:45.307901+0000 mon.a (mon.0) 1199 : audit 1 from='client.? 172.21.15.72:0/2830464926' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:46.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:46 smithi072 bash[28946]: audit 2024-03-30T15:12:45.307979+0000 mon.a (mon.0) 1200 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi072-64163-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:46.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:46 smithi072 bash[28946]: audit 2024-03-30T15:12:45.308186+0000 mon.a (mon.0) 1201 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi072-64171-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:46.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:46 smithi072 bash[28946]: audit 2024-03-30T15:12:45.308255+0000 mon.a (mon.0) 1202 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:12:46.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:46 smithi072 bash[28946]: cluster 2024-03-30T15:12:45.314136+0000 mon.a (mon.0) 1203 : cluster 0 osdmap e109: 8 total, 8 up, 8 in 2024-03-30T15:12:46.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:46 smithi072 bash[28946]: audit 2024-03-30T15:12:45.314866+0000 mon.a (mon.0) 1204 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-7"}]: dispatch 2024-03-30T15:12:46.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:46 smithi172 bash[23680]: audit 2024-03-30T15:12:45.302327+0000 mon.a (mon.0) 1198 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:46.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:46 smithi172 bash[23680]: audit 2024-03-30T15:12:45.307901+0000 mon.a (mon.0) 1199 : audit 1 from='client.? 172.21.15.72:0/2830464926' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:46.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:46 smithi172 bash[23680]: audit 2024-03-30T15:12:45.307979+0000 mon.a (mon.0) 1200 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi072-64163-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:46.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:46 smithi172 bash[23680]: audit 2024-03-30T15:12:45.308186+0000 mon.a (mon.0) 1201 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi072-64171-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:46.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:46 smithi172 bash[23680]: audit 2024-03-30T15:12:45.308255+0000 mon.a (mon.0) 1202 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:12:46.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:46 smithi172 bash[23680]: cluster 2024-03-30T15:12:45.314136+0000 mon.a (mon.0) 1203 : cluster 0 osdmap e109: 8 total, 8 up, 8 in 2024-03-30T15:12:46.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:46 smithi172 bash[23680]: audit 2024-03-30T15:12:45.314866+0000 mon.a (mon.0) 1204 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-7"}]: dispatch 2024-03-30T15:12:48.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:47 smithi072 bash[21573]: audit 2024-03-30T15:12:46.654507+0000 mon.a (mon.0) 1205 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:48.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:47 smithi072 bash[28946]: audit 2024-03-30T15:12:46.654507+0000 mon.a (mon.0) 1205 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:48.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:47 smithi172 bash[23680]: audit 2024-03-30T15:12:46.654507+0000 mon.a (mon.0) 1205 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:49.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:49 smithi072 bash[21573]: cluster 2024-03-30T15:12:45.873819+0000 mgr.y (mgr.14526) 212 : cluster 0 pgmap v166: 592 pgs: 592 active+clean; 217 MiB data, 996 MiB used, 714 GiB / 715 GiB avail; 2.5 KiB/s rd, 18 MiB/s wr, 9 op/s 2024-03-30T15:12:49.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:49 smithi072 bash[21573]: audit 2024-03-30T15:12:46.687504+0000 mon.a (mon.0) 1206 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-7"}]': finished 2024-03-30T15:12:49.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:49 smithi072 bash[21573]: audit 2024-03-30T15:12:46.714939+0000 mon.b (mon.1) 44 : audit 1 from='client.? 172.21.15.72:0/2212924253' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:49.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:49 smithi072 bash[21573]: cluster 2024-03-30T15:12:47.831876+0000 mon.a (mon.0) 1207 : cluster 0 osdmap e110: 8 total, 8 up, 8 in 2024-03-30T15:12:49.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:49 smithi072 bash[21573]: audit 2024-03-30T15:12:47.843683+0000 mon.a (mon.0) 1208 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:49.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:49 smithi072 bash[21573]: cluster 2024-03-30T15:12:48.441222+0000 mon.a (mon.0) 1209 : cluster 0 osdmap e111: 8 total, 8 up, 8 in 2024-03-30T15:12:49.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:49 smithi072 bash[21573]: audit 2024-03-30T15:12:48.459937+0000 mon.a (mon.0) 1210 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:49.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:49 smithi072 bash[28946]: cluster 2024-03-30T15:12:45.873819+0000 mgr.y (mgr.14526) 212 : cluster 0 pgmap v166: 592 pgs: 592 active+clean; 217 MiB data, 996 MiB used, 714 GiB / 715 GiB avail; 2.5 KiB/s rd, 18 MiB/s wr, 9 op/s 2024-03-30T15:12:49.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:49 smithi072 bash[28946]: audit 2024-03-30T15:12:46.687504+0000 mon.a (mon.0) 1206 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-7"}]': finished 2024-03-30T15:12:49.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:49 smithi072 bash[28946]: audit 2024-03-30T15:12:46.714939+0000 mon.b (mon.1) 44 : audit 1 from='client.? 172.21.15.72:0/2212924253' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:49.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:49 smithi072 bash[28946]: cluster 2024-03-30T15:12:47.831876+0000 mon.a (mon.0) 1207 : cluster 0 osdmap e110: 8 total, 8 up, 8 in 2024-03-30T15:12:49.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:49 smithi072 bash[28946]: audit 2024-03-30T15:12:47.843683+0000 mon.a (mon.0) 1208 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:49.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:49 smithi072 bash[28946]: cluster 2024-03-30T15:12:48.441222+0000 mon.a (mon.0) 1209 : cluster 0 osdmap e111: 8 total, 8 up, 8 in 2024-03-30T15:12:49.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:49 smithi072 bash[28946]: audit 2024-03-30T15:12:48.459937+0000 mon.a (mon.0) 1210 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:49.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:49 smithi172 bash[23680]: cluster 2024-03-30T15:12:45.873819+0000 mgr.y (mgr.14526) 212 : cluster 0 pgmap v166: 592 pgs: 592 active+clean; 217 MiB data, 996 MiB used, 714 GiB / 715 GiB avail; 2.5 KiB/s rd, 18 MiB/s wr, 9 op/s 2024-03-30T15:12:49.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:49 smithi172 bash[23680]: audit 2024-03-30T15:12:46.687504+0000 mon.a (mon.0) 1206 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-7"}]': finished 2024-03-30T15:12:49.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:49 smithi172 bash[23680]: audit 2024-03-30T15:12:46.714939+0000 mon.b (mon.1) 44 : audit 1 from='client.? 172.21.15.72:0/2212924253' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:49.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:49 smithi172 bash[23680]: cluster 2024-03-30T15:12:47.831876+0000 mon.a (mon.0) 1207 : cluster 0 osdmap e110: 8 total, 8 up, 8 in 2024-03-30T15:12:49.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:49 smithi172 bash[23680]: audit 2024-03-30T15:12:47.843683+0000 mon.a (mon.0) 1208 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:49.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:49 smithi172 bash[23680]: cluster 2024-03-30T15:12:48.441222+0000 mon.a (mon.0) 1209 : cluster 0 osdmap e111: 8 total, 8 up, 8 in 2024-03-30T15:12:49.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:49 smithi172 bash[23680]: audit 2024-03-30T15:12:48.459937+0000 mon.a (mon.0) 1210 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:50.990 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:50 smithi172 bash[23680]: cluster 2024-03-30T15:12:47.874677+0000 mgr.y (mgr.14526) 213 : cluster 0 pgmap v168: 560 pgs: 64 unknown, 496 active+clean; 217 MiB data, 996 MiB used, 714 GiB / 715 GiB avail; 1.9 KiB/s rd, 15 MiB/s wr, 8 op/s 2024-03-30T15:12:50.990 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:50 smithi172 bash[23680]: cluster 2024-03-30T15:12:48.164096+0000 osd.7 (osd.7) 9 : cluster 0 38.4 deep-scrub starts 2024-03-30T15:12:50.990 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:50 smithi172 bash[23680]: audit 2024-03-30T15:12:49.011571+0000 mon.a (mon.0) 1211 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:50.990 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:50 smithi172 bash[23680]: audit 2024-03-30T15:12:49.019448+0000 mon.a (mon.0) 1212 : audit 1 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi072-64203-1","var":"pg_num","val":"11"}]: dispatch 2024-03-30T15:12:50.990 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:50 smithi172 bash[23680]: audit 2024-03-30T15:12:49.022658+0000 mon.a (mon.0) 1213 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:50.990 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:50 smithi172 bash[23680]: cluster 2024-03-30T15:12:49.611126+0000 mon.a (mon.0) 1214 : cluster 0 osdmap e112: 8 total, 8 up, 8 in 2024-03-30T15:12:50.991 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:50 smithi172 bash[23680]: cluster 2024-03-30T15:12:49.616736+0000 mon.a (mon.0) 1215 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:12:50.991 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:50 smithi172 bash[23680]: audit 2024-03-30T15:12:49.635813+0000 mon.a (mon.0) 1216 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:12:50.991 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:50 smithi172 bash[23680]: audit 2024-03-30T15:12:49.637901+0000 mon.a (mon.0) 1217 : audit 1 from='client.? 172.21.15.72:0/1189606274' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi072-64163-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:51.034 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:50 smithi072 bash[21573]: cluster 2024-03-30T15:12:47.874677+0000 mgr.y (mgr.14526) 213 : cluster 0 pgmap v168: 560 pgs: 64 unknown, 496 active+clean; 217 MiB data, 996 MiB used, 714 GiB / 715 GiB avail; 1.9 KiB/s rd, 15 MiB/s wr, 8 op/s 2024-03-30T15:12:51.035 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:50 smithi072 bash[21573]: cluster 2024-03-30T15:12:48.164096+0000 osd.7 (osd.7) 9 : cluster 0 38.4 deep-scrub starts 2024-03-30T15:12:51.035 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:50 smithi072 bash[21573]: audit 2024-03-30T15:12:49.011571+0000 mon.a (mon.0) 1211 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:51.035 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:50 smithi072 bash[21573]: audit 2024-03-30T15:12:49.019448+0000 mon.a (mon.0) 1212 : audit 1 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi072-64203-1","var":"pg_num","val":"11"}]: dispatch 2024-03-30T15:12:51.035 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:50 smithi072 bash[21573]: audit 2024-03-30T15:12:49.022658+0000 mon.a (mon.0) 1213 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:51.035 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:50 smithi072 bash[21573]: cluster 2024-03-30T15:12:49.611126+0000 mon.a (mon.0) 1214 : cluster 0 osdmap e112: 8 total, 8 up, 8 in 2024-03-30T15:12:51.035 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:50 smithi072 bash[21573]: cluster 2024-03-30T15:12:49.616736+0000 mon.a (mon.0) 1215 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:12:51.035 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:50 smithi072 bash[21573]: audit 2024-03-30T15:12:49.635813+0000 mon.a (mon.0) 1216 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:12:51.035 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:50 smithi072 bash[21573]: audit 2024-03-30T15:12:49.637901+0000 mon.a (mon.0) 1217 : audit 1 from='client.? 172.21.15.72:0/1189606274' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi072-64163-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:51.035 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:12:51 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:12:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:12:51.036 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:50 smithi072 bash[28946]: cluster 2024-03-30T15:12:47.874677+0000 mgr.y (mgr.14526) 213 : cluster 0 pgmap v168: 560 pgs: 64 unknown, 496 active+clean; 217 MiB data, 996 MiB used, 714 GiB / 715 GiB avail; 1.9 KiB/s rd, 15 MiB/s wr, 8 op/s 2024-03-30T15:12:51.036 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:50 smithi072 bash[28946]: cluster 2024-03-30T15:12:48.164096+0000 osd.7 (osd.7) 9 : cluster 0 38.4 deep-scrub starts 2024-03-30T15:12:51.036 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:50 smithi072 bash[28946]: audit 2024-03-30T15:12:49.011571+0000 mon.a (mon.0) 1211 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:51.036 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:50 smithi072 bash[28946]: audit 2024-03-30T15:12:49.019448+0000 mon.a (mon.0) 1212 : audit 1 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi072-64203-1","var":"pg_num","val":"11"}]: dispatch 2024-03-30T15:12:51.036 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:50 smithi072 bash[28946]: audit 2024-03-30T15:12:49.022658+0000 mon.a (mon.0) 1213 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:51.036 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:50 smithi072 bash[28946]: cluster 2024-03-30T15:12:49.611126+0000 mon.a (mon.0) 1214 : cluster 0 osdmap e112: 8 total, 8 up, 8 in 2024-03-30T15:12:51.036 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:50 smithi072 bash[28946]: cluster 2024-03-30T15:12:49.616736+0000 mon.a (mon.0) 1215 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:12:51.036 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:50 smithi072 bash[28946]: audit 2024-03-30T15:12:49.635813+0000 mon.a (mon.0) 1216 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:12:51.036 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:50 smithi072 bash[28946]: audit 2024-03-30T15:12:49.637901+0000 mon.a (mon.0) 1217 : audit 1 from='client.? 172.21.15.72:0/1189606274' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi072-64163-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:51.465 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:12:50 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:12:52.179 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:51 smithi072 bash[21573]: cluster 2024-03-30T15:12:48.334465+0000 osd.7 (osd.7) 10 : cluster 0 38.4 deep-scrub ok 2024-03-30T15:12:52.180 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:51 smithi072 bash[21573]: audit 2024-03-30T15:12:49.640996+0000 mon.c (mon.2) 199 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:12:52.180 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:51 smithi072 bash[21573]: audit 2024-03-30T15:12:49.641425+0000 mon.a (mon.0) 1218 : audit 1 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi072-64203-1","var":"pg_num","val":"11"}]': finished 2024-03-30T15:12:52.180 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:51 smithi072 bash[21573]: audit 2024-03-30T15:12:49.677358+0000 mon.b (mon.1) 45 : audit 1 from='client.? 172.21.15.72:0/1680039229' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi072-64171-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:52.180 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:51 smithi072 bash[21573]: cluster 2024-03-30T15:12:49.875267+0000 mgr.y (mgr.14526) 214 : cluster 0 pgmap v172: 624 pgs: 224 unknown, 400 active+clean; 217 MiB data, 996 MiB used, 714 GiB / 715 GiB avail 2024-03-30T15:12:52.180 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:51 smithi072 bash[21573]: cluster 2024-03-30T15:12:50.712525+0000 mon.a (mon.0) 1219 : cluster 0 osdmap e113: 8 total, 8 up, 8 in 2024-03-30T15:12:52.180 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:51 smithi072 bash[21573]: audit 2024-03-30T15:12:50.737835+0000 mon.a (mon.0) 1220 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:52.180 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:51 smithi072 bash[21573]: audit 2024-03-30T15:12:50.741992+0000 mon.a (mon.0) 1221 : audit 1 from='client.? 172.21.15.72:0/1189606274' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi072-64163-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:52.180 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:51 smithi072 bash[21573]: cluster 2024-03-30T15:12:50.748261+0000 mon.a (mon.0) 1222 : cluster 0 osdmap e114: 8 total, 8 up, 8 in 2024-03-30T15:12:52.180 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:51 smithi072 bash[21573]: audit 2024-03-30T15:12:50.774325+0000 mon.c (mon.2) 200 : audit 1 from='client.? 172.21.15.72:0/2538109740' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi072-64882-3"}]: dispatch 2024-03-30T15:12:52.180 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:51 smithi072 bash[21573]: audit 2024-03-30T15:12:51.356934+0000 mon.a (mon.0) 1223 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:52.180 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:51 smithi072 bash[21573]: audit 2024-03-30T15:12:51.363471+0000 mon.a (mon.0) 1224 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi072-64882-3"}]: dispatch 2024-03-30T15:12:52.180 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:51 smithi072 bash[21573]: audit 2024-03-30T15:12:51.365531+0000 mon.a (mon.0) 1225 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi072-64171-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:52.181 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:51 smithi072 bash[28946]: cluster 2024-03-30T15:12:48.334465+0000 osd.7 (osd.7) 10 : cluster 0 38.4 deep-scrub ok 2024-03-30T15:12:52.181 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:51 smithi072 bash[28946]: audit 2024-03-30T15:12:49.640996+0000 mon.c (mon.2) 199 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:12:52.181 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:51 smithi072 bash[28946]: audit 2024-03-30T15:12:49.641425+0000 mon.a (mon.0) 1218 : audit 1 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi072-64203-1","var":"pg_num","val":"11"}]': finished 2024-03-30T15:12:52.181 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:51 smithi072 bash[28946]: audit 2024-03-30T15:12:49.677358+0000 mon.b (mon.1) 45 : audit 1 from='client.? 172.21.15.72:0/1680039229' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi072-64171-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:52.181 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:51 smithi072 bash[28946]: cluster 2024-03-30T15:12:49.875267+0000 mgr.y (mgr.14526) 214 : cluster 0 pgmap v172: 624 pgs: 224 unknown, 400 active+clean; 217 MiB data, 996 MiB used, 714 GiB / 715 GiB avail 2024-03-30T15:12:52.181 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:51 smithi072 bash[28946]: cluster 2024-03-30T15:12:50.712525+0000 mon.a (mon.0) 1219 : cluster 0 osdmap e113: 8 total, 8 up, 8 in 2024-03-30T15:12:52.181 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:51 smithi072 bash[28946]: audit 2024-03-30T15:12:50.737835+0000 mon.a (mon.0) 1220 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:52.181 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:51 smithi072 bash[28946]: audit 2024-03-30T15:12:50.741992+0000 mon.a (mon.0) 1221 : audit 1 from='client.? 172.21.15.72:0/1189606274' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi072-64163-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:52.181 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:51 smithi072 bash[28946]: cluster 2024-03-30T15:12:50.748261+0000 mon.a (mon.0) 1222 : cluster 0 osdmap e114: 8 total, 8 up, 8 in 2024-03-30T15:12:52.181 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:51 smithi072 bash[28946]: audit 2024-03-30T15:12:50.774325+0000 mon.c (mon.2) 200 : audit 1 from='client.? 172.21.15.72:0/2538109740' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi072-64882-3"}]: dispatch 2024-03-30T15:12:52.181 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:51 smithi072 bash[28946]: audit 2024-03-30T15:12:51.356934+0000 mon.a (mon.0) 1223 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:52.181 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:51 smithi072 bash[28946]: audit 2024-03-30T15:12:51.363471+0000 mon.a (mon.0) 1224 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi072-64882-3"}]: dispatch 2024-03-30T15:12:52.182 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:51 smithi072 bash[28946]: audit 2024-03-30T15:12:51.365531+0000 mon.a (mon.0) 1225 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi072-64171-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:52.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:51 smithi172 bash[23680]: cluster 2024-03-30T15:12:48.334465+0000 osd.7 (osd.7) 10 : cluster 0 38.4 deep-scrub ok 2024-03-30T15:12:52.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:51 smithi172 bash[23680]: audit 2024-03-30T15:12:49.640996+0000 mon.c (mon.2) 199 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:12:52.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:51 smithi172 bash[23680]: audit 2024-03-30T15:12:49.641425+0000 mon.a (mon.0) 1218 : audit 1 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi072-64203-1","var":"pg_num","val":"11"}]': finished 2024-03-30T15:12:52.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:51 smithi172 bash[23680]: audit 2024-03-30T15:12:49.677358+0000 mon.b (mon.1) 45 : audit 1 from='client.? 172.21.15.72:0/1680039229' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi072-64171-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:52.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:51 smithi172 bash[23680]: cluster 2024-03-30T15:12:49.875267+0000 mgr.y (mgr.14526) 214 : cluster 0 pgmap v172: 624 pgs: 224 unknown, 400 active+clean; 217 MiB data, 996 MiB used, 714 GiB / 715 GiB avail 2024-03-30T15:12:52.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:51 smithi172 bash[23680]: cluster 2024-03-30T15:12:50.712525+0000 mon.a (mon.0) 1219 : cluster 0 osdmap e113: 8 total, 8 up, 8 in 2024-03-30T15:12:52.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:51 smithi172 bash[23680]: audit 2024-03-30T15:12:50.737835+0000 mon.a (mon.0) 1220 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:52.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:51 smithi172 bash[23680]: audit 2024-03-30T15:12:50.741992+0000 mon.a (mon.0) 1221 : audit 1 from='client.? 172.21.15.72:0/1189606274' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi072-64163-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:52.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:51 smithi172 bash[23680]: cluster 2024-03-30T15:12:50.748261+0000 mon.a (mon.0) 1222 : cluster 0 osdmap e114: 8 total, 8 up, 8 in 2024-03-30T15:12:52.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:51 smithi172 bash[23680]: audit 2024-03-30T15:12:50.774325+0000 mon.c (mon.2) 200 : audit 1 from='client.? 172.21.15.72:0/2538109740' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi072-64882-3"}]: dispatch 2024-03-30T15:12:52.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:51 smithi172 bash[23680]: audit 2024-03-30T15:12:51.356934+0000 mon.a (mon.0) 1223 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:52.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:51 smithi172 bash[23680]: audit 2024-03-30T15:12:51.363471+0000 mon.a (mon.0) 1224 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi072-64882-3"}]: dispatch 2024-03-30T15:12:52.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:51 smithi172 bash[23680]: audit 2024-03-30T15:12:51.365531+0000 mon.a (mon.0) 1225 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi072-64171-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:53.192 INFO:tasks.workunit.client.0.smithi072.stdout: a ec_list: Running main() from gmock_main.cc 2024-03-30T15:12:53.192 INFO:tasks.workunit.client.0.smithi072.stdout: ec_list: [==========] Running 3 tests from 1 test suite. 2024-03-30T15:12:53.192 INFO:tasks.workunit.client.0.smithi072.stdout: ec_list: [----------] Global test environment set-up. 2024-03-30T15:12:53.192 INFO:tasks.workunit.client.0.smithi072.stdout: ec_list: [----------] 3 tests from NeoradosECList 2024-03-30T15:12:53.192 INFO:tasks.workunit.client.0.smithi072.stdout: ec_list: [ RUN ] NeoradosECList.ListObjects 2024-03-30T15:12:53.193 INFO:tasks.workunit.client.0.smithi072.stdout: ec_list: [ OK ] NeoradosECList.ListObjects (32505 ms) 2024-03-30T15:12:53.193 INFO:tasks.workunit.client.0.smithi072.stdout: ec_list: [ RUN ] NeoradosECList.ListObjectsNS 2024-03-30T15:12:53.193 INFO:tasks.workunit.client.0.smithi072.stdout: ec_list: [ OK ] NeoradosECList.ListObjectsNS (11146 ms) 2024-03-30T15:12:53.193 INFO:tasks.workunit.client.0.smithi072.stdout: ec_list: [ RUN ] NeoradosECList.ListObjectsMany 2024-03-30T15:12:53.193 INFO:tasks.workunit.client.0.smithi072.stdout: ec_list: [ OK ] NeoradosECList.ListObjectsMany (17250 ms) 2024-03-30T15:12:53.193 INFO:tasks.workunit.client.0.smithi072.stdout: ec_list: [----------] 3 tests from NeoradosECList (60901 ms total) 2024-03-30T15:12:53.194 INFO:tasks.workunit.client.0.smithi072.stdout: ec_list: 2024-03-30T15:12:53.194 INFO:tasks.workunit.client.0.smithi072.stdout: ec_list: [----------] Global test environment tear-down 2024-03-30T15:12:53.194 INFO:tasks.workunit.client.0.smithi072.stdout: ec_list: [==========] 3 tests from 1 test suite ran. (60901 ms total) 2024-03-30T15:12:53.194 INFO:tasks.workunit.client.0.smithi072.stdout: ec_list: [ PASSED ] 3 tests. 2024-03-30T15:12:53.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:53 smithi072 bash[21573]: audit 2024-03-30T15:12:50.993294+0000 mgr.y (mgr.14526) 215 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:12:53.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:53 smithi072 bash[21573]: audit 2024-03-30T15:12:51.901187+0000 mon.a (mon.0) 1226 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:53.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:53 smithi072 bash[21573]: audit 2024-03-30T15:12:51.905135+0000 mon.a (mon.0) 1227 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:53.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:53 smithi072 bash[21573]: audit 2024-03-30T15:12:51.905222+0000 mon.a (mon.0) 1228 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi072-64882-3"}]': finished 2024-03-30T15:12:53.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:53 smithi072 bash[21573]: audit 2024-03-30T15:12:51.905279+0000 mon.a (mon.0) 1229 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi072-64171-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:53.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:53 smithi072 bash[21573]: cluster 2024-03-30T15:12:51.909758+0000 mon.a (mon.0) 1230 : cluster 0 osdmap e115: 8 total, 8 up, 8 in 2024-03-30T15:12:53.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:53 smithi072 bash[21573]: audit 2024-03-30T15:12:51.949039+0000 mon.c (mon.2) 201 : audit 1 from='client.? 172.21.15.72:0/2538109740' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi072-64882-3"}]: dispatch 2024-03-30T15:12:53.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:53 smithi072 bash[21573]: audit 2024-03-30T15:12:51.952366+0000 mon.a (mon.0) 1231 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi072-64882-3"}]: dispatch 2024-03-30T15:12:53.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:53 smithi072 bash[21573]: audit 2024-03-30T15:12:51.953470+0000 mon.c (mon.2) 202 : audit 1 from='client.? 172.21.15.72:0/2953831485' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:53.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:53 smithi072 bash[21573]: audit 2024-03-30T15:12:51.959354+0000 mon.a (mon.0) 1232 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:53.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:53 smithi072 bash[21573]: audit 2024-03-30T15:12:52.590714+0000 mon.a (mon.0) 1233 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:12:53.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:53 smithi072 bash[28946]: audit 2024-03-30T15:12:50.993294+0000 mgr.y (mgr.14526) 215 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:12:53.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:53 smithi072 bash[28946]: audit 2024-03-30T15:12:51.901187+0000 mon.a (mon.0) 1226 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:53.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:53 smithi072 bash[28946]: audit 2024-03-30T15:12:51.905135+0000 mon.a (mon.0) 1227 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:53.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:53 smithi072 bash[28946]: audit 2024-03-30T15:12:51.905222+0000 mon.a (mon.0) 1228 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi072-64882-3"}]': finished 2024-03-30T15:12:53.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:53 smithi072 bash[28946]: audit 2024-03-30T15:12:51.905279+0000 mon.a (mon.0) 1229 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi072-64171-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:53.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:53 smithi072 bash[28946]: cluster 2024-03-30T15:12:51.909758+0000 mon.a (mon.0) 1230 : cluster 0 osdmap e115: 8 total, 8 up, 8 in 2024-03-30T15:12:53.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:53 smithi072 bash[28946]: audit 2024-03-30T15:12:51.949039+0000 mon.c (mon.2) 201 : audit 1 from='client.? 172.21.15.72:0/2538109740' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi072-64882-3"}]: dispatch 2024-03-30T15:12:53.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:53 smithi072 bash[28946]: audit 2024-03-30T15:12:51.952366+0000 mon.a (mon.0) 1231 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi072-64882-3"}]: dispatch 2024-03-30T15:12:53.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:53 smithi072 bash[28946]: audit 2024-03-30T15:12:51.953470+0000 mon.c (mon.2) 202 : audit 1 from='client.? 172.21.15.72:0/2953831485' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:53.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:53 smithi072 bash[28946]: audit 2024-03-30T15:12:51.959354+0000 mon.a (mon.0) 1232 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:53.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:53 smithi072 bash[28946]: audit 2024-03-30T15:12:52.590714+0000 mon.a (mon.0) 1233 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:12:53.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:53 smithi172 bash[23680]: audit 2024-03-30T15:12:50.993294+0000 mgr.y (mgr.14526) 215 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:12:53.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:53 smithi172 bash[23680]: audit 2024-03-30T15:12:51.901187+0000 mon.a (mon.0) 1226 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:53.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:53 smithi172 bash[23680]: audit 2024-03-30T15:12:51.905135+0000 mon.a (mon.0) 1227 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:53.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:53 smithi172 bash[23680]: audit 2024-03-30T15:12:51.905222+0000 mon.a (mon.0) 1228 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi072-64882-3"}]': finished 2024-03-30T15:12:53.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:53 smithi172 bash[23680]: audit 2024-03-30T15:12:51.905279+0000 mon.a (mon.0) 1229 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi072-64171-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:53.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:53 smithi172 bash[23680]: cluster 2024-03-30T15:12:51.909758+0000 mon.a (mon.0) 1230 : cluster 0 osdmap e115: 8 total, 8 up, 8 in 2024-03-30T15:12:53.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:53 smithi172 bash[23680]: audit 2024-03-30T15:12:51.949039+0000 mon.c (mon.2) 201 : audit 1 from='client.? 172.21.15.72:0/2538109740' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi072-64882-3"}]: dispatch 2024-03-30T15:12:53.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:53 smithi172 bash[23680]: audit 2024-03-30T15:12:51.952366+0000 mon.a (mon.0) 1231 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi072-64882-3"}]: dispatch 2024-03-30T15:12:53.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:53 smithi172 bash[23680]: audit 2024-03-30T15:12:51.953470+0000 mon.c (mon.2) 202 : audit 1 from='client.? 172.21.15.72:0/2953831485' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:53.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:53 smithi172 bash[23680]: audit 2024-03-30T15:12:51.959354+0000 mon.a (mon.0) 1232 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:53.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:53 smithi172 bash[23680]: audit 2024-03-30T15:12:52.590714+0000 mon.a (mon.0) 1233 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:12:54.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:54 smithi072 bash[21573]: cluster 2024-03-30T15:12:51.877934+0000 mgr.y (mgr.14526) 216 : cluster 0 pgmap v174: 648 pgs: 109 creating+peering, 38 creating+activating, 1 active+clean+snaptrim_wait, 1 unknown, 499 active+clean; 217 MiB data, 999 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 2.2 KiB/s wr, 4 op/s 2024-03-30T15:12:54.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:54 smithi072 bash[21573]: audit 2024-03-30T15:12:53.116582+0000 mon.a (mon.0) 1234 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:54.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:54 smithi072 bash[21573]: audit 2024-03-30T15:12:53.146650+0000 mon.a (mon.0) 1235 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi072-64882-3"}]': finished 2024-03-30T15:12:54.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:54 smithi072 bash[28946]: cluster 2024-03-30T15:12:51.877934+0000 mgr.y (mgr.14526) 216 : cluster 0 pgmap v174: 648 pgs: 109 creating+peering, 38 creating+activating, 1 active+clean+snaptrim_wait, 1 unknown, 499 active+clean; 217 MiB data, 999 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 2.2 KiB/s wr, 4 op/s 2024-03-30T15:12:54.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:54 smithi072 bash[28946]: audit 2024-03-30T15:12:53.116582+0000 mon.a (mon.0) 1234 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:54.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:54 smithi072 bash[28946]: audit 2024-03-30T15:12:53.146650+0000 mon.a (mon.0) 1235 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi072-64882-3"}]': finished 2024-03-30T15:12:54.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:54 smithi172 bash[23680]: cluster 2024-03-30T15:12:51.877934+0000 mgr.y (mgr.14526) 216 : cluster 0 pgmap v174: 648 pgs: 109 creating+peering, 38 creating+activating, 1 active+clean+snaptrim_wait, 1 unknown, 499 active+clean; 217 MiB data, 999 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 2.2 KiB/s wr, 4 op/s 2024-03-30T15:12:54.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:54 smithi172 bash[23680]: audit 2024-03-30T15:12:53.116582+0000 mon.a (mon.0) 1234 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:54.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:54 smithi172 bash[23680]: audit 2024-03-30T15:12:53.146650+0000 mon.a (mon.0) 1235 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi072-64882-3"}]': finished 2024-03-30T15:12:55.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:55 smithi072 bash[21573]: audit 2024-03-30T15:12:53.146735+0000 mon.a (mon.0) 1236 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:55.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:55 smithi072 bash[21573]: audit 2024-03-30T15:12:53.146796+0000 mon.a (mon.0) 1237 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-9", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:12:55.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:55 smithi072 bash[21573]: cluster 2024-03-30T15:12:54.286724+0000 mon.a (mon.0) 1238 : cluster 0 osdmap e116: 8 total, 8 up, 8 in 2024-03-30T15:12:55.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:55 smithi072 bash[21573]: audit 2024-03-30T15:12:54.302767+0000 mon.a (mon.0) 1239 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:55.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:55 smithi072 bash[21573]: audit 2024-03-30T15:12:54.303173+0000 mon.a (mon.0) 1240 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-9"}]: dispatch 2024-03-30T15:12:55.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:55 smithi072 bash[21573]: audit 2024-03-30T15:12:54.361218+0000 mon.c (mon.2) 203 : audit 1 from='client.? 172.21.15.72:0/1198702507' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:55.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:55 smithi072 bash[21573]: cluster 2024-03-30T15:12:54.957590+0000 mon.a (mon.0) 1241 : cluster 0 osdmap e117: 8 total, 8 up, 8 in 2024-03-30T15:12:55.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:55 smithi072 bash[21573]: cluster 2024-03-30T15:12:54.959639+0000 mon.a (mon.0) 1242 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:12:55.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:55 smithi072 bash[21573]: audit 2024-03-30T15:12:54.974286+0000 mon.a (mon.0) 1243 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-9"}]': finished 2024-03-30T15:12:55.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:55 smithi072 bash[21573]: cluster 2024-03-30T15:12:54.980541+0000 mon.a (mon.0) 1244 : cluster 0 osdmap e118: 8 total, 8 up, 8 in 2024-03-30T15:12:55.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:55 smithi072 bash[21573]: audit 2024-03-30T15:12:54.985706+0000 mon.a (mon.0) 1245 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-9", "mode": "writeback"}]: dispatch 2024-03-30T15:12:55.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:55 smithi072 bash[21573]: audit 2024-03-30T15:12:54.987819+0000 mon.a (mon.0) 1246 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:55.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:55 smithi072 bash[21573]: audit 2024-03-30T15:12:55.456306+0000 mon.c (mon.2) 204 : audit 1 from='client.? 172.21.15.72:0/4226267530' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi072-64478-4"}]: dispatch 2024-03-30T15:12:55.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:55 smithi072 bash[28946]: audit 2024-03-30T15:12:53.146735+0000 mon.a (mon.0) 1236 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:55.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:55 smithi072 bash[28946]: audit 2024-03-30T15:12:53.146796+0000 mon.a (mon.0) 1237 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-9", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:12:55.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:55 smithi072 bash[28946]: cluster 2024-03-30T15:12:54.286724+0000 mon.a (mon.0) 1238 : cluster 0 osdmap e116: 8 total, 8 up, 8 in 2024-03-30T15:12:55.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:55 smithi072 bash[28946]: audit 2024-03-30T15:12:54.302767+0000 mon.a (mon.0) 1239 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:55.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:55 smithi072 bash[28946]: audit 2024-03-30T15:12:54.303173+0000 mon.a (mon.0) 1240 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-9"}]: dispatch 2024-03-30T15:12:55.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:55 smithi072 bash[28946]: audit 2024-03-30T15:12:54.361218+0000 mon.c (mon.2) 203 : audit 1 from='client.? 172.21.15.72:0/1198702507' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:55.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:55 smithi072 bash[28946]: cluster 2024-03-30T15:12:54.957590+0000 mon.a (mon.0) 1241 : cluster 0 osdmap e117: 8 total, 8 up, 8 in 2024-03-30T15:12:55.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:55 smithi072 bash[28946]: cluster 2024-03-30T15:12:54.959639+0000 mon.a (mon.0) 1242 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:12:55.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:55 smithi072 bash[28946]: audit 2024-03-30T15:12:54.974286+0000 mon.a (mon.0) 1243 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-9"}]': finished 2024-03-30T15:12:55.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:55 smithi072 bash[28946]: cluster 2024-03-30T15:12:54.980541+0000 mon.a (mon.0) 1244 : cluster 0 osdmap e118: 8 total, 8 up, 8 in 2024-03-30T15:12:55.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:55 smithi072 bash[28946]: audit 2024-03-30T15:12:54.985706+0000 mon.a (mon.0) 1245 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-9", "mode": "writeback"}]: dispatch 2024-03-30T15:12:55.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:55 smithi072 bash[28946]: audit 2024-03-30T15:12:54.987819+0000 mon.a (mon.0) 1246 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:55.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:55 smithi072 bash[28946]: audit 2024-03-30T15:12:55.456306+0000 mon.c (mon.2) 204 : audit 1 from='client.? 172.21.15.72:0/4226267530' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi072-64478-4"}]: dispatch 2024-03-30T15:12:55.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:55 smithi172 bash[23680]: audit 2024-03-30T15:12:53.146735+0000 mon.a (mon.0) 1236 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:55.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:55 smithi172 bash[23680]: audit 2024-03-30T15:12:53.146796+0000 mon.a (mon.0) 1237 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-9", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:12:55.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:55 smithi172 bash[23680]: cluster 2024-03-30T15:12:54.286724+0000 mon.a (mon.0) 1238 : cluster 0 osdmap e116: 8 total, 8 up, 8 in 2024-03-30T15:12:55.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:55 smithi172 bash[23680]: audit 2024-03-30T15:12:54.302767+0000 mon.a (mon.0) 1239 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:55.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:55 smithi172 bash[23680]: audit 2024-03-30T15:12:54.303173+0000 mon.a (mon.0) 1240 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-9"}]: dispatch 2024-03-30T15:12:55.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:55 smithi172 bash[23680]: audit 2024-03-30T15:12:54.361218+0000 mon.c (mon.2) 203 : audit 1 from='client.? 172.21.15.72:0/1198702507' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:55.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:55 smithi172 bash[23680]: cluster 2024-03-30T15:12:54.957590+0000 mon.a (mon.0) 1241 : cluster 0 osdmap e117: 8 total, 8 up, 8 in 2024-03-30T15:12:55.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:55 smithi172 bash[23680]: cluster 2024-03-30T15:12:54.959639+0000 mon.a (mon.0) 1242 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:12:55.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:55 smithi172 bash[23680]: audit 2024-03-30T15:12:54.974286+0000 mon.a (mon.0) 1243 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-9"}]': finished 2024-03-30T15:12:55.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:55 smithi172 bash[23680]: cluster 2024-03-30T15:12:54.980541+0000 mon.a (mon.0) 1244 : cluster 0 osdmap e118: 8 total, 8 up, 8 in 2024-03-30T15:12:55.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:55 smithi172 bash[23680]: audit 2024-03-30T15:12:54.985706+0000 mon.a (mon.0) 1245 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-9", "mode": "writeback"}]: dispatch 2024-03-30T15:12:55.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:55 smithi172 bash[23680]: audit 2024-03-30T15:12:54.987819+0000 mon.a (mon.0) 1246 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:55.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:55 smithi172 bash[23680]: audit 2024-03-30T15:12:55.456306+0000 mon.c (mon.2) 204 : audit 1 from='client.? 172.21.15.72:0/4226267530' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi072-64478-4"}]: dispatch 2024-03-30T15:12:56.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:56 smithi172 bash[23680]: cluster 2024-03-30T15:12:53.878585+0000 mgr.y (mgr.14526) 217 : cluster 0 pgmap v177: 616 pgs: 95 creating+peering, 1 active+clean+snaptrim_wait, 129 unknown, 391 active+clean; 217 MiB data, 999 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.4 KiB/s wr, 3 op/s 2024-03-30T15:12:56.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:56 smithi172 bash[23680]: audit 2024-03-30T15:12:55.581910+0000 mon.a (mon.0) 1247 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:56.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:56 smithi172 bash[23680]: cluster 2024-03-30T15:12:56.085884+0000 mon.a (mon.0) 1248 : cluster 3 Health check update: 2 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:12:56.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:56 smithi172 bash[23680]: audit 2024-03-30T15:12:56.089541+0000 mon.a (mon.0) 1249 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-9", "mode": "writeback"}]': finished 2024-03-30T15:12:56.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:56 smithi172 bash[23680]: audit 2024-03-30T15:12:56.089627+0000 mon.a (mon.0) 1250 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:56.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:56 smithi172 bash[23680]: cluster 2024-03-30T15:12:56.110024+0000 mon.a (mon.0) 1251 : cluster 0 osdmap e119: 8 total, 8 up, 8 in 2024-03-30T15:12:57.132 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: [==========] Running 12 tests from 4 test suites. 2024-03-30T15:12:57.132 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: [----------] Global test environment set-up. 2024-03-30T15:12:57.132 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion 2024-03-30T15:12:57.133 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: [ RUN ] LibRadosMiscVersion.Version 2024-03-30T15:12:57.133 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: [ OK ] LibRadosMiscVersion.Version (0 ms) 2024-03-30T15:12:57.133 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion (1 ms total) 2024-03-30T15:12:57.133 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: 2024-03-30T15:12:57.133 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure 2024-03-30T15:12:57.133 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2024-03-30T15:12:57.133 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: unable to get monitor info from DNS SRV with service name: 2024-03-30T15:11:52.929+0000 7f15c1bb1880 -1 failed for service _ceph-mon._tcp 2024-03-30T15:12:57.133 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: ceph-mon 2024-03-30T15:12:57.133 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: 2024-03-30T15:11:52.933+0000 7f15c1bb1880 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2024-03-30T15:12:57.133 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectFailure (912 ms) 2024-03-30T15:12:57.134 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2024-03-30T15:12:57.134 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectTimeout (2006 ms) 2024-03-30T15:12:57.134 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure (2918 ms total) 2024-03-30T15:12:57.134 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: 2024-03-30T15:12:57.134 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: [----------] 1 test from LibRadosMiscPool 2024-03-30T15:12:57.134 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: [ RUN ] LibRadosMiscPool.PoolCreationRace 2024-03-30T15:12:57.134 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: started 0x5593c117a300 2024-03-30T15:12:57.134 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: started 0x5593c14ad1d0 2024-03-30T15:12:57.134 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: started 2 aios 2024-03-30T15:12:57.134 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: waiting 0x5593c117a300 2024-03-30T15:12:57.134 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: waiting 0x5593c14ad1d0 2024-03-30T15:12:57.135 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: done. 2024-03-30T15:12:57.135 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: [ OK ] LibRadosMiscPool.PoolCreationRace (23628 ms) 2024-03-30T15:12:57.135 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: [----------] 1 test from LibRadosMiscPool (23628 ms total) 2024-03-30T15:12:57.135 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: 2024-03-30T15:12:57.135 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: [----------] 8 tests from LibRadosMisc 2024-03-30T15:12:57.135 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: [ RUN ] LibRadosMisc.ClusterFSID 2024-03-30T15:12:57.135 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: [ OK ] LibRadosMisc.ClusterFSID (0 ms) 2024-03-30T15:12:57.135 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: [ RUN ] LibRadosMisc.Exec 2024-03-30T15:12:57.135 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: [ OK ] LibRadosMisc.Exec (153 ms) 2024-03-30T15:12:57.135 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: [ RUN ] LibRadosMisc.WriteSame 2024-03-30T15:12:57.135 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: [ OK ] LibRadosMisc.WriteSame (32 ms) 2024-03-30T15:12:57.135 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: [ RUN ] LibRadosMisc.CmpExt 2024-03-30T15:12:57.135 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: [ OK ] LibRadosMisc.CmpExt (6 ms) 2024-03-30T15:12:57.135 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: [ RUN ] LibRadosMisc.Applications 2024-03-30T15:12:57.136 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: [ OK ] LibRadosMisc.Applications (10237 ms) 2024-03-30T15:12:57.136 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatOSD 2024-03-30T15:12:57.136 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2024-03-30T15:12:57.136 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatClient 2024-03-30T15:12:57.136 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatClient (0 ms) 2024-03-30T15:12:57.136 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: [ RUN ] LibRadosMisc.ShutdownRace 2024-03-30T15:12:57.136 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: [ OK ] LibRadosMisc.ShutdownRace (24319 ms) 2024-03-30T15:12:57.136 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: [----------] 8 tests from LibRadosMisc (34747 ms total) 2024-03-30T15:12:57.136 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: 2024-03-30T15:12:57.136 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: [----------] Global test environment tear-down 2024-03-30T15:12:57.136 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: [==========] 12 tests from 4 test suites ran. (65092 ms total) 2024-03-30T15:12:57.136 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc: [ PASSED ] 12 tests. 2024-03-30T15:12:57.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:56 smithi072 bash[21573]: cluster 2024-03-30T15:12:53.878585+0000 mgr.y (mgr.14526) 217 : cluster 0 pgmap v177: 616 pgs: 95 creating+peering, 1 active+clean+snaptrim_wait, 129 unknown, 391 active+clean; 217 MiB data, 999 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.4 KiB/s wr, 3 op/s 2024-03-30T15:12:57.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:56 smithi072 bash[21573]: audit 2024-03-30T15:12:55.581910+0000 mon.a (mon.0) 1247 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:57.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:56 smithi072 bash[21573]: cluster 2024-03-30T15:12:56.085884+0000 mon.a (mon.0) 1248 : cluster 3 Health check update: 2 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:12:57.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:56 smithi072 bash[21573]: audit 2024-03-30T15:12:56.089541+0000 mon.a (mon.0) 1249 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-9", "mode": "writeback"}]': finished 2024-03-30T15:12:57.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:56 smithi072 bash[21573]: audit 2024-03-30T15:12:56.089627+0000 mon.a (mon.0) 1250 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:57.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:56 smithi072 bash[21573]: cluster 2024-03-30T15:12:56.110024+0000 mon.a (mon.0) 1251 : cluster 0 osdmap e119: 8 total, 8 up, 8 in 2024-03-30T15:12:57.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:56 smithi072 bash[28946]: cluster 2024-03-30T15:12:53.878585+0000 mgr.y (mgr.14526) 217 : cluster 0 pgmap v177: 616 pgs: 95 creating+peering, 1 active+clean+snaptrim_wait, 129 unknown, 391 active+clean; 217 MiB data, 999 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.4 KiB/s wr, 3 op/s 2024-03-30T15:12:57.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:56 smithi072 bash[28946]: audit 2024-03-30T15:12:55.581910+0000 mon.a (mon.0) 1247 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:57.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:56 smithi072 bash[28946]: cluster 2024-03-30T15:12:56.085884+0000 mon.a (mon.0) 1248 : cluster 3 Health check update: 2 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:12:57.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:56 smithi072 bash[28946]: audit 2024-03-30T15:12:56.089541+0000 mon.a (mon.0) 1249 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-9", "mode": "writeback"}]': finished 2024-03-30T15:12:57.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:56 smithi072 bash[28946]: audit 2024-03-30T15:12:56.089627+0000 mon.a (mon.0) 1250 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64575-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:57.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:56 smithi072 bash[28946]: cluster 2024-03-30T15:12:56.110024+0000 mon.a (mon.0) 1251 : cluster 0 osdmap e119: 8 total, 8 up, 8 in 2024-03-30T15:12:58.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:58 smithi072 bash[21573]: cluster 2024-03-30T15:12:55.881314+0000 mgr.y (mgr.14526) 218 : cluster 0 pgmap v180: 648 pgs: 91 creating+peering, 21 unknown, 536 active+clean; 217 MiB data, 992 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 767 B/s wr, 1 op/s 2024-03-30T15:12:58.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:58 smithi072 bash[21573]: audit 2024-03-30T15:12:56.131504+0000 mon.a (mon.0) 1252 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi072-64478-4"}]: dispatch 2024-03-30T15:12:58.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:58 smithi072 bash[21573]: audit 2024-03-30T15:12:56.131867+0000 mon.c (mon.2) 205 : audit 1 from='client.? 172.21.15.72:0/2552793561' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi072-64163-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:58.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:58 smithi072 bash[21573]: audit 2024-03-30T15:12:56.678333+0000 mon.a (mon.0) 1253 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:58.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:58 smithi072 bash[21573]: audit 2024-03-30T15:12:56.686987+0000 mon.a (mon.0) 1254 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi072-64163-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:58.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:58 smithi072 bash[21573]: audit 2024-03-30T15:12:56.754128+0000 mon.a (mon.0) 1255 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:12:58.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:58 smithi072 bash[21573]: audit 2024-03-30T15:12:57.101018+0000 mon.a (mon.0) 1256 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi072-64478-4"}]': finished 2024-03-30T15:12:58.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:58 smithi072 bash[21573]: audit 2024-03-30T15:12:57.101104+0000 mon.a (mon.0) 1257 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi072-64163-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:58.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:58 smithi072 bash[21573]: audit 2024-03-30T15:12:57.101169+0000 mon.a (mon.0) 1258 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:12:58.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:58 smithi072 bash[21573]: cluster 2024-03-30T15:12:57.105906+0000 mon.a (mon.0) 1259 : cluster 0 osdmap e120: 8 total, 8 up, 8 in 2024-03-30T15:12:58.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:58 smithi072 bash[21573]: audit 2024-03-30T15:12:57.106352+0000 mon.a (mon.0) 1260 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-9"}]: dispatch 2024-03-30T15:12:58.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:58 smithi072 bash[21573]: audit 2024-03-30T15:12:57.108144+0000 mon.b (mon.1) 46 : audit 1 from='client.? 172.21.15.72:0/4082959799' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi072-64171-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:58.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:58 smithi072 bash[21573]: audit 2024-03-30T15:12:57.108274+0000 mon.a (mon.0) 1261 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi072-64171-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:58.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:58 smithi072 bash[21573]: audit 2024-03-30T15:12:57.112732+0000 mon.c (mon.2) 206 : audit 1 from='client.? 172.21.15.72:0/4226267530' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi072-64478-4", "tierpool": "test-rados-api-smithi072-64478-6"}]: dispatch 2024-03-30T15:12:58.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:58 smithi072 bash[21573]: audit 2024-03-30T15:12:57.114439+0000 mon.a (mon.0) 1262 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi072-64478-4", "tierpool": "test-rados-api-smithi072-64478-6"}]: dispatch 2024-03-30T15:12:58.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:58 smithi072 bash[28946]: cluster 2024-03-30T15:12:55.881314+0000 mgr.y (mgr.14526) 218 : cluster 0 pgmap v180: 648 pgs: 91 creating+peering, 21 unknown, 536 active+clean; 217 MiB data, 992 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 767 B/s wr, 1 op/s 2024-03-30T15:12:58.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:58 smithi072 bash[28946]: audit 2024-03-30T15:12:56.131504+0000 mon.a (mon.0) 1252 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi072-64478-4"}]: dispatch 2024-03-30T15:12:58.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:58 smithi072 bash[28946]: audit 2024-03-30T15:12:56.131867+0000 mon.c (mon.2) 205 : audit 1 from='client.? 172.21.15.72:0/2552793561' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi072-64163-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:58.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:58 smithi072 bash[28946]: audit 2024-03-30T15:12:56.678333+0000 mon.a (mon.0) 1253 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:58.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:58 smithi072 bash[28946]: audit 2024-03-30T15:12:56.686987+0000 mon.a (mon.0) 1254 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi072-64163-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:58.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:58 smithi072 bash[28946]: audit 2024-03-30T15:12:56.754128+0000 mon.a (mon.0) 1255 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:12:58.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:58 smithi072 bash[28946]: audit 2024-03-30T15:12:57.101018+0000 mon.a (mon.0) 1256 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi072-64478-4"}]': finished 2024-03-30T15:12:58.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:58 smithi072 bash[28946]: audit 2024-03-30T15:12:57.101104+0000 mon.a (mon.0) 1257 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi072-64163-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:58.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:58 smithi072 bash[28946]: audit 2024-03-30T15:12:57.101169+0000 mon.a (mon.0) 1258 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:12:58.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:58 smithi072 bash[28946]: cluster 2024-03-30T15:12:57.105906+0000 mon.a (mon.0) 1259 : cluster 0 osdmap e120: 8 total, 8 up, 8 in 2024-03-30T15:12:58.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:58 smithi072 bash[28946]: audit 2024-03-30T15:12:57.106352+0000 mon.a (mon.0) 1260 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-9"}]: dispatch 2024-03-30T15:12:58.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:58 smithi072 bash[28946]: audit 2024-03-30T15:12:57.108144+0000 mon.b (mon.1) 46 : audit 1 from='client.? 172.21.15.72:0/4082959799' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi072-64171-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:58.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:58 smithi072 bash[28946]: audit 2024-03-30T15:12:57.108274+0000 mon.a (mon.0) 1261 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi072-64171-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:58.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:58 smithi072 bash[28946]: audit 2024-03-30T15:12:57.112732+0000 mon.c (mon.2) 206 : audit 1 from='client.? 172.21.15.72:0/4226267530' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi072-64478-4", "tierpool": "test-rados-api-smithi072-64478-6"}]: dispatch 2024-03-30T15:12:58.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:58 smithi072 bash[28946]: audit 2024-03-30T15:12:57.114439+0000 mon.a (mon.0) 1262 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi072-64478-4", "tierpool": "test-rados-api-smithi072-64478-6"}]: dispatch 2024-03-30T15:12:58.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:58 smithi172 bash[23680]: cluster 2024-03-30T15:12:55.881314+0000 mgr.y (mgr.14526) 218 : cluster 0 pgmap v180: 648 pgs: 91 creating+peering, 21 unknown, 536 active+clean; 217 MiB data, 992 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 767 B/s wr, 1 op/s 2024-03-30T15:12:58.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:58 smithi172 bash[23680]: audit 2024-03-30T15:12:56.131504+0000 mon.a (mon.0) 1252 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi072-64478-4"}]: dispatch 2024-03-30T15:12:58.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:58 smithi172 bash[23680]: audit 2024-03-30T15:12:56.131867+0000 mon.c (mon.2) 205 : audit 1 from='client.? 172.21.15.72:0/2552793561' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi072-64163-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:58.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:58 smithi172 bash[23680]: audit 2024-03-30T15:12:56.678333+0000 mon.a (mon.0) 1253 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:58.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:58 smithi172 bash[23680]: audit 2024-03-30T15:12:56.686987+0000 mon.a (mon.0) 1254 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi072-64163-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:58.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:58 smithi172 bash[23680]: audit 2024-03-30T15:12:56.754128+0000 mon.a (mon.0) 1255 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:12:58.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:58 smithi172 bash[23680]: audit 2024-03-30T15:12:57.101018+0000 mon.a (mon.0) 1256 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi072-64478-4"}]': finished 2024-03-30T15:12:58.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:58 smithi172 bash[23680]: audit 2024-03-30T15:12:57.101104+0000 mon.a (mon.0) 1257 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi072-64163-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:58.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:58 smithi172 bash[23680]: audit 2024-03-30T15:12:57.101169+0000 mon.a (mon.0) 1258 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:12:58.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:58 smithi172 bash[23680]: cluster 2024-03-30T15:12:57.105906+0000 mon.a (mon.0) 1259 : cluster 0 osdmap e120: 8 total, 8 up, 8 in 2024-03-30T15:12:58.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:58 smithi172 bash[23680]: audit 2024-03-30T15:12:57.106352+0000 mon.a (mon.0) 1260 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-9"}]: dispatch 2024-03-30T15:12:58.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:58 smithi172 bash[23680]: audit 2024-03-30T15:12:57.108144+0000 mon.b (mon.1) 46 : audit 1 from='client.? 172.21.15.72:0/4082959799' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi072-64171-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:58.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:58 smithi172 bash[23680]: audit 2024-03-30T15:12:57.108274+0000 mon.a (mon.0) 1261 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi072-64171-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:58.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:58 smithi172 bash[23680]: audit 2024-03-30T15:12:57.112732+0000 mon.c (mon.2) 206 : audit 1 from='client.? 172.21.15.72:0/4226267530' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi072-64478-4", "tierpool": "test-rados-api-smithi072-64478-6"}]: dispatch 2024-03-30T15:12:58.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:58 smithi172 bash[23680]: audit 2024-03-30T15:12:57.114439+0000 mon.a (mon.0) 1262 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi072-64478-4", "tierpool": "test-rados-api-smithi072-64478-6"}]: dispatch 2024-03-30T15:12:59.563 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_write_operations: Running main() from gmock_main.cc 2024-03-30T15:12:59.563 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_write_operations: [==========] Running 8 tests from 2 test suites. 2024-03-30T15:12:59.563 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_write_operations: [----------] Global test environment set-up. 2024-03-30T15:12:59.563 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps 2024-03-30T15:12:59.563 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_write_operations: [ RUN ] LibradosCWriteOps.NewDelete 2024-03-30T15:12:59.563 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_write_operations: [ OK ] LibradosCWriteOps.NewDelete (0 ms) 2024-03-30T15:12:59.564 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps (1 ms total) 2024-03-30T15:12:59.564 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_write_operations: 2024-03-30T15:12:59.564 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps 2024-03-30T15:12:59.564 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.assertExists 2024-03-30T15:12:59.564 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.assertExists (22018 ms) 2024-03-30T15:12:59.564 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2024-03-30T15:12:59.564 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteOpAssertVersion (12019 ms) 2024-03-30T15:12:59.564 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Xattrs 2024-03-30T15:12:59.564 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Xattrs (6453 ms) 2024-03-30T15:12:59.564 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Write 2024-03-30T15:12:59.564 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Write (8173 ms) 2024-03-30T15:12:59.564 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Exec 2024-03-30T15:12:59.564 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Exec (4529 ms) 2024-03-30T15:12:59.564 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteSame 2024-03-30T15:12:59.564 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteSame (6668 ms) 2024-03-30T15:12:59.565 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.CmpExt 2024-03-30T15:12:59.565 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.CmpExt (7563 ms) 2024-03-30T15:12:59.565 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps (67423 ms total) 2024-03-30T15:12:59.565 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_write_operations: 2024-03-30T15:12:59.565 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_write_operations: [----------] Global test environment tear-down 2024-03-30T15:12:59.565 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_write_operations: [==========] 8 tests from 2 test suites ran. (67424 ms total) 2024-03-30T15:12:59.565 INFO:tasks.workunit.client.0.smithi072.stdout: api_c_write_operations: [ PASSED ] 8 tests. 2024-03-30T15:12:59.575 INFO:tasks.workunit.client.0.smithi072.stdout: write_operations: Running main() from gmock_main.cc 2024-03-30T15:12:59.576 INFO:tasks.workunit.client.0.smithi072.stdout: write_operations: [==========] Running 7 tests from 1 test suite. 2024-03-30T15:12:59.577 INFO:tasks.workunit.client.0.smithi072.stdout: write_operations: [----------] Global test environment set-up. 2024-03-30T15:12:59.577 INFO:tasks.workunit.client.0.smithi072.stdout: write_operations: [----------] 7 tests from NeoRadosWriteOps 2024-03-30T15:12:59.577 INFO:tasks.workunit.client.0.smithi072.stdout: write_operations: [ RUN ] NeoRadosWriteOps.AssertExists 2024-03-30T15:12:59.577 INFO:tasks.workunit.client.0.smithi072.stdout: write_operations: [ OK ] NeoRadosWriteOps.AssertExists (20040 ms) 2024-03-30T15:12:59.577 INFO:tasks.workunit.client.0.smithi072.stdout: write_operations: [ RUN ] NeoRadosWriteOps.AssertVersion 2024-03-30T15:12:59.577 INFO:tasks.workunit.client.0.smithi072.stdout: write_operations: [ OK ] NeoRadosWriteOps.AssertVersion (8892 ms) 2024-03-30T15:12:59.578 INFO:tasks.workunit.client.0.smithi072.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Xattrs 2024-03-30T15:12:59.578 INFO:tasks.workunit.client.0.smithi072.stdout: write_operations: [ OK ] NeoRadosWriteOps.Xattrs (6264 ms) 2024-03-30T15:12:59.578 INFO:tasks.workunit.client.0.smithi072.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Write 2024-03-30T15:12:59.578 INFO:tasks.workunit.client.0.smithi072.stdout: write_operations: [ OK ] NeoRadosWriteOps.Write (6179 ms) 2024-03-30T15:12:59.578 INFO:tasks.workunit.client.0.smithi072.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Exec 2024-03-30T15:12:59.579 INFO:tasks.workunit.client.0.smithi072.stdout: write_operations: [ OK ] NeoRadosWriteOps.Exec (11645 ms) 2024-03-30T15:12:59.579 INFO:tasks.workunit.client.0.smithi072.stdout: write_operations: [ RUN ] NeoRadosWriteOps.WriteSame 2024-03-30T15:12:59.579 INFO:tasks.workunit.client.0.smithi072.stdout: write_operations: [ OK ] NeoRadosWriteOps.WriteSame (6596 ms) 2024-03-30T15:12:59.579 INFO:tasks.workunit.client.0.smithi072.stdout: write_operations: [ RUN ] NeoRadosWriteOps.CmpExt 2024-03-30T15:12:59.579 INFO:tasks.workunit.client.0.smithi072.stdout: write_operations: [ OK ] NeoRadosWriteOps.CmpExt (7622 ms) 2024-03-30T15:12:59.579 INFO:tasks.workunit.client.0.smithi072.stdout: write_operations: [----------] 7 tests from NeoRadosWriteOps (67238 ms total) 2024-03-30T15:12:59.579 INFO:tasks.workunit.client.0.smithi072.stdout: write_operations: 2024-03-30T15:12:59.580 INFO:tasks.workunit.client.0.smithi072.stdout: write_operations: [----------] Global test environment tear-down 2024-03-30T15:12:59.580 INFO:tasks.workunit.client.0.smithi072.stdout: write_operations: [==========] 7 tests from 1 test suite ran. (67238 ms total) 2024-03-30T15:12:59.580 INFO:tasks.workunit.client.0.smithi072.stdout: write_operations: [ PASSED ] 7 tests. 2024-03-30T15:12:59.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:59 smithi072 bash[21573]: cluster 2024-03-30T15:12:57.882012+0000 mgr.y (mgr.14526) 219 : cluster 0 pgmap v183: 584 pgs: 64 creating+peering, 96 unknown, 424 active+clean; 217 MiB data, 992 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 3 op/s 2024-03-30T15:12:59.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:59 smithi072 bash[21573]: audit 2024-03-30T15:12:58.076878+0000 mon.a (mon.0) 1263 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:59.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:59 smithi072 bash[21573]: cluster 2024-03-30T15:12:58.489706+0000 mon.a (mon.0) 1264 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 2 cache pools are missing hit_sets) 2024-03-30T15:12:59.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:59 smithi072 bash[21573]: audit 2024-03-30T15:12:58.506545+0000 mon.a (mon.0) 1265 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-9"}]': finished 2024-03-30T15:12:59.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:59 smithi072 bash[21573]: audit 2024-03-30T15:12:58.506757+0000 mon.a (mon.0) 1266 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi072-64171-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:59.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:59 smithi072 bash[21573]: audit 2024-03-30T15:12:58.506954+0000 mon.a (mon.0) 1267 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi072-64478-4", "tierpool": "test-rados-api-smithi072-64478-6"}]': finished 2024-03-30T15:12:59.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:59 smithi072 bash[21573]: audit 2024-03-30T15:12:58.516371+0000 mon.c (mon.2) 207 : audit 1 from='client.? 172.21.15.72:0/4226267530' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi072-64478-6", "pool2": "test-rados-api-smithi072-64478-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-30T15:12:59.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:59 smithi072 bash[21573]: audit 2024-03-30T15:12:58.529733+0000 mon.c (mon.2) 208 : audit 1 from='client.? 172.21.15.72:0/4271770396' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:59.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:59 smithi072 bash[21573]: cluster 2024-03-30T15:12:58.529798+0000 mon.a (mon.0) 1268 : cluster 0 osdmap e121: 8 total, 8 up, 8 in 2024-03-30T15:12:59.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:59 smithi072 bash[21573]: audit 2024-03-30T15:12:58.535336+0000 mon.a (mon.0) 1269 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi072-64478-6", "pool2": "test-rados-api-smithi072-64478-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-30T15:12:59.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:59 smithi072 bash[21573]: audit 2024-03-30T15:12:58.537290+0000 mon.a (mon.0) 1270 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:59.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:12:59 smithi072 bash[21573]: audit 2024-03-30T15:12:59.078161+0000 mon.a (mon.0) 1271 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:59.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:59 smithi072 bash[28946]: cluster 2024-03-30T15:12:57.882012+0000 mgr.y (mgr.14526) 219 : cluster 0 pgmap v183: 584 pgs: 64 creating+peering, 96 unknown, 424 active+clean; 217 MiB data, 992 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 3 op/s 2024-03-30T15:12:59.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:59 smithi072 bash[28946]: audit 2024-03-30T15:12:58.076878+0000 mon.a (mon.0) 1263 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:59.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:59 smithi072 bash[28946]: cluster 2024-03-30T15:12:58.489706+0000 mon.a (mon.0) 1264 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 2 cache pools are missing hit_sets) 2024-03-30T15:12:59.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:59 smithi072 bash[28946]: audit 2024-03-30T15:12:58.506545+0000 mon.a (mon.0) 1265 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-9"}]': finished 2024-03-30T15:12:59.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:59 smithi072 bash[28946]: audit 2024-03-30T15:12:58.506757+0000 mon.a (mon.0) 1266 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi072-64171-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:59.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:59 smithi072 bash[28946]: audit 2024-03-30T15:12:58.506954+0000 mon.a (mon.0) 1267 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi072-64478-4", "tierpool": "test-rados-api-smithi072-64478-6"}]': finished 2024-03-30T15:12:59.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:59 smithi072 bash[28946]: audit 2024-03-30T15:12:58.516371+0000 mon.c (mon.2) 207 : audit 1 from='client.? 172.21.15.72:0/4226267530' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi072-64478-6", "pool2": "test-rados-api-smithi072-64478-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-30T15:12:59.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:59 smithi072 bash[28946]: audit 2024-03-30T15:12:58.529733+0000 mon.c (mon.2) 208 : audit 1 from='client.? 172.21.15.72:0/4271770396' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:59.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:59 smithi072 bash[28946]: cluster 2024-03-30T15:12:58.529798+0000 mon.a (mon.0) 1268 : cluster 0 osdmap e121: 8 total, 8 up, 8 in 2024-03-30T15:12:59.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:59 smithi072 bash[28946]: audit 2024-03-30T15:12:58.535336+0000 mon.a (mon.0) 1269 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi072-64478-6", "pool2": "test-rados-api-smithi072-64478-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-30T15:12:59.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:59 smithi072 bash[28946]: audit 2024-03-30T15:12:58.537290+0000 mon.a (mon.0) 1270 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:59.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:12:59 smithi072 bash[28946]: audit 2024-03-30T15:12:59.078161+0000 mon.a (mon.0) 1271 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:59.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:59 smithi172 bash[23680]: cluster 2024-03-30T15:12:57.882012+0000 mgr.y (mgr.14526) 219 : cluster 0 pgmap v183: 584 pgs: 64 creating+peering, 96 unknown, 424 active+clean; 217 MiB data, 992 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 3 op/s 2024-03-30T15:12:59.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:59 smithi172 bash[23680]: audit 2024-03-30T15:12:58.076878+0000 mon.a (mon.0) 1263 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:12:59.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:59 smithi172 bash[23680]: cluster 2024-03-30T15:12:58.489706+0000 mon.a (mon.0) 1264 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 2 cache pools are missing hit_sets) 2024-03-30T15:12:59.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:59 smithi172 bash[23680]: audit 2024-03-30T15:12:58.506545+0000 mon.a (mon.0) 1265 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-9"}]': finished 2024-03-30T15:12:59.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:59 smithi172 bash[23680]: audit 2024-03-30T15:12:58.506757+0000 mon.a (mon.0) 1266 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi072-64171-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:12:59.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:59 smithi172 bash[23680]: audit 2024-03-30T15:12:58.506954+0000 mon.a (mon.0) 1267 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi072-64478-4", "tierpool": "test-rados-api-smithi072-64478-6"}]': finished 2024-03-30T15:12:59.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:59 smithi172 bash[23680]: audit 2024-03-30T15:12:58.516371+0000 mon.c (mon.2) 207 : audit 1 from='client.? 172.21.15.72:0/4226267530' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi072-64478-6", "pool2": "test-rados-api-smithi072-64478-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-30T15:12:59.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:59 smithi172 bash[23680]: audit 2024-03-30T15:12:58.529733+0000 mon.c (mon.2) 208 : audit 1 from='client.? 172.21.15.72:0/4271770396' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:59.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:59 smithi172 bash[23680]: cluster 2024-03-30T15:12:58.529798+0000 mon.a (mon.0) 1268 : cluster 0 osdmap e121: 8 total, 8 up, 8 in 2024-03-30T15:12:59.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:59 smithi172 bash[23680]: audit 2024-03-30T15:12:58.535336+0000 mon.a (mon.0) 1269 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi072-64478-6", "pool2": "test-rados-api-smithi072-64478-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-30T15:12:59.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:59 smithi172 bash[23680]: audit 2024-03-30T15:12:58.537290+0000 mon.a (mon.0) 1270 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:12:59.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:12:59 smithi172 bash[23680]: audit 2024-03-30T15:12:59.078161+0000 mon.a (mon.0) 1271 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:00.039 INFO:tasks.workunit.client.0.smithi072.stdout:pi_watch_notify_pp: flushed 2024-03-30T15:13:00.039 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (3025 ms) 2024-03-30T15:13:00.039 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2024-03-30T15:13:00.039 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: trying... 2024-03-30T15:13:00.039 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: handle_notify cookie 94363809290784 notify_id 468151435274 notifier_gid 25256 2024-03-30T15:13:00.039 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: timed out 2024-03-30T15:13:00.039 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: flushing 2024-03-30T15:13:00.039 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: flushed 2024-03-30T15:13:00.039 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (3035 ms) 2024-03-30T15:13:00.039 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2024-03-30T15:13:00.039 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: List watches 2024-03-30T15:13:00.039 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: notify2 2024-03-30T15:13:00.040 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: handle_notify cookie 94363809290784 notify_id 481036337157 notifier_gid 25256 2024-03-30T15:13:00.040 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: notify2 done 2024-03-30T15:13:00.040 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: watch_check 2024-03-30T15:13:00.040 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: unwatch2 2024-03-30T15:13:00.040 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: flushing 2024-03-30T15:13:00.040 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: done 2024-03-30T15:13:00.040 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (3018 ms) 2024-03-30T15:13:00.040 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2024-03-30T15:13:00.040 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: List watches 2024-03-30T15:13:00.040 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: notify2 2024-03-30T15:13:00.040 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: handle_notify cookie 94363809290784 notify_id 493921239046 notifier_gid 25256 2024-03-30T15:13:00.040 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: notify2 done 2024-03-30T15:13:00.040 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: watch_check 2024-03-30T15:13:00.041 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: unwatch2 2024-03-30T15:13:00.041 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: flushing 2024-03-30T15:13:00.041 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: done 2024-03-30T15:13:00.041 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (3013 ms) 2024-03-30T15:13:00.041 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (22836 ms total) 2024-03-30T15:13:00.041 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: 2024-03-30T15:13:00.041 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: [----------] Global test environment tear-down 2024-03-30T15:13:00.041 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: [==========] 16 tests from 2 test suites ran. (67943 ms total) 2024-03-30T15:13:00.041 INFO:tasks.workunit.client.0.smithi072.stdout: api_watch_notify_pp: [ PASSED ] 16 tests. 2024-03-30T15:13:01.166 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:13:01 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:13:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:13:01.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:00 smithi072 bash[21573]: audit 2024-03-30T15:12:59.510769+0000 mon.a (mon.0) 1272 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi072-64478-6", "pool2": "test-rados-api-smithi072-64478-6", "yes_i_really_really_mean_it": true}]': finished 2024-03-30T15:13:01.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:00 smithi072 bash[21573]: audit 2024-03-30T15:12:59.510987+0000 mon.a (mon.0) 1273 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:01.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:00 smithi072 bash[21573]: cluster 2024-03-30T15:12:59.521862+0000 mon.a (mon.0) 1274 : cluster 0 osdmap e122: 8 total, 8 up, 8 in 2024-03-30T15:13:01.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:00 smithi072 bash[21573]: audit 2024-03-30T15:12:59.611011+0000 mon.c (mon.2) 209 : audit 1 from='client.? 172.21.15.72:0/3570618374' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi072-64378-10"}]: dispatch 2024-03-30T15:13:01.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:00 smithi072 bash[21573]: cluster 2024-03-30T15:13:00.022433+0000 mon.a (mon.0) 1275 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:13:01.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:00 smithi072 bash[21573]: cluster 2024-03-30T15:13:00.451628+0000 mon.a (mon.0) 1276 : cluster 0 osdmap e123: 8 total, 8 up, 8 in 2024-03-30T15:13:01.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:00 smithi072 bash[28946]: audit 2024-03-30T15:12:59.510769+0000 mon.a (mon.0) 1272 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi072-64478-6", "pool2": "test-rados-api-smithi072-64478-6", "yes_i_really_really_mean_it": true}]': finished 2024-03-30T15:13:01.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:00 smithi072 bash[28946]: audit 2024-03-30T15:12:59.510987+0000 mon.a (mon.0) 1273 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:01.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:00 smithi072 bash[28946]: cluster 2024-03-30T15:12:59.521862+0000 mon.a (mon.0) 1274 : cluster 0 osdmap e122: 8 total, 8 up, 8 in 2024-03-30T15:13:01.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:00 smithi072 bash[28946]: audit 2024-03-30T15:12:59.611011+0000 mon.c (mon.2) 209 : audit 1 from='client.? 172.21.15.72:0/3570618374' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi072-64378-10"}]: dispatch 2024-03-30T15:13:01.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:00 smithi072 bash[28946]: cluster 2024-03-30T15:13:00.022433+0000 mon.a (mon.0) 1275 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:13:01.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:00 smithi072 bash[28946]: cluster 2024-03-30T15:13:00.451628+0000 mon.a (mon.0) 1276 : cluster 0 osdmap e123: 8 total, 8 up, 8 in 2024-03-30T15:13:01.216 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:13:01 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:13:01.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:00 smithi172 bash[23680]: audit 2024-03-30T15:12:59.510769+0000 mon.a (mon.0) 1272 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi072-64478-6", "pool2": "test-rados-api-smithi072-64478-6", "yes_i_really_really_mean_it": true}]': finished 2024-03-30T15:13:01.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:00 smithi172 bash[23680]: audit 2024-03-30T15:12:59.510987+0000 mon.a (mon.0) 1273 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:01.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:00 smithi172 bash[23680]: cluster 2024-03-30T15:12:59.521862+0000 mon.a (mon.0) 1274 : cluster 0 osdmap e122: 8 total, 8 up, 8 in 2024-03-30T15:13:01.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:00 smithi172 bash[23680]: audit 2024-03-30T15:12:59.611011+0000 mon.c (mon.2) 209 : audit 1 from='client.? 172.21.15.72:0/3570618374' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi072-64378-10"}]: dispatch 2024-03-30T15:13:01.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:00 smithi172 bash[23680]: cluster 2024-03-30T15:13:00.022433+0000 mon.a (mon.0) 1275 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:13:01.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:00 smithi172 bash[23680]: cluster 2024-03-30T15:13:00.451628+0000 mon.a (mon.0) 1276 : cluster 0 osdmap e123: 8 total, 8 up, 8 in 2024-03-30T15:13:02.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:02 smithi072 bash[28946]: cluster 2024-03-30T15:12:59.882900+0000 mgr.y (mgr.14526) 220 : cluster 0 pgmap v186: 420 pgs: 96 unknown, 324 active+clean; 217 MiB data, 992 MiB used, 714 GiB / 715 GiB avail 2024-03-30T15:13:02.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:02 smithi072 bash[28946]: audit 2024-03-30T15:13:00.892969+0000 mon.a (mon.0) 1277 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:02.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:02 smithi072 bash[28946]: audit 2024-03-30T15:13:00.899693+0000 mon.a (mon.0) 1278 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi072-64378-10"}]: dispatch 2024-03-30T15:13:02.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:02 smithi072 bash[28946]: audit 2024-03-30T15:13:00.900568+0000 mon.a (mon.0) 1279 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:02.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:02 smithi072 bash[28946]: audit 2024-03-30T15:13:00.901243+0000 mon.c (mon.2) 210 : audit 1 from='client.? 172.21.15.72:0/3570618374' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi072-64378-10"}]: dispatch 2024-03-30T15:13:02.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:02 smithi072 bash[28946]: audit 2024-03-30T15:13:01.318267+0000 mon.a (mon.0) 1280 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:02.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:02 smithi072 bash[28946]: audit 2024-03-30T15:13:01.335916+0000 mon.c (mon.2) 211 : audit 1 from='client.? 172.21.15.72:0/4111829184' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi072-64163-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:02.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:02 smithi072 bash[28946]: audit 2024-03-30T15:13:01.336276+0000 mon.c (mon.2) 212 : audit 1 from='client.? 172.21.15.72:0/2394348766' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi072-64171-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:02.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:02 smithi072 bash[28946]: cluster 2024-03-30T15:13:01.776055+0000 mon.a (mon.0) 1281 : cluster 0 osdmap e124: 8 total, 8 up, 8 in 2024-03-30T15:13:02.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:02 smithi072 bash[28946]: audit 2024-03-30T15:13:01.791054+0000 mon.a (mon.0) 1282 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi072-64378-10"}]: dispatch 2024-03-30T15:13:02.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:02 smithi072 bash[21573]: cluster 2024-03-30T15:12:59.882900+0000 mgr.y (mgr.14526) 220 : cluster 0 pgmap v186: 420 pgs: 96 unknown, 324 active+clean; 217 MiB data, 992 MiB used, 714 GiB / 715 GiB avail 2024-03-30T15:13:02.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:02 smithi072 bash[21573]: audit 2024-03-30T15:13:00.892969+0000 mon.a (mon.0) 1277 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:02.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:02 smithi072 bash[21573]: audit 2024-03-30T15:13:00.899693+0000 mon.a (mon.0) 1278 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi072-64378-10"}]: dispatch 2024-03-30T15:13:02.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:02 smithi072 bash[21573]: audit 2024-03-30T15:13:00.900568+0000 mon.a (mon.0) 1279 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:02.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:02 smithi072 bash[21573]: audit 2024-03-30T15:13:00.901243+0000 mon.c (mon.2) 210 : audit 1 from='client.? 172.21.15.72:0/3570618374' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi072-64378-10"}]: dispatch 2024-03-30T15:13:02.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:02 smithi072 bash[21573]: audit 2024-03-30T15:13:01.318267+0000 mon.a (mon.0) 1280 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:02.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:02 smithi072 bash[21573]: audit 2024-03-30T15:13:01.335916+0000 mon.c (mon.2) 211 : audit 1 from='client.? 172.21.15.72:0/4111829184' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi072-64163-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:02.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:02 smithi072 bash[21573]: audit 2024-03-30T15:13:01.336276+0000 mon.c (mon.2) 212 : audit 1 from='client.? 172.21.15.72:0/2394348766' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi072-64171-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:02.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:02 smithi072 bash[21573]: cluster 2024-03-30T15:13:01.776055+0000 mon.a (mon.0) 1281 : cluster 0 osdmap e124: 8 total, 8 up, 8 in 2024-03-30T15:13:02.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:02 smithi072 bash[21573]: audit 2024-03-30T15:13:01.791054+0000 mon.a (mon.0) 1282 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi072-64378-10"}]: dispatch 2024-03-30T15:13:02.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:02 smithi172 bash[23680]: cluster 2024-03-30T15:12:59.882900+0000 mgr.y (mgr.14526) 220 : cluster 0 pgmap v186: 420 pgs: 96 unknown, 324 active+clean; 217 MiB data, 992 MiB used, 714 GiB / 715 GiB avail 2024-03-30T15:13:02.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:02 smithi172 bash[23680]: audit 2024-03-30T15:13:00.892969+0000 mon.a (mon.0) 1277 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:02.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:02 smithi172 bash[23680]: audit 2024-03-30T15:13:00.899693+0000 mon.a (mon.0) 1278 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi072-64378-10"}]: dispatch 2024-03-30T15:13:02.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:02 smithi172 bash[23680]: audit 2024-03-30T15:13:00.900568+0000 mon.a (mon.0) 1279 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:02.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:02 smithi172 bash[23680]: audit 2024-03-30T15:13:00.901243+0000 mon.c (mon.2) 210 : audit 1 from='client.? 172.21.15.72:0/3570618374' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi072-64378-10"}]: dispatch 2024-03-30T15:13:02.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:02 smithi172 bash[23680]: audit 2024-03-30T15:13:01.318267+0000 mon.a (mon.0) 1280 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:02.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:02 smithi172 bash[23680]: audit 2024-03-30T15:13:01.335916+0000 mon.c (mon.2) 211 : audit 1 from='client.? 172.21.15.72:0/4111829184' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi072-64163-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:02.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:02 smithi172 bash[23680]: audit 2024-03-30T15:13:01.336276+0000 mon.c (mon.2) 212 : audit 1 from='client.? 172.21.15.72:0/2394348766' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi072-64171-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:02.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:02 smithi172 bash[23680]: cluster 2024-03-30T15:13:01.776055+0000 mon.a (mon.0) 1281 : cluster 0 osdmap e124: 8 total, 8 up, 8 in 2024-03-30T15:13:02.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:02 smithi172 bash[23680]: audit 2024-03-30T15:13:01.791054+0000 mon.a (mon.0) 1282 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi072-64378-10"}]: dispatch 2024-03-30T15:13:03.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:03 smithi072 bash[21573]: audit 2024-03-30T15:13:00.999741+0000 mgr.y (mgr.14526) 221 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:13:03.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:03 smithi072 bash[21573]: audit 2024-03-30T15:13:01.795476+0000 mon.c (mon.2) 213 : audit 1 from='client.? 172.21.15.72:0/3570618374' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi072-64378-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:13:03.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:03 smithi072 bash[21573]: cluster 2024-03-30T15:13:01.883909+0000 mgr.y (mgr.14526) 222 : cluster 0 pgmap v189: 452 pgs: 32 creating+peering, 96 unknown, 324 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-03-30T15:13:03.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:03 smithi072 bash[21573]: audit 2024-03-30T15:13:02.221224+0000 mon.a (mon.0) 1283 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi072-64163-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:03.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:03 smithi072 bash[21573]: audit 2024-03-30T15:13:02.221909+0000 mon.a (mon.0) 1284 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:03.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:03 smithi072 bash[21573]: audit 2024-03-30T15:13:02.230356+0000 mon.a (mon.0) 1285 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi072-64171-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:03.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:03 smithi072 bash[21573]: audit 2024-03-30T15:13:02.232410+0000 mon.a (mon.0) 1286 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi072-64378-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:13:03.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:03 smithi072 bash[21573]: audit 2024-03-30T15:13:02.686190+0000 mon.a (mon.0) 1287 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi072-64163-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:03.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:03 smithi072 bash[21573]: audit 2024-03-30T15:13:02.686335+0000 mon.a (mon.0) 1288 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi072-64171-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:03.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:03 smithi072 bash[21573]: audit 2024-03-30T15:13:02.686469+0000 mon.a (mon.0) 1289 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi072-64378-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:13:03.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:03 smithi072 bash[21573]: audit 2024-03-30T15:13:02.703939+0000 mon.c (mon.2) 214 : audit 1 from='client.? 172.21.15.72:0/3570618374' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi072-64378-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi072-64378-10"}]: dispatch 2024-03-30T15:13:03.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:03 smithi072 bash[21573]: cluster 2024-03-30T15:13:03.122478+0000 mon.a (mon.0) 1290 : cluster 0 osdmap e125: 8 total, 8 up, 8 in 2024-03-30T15:13:03.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:03 smithi072 bash[21573]: audit 2024-03-30T15:13:03.124196+0000 mon.a (mon.0) 1291 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi072-64378-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi072-64378-10"}]: dispatch 2024-03-30T15:13:03.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:03 smithi072 bash[21573]: audit 2024-03-30T15:13:03.143048+0000 mon.a (mon.0) 1292 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:13:03.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:03 smithi072 bash[28946]: audit 2024-03-30T15:13:00.999741+0000 mgr.y (mgr.14526) 221 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:13:03.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:03 smithi072 bash[28946]: audit 2024-03-30T15:13:01.795476+0000 mon.c (mon.2) 213 : audit 1 from='client.? 172.21.15.72:0/3570618374' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi072-64378-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:13:03.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:03 smithi072 bash[28946]: cluster 2024-03-30T15:13:01.883909+0000 mgr.y (mgr.14526) 222 : cluster 0 pgmap v189: 452 pgs: 32 creating+peering, 96 unknown, 324 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-03-30T15:13:03.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:03 smithi072 bash[28946]: audit 2024-03-30T15:13:02.221224+0000 mon.a (mon.0) 1283 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi072-64163-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:03.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:03 smithi072 bash[28946]: audit 2024-03-30T15:13:02.221909+0000 mon.a (mon.0) 1284 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:03.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:03 smithi072 bash[28946]: audit 2024-03-30T15:13:02.230356+0000 mon.a (mon.0) 1285 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi072-64171-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:03.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:03 smithi072 bash[28946]: audit 2024-03-30T15:13:02.232410+0000 mon.a (mon.0) 1286 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi072-64378-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:13:03.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:03 smithi072 bash[28946]: audit 2024-03-30T15:13:02.686190+0000 mon.a (mon.0) 1287 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi072-64163-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:03.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:03 smithi072 bash[28946]: audit 2024-03-30T15:13:02.686335+0000 mon.a (mon.0) 1288 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi072-64171-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:03.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:03 smithi072 bash[28946]: audit 2024-03-30T15:13:02.686469+0000 mon.a (mon.0) 1289 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi072-64378-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:13:03.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:03 smithi072 bash[28946]: audit 2024-03-30T15:13:02.703939+0000 mon.c (mon.2) 214 : audit 1 from='client.? 172.21.15.72:0/3570618374' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi072-64378-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi072-64378-10"}]: dispatch 2024-03-30T15:13:03.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:03 smithi072 bash[28946]: cluster 2024-03-30T15:13:03.122478+0000 mon.a (mon.0) 1290 : cluster 0 osdmap e125: 8 total, 8 up, 8 in 2024-03-30T15:13:03.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:03 smithi072 bash[28946]: audit 2024-03-30T15:13:03.124196+0000 mon.a (mon.0) 1291 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi072-64378-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi072-64378-10"}]: dispatch 2024-03-30T15:13:03.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:03 smithi072 bash[28946]: audit 2024-03-30T15:13:03.143048+0000 mon.a (mon.0) 1292 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:13:03.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:03 smithi172 bash[23680]: audit 2024-03-30T15:13:00.999741+0000 mgr.y (mgr.14526) 221 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:13:03.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:03 smithi172 bash[23680]: audit 2024-03-30T15:13:01.795476+0000 mon.c (mon.2) 213 : audit 1 from='client.? 172.21.15.72:0/3570618374' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi072-64378-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:13:03.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:03 smithi172 bash[23680]: cluster 2024-03-30T15:13:01.883909+0000 mgr.y (mgr.14526) 222 : cluster 0 pgmap v189: 452 pgs: 32 creating+peering, 96 unknown, 324 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-03-30T15:13:03.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:03 smithi172 bash[23680]: audit 2024-03-30T15:13:02.221224+0000 mon.a (mon.0) 1283 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi072-64163-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:03.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:03 smithi172 bash[23680]: audit 2024-03-30T15:13:02.221909+0000 mon.a (mon.0) 1284 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:03.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:03 smithi172 bash[23680]: audit 2024-03-30T15:13:02.230356+0000 mon.a (mon.0) 1285 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi072-64171-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:03.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:03 smithi172 bash[23680]: audit 2024-03-30T15:13:02.232410+0000 mon.a (mon.0) 1286 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi072-64378-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:13:03.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:03 smithi172 bash[23680]: audit 2024-03-30T15:13:02.686190+0000 mon.a (mon.0) 1287 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi072-64163-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:03.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:03 smithi172 bash[23680]: audit 2024-03-30T15:13:02.686335+0000 mon.a (mon.0) 1288 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi072-64171-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:03.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:03 smithi172 bash[23680]: audit 2024-03-30T15:13:02.686469+0000 mon.a (mon.0) 1289 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi072-64378-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:13:03.721 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:03 smithi172 bash[23680]: audit 2024-03-30T15:13:02.703939+0000 mon.c (mon.2) 214 : audit 1 from='client.? 172.21.15.72:0/3570618374' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi072-64378-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi072-64378-10"}]: dispatch 2024-03-30T15:13:03.722 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:03 smithi172 bash[23680]: cluster 2024-03-30T15:13:03.122478+0000 mon.a (mon.0) 1290 : cluster 0 osdmap e125: 8 total, 8 up, 8 in 2024-03-30T15:13:03.722 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:03 smithi172 bash[23680]: audit 2024-03-30T15:13:03.124196+0000 mon.a (mon.0) 1291 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi072-64378-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi072-64378-10"}]: dispatch 2024-03-30T15:13:03.722 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:03 smithi172 bash[23680]: audit 2024-03-30T15:13:03.143048+0000 mon.a (mon.0) 1292 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:13:04.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:04 smithi072 bash[21573]: audit 2024-03-30T15:13:03.223616+0000 mon.a (mon.0) 1293 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:04.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:04 smithi072 bash[21573]: audit 2024-03-30T15:13:03.692049+0000 mon.a (mon.0) 1294 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-11", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:13:04.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:04 smithi072 bash[21573]: cluster 2024-03-30T15:13:04.139360+0000 mon.a (mon.0) 1295 : cluster 0 osdmap e126: 8 total, 8 up, 8 in 2024-03-30T15:13:04.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:04 smithi072 bash[21573]: audit 2024-03-30T15:13:04.140566+0000 mon.a (mon.0) 1296 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-11"}]: dispatch 2024-03-30T15:13:04.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:04 smithi072 bash[28946]: audit 2024-03-30T15:13:03.223616+0000 mon.a (mon.0) 1293 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:04.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:04 smithi072 bash[28946]: audit 2024-03-30T15:13:03.692049+0000 mon.a (mon.0) 1294 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-11", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:13:04.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:04 smithi072 bash[28946]: cluster 2024-03-30T15:13:04.139360+0000 mon.a (mon.0) 1295 : cluster 0 osdmap e126: 8 total, 8 up, 8 in 2024-03-30T15:13:04.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:04 smithi072 bash[28946]: audit 2024-03-30T15:13:04.140566+0000 mon.a (mon.0) 1296 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-11"}]: dispatch 2024-03-30T15:13:04.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:04 smithi172 bash[23680]: audit 2024-03-30T15:13:03.223616+0000 mon.a (mon.0) 1293 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:04.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:04 smithi172 bash[23680]: audit 2024-03-30T15:13:03.692049+0000 mon.a (mon.0) 1294 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-11", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:13:04.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:04 smithi172 bash[23680]: cluster 2024-03-30T15:13:04.139360+0000 mon.a (mon.0) 1295 : cluster 0 osdmap e126: 8 total, 8 up, 8 in 2024-03-30T15:13:04.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:04 smithi172 bash[23680]: audit 2024-03-30T15:13:04.140566+0000 mon.a (mon.0) 1296 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-11"}]: dispatch 2024-03-30T15:13:06.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:06 smithi072 bash[21573]: cluster 2024-03-30T15:13:03.884523+0000 mgr.y (mgr.14526) 223 : cluster 0 pgmap v192: 484 pgs: 32 creating+peering, 160 unknown, 292 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-03-30T15:13:06.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:06 smithi072 bash[21573]: audit 2024-03-30T15:13:04.601256+0000 mon.a (mon.0) 1297 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:06.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:06 smithi072 bash[21573]: cluster 2024-03-30T15:13:05.025416+0000 mon.a (mon.0) 1298 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:13:06.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:06 smithi072 bash[21573]: audit 2024-03-30T15:13:05.027525+0000 mon.a (mon.0) 1299 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi072-64378-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi072-64378-10"}]': finished 2024-03-30T15:13:06.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:06 smithi072 bash[21573]: audit 2024-03-30T15:13:05.027777+0000 mon.a (mon.0) 1300 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-11"}]': finished 2024-03-30T15:13:06.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:06 smithi072 bash[21573]: cluster 2024-03-30T15:13:05.038667+0000 mon.a (mon.0) 1301 : cluster 0 osdmap e127: 8 total, 8 up, 8 in 2024-03-30T15:13:06.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:06 smithi072 bash[21573]: audit 2024-03-30T15:13:05.047813+0000 mon.a (mon.0) 1302 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-11", "mode": "writeback"}]: dispatch 2024-03-30T15:13:06.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:06 smithi072 bash[21573]: audit 2024-03-30T15:13:05.058006+0000 mon.a (mon.0) 1303 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:13:06.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:06 smithi072 bash[21573]: audit 2024-03-30T15:13:05.068350+0000 mon.c (mon.2) 215 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:13:06.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:06 smithi072 bash[21573]: audit 2024-03-30T15:13:05.069963+0000 mon.a (mon.0) 1304 : audit 1 from='client.? 172.21.15.72:0/2096135157' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:06.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:06 smithi072 bash[21573]: audit 2024-03-30T15:13:05.070394+0000 mon.a (mon.0) 1305 : audit 1 from='client.? 172.21.15.72:0/2000656138' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi072-64171-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:06.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:06 smithi072 bash[21573]: cluster 2024-03-30T15:13:05.090131+0000 mon.a (mon.0) 1306 : cluster 0 osdmap e128: 8 total, 8 up, 8 in 2024-03-30T15:13:06.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:06 smithi072 bash[28946]: cluster 2024-03-30T15:13:03.884523+0000 mgr.y (mgr.14526) 223 : cluster 0 pgmap v192: 484 pgs: 32 creating+peering, 160 unknown, 292 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-03-30T15:13:06.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:06 smithi072 bash[28946]: audit 2024-03-30T15:13:04.601256+0000 mon.a (mon.0) 1297 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:06.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:06 smithi072 bash[28946]: cluster 2024-03-30T15:13:05.025416+0000 mon.a (mon.0) 1298 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:13:06.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:06 smithi072 bash[28946]: audit 2024-03-30T15:13:05.027525+0000 mon.a (mon.0) 1299 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi072-64378-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi072-64378-10"}]': finished 2024-03-30T15:13:06.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:06 smithi072 bash[28946]: audit 2024-03-30T15:13:05.027777+0000 mon.a (mon.0) 1300 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-11"}]': finished 2024-03-30T15:13:06.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:06 smithi072 bash[28946]: cluster 2024-03-30T15:13:05.038667+0000 mon.a (mon.0) 1301 : cluster 0 osdmap e127: 8 total, 8 up, 8 in 2024-03-30T15:13:06.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:06 smithi072 bash[28946]: audit 2024-03-30T15:13:05.047813+0000 mon.a (mon.0) 1302 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-11", "mode": "writeback"}]: dispatch 2024-03-30T15:13:06.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:06 smithi072 bash[28946]: audit 2024-03-30T15:13:05.058006+0000 mon.a (mon.0) 1303 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:13:06.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:06 smithi072 bash[28946]: audit 2024-03-30T15:13:05.068350+0000 mon.c (mon.2) 215 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:13:06.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:06 smithi072 bash[28946]: audit 2024-03-30T15:13:05.069963+0000 mon.a (mon.0) 1304 : audit 1 from='client.? 172.21.15.72:0/2096135157' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:06.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:06 smithi072 bash[28946]: audit 2024-03-30T15:13:05.070394+0000 mon.a (mon.0) 1305 : audit 1 from='client.? 172.21.15.72:0/2000656138' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi072-64171-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:06.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:06 smithi072 bash[28946]: cluster 2024-03-30T15:13:05.090131+0000 mon.a (mon.0) 1306 : cluster 0 osdmap e128: 8 total, 8 up, 8 in 2024-03-30T15:13:06.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:06 smithi172 bash[23680]: cluster 2024-03-30T15:13:03.884523+0000 mgr.y (mgr.14526) 223 : cluster 0 pgmap v192: 484 pgs: 32 creating+peering, 160 unknown, 292 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-03-30T15:13:06.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:06 smithi172 bash[23680]: audit 2024-03-30T15:13:04.601256+0000 mon.a (mon.0) 1297 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:06.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:06 smithi172 bash[23680]: cluster 2024-03-30T15:13:05.025416+0000 mon.a (mon.0) 1298 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:13:06.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:06 smithi172 bash[23680]: audit 2024-03-30T15:13:05.027525+0000 mon.a (mon.0) 1299 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi072-64378-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi072-64378-10"}]': finished 2024-03-30T15:13:06.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:06 smithi172 bash[23680]: audit 2024-03-30T15:13:05.027777+0000 mon.a (mon.0) 1300 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-11"}]': finished 2024-03-30T15:13:06.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:06 smithi172 bash[23680]: cluster 2024-03-30T15:13:05.038667+0000 mon.a (mon.0) 1301 : cluster 0 osdmap e127: 8 total, 8 up, 8 in 2024-03-30T15:13:06.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:06 smithi172 bash[23680]: audit 2024-03-30T15:13:05.047813+0000 mon.a (mon.0) 1302 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-11", "mode": "writeback"}]: dispatch 2024-03-30T15:13:06.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:06 smithi172 bash[23680]: audit 2024-03-30T15:13:05.058006+0000 mon.a (mon.0) 1303 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:13:06.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:06 smithi172 bash[23680]: audit 2024-03-30T15:13:05.068350+0000 mon.c (mon.2) 215 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:13:06.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:06 smithi172 bash[23680]: audit 2024-03-30T15:13:05.069963+0000 mon.a (mon.0) 1304 : audit 1 from='client.? 172.21.15.72:0/2096135157' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:06.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:06 smithi172 bash[23680]: audit 2024-03-30T15:13:05.070394+0000 mon.a (mon.0) 1305 : audit 1 from='client.? 172.21.15.72:0/2000656138' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi072-64171-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:06.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:06 smithi172 bash[23680]: cluster 2024-03-30T15:13:05.090131+0000 mon.a (mon.0) 1306 : cluster 0 osdmap e128: 8 total, 8 up, 8 in 2024-03-30T15:13:07.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:07 smithi072 bash[21573]: cluster 2024-03-30T15:13:05.887846+0000 mgr.y (mgr.14526) 224 : cluster 0 pgmap v195: 460 pgs: 72 creating+peering, 388 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 3.7 KiB/s wr, 5 op/s 2024-03-30T15:13:07.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:07 smithi072 bash[21573]: audit 2024-03-30T15:13:05.956081+0000 mon.a (mon.0) 1307 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:07.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:07 smithi072 bash[21573]: cluster 2024-03-30T15:13:06.392522+0000 mon.a (mon.0) 1308 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:13:07.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:07 smithi072 bash[21573]: audit 2024-03-30T15:13:06.409355+0000 mon.a (mon.0) 1309 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-11", "mode": "writeback"}]': finished 2024-03-30T15:13:07.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:07 smithi072 bash[21573]: audit 2024-03-30T15:13:06.409411+0000 mon.a (mon.0) 1310 : audit 1 from='client.? 172.21.15.72:0/2096135157' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:07.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:07 smithi072 bash[21573]: audit 2024-03-30T15:13:06.409455+0000 mon.a (mon.0) 1311 : audit 1 from='client.? 172.21.15.72:0/2000656138' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi072-64171-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:07.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:07 smithi072 bash[21573]: cluster 2024-03-30T15:13:06.416588+0000 mon.a (mon.0) 1312 : cluster 0 osdmap e129: 8 total, 8 up, 8 in 2024-03-30T15:13:07.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:07 smithi072 bash[21573]: audit 2024-03-30T15:13:06.428228+0000 mon.c (mon.2) 216 : audit 1 from='client.? 172.21.15.72:0/3566271004' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi072-64163-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:07.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:07 smithi072 bash[21573]: audit 2024-03-30T15:13:06.431066+0000 mon.a (mon.0) 1313 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi072-64163-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:07.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:07 smithi072 bash[21573]: audit 2024-03-30T15:13:06.957438+0000 mon.a (mon.0) 1314 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:07.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:07 smithi072 bash[21573]: audit 2024-03-30T15:13:07.103612+0000 mon.c (mon.2) 217 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:13:07.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:07 smithi072 bash[28946]: cluster 2024-03-30T15:13:05.887846+0000 mgr.y (mgr.14526) 224 : cluster 0 pgmap v195: 460 pgs: 72 creating+peering, 388 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 3.7 KiB/s wr, 5 op/s 2024-03-30T15:13:07.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:07 smithi072 bash[28946]: audit 2024-03-30T15:13:05.956081+0000 mon.a (mon.0) 1307 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:07.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:07 smithi072 bash[28946]: cluster 2024-03-30T15:13:06.392522+0000 mon.a (mon.0) 1308 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:13:07.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:07 smithi072 bash[28946]: audit 2024-03-30T15:13:06.409355+0000 mon.a (mon.0) 1309 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-11", "mode": "writeback"}]': finished 2024-03-30T15:13:07.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:07 smithi072 bash[28946]: audit 2024-03-30T15:13:06.409411+0000 mon.a (mon.0) 1310 : audit 1 from='client.? 172.21.15.72:0/2096135157' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:07.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:07 smithi072 bash[28946]: audit 2024-03-30T15:13:06.409455+0000 mon.a (mon.0) 1311 : audit 1 from='client.? 172.21.15.72:0/2000656138' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi072-64171-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:07.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:07 smithi072 bash[28946]: cluster 2024-03-30T15:13:06.416588+0000 mon.a (mon.0) 1312 : cluster 0 osdmap e129: 8 total, 8 up, 8 in 2024-03-30T15:13:07.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:07 smithi072 bash[28946]: audit 2024-03-30T15:13:06.428228+0000 mon.c (mon.2) 216 : audit 1 from='client.? 172.21.15.72:0/3566271004' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi072-64163-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:07.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:07 smithi072 bash[28946]: audit 2024-03-30T15:13:06.431066+0000 mon.a (mon.0) 1313 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi072-64163-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:07.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:07 smithi072 bash[28946]: audit 2024-03-30T15:13:06.957438+0000 mon.a (mon.0) 1314 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:07.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:07 smithi072 bash[28946]: audit 2024-03-30T15:13:07.103612+0000 mon.c (mon.2) 217 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:13:07.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:07 smithi172 bash[23680]: cluster 2024-03-30T15:13:05.887846+0000 mgr.y (mgr.14526) 224 : cluster 0 pgmap v195: 460 pgs: 72 creating+peering, 388 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 3.7 KiB/s wr, 5 op/s 2024-03-30T15:13:07.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:07 smithi172 bash[23680]: audit 2024-03-30T15:13:05.956081+0000 mon.a (mon.0) 1307 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:07.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:07 smithi172 bash[23680]: cluster 2024-03-30T15:13:06.392522+0000 mon.a (mon.0) 1308 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:13:07.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:07 smithi172 bash[23680]: audit 2024-03-30T15:13:06.409355+0000 mon.a (mon.0) 1309 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-11", "mode": "writeback"}]': finished 2024-03-30T15:13:07.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:07 smithi172 bash[23680]: audit 2024-03-30T15:13:06.409411+0000 mon.a (mon.0) 1310 : audit 1 from='client.? 172.21.15.72:0/2096135157' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64381-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:07.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:07 smithi172 bash[23680]: audit 2024-03-30T15:13:06.409455+0000 mon.a (mon.0) 1311 : audit 1 from='client.? 172.21.15.72:0/2000656138' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi072-64171-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:07.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:07 smithi172 bash[23680]: cluster 2024-03-30T15:13:06.416588+0000 mon.a (mon.0) 1312 : cluster 0 osdmap e129: 8 total, 8 up, 8 in 2024-03-30T15:13:07.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:07 smithi172 bash[23680]: audit 2024-03-30T15:13:06.428228+0000 mon.c (mon.2) 216 : audit 1 from='client.? 172.21.15.72:0/3566271004' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi072-64163-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:07.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:07 smithi172 bash[23680]: audit 2024-03-30T15:13:06.431066+0000 mon.a (mon.0) 1313 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi072-64163-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:07.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:07 smithi172 bash[23680]: audit 2024-03-30T15:13:06.957438+0000 mon.a (mon.0) 1314 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:07.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:07 smithi172 bash[23680]: audit 2024-03-30T15:13:07.103612+0000 mon.c (mon.2) 217 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:13:08.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:08 smithi172 bash[23680]: audit 2024-03-30T15:13:07.416085+0000 mon.a (mon.0) 1315 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi072-64163-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:08.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:08 smithi172 bash[23680]: cluster 2024-03-30T15:13:07.429219+0000 mon.a (mon.0) 1316 : cluster 0 osdmap e130: 8 total, 8 up, 8 in 2024-03-30T15:13:08.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:08 smithi172 bash[23680]: audit 2024-03-30T15:13:07.462892+0000 mon.a (mon.0) 1317 : audit 1 from='client.? 172.21.15.72:0/2096135157' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64381-10", "tierpool":"test-rados-api-smithi072-64381-10-cache", "force_nonempty":""}]: dispatch 2024-03-30T15:13:08.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:08 smithi172 bash[23680]: audit 2024-03-30T15:13:07.894174+0000 mon.c (mon.2) 218 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:13:08.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:08 smithi172 bash[23680]: audit 2024-03-30T15:13:07.895667+0000 mon.c (mon.2) 219 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:13:08.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:08 smithi172 bash[23680]: audit 2024-03-30T15:13:08.400654+0000 mon.a (mon.0) 1318 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:08.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:08 smithi172 bash[23680]: audit 2024-03-30T15:13:08.401318+0000 mon.a (mon.0) 1319 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:13:08.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:08 smithi072 bash[21573]: audit 2024-03-30T15:13:07.416085+0000 mon.a (mon.0) 1315 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi072-64163-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:08.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:08 smithi072 bash[21573]: cluster 2024-03-30T15:13:07.429219+0000 mon.a (mon.0) 1316 : cluster 0 osdmap e130: 8 total, 8 up, 8 in 2024-03-30T15:13:08.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:08 smithi072 bash[21573]: audit 2024-03-30T15:13:07.462892+0000 mon.a (mon.0) 1317 : audit 1 from='client.? 172.21.15.72:0/2096135157' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64381-10", "tierpool":"test-rados-api-smithi072-64381-10-cache", "force_nonempty":""}]: dispatch 2024-03-30T15:13:08.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:08 smithi072 bash[21573]: audit 2024-03-30T15:13:07.894174+0000 mon.c (mon.2) 218 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:13:08.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:08 smithi072 bash[21573]: audit 2024-03-30T15:13:07.895667+0000 mon.c (mon.2) 219 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:13:08.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:08 smithi072 bash[21573]: audit 2024-03-30T15:13:08.400654+0000 mon.a (mon.0) 1318 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:08.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:08 smithi072 bash[21573]: audit 2024-03-30T15:13:08.401318+0000 mon.a (mon.0) 1319 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:13:08.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:08 smithi072 bash[28946]: audit 2024-03-30T15:13:07.416085+0000 mon.a (mon.0) 1315 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi072-64163-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:08.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:08 smithi072 bash[28946]: cluster 2024-03-30T15:13:07.429219+0000 mon.a (mon.0) 1316 : cluster 0 osdmap e130: 8 total, 8 up, 8 in 2024-03-30T15:13:08.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:08 smithi072 bash[28946]: audit 2024-03-30T15:13:07.462892+0000 mon.a (mon.0) 1317 : audit 1 from='client.? 172.21.15.72:0/2096135157' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64381-10", "tierpool":"test-rados-api-smithi072-64381-10-cache", "force_nonempty":""}]: dispatch 2024-03-30T15:13:08.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:08 smithi072 bash[28946]: audit 2024-03-30T15:13:07.894174+0000 mon.c (mon.2) 218 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:13:08.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:08 smithi072 bash[28946]: audit 2024-03-30T15:13:07.895667+0000 mon.c (mon.2) 219 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:13:08.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:08 smithi072 bash[28946]: audit 2024-03-30T15:13:08.400654+0000 mon.a (mon.0) 1318 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:08.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:08 smithi072 bash[28946]: audit 2024-03-30T15:13:08.401318+0000 mon.a (mon.0) 1319 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:13:10.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:09 smithi072 bash[21573]: audit 2024-03-30T15:13:08.424197+0000 mon.a (mon.0) 1320 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:13:10.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:09 smithi072 bash[21573]: audit 2024-03-30T15:13:08.430402+0000 mon.a (mon.0) 1321 : audit 1 from='client.? 172.21.15.72:0/2096135157' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64381-10", "tierpool":"test-rados-api-smithi072-64381-10-cache", "force_nonempty":""}]': finished 2024-03-30T15:13:10.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:09 smithi072 bash[21573]: audit 2024-03-30T15:13:08.430540+0000 mon.a (mon.0) 1322 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:13:10.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:09 smithi072 bash[21573]: audit 2024-03-30T15:13:08.446995+0000 mon.c (mon.2) 220 : audit 1 from='client.? 172.21.15.72:0/1158838620' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi072-64171-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:10.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:09 smithi072 bash[21573]: cluster 2024-03-30T15:13:08.447050+0000 mon.a (mon.0) 1323 : cluster 0 osdmap e131: 8 total, 8 up, 8 in 2024-03-30T15:13:10.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:09 smithi072 bash[21573]: audit 2024-03-30T15:13:08.459136+0000 mon.a (mon.0) 1324 : audit 1 from='client.? 172.21.15.72:0/2096135157' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64381-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:10.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:09 smithi072 bash[21573]: audit 2024-03-30T15:13:08.459691+0000 mon.a (mon.0) 1325 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi072-64171-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:10.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:09 smithi072 bash[21573]: audit 2024-03-30T15:13:08.459989+0000 mon.a (mon.0) 1326 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-11"}]: dispatch 2024-03-30T15:13:10.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:09 smithi072 bash[21573]: cluster 2024-03-30T15:13:08.461148+0000 mon.a (mon.0) 1327 : cluster 1 Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-03-30T15:13:10.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:09 smithi072 bash[28946]: audit 2024-03-30T15:13:08.424197+0000 mon.a (mon.0) 1320 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:13:10.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:09 smithi072 bash[28946]: audit 2024-03-30T15:13:08.430402+0000 mon.a (mon.0) 1321 : audit 1 from='client.? 172.21.15.72:0/2096135157' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64381-10", "tierpool":"test-rados-api-smithi072-64381-10-cache", "force_nonempty":""}]': finished 2024-03-30T15:13:10.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:09 smithi072 bash[28946]: audit 2024-03-30T15:13:08.430540+0000 mon.a (mon.0) 1322 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:13:10.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:09 smithi072 bash[28946]: audit 2024-03-30T15:13:08.446995+0000 mon.c (mon.2) 220 : audit 1 from='client.? 172.21.15.72:0/1158838620' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi072-64171-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:10.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:09 smithi072 bash[28946]: cluster 2024-03-30T15:13:08.447050+0000 mon.a (mon.0) 1323 : cluster 0 osdmap e131: 8 total, 8 up, 8 in 2024-03-30T15:13:10.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:09 smithi072 bash[28946]: audit 2024-03-30T15:13:08.459136+0000 mon.a (mon.0) 1324 : audit 1 from='client.? 172.21.15.72:0/2096135157' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64381-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:10.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:09 smithi072 bash[28946]: audit 2024-03-30T15:13:08.459691+0000 mon.a (mon.0) 1325 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi072-64171-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:10.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:09 smithi072 bash[28946]: audit 2024-03-30T15:13:08.459989+0000 mon.a (mon.0) 1326 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-11"}]: dispatch 2024-03-30T15:13:10.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:09 smithi072 bash[28946]: cluster 2024-03-30T15:13:08.461148+0000 mon.a (mon.0) 1327 : cluster 1 Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-03-30T15:13:10.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:09 smithi172 bash[23680]: audit 2024-03-30T15:13:08.424197+0000 mon.a (mon.0) 1320 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:13:10.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:09 smithi172 bash[23680]: audit 2024-03-30T15:13:08.430402+0000 mon.a (mon.0) 1321 : audit 1 from='client.? 172.21.15.72:0/2096135157' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64381-10", "tierpool":"test-rados-api-smithi072-64381-10-cache", "force_nonempty":""}]': finished 2024-03-30T15:13:10.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:09 smithi172 bash[23680]: audit 2024-03-30T15:13:08.430540+0000 mon.a (mon.0) 1322 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:13:10.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:09 smithi172 bash[23680]: audit 2024-03-30T15:13:08.446995+0000 mon.c (mon.2) 220 : audit 1 from='client.? 172.21.15.72:0/1158838620' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi072-64171-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:10.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:09 smithi172 bash[23680]: cluster 2024-03-30T15:13:08.447050+0000 mon.a (mon.0) 1323 : cluster 0 osdmap e131: 8 total, 8 up, 8 in 2024-03-30T15:13:10.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:09 smithi172 bash[23680]: audit 2024-03-30T15:13:08.459136+0000 mon.a (mon.0) 1324 : audit 1 from='client.? 172.21.15.72:0/2096135157' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64381-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:10.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:09 smithi172 bash[23680]: audit 2024-03-30T15:13:08.459691+0000 mon.a (mon.0) 1325 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi072-64171-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:10.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:09 smithi172 bash[23680]: audit 2024-03-30T15:13:08.459989+0000 mon.a (mon.0) 1326 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-11"}]: dispatch 2024-03-30T15:13:10.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:09 smithi172 bash[23680]: cluster 2024-03-30T15:13:08.461148+0000 mon.a (mon.0) 1327 : cluster 1 Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-03-30T15:13:11.167 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:13:11 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:13:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:13:11.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:10 smithi072 bash[21573]: cluster 2024-03-30T15:13:07.888920+0000 mgr.y (mgr.14526) 225 : cluster 0 pgmap v198: 524 pgs: 128 unknown, 40 creating+peering, 356 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 3.2 KiB/s wr, 5 op/s 2024-03-30T15:13:11.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:10 smithi072 bash[21573]: cluster 2024-03-30T15:13:07.898688+0000 mgr.y (mgr.14526) 226 : cluster 0 pgmap v199: 524 pgs: 128 unknown, 40 creating+peering, 356 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 2.1 KiB/s rd, 4.5 KiB/s wr, 7 op/s 2024-03-30T15:13:11.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:10 smithi072 bash[21573]: cluster 2024-03-30T15:13:09.798372+0000 mon.a (mon.0) 1328 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:13:11.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:10 smithi072 bash[21573]: audit 2024-03-30T15:13:09.800387+0000 mon.a (mon.0) 1329 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:11.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:10 smithi072 bash[21573]: audit 2024-03-30T15:13:09.802092+0000 mon.a (mon.0) 1330 : audit 1 from='client.? 172.21.15.72:0/2096135157' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64381-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:11.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:10 smithi072 bash[21573]: audit 2024-03-30T15:13:09.802371+0000 mon.a (mon.0) 1331 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi072-64171-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:11.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:10 smithi072 bash[21573]: audit 2024-03-30T15:13:09.802635+0000 mon.a (mon.0) 1332 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-11"}]': finished 2024-03-30T15:13:11.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:10 smithi072 bash[21573]: cluster 2024-03-30T15:13:09.819211+0000 mon.a (mon.0) 1333 : cluster 0 osdmap e132: 8 total, 8 up, 8 in 2024-03-30T15:13:11.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:10 smithi072 bash[21573]: audit 2024-03-30T15:13:09.830262+0000 mon.a (mon.0) 1334 : audit 1 from='client.? 172.21.15.72:0/2096135157' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64381-10", "tierpool":"test-rados-api-smithi072-64381-10-cache"}]: dispatch 2024-03-30T15:13:11.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:10 smithi072 bash[21573]: audit 2024-03-30T15:13:09.836545+0000 mon.c (mon.2) 221 : audit 1 from='client.? 172.21.15.72:0/3445474914' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi072-64163-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:11.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:10 smithi072 bash[21573]: audit 2024-03-30T15:13:09.848871+0000 mon.a (mon.0) 1335 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi072-64163-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:11.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:10 smithi072 bash[21573]: cluster 2024-03-30T15:13:09.899760+0000 mgr.y (mgr.14526) 227 : cluster 0 pgmap v202: 556 pgs: 192 unknown, 40 creating+peering, 324 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-03-30T15:13:11.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:10 smithi072 bash[21573]: cluster 2024-03-30T15:13:10.291721+0000 mon.a (mon.0) 1336 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:13:11.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:10 smithi072 bash[21573]: audit 2024-03-30T15:13:10.295821+0000 mon.a (mon.0) 1337 : audit 1 from='client.? 172.21.15.72:0/2096135157' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64381-10", "tierpool":"test-rados-api-smithi072-64381-10-cache"}]': finished 2024-03-30T15:13:11.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:10 smithi072 bash[21573]: audit 2024-03-30T15:13:10.295969+0000 mon.a (mon.0) 1338 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattr_smithi072-64163-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:11.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:10 smithi072 bash[28946]: cluster 2024-03-30T15:13:07.888920+0000 mgr.y (mgr.14526) 225 : cluster 0 pgmap v198: 524 pgs: 128 unknown, 40 creating+peering, 356 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 3.2 KiB/s wr, 5 op/s 2024-03-30T15:13:11.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:10 smithi072 bash[28946]: cluster 2024-03-30T15:13:07.898688+0000 mgr.y (mgr.14526) 226 : cluster 0 pgmap v199: 524 pgs: 128 unknown, 40 creating+peering, 356 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 2.1 KiB/s rd, 4.5 KiB/s wr, 7 op/s 2024-03-30T15:13:11.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:10 smithi072 bash[28946]: cluster 2024-03-30T15:13:09.798372+0000 mon.a (mon.0) 1328 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:13:11.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:10 smithi072 bash[28946]: audit 2024-03-30T15:13:09.800387+0000 mon.a (mon.0) 1329 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:11.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:10 smithi072 bash[28946]: audit 2024-03-30T15:13:09.802092+0000 mon.a (mon.0) 1330 : audit 1 from='client.? 172.21.15.72:0/2096135157' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64381-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:11.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:10 smithi072 bash[28946]: audit 2024-03-30T15:13:09.802371+0000 mon.a (mon.0) 1331 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi072-64171-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:11.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:10 smithi072 bash[28946]: audit 2024-03-30T15:13:09.802635+0000 mon.a (mon.0) 1332 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-11"}]': finished 2024-03-30T15:13:11.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:10 smithi072 bash[28946]: cluster 2024-03-30T15:13:09.819211+0000 mon.a (mon.0) 1333 : cluster 0 osdmap e132: 8 total, 8 up, 8 in 2024-03-30T15:13:11.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:10 smithi072 bash[28946]: audit 2024-03-30T15:13:09.830262+0000 mon.a (mon.0) 1334 : audit 1 from='client.? 172.21.15.72:0/2096135157' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64381-10", "tierpool":"test-rados-api-smithi072-64381-10-cache"}]: dispatch 2024-03-30T15:13:11.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:10 smithi072 bash[28946]: audit 2024-03-30T15:13:09.836545+0000 mon.c (mon.2) 221 : audit 1 from='client.? 172.21.15.72:0/3445474914' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi072-64163-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:11.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:10 smithi072 bash[28946]: audit 2024-03-30T15:13:09.848871+0000 mon.a (mon.0) 1335 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi072-64163-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:11.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:10 smithi072 bash[28946]: cluster 2024-03-30T15:13:09.899760+0000 mgr.y (mgr.14526) 227 : cluster 0 pgmap v202: 556 pgs: 192 unknown, 40 creating+peering, 324 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-03-30T15:13:11.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:10 smithi072 bash[28946]: cluster 2024-03-30T15:13:10.291721+0000 mon.a (mon.0) 1336 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:13:11.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:10 smithi072 bash[28946]: audit 2024-03-30T15:13:10.295821+0000 mon.a (mon.0) 1337 : audit 1 from='client.? 172.21.15.72:0/2096135157' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64381-10", "tierpool":"test-rados-api-smithi072-64381-10-cache"}]': finished 2024-03-30T15:13:11.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:10 smithi072 bash[28946]: audit 2024-03-30T15:13:10.295969+0000 mon.a (mon.0) 1338 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattr_smithi072-64163-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:11.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:10 smithi072 bash[21573]: cluster 2024-03-30T15:13:10.307540+0000 mon.a (mon.0) 1339 : cluster 0 osdmap e133: 8 total, 8 up, 8 in 2024-03-30T15:13:11.171 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:10 smithi072 bash[21573]: audit 2024-03-30T15:13:10.801978+0000 mon.a (mon.0) 1340 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:11.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:10 smithi072 bash[28946]: cluster 2024-03-30T15:13:10.307540+0000 mon.a (mon.0) 1339 : cluster 0 osdmap e133: 8 total, 8 up, 8 in 2024-03-30T15:13:11.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:10 smithi072 bash[28946]: audit 2024-03-30T15:13:10.801978+0000 mon.a (mon.0) 1340 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:11.215 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:13:11 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:13:11.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:10 smithi172 bash[23680]: cluster 2024-03-30T15:13:07.888920+0000 mgr.y (mgr.14526) 225 : cluster 0 pgmap v198: 524 pgs: 128 unknown, 40 creating+peering, 356 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 3.2 KiB/s wr, 5 op/s 2024-03-30T15:13:11.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:10 smithi172 bash[23680]: cluster 2024-03-30T15:13:07.898688+0000 mgr.y (mgr.14526) 226 : cluster 0 pgmap v199: 524 pgs: 128 unknown, 40 creating+peering, 356 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 2.1 KiB/s rd, 4.5 KiB/s wr, 7 op/s 2024-03-30T15:13:11.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:10 smithi172 bash[23680]: cluster 2024-03-30T15:13:09.798372+0000 mon.a (mon.0) 1328 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:13:11.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:10 smithi172 bash[23680]: audit 2024-03-30T15:13:09.800387+0000 mon.a (mon.0) 1329 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:11.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:10 smithi172 bash[23680]: audit 2024-03-30T15:13:09.802092+0000 mon.a (mon.0) 1330 : audit 1 from='client.? 172.21.15.72:0/2096135157' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64381-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:11.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:10 smithi172 bash[23680]: audit 2024-03-30T15:13:09.802371+0000 mon.a (mon.0) 1331 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi072-64171-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:11.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:10 smithi172 bash[23680]: audit 2024-03-30T15:13:09.802635+0000 mon.a (mon.0) 1332 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-11"}]': finished 2024-03-30T15:13:11.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:10 smithi172 bash[23680]: cluster 2024-03-30T15:13:09.819211+0000 mon.a (mon.0) 1333 : cluster 0 osdmap e132: 8 total, 8 up, 8 in 2024-03-30T15:13:11.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:10 smithi172 bash[23680]: audit 2024-03-30T15:13:09.830262+0000 mon.a (mon.0) 1334 : audit 1 from='client.? 172.21.15.72:0/2096135157' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64381-10", "tierpool":"test-rados-api-smithi072-64381-10-cache"}]: dispatch 2024-03-30T15:13:11.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:10 smithi172 bash[23680]: audit 2024-03-30T15:13:09.836545+0000 mon.c (mon.2) 221 : audit 1 from='client.? 172.21.15.72:0/3445474914' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi072-64163-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:11.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:10 smithi172 bash[23680]: audit 2024-03-30T15:13:09.848871+0000 mon.a (mon.0) 1335 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi072-64163-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:11.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:10 smithi172 bash[23680]: cluster 2024-03-30T15:13:09.899760+0000 mgr.y (mgr.14526) 227 : cluster 0 pgmap v202: 556 pgs: 192 unknown, 40 creating+peering, 324 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-03-30T15:13:11.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:10 smithi172 bash[23680]: cluster 2024-03-30T15:13:10.291721+0000 mon.a (mon.0) 1336 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:13:11.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:10 smithi172 bash[23680]: audit 2024-03-30T15:13:10.295821+0000 mon.a (mon.0) 1337 : audit 1 from='client.? 172.21.15.72:0/2096135157' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64381-10", "tierpool":"test-rados-api-smithi072-64381-10-cache"}]': finished 2024-03-30T15:13:11.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:10 smithi172 bash[23680]: audit 2024-03-30T15:13:10.295969+0000 mon.a (mon.0) 1338 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattr_smithi072-64163-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:11.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:10 smithi172 bash[23680]: cluster 2024-03-30T15:13:10.307540+0000 mon.a (mon.0) 1339 : cluster 0 osdmap e133: 8 total, 8 up, 8 in 2024-03-30T15:13:11.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:10 smithi172 bash[23680]: audit 2024-03-30T15:13:10.801978+0000 mon.a (mon.0) 1340 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:12.658 INFO:tasks.workunit.client.0.smithi072.stdout: api_pool: Running main() from gmock_main.cc 2024-03-30T15:13:12.658 INFO:tasks.workunit.client.0.smithi072.stdout: api_pool: [==========] Running 9 tests from 1 test suite. 2024-03-30T15:13:12.658 INFO:tasks.workunit.client.0.smithi072.stdout: api_pool: [----------] Global test environment set-up. 2024-03-30T15:13:12.658 INFO:tasks.workunit.client.0.smithi072.stdout: api_pool: [----------] 9 tests from LibRadosPools 2024-03-30T15:13:12.658 INFO:tasks.workunit.client.0.smithi072.stdout: api_pool: [ RUN ] LibRadosPools.PoolList 2024-03-30T15:13:12.658 INFO:tasks.workunit.client.0.smithi072.stdout: api_pool: [ OK ] LibRadosPools.PoolList (18999 ms) 2024-03-30T15:13:12.658 INFO:tasks.workunit.client.0.smithi072.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup 2024-03-30T15:13:12.658 INFO:tasks.workunit.client.0.smithi072.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup (10208 ms) 2024-03-30T15:13:12.658 INFO:tasks.workunit.client.0.smithi072.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup2 2024-03-30T15:13:12.658 INFO:tasks.workunit.client.0.smithi072.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup2 (6268 ms) 2024-03-30T15:13:12.658 INFO:tasks.workunit.client.0.smithi072.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookupOtherInstance 2024-03-30T15:13:12.659 INFO:tasks.workunit.client.0.smithi072.stdout: api_pool: [ OK ] LibRadosPools.PoolLookupOtherInstance (6228 ms) 2024-03-30T15:13:12.659 INFO:tasks.workunit.client.0.smithi072.stdout: api_pool: [ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2024-03-30T15:13:12.659 INFO:tasks.workunit.client.0.smithi072.stdout: api_pool: [ OK ] LibRadosPools.PoolReverseLookupOtherInstance (8839 ms) 2024-03-30T15:13:12.659 INFO:tasks.workunit.client.0.smithi072.stdout: api_pool: [ RUN ] LibRadosPools.PoolDelete 2024-03-30T15:13:12.659 INFO:tasks.workunit.client.0.smithi072.stdout: api_pool: [ OK ] LibRadosPools.PoolDelete (8197 ms) 2024-03-30T15:13:12.659 INFO:tasks.workunit.client.0.smithi072.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateDelete 2024-03-30T15:13:12.659 INFO:tasks.workunit.client.0.smithi072.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateDelete (6321 ms) 2024-03-30T15:13:12.659 INFO:tasks.workunit.client.0.smithi072.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateWithCrushRule 2024-03-30T15:13:12.659 INFO:tasks.workunit.client.0.smithi072.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateWithCrushRule (7027 ms) 2024-03-30T15:13:12.659 INFO:tasks.workunit.client.0.smithi072.stdout: api_pool: [ RUN ] LibRadosPools.PoolGetBaseTier 2024-03-30T15:13:12.659 INFO:tasks.workunit.client.0.smithi072.stdout: api_pool: [ OK ] LibRadosPools.PoolGetBaseTier (8516 ms) 2024-03-30T15:13:12.659 INFO:tasks.workunit.client.0.smithi072.stdout: api_pool: [----------] 9 tests from LibRadosPools (80604 ms total) 2024-03-30T15:13:12.659 INFO:tasks.workunit.client.0.smithi072.stdout: api_pool: 2024-03-30T15:13:12.659 INFO:tasks.workunit.client.0.smithi072.stdout: api_pool: [----------] Global test environment tear-down 2024-03-30T15:13:12.660 INFO:tasks.workunit.client.0.smithi072.stdout: api_pool: [==========] 9 tests from 1 test suite ran. (80604 ms total) 2024-03-30T15:13:12.660 INFO:tasks.workunit.client.0.smithi072.stdout: api_pool: [ PASSED ] 9 tests. 2024-03-30T15:13:12.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:12 smithi172 bash[23680]: cluster 2024-03-30T15:13:11.320407+0000 mon.a (mon.0) 1341 : cluster 0 osdmap e134: 8 total, 8 up, 8 in 2024-03-30T15:13:12.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:12 smithi172 bash[23680]: audit 2024-03-30T15:13:12.200849+0000 mon.a (mon.0) 1342 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:13.012 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:12 smithi072 bash[21573]: cluster 2024-03-30T15:13:11.320407+0000 mon.a (mon.0) 1341 : cluster 0 osdmap e134: 8 total, 8 up, 8 in 2024-03-30T15:13:13.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:13 smithi072 bash[21573]: audit 2024-03-30T15:13:12.200849+0000 mon.a (mon.0) 1342 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:13.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:13 smithi072 bash[28946]: cluster 2024-03-30T15:13:11.320407+0000 mon.a (mon.0) 1341 : cluster 0 osdmap e134: 8 total, 8 up, 8 in 2024-03-30T15:13:13.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:13 smithi072 bash[28946]: audit 2024-03-30T15:13:12.200849+0000 mon.a (mon.0) 1342 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:13.672 INFO:tasks.workunit.client.0.smithi072.stdout: misc: Running main() from gmock_main.cc 2024-03-30T15:13:13.673 INFO:tasks.workunit.client.0.smithi072.stdout: misc: [==========] Running 12 tests from 1 test suite. 2024-03-30T15:13:13.673 INFO:tasks.workunit.client.0.smithi072.stdout: misc: [----------] Global test environment set-up. 2024-03-30T15:13:13.673 INFO:tasks.workunit.client.0.smithi072.stdout: misc: [----------] 12 tests from NeoRadosMisc 2024-03-30T15:13:13.673 INFO:tasks.workunit.client.0.smithi072.stdout: misc: [ RUN ] NeoRadosMisc.Version 2024-03-30T15:13:13.673 INFO:tasks.workunit.client.0.smithi072.stdout: misc: [ OK ] NeoRadosMisc.Version (16288 ms) 2024-03-30T15:13:13.673 INFO:tasks.workunit.client.0.smithi072.stdout: misc: [ RUN ] NeoRadosMisc.WaitOSDMap 2024-03-30T15:13:13.673 INFO:tasks.workunit.client.0.smithi072.stdout: misc: [ OK ] NeoRadosMisc.WaitOSDMap (5583 ms) 2024-03-30T15:13:13.673 INFO:tasks.workunit.client.0.smithi072.stdout: misc: [ RUN ] NeoRadosMisc.LongName 2024-03-30T15:13:13.673 INFO:tasks.workunit.client.0.smithi072.stdout: misc: [ OK ] NeoRadosMisc.LongName (12019 ms) 2024-03-30T15:13:13.673 INFO:tasks.workunit.client.0.smithi072.stdout: misc: [ RUN ] NeoRadosMisc.LongLocator 2024-03-30T15:13:13.673 INFO:tasks.workunit.client.0.smithi072.stdout: misc: [ OK ] NeoRadosMisc.LongLocator (6459 ms) 2024-03-30T15:13:13.673 INFO:tasks.workunit.client.0.smithi072.stdout: misc: [ RUN ] NeoRadosMisc.LongNamespace 2024-03-30T15:13:13.674 INFO:tasks.workunit.client.0.smithi072.stdout: misc: [ OK ] NeoRadosMisc.LongNamespace (10528 ms) 2024-03-30T15:13:13.674 INFO:tasks.workunit.client.0.smithi072.stdout: misc: [ RUN ] NeoRadosMisc.LongAttrName 2024-03-30T15:13:13.674 INFO:tasks.workunit.client.0.smithi072.stdout: misc: [ OK ] NeoRadosMisc.LongAttrName (4741 ms) 2024-03-30T15:13:13.674 INFO:tasks.workunit.client.0.smithi072.stdout: misc: [ RUN ] NeoRadosMisc.Exec 2024-03-30T15:13:13.674 INFO:tasks.workunit.client.0.smithi072.stdout: misc: [ OK ] NeoRadosMisc.Exec (6472 ms) 2024-03-30T15:13:13.674 INFO:tasks.workunit.client.0.smithi072.stdout: misc: [ RUN ] NeoRadosMisc.Operate1 2024-03-30T15:13:13.674 INFO:tasks.workunit.client.0.smithi072.stdout: misc: [ OK ] NeoRadosMisc.Operate1 (5152 ms) 2024-03-30T15:13:13.674 INFO:tasks.workunit.client.0.smithi072.stdout: misc: [ RUN ] NeoRadosMisc.Operate2 2024-03-30T15:13:13.674 INFO:tasks.workunit.client.0.smithi072.stdout: misc: [ OK ] NeoRadosMisc.Operate2 (5543 ms) 2024-03-30T15:13:13.674 INFO:tasks.workunit.client.0.smithi072.stdout: misc: [ RUN ] NeoRadosMisc.BigObject 2024-03-30T15:13:13.674 INFO:tasks.workunit.client.0.smithi072.stdout: misc: [ OK ] NeoRadosMisc.BigObject (3382 ms) 2024-03-30T15:13:13.674 INFO:tasks.workunit.client.0.smithi072.stdout: misc: [ RUN ] NeoRadosMisc.BigAttr 2024-03-30T15:13:13.674 INFO:tasks.workunit.client.0.smithi072.stdout: misc: [ OK ] NeoRadosMisc.BigAttr (1864 ms) 2024-03-30T15:13:13.674 INFO:tasks.workunit.client.0.smithi072.stdout: misc: [ RUN ] NeoRadosMisc.WriteSame 2024-03-30T15:13:13.675 INFO:tasks.workunit.client.0.smithi072.stdout: misc: [ OK ] NeoRadosMisc.WriteSame (3355 ms) 2024-03-30T15:13:13.675 INFO:tasks.workunit.client.0.smithi072.stdout: misc: [----------] 12 tests from NeoRadosMisc (81386 ms total) 2024-03-30T15:13:13.675 INFO:tasks.workunit.client.0.smithi072.stdout: misc: 2024-03-30T15:13:13.675 INFO:tasks.workunit.client.0.smithi072.stdout: misc: [----------] Global test environment tear-down 2024-03-30T15:13:13.675 INFO:tasks.workunit.client.0.smithi072.stdout: misc: [==========] 12 tests from 1 test suite ran. (81386 ms total) 2024-03-30T15:13:13.675 INFO:tasks.workunit.client.0.smithi072.stdout: misc: [ PASSED ] 12 tests. 2024-03-30T15:13:13.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:13 smithi172 bash[23680]: audit 2024-03-30T15:13:11.010982+0000 mgr.y (mgr.14526) 228 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:13:13.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:13 smithi172 bash[23680]: cluster 2024-03-30T15:13:11.900681+0000 mgr.y (mgr.14526) 229 : cluster 0 pgmap v205: 460 pgs: 54 creating+peering, 32 unknown, 374 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 257 KiB/s wr, 3 op/s 2024-03-30T15:13:13.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:13 smithi172 bash[23680]: audit 2024-03-30T15:13:12.377129+0000 mon.c (mon.2) 222 : audit 0 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-03-30T15:13:13.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:13 smithi172 bash[23680]: audit 2024-03-30T15:13:12.384114+0000 mon.c (mon.2) 223 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi072-64321-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:13.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:13 smithi172 bash[23680]: cluster 2024-03-30T15:13:12.647670+0000 mon.a (mon.0) 1343 : cluster 0 osdmap e135: 8 total, 8 up, 8 in 2024-03-30T15:13:13.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:13 smithi172 bash[23680]: audit 2024-03-30T15:13:12.659591+0000 mon.a (mon.0) 1344 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:13.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:13 smithi172 bash[23680]: audit 2024-03-30T15:13:12.660070+0000 mon.c (mon.2) 224 : audit 1 from='client.? 172.21.15.72:0/2193417119' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi072-64171-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:13.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:13 smithi172 bash[23680]: audit 2024-03-30T15:13:12.669504+0000 mon.a (mon.0) 1345 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi072-64321-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:13.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:13 smithi172 bash[23680]: audit 2024-03-30T15:13:12.677820+0000 mon.a (mon.0) 1346 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi072-64171-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:13.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:13 smithi172 bash[23680]: audit 2024-03-30T15:13:13.202233+0000 mon.a (mon.0) 1347 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:13.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:13 smithi172 bash[23680]: audit 2024-03-30T15:13:13.649865+0000 mon.a (mon.0) 1348 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:13.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:13 smithi172 bash[23680]: audit 2024-03-30T15:13:13.650036+0000 mon.a (mon.0) 1349 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi072-64321-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:13.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:13 smithi172 bash[23680]: audit 2024-03-30T15:13:13.650278+0000 mon.a (mon.0) 1350 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi072-64171-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:13.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:13 smithi172 bash[23680]: cluster 2024-03-30T15:13:13.661482+0000 mon.a (mon.0) 1351 : cluster 0 osdmap e136: 8 total, 8 up, 8 in 2024-03-30T15:13:14.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:13 smithi072 bash[28946]: audit 2024-03-30T15:13:11.010982+0000 mgr.y (mgr.14526) 228 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:13:14.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:13 smithi072 bash[28946]: cluster 2024-03-30T15:13:11.900681+0000 mgr.y (mgr.14526) 229 : cluster 0 pgmap v205: 460 pgs: 54 creating+peering, 32 unknown, 374 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 257 KiB/s wr, 3 op/s 2024-03-30T15:13:14.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:13 smithi072 bash[28946]: audit 2024-03-30T15:13:12.377129+0000 mon.c (mon.2) 222 : audit 0 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-03-30T15:13:14.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:13 smithi072 bash[28946]: audit 2024-03-30T15:13:12.384114+0000 mon.c (mon.2) 223 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi072-64321-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:14.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:13 smithi072 bash[28946]: cluster 2024-03-30T15:13:12.647670+0000 mon.a (mon.0) 1343 : cluster 0 osdmap e135: 8 total, 8 up, 8 in 2024-03-30T15:13:14.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:13 smithi072 bash[28946]: audit 2024-03-30T15:13:12.659591+0000 mon.a (mon.0) 1344 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:14.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:13 smithi072 bash[28946]: audit 2024-03-30T15:13:12.660070+0000 mon.c (mon.2) 224 : audit 1 from='client.? 172.21.15.72:0/2193417119' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi072-64171-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:14.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:13 smithi072 bash[28946]: audit 2024-03-30T15:13:12.669504+0000 mon.a (mon.0) 1345 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi072-64321-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:14.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:13 smithi072 bash[28946]: audit 2024-03-30T15:13:12.677820+0000 mon.a (mon.0) 1346 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi072-64171-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:14.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:13 smithi072 bash[28946]: audit 2024-03-30T15:13:13.202233+0000 mon.a (mon.0) 1347 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:14.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:13 smithi072 bash[28946]: audit 2024-03-30T15:13:13.649865+0000 mon.a (mon.0) 1348 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:14.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:13 smithi072 bash[28946]: audit 2024-03-30T15:13:13.650036+0000 mon.a (mon.0) 1349 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi072-64321-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:14.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:13 smithi072 bash[28946]: audit 2024-03-30T15:13:13.650278+0000 mon.a (mon.0) 1350 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi072-64171-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:14.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:13 smithi072 bash[28946]: cluster 2024-03-30T15:13:13.661482+0000 mon.a (mon.0) 1351 : cluster 0 osdmap e136: 8 total, 8 up, 8 in 2024-03-30T15:13:14.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:13 smithi072 bash[21573]: audit 2024-03-30T15:13:11.010982+0000 mgr.y (mgr.14526) 228 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:13:14.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:13 smithi072 bash[21573]: cluster 2024-03-30T15:13:11.900681+0000 mgr.y (mgr.14526) 229 : cluster 0 pgmap v205: 460 pgs: 54 creating+peering, 32 unknown, 374 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 257 KiB/s wr, 3 op/s 2024-03-30T15:13:14.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:13 smithi072 bash[21573]: audit 2024-03-30T15:13:12.377129+0000 mon.c (mon.2) 222 : audit 0 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-03-30T15:13:14.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:13 smithi072 bash[21573]: audit 2024-03-30T15:13:12.384114+0000 mon.c (mon.2) 223 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi072-64321-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:14.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:13 smithi072 bash[21573]: cluster 2024-03-30T15:13:12.647670+0000 mon.a (mon.0) 1343 : cluster 0 osdmap e135: 8 total, 8 up, 8 in 2024-03-30T15:13:14.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:13 smithi072 bash[21573]: audit 2024-03-30T15:13:12.659591+0000 mon.a (mon.0) 1344 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:14.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:13 smithi072 bash[21573]: audit 2024-03-30T15:13:12.660070+0000 mon.c (mon.2) 224 : audit 1 from='client.? 172.21.15.72:0/2193417119' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi072-64171-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:14.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:13 smithi072 bash[21573]: audit 2024-03-30T15:13:12.669504+0000 mon.a (mon.0) 1345 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi072-64321-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:14.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:13 smithi072 bash[21573]: audit 2024-03-30T15:13:12.677820+0000 mon.a (mon.0) 1346 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi072-64171-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:14.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:13 smithi072 bash[21573]: audit 2024-03-30T15:13:13.202233+0000 mon.a (mon.0) 1347 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:14.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:13 smithi072 bash[21573]: audit 2024-03-30T15:13:13.649865+0000 mon.a (mon.0) 1348 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:14.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:13 smithi072 bash[21573]: audit 2024-03-30T15:13:13.650036+0000 mon.a (mon.0) 1349 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi072-64321-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:14.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:13 smithi072 bash[21573]: audit 2024-03-30T15:13:13.650278+0000 mon.a (mon.0) 1350 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi072-64171-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:14.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:13 smithi072 bash[21573]: cluster 2024-03-30T15:13:13.661482+0000 mon.a (mon.0) 1351 : cluster 0 osdmap e136: 8 total, 8 up, 8 in 2024-03-30T15:13:14.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:14 smithi172 bash[23680]: audit 2024-03-30T15:13:13.664984+0000 mon.c (mon.2) 225 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi072-64321-1","app": "app2"}]: dispatch 2024-03-30T15:13:14.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:14 smithi172 bash[23680]: audit 2024-03-30T15:13:13.666373+0000 mon.c (mon.2) 226 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi072-64321-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:14.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:14 smithi172 bash[23680]: audit 2024-03-30T15:13:13.670078+0000 mon.a (mon.0) 1352 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi072-64321-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:14.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:14 smithi172 bash[23680]: audit 2024-03-30T15:13:14.203669+0000 mon.a (mon.0) 1353 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:14.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:14 smithi172 bash[23680]: audit 2024-03-30T15:13:14.655190+0000 mon.a (mon.0) 1354 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi072-64321-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:14.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:14 smithi172 bash[23680]: cluster 2024-03-30T15:13:14.666045+0000 mon.a (mon.0) 1355 : cluster 0 osdmap e137: 8 total, 8 up, 8 in 2024-03-30T15:13:14.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:14 smithi172 bash[23680]: audit 2024-03-30T15:13:14.667768+0000 mon.c (mon.2) 227 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi072-64321-1","app":"dne","key":"key1","value":"value1"}]: dispatch 2024-03-30T15:13:14.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:14 smithi172 bash[23680]: audit 2024-03-30T15:13:14.672810+0000 mon.c (mon.2) 228 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi072-64321-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-03-30T15:13:14.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:14 smithi172 bash[23680]: audit 2024-03-30T15:13:14.677781+0000 mon.a (mon.0) 1356 : audit 1 from='client.? 172.21.15.72:0/466975839' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrIter_smithi072-64163-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:14.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:14 smithi172 bash[23680]: audit 2024-03-30T15:13:14.679813+0000 mon.a (mon.0) 1357 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi072-64321-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-03-30T15:13:15.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:14 smithi072 bash[28946]: audit 2024-03-30T15:13:13.664984+0000 mon.c (mon.2) 225 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi072-64321-1","app": "app2"}]: dispatch 2024-03-30T15:13:15.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:14 smithi072 bash[28946]: audit 2024-03-30T15:13:13.666373+0000 mon.c (mon.2) 226 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi072-64321-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:15.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:14 smithi072 bash[28946]: audit 2024-03-30T15:13:13.670078+0000 mon.a (mon.0) 1352 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi072-64321-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:15.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:14 smithi072 bash[28946]: audit 2024-03-30T15:13:14.203669+0000 mon.a (mon.0) 1353 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:15.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:14 smithi072 bash[28946]: audit 2024-03-30T15:13:14.655190+0000 mon.a (mon.0) 1354 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi072-64321-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:15.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:14 smithi072 bash[28946]: cluster 2024-03-30T15:13:14.666045+0000 mon.a (mon.0) 1355 : cluster 0 osdmap e137: 8 total, 8 up, 8 in 2024-03-30T15:13:15.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:14 smithi072 bash[28946]: audit 2024-03-30T15:13:14.667768+0000 mon.c (mon.2) 227 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi072-64321-1","app":"dne","key":"key1","value":"value1"}]: dispatch 2024-03-30T15:13:15.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:14 smithi072 bash[28946]: audit 2024-03-30T15:13:14.672810+0000 mon.c (mon.2) 228 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi072-64321-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-03-30T15:13:15.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:14 smithi072 bash[28946]: audit 2024-03-30T15:13:14.677781+0000 mon.a (mon.0) 1356 : audit 1 from='client.? 172.21.15.72:0/466975839' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrIter_smithi072-64163-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:15.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:14 smithi072 bash[28946]: audit 2024-03-30T15:13:14.679813+0000 mon.a (mon.0) 1357 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi072-64321-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-03-30T15:13:15.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:14 smithi072 bash[21573]: audit 2024-03-30T15:13:13.664984+0000 mon.c (mon.2) 225 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi072-64321-1","app": "app2"}]: dispatch 2024-03-30T15:13:15.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:14 smithi072 bash[21573]: audit 2024-03-30T15:13:13.666373+0000 mon.c (mon.2) 226 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi072-64321-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:15.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:14 smithi072 bash[21573]: audit 2024-03-30T15:13:13.670078+0000 mon.a (mon.0) 1352 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi072-64321-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:15.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:14 smithi072 bash[21573]: audit 2024-03-30T15:13:14.203669+0000 mon.a (mon.0) 1353 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:15.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:14 smithi072 bash[21573]: audit 2024-03-30T15:13:14.655190+0000 mon.a (mon.0) 1354 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi072-64321-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:15.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:14 smithi072 bash[21573]: cluster 2024-03-30T15:13:14.666045+0000 mon.a (mon.0) 1355 : cluster 0 osdmap e137: 8 total, 8 up, 8 in 2024-03-30T15:13:15.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:14 smithi072 bash[21573]: audit 2024-03-30T15:13:14.667768+0000 mon.c (mon.2) 227 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi072-64321-1","app":"dne","key":"key1","value":"value1"}]: dispatch 2024-03-30T15:13:15.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:14 smithi072 bash[21573]: audit 2024-03-30T15:13:14.672810+0000 mon.c (mon.2) 228 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi072-64321-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-03-30T15:13:15.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:14 smithi072 bash[21573]: audit 2024-03-30T15:13:14.677781+0000 mon.a (mon.0) 1356 : audit 1 from='client.? 172.21.15.72:0/466975839' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrIter_smithi072-64163-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:15.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:14 smithi072 bash[21573]: audit 2024-03-30T15:13:14.679813+0000 mon.a (mon.0) 1357 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi072-64321-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-03-30T15:13:16.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:16 smithi072 bash[21573]: cluster 2024-03-30T15:13:13.901711+0000 mgr.y (mgr.14526) 230 : cluster 0 pgmap v208: 460 pgs: 12 creating+peering, 128 unknown, 320 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 257 KiB/s wr, 4 op/s 2024-03-30T15:13:16.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:16 smithi072 bash[21573]: cluster 2024-03-30T15:13:15.598364+0000 mon.a (mon.0) 1358 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:13:16.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:16 smithi072 bash[21573]: audit 2024-03-30T15:13:15.604087+0000 mon.a (mon.0) 1359 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:16.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:16 smithi072 bash[21573]: audit 2024-03-30T15:13:15.604846+0000 mon.a (mon.0) 1360 : audit 1 from='client.? 172.21.15.72:0/466975839' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrIter_smithi072-64163-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:16.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:16 smithi072 bash[21573]: audit 2024-03-30T15:13:15.605033+0000 mon.a (mon.0) 1361 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi072-64321-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-03-30T15:13:16.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:16 smithi072 bash[21573]: cluster 2024-03-30T15:13:15.617037+0000 mon.a (mon.0) 1362 : cluster 0 osdmap e138: 8 total, 8 up, 8 in 2024-03-30T15:13:16.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:16 smithi072 bash[21573]: audit 2024-03-30T15:13:15.622773+0000 mon.c (mon.2) 229 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi072-64321-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-03-30T15:13:16.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:16 smithi072 bash[21573]: audit 2024-03-30T15:13:15.623899+0000 mon.a (mon.0) 1363 : audit 1 from='client.? 172.21.15.72:0/2751115767' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi072-64171-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:16.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:16 smithi072 bash[21573]: audit 2024-03-30T15:13:15.640643+0000 mon.a (mon.0) 1364 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi072-64321-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-03-30T15:13:16.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:16 smithi072 bash[28946]: cluster 2024-03-30T15:13:13.901711+0000 mgr.y (mgr.14526) 230 : cluster 0 pgmap v208: 460 pgs: 12 creating+peering, 128 unknown, 320 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 257 KiB/s wr, 4 op/s 2024-03-30T15:13:16.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:16 smithi072 bash[28946]: cluster 2024-03-30T15:13:15.598364+0000 mon.a (mon.0) 1358 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:13:16.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:16 smithi072 bash[28946]: audit 2024-03-30T15:13:15.604087+0000 mon.a (mon.0) 1359 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:16.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:16 smithi072 bash[28946]: audit 2024-03-30T15:13:15.604846+0000 mon.a (mon.0) 1360 : audit 1 from='client.? 172.21.15.72:0/466975839' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrIter_smithi072-64163-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:16.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:16 smithi072 bash[28946]: audit 2024-03-30T15:13:15.605033+0000 mon.a (mon.0) 1361 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi072-64321-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-03-30T15:13:16.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:16 smithi072 bash[28946]: cluster 2024-03-30T15:13:15.617037+0000 mon.a (mon.0) 1362 : cluster 0 osdmap e138: 8 total, 8 up, 8 in 2024-03-30T15:13:16.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:16 smithi072 bash[28946]: audit 2024-03-30T15:13:15.622773+0000 mon.c (mon.2) 229 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi072-64321-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-03-30T15:13:16.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:16 smithi072 bash[28946]: audit 2024-03-30T15:13:15.623899+0000 mon.a (mon.0) 1363 : audit 1 from='client.? 172.21.15.72:0/2751115767' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi072-64171-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:16.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:16 smithi072 bash[28946]: audit 2024-03-30T15:13:15.640643+0000 mon.a (mon.0) 1364 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi072-64321-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-03-30T15:13:16.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:16 smithi172 bash[23680]: cluster 2024-03-30T15:13:13.901711+0000 mgr.y (mgr.14526) 230 : cluster 0 pgmap v208: 460 pgs: 12 creating+peering, 128 unknown, 320 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 257 KiB/s wr, 4 op/s 2024-03-30T15:13:16.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:16 smithi172 bash[23680]: cluster 2024-03-30T15:13:15.598364+0000 mon.a (mon.0) 1358 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:13:16.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:16 smithi172 bash[23680]: audit 2024-03-30T15:13:15.604087+0000 mon.a (mon.0) 1359 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:16.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:16 smithi172 bash[23680]: audit 2024-03-30T15:13:15.604846+0000 mon.a (mon.0) 1360 : audit 1 from='client.? 172.21.15.72:0/466975839' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrIter_smithi072-64163-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:16.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:16 smithi172 bash[23680]: audit 2024-03-30T15:13:15.605033+0000 mon.a (mon.0) 1361 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi072-64321-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-03-30T15:13:16.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:16 smithi172 bash[23680]: cluster 2024-03-30T15:13:15.617037+0000 mon.a (mon.0) 1362 : cluster 0 osdmap e138: 8 total, 8 up, 8 in 2024-03-30T15:13:16.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:16 smithi172 bash[23680]: audit 2024-03-30T15:13:15.622773+0000 mon.c (mon.2) 229 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi072-64321-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-03-30T15:13:16.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:16 smithi172 bash[23680]: audit 2024-03-30T15:13:15.623899+0000 mon.a (mon.0) 1363 : audit 1 from='client.? 172.21.15.72:0/2751115767' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi072-64171-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:16.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:16 smithi172 bash[23680]: audit 2024-03-30T15:13:15.640643+0000 mon.a (mon.0) 1364 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi072-64321-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-03-30T15:13:17.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:17 smithi072 bash[21573]: cluster 2024-03-30T15:13:15.904769+0000 mgr.y (mgr.14526) 231 : cluster 0 pgmap v211: 428 pgs: 64 creating+peering, 364 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 75 KiB/s wr, 77 op/s 2024-03-30T15:13:17.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:17 smithi072 bash[21573]: audit 2024-03-30T15:13:16.607790+0000 mon.a (mon.0) 1365 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:17.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:17 smithi072 bash[21573]: audit 2024-03-30T15:13:16.609870+0000 mon.a (mon.0) 1366 : audit 1 from='client.? 172.21.15.72:0/2751115767' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi072-64171-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:17.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:17 smithi072 bash[21573]: audit 2024-03-30T15:13:16.610083+0000 mon.a (mon.0) 1367 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi072-64321-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-03-30T15:13:17.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:17 smithi072 bash[21573]: cluster 2024-03-30T15:13:16.618221+0000 mon.a (mon.0) 1368 : cluster 0 osdmap e139: 8 total, 8 up, 8 in 2024-03-30T15:13:17.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:17 smithi072 bash[21573]: audit 2024-03-30T15:13:16.626736+0000 mon.c (mon.2) 230 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi072-64321-1","app":"app1","key":"key1"}]: dispatch 2024-03-30T15:13:17.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:17 smithi072 bash[21573]: audit 2024-03-30T15:13:16.628030+0000 mon.c (mon.2) 231 : audit 1 from='client.? 172.21.15.72:0/3570618374' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi072-64378-10"}]: dispatch 2024-03-30T15:13:17.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:17 smithi072 bash[21573]: audit 2024-03-30T15:13:16.630601+0000 mon.a (mon.0) 1369 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi072-64321-1","app":"app1","key":"key1"}]: dispatch 2024-03-30T15:13:17.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:17 smithi072 bash[21573]: audit 2024-03-30T15:13:16.631261+0000 mon.a (mon.0) 1370 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi072-64378-10"}]: dispatch 2024-03-30T15:13:17.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:17 smithi072 bash[28946]: cluster 2024-03-30T15:13:15.904769+0000 mgr.y (mgr.14526) 231 : cluster 0 pgmap v211: 428 pgs: 64 creating+peering, 364 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 75 KiB/s wr, 77 op/s 2024-03-30T15:13:17.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:17 smithi072 bash[28946]: audit 2024-03-30T15:13:16.607790+0000 mon.a (mon.0) 1365 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:17.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:17 smithi072 bash[28946]: audit 2024-03-30T15:13:16.609870+0000 mon.a (mon.0) 1366 : audit 1 from='client.? 172.21.15.72:0/2751115767' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi072-64171-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:17.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:17 smithi072 bash[28946]: audit 2024-03-30T15:13:16.610083+0000 mon.a (mon.0) 1367 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi072-64321-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-03-30T15:13:17.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:17 smithi072 bash[28946]: cluster 2024-03-30T15:13:16.618221+0000 mon.a (mon.0) 1368 : cluster 0 osdmap e139: 8 total, 8 up, 8 in 2024-03-30T15:13:17.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:17 smithi072 bash[28946]: audit 2024-03-30T15:13:16.626736+0000 mon.c (mon.2) 230 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi072-64321-1","app":"app1","key":"key1"}]: dispatch 2024-03-30T15:13:17.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:17 smithi072 bash[28946]: audit 2024-03-30T15:13:16.628030+0000 mon.c (mon.2) 231 : audit 1 from='client.? 172.21.15.72:0/3570618374' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi072-64378-10"}]: dispatch 2024-03-30T15:13:17.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:17 smithi072 bash[28946]: audit 2024-03-30T15:13:16.630601+0000 mon.a (mon.0) 1369 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi072-64321-1","app":"app1","key":"key1"}]: dispatch 2024-03-30T15:13:17.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:17 smithi072 bash[28946]: audit 2024-03-30T15:13:16.631261+0000 mon.a (mon.0) 1370 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi072-64378-10"}]: dispatch 2024-03-30T15:13:17.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:17 smithi172 bash[23680]: cluster 2024-03-30T15:13:15.904769+0000 mgr.y (mgr.14526) 231 : cluster 0 pgmap v211: 428 pgs: 64 creating+peering, 364 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 75 KiB/s wr, 77 op/s 2024-03-30T15:13:17.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:17 smithi172 bash[23680]: audit 2024-03-30T15:13:16.607790+0000 mon.a (mon.0) 1365 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:17.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:17 smithi172 bash[23680]: audit 2024-03-30T15:13:16.609870+0000 mon.a (mon.0) 1366 : audit 1 from='client.? 172.21.15.72:0/2751115767' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi072-64171-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:17.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:17 smithi172 bash[23680]: audit 2024-03-30T15:13:16.610083+0000 mon.a (mon.0) 1367 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi072-64321-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-03-30T15:13:17.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:17 smithi172 bash[23680]: cluster 2024-03-30T15:13:16.618221+0000 mon.a (mon.0) 1368 : cluster 0 osdmap e139: 8 total, 8 up, 8 in 2024-03-30T15:13:17.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:17 smithi172 bash[23680]: audit 2024-03-30T15:13:16.626736+0000 mon.c (mon.2) 230 : audit 1 from='client.? 172.21.15.72:0/3052126303' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi072-64321-1","app":"app1","key":"key1"}]: dispatch 2024-03-30T15:13:17.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:17 smithi172 bash[23680]: audit 2024-03-30T15:13:16.628030+0000 mon.c (mon.2) 231 : audit 1 from='client.? 172.21.15.72:0/3570618374' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi072-64378-10"}]: dispatch 2024-03-30T15:13:17.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:17 smithi172 bash[23680]: audit 2024-03-30T15:13:16.630601+0000 mon.a (mon.0) 1369 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi072-64321-1","app":"app1","key":"key1"}]: dispatch 2024-03-30T15:13:17.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:17 smithi172 bash[23680]: audit 2024-03-30T15:13:16.631261+0000 mon.a (mon.0) 1370 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi072-64378-10"}]: dispatch 2024-03-30T15:13:18.643 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [==========] Running 31 tests from 7 test suites. 2024-03-30T15:13:18.643 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [----------] Global test environment set-up. 2024-03-30T15:13:18.644 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion 2024-03-30T15:13:18.644 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ RUN ] LibRadosMiscVersion.VersionPP 2024-03-30T15:13:18.644 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2024-03-30T15:13:18.644 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-03-30T15:13:18.644 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: 2024-03-30T15:13:18.644 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP 2024-03-30T15:13:18.644 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: seed 64321 2024-03-30T15:13:18.644 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WaitOSDMapPP 2024-03-30T15:13:18.644 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WaitOSDMapPP (13 ms) 2024-03-30T15:13:18.644 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNamePP 2024-03-30T15:13:18.644 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNamePP (426 ms) 2024-03-30T15:13:18.644 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongLocatorPP 2024-03-30T15:13:18.644 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongLocatorPP (8 ms) 2024-03-30T15:13:18.644 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNSpacePP 2024-03-30T15:13:18.645 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNSpacePP (6 ms) 2024-03-30T15:13:18.645 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongAttrNamePP 2024-03-30T15:13:18.645 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongAttrNamePP (10 ms) 2024-03-30T15:13:18.645 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.ExecPP 2024-03-30T15:13:18.645 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.ExecPP (2 ms) 2024-03-30T15:13:18.645 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BadFlagsPP 2024-03-30T15:13:18.645 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BadFlagsPP (2 ms) 2024-03-30T15:13:18.645 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate1PP 2024-03-30T15:13:18.645 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate1PP (5 ms) 2024-03-30T15:13:18.645 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate2PP 2024-03-30T15:13:18.645 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate2PP (1 ms) 2024-03-30T15:13:18.645 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigObjectPP 2024-03-30T15:13:18.645 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigObjectPP (9 ms) 2024-03-30T15:13:18.645 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AioOperatePP 2024-03-30T15:13:18.645 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AioOperatePP (3 ms) 2024-03-30T15:13:18.646 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertExistsPP 2024-03-30T15:13:18.646 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertExistsPP (5 ms) 2024-03-30T15:13:18.646 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertVersionPP 2024-03-30T15:13:18.646 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertVersionPP (7 ms) 2024-03-30T15:13:18.646 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigAttrPP 2024-03-30T15:13:18.646 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: osd_max_attr_size = 0 2024-03-30T15:13:18.646 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: osd_max_attr_size == 0; skipping test 2024-03-30T15:13:18.646 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigAttrPP (2314 ms) 2024-03-30T15:13:18.646 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyPP 2024-03-30T15:13:18.646 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyPP (446 ms) 2024-03-30T15:13:18.646 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyScrubPP 2024-03-30T15:13:18.646 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: waiting for initial deep scrubs... 2024-03-30T15:13:18.646 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: done waiting, doing copies 2024-03-30T15:13:18.646 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: waiting for final deep scrubs... 2024-03-30T15:13:18.646 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: done waiting 2024-03-30T15:13:18.647 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyScrubPP (61042 ms) 2024-03-30T15:13:18.647 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WriteSamePP 2024-03-30T15:13:18.647 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WriteSamePP (10 ms) 2024-03-30T15:13:18.647 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CmpExtPP 2024-03-30T15:13:18.647 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CmpExtPP (6 ms) 2024-03-30T15:13:18.647 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Applications 2024-03-30T15:13:18.647 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Applications (5251 ms) 2024-03-30T15:13:18.647 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatOSD 2024-03-30T15:13:18.647 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2024-03-30T15:13:18.647 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatClient 2024-03-30T15:13:18.647 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2024-03-30T15:13:18.647 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Conf 2024-03-30T15:13:18.647 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Conf (0 ms) 2024-03-30T15:13:18.658 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP read_operations: Running main() from gmock_main.cc 2024-03-30T15:13:18.659 INFO:tasks.workunit.client.0.smithi072.stdout: read_operations: [==========] Running 14 tests from 1 test suite. 2024-03-30T15:13:18.659 INFO:tasks.workunit.client.0.smithi072.stdout: read_operations: [----------] Global test environment set-up. 2024-03-30T15:13:18.659 INFO:tasks.workunit.client.0.smithi072.stdout: read_operations: [----------] 14 tests from NeoRadosReadOps 2024-03-30T15:13:18.659 INFO:tasks.workunit.client.0.smithi072.stdout: read_operations: [ RUN ] NeoRadosReadOps.SetOpFlags 2024-03-30T15:13:18.659 INFO:tasks.workunit.client.0.smithi072.stdout: read_operations: [ OK ] NeoRadosReadOps.SetOpFlags (20058 ms) 2024-03-30T15:13:18.659 INFO:tasks.workunit.client.0.smithi072.stdout: read_operations: [ RUN ] NeoRadosReadOps.AssertExists 2024-03-30T15:13:18.659 INFO:tasks.workunit.client.0.smithi072.stdout: read_operations: [ OK ] NeoRadosReadOps.AssertExists (10681 ms) 2024-03-30T15:13:18.659 INFO:tasks.workunit.client.0.smithi072.stdout: read_operations: [ RUN ] NeoRadosReadOps.AssertVersion 2024-03-30T15:13:18.659 INFO:tasks.workunit.client.0.smithi072.stdout: read_operations: [ OK ] NeoRadosReadOps.AssertVersion (4488 ms) 2024-03-30T15:13:18.659 INFO:tasks.workunit.client.0.smithi072.stdout: read_operations: [ RUN ] NeoRadosReadOps.CmpXattr 2024-03-30T15:13:18.659 INFO:tasks.workunit.client.0.smithi072.stdout: read_operations: [ OK ] NeoRadosReadOps.CmpXattr (5069 ms) 2024-03-30T15:13:18.659 INFO:tasks.workunit.client.0.smithi072.stdout: read_operations: [ RUN ] NeoRadosReadOps.Read 2024-03-30T15:13:18.659 INFO:tasks.workunit.client.0.smithi072.stdout: read_operations: [ OK ] NeoRadosReadOps.Read (4498 ms) 2024-03-30T15:13:18.659 INFO:tasks.workunit.client.0.smithi072.stdout: read_operations: [ RUN ] NeoRadosReadOps.Checksum 2024-03-30T15:13:18.660 INFO:tasks.workunit.client.0.smithi072.stdout: read_operations: [ OK ] NeoRadosReadOps.Checksum (8229 ms) 2024-03-30T15:13:18.660 INFO:tasks.workunit.client.0.smithi072.stdout: read_operations: [ RUN ] NeoRadosReadOps.RWOrderedRead 2024-03-30T15:13:18.660 INFO:tasks.workunit.client.0.smithi072.stdout: read_operations: [ OK ] NeoRadosReadOps.RWOrderedRead (6629 ms) 2024-03-30T15:13:18.660 INFO:tasks.workunit.client.0.smithi072.stdout: read_operations: [ RUN ] NeoRadosReadOps.ShortRead 2024-03-30T15:13:18.660 INFO:tasks.workunit.client.0.smithi072.stdout: read_operations: [ OK ] NeoRadosReadOps.ShortRead (5149 ms) 2024-03-30T15:13:18.660 INFO:tasks.workunit.client.0.smithi072.stdout: read_operations: [ RUN ] NeoRadosReadOps.Exec 2024-03-30T15:13:18.660 INFO:tasks.workunit.client.0.smithi072.stdout: read_operations: [ OK ] NeoRadosReadOps.Exec (4677 ms) 2024-03-30T15:13:18.660 INFO:tasks.workunit.client.0.smithi072.stdout: read_operations: [ RUN ] NeoRadosReadOps.Stat 2024-03-30T15:13:18.660 INFO:tasks.workunit.client.0.smithi072.stdout: read_operations: [ OK ] NeoRadosReadOps.Stat (3265 ms) 2024-03-30T15:13:18.660 INFO:tasks.workunit.client.0.smithi072.stdout: read_operations: [ RUN ] NeoRadosReadOps.Omap 2024-03-30T15:13:18.660 INFO:tasks.workunit.client.0.smithi072.stdout: read_operations: [ OK ] NeoRadosReadOps.Omap (4777 ms) 2024-03-30T15:13:18.660 INFO:tasks.workunit.client.0.smithi072.stdout: read_operations: [ RUN ] NeoRadosReadOps.OmapNuls 2024-03-30T15:13:18.660 INFO:tasks.workunit.client.0.smithi072.stdout: read_operations: [ OK ] NeoRadosReadOps.OmapNuls (2834 ms) 2024-03-30T15:13:18.660 INFO:tasks.workunit.client.0.smithi072.stdout: read_operations: [ RUN ] NeoRadosReadOps.GetXattrs 2024-03-30T15:13:18.660 INFO:tasks.workunit.client.0.smithi072.stdout: read_operations: [ OK ] NeoRadosReadOps.GetXattrs (2963 ms) 2024-03-30T15:13:18.661 INFO:tasks.workunit.client.0.smithi072.stdout: read_operations: [ RUN ] NeoRadosReadOps.CmpExt 2024-03-30T15:13:18.661 INFO:tasks.workunit.client.0.smithi072.stdout: read_operations: [ OK ] NeoRadosReadOps.CmpExt (3031 ms) 2024-03-30T15:13:18.661 INFO:tasks.workunit.client.0.smithi072.stdout: read_operations: [----------] 14 tests from NeoRadosReadOps (86348 ms total) 2024-03-30T15:13:18.661 INFO:tasks.workunit.client.0.smithi072.stdout: read_operations: 2024-03-30T15:13:18.661 INFO:tasks.workunit.client.0.smithi072.stdout: read_operations: [----------] Global test environment tear-down 2024-03-30T15:13:18.661 INFO:tasks.workunit.client.0.smithi072.stdout: read_operations: [==========] 14 tests from 1 test suite ran. (86348 ms total) 2024-03-30T15:13:18.661 INFO:tasks.workunit.client.0.smithi072.stdout: read_operations: [ PASSED ] 14 tests. 2024-03-30T15:13:18.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:18 smithi072 bash[21573]: audit 2024-03-30T15:13:17.609654+0000 mon.a (mon.0) 1371 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:18.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:18 smithi072 bash[21573]: audit 2024-03-30T15:13:17.615427+0000 mon.a (mon.0) 1372 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi072-64321-1","app":"app1","key":"key1"}]': finished 2024-03-30T15:13:18.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:18 smithi072 bash[21573]: audit 2024-03-30T15:13:17.615616+0000 mon.a (mon.0) 1373 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi072-64378-10"}]': finished 2024-03-30T15:13:18.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:18 smithi072 bash[21573]: cluster 2024-03-30T15:13:17.624154+0000 mon.a (mon.0) 1374 : cluster 0 osdmap e140: 8 total, 8 up, 8 in 2024-03-30T15:13:18.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:18 smithi072 bash[21573]: audit 2024-03-30T15:13:17.634333+0000 mon.c (mon.2) 232 : audit 1 from='client.? 172.21.15.72:0/3570618374' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi072-64378-10"}]: dispatch 2024-03-30T15:13:18.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:18 smithi072 bash[21573]: audit 2024-03-30T15:13:17.638484+0000 mon.a (mon.0) 1375 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi072-64378-10"}]: dispatch 2024-03-30T15:13:18.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:18 smithi072 bash[21573]: audit 2024-03-30T15:13:17.639137+0000 mon.c (mon.2) 233 : audit 1 from='client.? 172.21.15.72:0/793175807' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsComplete_smithi072-64163-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:18.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:18 smithi072 bash[21573]: audit 2024-03-30T15:13:17.640102+0000 mon.a (mon.0) 1376 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsComplete_smithi072-64163-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:18.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:18 smithi072 bash[21573]: audit 2024-03-30T15:13:18.126396+0000 mon.a (mon.0) 1377 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:13:18.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:18 smithi072 bash[28946]: audit 2024-03-30T15:13:17.609654+0000 mon.a (mon.0) 1371 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:18.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:18 smithi072 bash[28946]: audit 2024-03-30T15:13:17.615427+0000 mon.a (mon.0) 1372 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi072-64321-1","app":"app1","key":"key1"}]': finished 2024-03-30T15:13:18.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:18 smithi072 bash[28946]: audit 2024-03-30T15:13:17.615616+0000 mon.a (mon.0) 1373 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi072-64378-10"}]': finished 2024-03-30T15:13:18.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:18 smithi072 bash[28946]: cluster 2024-03-30T15:13:17.624154+0000 mon.a (mon.0) 1374 : cluster 0 osdmap e140: 8 total, 8 up, 8 in 2024-03-30T15:13:18.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:18 smithi072 bash[28946]: audit 2024-03-30T15:13:17.634333+0000 mon.c (mon.2) 232 : audit 1 from='client.? 172.21.15.72:0/3570618374' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi072-64378-10"}]: dispatch 2024-03-30T15:13:18.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:18 smithi072 bash[28946]: audit 2024-03-30T15:13:17.638484+0000 mon.a (mon.0) 1375 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi072-64378-10"}]: dispatch 2024-03-30T15:13:18.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:18 smithi072 bash[28946]: audit 2024-03-30T15:13:17.639137+0000 mon.c (mon.2) 233 : audit 1 from='client.? 172.21.15.72:0/793175807' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsComplete_smithi072-64163-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:18.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:18 smithi072 bash[28946]: audit 2024-03-30T15:13:17.640102+0000 mon.a (mon.0) 1376 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsComplete_smithi072-64163-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:18.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:18 smithi072 bash[28946]: audit 2024-03-30T15:13:18.126396+0000 mon.a (mon.0) 1377 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:13:18.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:18 smithi172 bash[23680]: audit 2024-03-30T15:13:17.609654+0000 mon.a (mon.0) 1371 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:18.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:18 smithi172 bash[23680]: audit 2024-03-30T15:13:17.615427+0000 mon.a (mon.0) 1372 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi072-64321-1","app":"app1","key":"key1"}]': finished 2024-03-30T15:13:18.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:18 smithi172 bash[23680]: audit 2024-03-30T15:13:17.615616+0000 mon.a (mon.0) 1373 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi072-64378-10"}]': finished 2024-03-30T15:13:18.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:18 smithi172 bash[23680]: cluster 2024-03-30T15:13:17.624154+0000 mon.a (mon.0) 1374 : cluster 0 osdmap e140: 8 total, 8 up, 8 in 2024-03-30T15:13:18.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:18 smithi172 bash[23680]: audit 2024-03-30T15:13:17.634333+0000 mon.c (mon.2) 232 : audit 1 from='client.? 172.21.15.72:0/3570618374' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi072-64378-10"}]: dispatch 2024-03-30T15:13:18.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:18 smithi172 bash[23680]: audit 2024-03-30T15:13:17.638484+0000 mon.a (mon.0) 1375 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi072-64378-10"}]: dispatch 2024-03-30T15:13:18.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:18 smithi172 bash[23680]: audit 2024-03-30T15:13:17.639137+0000 mon.c (mon.2) 233 : audit 1 from='client.? 172.21.15.72:0/793175807' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsComplete_smithi072-64163-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:18.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:18 smithi172 bash[23680]: audit 2024-03-30T15:13:17.640102+0000 mon.a (mon.0) 1376 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsComplete_smithi072-64163-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:18.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:18 smithi172 bash[23680]: audit 2024-03-30T15:13:18.126396+0000 mon.a (mon.0) 1377 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:13:19.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:19 smithi072 bash[21573]: cluster 2024-03-30T15:13:17.905709+0000 mgr.y (mgr.14526) 232 : cluster 0 pgmap v214: 420 pgs: 96 unknown, 324 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 73 KiB/s wr, 74 op/s 2024-03-30T15:13:19.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:19 smithi072 bash[21573]: audit 2024-03-30T15:13:18.611302+0000 mon.a (mon.0) 1378 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:19.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:19 smithi072 bash[21573]: audit 2024-03-30T15:13:18.626009+0000 mon.a (mon.0) 1379 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi072-64378-10"}]': finished 2024-03-30T15:13:19.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:19 smithi072 bash[21573]: audit 2024-03-30T15:13:18.626150+0000 mon.a (mon.0) 1380 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsComplete_smithi072-64163-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:19.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:19 smithi072 bash[21573]: audit 2024-03-30T15:13:18.626317+0000 mon.a (mon.0) 1381 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-13", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:13:19.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:19 smithi072 bash[21573]: cluster 2024-03-30T15:13:18.634995+0000 mon.a (mon.0) 1382 : cluster 0 osdmap e141: 8 total, 8 up, 8 in 2024-03-30T15:13:19.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:19 smithi072 bash[21573]: audit 2024-03-30T15:13:18.639212+0000 mon.a (mon.0) 1383 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-13"}]: dispatch 2024-03-30T15:13:19.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:19 smithi072 bash[21573]: audit 2024-03-30T15:13:18.648686+0000 mon.b (mon.1) 47 : audit 1 from='client.? 172.21.15.72:0/1186081843' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi072-64171-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:19.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:19 smithi072 bash[21573]: audit 2024-03-30T15:13:18.657627+0000 mon.a (mon.0) 1384 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi072-64171-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:19.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:19 smithi072 bash[21573]: audit 2024-03-30T15:13:18.696994+0000 mon.a (mon.0) 1385 : audit 1 from='client.? 172.21.15.72:0/3759683074' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi072-64378-15"}]: dispatch 2024-03-30T15:13:19.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:19 smithi072 bash[21573]: audit 2024-03-30T15:13:18.701715+0000 mon.a (mon.0) 1386 : audit 1 from='client.? 172.21.15.72:0/3759683074' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi072-64378-15"}]: dispatch 2024-03-30T15:13:19.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:19 smithi072 bash[21573]: audit 2024-03-30T15:13:18.702920+0000 mon.a (mon.0) 1387 : audit 1 from='client.? 172.21.15.72:0/3759683074' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi072-64378-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:13:19.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:19 smithi072 bash[21573]: audit 2024-03-30T15:13:18.703981+0000 mon.a (mon.0) 1388 : audit 1 from='client.? 172.21.15.72:0/3416764051' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi072-64321-24"}]: dispatch 2024-03-30T15:13:19.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:19 smithi072 bash[21573]: audit 2024-03-30T15:13:18.707502+0000 mon.a (mon.0) 1389 : audit 1 from='client.? 172.21.15.72:0/3416764051' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi072-64321-24"}]: dispatch 2024-03-30T15:13:19.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:19 smithi072 bash[21573]: audit 2024-03-30T15:13:18.710177+0000 mon.a (mon.0) 1390 : audit 1 from='client.? 172.21.15.72:0/3416764051' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi072-64321-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:13:19.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:19 smithi072 bash[28946]: cluster 2024-03-30T15:13:17.905709+0000 mgr.y (mgr.14526) 232 : cluster 0 pgmap v214: 420 pgs: 96 unknown, 324 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 73 KiB/s wr, 74 op/s 2024-03-30T15:13:19.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:19 smithi072 bash[28946]: audit 2024-03-30T15:13:18.611302+0000 mon.a (mon.0) 1378 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:19.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:19 smithi072 bash[28946]: audit 2024-03-30T15:13:18.626009+0000 mon.a (mon.0) 1379 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi072-64378-10"}]': finished 2024-03-30T15:13:19.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:19 smithi072 bash[28946]: audit 2024-03-30T15:13:18.626150+0000 mon.a (mon.0) 1380 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsComplete_smithi072-64163-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:19.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:19 smithi072 bash[28946]: audit 2024-03-30T15:13:18.626317+0000 mon.a (mon.0) 1381 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-13", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:13:19.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:19 smithi072 bash[28946]: cluster 2024-03-30T15:13:18.634995+0000 mon.a (mon.0) 1382 : cluster 0 osdmap e141: 8 total, 8 up, 8 in 2024-03-30T15:13:19.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:19 smithi072 bash[28946]: audit 2024-03-30T15:13:18.639212+0000 mon.a (mon.0) 1383 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-13"}]: dispatch 2024-03-30T15:13:19.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:19 smithi072 bash[28946]: audit 2024-03-30T15:13:18.648686+0000 mon.b (mon.1) 47 : audit 1 from='client.? 172.21.15.72:0/1186081843' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi072-64171-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:19.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:19 smithi072 bash[28946]: audit 2024-03-30T15:13:18.657627+0000 mon.a (mon.0) 1384 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi072-64171-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:19.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:19 smithi072 bash[28946]: audit 2024-03-30T15:13:18.696994+0000 mon.a (mon.0) 1385 : audit 1 from='client.? 172.21.15.72:0/3759683074' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi072-64378-15"}]: dispatch 2024-03-30T15:13:19.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:19 smithi072 bash[28946]: audit 2024-03-30T15:13:18.701715+0000 mon.a (mon.0) 1386 : audit 1 from='client.? 172.21.15.72:0/3759683074' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi072-64378-15"}]: dispatch 2024-03-30T15:13:19.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:19 smithi072 bash[28946]: audit 2024-03-30T15:13:18.702920+0000 mon.a (mon.0) 1387 : audit 1 from='client.? 172.21.15.72:0/3759683074' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi072-64378-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:13:19.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:19 smithi072 bash[28946]: audit 2024-03-30T15:13:18.703981+0000 mon.a (mon.0) 1388 : audit 1 from='client.? 172.21.15.72:0/3416764051' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi072-64321-24"}]: dispatch 2024-03-30T15:13:19.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:19 smithi072 bash[28946]: audit 2024-03-30T15:13:18.707502+0000 mon.a (mon.0) 1389 : audit 1 from='client.? 172.21.15.72:0/3416764051' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi072-64321-24"}]: dispatch 2024-03-30T15:13:19.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:19 smithi072 bash[28946]: audit 2024-03-30T15:13:18.710177+0000 mon.a (mon.0) 1390 : audit 1 from='client.? 172.21.15.72:0/3416764051' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi072-64321-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:13:19.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:19 smithi172 bash[23680]: cluster 2024-03-30T15:13:17.905709+0000 mgr.y (mgr.14526) 232 : cluster 0 pgmap v214: 420 pgs: 96 unknown, 324 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 73 KiB/s wr, 74 op/s 2024-03-30T15:13:19.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:19 smithi172 bash[23680]: audit 2024-03-30T15:13:18.611302+0000 mon.a (mon.0) 1378 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:19.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:19 smithi172 bash[23680]: audit 2024-03-30T15:13:18.626009+0000 mon.a (mon.0) 1379 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi072-64378-10"}]': finished 2024-03-30T15:13:19.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:19 smithi172 bash[23680]: audit 2024-03-30T15:13:18.626150+0000 mon.a (mon.0) 1380 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsComplete_smithi072-64163-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:19.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:19 smithi172 bash[23680]: audit 2024-03-30T15:13:18.626317+0000 mon.a (mon.0) 1381 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-13", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:13:19.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:19 smithi172 bash[23680]: cluster 2024-03-30T15:13:18.634995+0000 mon.a (mon.0) 1382 : cluster 0 osdmap e141: 8 total, 8 up, 8 in 2024-03-30T15:13:19.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:19 smithi172 bash[23680]: audit 2024-03-30T15:13:18.639212+0000 mon.a (mon.0) 1383 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-13"}]: dispatch 2024-03-30T15:13:19.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:19 smithi172 bash[23680]: audit 2024-03-30T15:13:18.648686+0000 mon.b (mon.1) 47 : audit 1 from='client.? 172.21.15.72:0/1186081843' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi072-64171-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:19.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:19 smithi172 bash[23680]: audit 2024-03-30T15:13:18.657627+0000 mon.a (mon.0) 1384 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi072-64171-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:19.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:19 smithi172 bash[23680]: audit 2024-03-30T15:13:18.696994+0000 mon.a (mon.0) 1385 : audit 1 from='client.? 172.21.15.72:0/3759683074' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi072-64378-15"}]: dispatch 2024-03-30T15:13:19.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:19 smithi172 bash[23680]: audit 2024-03-30T15:13:18.701715+0000 mon.a (mon.0) 1386 : audit 1 from='client.? 172.21.15.72:0/3759683074' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi072-64378-15"}]: dispatch 2024-03-30T15:13:19.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:19 smithi172 bash[23680]: audit 2024-03-30T15:13:18.702920+0000 mon.a (mon.0) 1387 : audit 1 from='client.? 172.21.15.72:0/3759683074' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi072-64378-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:13:19.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:19 smithi172 bash[23680]: audit 2024-03-30T15:13:18.703981+0000 mon.a (mon.0) 1388 : audit 1 from='client.? 172.21.15.72:0/3416764051' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi072-64321-24"}]: dispatch 2024-03-30T15:13:19.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:19 smithi172 bash[23680]: audit 2024-03-30T15:13:18.707502+0000 mon.a (mon.0) 1389 : audit 1 from='client.? 172.21.15.72:0/3416764051' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi072-64321-24"}]: dispatch 2024-03-30T15:13:19.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:19 smithi172 bash[23680]: audit 2024-03-30T15:13:18.710177+0000 mon.a (mon.0) 1390 : audit 1 from='client.? 172.21.15.72:0/3416764051' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi072-64321-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:13:20.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:20 smithi072 bash[21573]: audit 2024-03-30T15:13:19.612993+0000 mon.a (mon.0) 1391 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:20.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:20 smithi072 bash[21573]: audit 2024-03-30T15:13:19.631351+0000 mon.a (mon.0) 1392 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-13"}]': finished 2024-03-30T15:13:20.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:20 smithi072 bash[21573]: audit 2024-03-30T15:13:19.631577+0000 mon.a (mon.0) 1393 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi072-64171-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:20.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:20 smithi072 bash[21573]: audit 2024-03-30T15:13:19.631823+0000 mon.a (mon.0) 1394 : audit 1 from='client.? 172.21.15.72:0/3759683074' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi072-64378-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:13:20.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:20 smithi072 bash[21573]: audit 2024-03-30T15:13:19.632015+0000 mon.a (mon.0) 1395 : audit 1 from='client.? 172.21.15.72:0/3416764051' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi072-64321-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:13:20.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:20 smithi072 bash[21573]: cluster 2024-03-30T15:13:19.639236+0000 mon.a (mon.0) 1396 : cluster 0 osdmap e142: 8 total, 8 up, 8 in 2024-03-30T15:13:20.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:20 smithi072 bash[21573]: audit 2024-03-30T15:13:19.640793+0000 mon.a (mon.0) 1397 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-13", "mode": "writeback"}]: dispatch 2024-03-30T15:13:20.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:20 smithi072 bash[21573]: audit 2024-03-30T15:13:19.641822+0000 mon.a (mon.0) 1398 : audit 1 from='client.? 172.21.15.72:0/3759683074' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi072-64378-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi072-64378-15"}]: dispatch 2024-03-30T15:13:20.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:20 smithi072 bash[21573]: audit 2024-03-30T15:13:19.642628+0000 mon.a (mon.0) 1399 : audit 1 from='client.? 172.21.15.72:0/3416764051' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi072-64321-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi072-64321-24"}]: dispatch 2024-03-30T15:13:20.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:20 smithi072 bash[21573]: audit 2024-03-30T15:13:20.152803+0000 mon.a (mon.0) 1400 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:13:20.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:20 smithi072 bash[21573]: audit 2024-03-30T15:13:20.160095+0000 mon.c (mon.2) 234 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:13:20.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:20 smithi072 bash[28946]: audit 2024-03-30T15:13:19.612993+0000 mon.a (mon.0) 1391 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:20.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:20 smithi072 bash[28946]: audit 2024-03-30T15:13:19.631351+0000 mon.a (mon.0) 1392 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-13"}]': finished 2024-03-30T15:13:20.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:20 smithi072 bash[28946]: audit 2024-03-30T15:13:19.631577+0000 mon.a (mon.0) 1393 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi072-64171-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:20.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:20 smithi072 bash[28946]: audit 2024-03-30T15:13:19.631823+0000 mon.a (mon.0) 1394 : audit 1 from='client.? 172.21.15.72:0/3759683074' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi072-64378-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:13:20.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:20 smithi072 bash[28946]: audit 2024-03-30T15:13:19.632015+0000 mon.a (mon.0) 1395 : audit 1 from='client.? 172.21.15.72:0/3416764051' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi072-64321-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:13:20.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:20 smithi072 bash[28946]: cluster 2024-03-30T15:13:19.639236+0000 mon.a (mon.0) 1396 : cluster 0 osdmap e142: 8 total, 8 up, 8 in 2024-03-30T15:13:20.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:20 smithi072 bash[28946]: audit 2024-03-30T15:13:19.640793+0000 mon.a (mon.0) 1397 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-13", "mode": "writeback"}]: dispatch 2024-03-30T15:13:20.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:20 smithi072 bash[28946]: audit 2024-03-30T15:13:19.641822+0000 mon.a (mon.0) 1398 : audit 1 from='client.? 172.21.15.72:0/3759683074' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi072-64378-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi072-64378-15"}]: dispatch 2024-03-30T15:13:20.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:20 smithi072 bash[28946]: audit 2024-03-30T15:13:19.642628+0000 mon.a (mon.0) 1399 : audit 1 from='client.? 172.21.15.72:0/3416764051' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi072-64321-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi072-64321-24"}]: dispatch 2024-03-30T15:13:20.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:20 smithi072 bash[28946]: audit 2024-03-30T15:13:20.152803+0000 mon.a (mon.0) 1400 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:13:20.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:20 smithi072 bash[28946]: audit 2024-03-30T15:13:20.160095+0000 mon.c (mon.2) 234 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:13:20.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:20 smithi172 bash[23680]: audit 2024-03-30T15:13:19.612993+0000 mon.a (mon.0) 1391 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:20.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:20 smithi172 bash[23680]: audit 2024-03-30T15:13:19.631351+0000 mon.a (mon.0) 1392 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-13"}]': finished 2024-03-30T15:13:20.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:20 smithi172 bash[23680]: audit 2024-03-30T15:13:19.631577+0000 mon.a (mon.0) 1393 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi072-64171-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:20.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:20 smithi172 bash[23680]: audit 2024-03-30T15:13:19.631823+0000 mon.a (mon.0) 1394 : audit 1 from='client.? 172.21.15.72:0/3759683074' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi072-64378-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:13:20.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:20 smithi172 bash[23680]: audit 2024-03-30T15:13:19.632015+0000 mon.a (mon.0) 1395 : audit 1 from='client.? 172.21.15.72:0/3416764051' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi072-64321-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:13:20.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:20 smithi172 bash[23680]: cluster 2024-03-30T15:13:19.639236+0000 mon.a (mon.0) 1396 : cluster 0 osdmap e142: 8 total, 8 up, 8 in 2024-03-30T15:13:20.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:20 smithi172 bash[23680]: audit 2024-03-30T15:13:19.640793+0000 mon.a (mon.0) 1397 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-13", "mode": "writeback"}]: dispatch 2024-03-30T15:13:20.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:20 smithi172 bash[23680]: audit 2024-03-30T15:13:19.641822+0000 mon.a (mon.0) 1398 : audit 1 from='client.? 172.21.15.72:0/3759683074' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi072-64378-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi072-64378-15"}]: dispatch 2024-03-30T15:13:20.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:20 smithi172 bash[23680]: audit 2024-03-30T15:13:19.642628+0000 mon.a (mon.0) 1399 : audit 1 from='client.? 172.21.15.72:0/3416764051' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi072-64321-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi072-64321-24"}]: dispatch 2024-03-30T15:13:20.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:20 smithi172 bash[23680]: audit 2024-03-30T15:13:20.152803+0000 mon.a (mon.0) 1400 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:13:20.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:20 smithi172 bash[23680]: audit 2024-03-30T15:13:20.160095+0000 mon.c (mon.2) 234 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:13:21.416 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:13:21 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:13:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:13:21.465 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:13:21 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:13:22.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:21 smithi072 bash[21573]: cluster 2024-03-30T15:13:19.906698+0000 mgr.y (mgr.14526) 233 : cluster 0 pgmap v217: 388 pgs: 96 unknown, 292 active+clean; 589 KiB data, 1.1 GiB used, 714 GiB / 715 GiB avail 2024-03-30T15:13:22.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:21 smithi072 bash[21573]: cluster 2024-03-30T15:13:20.603491+0000 mon.a (mon.0) 1401 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:13:22.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:21 smithi072 bash[21573]: cluster 2024-03-30T15:13:20.606195+0000 mon.a (mon.0) 1402 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:13:22.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:21 smithi072 bash[21573]: audit 2024-03-30T15:13:20.608790+0000 mon.a (mon.0) 1403 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-13", "mode": "writeback"}]': finished 2024-03-30T15:13:22.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:21 smithi072 bash[21573]: cluster 2024-03-30T15:13:21.519955+0000 mon.a (mon.0) 1404 : cluster 0 osdmap e143: 8 total, 8 up, 8 in 2024-03-30T15:13:22.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:21 smithi072 bash[21573]: audit 2024-03-30T15:13:21.521455+0000 mon.c (mon.2) 235 : audit 1 from='client.? 172.21.15.72:0/4186159526' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi072-64163-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:22.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:21 smithi072 bash[21573]: audit 2024-03-30T15:13:21.523423+0000 mon.a (mon.0) 1405 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:22.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:21 smithi072 bash[21573]: audit 2024-03-30T15:13:21.525123+0000 mon.a (mon.0) 1406 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi072-64163-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:22.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:21 smithi072 bash[28946]: cluster 2024-03-30T15:13:19.906698+0000 mgr.y (mgr.14526) 233 : cluster 0 pgmap v217: 388 pgs: 96 unknown, 292 active+clean; 589 KiB data, 1.1 GiB used, 714 GiB / 715 GiB avail 2024-03-30T15:13:22.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:21 smithi072 bash[28946]: cluster 2024-03-30T15:13:20.603491+0000 mon.a (mon.0) 1401 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:13:22.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:21 smithi072 bash[28946]: cluster 2024-03-30T15:13:20.606195+0000 mon.a (mon.0) 1402 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:13:22.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:21 smithi072 bash[28946]: audit 2024-03-30T15:13:20.608790+0000 mon.a (mon.0) 1403 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-13", "mode": "writeback"}]': finished 2024-03-30T15:13:22.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:21 smithi072 bash[28946]: cluster 2024-03-30T15:13:21.519955+0000 mon.a (mon.0) 1404 : cluster 0 osdmap e143: 8 total, 8 up, 8 in 2024-03-30T15:13:22.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:21 smithi072 bash[28946]: audit 2024-03-30T15:13:21.521455+0000 mon.c (mon.2) 235 : audit 1 from='client.? 172.21.15.72:0/4186159526' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi072-64163-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:22.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:21 smithi072 bash[28946]: audit 2024-03-30T15:13:21.523423+0000 mon.a (mon.0) 1405 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:22.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:21 smithi072 bash[28946]: audit 2024-03-30T15:13:21.525123+0000 mon.a (mon.0) 1406 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi072-64163-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:22.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:21 smithi172 bash[23680]: cluster 2024-03-30T15:13:19.906698+0000 mgr.y (mgr.14526) 233 : cluster 0 pgmap v217: 388 pgs: 96 unknown, 292 active+clean; 589 KiB data, 1.1 GiB used, 714 GiB / 715 GiB avail 2024-03-30T15:13:22.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:21 smithi172 bash[23680]: cluster 2024-03-30T15:13:20.603491+0000 mon.a (mon.0) 1401 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:13:22.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:21 smithi172 bash[23680]: cluster 2024-03-30T15:13:20.606195+0000 mon.a (mon.0) 1402 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:13:22.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:21 smithi172 bash[23680]: audit 2024-03-30T15:13:20.608790+0000 mon.a (mon.0) 1403 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-13", "mode": "writeback"}]': finished 2024-03-30T15:13:22.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:21 smithi172 bash[23680]: cluster 2024-03-30T15:13:21.519955+0000 mon.a (mon.0) 1404 : cluster 0 osdmap e143: 8 total, 8 up, 8 in 2024-03-30T15:13:22.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:21 smithi172 bash[23680]: audit 2024-03-30T15:13:21.521455+0000 mon.c (mon.2) 235 : audit 1 from='client.? 172.21.15.72:0/4186159526' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi072-64163-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:22.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:21 smithi172 bash[23680]: audit 2024-03-30T15:13:21.523423+0000 mon.a (mon.0) 1405 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:22.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:21 smithi172 bash[23680]: audit 2024-03-30T15:13:21.525123+0000 mon.a (mon.0) 1406 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi072-64163-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:23.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:22 smithi072 bash[21573]: audit 2024-03-30T15:13:21.022208+0000 mgr.y (mgr.14526) 234 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:13:23.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:22 smithi072 bash[21573]: cluster 2024-03-30T15:13:21.909651+0000 mgr.y (mgr.14526) 235 : cluster 0 pgmap v219: 356 pgs: 25 creating+peering, 7 unknown, 324 active+clean; 593 KiB data, 464 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:13:23.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:22 smithi072 bash[21573]: audit 2024-03-30T15:13:21.996681+0000 mon.a (mon.0) 1407 : audit 1 from='client.? 172.21.15.72:0/3759683074' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi072-64378-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi072-64378-15"}]': finished 2024-03-30T15:13:23.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:22 smithi072 bash[21573]: audit 2024-03-30T15:13:21.996770+0000 mon.a (mon.0) 1408 : audit 1 from='client.? 172.21.15.72:0/3416764051' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi072-64321-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi072-64321-24"}]': finished 2024-03-30T15:13:23.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:22 smithi072 bash[21573]: audit 2024-03-30T15:13:21.996845+0000 mon.a (mon.0) 1409 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafe_smithi072-64163-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:23.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:22 smithi072 bash[21573]: cluster 2024-03-30T15:13:22.437957+0000 mon.a (mon.0) 1410 : cluster 0 osdmap e144: 8 total, 8 up, 8 in 2024-03-30T15:13:23.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:22 smithi072 bash[21573]: audit 2024-03-30T15:13:22.882686+0000 mon.a (mon.0) 1411 : audit 1 from='client.? 172.21.15.72:0/2893341023' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi072-64171-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:23.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:22 smithi072 bash[21573]: audit 2024-03-30T15:13:22.883985+0000 mon.a (mon.0) 1412 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:23.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:22 smithi072 bash[21573]: audit 2024-03-30T15:13:22.884678+0000 mon.a (mon.0) 1413 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "161.0"}]: dispatch 2024-03-30T15:13:23.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:22 smithi072 bash[21573]: audit 2024-03-30T15:13:22.886585+0000 mon.a (mon.0) 1414 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "161.1"}]: dispatch 2024-03-30T15:13:23.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:22 smithi072 bash[21573]: audit 2024-03-30T15:13:22.887982+0000 mon.a (mon.0) 1415 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "161.2"}]: dispatch 2024-03-30T15:13:23.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:22 smithi072 bash[21573]: audit 2024-03-30T15:13:22.889600+0000 mon.a (mon.0) 1416 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "161.3"}]: dispatch 2024-03-30T15:13:23.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:22 smithi072 bash[21573]: audit 2024-03-30T15:13:22.890966+0000 mon.a (mon.0) 1417 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "161.4"}]: dispatch 2024-03-30T15:13:23.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:22 smithi072 bash[21573]: audit 2024-03-30T15:13:22.892174+0000 mon.a (mon.0) 1418 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "161.5"}]: dispatch 2024-03-30T15:13:23.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:22 smithi072 bash[21573]: audit 2024-03-30T15:13:22.893078+0000 mon.a (mon.0) 1419 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "161.6"}]: dispatch 2024-03-30T15:13:23.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:22 smithi072 bash[21573]: audit 2024-03-30T15:13:22.894019+0000 mon.a (mon.0) 1420 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "161.7"}]: dispatch 2024-03-30T15:13:23.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:22 smithi072 bash[21573]: audit 2024-03-30T15:13:22.894999+0000 mon.a (mon.0) 1421 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "161.8"}]: dispatch 2024-03-30T15:13:23.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:22 smithi072 bash[21573]: audit 2024-03-30T15:13:22.895852+0000 mon.a (mon.0) 1422 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "161.9"}]: dispatch 2024-03-30T15:13:23.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:22 smithi072 bash[28946]: audit 2024-03-30T15:13:21.022208+0000 mgr.y (mgr.14526) 234 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:13:23.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:22 smithi072 bash[28946]: cluster 2024-03-30T15:13:21.909651+0000 mgr.y (mgr.14526) 235 : cluster 0 pgmap v219: 356 pgs: 25 creating+peering, 7 unknown, 324 active+clean; 593 KiB data, 464 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:13:23.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:22 smithi072 bash[28946]: audit 2024-03-30T15:13:21.996681+0000 mon.a (mon.0) 1407 : audit 1 from='client.? 172.21.15.72:0/3759683074' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi072-64378-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi072-64378-15"}]': finished 2024-03-30T15:13:23.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:22 smithi072 bash[28946]: audit 2024-03-30T15:13:21.996770+0000 mon.a (mon.0) 1408 : audit 1 from='client.? 172.21.15.72:0/3416764051' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi072-64321-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi072-64321-24"}]': finished 2024-03-30T15:13:23.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:22 smithi072 bash[28946]: audit 2024-03-30T15:13:21.996845+0000 mon.a (mon.0) 1409 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafe_smithi072-64163-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:23.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:22 smithi072 bash[28946]: cluster 2024-03-30T15:13:22.437957+0000 mon.a (mon.0) 1410 : cluster 0 osdmap e144: 8 total, 8 up, 8 in 2024-03-30T15:13:23.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:22 smithi072 bash[28946]: audit 2024-03-30T15:13:22.882686+0000 mon.a (mon.0) 1411 : audit 1 from='client.? 172.21.15.72:0/2893341023' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi072-64171-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:23.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:22 smithi072 bash[28946]: audit 2024-03-30T15:13:22.883985+0000 mon.a (mon.0) 1412 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:23.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:22 smithi072 bash[28946]: audit 2024-03-30T15:13:22.884678+0000 mon.a (mon.0) 1413 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "161.0"}]: dispatch 2024-03-30T15:13:23.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:22 smithi072 bash[28946]: audit 2024-03-30T15:13:22.886585+0000 mon.a (mon.0) 1414 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "161.1"}]: dispatch 2024-03-30T15:13:23.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:22 smithi072 bash[28946]: audit 2024-03-30T15:13:22.887982+0000 mon.a (mon.0) 1415 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "161.2"}]: dispatch 2024-03-30T15:13:23.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:22 smithi072 bash[28946]: audit 2024-03-30T15:13:22.889600+0000 mon.a (mon.0) 1416 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "161.3"}]: dispatch 2024-03-30T15:13:23.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:22 smithi072 bash[28946]: audit 2024-03-30T15:13:22.890966+0000 mon.a (mon.0) 1417 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "161.4"}]: dispatch 2024-03-30T15:13:23.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:22 smithi072 bash[28946]: audit 2024-03-30T15:13:22.892174+0000 mon.a (mon.0) 1418 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "161.5"}]: dispatch 2024-03-30T15:13:23.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:22 smithi072 bash[28946]: audit 2024-03-30T15:13:22.893078+0000 mon.a (mon.0) 1419 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "161.6"}]: dispatch 2024-03-30T15:13:23.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:22 smithi072 bash[28946]: audit 2024-03-30T15:13:22.894019+0000 mon.a (mon.0) 1420 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "161.7"}]: dispatch 2024-03-30T15:13:23.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:22 smithi072 bash[28946]: audit 2024-03-30T15:13:22.894999+0000 mon.a (mon.0) 1421 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "161.8"}]: dispatch 2024-03-30T15:13:23.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:22 smithi072 bash[28946]: audit 2024-03-30T15:13:22.895852+0000 mon.a (mon.0) 1422 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "161.9"}]: dispatch 2024-03-30T15:13:23.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:22 smithi172 bash[23680]: audit 2024-03-30T15:13:21.022208+0000 mgr.y (mgr.14526) 234 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:13:23.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:22 smithi172 bash[23680]: cluster 2024-03-30T15:13:21.909651+0000 mgr.y (mgr.14526) 235 : cluster 0 pgmap v219: 356 pgs: 25 creating+peering, 7 unknown, 324 active+clean; 593 KiB data, 464 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:13:23.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:22 smithi172 bash[23680]: audit 2024-03-30T15:13:21.996681+0000 mon.a (mon.0) 1407 : audit 1 from='client.? 172.21.15.72:0/3759683074' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi072-64378-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi072-64378-15"}]': finished 2024-03-30T15:13:23.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:22 smithi172 bash[23680]: audit 2024-03-30T15:13:21.996770+0000 mon.a (mon.0) 1408 : audit 1 from='client.? 172.21.15.72:0/3416764051' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi072-64321-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi072-64321-24"}]': finished 2024-03-30T15:13:23.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:22 smithi172 bash[23680]: audit 2024-03-30T15:13:21.996845+0000 mon.a (mon.0) 1409 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafe_smithi072-64163-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:23.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:22 smithi172 bash[23680]: cluster 2024-03-30T15:13:22.437957+0000 mon.a (mon.0) 1410 : cluster 0 osdmap e144: 8 total, 8 up, 8 in 2024-03-30T15:13:23.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:22 smithi172 bash[23680]: audit 2024-03-30T15:13:22.882686+0000 mon.a (mon.0) 1411 : audit 1 from='client.? 172.21.15.72:0/2893341023' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi072-64171-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:23.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:22 smithi172 bash[23680]: audit 2024-03-30T15:13:22.883985+0000 mon.a (mon.0) 1412 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:23.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:22 smithi172 bash[23680]: audit 2024-03-30T15:13:22.884678+0000 mon.a (mon.0) 1413 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "161.0"}]: dispatch 2024-03-30T15:13:23.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:22 smithi172 bash[23680]: audit 2024-03-30T15:13:22.886585+0000 mon.a (mon.0) 1414 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "161.1"}]: dispatch 2024-03-30T15:13:23.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:22 smithi172 bash[23680]: audit 2024-03-30T15:13:22.887982+0000 mon.a (mon.0) 1415 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "161.2"}]: dispatch 2024-03-30T15:13:23.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:22 smithi172 bash[23680]: audit 2024-03-30T15:13:22.889600+0000 mon.a (mon.0) 1416 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "161.3"}]: dispatch 2024-03-30T15:13:23.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:22 smithi172 bash[23680]: audit 2024-03-30T15:13:22.890966+0000 mon.a (mon.0) 1417 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "161.4"}]: dispatch 2024-03-30T15:13:23.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:22 smithi172 bash[23680]: audit 2024-03-30T15:13:22.892174+0000 mon.a (mon.0) 1418 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "161.5"}]: dispatch 2024-03-30T15:13:23.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:22 smithi172 bash[23680]: audit 2024-03-30T15:13:22.893078+0000 mon.a (mon.0) 1419 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "161.6"}]: dispatch 2024-03-30T15:13:23.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:22 smithi172 bash[23680]: audit 2024-03-30T15:13:22.894019+0000 mon.a (mon.0) 1420 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "161.7"}]: dispatch 2024-03-30T15:13:23.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:22 smithi172 bash[23680]: audit 2024-03-30T15:13:22.894999+0000 mon.a (mon.0) 1421 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "161.8"}]: dispatch 2024-03-30T15:13:23.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:22 smithi172 bash[23680]: audit 2024-03-30T15:13:22.895852+0000 mon.a (mon.0) 1422 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "161.9"}]: dispatch 2024-03-30T15:13:24.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:24 smithi072 bash[21573]: audit 2024-03-30T15:13:22.885016+0000 mgr.y (mgr.14526) 236 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "161.0"}]: dispatch 2024-03-30T15:13:24.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:24 smithi072 bash[21573]: audit 2024-03-30T15:13:22.886786+0000 mgr.y (mgr.14526) 237 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "161.1"}]: dispatch 2024-03-30T15:13:24.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:24 smithi072 bash[21573]: audit 2024-03-30T15:13:22.888190+0000 mgr.y (mgr.14526) 238 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "161.2"}]: dispatch 2024-03-30T15:13:24.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:24 smithi072 bash[21573]: audit 2024-03-30T15:13:22.889825+0000 mgr.y (mgr.14526) 239 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "161.3"}]: dispatch 2024-03-30T15:13:24.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:24 smithi072 bash[21573]: audit 2024-03-30T15:13:22.891219+0000 mgr.y (mgr.14526) 240 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "161.4"}]: dispatch 2024-03-30T15:13:24.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:24 smithi072 bash[21573]: audit 2024-03-30T15:13:22.892388+0000 mgr.y (mgr.14526) 241 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "161.5"}]: dispatch 2024-03-30T15:13:24.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:24 smithi072 bash[21573]: audit 2024-03-30T15:13:22.893262+0000 mgr.y (mgr.14526) 242 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "161.6"}]: dispatch 2024-03-30T15:13:24.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:24 smithi072 bash[21573]: audit 2024-03-30T15:13:22.894238+0000 mgr.y (mgr.14526) 243 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "161.7"}]: dispatch 2024-03-30T15:13:24.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:24 smithi072 bash[21573]: audit 2024-03-30T15:13:22.895187+0000 mgr.y (mgr.14526) 244 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "161.8"}]: dispatch 2024-03-30T15:13:24.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:24 smithi072 bash[21573]: audit 2024-03-30T15:13:22.896037+0000 mgr.y (mgr.14526) 245 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "161.9"}]: dispatch 2024-03-30T15:13:24.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:24 smithi072 bash[21573]: cluster 2024-03-30T15:13:23.011417+0000 osd.5 (osd.5) 3 : cluster 0 161.3 scrub starts 2024-03-30T15:13:24.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:24 smithi072 bash[21573]: audit 2024-03-30T15:13:23.012258+0000 mon.a (mon.0) 1423 : audit 1 from='client.? 172.21.15.72:0/2893341023' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi072-64171-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:24.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:24 smithi072 bash[21573]: cluster 2024-03-30T15:13:23.017544+0000 osd.5 (osd.5) 4 : cluster 0 161.3 scrub ok 2024-03-30T15:13:24.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:24 smithi072 bash[21573]: cluster 2024-03-30T15:13:23.021114+0000 mon.a (mon.0) 1424 : cluster 0 osdmap e145: 8 total, 8 up, 8 in 2024-03-30T15:13:24.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:24 smithi072 bash[21573]: audit 2024-03-30T15:13:23.046222+0000 mon.a (mon.0) 1425 : audit 1 from='client.? 172.21.15.72:0/3416764051' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64321-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:24.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:24 smithi072 bash[21573]: cluster 2024-03-30T15:13:23.212007+0000 osd.7 (osd.7) 11 : cluster 0 161.1 scrub starts 2024-03-30T15:13:24.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:24 smithi072 bash[21573]: cluster 2024-03-30T15:13:23.219309+0000 osd.7 (osd.7) 12 : cluster 0 161.1 scrub ok 2024-03-30T15:13:24.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:24 smithi072 bash[21573]: cluster 2024-03-30T15:13:23.245841+0000 osd.0 (osd.0) 11 : cluster 0 161.5 scrub starts 2024-03-30T15:13:24.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:24 smithi072 bash[21573]: cluster 2024-03-30T15:13:23.253351+0000 osd.0 (osd.0) 12 : cluster 0 161.5 scrub ok 2024-03-30T15:13:24.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:24 smithi072 bash[21573]: audit 2024-03-30T15:13:23.885724+0000 mon.a (mon.0) 1426 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:24.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:24 smithi072 bash[28946]: audit 2024-03-30T15:13:22.885016+0000 mgr.y (mgr.14526) 236 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "161.0"}]: dispatch 2024-03-30T15:13:24.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:24 smithi072 bash[28946]: audit 2024-03-30T15:13:22.886786+0000 mgr.y (mgr.14526) 237 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "161.1"}]: dispatch 2024-03-30T15:13:24.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:24 smithi072 bash[28946]: audit 2024-03-30T15:13:22.888190+0000 mgr.y (mgr.14526) 238 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "161.2"}]: dispatch 2024-03-30T15:13:24.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:24 smithi072 bash[28946]: audit 2024-03-30T15:13:22.889825+0000 mgr.y (mgr.14526) 239 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "161.3"}]: dispatch 2024-03-30T15:13:24.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:24 smithi072 bash[28946]: audit 2024-03-30T15:13:22.891219+0000 mgr.y (mgr.14526) 240 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "161.4"}]: dispatch 2024-03-30T15:13:24.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:24 smithi072 bash[28946]: audit 2024-03-30T15:13:22.892388+0000 mgr.y (mgr.14526) 241 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "161.5"}]: dispatch 2024-03-30T15:13:24.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:24 smithi072 bash[28946]: audit 2024-03-30T15:13:22.893262+0000 mgr.y (mgr.14526) 242 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "161.6"}]: dispatch 2024-03-30T15:13:24.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:24 smithi072 bash[28946]: audit 2024-03-30T15:13:22.894238+0000 mgr.y (mgr.14526) 243 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "161.7"}]: dispatch 2024-03-30T15:13:24.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:24 smithi072 bash[28946]: audit 2024-03-30T15:13:22.895187+0000 mgr.y (mgr.14526) 244 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "161.8"}]: dispatch 2024-03-30T15:13:24.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:24 smithi072 bash[28946]: audit 2024-03-30T15:13:22.896037+0000 mgr.y (mgr.14526) 245 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "161.9"}]: dispatch 2024-03-30T15:13:24.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:24 smithi072 bash[28946]: cluster 2024-03-30T15:13:23.011417+0000 osd.5 (osd.5) 3 : cluster 0 161.3 scrub starts 2024-03-30T15:13:24.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:24 smithi072 bash[28946]: audit 2024-03-30T15:13:23.012258+0000 mon.a (mon.0) 1423 : audit 1 from='client.? 172.21.15.72:0/2893341023' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi072-64171-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:24.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:24 smithi072 bash[28946]: cluster 2024-03-30T15:13:23.017544+0000 osd.5 (osd.5) 4 : cluster 0 161.3 scrub ok 2024-03-30T15:13:24.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:24 smithi072 bash[28946]: cluster 2024-03-30T15:13:23.021114+0000 mon.a (mon.0) 1424 : cluster 0 osdmap e145: 8 total, 8 up, 8 in 2024-03-30T15:13:24.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:24 smithi072 bash[28946]: audit 2024-03-30T15:13:23.046222+0000 mon.a (mon.0) 1425 : audit 1 from='client.? 172.21.15.72:0/3416764051' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64321-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:24.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:24 smithi072 bash[28946]: cluster 2024-03-30T15:13:23.212007+0000 osd.7 (osd.7) 11 : cluster 0 161.1 scrub starts 2024-03-30T15:13:24.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:24 smithi072 bash[28946]: cluster 2024-03-30T15:13:23.219309+0000 osd.7 (osd.7) 12 : cluster 0 161.1 scrub ok 2024-03-30T15:13:24.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:24 smithi072 bash[28946]: cluster 2024-03-30T15:13:23.245841+0000 osd.0 (osd.0) 11 : cluster 0 161.5 scrub starts 2024-03-30T15:13:24.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:24 smithi072 bash[28946]: cluster 2024-03-30T15:13:23.253351+0000 osd.0 (osd.0) 12 : cluster 0 161.5 scrub ok 2024-03-30T15:13:24.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:24 smithi072 bash[28946]: audit 2024-03-30T15:13:23.885724+0000 mon.a (mon.0) 1426 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:24.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:24 smithi172 bash[23680]: audit 2024-03-30T15:13:22.885016+0000 mgr.y (mgr.14526) 236 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "161.0"}]: dispatch 2024-03-30T15:13:24.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:24 smithi172 bash[23680]: audit 2024-03-30T15:13:22.886786+0000 mgr.y (mgr.14526) 237 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "161.1"}]: dispatch 2024-03-30T15:13:24.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:24 smithi172 bash[23680]: audit 2024-03-30T15:13:22.888190+0000 mgr.y (mgr.14526) 238 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "161.2"}]: dispatch 2024-03-30T15:13:24.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:24 smithi172 bash[23680]: audit 2024-03-30T15:13:22.889825+0000 mgr.y (mgr.14526) 239 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "161.3"}]: dispatch 2024-03-30T15:13:24.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:24 smithi172 bash[23680]: audit 2024-03-30T15:13:22.891219+0000 mgr.y (mgr.14526) 240 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "161.4"}]: dispatch 2024-03-30T15:13:24.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:24 smithi172 bash[23680]: audit 2024-03-30T15:13:22.892388+0000 mgr.y (mgr.14526) 241 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "161.5"}]: dispatch 2024-03-30T15:13:24.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:24 smithi172 bash[23680]: audit 2024-03-30T15:13:22.893262+0000 mgr.y (mgr.14526) 242 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "161.6"}]: dispatch 2024-03-30T15:13:24.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:24 smithi172 bash[23680]: audit 2024-03-30T15:13:22.894238+0000 mgr.y (mgr.14526) 243 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "161.7"}]: dispatch 2024-03-30T15:13:24.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:24 smithi172 bash[23680]: audit 2024-03-30T15:13:22.895187+0000 mgr.y (mgr.14526) 244 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "161.8"}]: dispatch 2024-03-30T15:13:24.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:24 smithi172 bash[23680]: audit 2024-03-30T15:13:22.896037+0000 mgr.y (mgr.14526) 245 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "161.9"}]: dispatch 2024-03-30T15:13:24.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:24 smithi172 bash[23680]: cluster 2024-03-30T15:13:23.011417+0000 osd.5 (osd.5) 3 : cluster 0 161.3 scrub starts 2024-03-30T15:13:24.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:24 smithi172 bash[23680]: audit 2024-03-30T15:13:23.012258+0000 mon.a (mon.0) 1423 : audit 1 from='client.? 172.21.15.72:0/2893341023' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi072-64171-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:24.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:24 smithi172 bash[23680]: cluster 2024-03-30T15:13:23.017544+0000 osd.5 (osd.5) 4 : cluster 0 161.3 scrub ok 2024-03-30T15:13:24.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:24 smithi172 bash[23680]: cluster 2024-03-30T15:13:23.021114+0000 mon.a (mon.0) 1424 : cluster 0 osdmap e145: 8 total, 8 up, 8 in 2024-03-30T15:13:24.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:24 smithi172 bash[23680]: audit 2024-03-30T15:13:23.046222+0000 mon.a (mon.0) 1425 : audit 1 from='client.? 172.21.15.72:0/3416764051' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64321-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:24.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:24 smithi172 bash[23680]: cluster 2024-03-30T15:13:23.212007+0000 osd.7 (osd.7) 11 : cluster 0 161.1 scrub starts 2024-03-30T15:13:24.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:24 smithi172 bash[23680]: cluster 2024-03-30T15:13:23.219309+0000 osd.7 (osd.7) 12 : cluster 0 161.1 scrub ok 2024-03-30T15:13:24.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:24 smithi172 bash[23680]: cluster 2024-03-30T15:13:23.245841+0000 osd.0 (osd.0) 11 : cluster 0 161.5 scrub starts 2024-03-30T15:13:24.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:24 smithi172 bash[23680]: cluster 2024-03-30T15:13:23.253351+0000 osd.0 (osd.0) 12 : cluster 0 161.5 scrub ok 2024-03-30T15:13:24.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:24 smithi172 bash[23680]: audit 2024-03-30T15:13:23.885724+0000 mon.a (mon.0) 1426 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:25.053 INFO:tasks.workunit.client.0.smithi072.stdout: io: Running main() from gmock_main.cc 2024-03-30T15:13:25.053 INFO:tasks.workunit.client.0.smithi072.stdout: io: [==========] Running 14 tests from 1 test suite. 2024-03-30T15:13:25.053 INFO:tasks.workunit.client.0.smithi072.stdout: io: [----------] Global test environment set-up. 2024-03-30T15:13:25.053 INFO:tasks.workunit.client.0.smithi072.stdout: io: [----------] 14 tests from NeoRadosIo 2024-03-30T15:13:25.053 INFO:tasks.workunit.client.0.smithi072.stdout: io: [ RUN ] NeoRadosIo.Limits 2024-03-30T15:13:25.053 INFO:tasks.workunit.client.0.smithi072.stdout: io: [ OK ] NeoRadosIo.Limits (18800 ms) 2024-03-30T15:13:25.053 INFO:tasks.workunit.client.0.smithi072.stdout: io: [ RUN ] NeoRadosIo.SimpleWrite 2024-03-30T15:13:25.053 INFO:tasks.workunit.client.0.smithi072.stdout: io: [ OK ] NeoRadosIo.SimpleWrite (11983 ms) 2024-03-30T15:13:25.053 INFO:tasks.workunit.client.0.smithi072.stdout: io: [ RUN ] NeoRadosIo.ReadOp 2024-03-30T15:13:25.053 INFO:tasks.workunit.client.0.smithi072.stdout: io: [ OK ] NeoRadosIo.ReadOp (6777 ms) 2024-03-30T15:13:25.054 INFO:tasks.workunit.client.0.smithi072.stdout: io: [ RUN ] NeoRadosIo.SparseRead 2024-03-30T15:13:25.054 INFO:tasks.workunit.client.0.smithi072.stdout: io: [ OK ] NeoRadosIo.SparseRead (3925 ms) 2024-03-30T15:13:25.054 INFO:tasks.workunit.client.0.smithi072.stdout: io: [ RUN ] NeoRadosIo.RoundTrip 2024-03-30T15:13:25.054 INFO:tasks.workunit.client.0.smithi072.stdout: io: [ OK ] NeoRadosIo.RoundTrip (11592 ms) 2024-03-30T15:13:25.054 INFO:tasks.workunit.client.0.smithi072.stdout: io: [ RUN ] NeoRadosIo.ReadIntoBuufferlist 2024-03-30T15:13:25.054 INFO:tasks.workunit.client.0.smithi072.stdout: io: [ OK ] NeoRadosIo.ReadIntoBuufferlist (6620 ms) 2024-03-30T15:13:25.054 INFO:tasks.workunit.client.0.smithi072.stdout: io: [ RUN ] NeoRadosIo.OverlappingWriteRoundTrip 2024-03-30T15:13:25.054 INFO:tasks.workunit.client.0.smithi072.stdout: io: [ OK ] NeoRadosIo.OverlappingWriteRoundTrip (5164 ms) 2024-03-30T15:13:25.054 INFO:tasks.workunit.client.0.smithi072.stdout: io: [ RUN ] NeoRadosIo.WriteFullRoundTrip 2024-03-30T15:13:25.054 INFO:tasks.workunit.client.0.smithi072.stdout: io: [ OK ] NeoRadosIo.WriteFullRoundTrip (4665 ms) 2024-03-30T15:13:25.054 INFO:tasks.workunit.client.0.smithi072.stdout: io: [ RUN ] NeoRadosIo.AppendRoundTrip 2024-03-30T15:13:25.054 INFO:tasks.workunit.client.0.smithi072.stdout: io: [ OK ] NeoRadosIo.AppendRoundTrip (5671 ms) 2024-03-30T15:13:25.054 INFO:tasks.workunit.client.0.smithi072.stdout: io: [ RUN ] NeoRadosIo.Trunc 2024-03-30T15:13:25.054 INFO:tasks.workunit.client.0.smithi072.stdout: io: [ OK ] NeoRadosIo.Trunc (3875 ms) 2024-03-30T15:13:25.055 INFO:tasks.workunit.client.0.smithi072.stdout: io: [ RUN ] NeoRadosIo.Remove 2024-03-30T15:13:25.055 INFO:tasks.workunit.client.0.smithi072.stdout: io: [ OK ] NeoRadosIo.Remove (3347 ms) 2024-03-30T15:13:25.055 INFO:tasks.workunit.client.0.smithi072.stdout: io: [ RUN ] NeoRadosIo.XattrsRoundTrip 2024-03-30T15:13:25.055 INFO:tasks.workunit.client.0.smithi072.stdout: io: [ OK ] NeoRadosIo.XattrsRoundTrip (2971 ms) 2024-03-30T15:13:25.055 INFO:tasks.workunit.client.0.smithi072.stdout: io: [ RUN ] NeoRadosIo.RmXattr 2024-03-30T15:13:25.055 INFO:tasks.workunit.client.0.smithi072.stdout: io: [ OK ] NeoRadosIo.RmXattr (3879 ms) 2024-03-30T15:13:25.055 INFO:tasks.workunit.client.0.smithi072.stdout: io: [ RUN ] NeoRadosIo.GetXattrs 2024-03-30T15:13:25.055 INFO:tasks.workunit.client.0.smithi072.stdout: io: [ OK ] NeoRadosIo.GetXattrs (3529 ms) 2024-03-30T15:13:25.055 INFO:tasks.workunit.client.0.smithi072.stdout: io: [----------] 14 tests from NeoRadosIo (92798 ms total) 2024-03-30T15:13:25.055 INFO:tasks.workunit.client.0.smithi072.stdout: io: 2024-03-30T15:13:25.055 INFO:tasks.workunit.client.0.smithi072.stdout: io: [----------] Global test environment tear-down 2024-03-30T15:13:25.055 INFO:tasks.workunit.client.0.smithi072.stdout: io: [==========] 14 tests from 1 test suite ran. (92798 ms total) 2024-03-30T15:13:25.055 INFO:tasks.workunit.client.0.smithi072.stdout: io: [ PASSED ] 14 tests. 2024-03-30T15:13:25.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:25 smithi072 bash[21573]: cluster 2024-03-30T15:13:23.309066+0000 osd.1 (osd.1) 3 : cluster 0 161.2 scrub starts 2024-03-30T15:13:25.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:25 smithi072 bash[21573]: cluster 2024-03-30T15:13:23.318579+0000 osd.1 (osd.1) 4 : cluster 0 161.2 scrub ok 2024-03-30T15:13:25.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:25 smithi072 bash[21573]: cluster 2024-03-30T15:13:23.332556+0000 osd.3 (osd.3) 15 : cluster 0 161.7 scrub starts 2024-03-30T15:13:25.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:25 smithi072 bash[21573]: cluster 2024-03-30T15:13:23.340604+0000 osd.3 (osd.3) 16 : cluster 0 161.7 scrub ok 2024-03-30T15:13:25.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:25 smithi072 bash[21573]: cluster 2024-03-30T15:13:23.622733+0000 osd.2 (osd.2) 3 : cluster 0 161.6 scrub starts 2024-03-30T15:13:25.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:25 smithi072 bash[21573]: cluster 2024-03-30T15:13:23.627765+0000 osd.2 (osd.2) 4 : cluster 0 161.6 scrub ok 2024-03-30T15:13:25.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:25 smithi072 bash[21573]: cluster 2024-03-30T15:13:23.778533+0000 osd.4 (osd.4) 7 : cluster 0 161.9 scrub starts 2024-03-30T15:13:25.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:25 smithi072 bash[21573]: cluster 2024-03-30T15:13:23.783367+0000 osd.4 (osd.4) 8 : cluster 0 161.9 scrub ok 2024-03-30T15:13:25.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:25 smithi072 bash[21573]: cluster 2024-03-30T15:13:23.910745+0000 mgr.y (mgr.14526) 246 : cluster 0 pgmap v222: 436 pgs: 112 unknown, 324 active+clean; 593 KiB data, 464 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 52 KiB/s wr, 53 op/s 2024-03-30T15:13:25.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:25 smithi072 bash[21573]: cluster 2024-03-30T15:13:23.976654+0000 osd.5 (osd.5) 5 : cluster 0 161.0 scrub starts 2024-03-30T15:13:25.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:25 smithi072 bash[21573]: cluster 2024-03-30T15:13:23.984710+0000 osd.5 (osd.5) 6 : cluster 0 161.0 scrub ok 2024-03-30T15:13:25.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:25 smithi072 bash[21573]: audit 2024-03-30T15:13:24.017316+0000 mon.a (mon.0) 1427 : audit 1 from='client.? 172.21.15.72:0/3416764051' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64321-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:25.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:25 smithi072 bash[21573]: cluster 2024-03-30T15:13:24.029745+0000 mon.a (mon.0) 1428 : cluster 0 osdmap e146: 8 total, 8 up, 8 in 2024-03-30T15:13:25.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:25 smithi072 bash[21573]: audit 2024-03-30T15:13:24.032537+0000 mon.c (mon.2) 236 : audit 1 from='client.? 172.21.15.72:0/4193366694' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi072-64163-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:25.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:25 smithi072 bash[21573]: audit 2024-03-30T15:13:24.038996+0000 mon.a (mon.0) 1429 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi072-64163-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:25.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:25 smithi072 bash[21573]: audit 2024-03-30T15:13:24.040592+0000 mon.a (mon.0) 1430 : audit 1 from='client.? 172.21.15.72:0/3416764051' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64321-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:25.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:25 smithi072 bash[21573]: audit 2024-03-30T15:13:24.959341+0000 mon.a (mon.0) 1431 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:25.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:25 smithi072 bash[21573]: audit 2024-03-30T15:13:25.022414+0000 mon.a (mon.0) 1432 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi072-64163-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:25.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:25 smithi072 bash[21573]: audit 2024-03-30T15:13:25.022638+0000 mon.a (mon.0) 1433 : audit 1 from='client.? 172.21.15.72:0/3416764051' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64321-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:25.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:25 smithi072 bash[21573]: cluster 2024-03-30T15:13:25.032882+0000 mon.a (mon.0) 1434 : cluster 0 osdmap e147: 8 total, 8 up, 8 in 2024-03-30T15:13:25.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:25 smithi072 bash[21573]: audit 2024-03-30T15:13:25.051573+0000 mon.c (mon.2) 237 : audit 1 from='client.? 172.21.15.72:0/1892742158' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi072-64171-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:25.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:25 smithi072 bash[21573]: audit 2024-03-30T15:13:25.053891+0000 mon.a (mon.0) 1435 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi072-64171-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:25.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:25 smithi072 bash[28946]: cluster 2024-03-30T15:13:23.309066+0000 osd.1 (osd.1) 3 : cluster 0 161.2 scrub starts 2024-03-30T15:13:25.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:25 smithi072 bash[28946]: cluster 2024-03-30T15:13:23.318579+0000 osd.1 (osd.1) 4 : cluster 0 161.2 scrub ok 2024-03-30T15:13:25.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:25 smithi072 bash[28946]: cluster 2024-03-30T15:13:23.332556+0000 osd.3 (osd.3) 15 : cluster 0 161.7 scrub starts 2024-03-30T15:13:25.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:25 smithi072 bash[28946]: cluster 2024-03-30T15:13:23.340604+0000 osd.3 (osd.3) 16 : cluster 0 161.7 scrub ok 2024-03-30T15:13:25.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:25 smithi072 bash[28946]: cluster 2024-03-30T15:13:23.622733+0000 osd.2 (osd.2) 3 : cluster 0 161.6 scrub starts 2024-03-30T15:13:25.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:25 smithi072 bash[28946]: cluster 2024-03-30T15:13:23.627765+0000 osd.2 (osd.2) 4 : cluster 0 161.6 scrub ok 2024-03-30T15:13:25.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:25 smithi072 bash[28946]: cluster 2024-03-30T15:13:23.778533+0000 osd.4 (osd.4) 7 : cluster 0 161.9 scrub starts 2024-03-30T15:13:25.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:25 smithi072 bash[28946]: cluster 2024-03-30T15:13:23.783367+0000 osd.4 (osd.4) 8 : cluster 0 161.9 scrub ok 2024-03-30T15:13:25.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:25 smithi072 bash[28946]: cluster 2024-03-30T15:13:23.910745+0000 mgr.y (mgr.14526) 246 : cluster 0 pgmap v222: 436 pgs: 112 unknown, 324 active+clean; 593 KiB data, 464 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 52 KiB/s wr, 53 op/s 2024-03-30T15:13:25.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:25 smithi072 bash[28946]: cluster 2024-03-30T15:13:23.976654+0000 osd.5 (osd.5) 5 : cluster 0 161.0 scrub starts 2024-03-30T15:13:25.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:25 smithi072 bash[28946]: cluster 2024-03-30T15:13:23.984710+0000 osd.5 (osd.5) 6 : cluster 0 161.0 scrub ok 2024-03-30T15:13:25.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:25 smithi072 bash[28946]: audit 2024-03-30T15:13:24.017316+0000 mon.a (mon.0) 1427 : audit 1 from='client.? 172.21.15.72:0/3416764051' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64321-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:25.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:25 smithi072 bash[28946]: cluster 2024-03-30T15:13:24.029745+0000 mon.a (mon.0) 1428 : cluster 0 osdmap e146: 8 total, 8 up, 8 in 2024-03-30T15:13:25.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:25 smithi072 bash[28946]: audit 2024-03-30T15:13:24.032537+0000 mon.c (mon.2) 236 : audit 1 from='client.? 172.21.15.72:0/4193366694' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi072-64163-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:25.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:25 smithi072 bash[28946]: audit 2024-03-30T15:13:24.038996+0000 mon.a (mon.0) 1429 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi072-64163-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:25.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:25 smithi072 bash[28946]: audit 2024-03-30T15:13:24.040592+0000 mon.a (mon.0) 1430 : audit 1 from='client.? 172.21.15.72:0/3416764051' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64321-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:25.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:25 smithi072 bash[28946]: audit 2024-03-30T15:13:24.959341+0000 mon.a (mon.0) 1431 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:25.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:25 smithi072 bash[28946]: audit 2024-03-30T15:13:25.022414+0000 mon.a (mon.0) 1432 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi072-64163-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:25.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:25 smithi072 bash[28946]: audit 2024-03-30T15:13:25.022638+0000 mon.a (mon.0) 1433 : audit 1 from='client.? 172.21.15.72:0/3416764051' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64321-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:25.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:25 smithi072 bash[28946]: cluster 2024-03-30T15:13:25.032882+0000 mon.a (mon.0) 1434 : cluster 0 osdmap e147: 8 total, 8 up, 8 in 2024-03-30T15:13:25.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:25 smithi072 bash[28946]: audit 2024-03-30T15:13:25.051573+0000 mon.c (mon.2) 237 : audit 1 from='client.? 172.21.15.72:0/1892742158' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi072-64171-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:25.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:25 smithi072 bash[28946]: audit 2024-03-30T15:13:25.053891+0000 mon.a (mon.0) 1435 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi072-64171-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:25.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:25 smithi172 bash[23680]: cluster 2024-03-30T15:13:23.309066+0000 osd.1 (osd.1) 3 : cluster 0 161.2 scrub starts 2024-03-30T15:13:25.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:25 smithi172 bash[23680]: cluster 2024-03-30T15:13:23.318579+0000 osd.1 (osd.1) 4 : cluster 0 161.2 scrub ok 2024-03-30T15:13:25.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:25 smithi172 bash[23680]: cluster 2024-03-30T15:13:23.332556+0000 osd.3 (osd.3) 15 : cluster 0 161.7 scrub starts 2024-03-30T15:13:25.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:25 smithi172 bash[23680]: cluster 2024-03-30T15:13:23.340604+0000 osd.3 (osd.3) 16 : cluster 0 161.7 scrub ok 2024-03-30T15:13:25.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:25 smithi172 bash[23680]: cluster 2024-03-30T15:13:23.622733+0000 osd.2 (osd.2) 3 : cluster 0 161.6 scrub starts 2024-03-30T15:13:25.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:25 smithi172 bash[23680]: cluster 2024-03-30T15:13:23.627765+0000 osd.2 (osd.2) 4 : cluster 0 161.6 scrub ok 2024-03-30T15:13:25.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:25 smithi172 bash[23680]: cluster 2024-03-30T15:13:23.778533+0000 osd.4 (osd.4) 7 : cluster 0 161.9 scrub starts 2024-03-30T15:13:25.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:25 smithi172 bash[23680]: cluster 2024-03-30T15:13:23.783367+0000 osd.4 (osd.4) 8 : cluster 0 161.9 scrub ok 2024-03-30T15:13:25.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:25 smithi172 bash[23680]: cluster 2024-03-30T15:13:23.910745+0000 mgr.y (mgr.14526) 246 : cluster 0 pgmap v222: 436 pgs: 112 unknown, 324 active+clean; 593 KiB data, 464 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 52 KiB/s wr, 53 op/s 2024-03-30T15:13:25.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:25 smithi172 bash[23680]: cluster 2024-03-30T15:13:23.976654+0000 osd.5 (osd.5) 5 : cluster 0 161.0 scrub starts 2024-03-30T15:13:25.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:25 smithi172 bash[23680]: cluster 2024-03-30T15:13:23.984710+0000 osd.5 (osd.5) 6 : cluster 0 161.0 scrub ok 2024-03-30T15:13:25.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:25 smithi172 bash[23680]: audit 2024-03-30T15:13:24.017316+0000 mon.a (mon.0) 1427 : audit 1 from='client.? 172.21.15.72:0/3416764051' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64321-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:25.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:25 smithi172 bash[23680]: cluster 2024-03-30T15:13:24.029745+0000 mon.a (mon.0) 1428 : cluster 0 osdmap e146: 8 total, 8 up, 8 in 2024-03-30T15:13:25.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:25 smithi172 bash[23680]: audit 2024-03-30T15:13:24.032537+0000 mon.c (mon.2) 236 : audit 1 from='client.? 172.21.15.72:0/4193366694' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi072-64163-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:25.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:25 smithi172 bash[23680]: audit 2024-03-30T15:13:24.038996+0000 mon.a (mon.0) 1429 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi072-64163-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:25.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:25 smithi172 bash[23680]: audit 2024-03-30T15:13:24.040592+0000 mon.a (mon.0) 1430 : audit 1 from='client.? 172.21.15.72:0/3416764051' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64321-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:25.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:25 smithi172 bash[23680]: audit 2024-03-30T15:13:24.959341+0000 mon.a (mon.0) 1431 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:25.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:25 smithi172 bash[23680]: audit 2024-03-30T15:13:25.022414+0000 mon.a (mon.0) 1432 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi072-64163-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:25.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:25 smithi172 bash[23680]: audit 2024-03-30T15:13:25.022638+0000 mon.a (mon.0) 1433 : audit 1 from='client.? 172.21.15.72:0/3416764051' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64321-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:25.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:25 smithi172 bash[23680]: cluster 2024-03-30T15:13:25.032882+0000 mon.a (mon.0) 1434 : cluster 0 osdmap e147: 8 total, 8 up, 8 in 2024-03-30T15:13:25.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:25 smithi172 bash[23680]: audit 2024-03-30T15:13:25.051573+0000 mon.c (mon.2) 237 : audit 1 from='client.? 172.21.15.72:0/1892742158' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi072-64171-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:25.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:25 smithi172 bash[23680]: audit 2024-03-30T15:13:25.053891+0000 mon.a (mon.0) 1435 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi072-64171-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:26.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:26 smithi072 bash[21573]: cluster 2024-03-30T15:13:24.340304+0000 osd.1 (osd.1) 5 : cluster 0 161.4 scrub starts 2024-03-30T15:13:26.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:26 smithi072 bash[21573]: cluster 2024-03-30T15:13:24.342469+0000 osd.1 (osd.1) 6 : cluster 0 161.4 scrub ok 2024-03-30T15:13:26.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:26 smithi072 bash[21573]: cluster 2024-03-30T15:13:25.607805+0000 mon.a (mon.0) 1436 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:13:26.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:26 smithi072 bash[21573]: audit 2024-03-30T15:13:25.614167+0000 mon.a (mon.0) 1437 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushPP_smithi072-64171-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:26.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:26 smithi072 bash[21573]: cluster 2024-03-30T15:13:25.623286+0000 mon.a (mon.0) 1438 : cluster 0 osdmap e148: 8 total, 8 up, 8 in 2024-03-30T15:13:26.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:26 smithi072 bash[28946]: cluster 2024-03-30T15:13:24.340304+0000 osd.1 (osd.1) 5 : cluster 0 161.4 scrub starts 2024-03-30T15:13:26.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:26 smithi072 bash[28946]: cluster 2024-03-30T15:13:24.342469+0000 osd.1 (osd.1) 6 : cluster 0 161.4 scrub ok 2024-03-30T15:13:26.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:26 smithi072 bash[28946]: cluster 2024-03-30T15:13:25.607805+0000 mon.a (mon.0) 1436 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:13:26.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:26 smithi072 bash[28946]: audit 2024-03-30T15:13:25.614167+0000 mon.a (mon.0) 1437 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushPP_smithi072-64171-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:26.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:26 smithi072 bash[28946]: cluster 2024-03-30T15:13:25.623286+0000 mon.a (mon.0) 1438 : cluster 0 osdmap e148: 8 total, 8 up, 8 in 2024-03-30T15:13:26.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:26 smithi172 bash[23680]: cluster 2024-03-30T15:13:24.340304+0000 osd.1 (osd.1) 5 : cluster 0 161.4 scrub starts 2024-03-30T15:13:26.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:26 smithi172 bash[23680]: cluster 2024-03-30T15:13:24.342469+0000 osd.1 (osd.1) 6 : cluster 0 161.4 scrub ok 2024-03-30T15:13:26.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:26 smithi172 bash[23680]: cluster 2024-03-30T15:13:25.607805+0000 mon.a (mon.0) 1436 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:13:26.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:26 smithi172 bash[23680]: audit 2024-03-30T15:13:25.614167+0000 mon.a (mon.0) 1437 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushPP_smithi072-64171-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:26.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:26 smithi172 bash[23680]: cluster 2024-03-30T15:13:25.623286+0000 mon.a (mon.0) 1438 : cluster 0 osdmap e148: 8 total, 8 up, 8 in 2024-03-30T15:13:27.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:27 smithi072 bash[28946]: cluster 2024-03-30T15:13:25.298010+0000 osd.1 (osd.1) 7 : cluster 0 161.8 scrub starts 2024-03-30T15:13:27.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:27 smithi072 bash[28946]: cluster 2024-03-30T15:13:25.301820+0000 osd.1 (osd.1) 8 : cluster 0 161.8 scrub ok 2024-03-30T15:13:27.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:27 smithi072 bash[28946]: cluster 2024-03-30T15:13:25.913191+0000 mgr.y (mgr.14526) 247 : cluster 0 pgmap v226: 372 pgs: 372 active+clean; 1.6 MiB data, 561 MiB used, 715 GiB / 715 GiB avail; 60 KiB/s rd, 78 op/s 2024-03-30T15:13:27.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:27 smithi072 bash[28946]: audit 2024-03-30T15:13:25.913897+0000 mon.c (mon.2) 238 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi072-64203-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2024-03-30T15:13:27.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:27 smithi072 bash[28946]: audit 2024-03-30T15:13:26.120188+0000 mon.a (mon.0) 1439 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:27.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:27 smithi072 bash[28946]: audit 2024-03-30T15:13:26.133464+0000 mon.a (mon.0) 1440 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi072-64203-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2024-03-30T15:13:27.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:27 smithi072 bash[28946]: audit 2024-03-30T15:13:26.619563+0000 mon.a (mon.0) 1441 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi072-64203-1", "var": "pgp_num_actual", "val": "31"}]': finished 2024-03-30T15:13:27.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:27 smithi072 bash[28946]: cluster 2024-03-30T15:13:26.626691+0000 mon.a (mon.0) 1442 : cluster 0 osdmap e149: 8 total, 8 up, 8 in 2024-03-30T15:13:27.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:27 smithi072 bash[28946]: audit 2024-03-30T15:13:26.633728+0000 mon.c (mon.2) 239 : audit 1 from='client.? 172.21.15.72:0/3311163667' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi072-64163-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:27.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:27 smithi072 bash[28946]: audit 2024-03-30T15:13:26.636454+0000 mon.a (mon.0) 1443 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi072-64163-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:27.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:27 smithi072 bash[28946]: audit 2024-03-30T15:13:26.638094+0000 mon.a (mon.0) 1444 : audit 1 from='client.? 172.21.15.72:0/3416764051' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi072-64321-24"}]: dispatch 2024-03-30T15:13:27.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:27 smithi072 bash[21573]: cluster 2024-03-30T15:13:25.298010+0000 osd.1 (osd.1) 7 : cluster 0 161.8 scrub starts 2024-03-30T15:13:27.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:27 smithi072 bash[21573]: cluster 2024-03-30T15:13:25.301820+0000 osd.1 (osd.1) 8 : cluster 0 161.8 scrub ok 2024-03-30T15:13:27.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:27 smithi072 bash[21573]: cluster 2024-03-30T15:13:25.913191+0000 mgr.y (mgr.14526) 247 : cluster 0 pgmap v226: 372 pgs: 372 active+clean; 1.6 MiB data, 561 MiB used, 715 GiB / 715 GiB avail; 60 KiB/s rd, 78 op/s 2024-03-30T15:13:27.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:27 smithi072 bash[21573]: audit 2024-03-30T15:13:25.913897+0000 mon.c (mon.2) 238 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi072-64203-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2024-03-30T15:13:27.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:27 smithi072 bash[21573]: audit 2024-03-30T15:13:26.120188+0000 mon.a (mon.0) 1439 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:27.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:27 smithi072 bash[21573]: audit 2024-03-30T15:13:26.133464+0000 mon.a (mon.0) 1440 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi072-64203-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2024-03-30T15:13:27.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:27 smithi072 bash[21573]: audit 2024-03-30T15:13:26.619563+0000 mon.a (mon.0) 1441 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi072-64203-1", "var": "pgp_num_actual", "val": "31"}]': finished 2024-03-30T15:13:27.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:27 smithi072 bash[21573]: cluster 2024-03-30T15:13:26.626691+0000 mon.a (mon.0) 1442 : cluster 0 osdmap e149: 8 total, 8 up, 8 in 2024-03-30T15:13:27.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:27 smithi072 bash[21573]: audit 2024-03-30T15:13:26.633728+0000 mon.c (mon.2) 239 : audit 1 from='client.? 172.21.15.72:0/3311163667' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi072-64163-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:27.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:27 smithi072 bash[21573]: audit 2024-03-30T15:13:26.636454+0000 mon.a (mon.0) 1443 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi072-64163-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:27.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:27 smithi072 bash[21573]: audit 2024-03-30T15:13:26.638094+0000 mon.a (mon.0) 1444 : audit 1 from='client.? 172.21.15.72:0/3416764051' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi072-64321-24"}]: dispatch 2024-03-30T15:13:27.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:27 smithi172 bash[23680]: cluster 2024-03-30T15:13:25.298010+0000 osd.1 (osd.1) 7 : cluster 0 161.8 scrub starts 2024-03-30T15:13:27.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:27 smithi172 bash[23680]: cluster 2024-03-30T15:13:25.301820+0000 osd.1 (osd.1) 8 : cluster 0 161.8 scrub ok 2024-03-30T15:13:27.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:27 smithi172 bash[23680]: cluster 2024-03-30T15:13:25.913191+0000 mgr.y (mgr.14526) 247 : cluster 0 pgmap v226: 372 pgs: 372 active+clean; 1.6 MiB data, 561 MiB used, 715 GiB / 715 GiB avail; 60 KiB/s rd, 78 op/s 2024-03-30T15:13:27.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:27 smithi172 bash[23680]: audit 2024-03-30T15:13:25.913897+0000 mon.c (mon.2) 238 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi072-64203-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2024-03-30T15:13:27.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:27 smithi172 bash[23680]: audit 2024-03-30T15:13:26.120188+0000 mon.a (mon.0) 1439 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:27.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:27 smithi172 bash[23680]: audit 2024-03-30T15:13:26.133464+0000 mon.a (mon.0) 1440 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi072-64203-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2024-03-30T15:13:27.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:27 smithi172 bash[23680]: audit 2024-03-30T15:13:26.619563+0000 mon.a (mon.0) 1441 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi072-64203-1", "var": "pgp_num_actual", "val": "31"}]': finished 2024-03-30T15:13:27.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:27 smithi172 bash[23680]: cluster 2024-03-30T15:13:26.626691+0000 mon.a (mon.0) 1442 : cluster 0 osdmap e149: 8 total, 8 up, 8 in 2024-03-30T15:13:27.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:27 smithi172 bash[23680]: audit 2024-03-30T15:13:26.633728+0000 mon.c (mon.2) 239 : audit 1 from='client.? 172.21.15.72:0/3311163667' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi072-64163-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:27.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:27 smithi172 bash[23680]: audit 2024-03-30T15:13:26.636454+0000 mon.a (mon.0) 1443 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi072-64163-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:27.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:27 smithi172 bash[23680]: audit 2024-03-30T15:13:26.638094+0000 mon.a (mon.0) 1444 : audit 1 from='client.? 172.21.15.72:0/3416764051' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi072-64321-24"}]: dispatch 2024-03-30T15:13:28.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:28 smithi072 bash[21573]: audit 2024-03-30T15:13:27.122397+0000 mon.a (mon.0) 1445 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:28.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:28 smithi072 bash[21573]: audit 2024-03-30T15:13:27.624015+0000 mon.a (mon.0) 1446 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Flush_smithi072-64163-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:28.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:28 smithi072 bash[21573]: audit 2024-03-30T15:13:27.624292+0000 mon.a (mon.0) 1447 : audit 1 from='client.? 172.21.15.72:0/3416764051' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi072-64321-24"}]': finished 2024-03-30T15:13:28.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:28 smithi072 bash[21573]: cluster 2024-03-30T15:13:27.633029+0000 mon.a (mon.0) 1448 : cluster 0 osdmap e150: 8 total, 8 up, 8 in 2024-03-30T15:13:28.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:28 smithi072 bash[21573]: audit 2024-03-30T15:13:27.636544+0000 mon.a (mon.0) 1449 : audit 1 from='client.? 172.21.15.72:0/3416764051' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi072-64321-24"}]: dispatch 2024-03-30T15:13:28.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:28 smithi072 bash[21573]: audit 2024-03-30T15:13:27.641896+0000 mon.c (mon.2) 240 : audit 1 from='client.? 172.21.15.72:0/3976995876' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi072-64171-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:28.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:28 smithi072 bash[21573]: audit 2024-03-30T15:13:27.642957+0000 mon.a (mon.0) 1450 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi072-64171-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:28.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:28 smithi072 bash[28946]: audit 2024-03-30T15:13:27.122397+0000 mon.a (mon.0) 1445 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:28.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:28 smithi072 bash[28946]: audit 2024-03-30T15:13:27.624015+0000 mon.a (mon.0) 1446 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Flush_smithi072-64163-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:28.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:28 smithi072 bash[28946]: audit 2024-03-30T15:13:27.624292+0000 mon.a (mon.0) 1447 : audit 1 from='client.? 172.21.15.72:0/3416764051' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi072-64321-24"}]': finished 2024-03-30T15:13:28.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:28 smithi072 bash[28946]: cluster 2024-03-30T15:13:27.633029+0000 mon.a (mon.0) 1448 : cluster 0 osdmap e150: 8 total, 8 up, 8 in 2024-03-30T15:13:28.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:28 smithi072 bash[28946]: audit 2024-03-30T15:13:27.636544+0000 mon.a (mon.0) 1449 : audit 1 from='client.? 172.21.15.72:0/3416764051' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi072-64321-24"}]: dispatch 2024-03-30T15:13:28.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:28 smithi072 bash[28946]: audit 2024-03-30T15:13:27.641896+0000 mon.c (mon.2) 240 : audit 1 from='client.? 172.21.15.72:0/3976995876' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi072-64171-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:28.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:28 smithi072 bash[28946]: audit 2024-03-30T15:13:27.642957+0000 mon.a (mon.0) 1450 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi072-64171-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:28.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:28 smithi172 bash[23680]: audit 2024-03-30T15:13:27.122397+0000 mon.a (mon.0) 1445 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:28.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:28 smithi172 bash[23680]: audit 2024-03-30T15:13:27.624015+0000 mon.a (mon.0) 1446 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Flush_smithi072-64163-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:28.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:28 smithi172 bash[23680]: audit 2024-03-30T15:13:27.624292+0000 mon.a (mon.0) 1447 : audit 1 from='client.? 172.21.15.72:0/3416764051' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi072-64321-24"}]': finished 2024-03-30T15:13:28.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:28 smithi172 bash[23680]: cluster 2024-03-30T15:13:27.633029+0000 mon.a (mon.0) 1448 : cluster 0 osdmap e150: 8 total, 8 up, 8 in 2024-03-30T15:13:28.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:28 smithi172 bash[23680]: audit 2024-03-30T15:13:27.636544+0000 mon.a (mon.0) 1449 : audit 1 from='client.? 172.21.15.72:0/3416764051' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi072-64321-24"}]: dispatch 2024-03-30T15:13:28.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:28 smithi172 bash[23680]: audit 2024-03-30T15:13:27.641896+0000 mon.c (mon.2) 240 : audit 1 from='client.? 172.21.15.72:0/3976995876' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi072-64171-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:28.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:28 smithi172 bash[23680]: audit 2024-03-30T15:13:27.642957+0000 mon.a (mon.0) 1450 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi072-64171-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:29.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:29 smithi072 bash[28946]: cluster 2024-03-30T15:13:27.914321+0000 mgr.y (mgr.14526) 248 : cluster 0 pgmap v229: 396 pgs: 64 unknown, 332 active+clean; 1.6 MiB data, 561 MiB used, 715 GiB / 715 GiB avail; 60 KiB/s rd, 267 KiB/s wr, 80 op/s 2024-03-30T15:13:29.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:29 smithi072 bash[28946]: audit 2024-03-30T15:13:28.124334+0000 mon.a (mon.0) 1451 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:29.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:29 smithi072 bash[28946]: audit 2024-03-30T15:13:28.132778+0000 mon.a (mon.0) 1452 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:29.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:29 smithi072 bash[28946]: audit 2024-03-30T15:13:28.134343+0000 mon.a (mon.0) 1453 : audit 1 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi072-64203-1","var":"pgp_num","val":"11"}]: dispatch 2024-03-30T15:13:29.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:29 smithi072 bash[28946]: audit 2024-03-30T15:13:28.637377+0000 mon.a (mon.0) 1454 : audit 1 from='client.? 172.21.15.72:0/3416764051' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi072-64321-24"}]': finished 2024-03-30T15:13:29.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:29 smithi072 bash[28946]: audit 2024-03-30T15:13:28.637515+0000 mon.a (mon.0) 1455 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi072-64171-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:29.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:29 smithi072 bash[28946]: audit 2024-03-30T15:13:28.637762+0000 mon.a (mon.0) 1456 : audit 1 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi072-64203-1","var":"pgp_num","val":"11"}]': finished 2024-03-30T15:13:29.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:29 smithi072 bash[28946]: cluster 2024-03-30T15:13:28.645666+0000 mon.a (mon.0) 1457 : cluster 0 osdmap e151: 8 total, 8 up, 8 in 2024-03-30T15:13:29.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:29 smithi072 bash[28946]: audit 2024-03-30T15:13:28.647899+0000 mon.a (mon.0) 1458 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:29.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:29 smithi072 bash[21573]: cluster 2024-03-30T15:13:27.914321+0000 mgr.y (mgr.14526) 248 : cluster 0 pgmap v229: 396 pgs: 64 unknown, 332 active+clean; 1.6 MiB data, 561 MiB used, 715 GiB / 715 GiB avail; 60 KiB/s rd, 267 KiB/s wr, 80 op/s 2024-03-30T15:13:29.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:29 smithi072 bash[21573]: audit 2024-03-30T15:13:28.124334+0000 mon.a (mon.0) 1451 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:29.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:29 smithi072 bash[21573]: audit 2024-03-30T15:13:28.132778+0000 mon.a (mon.0) 1452 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:29.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:29 smithi072 bash[21573]: audit 2024-03-30T15:13:28.134343+0000 mon.a (mon.0) 1453 : audit 1 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi072-64203-1","var":"pgp_num","val":"11"}]: dispatch 2024-03-30T15:13:29.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:29 smithi072 bash[21573]: audit 2024-03-30T15:13:28.637377+0000 mon.a (mon.0) 1454 : audit 1 from='client.? 172.21.15.72:0/3416764051' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi072-64321-24"}]': finished 2024-03-30T15:13:29.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:29 smithi072 bash[21573]: audit 2024-03-30T15:13:28.637515+0000 mon.a (mon.0) 1455 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi072-64171-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:29.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:29 smithi072 bash[21573]: audit 2024-03-30T15:13:28.637762+0000 mon.a (mon.0) 1456 : audit 1 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi072-64203-1","var":"pgp_num","val":"11"}]': finished 2024-03-30T15:13:29.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:29 smithi072 bash[21573]: cluster 2024-03-30T15:13:28.645666+0000 mon.a (mon.0) 1457 : cluster 0 osdmap e151: 8 total, 8 up, 8 in 2024-03-30T15:13:29.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:29 smithi072 bash[21573]: audit 2024-03-30T15:13:28.647899+0000 mon.a (mon.0) 1458 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:29.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:29 smithi172 bash[23680]: cluster 2024-03-30T15:13:27.914321+0000 mgr.y (mgr.14526) 248 : cluster 0 pgmap v229: 396 pgs: 64 unknown, 332 active+clean; 1.6 MiB data, 561 MiB used, 715 GiB / 715 GiB avail; 60 KiB/s rd, 267 KiB/s wr, 80 op/s 2024-03-30T15:13:29.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:29 smithi172 bash[23680]: audit 2024-03-30T15:13:28.124334+0000 mon.a (mon.0) 1451 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:29.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:29 smithi172 bash[23680]: audit 2024-03-30T15:13:28.132778+0000 mon.a (mon.0) 1452 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:29.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:29 smithi172 bash[23680]: audit 2024-03-30T15:13:28.134343+0000 mon.a (mon.0) 1453 : audit 1 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi072-64203-1","var":"pgp_num","val":"11"}]: dispatch 2024-03-30T15:13:29.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:29 smithi172 bash[23680]: audit 2024-03-30T15:13:28.637377+0000 mon.a (mon.0) 1454 : audit 1 from='client.? 172.21.15.72:0/3416764051' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi072-64321-24"}]': finished 2024-03-30T15:13:29.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:29 smithi172 bash[23680]: audit 2024-03-30T15:13:28.637515+0000 mon.a (mon.0) 1455 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi072-64171-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:29.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:29 smithi172 bash[23680]: audit 2024-03-30T15:13:28.637762+0000 mon.a (mon.0) 1456 : audit 1 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi072-64203-1","var":"pgp_num","val":"11"}]': finished 2024-03-30T15:13:29.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:29 smithi172 bash[23680]: cluster 2024-03-30T15:13:28.645666+0000 mon.a (mon.0) 1457 : cluster 0 osdmap e151: 8 total, 8 up, 8 in 2024-03-30T15:13:29.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:29 smithi172 bash[23680]: audit 2024-03-30T15:13:28.647899+0000 mon.a (mon.0) 1458 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:30.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:30 smithi072 bash[28946]: cluster 2024-03-30T15:13:29.649545+0000 mon.a (mon.0) 1459 : cluster 0 osdmap e152: 8 total, 8 up, 8 in 2024-03-30T15:13:30.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:30 smithi072 bash[28946]: audit 2024-03-30T15:13:29.652270+0000 mon.a (mon.0) 1460 : audit 1 from='client.? 172.21.15.72:0/1702399626' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi072-64163-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:30.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:30 smithi072 bash[28946]: audit 2024-03-30T15:13:29.653663+0000 mon.a (mon.0) 1461 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:30.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:30 smithi072 bash[28946]: audit 2024-03-30T15:13:29.654798+0000 mon.c (mon.2) 241 : audit 1 from='client.? 172.21.15.72:0/3449273314' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi072-64321-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:30.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:30 smithi072 bash[28946]: audit 2024-03-30T15:13:29.671653+0000 mon.a (mon.0) 1462 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi072-64321-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:30.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:30 smithi072 bash[28946]: cluster 2024-03-30T15:13:30.611177+0000 mon.a (mon.0) 1463 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:13:30.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:30 smithi072 bash[28946]: audit 2024-03-30T15:13:30.617359+0000 mon.a (mon.0) 1464 : audit 1 from='client.? 172.21.15.72:0/1702399626' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi072-64163-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:30.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:30 smithi072 bash[28946]: audit 2024-03-30T15:13:30.617518+0000 mon.a (mon.0) 1465 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi072-64321-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:30.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:30 smithi072 bash[28946]: cluster 2024-03-30T15:13:30.625400+0000 mon.a (mon.0) 1466 : cluster 0 osdmap e153: 8 total, 8 up, 8 in 2024-03-30T15:13:30.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:30 smithi072 bash[28946]: audit 2024-03-30T15:13:30.635709+0000 mon.a (mon.0) 1467 : audit 1 from='client.? 172.21.15.72:0/3759683074' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi072-64378-15"}]: dispatch 2024-03-30T15:13:30.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:30 smithi072 bash[21573]: cluster 2024-03-30T15:13:29.649545+0000 mon.a (mon.0) 1459 : cluster 0 osdmap e152: 8 total, 8 up, 8 in 2024-03-30T15:13:30.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:30 smithi072 bash[21573]: audit 2024-03-30T15:13:29.652270+0000 mon.a (mon.0) 1460 : audit 1 from='client.? 172.21.15.72:0/1702399626' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi072-64163-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:30.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:30 smithi072 bash[21573]: audit 2024-03-30T15:13:29.653663+0000 mon.a (mon.0) 1461 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:30.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:30 smithi072 bash[21573]: audit 2024-03-30T15:13:29.654798+0000 mon.c (mon.2) 241 : audit 1 from='client.? 172.21.15.72:0/3449273314' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi072-64321-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:30.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:30 smithi072 bash[21573]: audit 2024-03-30T15:13:29.671653+0000 mon.a (mon.0) 1462 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi072-64321-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:30.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:30 smithi072 bash[21573]: cluster 2024-03-30T15:13:30.611177+0000 mon.a (mon.0) 1463 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:13:30.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:30 smithi072 bash[21573]: audit 2024-03-30T15:13:30.617359+0000 mon.a (mon.0) 1464 : audit 1 from='client.? 172.21.15.72:0/1702399626' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi072-64163-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:30.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:30 smithi072 bash[21573]: audit 2024-03-30T15:13:30.617518+0000 mon.a (mon.0) 1465 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi072-64321-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:30.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:30 smithi072 bash[21573]: cluster 2024-03-30T15:13:30.625400+0000 mon.a (mon.0) 1466 : cluster 0 osdmap e153: 8 total, 8 up, 8 in 2024-03-30T15:13:30.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:30 smithi072 bash[21573]: audit 2024-03-30T15:13:30.635709+0000 mon.a (mon.0) 1467 : audit 1 from='client.? 172.21.15.72:0/3759683074' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi072-64378-15"}]: dispatch 2024-03-30T15:13:30.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:30 smithi172 bash[23680]: cluster 2024-03-30T15:13:29.649545+0000 mon.a (mon.0) 1459 : cluster 0 osdmap e152: 8 total, 8 up, 8 in 2024-03-30T15:13:30.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:30 smithi172 bash[23680]: audit 2024-03-30T15:13:29.652270+0000 mon.a (mon.0) 1460 : audit 1 from='client.? 172.21.15.72:0/1702399626' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi072-64163-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:30.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:30 smithi172 bash[23680]: audit 2024-03-30T15:13:29.653663+0000 mon.a (mon.0) 1461 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:30.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:30 smithi172 bash[23680]: audit 2024-03-30T15:13:29.654798+0000 mon.c (mon.2) 241 : audit 1 from='client.? 172.21.15.72:0/3449273314' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi072-64321-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:30.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:30 smithi172 bash[23680]: audit 2024-03-30T15:13:29.671653+0000 mon.a (mon.0) 1462 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi072-64321-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:30.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:30 smithi172 bash[23680]: cluster 2024-03-30T15:13:30.611177+0000 mon.a (mon.0) 1463 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:13:30.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:30 smithi172 bash[23680]: audit 2024-03-30T15:13:30.617359+0000 mon.a (mon.0) 1464 : audit 1 from='client.? 172.21.15.72:0/1702399626' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi072-64163-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:30.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:30 smithi172 bash[23680]: audit 2024-03-30T15:13:30.617518+0000 mon.a (mon.0) 1465 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi072-64321-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:30.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:30 smithi172 bash[23680]: cluster 2024-03-30T15:13:30.625400+0000 mon.a (mon.0) 1466 : cluster 0 osdmap e153: 8 total, 8 up, 8 in 2024-03-30T15:13:30.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:30 smithi172 bash[23680]: audit 2024-03-30T15:13:30.635709+0000 mon.a (mon.0) 1467 : audit 1 from='client.? 172.21.15.72:0/3759683074' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi072-64378-15"}]: dispatch 2024-03-30T15:13:31.417 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:13:31 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:13:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:13:31.465 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:13:31 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:13:31.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:31 smithi172 bash[23680]: cluster 2024-03-30T15:13:29.915181+0000 mgr.y (mgr.14526) 249 : cluster 0 pgmap v232: 364 pgs: 64 unknown, 300 active+clean; 594 KiB data, 561 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:13:31.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:31 smithi172 bash[23680]: audit 2024-03-30T15:13:30.651072+0000 mon.a (mon.0) 1468 : audit 1 from='client.? 172.21.15.72:0/3189822033' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi072-64171-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:31.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:31 smithi172 bash[23680]: audit 2024-03-30T15:13:30.659083+0000 mon.a (mon.0) 1469 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:31.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:31 smithi172 bash[23680]: audit 2024-03-30T15:13:31.620998+0000 mon.a (mon.0) 1470 : audit 1 from='client.? 172.21.15.72:0/3759683074' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi072-64378-15"}]': finished 2024-03-30T15:13:31.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:31 smithi172 bash[23680]: audit 2024-03-30T15:13:31.621205+0000 mon.a (mon.0) 1471 : audit 1 from='client.? 172.21.15.72:0/3189822033' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi072-64171-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:31.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:31 smithi172 bash[23680]: cluster 2024-03-30T15:13:31.631272+0000 mon.a (mon.0) 1472 : cluster 0 osdmap e154: 8 total, 8 up, 8 in 2024-03-30T15:13:31.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:31 smithi172 bash[23680]: audit 2024-03-30T15:13:31.642470+0000 mon.a (mon.0) 1473 : audit 1 from='client.? 172.21.15.72:0/3759683074' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi072-64378-15"}]: dispatch 2024-03-30T15:13:31.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:31 smithi172 bash[23680]: audit 2024-03-30T15:13:31.663533+0000 mon.a (mon.0) 1474 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:32.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:31 smithi072 bash[28946]: cluster 2024-03-30T15:13:29.915181+0000 mgr.y (mgr.14526) 249 : cluster 0 pgmap v232: 364 pgs: 64 unknown, 300 active+clean; 594 KiB data, 561 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:13:32.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:31 smithi072 bash[28946]: audit 2024-03-30T15:13:30.651072+0000 mon.a (mon.0) 1468 : audit 1 from='client.? 172.21.15.72:0/3189822033' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi072-64171-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:32.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:31 smithi072 bash[28946]: audit 2024-03-30T15:13:30.659083+0000 mon.a (mon.0) 1469 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:32.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:31 smithi072 bash[28946]: audit 2024-03-30T15:13:31.620998+0000 mon.a (mon.0) 1470 : audit 1 from='client.? 172.21.15.72:0/3759683074' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi072-64378-15"}]': finished 2024-03-30T15:13:32.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:31 smithi072 bash[28946]: audit 2024-03-30T15:13:31.621205+0000 mon.a (mon.0) 1471 : audit 1 from='client.? 172.21.15.72:0/3189822033' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi072-64171-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:32.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:31 smithi072 bash[28946]: cluster 2024-03-30T15:13:31.631272+0000 mon.a (mon.0) 1472 : cluster 0 osdmap e154: 8 total, 8 up, 8 in 2024-03-30T15:13:32.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:31 smithi072 bash[28946]: audit 2024-03-30T15:13:31.642470+0000 mon.a (mon.0) 1473 : audit 1 from='client.? 172.21.15.72:0/3759683074' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi072-64378-15"}]: dispatch 2024-03-30T15:13:32.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:31 smithi072 bash[28946]: audit 2024-03-30T15:13:31.663533+0000 mon.a (mon.0) 1474 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:32.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:31 smithi072 bash[21573]: cluster 2024-03-30T15:13:29.915181+0000 mgr.y (mgr.14526) 249 : cluster 0 pgmap v232: 364 pgs: 64 unknown, 300 active+clean; 594 KiB data, 561 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:13:32.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:31 smithi072 bash[21573]: audit 2024-03-30T15:13:30.651072+0000 mon.a (mon.0) 1468 : audit 1 from='client.? 172.21.15.72:0/3189822033' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi072-64171-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:32.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:31 smithi072 bash[21573]: audit 2024-03-30T15:13:30.659083+0000 mon.a (mon.0) 1469 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:32.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:31 smithi072 bash[21573]: audit 2024-03-30T15:13:31.620998+0000 mon.a (mon.0) 1470 : audit 1 from='client.? 172.21.15.72:0/3759683074' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi072-64378-15"}]': finished 2024-03-30T15:13:32.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:31 smithi072 bash[21573]: audit 2024-03-30T15:13:31.621205+0000 mon.a (mon.0) 1471 : audit 1 from='client.? 172.21.15.72:0/3189822033' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi072-64171-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:32.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:31 smithi072 bash[21573]: cluster 2024-03-30T15:13:31.631272+0000 mon.a (mon.0) 1472 : cluster 0 osdmap e154: 8 total, 8 up, 8 in 2024-03-30T15:13:32.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:31 smithi072 bash[21573]: audit 2024-03-30T15:13:31.642470+0000 mon.a (mon.0) 1473 : audit 1 from='client.? 172.21.15.72:0/3759683074' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi072-64378-15"}]: dispatch 2024-03-30T15:13:32.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:31 smithi072 bash[21573]: audit 2024-03-30T15:13:31.663533+0000 mon.a (mon.0) 1474 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:32.636 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots: Running main() from gmock_main.cc 2024-03-30T15:13:32.636 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots: [==========] Running 13 tests from 4 test suites. 2024-03-30T15:13:32.636 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots: [----------] Global test environment set-up. 2024-03-30T15:13:32.636 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots 2024-03-30T15:13:32.636 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapList 2024-03-30T15:13:32.636 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapList (6095 ms) 2024-03-30T15:13:32.637 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapRemove 2024-03-30T15:13:32.637 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapRemove (7106 ms) 2024-03-30T15:13:32.637 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.Rollback 2024-03-30T15:13:32.637 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots: [ OK ] LibRadosSnapshots.Rollback (4917 ms) 2024-03-30T15:13:32.637 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapGetName 2024-03-30T15:13:32.637 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapGetName (3182 ms) 2024-03-30T15:13:32.638 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots (21300 ms total) 2024-03-30T15:13:32.638 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots: 2024-03-30T15:13:32.638 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged 2024-03-30T15:13:32.638 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Snap 2024-03-30T15:13:32.638 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Snap (10687 ms) 2024-03-30T15:13:32.638 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2024-03-30T15:13:32.639 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Rollback (6445 ms) 2024-03-30T15:13:32.639 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.FutureSnapRollback 2024-03-30T15:13:32.639 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.FutureSnapRollback (7744 ms) 2024-03-30T15:13:32.639 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged (24876 ms total) 2024-03-30T15:13:32.639 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots: 2024-03-30T15:13:32.639 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC 2024-03-30T15:13:32.640 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapList 2024-03-30T15:13:32.640 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapList (3372 ms) 2024-03-30T15:13:32.640 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapRemove 2024-03-30T15:13:32.640 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapRemove (1865 ms) 2024-03-30T15:13:32.640 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.Rollback 2024-03-30T15:13:32.640 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.Rollback (3357 ms) 2024-03-30T15:13:32.641 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapGetName 2024-03-30T15:13:32.641 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapGetName (1955 ms) 2024-03-30T15:13:32.641 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC (10549 ms total) 2024-03-30T15:13:32.641 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots: 2024-03-30T15:13:32.641 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2024-03-30T15:13:32.641 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2024-03-30T15:13:32.641 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Snap (3254 ms) 2024-03-30T15:13:32.642 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2024-03-30T15:13:32.642 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Rollback (4004 ms) 2024-03-30T15:13:32.642 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC (7258 ms total) 2024-03-30T15:13:32.642 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots: 2024-03-30T15:13:32.642 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots: [----------] Global test environment tear-down 2024-03-30T15:13:32.642 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots: [==========] 13 tests from 4 test suites ran. (100596 ms total) 2024-03-30T15:13:32.643 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots: [ PASSED ] 13 tests. 2024-03-30T15:13:32.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:32 smithi172 bash[23680]: audit 2024-03-30T15:13:31.032966+0000 mgr.y (mgr.14526) 250 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:13:32.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:32 smithi172 bash[23680]: audit 2024-03-30T15:13:31.916781+0000 mon.c (mon.2) 242 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi072-64203-1", "var": "pg_num_actual", "val": "31"}]: dispatch 2024-03-30T15:13:32.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:32 smithi172 bash[23680]: audit 2024-03-30T15:13:32.595952+0000 mon.a (mon.0) 1475 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi072-64203-1", "var": "pg_num_actual", "val": "31"}]: dispatch 2024-03-30T15:13:32.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:32 smithi172 bash[23680]: audit 2024-03-30T15:13:32.624834+0000 mon.a (mon.0) 1476 : audit 1 from='client.? 172.21.15.72:0/3759683074' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi072-64378-15"}]': finished 2024-03-30T15:13:32.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:32 smithi172 bash[23680]: audit 2024-03-30T15:13:32.625091+0000 mon.a (mon.0) 1477 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi072-64203-1", "var": "pg_num_actual", "val": "31"}]': finished 2024-03-30T15:13:32.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:32 smithi172 bash[23680]: cluster 2024-03-30T15:13:32.631296+0000 mon.a (mon.0) 1478 : cluster 0 osdmap e155: 8 total, 8 up, 8 in 2024-03-30T15:13:32.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:32 smithi172 bash[23680]: audit 2024-03-30T15:13:32.636231+0000 mon.a (mon.0) 1479 : audit 1 from='client.? 172.21.15.72:0/2746933263' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi072-64321-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:32.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:32 smithi172 bash[23680]: audit 2024-03-30T15:13:32.657676+0000 mon.c (mon.2) 243 : audit 1 from='client.? 172.21.15.72:0/60202070' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi072-64163-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:32.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:32 smithi172 bash[23680]: audit 2024-03-30T15:13:32.658733+0000 mon.a (mon.0) 1480 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi072-64163-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:32.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:32 smithi172 bash[23680]: audit 2024-03-30T15:13:32.665573+0000 mon.a (mon.0) 1481 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:33.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:32 smithi072 bash[21573]: audit 2024-03-30T15:13:31.032966+0000 mgr.y (mgr.14526) 250 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:13:33.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:32 smithi072 bash[21573]: audit 2024-03-30T15:13:31.916781+0000 mon.c (mon.2) 242 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi072-64203-1", "var": "pg_num_actual", "val": "31"}]: dispatch 2024-03-30T15:13:33.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:32 smithi072 bash[21573]: audit 2024-03-30T15:13:32.595952+0000 mon.a (mon.0) 1475 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi072-64203-1", "var": "pg_num_actual", "val": "31"}]: dispatch 2024-03-30T15:13:33.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:32 smithi072 bash[21573]: audit 2024-03-30T15:13:32.624834+0000 mon.a (mon.0) 1476 : audit 1 from='client.? 172.21.15.72:0/3759683074' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi072-64378-15"}]': finished 2024-03-30T15:13:33.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:32 smithi072 bash[21573]: audit 2024-03-30T15:13:32.625091+0000 mon.a (mon.0) 1477 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi072-64203-1", "var": "pg_num_actual", "val": "31"}]': finished 2024-03-30T15:13:33.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:32 smithi072 bash[21573]: cluster 2024-03-30T15:13:32.631296+0000 mon.a (mon.0) 1478 : cluster 0 osdmap e155: 8 total, 8 up, 8 in 2024-03-30T15:13:33.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:32 smithi072 bash[21573]: audit 2024-03-30T15:13:32.636231+0000 mon.a (mon.0) 1479 : audit 1 from='client.? 172.21.15.72:0/2746933263' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi072-64321-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:33.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:32 smithi072 bash[21573]: audit 2024-03-30T15:13:32.657676+0000 mon.c (mon.2) 243 : audit 1 from='client.? 172.21.15.72:0/60202070' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi072-64163-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:33.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:32 smithi072 bash[21573]: audit 2024-03-30T15:13:32.658733+0000 mon.a (mon.0) 1480 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi072-64163-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:33.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:32 smithi072 bash[21573]: audit 2024-03-30T15:13:32.665573+0000 mon.a (mon.0) 1481 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:33.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:32 smithi072 bash[28946]: audit 2024-03-30T15:13:31.032966+0000 mgr.y (mgr.14526) 250 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:13:33.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:32 smithi072 bash[28946]: audit 2024-03-30T15:13:31.916781+0000 mon.c (mon.2) 242 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi072-64203-1", "var": "pg_num_actual", "val": "31"}]: dispatch 2024-03-30T15:13:33.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:32 smithi072 bash[28946]: audit 2024-03-30T15:13:32.595952+0000 mon.a (mon.0) 1475 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi072-64203-1", "var": "pg_num_actual", "val": "31"}]: dispatch 2024-03-30T15:13:33.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:32 smithi072 bash[28946]: audit 2024-03-30T15:13:32.624834+0000 mon.a (mon.0) 1476 : audit 1 from='client.? 172.21.15.72:0/3759683074' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi072-64378-15"}]': finished 2024-03-30T15:13:33.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:32 smithi072 bash[28946]: audit 2024-03-30T15:13:32.625091+0000 mon.a (mon.0) 1477 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi072-64203-1", "var": "pg_num_actual", "val": "31"}]': finished 2024-03-30T15:13:33.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:32 smithi072 bash[28946]: cluster 2024-03-30T15:13:32.631296+0000 mon.a (mon.0) 1478 : cluster 0 osdmap e155: 8 total, 8 up, 8 in 2024-03-30T15:13:33.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:32 smithi072 bash[28946]: audit 2024-03-30T15:13:32.636231+0000 mon.a (mon.0) 1479 : audit 1 from='client.? 172.21.15.72:0/2746933263' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi072-64321-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:33.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:32 smithi072 bash[28946]: audit 2024-03-30T15:13:32.657676+0000 mon.c (mon.2) 243 : audit 1 from='client.? 172.21.15.72:0/60202070' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi072-64163-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:33.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:32 smithi072 bash[28946]: audit 2024-03-30T15:13:32.658733+0000 mon.a (mon.0) 1480 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi072-64163-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:33.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:32 smithi072 bash[28946]: audit 2024-03-30T15:13:32.665573+0000 mon.a (mon.0) 1481 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:34.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:34 smithi072 bash[21573]: cluster 2024-03-30T15:13:31.916072+0000 mgr.y (mgr.14526) 251 : cluster 0 pgmap v235: 356 pgs: 64 creating+peering, 292 active+clean; 594 KiB data, 597 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 op/s; 31 B/s, 0 objects/s recovering 2024-03-30T15:13:34.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:34 smithi072 bash[21573]: audit 2024-03-30T15:13:33.630335+0000 mon.a (mon.0) 1482 : audit 1 from='client.? 172.21.15.72:0/2746933263' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi072-64321-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:34.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:34 smithi072 bash[21573]: audit 2024-03-30T15:13:33.630533+0000 mon.a (mon.0) 1483 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi072-64163-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:34.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:34 smithi072 bash[21573]: cluster 2024-03-30T15:13:33.645489+0000 mon.a (mon.0) 1484 : cluster 0 osdmap e156: 8 total, 8 up, 8 in 2024-03-30T15:13:34.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:34 smithi072 bash[21573]: audit 2024-03-30T15:13:33.659792+0000 mon.c (mon.2) 244 : audit 1 from='client.? 172.21.15.72:0/3584950335' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64386-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:34.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:34 smithi072 bash[21573]: audit 2024-03-30T15:13:33.660580+0000 mon.c (mon.2) 245 : audit 1 from='client.? 172.21.15.72:0/3090608190' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi072-64171-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:34.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:34 smithi072 bash[21573]: audit 2024-03-30T15:13:33.661365+0000 mon.a (mon.0) 1485 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64386-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:34.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:34 smithi072 bash[21573]: audit 2024-03-30T15:13:33.663018+0000 mon.a (mon.0) 1486 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi072-64171-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:34.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:34 smithi072 bash[21573]: audit 2024-03-30T15:13:33.667710+0000 mon.a (mon.0) 1487 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:34.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:34 smithi072 bash[28946]: cluster 2024-03-30T15:13:31.916072+0000 mgr.y (mgr.14526) 251 : cluster 0 pgmap v235: 356 pgs: 64 creating+peering, 292 active+clean; 594 KiB data, 597 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 op/s; 31 B/s, 0 objects/s recovering 2024-03-30T15:13:34.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:34 smithi072 bash[28946]: audit 2024-03-30T15:13:33.630335+0000 mon.a (mon.0) 1482 : audit 1 from='client.? 172.21.15.72:0/2746933263' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi072-64321-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:34.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:34 smithi072 bash[28946]: audit 2024-03-30T15:13:33.630533+0000 mon.a (mon.0) 1483 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi072-64163-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:34.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:34 smithi072 bash[28946]: cluster 2024-03-30T15:13:33.645489+0000 mon.a (mon.0) 1484 : cluster 0 osdmap e156: 8 total, 8 up, 8 in 2024-03-30T15:13:34.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:34 smithi072 bash[28946]: audit 2024-03-30T15:13:33.659792+0000 mon.c (mon.2) 244 : audit 1 from='client.? 172.21.15.72:0/3584950335' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64386-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:34.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:34 smithi072 bash[28946]: audit 2024-03-30T15:13:33.660580+0000 mon.c (mon.2) 245 : audit 1 from='client.? 172.21.15.72:0/3090608190' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi072-64171-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:34.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:34 smithi072 bash[28946]: audit 2024-03-30T15:13:33.661365+0000 mon.a (mon.0) 1485 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64386-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:34.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:34 smithi072 bash[28946]: audit 2024-03-30T15:13:33.663018+0000 mon.a (mon.0) 1486 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi072-64171-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:34.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:34 smithi072 bash[28946]: audit 2024-03-30T15:13:33.667710+0000 mon.a (mon.0) 1487 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:34.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:34 smithi172 bash[23680]: cluster 2024-03-30T15:13:31.916072+0000 mgr.y (mgr.14526) 251 : cluster 0 pgmap v235: 356 pgs: 64 creating+peering, 292 active+clean; 594 KiB data, 597 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 op/s; 31 B/s, 0 objects/s recovering 2024-03-30T15:13:34.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:34 smithi172 bash[23680]: audit 2024-03-30T15:13:33.630335+0000 mon.a (mon.0) 1482 : audit 1 from='client.? 172.21.15.72:0/2746933263' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi072-64321-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:34.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:34 smithi172 bash[23680]: audit 2024-03-30T15:13:33.630533+0000 mon.a (mon.0) 1483 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi072-64163-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:34.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:34 smithi172 bash[23680]: cluster 2024-03-30T15:13:33.645489+0000 mon.a (mon.0) 1484 : cluster 0 osdmap e156: 8 total, 8 up, 8 in 2024-03-30T15:13:34.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:34 smithi172 bash[23680]: audit 2024-03-30T15:13:33.659792+0000 mon.c (mon.2) 244 : audit 1 from='client.? 172.21.15.72:0/3584950335' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64386-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:34.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:34 smithi172 bash[23680]: audit 2024-03-30T15:13:33.660580+0000 mon.c (mon.2) 245 : audit 1 from='client.? 172.21.15.72:0/3090608190' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi072-64171-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:34.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:34 smithi172 bash[23680]: audit 2024-03-30T15:13:33.661365+0000 mon.a (mon.0) 1485 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64386-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:34.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:34 smithi172 bash[23680]: audit 2024-03-30T15:13:33.663018+0000 mon.a (mon.0) 1486 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi072-64171-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:34.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:34 smithi172 bash[23680]: audit 2024-03-30T15:13:33.667710+0000 mon.a (mon.0) 1487 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:35.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:35 smithi172 bash[23680]: cluster 2024-03-30T15:13:33.917163+0000 mgr.y (mgr.14526) 252 : cluster 0 pgmap v238: 388 pgs: 128 unknown, 260 active+clean; 592 KiB data, 597 MiB used, 715 GiB / 715 GiB avail; 31 B/s, 0 objects/s recovering 2024-03-30T15:13:35.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:35 smithi172 bash[23680]: audit 2024-03-30T15:13:34.635229+0000 mon.a (mon.0) 1488 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64386-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:35.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:35 smithi172 bash[23680]: audit 2024-03-30T15:13:34.635516+0000 mon.a (mon.0) 1489 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi072-64171-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:35.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:35 smithi172 bash[23680]: cluster 2024-03-30T15:13:34.645108+0000 mon.a (mon.0) 1490 : cluster 0 osdmap e157: 8 total, 8 up, 8 in 2024-03-30T15:13:35.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:35 smithi172 bash[23680]: audit 2024-03-30T15:13:34.674005+0000 mon.a (mon.0) 1491 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:35.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:35 smithi172 bash[23680]: audit 2024-03-30T15:13:35.594509+0000 mon.a (mon.0) 1492 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:13:35.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:35 smithi172 bash[23680]: audit 2024-03-30T15:13:35.597625+0000 mon.c (mon.2) 246 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:13:35.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:35 smithi172 bash[23680]: cluster 2024-03-30T15:13:35.615966+0000 mon.a (mon.0) 1493 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:13:36.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:35 smithi072 bash[21573]: cluster 2024-03-30T15:13:33.917163+0000 mgr.y (mgr.14526) 252 : cluster 0 pgmap v238: 388 pgs: 128 unknown, 260 active+clean; 592 KiB data, 597 MiB used, 715 GiB / 715 GiB avail; 31 B/s, 0 objects/s recovering 2024-03-30T15:13:36.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:35 smithi072 bash[21573]: audit 2024-03-30T15:13:34.635229+0000 mon.a (mon.0) 1488 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64386-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:36.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:35 smithi072 bash[21573]: audit 2024-03-30T15:13:34.635516+0000 mon.a (mon.0) 1489 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi072-64171-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:36.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:35 smithi072 bash[21573]: cluster 2024-03-30T15:13:34.645108+0000 mon.a (mon.0) 1490 : cluster 0 osdmap e157: 8 total, 8 up, 8 in 2024-03-30T15:13:36.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:35 smithi072 bash[21573]: audit 2024-03-30T15:13:34.674005+0000 mon.a (mon.0) 1491 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:36.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:35 smithi072 bash[21573]: audit 2024-03-30T15:13:35.594509+0000 mon.a (mon.0) 1492 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:13:36.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:35 smithi072 bash[21573]: audit 2024-03-30T15:13:35.597625+0000 mon.c (mon.2) 246 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:13:36.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:35 smithi072 bash[21573]: cluster 2024-03-30T15:13:35.615966+0000 mon.a (mon.0) 1493 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:13:36.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:35 smithi072 bash[28946]: cluster 2024-03-30T15:13:33.917163+0000 mgr.y (mgr.14526) 252 : cluster 0 pgmap v238: 388 pgs: 128 unknown, 260 active+clean; 592 KiB data, 597 MiB used, 715 GiB / 715 GiB avail; 31 B/s, 0 objects/s recovering 2024-03-30T15:13:36.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:35 smithi072 bash[28946]: audit 2024-03-30T15:13:34.635229+0000 mon.a (mon.0) 1488 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64386-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:36.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:35 smithi072 bash[28946]: audit 2024-03-30T15:13:34.635516+0000 mon.a (mon.0) 1489 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi072-64171-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:36.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:35 smithi072 bash[28946]: cluster 2024-03-30T15:13:34.645108+0000 mon.a (mon.0) 1490 : cluster 0 osdmap e157: 8 total, 8 up, 8 in 2024-03-30T15:13:36.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:35 smithi072 bash[28946]: audit 2024-03-30T15:13:34.674005+0000 mon.a (mon.0) 1491 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:36.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:35 smithi072 bash[28946]: audit 2024-03-30T15:13:35.594509+0000 mon.a (mon.0) 1492 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:13:36.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:35 smithi072 bash[28946]: audit 2024-03-30T15:13:35.597625+0000 mon.c (mon.2) 246 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:13:36.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:35 smithi072 bash[28946]: cluster 2024-03-30T15:13:35.615966+0000 mon.a (mon.0) 1493 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:13:36.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:36 smithi172 bash[23680]: cluster 2024-03-30T15:13:35.647826+0000 mon.a (mon.0) 1494 : cluster 0 osdmap e158: 8 total, 8 up, 8 in 2024-03-30T15:13:36.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:36 smithi172 bash[23680]: audit 2024-03-30T15:13:35.658291+0000 mon.a (mon.0) 1495 : audit 1 from='client.? 172.21.15.72:0/3918187784' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi072-64163-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:36.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:36 smithi172 bash[23680]: audit 2024-03-30T15:13:35.676555+0000 mon.a (mon.0) 1496 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:36.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:36 smithi172 bash[23680]: audit 2024-03-30T15:13:35.687797+0000 mon.c (mon.2) 247 : audit 1 from='client.? 172.21.15.72:0/4240108424' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi072-64321-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:36.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:36 smithi172 bash[23680]: audit 2024-03-30T15:13:35.688554+0000 mon.a (mon.0) 1497 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi072-64321-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:36.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:36 smithi172 bash[23680]: audit 2024-03-30T15:13:36.645896+0000 mon.a (mon.0) 1498 : audit 1 from='client.? 172.21.15.72:0/3918187784' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi072-64163-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:36.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:36 smithi172 bash[23680]: audit 2024-03-30T15:13:36.646161+0000 mon.a (mon.0) 1499 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi072-64321-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:36.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:36 smithi172 bash[23680]: cluster 2024-03-30T15:13:36.657687+0000 mon.a (mon.0) 1500 : cluster 0 osdmap e159: 8 total, 8 up, 8 in 2024-03-30T15:13:37.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:36 smithi072 bash[21573]: cluster 2024-03-30T15:13:35.647826+0000 mon.a (mon.0) 1494 : cluster 0 osdmap e158: 8 total, 8 up, 8 in 2024-03-30T15:13:37.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:36 smithi072 bash[21573]: audit 2024-03-30T15:13:35.658291+0000 mon.a (mon.0) 1495 : audit 1 from='client.? 172.21.15.72:0/3918187784' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi072-64163-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:37.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:36 smithi072 bash[21573]: audit 2024-03-30T15:13:35.676555+0000 mon.a (mon.0) 1496 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:37.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:36 smithi072 bash[21573]: audit 2024-03-30T15:13:35.687797+0000 mon.c (mon.2) 247 : audit 1 from='client.? 172.21.15.72:0/4240108424' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi072-64321-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:37.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:36 smithi072 bash[21573]: audit 2024-03-30T15:13:35.688554+0000 mon.a (mon.0) 1497 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi072-64321-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:37.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:36 smithi072 bash[21573]: audit 2024-03-30T15:13:36.645896+0000 mon.a (mon.0) 1498 : audit 1 from='client.? 172.21.15.72:0/3918187784' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi072-64163-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:37.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:36 smithi072 bash[21573]: audit 2024-03-30T15:13:36.646161+0000 mon.a (mon.0) 1499 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi072-64321-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:37.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:36 smithi072 bash[21573]: cluster 2024-03-30T15:13:36.657687+0000 mon.a (mon.0) 1500 : cluster 0 osdmap e159: 8 total, 8 up, 8 in 2024-03-30T15:13:37.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:36 smithi072 bash[28946]: cluster 2024-03-30T15:13:35.647826+0000 mon.a (mon.0) 1494 : cluster 0 osdmap e158: 8 total, 8 up, 8 in 2024-03-30T15:13:37.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:36 smithi072 bash[28946]: audit 2024-03-30T15:13:35.658291+0000 mon.a (mon.0) 1495 : audit 1 from='client.? 172.21.15.72:0/3918187784' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi072-64163-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:37.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:36 smithi072 bash[28946]: audit 2024-03-30T15:13:35.676555+0000 mon.a (mon.0) 1496 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:37.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:36 smithi072 bash[28946]: audit 2024-03-30T15:13:35.687797+0000 mon.c (mon.2) 247 : audit 1 from='client.? 172.21.15.72:0/4240108424' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi072-64321-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:37.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:36 smithi072 bash[28946]: audit 2024-03-30T15:13:35.688554+0000 mon.a (mon.0) 1497 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi072-64321-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:37.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:36 smithi072 bash[28946]: audit 2024-03-30T15:13:36.645896+0000 mon.a (mon.0) 1498 : audit 1 from='client.? 172.21.15.72:0/3918187784' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi072-64163-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:37.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:36 smithi072 bash[28946]: audit 2024-03-30T15:13:36.646161+0000 mon.a (mon.0) 1499 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi072-64321-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:37.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:36 smithi072 bash[28946]: cluster 2024-03-30T15:13:36.657687+0000 mon.a (mon.0) 1500 : cluster 0 osdmap e159: 8 total, 8 up, 8 in 2024-03-30T15:13:37.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:37 smithi172 bash[23680]: cluster 2024-03-30T15:13:35.920101+0000 mgr.y (mgr.14526) 253 : cluster 0 pgmap v241: 387 pgs: 64 creating+peering, 323 active+clean; 592 KiB data, 602 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:13:37.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:37 smithi172 bash[23680]: audit 2024-03-30T15:13:36.674432+0000 mon.a (mon.0) 1501 : audit 1 from='client.? 172.21.15.72:0/3275902393' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi072-64171-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:37.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:37 smithi172 bash[23680]: audit 2024-03-30T15:13:36.682745+0000 mon.a (mon.0) 1502 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:37.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:37 smithi172 bash[23680]: audit 2024-03-30T15:13:37.650166+0000 mon.a (mon.0) 1503 : audit 1 from='client.? 172.21.15.72:0/3275902393' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi072-64171-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:37.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:37 smithi172 bash[23680]: cluster 2024-03-30T15:13:37.659625+0000 mon.a (mon.0) 1504 : cluster 0 osdmap e160: 8 total, 8 up, 8 in 2024-03-30T15:13:38.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:37 smithi072 bash[21573]: cluster 2024-03-30T15:13:35.920101+0000 mgr.y (mgr.14526) 253 : cluster 0 pgmap v241: 387 pgs: 64 creating+peering, 323 active+clean; 592 KiB data, 602 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:13:38.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:37 smithi072 bash[21573]: audit 2024-03-30T15:13:36.674432+0000 mon.a (mon.0) 1501 : audit 1 from='client.? 172.21.15.72:0/3275902393' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi072-64171-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:38.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:37 smithi072 bash[21573]: audit 2024-03-30T15:13:36.682745+0000 mon.a (mon.0) 1502 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:38.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:37 smithi072 bash[21573]: audit 2024-03-30T15:13:37.650166+0000 mon.a (mon.0) 1503 : audit 1 from='client.? 172.21.15.72:0/3275902393' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi072-64171-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:38.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:37 smithi072 bash[21573]: cluster 2024-03-30T15:13:37.659625+0000 mon.a (mon.0) 1504 : cluster 0 osdmap e160: 8 total, 8 up, 8 in 2024-03-30T15:13:38.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:37 smithi072 bash[28946]: cluster 2024-03-30T15:13:35.920101+0000 mgr.y (mgr.14526) 253 : cluster 0 pgmap v241: 387 pgs: 64 creating+peering, 323 active+clean; 592 KiB data, 602 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:13:38.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:37 smithi072 bash[28946]: audit 2024-03-30T15:13:36.674432+0000 mon.a (mon.0) 1501 : audit 1 from='client.? 172.21.15.72:0/3275902393' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi072-64171-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:38.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:37 smithi072 bash[28946]: audit 2024-03-30T15:13:36.682745+0000 mon.a (mon.0) 1502 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:38.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:37 smithi072 bash[28946]: audit 2024-03-30T15:13:37.650166+0000 mon.a (mon.0) 1503 : audit 1 from='client.? 172.21.15.72:0/3275902393' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi072-64171-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:38.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:37 smithi072 bash[28946]: cluster 2024-03-30T15:13:37.659625+0000 mon.a (mon.0) 1504 : cluster 0 osdmap e160: 8 total, 8 up, 8 in 2024-03-30T15:13:38.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:38 smithi172 bash[23680]: audit 2024-03-30T15:13:37.689602+0000 mon.a (mon.0) 1505 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:38.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:38 smithi172 bash[23680]: audit 2024-03-30T15:13:37.722784+0000 mon.c (mon.2) 248 : audit 1 from='client.? 172.21.15.72:0/3406091110' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi072-64321-36"}]: dispatch 2024-03-30T15:13:38.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:38 smithi172 bash[23680]: audit 2024-03-30T15:13:37.724218+0000 mon.a (mon.0) 1506 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi072-64321-36"}]: dispatch 2024-03-30T15:13:38.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:38 smithi172 bash[23680]: audit 2024-03-30T15:13:37.732712+0000 mon.c (mon.2) 249 : audit 1 from='client.? 172.21.15.72:0/3406091110' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi072-64321-36"}]: dispatch 2024-03-30T15:13:38.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:38 smithi172 bash[23680]: audit 2024-03-30T15:13:37.763139+0000 mon.b (mon.1) 48 : audit 1 from='client.? 172.21.15.72:0/1308200294' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi072-64386-16"}]: dispatch 2024-03-30T15:13:38.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:38 smithi172 bash[23680]: audit 2024-03-30T15:13:38.164925+0000 mon.a (mon.0) 1507 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi072-64321-36"}]: dispatch 2024-03-30T15:13:38.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:38 smithi172 bash[23680]: audit 2024-03-30T15:13:38.166101+0000 mon.c (mon.2) 250 : audit 1 from='client.? 172.21.15.72:0/3406091110' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi072-64321-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:13:38.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:38 smithi172 bash[23680]: audit 2024-03-30T15:13:38.169812+0000 mon.a (mon.0) 1508 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi072-64321-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:13:38.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:38 smithi172 bash[23680]: audit 2024-03-30T15:13:38.171087+0000 mon.a (mon.0) 1509 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi072-64386-16"}]: dispatch 2024-03-30T15:13:38.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:38 smithi172 bash[23680]: audit 2024-03-30T15:13:38.173240+0000 mon.a (mon.0) 1510 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi072-64386-16"}]: dispatch 2024-03-30T15:13:38.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:38 smithi172 bash[23680]: audit 2024-03-30T15:13:38.173955+0000 mon.b (mon.1) 49 : audit 1 from='client.? 172.21.15.72:0/1308200294' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi072-64386-16"}]: dispatch 2024-03-30T15:13:38.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:38 smithi172 bash[23680]: audit 2024-03-30T15:13:38.174987+0000 mon.a (mon.0) 1511 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi072-64386-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:13:38.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:38 smithi172 bash[23680]: audit 2024-03-30T15:13:38.175725+0000 mon.b (mon.1) 50 : audit 1 from='client.? 172.21.15.72:0/1308200294' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi072-64386-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:13:39.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:38 smithi072 bash[21573]: audit 2024-03-30T15:13:37.689602+0000 mon.a (mon.0) 1505 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:39.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:38 smithi072 bash[21573]: audit 2024-03-30T15:13:37.722784+0000 mon.c (mon.2) 248 : audit 1 from='client.? 172.21.15.72:0/3406091110' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi072-64321-36"}]: dispatch 2024-03-30T15:13:39.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:38 smithi072 bash[21573]: audit 2024-03-30T15:13:37.724218+0000 mon.a (mon.0) 1506 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi072-64321-36"}]: dispatch 2024-03-30T15:13:39.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:38 smithi072 bash[21573]: audit 2024-03-30T15:13:37.732712+0000 mon.c (mon.2) 249 : audit 1 from='client.? 172.21.15.72:0/3406091110' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi072-64321-36"}]: dispatch 2024-03-30T15:13:39.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:38 smithi072 bash[21573]: audit 2024-03-30T15:13:37.763139+0000 mon.b (mon.1) 48 : audit 1 from='client.? 172.21.15.72:0/1308200294' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi072-64386-16"}]: dispatch 2024-03-30T15:13:39.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:38 smithi072 bash[21573]: audit 2024-03-30T15:13:38.164925+0000 mon.a (mon.0) 1507 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi072-64321-36"}]: dispatch 2024-03-30T15:13:39.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:38 smithi072 bash[21573]: audit 2024-03-30T15:13:38.166101+0000 mon.c (mon.2) 250 : audit 1 from='client.? 172.21.15.72:0/3406091110' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi072-64321-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:13:39.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:38 smithi072 bash[21573]: audit 2024-03-30T15:13:38.169812+0000 mon.a (mon.0) 1508 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi072-64321-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:13:39.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:38 smithi072 bash[21573]: audit 2024-03-30T15:13:38.171087+0000 mon.a (mon.0) 1509 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi072-64386-16"}]: dispatch 2024-03-30T15:13:39.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:38 smithi072 bash[21573]: audit 2024-03-30T15:13:38.173240+0000 mon.a (mon.0) 1510 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi072-64386-16"}]: dispatch 2024-03-30T15:13:39.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:38 smithi072 bash[21573]: audit 2024-03-30T15:13:38.173955+0000 mon.b (mon.1) 49 : audit 1 from='client.? 172.21.15.72:0/1308200294' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi072-64386-16"}]: dispatch 2024-03-30T15:13:39.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:38 smithi072 bash[21573]: audit 2024-03-30T15:13:38.174987+0000 mon.a (mon.0) 1511 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi072-64386-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:13:39.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:38 smithi072 bash[21573]: audit 2024-03-30T15:13:38.175725+0000 mon.b (mon.1) 50 : audit 1 from='client.? 172.21.15.72:0/1308200294' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi072-64386-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:13:39.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:38 smithi072 bash[28946]: audit 2024-03-30T15:13:37.689602+0000 mon.a (mon.0) 1505 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:39.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:38 smithi072 bash[28946]: audit 2024-03-30T15:13:37.722784+0000 mon.c (mon.2) 248 : audit 1 from='client.? 172.21.15.72:0/3406091110' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi072-64321-36"}]: dispatch 2024-03-30T15:13:39.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:38 smithi072 bash[28946]: audit 2024-03-30T15:13:37.724218+0000 mon.a (mon.0) 1506 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi072-64321-36"}]: dispatch 2024-03-30T15:13:39.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:38 smithi072 bash[28946]: audit 2024-03-30T15:13:37.732712+0000 mon.c (mon.2) 249 : audit 1 from='client.? 172.21.15.72:0/3406091110' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi072-64321-36"}]: dispatch 2024-03-30T15:13:39.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:38 smithi072 bash[28946]: audit 2024-03-30T15:13:37.763139+0000 mon.b (mon.1) 48 : audit 1 from='client.? 172.21.15.72:0/1308200294' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi072-64386-16"}]: dispatch 2024-03-30T15:13:39.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:38 smithi072 bash[28946]: audit 2024-03-30T15:13:38.164925+0000 mon.a (mon.0) 1507 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi072-64321-36"}]: dispatch 2024-03-30T15:13:39.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:38 smithi072 bash[28946]: audit 2024-03-30T15:13:38.166101+0000 mon.c (mon.2) 250 : audit 1 from='client.? 172.21.15.72:0/3406091110' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi072-64321-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:13:39.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:38 smithi072 bash[28946]: audit 2024-03-30T15:13:38.169812+0000 mon.a (mon.0) 1508 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi072-64321-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:13:39.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:38 smithi072 bash[28946]: audit 2024-03-30T15:13:38.171087+0000 mon.a (mon.0) 1509 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi072-64386-16"}]: dispatch 2024-03-30T15:13:39.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:38 smithi072 bash[28946]: audit 2024-03-30T15:13:38.173240+0000 mon.a (mon.0) 1510 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi072-64386-16"}]: dispatch 2024-03-30T15:13:39.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:38 smithi072 bash[28946]: audit 2024-03-30T15:13:38.173955+0000 mon.b (mon.1) 49 : audit 1 from='client.? 172.21.15.72:0/1308200294' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi072-64386-16"}]: dispatch 2024-03-30T15:13:39.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:38 smithi072 bash[28946]: audit 2024-03-30T15:13:38.174987+0000 mon.a (mon.0) 1511 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi072-64386-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:13:39.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:38 smithi072 bash[28946]: audit 2024-03-30T15:13:38.175725+0000 mon.b (mon.1) 50 : audit 1 from='client.? 172.21.15.72:0/1308200294' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi072-64386-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:13:39.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:39 smithi172 bash[23680]: cluster 2024-03-30T15:13:37.920983+0000 mgr.y (mgr.14526) 254 : cluster 0 pgmap v244: 323 pgs: 32 unknown, 291 active+clean; 592 KiB data, 602 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:13:39.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:39 smithi172 bash[23680]: audit 2024-03-30T15:13:38.696645+0000 mon.a (mon.0) 1512 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:39.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:39 smithi172 bash[23680]: audit 2024-03-30T15:13:38.697947+0000 mon.a (mon.0) 1513 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi072-64321-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:13:39.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:39 smithi172 bash[23680]: audit 2024-03-30T15:13:38.698208+0000 mon.a (mon.0) 1514 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi072-64386-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:13:39.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:39 smithi172 bash[23680]: cluster 2024-03-30T15:13:38.706318+0000 mon.a (mon.0) 1515 : cluster 0 osdmap e161: 8 total, 8 up, 8 in 2024-03-30T15:13:39.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:39 smithi172 bash[23680]: audit 2024-03-30T15:13:38.708272+0000 mon.a (mon.0) 1516 : audit 1 from='client.? 172.21.15.72:0/1178705998' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi072-64163-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:39.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:39 smithi172 bash[23680]: audit 2024-03-30T15:13:38.709555+0000 mon.c (mon.2) 251 : audit 1 from='client.? 172.21.15.72:0/3406091110' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi072-64321-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi072-64321-36"}]: dispatch 2024-03-30T15:13:39.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:39 smithi172 bash[23680]: audit 2024-03-30T15:13:38.710483+0000 mon.a (mon.0) 1517 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi072-64321-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi072-64321-36"}]: dispatch 2024-03-30T15:13:39.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:39 smithi172 bash[23680]: audit 2024-03-30T15:13:38.711869+0000 mon.b (mon.1) 51 : audit 1 from='client.? 172.21.15.72:0/1308200294' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi072-64386-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi072-64386-16"}]: dispatch 2024-03-30T15:13:39.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:39 smithi172 bash[23680]: audit 2024-03-30T15:13:38.718833+0000 mon.a (mon.0) 1518 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi072-64386-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi072-64386-16"}]: dispatch 2024-03-30T15:13:40.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:39 smithi072 bash[28946]: cluster 2024-03-30T15:13:37.920983+0000 mgr.y (mgr.14526) 254 : cluster 0 pgmap v244: 323 pgs: 32 unknown, 291 active+clean; 592 KiB data, 602 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:13:40.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:39 smithi072 bash[28946]: audit 2024-03-30T15:13:38.696645+0000 mon.a (mon.0) 1512 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:40.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:39 smithi072 bash[28946]: audit 2024-03-30T15:13:38.697947+0000 mon.a (mon.0) 1513 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi072-64321-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:13:40.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:39 smithi072 bash[28946]: audit 2024-03-30T15:13:38.698208+0000 mon.a (mon.0) 1514 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi072-64386-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:13:40.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:39 smithi072 bash[28946]: cluster 2024-03-30T15:13:38.706318+0000 mon.a (mon.0) 1515 : cluster 0 osdmap e161: 8 total, 8 up, 8 in 2024-03-30T15:13:40.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:39 smithi072 bash[28946]: audit 2024-03-30T15:13:38.708272+0000 mon.a (mon.0) 1516 : audit 1 from='client.? 172.21.15.72:0/1178705998' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi072-64163-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:40.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:39 smithi072 bash[28946]: audit 2024-03-30T15:13:38.709555+0000 mon.c (mon.2) 251 : audit 1 from='client.? 172.21.15.72:0/3406091110' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi072-64321-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi072-64321-36"}]: dispatch 2024-03-30T15:13:40.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:39 smithi072 bash[28946]: audit 2024-03-30T15:13:38.710483+0000 mon.a (mon.0) 1517 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi072-64321-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi072-64321-36"}]: dispatch 2024-03-30T15:13:40.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:39 smithi072 bash[28946]: audit 2024-03-30T15:13:38.711869+0000 mon.b (mon.1) 51 : audit 1 from='client.? 172.21.15.72:0/1308200294' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi072-64386-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi072-64386-16"}]: dispatch 2024-03-30T15:13:40.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:39 smithi072 bash[28946]: audit 2024-03-30T15:13:38.718833+0000 mon.a (mon.0) 1518 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi072-64386-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi072-64386-16"}]: dispatch 2024-03-30T15:13:40.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:39 smithi072 bash[21573]: cluster 2024-03-30T15:13:37.920983+0000 mgr.y (mgr.14526) 254 : cluster 0 pgmap v244: 323 pgs: 32 unknown, 291 active+clean; 592 KiB data, 602 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:13:40.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:39 smithi072 bash[21573]: audit 2024-03-30T15:13:38.696645+0000 mon.a (mon.0) 1512 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:40.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:39 smithi072 bash[21573]: audit 2024-03-30T15:13:38.697947+0000 mon.a (mon.0) 1513 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi072-64321-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:13:40.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:39 smithi072 bash[21573]: audit 2024-03-30T15:13:38.698208+0000 mon.a (mon.0) 1514 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi072-64386-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:13:40.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:39 smithi072 bash[21573]: cluster 2024-03-30T15:13:38.706318+0000 mon.a (mon.0) 1515 : cluster 0 osdmap e161: 8 total, 8 up, 8 in 2024-03-30T15:13:40.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:39 smithi072 bash[21573]: audit 2024-03-30T15:13:38.708272+0000 mon.a (mon.0) 1516 : audit 1 from='client.? 172.21.15.72:0/1178705998' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi072-64163-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:40.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:39 smithi072 bash[21573]: audit 2024-03-30T15:13:38.709555+0000 mon.c (mon.2) 251 : audit 1 from='client.? 172.21.15.72:0/3406091110' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi072-64321-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi072-64321-36"}]: dispatch 2024-03-30T15:13:40.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:39 smithi072 bash[21573]: audit 2024-03-30T15:13:38.710483+0000 mon.a (mon.0) 1517 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi072-64321-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi072-64321-36"}]: dispatch 2024-03-30T15:13:40.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:39 smithi072 bash[21573]: audit 2024-03-30T15:13:38.711869+0000 mon.b (mon.1) 51 : audit 1 from='client.? 172.21.15.72:0/1308200294' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi072-64386-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi072-64386-16"}]: dispatch 2024-03-30T15:13:40.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:39 smithi072 bash[21573]: audit 2024-03-30T15:13:38.718833+0000 mon.a (mon.0) 1518 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi072-64386-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi072-64386-16"}]: dispatch 2024-03-30T15:13:40.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:40 smithi172 bash[23680]: audit 2024-03-30T15:13:39.701488+0000 mon.a (mon.0) 1519 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:40.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:40 smithi172 bash[23680]: audit 2024-03-30T15:13:39.702833+0000 mon.a (mon.0) 1520 : audit 1 from='client.? 172.21.15.72:0/1178705998' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi072-64163-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:40.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:40 smithi172 bash[23680]: cluster 2024-03-30T15:13:40.575964+0000 mon.a (mon.0) 1521 : cluster 0 osdmap e162: 8 total, 8 up, 8 in 2024-03-30T15:13:40.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:40 smithi172 bash[23680]: audit 2024-03-30T15:13:40.577404+0000 mon.c (mon.2) 252 : audit 1 from='client.? 172.21.15.72:0/380397236' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi072-64171-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:40.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:40 smithi172 bash[23680]: audit 2024-03-30T15:13:40.586185+0000 mon.a (mon.0) 1522 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi072-64171-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:40.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:40 smithi172 bash[23680]: cluster 2024-03-30T15:13:40.617335+0000 mon.a (mon.0) 1523 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:13:41.030 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:40 smithi072 bash[21573]: audit 2024-03-30T15:13:39.701488+0000 mon.a (mon.0) 1519 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:41.030 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:40 smithi072 bash[21573]: audit 2024-03-30T15:13:39.702833+0000 mon.a (mon.0) 1520 : audit 1 from='client.? 172.21.15.72:0/1178705998' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi072-64163-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:41.030 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:40 smithi072 bash[21573]: cluster 2024-03-30T15:13:40.575964+0000 mon.a (mon.0) 1521 : cluster 0 osdmap e162: 8 total, 8 up, 8 in 2024-03-30T15:13:41.030 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:40 smithi072 bash[21573]: audit 2024-03-30T15:13:40.577404+0000 mon.c (mon.2) 252 : audit 1 from='client.? 172.21.15.72:0/380397236' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi072-64171-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:41.030 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:40 smithi072 bash[21573]: audit 2024-03-30T15:13:40.586185+0000 mon.a (mon.0) 1522 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi072-64171-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:41.030 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:40 smithi072 bash[21573]: cluster 2024-03-30T15:13:40.617335+0000 mon.a (mon.0) 1523 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:13:41.030 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:40 smithi072 bash[28946]: audit 2024-03-30T15:13:39.701488+0000 mon.a (mon.0) 1519 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:41.031 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:40 smithi072 bash[28946]: audit 2024-03-30T15:13:39.702833+0000 mon.a (mon.0) 1520 : audit 1 from='client.? 172.21.15.72:0/1178705998' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi072-64163-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:41.031 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:40 smithi072 bash[28946]: cluster 2024-03-30T15:13:40.575964+0000 mon.a (mon.0) 1521 : cluster 0 osdmap e162: 8 total, 8 up, 8 in 2024-03-30T15:13:41.031 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:40 smithi072 bash[28946]: audit 2024-03-30T15:13:40.577404+0000 mon.c (mon.2) 252 : audit 1 from='client.? 172.21.15.72:0/380397236' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi072-64171-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:41.031 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:40 smithi072 bash[28946]: audit 2024-03-30T15:13:40.586185+0000 mon.a (mon.0) 1522 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi072-64171-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:41.031 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:40 smithi072 bash[28946]: cluster 2024-03-30T15:13:40.617335+0000 mon.a (mon.0) 1523 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:13:41.417 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:13:41 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:13:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:13:41.465 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:13:41 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:13:41.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:41 smithi172 bash[23680]: cluster 2024-03-30T15:13:39.921911+0000 mgr.y (mgr.14526) 255 : cluster 0 pgmap v247: 355 pgs: 64 unknown, 291 active+clean; 592 KiB data, 602 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:13:41.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:41 smithi172 bash[23680]: audit 2024-03-30T15:13:40.704960+0000 mon.a (mon.0) 1524 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:41.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:41 smithi172 bash[23680]: audit 2024-03-30T15:13:40.712677+0000 mon.a (mon.0) 1525 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi072-64321-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi072-64321-36"}]': finished 2024-03-30T15:13:41.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:41 smithi172 bash[23680]: audit 2024-03-30T15:13:40.712908+0000 mon.a (mon.0) 1526 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi072-64386-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi072-64386-16"}]': finished 2024-03-30T15:13:41.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:41 smithi172 bash[23680]: audit 2024-03-30T15:13:40.713144+0000 mon.a (mon.0) 1527 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi072-64171-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:41.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:41 smithi172 bash[23680]: cluster 2024-03-30T15:13:40.721115+0000 mon.a (mon.0) 1528 : cluster 0 osdmap e163: 8 total, 8 up, 8 in 2024-03-30T15:13:42.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:41 smithi072 bash[21573]: cluster 2024-03-30T15:13:39.921911+0000 mgr.y (mgr.14526) 255 : cluster 0 pgmap v247: 355 pgs: 64 unknown, 291 active+clean; 592 KiB data, 602 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:13:42.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:41 smithi072 bash[21573]: audit 2024-03-30T15:13:40.704960+0000 mon.a (mon.0) 1524 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:42.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:41 smithi072 bash[21573]: audit 2024-03-30T15:13:40.712677+0000 mon.a (mon.0) 1525 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi072-64321-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi072-64321-36"}]': finished 2024-03-30T15:13:42.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:41 smithi072 bash[21573]: audit 2024-03-30T15:13:40.712908+0000 mon.a (mon.0) 1526 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi072-64386-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi072-64386-16"}]': finished 2024-03-30T15:13:42.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:41 smithi072 bash[21573]: audit 2024-03-30T15:13:40.713144+0000 mon.a (mon.0) 1527 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi072-64171-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:42.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:41 smithi072 bash[21573]: cluster 2024-03-30T15:13:40.721115+0000 mon.a (mon.0) 1528 : cluster 0 osdmap e163: 8 total, 8 up, 8 in 2024-03-30T15:13:42.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:41 smithi072 bash[28946]: cluster 2024-03-30T15:13:39.921911+0000 mgr.y (mgr.14526) 255 : cluster 0 pgmap v247: 355 pgs: 64 unknown, 291 active+clean; 592 KiB data, 602 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:13:42.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:41 smithi072 bash[28946]: audit 2024-03-30T15:13:40.704960+0000 mon.a (mon.0) 1524 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:42.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:41 smithi072 bash[28946]: audit 2024-03-30T15:13:40.712677+0000 mon.a (mon.0) 1525 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi072-64321-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi072-64321-36"}]': finished 2024-03-30T15:13:42.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:41 smithi072 bash[28946]: audit 2024-03-30T15:13:40.712908+0000 mon.a (mon.0) 1526 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi072-64386-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi072-64386-16"}]': finished 2024-03-30T15:13:42.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:41 smithi072 bash[28946]: audit 2024-03-30T15:13:40.713144+0000 mon.a (mon.0) 1527 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi072-64171-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:42.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:41 smithi072 bash[28946]: cluster 2024-03-30T15:13:40.721115+0000 mon.a (mon.0) 1528 : cluster 0 osdmap e163: 8 total, 8 up, 8 in 2024-03-30T15:13:42.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:42 smithi172 bash[23680]: audit 2024-03-30T15:13:41.040763+0000 mgr.y (mgr.14526) 256 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:13:42.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:42 smithi172 bash[23680]: audit 2024-03-30T15:13:41.706585+0000 mon.a (mon.0) 1529 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:42.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:42 smithi172 bash[23680]: cluster 2024-03-30T15:13:41.724996+0000 mon.a (mon.0) 1530 : cluster 0 osdmap e164: 8 total, 8 up, 8 in 2024-03-30T15:13:42.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:42 smithi172 bash[23680]: audit 2024-03-30T15:13:41.734437+0000 mon.a (mon.0) 1531 : audit 1 from='client.? 172.21.15.72:0/3285802507' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi072-64163-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:43.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:42 smithi072 bash[21573]: audit 2024-03-30T15:13:41.040763+0000 mgr.y (mgr.14526) 256 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:13:43.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:42 smithi072 bash[21573]: audit 2024-03-30T15:13:41.706585+0000 mon.a (mon.0) 1529 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:43.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:42 smithi072 bash[21573]: cluster 2024-03-30T15:13:41.724996+0000 mon.a (mon.0) 1530 : cluster 0 osdmap e164: 8 total, 8 up, 8 in 2024-03-30T15:13:43.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:42 smithi072 bash[21573]: audit 2024-03-30T15:13:41.734437+0000 mon.a (mon.0) 1531 : audit 1 from='client.? 172.21.15.72:0/3285802507' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi072-64163-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:43.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:42 smithi072 bash[28946]: audit 2024-03-30T15:13:41.040763+0000 mgr.y (mgr.14526) 256 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:13:43.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:42 smithi072 bash[28946]: audit 2024-03-30T15:13:41.706585+0000 mon.a (mon.0) 1529 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:43.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:42 smithi072 bash[28946]: cluster 2024-03-30T15:13:41.724996+0000 mon.a (mon.0) 1530 : cluster 0 osdmap e164: 8 total, 8 up, 8 in 2024-03-30T15:13:43.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:42 smithi072 bash[28946]: audit 2024-03-30T15:13:41.734437+0000 mon.a (mon.0) 1531 : audit 1 from='client.? 172.21.15.72:0/3285802507' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi072-64163-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:43.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:43 smithi172 bash[23680]: cluster 2024-03-30T15:13:41.922773+0000 mgr.y (mgr.14526) 257 : cluster 0 pgmap v250: 339 pgs: 16 creating+peering, 32 unknown, 291 active+clean; 592 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:13:43.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:43 smithi172 bash[23680]: audit 2024-03-30T15:13:42.708338+0000 mon.a (mon.0) 1532 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:43.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:43 smithi172 bash[23680]: audit 2024-03-30T15:13:42.721276+0000 mon.a (mon.0) 1533 : audit 1 from='client.? 172.21.15.72:0/3285802507' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi072-64163-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:43.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:43 smithi172 bash[23680]: cluster 2024-03-30T15:13:42.734047+0000 mon.a (mon.0) 1534 : cluster 0 osdmap e165: 8 total, 8 up, 8 in 2024-03-30T15:13:43.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:43 smithi172 bash[23680]: audit 2024-03-30T15:13:42.749170+0000 mon.c (mon.2) 253 : audit 1 from='client.? 172.21.15.72:0/3406091110' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi072-64321-36"}]: dispatch 2024-03-30T15:13:43.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:43 smithi172 bash[23680]: audit 2024-03-30T15:13:42.753199+0000 mon.a (mon.0) 1535 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi072-64321-36"}]: dispatch 2024-03-30T15:13:43.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:43 smithi172 bash[23680]: audit 2024-03-30T15:13:42.753897+0000 mon.a (mon.0) 1536 : audit 1 from='client.? 172.21.15.72:0/2339446757' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi072-64171-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:44.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:43 smithi072 bash[21573]: cluster 2024-03-30T15:13:41.922773+0000 mgr.y (mgr.14526) 257 : cluster 0 pgmap v250: 339 pgs: 16 creating+peering, 32 unknown, 291 active+clean; 592 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:13:44.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:43 smithi072 bash[21573]: audit 2024-03-30T15:13:42.708338+0000 mon.a (mon.0) 1532 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:44.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:43 smithi072 bash[21573]: audit 2024-03-30T15:13:42.721276+0000 mon.a (mon.0) 1533 : audit 1 from='client.? 172.21.15.72:0/3285802507' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi072-64163-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:44.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:43 smithi072 bash[21573]: cluster 2024-03-30T15:13:42.734047+0000 mon.a (mon.0) 1534 : cluster 0 osdmap e165: 8 total, 8 up, 8 in 2024-03-30T15:13:44.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:43 smithi072 bash[21573]: audit 2024-03-30T15:13:42.749170+0000 mon.c (mon.2) 253 : audit 1 from='client.? 172.21.15.72:0/3406091110' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi072-64321-36"}]: dispatch 2024-03-30T15:13:44.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:43 smithi072 bash[21573]: audit 2024-03-30T15:13:42.753199+0000 mon.a (mon.0) 1535 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi072-64321-36"}]: dispatch 2024-03-30T15:13:44.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:43 smithi072 bash[21573]: audit 2024-03-30T15:13:42.753897+0000 mon.a (mon.0) 1536 : audit 1 from='client.? 172.21.15.72:0/2339446757' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi072-64171-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:44.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:43 smithi072 bash[28946]: cluster 2024-03-30T15:13:41.922773+0000 mgr.y (mgr.14526) 257 : cluster 0 pgmap v250: 339 pgs: 16 creating+peering, 32 unknown, 291 active+clean; 592 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:13:44.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:43 smithi072 bash[28946]: audit 2024-03-30T15:13:42.708338+0000 mon.a (mon.0) 1532 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:44.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:43 smithi072 bash[28946]: audit 2024-03-30T15:13:42.721276+0000 mon.a (mon.0) 1533 : audit 1 from='client.? 172.21.15.72:0/3285802507' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi072-64163-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:44.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:43 smithi072 bash[28946]: cluster 2024-03-30T15:13:42.734047+0000 mon.a (mon.0) 1534 : cluster 0 osdmap e165: 8 total, 8 up, 8 in 2024-03-30T15:13:44.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:43 smithi072 bash[28946]: audit 2024-03-30T15:13:42.749170+0000 mon.c (mon.2) 253 : audit 1 from='client.? 172.21.15.72:0/3406091110' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi072-64321-36"}]: dispatch 2024-03-30T15:13:44.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:43 smithi072 bash[28946]: audit 2024-03-30T15:13:42.753199+0000 mon.a (mon.0) 1535 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi072-64321-36"}]: dispatch 2024-03-30T15:13:44.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:43 smithi072 bash[28946]: audit 2024-03-30T15:13:42.753897+0000 mon.a (mon.0) 1536 : audit 1 from='client.? 172.21.15.72:0/2339446757' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi072-64171-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:44.753 INFO:tasks.workunit.client.0.smithi072.stdout:(69566 ms total) 2024-03-30T15:13:44.754 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: 2024-03-30T15:13:44.754 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP 2024-03-30T15:13:44.754 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2024-03-30T15:13:44.754 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ OK ] LibRadosTwoPoolsECPP.CopyFrom (142 ms) 2024-03-30T15:13:44.754 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP (142 ms total) 2024-03-30T15:13:44.754 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: 2024-03-30T15:13:44.754 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0, Checksummer::xxhash32, ceph_le > 2024-03-30T15:13:44.754 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Subset 2024-03-30T15:13:44.754 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Subset (69 ms) 2024-03-30T15:13:44.754 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Chunked 2024-03-30T15:13:44.754 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Chunked (1 ms) 2024-03-30T15:13:44.754 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0 (71 ms total) 2024-03-30T15:13:44.755 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: 2024-03-30T15:13:44.755 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1, Checksummer::xxhash64, ceph_le > 2024-03-30T15:13:44.755 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Subset 2024-03-30T15:13:44.755 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Subset (67 ms) 2024-03-30T15:13:44.755 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Chunked 2024-03-30T15:13:44.755 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Chunked (7 ms) 2024-03-30T15:13:44.755 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1 (74 ms total) 2024-03-30T15:13:44.755 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: 2024-03-30T15:13:44.755 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2, Checksummer::crc32c, ceph_le > 2024-03-30T15:13:44.755 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Subset 2024-03-30T15:13:44.755 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Subset (78 ms) 2024-03-30T15:13:44.755 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Chunked 2024-03-30T15:13:44.755 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Chunked (5 ms) 2024-03-30T15:13:44.755 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2 (83 ms total) 2024-03-30T15:13:44.756 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: 2024-03-30T15:13:44.756 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP 2024-03-30T15:13:44.756 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ RUN ] LibRadosMiscECPP.CompareExtentRange 2024-03-30T15:13:44.756 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ OK ] LibRadosMiscECPP.CompareExtentRange (1075 ms) 2024-03-30T15:13:44.756 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP (1075 ms total) 2024-03-30T15:13:44.756 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: 2024-03-30T15:13:44.756 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [----------] Global test environment tear-down 2024-03-30T15:13:44.756 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [==========] 31 tests from 7 test suites ran. (112729 ms total) 2024-03-30T15:13:44.756 INFO:tasks.workunit.client.0.smithi072.stdout: api_misc_pp: [ PASSED ] 31 tests. 2024-03-30T15:13:44.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:44 smithi172 bash[23680]: audit 2024-03-30T15:13:43.710234+0000 mon.a (mon.0) 1537 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:44.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:44 smithi172 bash[23680]: audit 2024-03-30T15:13:43.724814+0000 mon.a (mon.0) 1538 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi072-64321-36"}]': finished 2024-03-30T15:13:44.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:44 smithi172 bash[23680]: audit 2024-03-30T15:13:43.725121+0000 mon.a (mon.0) 1539 : audit 1 from='client.? 172.21.15.72:0/2339446757' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi072-64171-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:44.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:44 smithi172 bash[23680]: cluster 2024-03-30T15:13:43.734321+0000 mon.a (mon.0) 1540 : cluster 0 osdmap e166: 8 total, 8 up, 8 in 2024-03-30T15:13:44.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:44 smithi172 bash[23680]: audit 2024-03-30T15:13:43.739641+0000 mon.c (mon.2) 254 : audit 1 from='client.? 172.21.15.72:0/3406091110' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi072-64321-36"}]: dispatch 2024-03-30T15:13:44.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:44 smithi172 bash[23680]: audit 2024-03-30T15:13:43.753336+0000 mon.a (mon.0) 1541 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi072-64321-36"}]: dispatch 2024-03-30T15:13:44.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:44 smithi172 bash[23680]: cluster 2024-03-30T15:13:43.923668+0000 mgr.y (mgr.14526) 258 : cluster 0 pgmap v253: 331 pgs: 8 creating+peering, 32 unknown, 291 active+clean; 592 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:13:45.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:44 smithi072 bash[21573]: audit 2024-03-30T15:13:43.710234+0000 mon.a (mon.0) 1537 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:45.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:44 smithi072 bash[21573]: audit 2024-03-30T15:13:43.724814+0000 mon.a (mon.0) 1538 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi072-64321-36"}]': finished 2024-03-30T15:13:45.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:44 smithi072 bash[21573]: audit 2024-03-30T15:13:43.725121+0000 mon.a (mon.0) 1539 : audit 1 from='client.? 172.21.15.72:0/2339446757' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi072-64171-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:45.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:44 smithi072 bash[21573]: cluster 2024-03-30T15:13:43.734321+0000 mon.a (mon.0) 1540 : cluster 0 osdmap e166: 8 total, 8 up, 8 in 2024-03-30T15:13:45.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:44 smithi072 bash[21573]: audit 2024-03-30T15:13:43.739641+0000 mon.c (mon.2) 254 : audit 1 from='client.? 172.21.15.72:0/3406091110' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi072-64321-36"}]: dispatch 2024-03-30T15:13:45.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:44 smithi072 bash[21573]: audit 2024-03-30T15:13:43.753336+0000 mon.a (mon.0) 1541 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi072-64321-36"}]: dispatch 2024-03-30T15:13:45.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:44 smithi072 bash[21573]: cluster 2024-03-30T15:13:43.923668+0000 mgr.y (mgr.14526) 258 : cluster 0 pgmap v253: 331 pgs: 8 creating+peering, 32 unknown, 291 active+clean; 592 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:13:45.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:44 smithi072 bash[28946]: audit 2024-03-30T15:13:43.710234+0000 mon.a (mon.0) 1537 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:45.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:44 smithi072 bash[28946]: audit 2024-03-30T15:13:43.724814+0000 mon.a (mon.0) 1538 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi072-64321-36"}]': finished 2024-03-30T15:13:45.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:44 smithi072 bash[28946]: audit 2024-03-30T15:13:43.725121+0000 mon.a (mon.0) 1539 : audit 1 from='client.? 172.21.15.72:0/2339446757' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi072-64171-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:45.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:44 smithi072 bash[28946]: cluster 2024-03-30T15:13:43.734321+0000 mon.a (mon.0) 1540 : cluster 0 osdmap e166: 8 total, 8 up, 8 in 2024-03-30T15:13:45.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:44 smithi072 bash[28946]: audit 2024-03-30T15:13:43.739641+0000 mon.c (mon.2) 254 : audit 1 from='client.? 172.21.15.72:0/3406091110' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi072-64321-36"}]: dispatch 2024-03-30T15:13:45.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:44 smithi072 bash[28946]: audit 2024-03-30T15:13:43.753336+0000 mon.a (mon.0) 1541 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi072-64321-36"}]: dispatch 2024-03-30T15:13:45.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:44 smithi072 bash[28946]: cluster 2024-03-30T15:13:43.923668+0000 mgr.y (mgr.14526) 258 : cluster 0 pgmap v253: 331 pgs: 8 creating+peering, 32 unknown, 291 active+clean; 592 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:13:45.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:45 smithi172 bash[23680]: audit 2024-03-30T15:13:44.711776+0000 mon.a (mon.0) 1542 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:45.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:45 smithi172 bash[23680]: audit 2024-03-30T15:13:44.735560+0000 mon.a (mon.0) 1543 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi072-64321-36"}]': finished 2024-03-30T15:13:45.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:45 smithi172 bash[23680]: cluster 2024-03-30T15:13:44.743237+0000 mon.a (mon.0) 1544 : cluster 0 osdmap e167: 8 total, 8 up, 8 in 2024-03-30T15:13:45.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:45 smithi172 bash[23680]: audit 2024-03-30T15:13:44.748318+0000 mon.c (mon.2) 255 : audit 1 from='client.? 172.21.15.72:0/3940213924' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi072-64163-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:45.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:45 smithi172 bash[23680]: audit 2024-03-30T15:13:44.751700+0000 mon.a (mon.0) 1545 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi072-64163-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:45.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:45 smithi172 bash[23680]: cluster 2024-03-30T15:13:45.618817+0000 mon.a (mon.0) 1546 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:13:45.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:45 smithi172 bash[23680]: audit 2024-03-30T15:13:45.624276+0000 mon.a (mon.0) 1547 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi072-64163-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:45.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:45 smithi172 bash[23680]: cluster 2024-03-30T15:13:45.635700+0000 mon.a (mon.0) 1548 : cluster 0 osdmap e168: 8 total, 8 up, 8 in 2024-03-30T15:13:45.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:45 smithi172 bash[23680]: audit 2024-03-30T15:13:45.639253+0000 mon.c (mon.2) 256 : audit 1 from='client.? 172.21.15.72:0/3946850330' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi072-64171-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:45.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:45 smithi172 bash[23680]: audit 2024-03-30T15:13:45.643104+0000 mon.a (mon.0) 1549 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi072-64171-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:46.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:45 smithi072 bash[21573]: audit 2024-03-30T15:13:44.711776+0000 mon.a (mon.0) 1542 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:46.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:45 smithi072 bash[21573]: audit 2024-03-30T15:13:44.735560+0000 mon.a (mon.0) 1543 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi072-64321-36"}]': finished 2024-03-30T15:13:46.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:45 smithi072 bash[21573]: cluster 2024-03-30T15:13:44.743237+0000 mon.a (mon.0) 1544 : cluster 0 osdmap e167: 8 total, 8 up, 8 in 2024-03-30T15:13:46.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:45 smithi072 bash[21573]: audit 2024-03-30T15:13:44.748318+0000 mon.c (mon.2) 255 : audit 1 from='client.? 172.21.15.72:0/3940213924' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi072-64163-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:46.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:45 smithi072 bash[21573]: audit 2024-03-30T15:13:44.751700+0000 mon.a (mon.0) 1545 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi072-64163-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:46.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:45 smithi072 bash[21573]: cluster 2024-03-30T15:13:45.618817+0000 mon.a (mon.0) 1546 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:13:46.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:45 smithi072 bash[21573]: audit 2024-03-30T15:13:45.624276+0000 mon.a (mon.0) 1547 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi072-64163-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:46.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:45 smithi072 bash[21573]: cluster 2024-03-30T15:13:45.635700+0000 mon.a (mon.0) 1548 : cluster 0 osdmap e168: 8 total, 8 up, 8 in 2024-03-30T15:13:46.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:45 smithi072 bash[21573]: audit 2024-03-30T15:13:45.639253+0000 mon.c (mon.2) 256 : audit 1 from='client.? 172.21.15.72:0/3946850330' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi072-64171-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:46.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:45 smithi072 bash[21573]: audit 2024-03-30T15:13:45.643104+0000 mon.a (mon.0) 1549 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi072-64171-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:46.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:45 smithi072 bash[28946]: audit 2024-03-30T15:13:44.711776+0000 mon.a (mon.0) 1542 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:46.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:45 smithi072 bash[28946]: audit 2024-03-30T15:13:44.735560+0000 mon.a (mon.0) 1543 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi072-64321-36"}]': finished 2024-03-30T15:13:46.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:45 smithi072 bash[28946]: cluster 2024-03-30T15:13:44.743237+0000 mon.a (mon.0) 1544 : cluster 0 osdmap e167: 8 total, 8 up, 8 in 2024-03-30T15:13:46.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:45 smithi072 bash[28946]: audit 2024-03-30T15:13:44.748318+0000 mon.c (mon.2) 255 : audit 1 from='client.? 172.21.15.72:0/3940213924' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi072-64163-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:46.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:45 smithi072 bash[28946]: audit 2024-03-30T15:13:44.751700+0000 mon.a (mon.0) 1545 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi072-64163-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:46.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:45 smithi072 bash[28946]: cluster 2024-03-30T15:13:45.618817+0000 mon.a (mon.0) 1546 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:13:46.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:45 smithi072 bash[28946]: audit 2024-03-30T15:13:45.624276+0000 mon.a (mon.0) 1547 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi072-64163-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:46.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:45 smithi072 bash[28946]: cluster 2024-03-30T15:13:45.635700+0000 mon.a (mon.0) 1548 : cluster 0 osdmap e168: 8 total, 8 up, 8 in 2024-03-30T15:13:46.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:45 smithi072 bash[28946]: audit 2024-03-30T15:13:45.639253+0000 mon.c (mon.2) 256 : audit 1 from='client.? 172.21.15.72:0/3946850330' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi072-64171-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:46.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:45 smithi072 bash[28946]: audit 2024-03-30T15:13:45.643104+0000 mon.a (mon.0) 1549 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi072-64171-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:46.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:46 smithi172 bash[23680]: audit 2024-03-30T15:13:45.713312+0000 mon.a (mon.0) 1550 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:46.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:46 smithi172 bash[23680]: cluster 2024-03-30T15:13:45.926686+0000 mgr.y (mgr.14526) 259 : cluster 0 pgmap v256: 363 pgs: 32 creating+peering, 331 active+clean; 592 KiB data, 592 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-30T15:13:46.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:46 smithi172 bash[23680]: audit 2024-03-30T15:13:46.627625+0000 mon.a (mon.0) 1551 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi072-64171-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:46.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:46 smithi172 bash[23680]: cluster 2024-03-30T15:13:46.637236+0000 mon.a (mon.0) 1552 : cluster 0 osdmap e169: 8 total, 8 up, 8 in 2024-03-30T15:13:47.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:46 smithi072 bash[21573]: audit 2024-03-30T15:13:45.713312+0000 mon.a (mon.0) 1550 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:47.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:46 smithi072 bash[21573]: cluster 2024-03-30T15:13:45.926686+0000 mgr.y (mgr.14526) 259 : cluster 0 pgmap v256: 363 pgs: 32 creating+peering, 331 active+clean; 592 KiB data, 592 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-30T15:13:47.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:46 smithi072 bash[21573]: audit 2024-03-30T15:13:46.627625+0000 mon.a (mon.0) 1551 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi072-64171-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:47.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:46 smithi072 bash[21573]: cluster 2024-03-30T15:13:46.637236+0000 mon.a (mon.0) 1552 : cluster 0 osdmap e169: 8 total, 8 up, 8 in 2024-03-30T15:13:47.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:46 smithi072 bash[28946]: audit 2024-03-30T15:13:45.713312+0000 mon.a (mon.0) 1550 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:47.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:46 smithi072 bash[28946]: cluster 2024-03-30T15:13:45.926686+0000 mgr.y (mgr.14526) 259 : cluster 0 pgmap v256: 363 pgs: 32 creating+peering, 331 active+clean; 592 KiB data, 592 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-30T15:13:47.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:46 smithi072 bash[28946]: audit 2024-03-30T15:13:46.627625+0000 mon.a (mon.0) 1551 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi072-64171-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:47.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:46 smithi072 bash[28946]: cluster 2024-03-30T15:13:46.637236+0000 mon.a (mon.0) 1552 : cluster 0 osdmap e169: 8 total, 8 up, 8 in 2024-03-30T15:13:47.639 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: Running main() from gmock_main.cc 2024-03-30T15:13:47.639 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [==========] Running 21 tests from 5 test suites. 2024-03-30T15:13:47.639 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [----------] Global test environment set-up. 2024-03-30T15:13:47.639 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP 2024-03-30T15:13:47.639 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: seed 64386 2024-03-30T15:13:47.640 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapListPP 2024-03-30T15:13:47.640 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapListPP (6347 ms) 2024-03-30T15:13:47.640 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2024-03-30T15:13:47.640 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapRemovePP (5842 ms) 2024-03-30T15:13:47.640 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.RollbackPP 2024-03-30T15:13:47.640 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.RollbackPP (4457 ms) 2024-03-30T15:13:47.640 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2024-03-30T15:13:47.640 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapGetNamePP (1799 ms) 2024-03-30T15:13:47.640 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2024-03-30T15:13:47.640 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (6185 ms) 2024-03-30T15:13:47.640 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP (24630 ms total) 2024-03-30T15:13:47.640 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: 2024-03-30T15:13:47.640 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP 2024-03-30T15:13:47.640 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2024-03-30T15:13:47.640 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (4825 ms) 2024-03-30T15:13:47.640 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2024-03-30T15:13:47.641 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.RollbackPP (9348 ms) 2024-03-30T15:13:47.641 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2024-03-30T15:13:47.641 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (10297 ms) 2024-03-30T15:13:47.641 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2024-03-30T15:13:47.641 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (4901 ms) 2024-03-30T15:13:47.641 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2024-03-30T15:13:47.641 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (2446 ms) 2024-03-30T15:13:47.641 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-03-30T15:13:47.641 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: ./src/test/librados/snapshots_cxx.cc:463: Skipped 2024-03-30T15:13:47.641 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: 2024-03-30T15:13:47.641 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback (0 ms) 2024-03-30T15:13:47.641 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2024-03-30T15:13:47.642 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: deleting snap 14 in pool LibRadosSnapshotsSelfManagedPP_smithi072-64386-7 2024-03-30T15:13:47.642 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: waiting for snaps to purge 2024-03-30T15:13:47.642 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (17921 ms) 2024-03-30T15:13:47.642 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP (49738 ms total) 2024-03-30T15:13:47.642 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: 2024-03-30T15:13:47.642 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode 2024-03-30T15:13:47.642 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected 2024-03-30T15:13:47.642 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected (9 ms) 2024-03-30T15:13:47.643 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance 2024-03-30T15:13:47.643 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance (5087 ms) 2024-03-30T15:13:47.643 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode (5096 ms total) 2024-03-30T15:13:47.643 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: 2024-03-30T15:13:47.643 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP 2024-03-30T15:13:47.643 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapListPP 2024-03-30T15:13:47.643 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapListPP (3003 ms) 2024-03-30T15:13:47.643 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2024-03-30T15:13:47.643 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapRemovePP (1904 ms) 2024-03-30T15:13:47.643 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.RollbackPP 2024-03-30T15:13:47.643 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.RollbackPP (2005 ms) 2024-03-30T15:13:48.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:48 smithi072 bash[21573]: audit 2024-03-30T15:13:47.140923+0000 mon.a (mon.0) 1553 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:48.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:48 smithi072 bash[21573]: cluster 2024-03-30T15:13:47.641955+0000 mon.a (mon.0) 1554 : cluster 0 osdmap e170: 8 total, 8 up, 8 in 2024-03-30T15:13:48.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:48 smithi072 bash[21573]: audit 2024-03-30T15:13:47.655959+0000 mon.a (mon.0) 1555 : audit 1 from='client.? 172.21.15.72:0/432522841' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi072-64163-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:48.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:48 smithi072 bash[28946]: audit 2024-03-30T15:13:47.140923+0000 mon.a (mon.0) 1553 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:48.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:48 smithi072 bash[28946]: cluster 2024-03-30T15:13:47.641955+0000 mon.a (mon.0) 1554 : cluster 0 osdmap e170: 8 total, 8 up, 8 in 2024-03-30T15:13:48.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:48 smithi072 bash[28946]: audit 2024-03-30T15:13:47.655959+0000 mon.a (mon.0) 1555 : audit 1 from='client.? 172.21.15.72:0/432522841' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi072-64163-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:48.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:48 smithi172 bash[23680]: audit 2024-03-30T15:13:47.140923+0000 mon.a (mon.0) 1553 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:48.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:48 smithi172 bash[23680]: cluster 2024-03-30T15:13:47.641955+0000 mon.a (mon.0) 1554 : cluster 0 osdmap e170: 8 total, 8 up, 8 in 2024-03-30T15:13:48.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:48 smithi172 bash[23680]: audit 2024-03-30T15:13:47.655959+0000 mon.a (mon.0) 1555 : audit 1 from='client.? 172.21.15.72:0/432522841' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi072-64163-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:49.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:49 smithi072 bash[21573]: cluster 2024-03-30T15:13:47.927587+0000 mgr.y (mgr.14526) 260 : cluster 0 pgmap v259: 331 pgs: 32 unknown, 299 active+clean; 592 KiB data, 592 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-03-30T15:13:49.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:49 smithi072 bash[21573]: audit 2024-03-30T15:13:48.142409+0000 mon.a (mon.0) 1556 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:49.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:49 smithi072 bash[21573]: audit 2024-03-30T15:13:48.637073+0000 mon.a (mon.0) 1557 : audit 1 from='client.? 172.21.15.72:0/432522841' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi072-64163-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:49.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:49 smithi072 bash[21573]: cluster 2024-03-30T15:13:48.645894+0000 mon.a (mon.0) 1558 : cluster 0 osdmap e171: 8 total, 8 up, 8 in 2024-03-30T15:13:49.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:49 smithi072 bash[21573]: audit 2024-03-30T15:13:48.648656+0000 mon.c (mon.2) 257 : audit 1 from='client.? 172.21.15.72:0/1318792185' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi072-64171-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:49.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:49 smithi072 bash[21573]: audit 2024-03-30T15:13:48.665473+0000 mon.a (mon.0) 1559 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi072-64171-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:49.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:49 smithi072 bash[28946]: cluster 2024-03-30T15:13:47.927587+0000 mgr.y (mgr.14526) 260 : cluster 0 pgmap v259: 331 pgs: 32 unknown, 299 active+clean; 592 KiB data, 592 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-03-30T15:13:49.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:49 smithi072 bash[28946]: audit 2024-03-30T15:13:48.142409+0000 mon.a (mon.0) 1556 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:49.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:49 smithi072 bash[28946]: audit 2024-03-30T15:13:48.637073+0000 mon.a (mon.0) 1557 : audit 1 from='client.? 172.21.15.72:0/432522841' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi072-64163-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:49.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:49 smithi072 bash[28946]: cluster 2024-03-30T15:13:48.645894+0000 mon.a (mon.0) 1558 : cluster 0 osdmap e171: 8 total, 8 up, 8 in 2024-03-30T15:13:49.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:49 smithi072 bash[28946]: audit 2024-03-30T15:13:48.648656+0000 mon.c (mon.2) 257 : audit 1 from='client.? 172.21.15.72:0/1318792185' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi072-64171-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:49.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:49 smithi072 bash[28946]: audit 2024-03-30T15:13:48.665473+0000 mon.a (mon.0) 1559 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi072-64171-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:49.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:49 smithi172 bash[23680]: cluster 2024-03-30T15:13:47.927587+0000 mgr.y (mgr.14526) 260 : cluster 0 pgmap v259: 331 pgs: 32 unknown, 299 active+clean; 592 KiB data, 592 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-03-30T15:13:49.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:49 smithi172 bash[23680]: audit 2024-03-30T15:13:48.142409+0000 mon.a (mon.0) 1556 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:49.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:49 smithi172 bash[23680]: audit 2024-03-30T15:13:48.637073+0000 mon.a (mon.0) 1557 : audit 1 from='client.? 172.21.15.72:0/432522841' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi072-64163-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:49.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:49 smithi172 bash[23680]: cluster 2024-03-30T15:13:48.645894+0000 mon.a (mon.0) 1558 : cluster 0 osdmap e171: 8 total, 8 up, 8 in 2024-03-30T15:13:49.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:49 smithi172 bash[23680]: audit 2024-03-30T15:13:48.648656+0000 mon.c (mon.2) 257 : audit 1 from='client.? 172.21.15.72:0/1318792185' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi072-64171-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:49.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:49 smithi172 bash[23680]: audit 2024-03-30T15:13:48.665473+0000 mon.a (mon.0) 1559 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi072-64171-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:50.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:50 smithi072 bash[21573]: audit 2024-03-30T15:13:49.143854+0000 mon.a (mon.0) 1560 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:50.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:50 smithi072 bash[21573]: audit 2024-03-30T15:13:49.641398+0000 mon.a (mon.0) 1561 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi072-64171-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:50.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:50 smithi072 bash[21573]: cluster 2024-03-30T15:13:49.650807+0000 mon.a (mon.0) 1562 : cluster 0 osdmap e172: 8 total, 8 up, 8 in 2024-03-30T15:13:50.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:50 smithi072 bash[28946]: audit 2024-03-30T15:13:49.143854+0000 mon.a (mon.0) 1560 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:50.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:50 smithi072 bash[28946]: audit 2024-03-30T15:13:49.641398+0000 mon.a (mon.0) 1561 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi072-64171-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:50.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:50 smithi072 bash[28946]: cluster 2024-03-30T15:13:49.650807+0000 mon.a (mon.0) 1562 : cluster 0 osdmap e172: 8 total, 8 up, 8 in 2024-03-30T15:13:50.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:50 smithi172 bash[23680]: audit 2024-03-30T15:13:49.143854+0000 mon.a (mon.0) 1560 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:50.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:50 smithi172 bash[23680]: audit 2024-03-30T15:13:49.641398+0000 mon.a (mon.0) 1561 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi072-64171-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:50.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:50 smithi172 bash[23680]: cluster 2024-03-30T15:13:49.650807+0000 mon.a (mon.0) 1562 : cluster 0 osdmap e172: 8 total, 8 up, 8 in 2024-03-30T15:13:51.417 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:13:51 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:13:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:13:51.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:51 smithi072 bash[21573]: cluster 2024-03-30T15:13:49.928454+0000 mgr.y (mgr.14526) 261 : cluster 0 pgmap v262: 331 pgs: 32 unknown, 299 active+clean; 592 KiB data, 592 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:13:51.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:51 smithi072 bash[21573]: audit 2024-03-30T15:13:50.149528+0000 mon.a (mon.0) 1563 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:51.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:51 smithi072 bash[21573]: audit 2024-03-30T15:13:50.612473+0000 mon.c (mon.2) 258 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:13:51.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:51 smithi072 bash[21573]: cluster 2024-03-30T15:13:50.623317+0000 mon.a (mon.0) 1564 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:13:51.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:51 smithi072 bash[21573]: cluster 2024-03-30T15:13:50.637561+0000 mon.a (mon.0) 1565 : cluster 0 osdmap e173: 8 total, 8 up, 8 in 2024-03-30T15:13:51.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:51 smithi072 bash[21573]: audit 2024-03-30T15:13:50.644635+0000 mon.b (mon.1) 52 : audit 1 from='client.? 172.21.15.72:0/1308200294' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi072-64386-16"}]: dispatch 2024-03-30T15:13:51.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:51 smithi072 bash[21573]: audit 2024-03-30T15:13:50.645296+0000 mon.a (mon.0) 1566 : audit 1 from='client.? 172.21.15.72:0/442164244' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi072-64163-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:51.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:51 smithi072 bash[21573]: audit 2024-03-30T15:13:50.645697+0000 mon.a (mon.0) 1567 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi072-64386-16"}]: dispatch 2024-03-30T15:13:51.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:51 smithi072 bash[28946]: cluster 2024-03-30T15:13:49.928454+0000 mgr.y (mgr.14526) 261 : cluster 0 pgmap v262: 331 pgs: 32 unknown, 299 active+clean; 592 KiB data, 592 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:13:51.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:51 smithi072 bash[28946]: audit 2024-03-30T15:13:50.149528+0000 mon.a (mon.0) 1563 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:51.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:51 smithi072 bash[28946]: audit 2024-03-30T15:13:50.612473+0000 mon.c (mon.2) 258 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:13:51.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:51 smithi072 bash[28946]: cluster 2024-03-30T15:13:50.623317+0000 mon.a (mon.0) 1564 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:13:51.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:51 smithi072 bash[28946]: cluster 2024-03-30T15:13:50.637561+0000 mon.a (mon.0) 1565 : cluster 0 osdmap e173: 8 total, 8 up, 8 in 2024-03-30T15:13:51.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:51 smithi072 bash[28946]: audit 2024-03-30T15:13:50.644635+0000 mon.b (mon.1) 52 : audit 1 from='client.? 172.21.15.72:0/1308200294' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi072-64386-16"}]: dispatch 2024-03-30T15:13:51.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:51 smithi072 bash[28946]: audit 2024-03-30T15:13:50.645296+0000 mon.a (mon.0) 1566 : audit 1 from='client.? 172.21.15.72:0/442164244' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi072-64163-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:51.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:51 smithi072 bash[28946]: audit 2024-03-30T15:13:50.645697+0000 mon.a (mon.0) 1567 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi072-64386-16"}]: dispatch 2024-03-30T15:13:51.465 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:13:51 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:13:51.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:51 smithi172 bash[23680]: cluster 2024-03-30T15:13:49.928454+0000 mgr.y (mgr.14526) 261 : cluster 0 pgmap v262: 331 pgs: 32 unknown, 299 active+clean; 592 KiB data, 592 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:13:51.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:51 smithi172 bash[23680]: audit 2024-03-30T15:13:50.149528+0000 mon.a (mon.0) 1563 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:51.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:51 smithi172 bash[23680]: audit 2024-03-30T15:13:50.612473+0000 mon.c (mon.2) 258 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:13:51.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:51 smithi172 bash[23680]: cluster 2024-03-30T15:13:50.623317+0000 mon.a (mon.0) 1564 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:13:51.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:51 smithi172 bash[23680]: cluster 2024-03-30T15:13:50.637561+0000 mon.a (mon.0) 1565 : cluster 0 osdmap e173: 8 total, 8 up, 8 in 2024-03-30T15:13:51.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:51 smithi172 bash[23680]: audit 2024-03-30T15:13:50.644635+0000 mon.b (mon.1) 52 : audit 1 from='client.? 172.21.15.72:0/1308200294' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi072-64386-16"}]: dispatch 2024-03-30T15:13:51.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:51 smithi172 bash[23680]: audit 2024-03-30T15:13:50.645296+0000 mon.a (mon.0) 1566 : audit 1 from='client.? 172.21.15.72:0/442164244' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi072-64163-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:51.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:51 smithi172 bash[23680]: audit 2024-03-30T15:13:50.645697+0000 mon.a (mon.0) 1567 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi072-64386-16"}]: dispatch 2024-03-30T15:13:52.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:52 smithi072 bash[21573]: audit 2024-03-30T15:13:51.051985+0000 mgr.y (mgr.14526) 262 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:13:52.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:52 smithi072 bash[21573]: audit 2024-03-30T15:13:51.153392+0000 mon.a (mon.0) 1568 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:52.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:52 smithi072 bash[21573]: audit 2024-03-30T15:13:51.632259+0000 mon.a (mon.0) 1569 : audit 1 from='client.? 172.21.15.72:0/442164244' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemove_smithi072-64163-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:52.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:52 smithi072 bash[21573]: audit 2024-03-30T15:13:51.632517+0000 mon.a (mon.0) 1570 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi072-64386-16"}]': finished 2024-03-30T15:13:52.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:52 smithi072 bash[21573]: audit 2024-03-30T15:13:51.644609+0000 mon.b (mon.1) 53 : audit 1 from='client.? 172.21.15.72:0/1308200294' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi072-64386-16"}]: dispatch 2024-03-30T15:13:52.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:52 smithi072 bash[21573]: cluster 2024-03-30T15:13:51.647729+0000 mon.a (mon.0) 1571 : cluster 0 osdmap e174: 8 total, 8 up, 8 in 2024-03-30T15:13:52.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:52 smithi072 bash[21573]: audit 2024-03-30T15:13:51.655150+0000 mon.c (mon.2) 259 : audit 1 from='client.? 172.21.15.72:0/4124129129' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi072-64171-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:52.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:52 smithi072 bash[21573]: audit 2024-03-30T15:13:51.656709+0000 mon.a (mon.0) 1572 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi072-64386-16"}]: dispatch 2024-03-30T15:13:52.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:52 smithi072 bash[21573]: audit 2024-03-30T15:13:51.658379+0000 mon.a (mon.0) 1573 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi072-64171-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:52.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:52 smithi072 bash[28946]: audit 2024-03-30T15:13:51.051985+0000 mgr.y (mgr.14526) 262 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:13:52.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:52 smithi072 bash[28946]: audit 2024-03-30T15:13:51.153392+0000 mon.a (mon.0) 1568 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:52.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:52 smithi072 bash[28946]: audit 2024-03-30T15:13:51.632259+0000 mon.a (mon.0) 1569 : audit 1 from='client.? 172.21.15.72:0/442164244' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemove_smithi072-64163-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:52.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:52 smithi072 bash[28946]: audit 2024-03-30T15:13:51.632517+0000 mon.a (mon.0) 1570 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi072-64386-16"}]': finished 2024-03-30T15:13:52.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:52 smithi072 bash[28946]: audit 2024-03-30T15:13:51.644609+0000 mon.b (mon.1) 53 : audit 1 from='client.? 172.21.15.72:0/1308200294' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi072-64386-16"}]: dispatch 2024-03-30T15:13:52.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:52 smithi072 bash[28946]: cluster 2024-03-30T15:13:51.647729+0000 mon.a (mon.0) 1571 : cluster 0 osdmap e174: 8 total, 8 up, 8 in 2024-03-30T15:13:52.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:52 smithi072 bash[28946]: audit 2024-03-30T15:13:51.655150+0000 mon.c (mon.2) 259 : audit 1 from='client.? 172.21.15.72:0/4124129129' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi072-64171-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:52.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:52 smithi072 bash[28946]: audit 2024-03-30T15:13:51.656709+0000 mon.a (mon.0) 1572 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi072-64386-16"}]: dispatch 2024-03-30T15:13:52.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:52 smithi072 bash[28946]: audit 2024-03-30T15:13:51.658379+0000 mon.a (mon.0) 1573 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi072-64171-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:52.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:52 smithi172 bash[23680]: audit 2024-03-30T15:13:51.051985+0000 mgr.y (mgr.14526) 262 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:13:52.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:52 smithi172 bash[23680]: audit 2024-03-30T15:13:51.153392+0000 mon.a (mon.0) 1568 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:52.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:52 smithi172 bash[23680]: audit 2024-03-30T15:13:51.632259+0000 mon.a (mon.0) 1569 : audit 1 from='client.? 172.21.15.72:0/442164244' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemove_smithi072-64163-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:52.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:52 smithi172 bash[23680]: audit 2024-03-30T15:13:51.632517+0000 mon.a (mon.0) 1570 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi072-64386-16"}]': finished 2024-03-30T15:13:52.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:52 smithi172 bash[23680]: audit 2024-03-30T15:13:51.644609+0000 mon.b (mon.1) 53 : audit 1 from='client.? 172.21.15.72:0/1308200294' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi072-64386-16"}]: dispatch 2024-03-30T15:13:52.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:52 smithi172 bash[23680]: cluster 2024-03-30T15:13:51.647729+0000 mon.a (mon.0) 1571 : cluster 0 osdmap e174: 8 total, 8 up, 8 in 2024-03-30T15:13:52.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:52 smithi172 bash[23680]: audit 2024-03-30T15:13:51.655150+0000 mon.c (mon.2) 259 : audit 1 from='client.? 172.21.15.72:0/4124129129' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi072-64171-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:52.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:52 smithi172 bash[23680]: audit 2024-03-30T15:13:51.656709+0000 mon.a (mon.0) 1572 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi072-64386-16"}]: dispatch 2024-03-30T15:13:52.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:52 smithi172 bash[23680]: audit 2024-03-30T15:13:51.658379+0000 mon.a (mon.0) 1573 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi072-64171-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:53.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:53 smithi072 bash[21573]: cluster 2024-03-30T15:13:51.929428+0000 mgr.y (mgr.14526) 263 : cluster 0 pgmap v265: 355 pgs: 32 unknown, 32 creating+peering, 291 active+clean; 592 KiB data, 564 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:13:53.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:53 smithi072 bash[21573]: audit 2024-03-30T15:13:52.154934+0000 mon.a (mon.0) 1574 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:53.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:53 smithi072 bash[21573]: audit 2024-03-30T15:13:52.646986+0000 mon.a (mon.0) 1575 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi072-64386-16"}]': finished 2024-03-30T15:13:53.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:53 smithi072 bash[21573]: audit 2024-03-30T15:13:52.647160+0000 mon.a (mon.0) 1576 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi072-64171-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:53.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:53 smithi072 bash[21573]: cluster 2024-03-30T15:13:52.654611+0000 mon.a (mon.0) 1577 : cluster 0 osdmap e175: 8 total, 8 up, 8 in 2024-03-30T15:13:53.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:53 smithi072 bash[21573]: audit 2024-03-30T15:13:53.137982+0000 mon.a (mon.0) 1578 : audit 1 from='client.? 172.21.15.72:0/179484884' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi072-64386-21"}]: dispatch 2024-03-30T15:13:53.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:53 smithi072 bash[21573]: audit 2024-03-30T15:13:53.139527+0000 mon.a (mon.0) 1579 : audit 1 from='client.? 172.21.15.72:0/179484884' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi072-64386-21"}]: dispatch 2024-03-30T15:13:53.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:53 smithi072 bash[21573]: audit 2024-03-30T15:13:53.140219+0000 mon.a (mon.0) 1580 : audit 1 from='client.? 172.21.15.72:0/179484884' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi072-64386-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:13:53.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:53 smithi072 bash[28946]: cluster 2024-03-30T15:13:51.929428+0000 mgr.y (mgr.14526) 263 : cluster 0 pgmap v265: 355 pgs: 32 unknown, 32 creating+peering, 291 active+clean; 592 KiB data, 564 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:13:53.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:53 smithi072 bash[28946]: audit 2024-03-30T15:13:52.154934+0000 mon.a (mon.0) 1574 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:53.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:53 smithi072 bash[28946]: audit 2024-03-30T15:13:52.646986+0000 mon.a (mon.0) 1575 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi072-64386-16"}]': finished 2024-03-30T15:13:53.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:53 smithi072 bash[28946]: audit 2024-03-30T15:13:52.647160+0000 mon.a (mon.0) 1576 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi072-64171-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:53.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:53 smithi072 bash[28946]: cluster 2024-03-30T15:13:52.654611+0000 mon.a (mon.0) 1577 : cluster 0 osdmap e175: 8 total, 8 up, 8 in 2024-03-30T15:13:53.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:53 smithi072 bash[28946]: audit 2024-03-30T15:13:53.137982+0000 mon.a (mon.0) 1578 : audit 1 from='client.? 172.21.15.72:0/179484884' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi072-64386-21"}]: dispatch 2024-03-30T15:13:53.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:53 smithi072 bash[28946]: audit 2024-03-30T15:13:53.139527+0000 mon.a (mon.0) 1579 : audit 1 from='client.? 172.21.15.72:0/179484884' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi072-64386-21"}]: dispatch 2024-03-30T15:13:53.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:53 smithi072 bash[28946]: audit 2024-03-30T15:13:53.140219+0000 mon.a (mon.0) 1580 : audit 1 from='client.? 172.21.15.72:0/179484884' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi072-64386-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:13:53.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:53 smithi172 bash[23680]: cluster 2024-03-30T15:13:51.929428+0000 mgr.y (mgr.14526) 263 : cluster 0 pgmap v265: 355 pgs: 32 unknown, 32 creating+peering, 291 active+clean; 592 KiB data, 564 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:13:53.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:53 smithi172 bash[23680]: audit 2024-03-30T15:13:52.154934+0000 mon.a (mon.0) 1574 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:53.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:53 smithi172 bash[23680]: audit 2024-03-30T15:13:52.646986+0000 mon.a (mon.0) 1575 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi072-64386-16"}]': finished 2024-03-30T15:13:53.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:53 smithi172 bash[23680]: audit 2024-03-30T15:13:52.647160+0000 mon.a (mon.0) 1576 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi072-64171-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:53.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:53 smithi172 bash[23680]: cluster 2024-03-30T15:13:52.654611+0000 mon.a (mon.0) 1577 : cluster 0 osdmap e175: 8 total, 8 up, 8 in 2024-03-30T15:13:53.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:53 smithi172 bash[23680]: audit 2024-03-30T15:13:53.137982+0000 mon.a (mon.0) 1578 : audit 1 from='client.? 172.21.15.72:0/179484884' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi072-64386-21"}]: dispatch 2024-03-30T15:13:53.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:53 smithi172 bash[23680]: audit 2024-03-30T15:13:53.139527+0000 mon.a (mon.0) 1579 : audit 1 from='client.? 172.21.15.72:0/179484884' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi072-64386-21"}]: dispatch 2024-03-30T15:13:53.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:53 smithi172 bash[23680]: audit 2024-03-30T15:13:53.140219+0000 mon.a (mon.0) 1580 : audit 1 from='client.? 172.21.15.72:0/179484884' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi072-64386-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:13:53.676 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_ snapshots: Running main() from gmock_main.cc 2024-03-30T15:13:53.676 INFO:tasks.workunit.client.0.smithi072.stdout: snapshots: [==========] Running 11 tests from 2 test suites. 2024-03-30T15:13:53.676 INFO:tasks.workunit.client.0.smithi072.stdout: snapshots: [----------] Global test environment set-up. 2024-03-30T15:13:53.676 INFO:tasks.workunit.client.0.smithi072.stdout: snapshots: [----------] 5 tests from NeoRadosSnapshots 2024-03-30T15:13:53.676 INFO:tasks.workunit.client.0.smithi072.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapList 2024-03-30T15:13:53.676 INFO:tasks.workunit.client.0.smithi072.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapList (25810 ms) 2024-03-30T15:13:53.676 INFO:tasks.workunit.client.0.smithi072.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapRemove 2024-03-30T15:13:53.676 INFO:tasks.workunit.client.0.smithi072.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapRemove (11239 ms) 2024-03-30T15:13:53.676 INFO:tasks.workunit.client.0.smithi072.stdout: snapshots: [ RUN ] NeoRadosSnapshots.Rollback 2024-03-30T15:13:53.676 INFO:tasks.workunit.client.0.smithi072.stdout: snapshots: [ OK ] NeoRadosSnapshots.Rollback (8904 ms) 2024-03-30T15:13:53.677 INFO:tasks.workunit.client.0.smithi072.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapGetName 2024-03-30T15:13:53.677 INFO:tasks.workunit.client.0.smithi072.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapGetName (11373 ms) 2024-03-30T15:13:53.677 INFO:tasks.workunit.client.0.smithi072.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapCreateRemove 2024-03-30T15:13:53.677 INFO:tasks.workunit.client.0.smithi072.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapCreateRemove (9893 ms) 2024-03-30T15:13:53.677 INFO:tasks.workunit.client.0.smithi072.stdout: snapshots: [----------] 5 tests from NeoRadosSnapshots (67219 ms total) 2024-03-30T15:13:53.677 INFO:tasks.workunit.client.0.smithi072.stdout: snapshots: 2024-03-30T15:13:53.677 INFO:tasks.workunit.client.0.smithi072.stdout: snapshots: [----------] 6 tests from NeoRadosSelfManagedSnaps 2024-03-30T15:13:53.677 INFO:tasks.workunit.client.0.smithi072.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Snap 2024-03-30T15:13:53.677 INFO:tasks.workunit.client.0.smithi072.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Snap (8920 ms) 2024-03-30T15:13:53.677 INFO:tasks.workunit.client.0.smithi072.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Rollback 2024-03-30T15:13:53.677 INFO:tasks.workunit.client.0.smithi072.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Rollback (7174 ms) 2024-03-30T15:13:53.677 INFO:tasks.workunit.client.0.smithi072.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.SnapOverlap 2024-03-30T15:13:53.677 INFO:tasks.workunit.client.0.smithi072.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.SnapOverlap (8417 ms) 2024-03-30T15:13:53.677 INFO:tasks.workunit.client.0.smithi072.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Bug11677 2024-03-30T15:13:53.677 INFO:tasks.workunit.client.0.smithi072.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Bug11677 (5632 ms) 2024-03-30T15:13:53.678 INFO:tasks.workunit.client.0.smithi072.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.OrderSnap 2024-03-30T15:13:53.678 INFO:tasks.workunit.client.0.smithi072.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.OrderSnap (3984 ms) 2024-03-30T15:13:53.678 INFO:tasks.workunit.client.0.smithi072.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.ReusePurgedSnap 2024-03-30T15:13:53.678 INFO:tasks.workunit.client.0.smithi072.stdout: snapshots: Deleting snap 3 in pool ReusePurgedSnapsmithi072-64946-11. 2024-03-30T15:13:53.678 INFO:tasks.workunit.client.0.smithi072.stdout: snapshots: Waiting for snaps to purge. 2024-03-30T15:13:53.678 INFO:tasks.workunit.client.0.smithi072.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.ReusePurgedSnap (20018 ms) 2024-03-30T15:13:53.678 INFO:tasks.workunit.client.0.smithi072.stdout: snapshots: [----------] 6 tests from NeoRadosSelfManagedSnaps (54145 ms total) 2024-03-30T15:13:53.678 INFO:tasks.workunit.client.0.smithi072.stdout: snapshots: 2024-03-30T15:13:53.678 INFO:tasks.workunit.client.0.smithi072.stdout: snapshots: [----------] Global test environment tear-down 2024-03-30T15:13:53.678 INFO:tasks.workunit.client.0.smithi072.stdout: snapshots: [==========] 11 tests from 2 test suites ran. (121364 ms total) 2024-03-30T15:13:53.678 INFO:tasks.workunit.client.0.smithi072.stdout: snapshots: [ PASSED ] 11 tests. 2024-03-30T15:13:54.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:54 smithi072 bash[21573]: audit 2024-03-30T15:13:53.156331+0000 mon.a (mon.0) 1581 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:54.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:54 smithi072 bash[21573]: audit 2024-03-30T15:13:53.650750+0000 mon.a (mon.0) 1582 : audit 1 from='client.? 172.21.15.72:0/179484884' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi072-64386-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:13:54.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:54 smithi072 bash[21573]: cluster 2024-03-30T15:13:53.661234+0000 mon.a (mon.0) 1583 : cluster 0 osdmap e176: 8 total, 8 up, 8 in 2024-03-30T15:13:54.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:54 smithi072 bash[21573]: audit 2024-03-30T15:13:53.663710+0000 mon.a (mon.0) 1584 : audit 1 from='client.? 172.21.15.72:0/179484884' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi072-64386-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi072-64386-21"}]: dispatch 2024-03-30T15:13:54.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:54 smithi072 bash[21573]: audit 2024-03-30T15:13:53.667705+0000 mon.c (mon.2) 260 : audit 1 from='client.? 172.21.15.72:0/255513039' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi072-64163-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:54.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:54 smithi072 bash[21573]: audit 2024-03-30T15:13:53.675916+0000 mon.a (mon.0) 1585 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi072-64163-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:54.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:54 smithi072 bash[28946]: audit 2024-03-30T15:13:53.156331+0000 mon.a (mon.0) 1581 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:54.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:54 smithi072 bash[28946]: audit 2024-03-30T15:13:53.650750+0000 mon.a (mon.0) 1582 : audit 1 from='client.? 172.21.15.72:0/179484884' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi072-64386-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:13:54.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:54 smithi072 bash[28946]: cluster 2024-03-30T15:13:53.661234+0000 mon.a (mon.0) 1583 : cluster 0 osdmap e176: 8 total, 8 up, 8 in 2024-03-30T15:13:54.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:54 smithi072 bash[28946]: audit 2024-03-30T15:13:53.663710+0000 mon.a (mon.0) 1584 : audit 1 from='client.? 172.21.15.72:0/179484884' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi072-64386-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi072-64386-21"}]: dispatch 2024-03-30T15:13:54.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:54 smithi072 bash[28946]: audit 2024-03-30T15:13:53.667705+0000 mon.c (mon.2) 260 : audit 1 from='client.? 172.21.15.72:0/255513039' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi072-64163-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:54.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:54 smithi072 bash[28946]: audit 2024-03-30T15:13:53.675916+0000 mon.a (mon.0) 1585 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi072-64163-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:54.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:54 smithi172 bash[23680]: audit 2024-03-30T15:13:53.156331+0000 mon.a (mon.0) 1581 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:54.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:54 smithi172 bash[23680]: audit 2024-03-30T15:13:53.650750+0000 mon.a (mon.0) 1582 : audit 1 from='client.? 172.21.15.72:0/179484884' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi072-64386-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:13:54.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:54 smithi172 bash[23680]: cluster 2024-03-30T15:13:53.661234+0000 mon.a (mon.0) 1583 : cluster 0 osdmap e176: 8 total, 8 up, 8 in 2024-03-30T15:13:54.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:54 smithi172 bash[23680]: audit 2024-03-30T15:13:53.663710+0000 mon.a (mon.0) 1584 : audit 1 from='client.? 172.21.15.72:0/179484884' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi072-64386-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi072-64386-21"}]: dispatch 2024-03-30T15:13:54.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:54 smithi172 bash[23680]: audit 2024-03-30T15:13:53.667705+0000 mon.c (mon.2) 260 : audit 1 from='client.? 172.21.15.72:0/255513039' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi072-64163-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:54.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:54 smithi172 bash[23680]: audit 2024-03-30T15:13:53.675916+0000 mon.a (mon.0) 1585 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi072-64163-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:55.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:55 smithi072 bash[21573]: cluster 2024-03-30T15:13:53.930234+0000 mgr.y (mgr.14526) 264 : cluster 0 pgmap v268: 291 pgs: 32 unknown, 259 active+clean; 592 KiB data, 564 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:13:55.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:55 smithi072 bash[21573]: audit 2024-03-30T15:13:54.167678+0000 mon.a (mon.0) 1586 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:55.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:55 smithi072 bash[21573]: audit 2024-03-30T15:13:54.663584+0000 mon.a (mon.0) 1587 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi072-64163-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:55.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:55 smithi072 bash[21573]: cluster 2024-03-30T15:13:55.134905+0000 mon.a (mon.0) 1588 : cluster 0 osdmap e177: 8 total, 8 up, 8 in 2024-03-30T15:13:55.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:55 smithi072 bash[21573]: audit 2024-03-30T15:13:55.136380+0000 mon.c (mon.2) 261 : audit 1 from='client.? 172.21.15.72:0/2800321028' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi072-64171-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:55.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:55 smithi072 bash[21573]: audit 2024-03-30T15:13:55.144149+0000 mon.a (mon.0) 1589 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi072-64171-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:55.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:55 smithi072 bash[28946]: cluster 2024-03-30T15:13:53.930234+0000 mgr.y (mgr.14526) 264 : cluster 0 pgmap v268: 291 pgs: 32 unknown, 259 active+clean; 592 KiB data, 564 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:13:55.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:55 smithi072 bash[28946]: audit 2024-03-30T15:13:54.167678+0000 mon.a (mon.0) 1586 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:55.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:55 smithi072 bash[28946]: audit 2024-03-30T15:13:54.663584+0000 mon.a (mon.0) 1587 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi072-64163-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:55.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:55 smithi072 bash[28946]: cluster 2024-03-30T15:13:55.134905+0000 mon.a (mon.0) 1588 : cluster 0 osdmap e177: 8 total, 8 up, 8 in 2024-03-30T15:13:55.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:55 smithi072 bash[28946]: audit 2024-03-30T15:13:55.136380+0000 mon.c (mon.2) 261 : audit 1 from='client.? 172.21.15.72:0/2800321028' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi072-64171-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:55.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:55 smithi072 bash[28946]: audit 2024-03-30T15:13:55.144149+0000 mon.a (mon.0) 1589 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi072-64171-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:55.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:55 smithi172 bash[23680]: cluster 2024-03-30T15:13:53.930234+0000 mgr.y (mgr.14526) 264 : cluster 0 pgmap v268: 291 pgs: 32 unknown, 259 active+clean; 592 KiB data, 564 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:13:55.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:55 smithi172 bash[23680]: audit 2024-03-30T15:13:54.167678+0000 mon.a (mon.0) 1586 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:55.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:55 smithi172 bash[23680]: audit 2024-03-30T15:13:54.663584+0000 mon.a (mon.0) 1587 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi072-64163-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:55.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:55 smithi172 bash[23680]: cluster 2024-03-30T15:13:55.134905+0000 mon.a (mon.0) 1588 : cluster 0 osdmap e177: 8 total, 8 up, 8 in 2024-03-30T15:13:55.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:55 smithi172 bash[23680]: audit 2024-03-30T15:13:55.136380+0000 mon.c (mon.2) 261 : audit 1 from='client.? 172.21.15.72:0/2800321028' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi072-64171-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:55.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:55 smithi172 bash[23680]: audit 2024-03-30T15:13:55.144149+0000 mon.a (mon.0) 1589 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi072-64171-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:56.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:56 smithi172 bash[23680]: audit 2024-03-30T15:13:55.168882+0000 mon.a (mon.0) 1590 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:56.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:56 smithi172 bash[23680]: cluster 2024-03-30T15:13:55.626916+0000 mon.a (mon.0) 1591 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:13:56.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:56 smithi172 bash[23680]: audit 2024-03-30T15:13:55.669094+0000 mon.a (mon.0) 1592 : audit 1 from='client.? 172.21.15.72:0/179484884' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi072-64386-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi072-64386-21"}]': finished 2024-03-30T15:13:56.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:56 smithi172 bash[23680]: audit 2024-03-30T15:13:55.669335+0000 mon.a (mon.0) 1593 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi072-64171-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:56.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:56 smithi172 bash[23680]: cluster 2024-03-30T15:13:55.677198+0000 mon.a (mon.0) 1594 : cluster 0 osdmap e178: 8 total, 8 up, 8 in 2024-03-30T15:13:56.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:56 smithi072 bash[21573]: audit 2024-03-30T15:13:55.168882+0000 mon.a (mon.0) 1590 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:56.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:56 smithi072 bash[21573]: cluster 2024-03-30T15:13:55.626916+0000 mon.a (mon.0) 1591 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:13:56.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:56 smithi072 bash[21573]: audit 2024-03-30T15:13:55.669094+0000 mon.a (mon.0) 1592 : audit 1 from='client.? 172.21.15.72:0/179484884' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi072-64386-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi072-64386-21"}]': finished 2024-03-30T15:13:56.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:56 smithi072 bash[21573]: audit 2024-03-30T15:13:55.669335+0000 mon.a (mon.0) 1593 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi072-64171-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:56.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:56 smithi072 bash[21573]: cluster 2024-03-30T15:13:55.677198+0000 mon.a (mon.0) 1594 : cluster 0 osdmap e178: 8 total, 8 up, 8 in 2024-03-30T15:13:56.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:56 smithi072 bash[28946]: audit 2024-03-30T15:13:55.168882+0000 mon.a (mon.0) 1590 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:56.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:56 smithi072 bash[28946]: cluster 2024-03-30T15:13:55.626916+0000 mon.a (mon.0) 1591 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:13:56.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:56 smithi072 bash[28946]: audit 2024-03-30T15:13:55.669094+0000 mon.a (mon.0) 1592 : audit 1 from='client.? 172.21.15.72:0/179484884' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi072-64386-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi072-64386-21"}]': finished 2024-03-30T15:13:56.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:56 smithi072 bash[28946]: audit 2024-03-30T15:13:55.669335+0000 mon.a (mon.0) 1593 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi072-64171-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:56.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:56 smithi072 bash[28946]: cluster 2024-03-30T15:13:55.677198+0000 mon.a (mon.0) 1594 : cluster 0 osdmap e178: 8 total, 8 up, 8 in 2024-03-30T15:13:57.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:57 smithi172 bash[23680]: cluster 2024-03-30T15:13:55.932682+0000 mgr.y (mgr.14526) 265 : cluster 0 pgmap v271: 299 pgs: 8 creating+peering, 291 active+clean; 587 KiB data, 549 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:13:57.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:57 smithi172 bash[23680]: audit 2024-03-30T15:13:56.175651+0000 mon.a (mon.0) 1595 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:57.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:57 smithi172 bash[23680]: cluster 2024-03-30T15:13:56.685738+0000 mon.a (mon.0) 1596 : cluster 0 osdmap e179: 8 total, 8 up, 8 in 2024-03-30T15:13:57.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:57 smithi172 bash[23680]: audit 2024-03-30T15:13:56.707845+0000 mon.c (mon.2) 262 : audit 1 from='client.? 172.21.15.72:0/1725955035' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi072-64163-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:57.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:57 smithi172 bash[23680]: audit 2024-03-30T15:13:56.708896+0000 mon.a (mon.0) 1597 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi072-64163-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:57.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:57 smithi172 bash[23680]: audit 2024-03-30T15:13:57.171219+0000 mon.a (mon.0) 1598 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:13:57.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:57 smithi072 bash[21573]: cluster 2024-03-30T15:13:55.932682+0000 mgr.y (mgr.14526) 265 : cluster 0 pgmap v271: 299 pgs: 8 creating+peering, 291 active+clean; 587 KiB data, 549 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:13:57.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:57 smithi072 bash[21573]: audit 2024-03-30T15:13:56.175651+0000 mon.a (mon.0) 1595 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:57.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:57 smithi072 bash[21573]: cluster 2024-03-30T15:13:56.685738+0000 mon.a (mon.0) 1596 : cluster 0 osdmap e179: 8 total, 8 up, 8 in 2024-03-30T15:13:57.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:57 smithi072 bash[21573]: audit 2024-03-30T15:13:56.707845+0000 mon.c (mon.2) 262 : audit 1 from='client.? 172.21.15.72:0/1725955035' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi072-64163-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:57.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:57 smithi072 bash[21573]: audit 2024-03-30T15:13:56.708896+0000 mon.a (mon.0) 1597 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi072-64163-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:57.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:57 smithi072 bash[21573]: audit 2024-03-30T15:13:57.171219+0000 mon.a (mon.0) 1598 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:13:57.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:57 smithi072 bash[28946]: cluster 2024-03-30T15:13:55.932682+0000 mgr.y (mgr.14526) 265 : cluster 0 pgmap v271: 299 pgs: 8 creating+peering, 291 active+clean; 587 KiB data, 549 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:13:57.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:57 smithi072 bash[28946]: audit 2024-03-30T15:13:56.175651+0000 mon.a (mon.0) 1595 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:57.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:57 smithi072 bash[28946]: cluster 2024-03-30T15:13:56.685738+0000 mon.a (mon.0) 1596 : cluster 0 osdmap e179: 8 total, 8 up, 8 in 2024-03-30T15:13:57.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:57 smithi072 bash[28946]: audit 2024-03-30T15:13:56.707845+0000 mon.c (mon.2) 262 : audit 1 from='client.? 172.21.15.72:0/1725955035' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi072-64163-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:57.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:57 smithi072 bash[28946]: audit 2024-03-30T15:13:56.708896+0000 mon.a (mon.0) 1597 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi072-64163-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:57.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:57 smithi072 bash[28946]: audit 2024-03-30T15:13:57.171219+0000 mon.a (mon.0) 1598 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:13:58.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:58 smithi172 bash[23680]: audit 2024-03-30T15:13:57.177844+0000 mon.a (mon.0) 1599 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:58.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:58 smithi172 bash[23680]: audit 2024-03-30T15:13:57.681172+0000 mon.a (mon.0) 1600 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi072-64163-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:58.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:58 smithi172 bash[23680]: audit 2024-03-30T15:13:57.681477+0000 mon.a (mon.0) 1601 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:13:58.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:58 smithi172 bash[23680]: cluster 2024-03-30T15:13:57.690380+0000 mon.a (mon.0) 1602 : cluster 0 osdmap e180: 8 total, 8 up, 8 in 2024-03-30T15:13:58.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:58 smithi172 bash[23680]: audit 2024-03-30T15:13:57.692254+0000 mon.a (mon.0) 1603 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-13"}]: dispatch 2024-03-30T15:13:58.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:58 smithi172 bash[23680]: audit 2024-03-30T15:13:57.697141+0000 mon.a (mon.0) 1604 : audit 1 from='client.? 172.21.15.72:0/53628473' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi072-64171-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:58.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:58 smithi172 bash[23680]: audit 2024-03-30T15:13:58.179296+0000 mon.a (mon.0) 1605 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:58.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:58 smithi072 bash[21573]: audit 2024-03-30T15:13:57.177844+0000 mon.a (mon.0) 1599 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:58.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:58 smithi072 bash[21573]: audit 2024-03-30T15:13:57.681172+0000 mon.a (mon.0) 1600 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi072-64163-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:58.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:58 smithi072 bash[21573]: audit 2024-03-30T15:13:57.681477+0000 mon.a (mon.0) 1601 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:13:58.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:58 smithi072 bash[21573]: cluster 2024-03-30T15:13:57.690380+0000 mon.a (mon.0) 1602 : cluster 0 osdmap e180: 8 total, 8 up, 8 in 2024-03-30T15:13:58.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:58 smithi072 bash[21573]: audit 2024-03-30T15:13:57.692254+0000 mon.a (mon.0) 1603 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-13"}]: dispatch 2024-03-30T15:13:58.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:58 smithi072 bash[21573]: audit 2024-03-30T15:13:57.697141+0000 mon.a (mon.0) 1604 : audit 1 from='client.? 172.21.15.72:0/53628473' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi072-64171-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:58.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:58 smithi072 bash[21573]: audit 2024-03-30T15:13:58.179296+0000 mon.a (mon.0) 1605 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:58.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:58 smithi072 bash[28946]: audit 2024-03-30T15:13:57.177844+0000 mon.a (mon.0) 1599 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:58.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:58 smithi072 bash[28946]: audit 2024-03-30T15:13:57.681172+0000 mon.a (mon.0) 1600 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi072-64163-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:58.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:58 smithi072 bash[28946]: audit 2024-03-30T15:13:57.681477+0000 mon.a (mon.0) 1601 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:13:58.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:58 smithi072 bash[28946]: cluster 2024-03-30T15:13:57.690380+0000 mon.a (mon.0) 1602 : cluster 0 osdmap e180: 8 total, 8 up, 8 in 2024-03-30T15:13:58.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:58 smithi072 bash[28946]: audit 2024-03-30T15:13:57.692254+0000 mon.a (mon.0) 1603 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-13"}]: dispatch 2024-03-30T15:13:58.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:58 smithi072 bash[28946]: audit 2024-03-30T15:13:57.697141+0000 mon.a (mon.0) 1604 : audit 1 from='client.? 172.21.15.72:0/53628473' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi072-64171-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:13:58.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:58 smithi072 bash[28946]: audit 2024-03-30T15:13:58.179296+0000 mon.a (mon.0) 1605 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:13:59.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:59 smithi172 bash[23680]: cluster 2024-03-30T15:13:57.933679+0000 mgr.y (mgr.14526) 266 : cluster 0 pgmap v274: 331 pgs: 64 unknown, 8 creating+peering, 259 active+clean; 587 KiB data, 549 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:13:59.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:59 smithi172 bash[23680]: cluster 2024-03-30T15:13:58.682556+0000 mon.a (mon.0) 1606 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:13:59.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:59 smithi172 bash[23680]: audit 2024-03-30T15:13:58.691001+0000 mon.a (mon.0) 1607 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-13"}]': finished 2024-03-30T15:13:59.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:59 smithi172 bash[23680]: audit 2024-03-30T15:13:58.691200+0000 mon.a (mon.0) 1608 : audit 1 from='client.? 172.21.15.72:0/53628473' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi072-64171-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:59.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:13:59 smithi172 bash[23680]: cluster 2024-03-30T15:13:58.699397+0000 mon.a (mon.0) 1609 : cluster 0 osdmap e181: 8 total, 8 up, 8 in 2024-03-30T15:13:59.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:59 smithi072 bash[21573]: cluster 2024-03-30T15:13:57.933679+0000 mgr.y (mgr.14526) 266 : cluster 0 pgmap v274: 331 pgs: 64 unknown, 8 creating+peering, 259 active+clean; 587 KiB data, 549 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:13:59.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:59 smithi072 bash[21573]: cluster 2024-03-30T15:13:58.682556+0000 mon.a (mon.0) 1606 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:13:59.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:59 smithi072 bash[21573]: audit 2024-03-30T15:13:58.691001+0000 mon.a (mon.0) 1607 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-13"}]': finished 2024-03-30T15:13:59.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:59 smithi072 bash[21573]: audit 2024-03-30T15:13:58.691200+0000 mon.a (mon.0) 1608 : audit 1 from='client.? 172.21.15.72:0/53628473' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi072-64171-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:59.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:13:59 smithi072 bash[21573]: cluster 2024-03-30T15:13:58.699397+0000 mon.a (mon.0) 1609 : cluster 0 osdmap e181: 8 total, 8 up, 8 in 2024-03-30T15:13:59.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:59 smithi072 bash[28946]: cluster 2024-03-30T15:13:57.933679+0000 mgr.y (mgr.14526) 266 : cluster 0 pgmap v274: 331 pgs: 64 unknown, 8 creating+peering, 259 active+clean; 587 KiB data, 549 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:13:59.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:59 smithi072 bash[28946]: cluster 2024-03-30T15:13:58.682556+0000 mon.a (mon.0) 1606 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:13:59.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:59 smithi072 bash[28946]: audit 2024-03-30T15:13:58.691001+0000 mon.a (mon.0) 1607 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-13"}]': finished 2024-03-30T15:13:59.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:59 smithi072 bash[28946]: audit 2024-03-30T15:13:58.691200+0000 mon.a (mon.0) 1608 : audit 1 from='client.? 172.21.15.72:0/53628473' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi072-64171-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:13:59.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:13:59 smithi072 bash[28946]: cluster 2024-03-30T15:13:58.699397+0000 mon.a (mon.0) 1609 : cluster 0 osdmap e181: 8 total, 8 up, 8 in 2024-03-30T15:14:00.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:00 smithi072 bash[21573]: audit 2024-03-30T15:13:59.196400+0000 mon.a (mon.0) 1610 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:00.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:00 smithi072 bash[21573]: cluster 2024-03-30T15:13:59.701928+0000 mon.a (mon.0) 1611 : cluster 0 osdmap e182: 8 total, 8 up, 8 in 2024-03-30T15:14:00.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:00 smithi072 bash[21573]: audit 2024-03-30T15:13:59.713294+0000 mon.b (mon.1) 54 : audit 1 from='client.? 172.21.15.72:0/1756819664' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi072-64163-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:00.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:00 smithi072 bash[21573]: audit 2024-03-30T15:14:00.135315+0000 mon.a (mon.0) 1612 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi072-64163-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:00.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:00 smithi072 bash[28946]: audit 2024-03-30T15:13:59.196400+0000 mon.a (mon.0) 1610 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:00.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:00 smithi072 bash[28946]: cluster 2024-03-30T15:13:59.701928+0000 mon.a (mon.0) 1611 : cluster 0 osdmap e182: 8 total, 8 up, 8 in 2024-03-30T15:14:00.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:00 smithi072 bash[28946]: audit 2024-03-30T15:13:59.713294+0000 mon.b (mon.1) 54 : audit 1 from='client.? 172.21.15.72:0/1756819664' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi072-64163-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:00.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:00 smithi072 bash[28946]: audit 2024-03-30T15:14:00.135315+0000 mon.a (mon.0) 1612 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi072-64163-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:00.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:00 smithi172 bash[23680]: audit 2024-03-30T15:13:59.196400+0000 mon.a (mon.0) 1610 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:00.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:00 smithi172 bash[23680]: cluster 2024-03-30T15:13:59.701928+0000 mon.a (mon.0) 1611 : cluster 0 osdmap e182: 8 total, 8 up, 8 in 2024-03-30T15:14:00.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:00 smithi172 bash[23680]: audit 2024-03-30T15:13:59.713294+0000 mon.b (mon.1) 54 : audit 1 from='client.? 172.21.15.72:0/1756819664' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi072-64163-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:00.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:00 smithi172 bash[23680]: audit 2024-03-30T15:14:00.135315+0000 mon.a (mon.0) 1612 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi072-64163-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:01.417 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:14:01 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:14:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:14:01.465 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:14:01 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:14:01.660 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: Running main() from gmock_main.cc 2024-03-30T15:14:01.660 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [==========] Running 42 tests from 2 test suites. 2024-03-30T15:14:01.660 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [----------] Global test environment set-up. 2024-03-30T15:14:01.660 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [----------] 26 tests from LibRadosAio 2024-03-30T15:14:01.660 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ RUN ] LibRadosAio.TooBig 2024-03-30T15:14:01.660 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ OK ] LibRadosAio.TooBig (17082 ms) 2024-03-30T15:14:01.660 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ RUN ] LibRadosAio.SimpleWrite 2024-03-30T15:14:01.660 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ OK ] LibRadosAio.SimpleWrite (14012 ms) 2024-03-30T15:14:01.660 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ RUN ] LibRadosAio.WaitForSafe 2024-03-30T15:14:01.660 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ OK ] LibRadosAio.WaitForSafe (8570 ms) 2024-03-30T15:14:01.660 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip 2024-03-30T15:14:01.661 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip (4376 ms) 2024-03-30T15:14:01.661 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip2 2024-03-30T15:14:01.661 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip2 (10745 ms) 2024-03-30T15:14:01.661 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip3 2024-03-30T15:14:01.661 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip3 (7585 ms) 2024-03-30T15:14:01.661 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripAppend 2024-03-30T15:14:01.661 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ OK ] LibRadosAio.RoundTripAppend (5218 ms) 2024-03-30T15:14:01.661 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ RUN ] LibRadosAio.RemoveTest 2024-03-30T15:14:01.661 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ OK ] LibRadosAio.RemoveTest (5516 ms) 2024-03-30T15:14:01.661 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ RUN ] LibRadosAio.XattrsRoundTrip 2024-03-30T15:14:01.661 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ OK ] LibRadosAio.XattrsRoundTrip (3412 ms) 2024-03-30T15:14:01.661 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ RUN ] LibRadosAio.RmXattr 2024-03-30T15:14:01.661 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ OK ] LibRadosAio.RmXattr (5208 ms) 2024-03-30T15:14:01.661 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ RUN ] LibRadosAio.XattrIter 2024-03-30T15:14:01.661 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ OK ] LibRadosAio.XattrIter (2966 ms) 2024-03-30T15:14:01.662 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ RUN ] LibRadosAio.IsComplete 2024-03-30T15:14:01.662 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ OK ] LibRadosAio.IsComplete (3015 ms) 2024-03-30T15:14:01.662 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ RUN ] LibRadosAio.IsSafe 2024-03-30T15:14:01.662 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ OK ] LibRadosAio.IsSafe (3379 ms) 2024-03-30T15:14:01.662 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ RUN ] LibRadosAio.ReturnValue 2024-03-30T15:14:01.662 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ OK ] LibRadosAio.ReturnValue (2604 ms) 2024-03-30T15:14:01.662 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ RUN ] LibRadosAio.Flush 2024-03-30T15:14:01.662 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ OK ] LibRadosAio.Flush (3021 ms) 2024-03-30T15:14:01.662 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ RUN ] LibRadosAio.FlushAsync 2024-03-30T15:14:01.662 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ OK ] LibRadosAio.FlushAsync (3008 ms) 2024-03-30T15:14:01.662 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteFull 2024-03-30T15:14:01.662 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteFull (2995 ms) 2024-03-30T15:14:01.662 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteSame 2024-03-30T15:14:01.663 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteSame (3011 ms) 2024-03-30T15:14:01.663 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStat 2024-03-30T15:14:01.663 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ OK ] LibRadosAio.SimpleStat (3063 ms) 2024-03-30T15:14:01.663 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ RUN ] LibRadosAio.OperateMtime 2024-03-30T15:14:01.663 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ OK ] LibRadosAio.OperateMtime (3012 ms) 2024-03-30T15:14:01.663 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ RUN ] LibRadosAio.Operate2Mtime 2024-03-30T15:14:01.663 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ OK ] LibRadosAio.Operate2Mtime (2908 ms) 2024-03-30T15:14:01.663 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStatNS 2024-03-30T15:14:01.663 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ OK ] LibRadosAio.SimpleStatNS (3013 ms) 2024-03-30T15:14:01.663 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ RUN ] LibRadosAio.StatRemove 2024-03-30T15:14:01.663 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ OK ] LibRadosAio.StatRemove (3002 ms) 2024-03-30T15:14:01.663 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ RUN ] LibRadosAio.ExecuteClass 2024-03-30T15:14:01.663 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ OK ] LibRadosAio.ExecuteClass (3021 ms) 2024-03-30T15:14:01.663 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ RUN ] LibRadosAio.MultiWrite 2024-03-30T15:14:01.664 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ OK ] LibRadosAio.MultiWrite (3026 ms) 2024-03-30T15:14:01.664 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ RUN ] LibRadosAio.AioUnlock 2024-03-30T15:14:01.664 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ OK ] LibRadosAio.AioUnlock (2950 ms) 2024-03-30T15:14:01.664 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [----------] 26 tests from LibRadosAio (129718 ms total) 2024-03-30T15:14:01.664 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: 2024-03-30T15:14:01.664 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [----------] 16 tests from LibRadosAioEC 2024-03-30T15:14:01.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:01 smithi072 bash[21573]: cluster 2024-03-30T15:13:59.934505+0000 mgr.y (mgr.14526) 267 : cluster 0 pgmap v277: 267 pgs: 32 unknown, 8 creating+peering, 227 active+clean; 586 KiB data, 549 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:14:01.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:01 smithi072 bash[21573]: audit 2024-03-30T15:14:00.594191+0000 mon.a (mon.0) 1613 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:01.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:01 smithi072 bash[21573]: cluster 2024-03-30T15:14:00.628317+0000 mon.a (mon.0) 1614 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:14:01.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:01 smithi072 bash[21573]: audit 2024-03-30T15:14:00.632837+0000 mon.a (mon.0) 1615 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi072-64163-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:01.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:01 smithi072 bash[21573]: cluster 2024-03-30T15:14:00.643865+0000 mon.a (mon.0) 1616 : cluster 0 osdmap e183: 8 total, 8 up, 8 in 2024-03-30T15:14:01.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:01 smithi072 bash[21573]: audit 2024-03-30T15:14:00.648109+0000 mon.c (mon.2) 263 : audit 1 from='client.? 172.21.15.72:0/3750943886' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi072-64171-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:01.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:01 smithi072 bash[21573]: audit 2024-03-30T15:14:00.659463+0000 mon.a (mon.0) 1617 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi072-64171-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:01.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:01 smithi072 bash[21573]: audit 2024-03-30T15:14:00.660115+0000 mon.a (mon.0) 1618 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:01.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:01 smithi072 bash[28946]: cluster 2024-03-30T15:13:59.934505+0000 mgr.y (mgr.14526) 267 : cluster 0 pgmap v277: 267 pgs: 32 unknown, 8 creating+peering, 227 active+clean; 586 KiB data, 549 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:14:01.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:01 smithi072 bash[28946]: audit 2024-03-30T15:14:00.594191+0000 mon.a (mon.0) 1613 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:01.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:01 smithi072 bash[28946]: cluster 2024-03-30T15:14:00.628317+0000 mon.a (mon.0) 1614 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:14:01.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:01 smithi072 bash[28946]: audit 2024-03-30T15:14:00.632837+0000 mon.a (mon.0) 1615 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi072-64163-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:01.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:01 smithi072 bash[28946]: cluster 2024-03-30T15:14:00.643865+0000 mon.a (mon.0) 1616 : cluster 0 osdmap e183: 8 total, 8 up, 8 in 2024-03-30T15:14:01.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:01 smithi072 bash[28946]: audit 2024-03-30T15:14:00.648109+0000 mon.c (mon.2) 263 : audit 1 from='client.? 172.21.15.72:0/3750943886' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi072-64171-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:01.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:01 smithi072 bash[28946]: audit 2024-03-30T15:14:00.659463+0000 mon.a (mon.0) 1617 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi072-64171-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:01.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:01 smithi072 bash[28946]: audit 2024-03-30T15:14:00.660115+0000 mon.a (mon.0) 1618 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:01.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:01 smithi172 bash[23680]: cluster 2024-03-30T15:13:59.934505+0000 mgr.y (mgr.14526) 267 : cluster 0 pgmap v277: 267 pgs: 32 unknown, 8 creating+peering, 227 active+clean; 586 KiB data, 549 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:14:01.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:01 smithi172 bash[23680]: audit 2024-03-30T15:14:00.594191+0000 mon.a (mon.0) 1613 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:01.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:01 smithi172 bash[23680]: cluster 2024-03-30T15:14:00.628317+0000 mon.a (mon.0) 1614 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:14:01.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:01 smithi172 bash[23680]: audit 2024-03-30T15:14:00.632837+0000 mon.a (mon.0) 1615 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi072-64163-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:01.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:01 smithi172 bash[23680]: cluster 2024-03-30T15:14:00.643865+0000 mon.a (mon.0) 1616 : cluster 0 osdmap e183: 8 total, 8 up, 8 in 2024-03-30T15:14:01.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:01 smithi172 bash[23680]: audit 2024-03-30T15:14:00.648109+0000 mon.c (mon.2) 263 : audit 1 from='client.? 172.21.15.72:0/3750943886' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi072-64171-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:01.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:01 smithi172 bash[23680]: audit 2024-03-30T15:14:00.659463+0000 mon.a (mon.0) 1617 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi072-64171-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:01.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:01 smithi172 bash[23680]: audit 2024-03-30T15:14:00.660115+0000 mon.a (mon.0) 1618 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:02.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:02 smithi072 bash[21573]: audit 2024-03-30T15:14:01.063193+0000 mgr.y (mgr.14526) 268 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:14:02.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:02 smithi072 bash[21573]: audit 2024-03-30T15:14:01.595945+0000 mon.a (mon.0) 1619 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:02.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:02 smithi072 bash[21573]: audit 2024-03-30T15:14:01.636227+0000 mon.a (mon.0) 1620 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OmapPP_smithi072-64171-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:02.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:02 smithi072 bash[21573]: audit 2024-03-30T15:14:01.636402+0000 mon.a (mon.0) 1621 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:02.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:02 smithi072 bash[21573]: cluster 2024-03-30T15:14:01.646569+0000 mon.a (mon.0) 1622 : cluster 0 osdmap e184: 8 total, 8 up, 8 in 2024-03-30T15:14:02.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:02 smithi072 bash[21573]: audit 2024-03-30T15:14:01.702489+0000 mon.a (mon.0) 1623 : audit 1 from='client.? 172.21.15.72:0/3953246744' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi072-64163-27"}]: dispatch 2024-03-30T15:14:02.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:02 smithi072 bash[21573]: audit 2024-03-30T15:14:01.706112+0000 mon.a (mon.0) 1624 : audit 1 from='client.? 172.21.15.72:0/3953246744' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi072-64163-27"}]: dispatch 2024-03-30T15:14:02.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:02 smithi072 bash[21573]: audit 2024-03-30T15:14:01.706740+0000 mon.a (mon.0) 1625 : audit 1 from='client.? 172.21.15.72:0/3953246744' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi072-64163-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:02.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:02 smithi072 bash[28946]: audit 2024-03-30T15:14:01.063193+0000 mgr.y (mgr.14526) 268 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:14:02.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:02 smithi072 bash[28946]: audit 2024-03-30T15:14:01.595945+0000 mon.a (mon.0) 1619 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:02.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:02 smithi072 bash[28946]: audit 2024-03-30T15:14:01.636227+0000 mon.a (mon.0) 1620 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OmapPP_smithi072-64171-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:02.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:02 smithi072 bash[28946]: audit 2024-03-30T15:14:01.636402+0000 mon.a (mon.0) 1621 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:02.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:02 smithi072 bash[28946]: cluster 2024-03-30T15:14:01.646569+0000 mon.a (mon.0) 1622 : cluster 0 osdmap e184: 8 total, 8 up, 8 in 2024-03-30T15:14:02.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:02 smithi072 bash[28946]: audit 2024-03-30T15:14:01.702489+0000 mon.a (mon.0) 1623 : audit 1 from='client.? 172.21.15.72:0/3953246744' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi072-64163-27"}]: dispatch 2024-03-30T15:14:02.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:02 smithi072 bash[28946]: audit 2024-03-30T15:14:01.706112+0000 mon.a (mon.0) 1624 : audit 1 from='client.? 172.21.15.72:0/3953246744' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi072-64163-27"}]: dispatch 2024-03-30T15:14:02.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:02 smithi072 bash[28946]: audit 2024-03-30T15:14:01.706740+0000 mon.a (mon.0) 1625 : audit 1 from='client.? 172.21.15.72:0/3953246744' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi072-64163-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:02.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:02 smithi172 bash[23680]: audit 2024-03-30T15:14:01.063193+0000 mgr.y (mgr.14526) 268 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:14:02.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:02 smithi172 bash[23680]: audit 2024-03-30T15:14:01.595945+0000 mon.a (mon.0) 1619 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:02.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:02 smithi172 bash[23680]: audit 2024-03-30T15:14:01.636227+0000 mon.a (mon.0) 1620 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OmapPP_smithi072-64171-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:02.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:02 smithi172 bash[23680]: audit 2024-03-30T15:14:01.636402+0000 mon.a (mon.0) 1621 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:02.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:02 smithi172 bash[23680]: cluster 2024-03-30T15:14:01.646569+0000 mon.a (mon.0) 1622 : cluster 0 osdmap e184: 8 total, 8 up, 8 in 2024-03-30T15:14:02.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:02 smithi172 bash[23680]: audit 2024-03-30T15:14:01.702489+0000 mon.a (mon.0) 1623 : audit 1 from='client.? 172.21.15.72:0/3953246744' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi072-64163-27"}]: dispatch 2024-03-30T15:14:02.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:02 smithi172 bash[23680]: audit 2024-03-30T15:14:01.706112+0000 mon.a (mon.0) 1624 : audit 1 from='client.? 172.21.15.72:0/3953246744' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi072-64163-27"}]: dispatch 2024-03-30T15:14:02.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:02 smithi172 bash[23680]: audit 2024-03-30T15:14:01.706740+0000 mon.a (mon.0) 1625 : audit 1 from='client.? 172.21.15.72:0/3953246744' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi072-64163-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:03.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:03 smithi072 bash[21573]: cluster 2024-03-30T15:14:01.935457+0000 mgr.y (mgr.14526) 269 : cluster 0 pgmap v280: 299 pgs: 64 creating+peering, 235 active+clean; 609 KiB data, 554 MiB used, 715 GiB / 715 GiB avail; 10 KiB/s wr, 1 op/s 2024-03-30T15:14:03.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:03 smithi072 bash[21573]: audit 2024-03-30T15:14:02.597912+0000 mon.a (mon.0) 1626 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:03.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:03 smithi072 bash[21573]: audit 2024-03-30T15:14:02.639403+0000 mon.a (mon.0) 1627 : audit 1 from='client.? 172.21.15.72:0/3953246744' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi072-64163-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:14:03.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:03 smithi072 bash[21573]: cluster 2024-03-30T15:14:02.646968+0000 mon.a (mon.0) 1628 : cluster 0 osdmap e185: 8 total, 8 up, 8 in 2024-03-30T15:14:03.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:03 smithi072 bash[21573]: audit 2024-03-30T15:14:02.648093+0000 mon.a (mon.0) 1629 : audit 1 from='client.? 172.21.15.72:0/3953246744' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi072-64163-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi072-64163-27"}]: dispatch 2024-03-30T15:14:03.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:03 smithi072 bash[21573]: audit 2024-03-30T15:14:03.120110+0000 mon.a (mon.0) 1630 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:14:03.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:03 smithi072 bash[28946]: cluster 2024-03-30T15:14:01.935457+0000 mgr.y (mgr.14526) 269 : cluster 0 pgmap v280: 299 pgs: 64 creating+peering, 235 active+clean; 609 KiB data, 554 MiB used, 715 GiB / 715 GiB avail; 10 KiB/s wr, 1 op/s 2024-03-30T15:14:03.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:03 smithi072 bash[28946]: audit 2024-03-30T15:14:02.597912+0000 mon.a (mon.0) 1626 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:03.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:03 smithi072 bash[28946]: audit 2024-03-30T15:14:02.639403+0000 mon.a (mon.0) 1627 : audit 1 from='client.? 172.21.15.72:0/3953246744' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi072-64163-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:14:03.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:03 smithi072 bash[28946]: cluster 2024-03-30T15:14:02.646968+0000 mon.a (mon.0) 1628 : cluster 0 osdmap e185: 8 total, 8 up, 8 in 2024-03-30T15:14:03.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:03 smithi072 bash[28946]: audit 2024-03-30T15:14:02.648093+0000 mon.a (mon.0) 1629 : audit 1 from='client.? 172.21.15.72:0/3953246744' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi072-64163-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi072-64163-27"}]: dispatch 2024-03-30T15:14:03.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:03 smithi072 bash[28946]: audit 2024-03-30T15:14:03.120110+0000 mon.a (mon.0) 1630 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:14:03.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:03 smithi172 bash[23680]: cluster 2024-03-30T15:14:01.935457+0000 mgr.y (mgr.14526) 269 : cluster 0 pgmap v280: 299 pgs: 64 creating+peering, 235 active+clean; 609 KiB data, 554 MiB used, 715 GiB / 715 GiB avail; 10 KiB/s wr, 1 op/s 2024-03-30T15:14:03.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:03 smithi172 bash[23680]: audit 2024-03-30T15:14:02.597912+0000 mon.a (mon.0) 1626 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:03.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:03 smithi172 bash[23680]: audit 2024-03-30T15:14:02.639403+0000 mon.a (mon.0) 1627 : audit 1 from='client.? 172.21.15.72:0/3953246744' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi072-64163-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:14:03.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:03 smithi172 bash[23680]: cluster 2024-03-30T15:14:02.646968+0000 mon.a (mon.0) 1628 : cluster 0 osdmap e185: 8 total, 8 up, 8 in 2024-03-30T15:14:03.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:03 smithi172 bash[23680]: audit 2024-03-30T15:14:02.648093+0000 mon.a (mon.0) 1629 : audit 1 from='client.? 172.21.15.72:0/3953246744' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi072-64163-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi072-64163-27"}]: dispatch 2024-03-30T15:14:03.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:03 smithi172 bash[23680]: audit 2024-03-30T15:14:03.120110+0000 mon.a (mon.0) 1630 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:14:04.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:04 smithi072 bash[21573]: audit 2024-03-30T15:14:03.600171+0000 mon.a (mon.0) 1631 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:04.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:04 smithi072 bash[21573]: audit 2024-03-30T15:14:03.644444+0000 mon.a (mon.0) 1632 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-15", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:14:04.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:04 smithi072 bash[21573]: cluster 2024-03-30T15:14:04.100166+0000 mon.a (mon.0) 1633 : cluster 0 osdmap e186: 8 total, 8 up, 8 in 2024-03-30T15:14:04.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:04 smithi072 bash[21573]: audit 2024-03-30T15:14:04.100778+0000 mon.a (mon.0) 1634 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-15"}]: dispatch 2024-03-30T15:14:04.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:04 smithi072 bash[21573]: audit 2024-03-30T15:14:04.103230+0000 mon.a (mon.0) 1635 : audit 1 from='client.? 172.21.15.72:0/3464696532' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi072-64171-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:04.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:04 smithi072 bash[21573]: audit 2024-03-30T15:14:04.601903+0000 mon.a (mon.0) 1636 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:04.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:04 smithi072 bash[28946]: audit 2024-03-30T15:14:03.600171+0000 mon.a (mon.0) 1631 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:04.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:04 smithi072 bash[28946]: audit 2024-03-30T15:14:03.644444+0000 mon.a (mon.0) 1632 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-15", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:14:04.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:04 smithi072 bash[28946]: cluster 2024-03-30T15:14:04.100166+0000 mon.a (mon.0) 1633 : cluster 0 osdmap e186: 8 total, 8 up, 8 in 2024-03-30T15:14:04.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:04 smithi072 bash[28946]: audit 2024-03-30T15:14:04.100778+0000 mon.a (mon.0) 1634 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-15"}]: dispatch 2024-03-30T15:14:04.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:04 smithi072 bash[28946]: audit 2024-03-30T15:14:04.103230+0000 mon.a (mon.0) 1635 : audit 1 from='client.? 172.21.15.72:0/3464696532' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi072-64171-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:04.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:04 smithi072 bash[28946]: audit 2024-03-30T15:14:04.601903+0000 mon.a (mon.0) 1636 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:04.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:04 smithi172 bash[23680]: audit 2024-03-30T15:14:03.600171+0000 mon.a (mon.0) 1631 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:04.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:04 smithi172 bash[23680]: audit 2024-03-30T15:14:03.644444+0000 mon.a (mon.0) 1632 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-15", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:14:04.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:04 smithi172 bash[23680]: cluster 2024-03-30T15:14:04.100166+0000 mon.a (mon.0) 1633 : cluster 0 osdmap e186: 8 total, 8 up, 8 in 2024-03-30T15:14:04.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:04 smithi172 bash[23680]: audit 2024-03-30T15:14:04.100778+0000 mon.a (mon.0) 1634 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-15"}]: dispatch 2024-03-30T15:14:04.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:04 smithi172 bash[23680]: audit 2024-03-30T15:14:04.103230+0000 mon.a (mon.0) 1635 : audit 1 from='client.? 172.21.15.72:0/3464696532' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi072-64171-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:04.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:04 smithi172 bash[23680]: audit 2024-03-30T15:14:04.601903+0000 mon.a (mon.0) 1636 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:05.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:05 smithi172 bash[23680]: cluster 2024-03-30T15:14:03.936298+0000 mgr.y (mgr.14526) 270 : cluster 0 pgmap v283: 299 pgs: 32 unknown, 32 creating+peering, 235 active+clean; 609 KiB data, 554 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 10 KiB/s wr, 3 op/s 2024-03-30T15:14:05.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:05 smithi172 bash[23680]: audit 2024-03-30T15:14:04.654356+0000 mon.a (mon.0) 1637 : audit 1 from='client.? 172.21.15.72:0/3953246744' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi072-64163-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi072-64163-27"}]': finished 2024-03-30T15:14:05.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:05 smithi172 bash[23680]: audit 2024-03-30T15:14:04.654580+0000 mon.a (mon.0) 1638 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-15"}]': finished 2024-03-30T15:14:05.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:05 smithi172 bash[23680]: audit 2024-03-30T15:14:04.654700+0000 mon.a (mon.0) 1639 : audit 1 from='client.? 172.21.15.72:0/3464696532' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi072-64171-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:05.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:05 smithi172 bash[23680]: cluster 2024-03-30T15:14:04.659262+0000 mon.a (mon.0) 1640 : cluster 0 osdmap e187: 8 total, 8 up, 8 in 2024-03-30T15:14:05.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:05 smithi172 bash[23680]: audit 2024-03-30T15:14:04.663455+0000 mon.a (mon.0) 1641 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-15", "mode": "writeback"}]: dispatch 2024-03-30T15:14:05.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:05 smithi172 bash[23680]: audit 2024-03-30T15:14:05.603583+0000 mon.a (mon.0) 1642 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:05.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:05 smithi172 bash[23680]: cluster 2024-03-30T15:14:05.631614+0000 mon.a (mon.0) 1643 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:14:05.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:05 smithi172 bash[23680]: audit 2024-03-30T15:14:05.634080+0000 mon.a (mon.0) 1644 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-15", "mode": "writeback"}]': finished 2024-03-30T15:14:05.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:05 smithi172 bash[23680]: cluster 2024-03-30T15:14:05.642328+0000 mon.a (mon.0) 1645 : cluster 0 osdmap e188: 8 total, 8 up, 8 in 2024-03-30T15:14:06.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:05 smithi072 bash[21573]: cluster 2024-03-30T15:14:03.936298+0000 mgr.y (mgr.14526) 270 : cluster 0 pgmap v283: 299 pgs: 32 unknown, 32 creating+peering, 235 active+clean; 609 KiB data, 554 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 10 KiB/s wr, 3 op/s 2024-03-30T15:14:06.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:05 smithi072 bash[21573]: audit 2024-03-30T15:14:04.654356+0000 mon.a (mon.0) 1637 : audit 1 from='client.? 172.21.15.72:0/3953246744' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi072-64163-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi072-64163-27"}]': finished 2024-03-30T15:14:06.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:05 smithi072 bash[21573]: audit 2024-03-30T15:14:04.654580+0000 mon.a (mon.0) 1638 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-15"}]': finished 2024-03-30T15:14:06.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:05 smithi072 bash[21573]: audit 2024-03-30T15:14:04.654700+0000 mon.a (mon.0) 1639 : audit 1 from='client.? 172.21.15.72:0/3464696532' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi072-64171-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:06.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:05 smithi072 bash[21573]: cluster 2024-03-30T15:14:04.659262+0000 mon.a (mon.0) 1640 : cluster 0 osdmap e187: 8 total, 8 up, 8 in 2024-03-30T15:14:06.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:05 smithi072 bash[21573]: audit 2024-03-30T15:14:04.663455+0000 mon.a (mon.0) 1641 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-15", "mode": "writeback"}]: dispatch 2024-03-30T15:14:06.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:05 smithi072 bash[21573]: audit 2024-03-30T15:14:05.603583+0000 mon.a (mon.0) 1642 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:06.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:05 smithi072 bash[21573]: cluster 2024-03-30T15:14:05.631614+0000 mon.a (mon.0) 1643 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:14:06.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:05 smithi072 bash[21573]: audit 2024-03-30T15:14:05.634080+0000 mon.a (mon.0) 1644 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-15", "mode": "writeback"}]': finished 2024-03-30T15:14:06.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:05 smithi072 bash[21573]: cluster 2024-03-30T15:14:05.642328+0000 mon.a (mon.0) 1645 : cluster 0 osdmap e188: 8 total, 8 up, 8 in 2024-03-30T15:14:06.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:05 smithi072 bash[28946]: cluster 2024-03-30T15:14:03.936298+0000 mgr.y (mgr.14526) 270 : cluster 0 pgmap v283: 299 pgs: 32 unknown, 32 creating+peering, 235 active+clean; 609 KiB data, 554 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 10 KiB/s wr, 3 op/s 2024-03-30T15:14:06.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:05 smithi072 bash[28946]: audit 2024-03-30T15:14:04.654356+0000 mon.a (mon.0) 1637 : audit 1 from='client.? 172.21.15.72:0/3953246744' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi072-64163-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi072-64163-27"}]': finished 2024-03-30T15:14:06.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:05 smithi072 bash[28946]: audit 2024-03-30T15:14:04.654580+0000 mon.a (mon.0) 1638 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-15"}]': finished 2024-03-30T15:14:06.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:05 smithi072 bash[28946]: audit 2024-03-30T15:14:04.654700+0000 mon.a (mon.0) 1639 : audit 1 from='client.? 172.21.15.72:0/3464696532' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi072-64171-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:06.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:05 smithi072 bash[28946]: cluster 2024-03-30T15:14:04.659262+0000 mon.a (mon.0) 1640 : cluster 0 osdmap e187: 8 total, 8 up, 8 in 2024-03-30T15:14:06.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:05 smithi072 bash[28946]: audit 2024-03-30T15:14:04.663455+0000 mon.a (mon.0) 1641 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-15", "mode": "writeback"}]: dispatch 2024-03-30T15:14:06.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:05 smithi072 bash[28946]: audit 2024-03-30T15:14:05.603583+0000 mon.a (mon.0) 1642 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:06.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:05 smithi072 bash[28946]: cluster 2024-03-30T15:14:05.631614+0000 mon.a (mon.0) 1643 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:14:06.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:05 smithi072 bash[28946]: audit 2024-03-30T15:14:05.634080+0000 mon.a (mon.0) 1644 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-15", "mode": "writeback"}]': finished 2024-03-30T15:14:06.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:05 smithi072 bash[28946]: cluster 2024-03-30T15:14:05.642328+0000 mon.a (mon.0) 1645 : cluster 0 osdmap e188: 8 total, 8 up, 8 in 2024-03-30T15:14:06.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:06 smithi172 bash[23680]: audit 2024-03-30T15:14:05.672242+0000 mon.c (mon.2) 264 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:14:06.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:06 smithi172 bash[23680]: audit 2024-03-30T15:14:06.605381+0000 mon.a (mon.0) 1646 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:06.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:06 smithi172 bash[23680]: cluster 2024-03-30T15:14:06.650200+0000 mon.a (mon.0) 1647 : cluster 0 osdmap e189: 8 total, 8 up, 8 in 2024-03-30T15:14:06.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:06 smithi172 bash[23680]: audit 2024-03-30T15:14:06.653280+0000 mon.a (mon.0) 1648 : audit 1 from='client.? 172.21.15.72:0/3953246744' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi072-64163-27"}]: dispatch 2024-03-30T15:14:06.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:06 smithi172 bash[23680]: audit 2024-03-30T15:14:06.653459+0000 mon.c (mon.2) 265 : audit 1 from='client.? 172.21.15.72:0/4002048139' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi072-64171-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:06.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:06 smithi172 bash[23680]: audit 2024-03-30T15:14:06.654595+0000 mon.a (mon.0) 1649 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi072-64171-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:07.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:06 smithi072 bash[21573]: audit 2024-03-30T15:14:05.672242+0000 mon.c (mon.2) 264 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:14:07.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:06 smithi072 bash[21573]: audit 2024-03-30T15:14:06.605381+0000 mon.a (mon.0) 1646 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:07.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:06 smithi072 bash[21573]: cluster 2024-03-30T15:14:06.650200+0000 mon.a (mon.0) 1647 : cluster 0 osdmap e189: 8 total, 8 up, 8 in 2024-03-30T15:14:07.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:06 smithi072 bash[21573]: audit 2024-03-30T15:14:06.653280+0000 mon.a (mon.0) 1648 : audit 1 from='client.? 172.21.15.72:0/3953246744' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi072-64163-27"}]: dispatch 2024-03-30T15:14:07.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:06 smithi072 bash[21573]: audit 2024-03-30T15:14:06.653459+0000 mon.c (mon.2) 265 : audit 1 from='client.? 172.21.15.72:0/4002048139' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi072-64171-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:07.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:06 smithi072 bash[21573]: audit 2024-03-30T15:14:06.654595+0000 mon.a (mon.0) 1649 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi072-64171-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:07.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:06 smithi072 bash[28946]: audit 2024-03-30T15:14:05.672242+0000 mon.c (mon.2) 264 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:14:07.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:06 smithi072 bash[28946]: audit 2024-03-30T15:14:06.605381+0000 mon.a (mon.0) 1646 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:07.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:06 smithi072 bash[28946]: cluster 2024-03-30T15:14:06.650200+0000 mon.a (mon.0) 1647 : cluster 0 osdmap e189: 8 total, 8 up, 8 in 2024-03-30T15:14:07.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:06 smithi072 bash[28946]: audit 2024-03-30T15:14:06.653280+0000 mon.a (mon.0) 1648 : audit 1 from='client.? 172.21.15.72:0/3953246744' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi072-64163-27"}]: dispatch 2024-03-30T15:14:07.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:06 smithi072 bash[28946]: audit 2024-03-30T15:14:06.653459+0000 mon.c (mon.2) 265 : audit 1 from='client.? 172.21.15.72:0/4002048139' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi072-64171-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:07.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:06 smithi072 bash[28946]: audit 2024-03-30T15:14:06.654595+0000 mon.a (mon.0) 1649 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi072-64171-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:07.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:07 smithi172 bash[23680]: cluster 2024-03-30T15:14:05.938794+0000 mgr.y (mgr.14526) 271 : cluster 0 pgmap v286: 275 pgs: 4 creating+activating, 271 active+clean; 618 KiB data, 559 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 5.0 KiB/s wr, 4 op/s 2024-03-30T15:14:07.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:07 smithi172 bash[23680]: audit 2024-03-30T15:14:06.716970+0000 mon.a (mon.0) 1650 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:14:07.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:07 smithi172 bash[23680]: audit 2024-03-30T15:14:07.607326+0000 mon.a (mon.0) 1651 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:07.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:07 smithi172 bash[23680]: audit 2024-03-30T15:14:07.641756+0000 mon.a (mon.0) 1652 : audit 1 from='client.? 172.21.15.72:0/3953246744' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi072-64163-27"}]': finished 2024-03-30T15:14:07.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:07 smithi172 bash[23680]: audit 2024-03-30T15:14:07.641928+0000 mon.a (mon.0) 1653 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi072-64171-28","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:07.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:07 smithi172 bash[23680]: audit 2024-03-30T15:14:07.642157+0000 mon.a (mon.0) 1654 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:14:07.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:07 smithi172 bash[23680]: cluster 2024-03-30T15:14:07.649917+0000 mon.a (mon.0) 1655 : cluster 0 osdmap e190: 8 total, 8 up, 8 in 2024-03-30T15:14:07.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:07 smithi172 bash[23680]: audit 2024-03-30T15:14:07.658826+0000 mon.a (mon.0) 1656 : audit 1 from='client.? 172.21.15.72:0/3953246744' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi072-64163-27"}]: dispatch 2024-03-30T15:14:07.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:07 smithi172 bash[23680]: audit 2024-03-30T15:14:07.660383+0000 mon.a (mon.0) 1657 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-15"}]: dispatch 2024-03-30T15:14:08.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:07 smithi072 bash[21573]: cluster 2024-03-30T15:14:05.938794+0000 mgr.y (mgr.14526) 271 : cluster 0 pgmap v286: 275 pgs: 4 creating+activating, 271 active+clean; 618 KiB data, 559 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 5.0 KiB/s wr, 4 op/s 2024-03-30T15:14:08.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:07 smithi072 bash[21573]: audit 2024-03-30T15:14:06.716970+0000 mon.a (mon.0) 1650 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:14:08.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:07 smithi072 bash[21573]: audit 2024-03-30T15:14:07.607326+0000 mon.a (mon.0) 1651 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:08.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:07 smithi072 bash[21573]: audit 2024-03-30T15:14:07.641756+0000 mon.a (mon.0) 1652 : audit 1 from='client.? 172.21.15.72:0/3953246744' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi072-64163-27"}]': finished 2024-03-30T15:14:08.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:07 smithi072 bash[21573]: audit 2024-03-30T15:14:07.641928+0000 mon.a (mon.0) 1653 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi072-64171-28","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:08.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:07 smithi072 bash[21573]: audit 2024-03-30T15:14:07.642157+0000 mon.a (mon.0) 1654 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:14:08.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:07 smithi072 bash[21573]: cluster 2024-03-30T15:14:07.649917+0000 mon.a (mon.0) 1655 : cluster 0 osdmap e190: 8 total, 8 up, 8 in 2024-03-30T15:14:08.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:07 smithi072 bash[21573]: audit 2024-03-30T15:14:07.658826+0000 mon.a (mon.0) 1656 : audit 1 from='client.? 172.21.15.72:0/3953246744' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi072-64163-27"}]: dispatch 2024-03-30T15:14:08.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:07 smithi072 bash[21573]: audit 2024-03-30T15:14:07.660383+0000 mon.a (mon.0) 1657 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-15"}]: dispatch 2024-03-30T15:14:08.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:07 smithi072 bash[28946]: cluster 2024-03-30T15:14:05.938794+0000 mgr.y (mgr.14526) 271 : cluster 0 pgmap v286: 275 pgs: 4 creating+activating, 271 active+clean; 618 KiB data, 559 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 5.0 KiB/s wr, 4 op/s 2024-03-30T15:14:08.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:07 smithi072 bash[28946]: audit 2024-03-30T15:14:06.716970+0000 mon.a (mon.0) 1650 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:14:08.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:07 smithi072 bash[28946]: audit 2024-03-30T15:14:07.607326+0000 mon.a (mon.0) 1651 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:08.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:07 smithi072 bash[28946]: audit 2024-03-30T15:14:07.641756+0000 mon.a (mon.0) 1652 : audit 1 from='client.? 172.21.15.72:0/3953246744' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi072-64163-27"}]': finished 2024-03-30T15:14:08.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:07 smithi072 bash[28946]: audit 2024-03-30T15:14:07.641928+0000 mon.a (mon.0) 1653 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi072-64171-28","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:08.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:07 smithi072 bash[28946]: audit 2024-03-30T15:14:07.642157+0000 mon.a (mon.0) 1654 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:14:08.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:07 smithi072 bash[28946]: cluster 2024-03-30T15:14:07.649917+0000 mon.a (mon.0) 1655 : cluster 0 osdmap e190: 8 total, 8 up, 8 in 2024-03-30T15:14:08.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:07 smithi072 bash[28946]: audit 2024-03-30T15:14:07.658826+0000 mon.a (mon.0) 1656 : audit 1 from='client.? 172.21.15.72:0/3953246744' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi072-64163-27"}]: dispatch 2024-03-30T15:14:08.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:07 smithi072 bash[28946]: audit 2024-03-30T15:14:07.660383+0000 mon.a (mon.0) 1657 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-15"}]: dispatch 2024-03-30T15:14:09.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:09 smithi072 bash[28946]: audit 2024-03-30T15:14:08.580534+0000 mon.c (mon.2) 266 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:14:09.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:09 smithi072 bash[28946]: audit 2024-03-30T15:14:08.609086+0000 mon.a (mon.0) 1658 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:09.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:09 smithi072 bash[28946]: cluster 2024-03-30T15:14:08.642465+0000 mon.a (mon.0) 1659 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:14:09.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:09 smithi072 bash[28946]: audit 2024-03-30T15:14:08.644569+0000 mon.a (mon.0) 1660 : audit 1 from='client.? 172.21.15.72:0/3953246744' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi072-64163-27"}]': finished 2024-03-30T15:14:09.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:09 smithi072 bash[28946]: audit 2024-03-30T15:14:08.644740+0000 mon.a (mon.0) 1661 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-15"}]': finished 2024-03-30T15:14:09.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:09 smithi072 bash[28946]: cluster 2024-03-30T15:14:08.650631+0000 mon.a (mon.0) 1662 : cluster 0 osdmap e191: 8 total, 8 up, 8 in 2024-03-30T15:14:09.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:09 smithi072 bash[28946]: audit 2024-03-30T15:14:08.653505+0000 mon.a (mon.0) 1663 : audit 1 from='client.? 172.21.15.72:0/179484884' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi072-64386-21"}]: dispatch 2024-03-30T15:14:09.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:09 smithi072 bash[21573]: audit 2024-03-30T15:14:08.580534+0000 mon.c (mon.2) 266 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:14:09.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:09 smithi072 bash[21573]: audit 2024-03-30T15:14:08.609086+0000 mon.a (mon.0) 1658 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:09.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:09 smithi072 bash[21573]: cluster 2024-03-30T15:14:08.642465+0000 mon.a (mon.0) 1659 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:14:09.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:09 smithi072 bash[21573]: audit 2024-03-30T15:14:08.644569+0000 mon.a (mon.0) 1660 : audit 1 from='client.? 172.21.15.72:0/3953246744' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi072-64163-27"}]': finished 2024-03-30T15:14:09.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:09 smithi072 bash[21573]: audit 2024-03-30T15:14:08.644740+0000 mon.a (mon.0) 1661 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-15"}]': finished 2024-03-30T15:14:09.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:09 smithi072 bash[21573]: cluster 2024-03-30T15:14:08.650631+0000 mon.a (mon.0) 1662 : cluster 0 osdmap e191: 8 total, 8 up, 8 in 2024-03-30T15:14:09.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:09 smithi072 bash[21573]: audit 2024-03-30T15:14:08.653505+0000 mon.a (mon.0) 1663 : audit 1 from='client.? 172.21.15.72:0/179484884' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi072-64386-21"}]: dispatch 2024-03-30T15:14:09.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:09 smithi172 bash[23680]: audit 2024-03-30T15:14:08.580534+0000 mon.c (mon.2) 266 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:14:09.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:09 smithi172 bash[23680]: audit 2024-03-30T15:14:08.609086+0000 mon.a (mon.0) 1658 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:09.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:09 smithi172 bash[23680]: cluster 2024-03-30T15:14:08.642465+0000 mon.a (mon.0) 1659 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:14:09.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:09 smithi172 bash[23680]: audit 2024-03-30T15:14:08.644569+0000 mon.a (mon.0) 1660 : audit 1 from='client.? 172.21.15.72:0/3953246744' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi072-64163-27"}]': finished 2024-03-30T15:14:09.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:09 smithi172 bash[23680]: audit 2024-03-30T15:14:08.644740+0000 mon.a (mon.0) 1661 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-15"}]': finished 2024-03-30T15:14:09.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:09 smithi172 bash[23680]: cluster 2024-03-30T15:14:08.650631+0000 mon.a (mon.0) 1662 : cluster 0 osdmap e191: 8 total, 8 up, 8 in 2024-03-30T15:14:09.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:09 smithi172 bash[23680]: audit 2024-03-30T15:14:08.653505+0000 mon.a (mon.0) 1663 : audit 1 from='client.? 172.21.15.72:0/179484884' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi072-64386-21"}]: dispatch 2024-03-30T15:14:10.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:10 smithi072 bash[28946]: cluster 2024-03-30T15:14:07.939757+0000 mgr.y (mgr.14526) 272 : cluster 0 pgmap v289: 299 pgs: 32 unknown, 267 active+clean; 617 KiB data, 559 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 4.5 KiB/s wr, 3 op/s 2024-03-30T15:14:10.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:10 smithi072 bash[28946]: cluster 2024-03-30T15:14:08.695642+0000 mon.a (mon.0) 1664 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:14:10.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:10 smithi072 bash[28946]: audit 2024-03-30T15:14:08.705657+0000 mon.c (mon.2) 267 : audit 1 from='client.? 172.21.15.72:0/2439594461' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi072-64163-28"}]: dispatch 2024-03-30T15:14:10.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:10 smithi072 bash[28946]: audit 2024-03-30T15:14:09.152073+0000 mon.a (mon.0) 1665 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi072-64163-28"}]: dispatch 2024-03-30T15:14:10.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:10 smithi072 bash[28946]: audit 2024-03-30T15:14:09.152747+0000 mon.c (mon.2) 268 : audit 1 from='client.? 172.21.15.72:0/2439594461' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi072-64163-28"}]: dispatch 2024-03-30T15:14:10.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:10 smithi072 bash[28946]: audit 2024-03-30T15:14:09.153032+0000 mon.a (mon.0) 1666 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi072-64163-28"}]: dispatch 2024-03-30T15:14:10.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:10 smithi072 bash[28946]: audit 2024-03-30T15:14:09.153491+0000 mon.c (mon.2) 269 : audit 1 from='client.? 172.21.15.72:0/2439594461' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi072-64163-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:10.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:10 smithi072 bash[28946]: audit 2024-03-30T15:14:09.153766+0000 mon.a (mon.0) 1667 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi072-64163-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:10.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:10 smithi072 bash[28946]: audit 2024-03-30T15:14:09.332721+0000 mon.c (mon.2) 270 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:14:10.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:10 smithi072 bash[28946]: audit 2024-03-30T15:14:09.334313+0000 mon.c (mon.2) 271 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:14:10.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:10 smithi072 bash[28946]: audit 2024-03-30T15:14:09.346608+0000 mon.a (mon.0) 1668 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:14:10.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:10 smithi072 bash[28946]: audit 2024-03-30T15:14:09.610899+0000 mon.a (mon.0) 1669 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:10.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:10 smithi072 bash[28946]: audit 2024-03-30T15:14:09.648878+0000 mon.a (mon.0) 1670 : audit 1 from='client.? 172.21.15.72:0/179484884' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi072-64386-21"}]': finished 2024-03-30T15:14:10.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:10 smithi072 bash[28946]: audit 2024-03-30T15:14:09.649071+0000 mon.a (mon.0) 1671 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi072-64163-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:14:10.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:10 smithi072 bash[28946]: cluster 2024-03-30T15:14:09.656439+0000 mon.a (mon.0) 1672 : cluster 0 osdmap e192: 8 total, 8 up, 8 in 2024-03-30T15:14:10.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:10 smithi072 bash[28946]: audit 2024-03-30T15:14:09.668628+0000 mon.a (mon.0) 1673 : audit 1 from='client.? 172.21.15.72:0/179484884' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi072-64386-21"}]: dispatch 2024-03-30T15:14:10.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:10 smithi072 bash[21573]: cluster 2024-03-30T15:14:07.939757+0000 mgr.y (mgr.14526) 272 : cluster 0 pgmap v289: 299 pgs: 32 unknown, 267 active+clean; 617 KiB data, 559 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 4.5 KiB/s wr, 3 op/s 2024-03-30T15:14:10.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:10 smithi072 bash[21573]: cluster 2024-03-30T15:14:08.695642+0000 mon.a (mon.0) 1664 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:14:10.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:10 smithi072 bash[21573]: audit 2024-03-30T15:14:08.705657+0000 mon.c (mon.2) 267 : audit 1 from='client.? 172.21.15.72:0/2439594461' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi072-64163-28"}]: dispatch 2024-03-30T15:14:10.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:10 smithi072 bash[21573]: audit 2024-03-30T15:14:09.152073+0000 mon.a (mon.0) 1665 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi072-64163-28"}]: dispatch 2024-03-30T15:14:10.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:10 smithi072 bash[21573]: audit 2024-03-30T15:14:09.152747+0000 mon.c (mon.2) 268 : audit 1 from='client.? 172.21.15.72:0/2439594461' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi072-64163-28"}]: dispatch 2024-03-30T15:14:10.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:10 smithi072 bash[21573]: audit 2024-03-30T15:14:09.153032+0000 mon.a (mon.0) 1666 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi072-64163-28"}]: dispatch 2024-03-30T15:14:10.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:10 smithi072 bash[21573]: audit 2024-03-30T15:14:09.153491+0000 mon.c (mon.2) 269 : audit 1 from='client.? 172.21.15.72:0/2439594461' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi072-64163-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:10.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:10 smithi072 bash[21573]: audit 2024-03-30T15:14:09.153766+0000 mon.a (mon.0) 1667 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi072-64163-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:10.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:10 smithi072 bash[21573]: audit 2024-03-30T15:14:09.332721+0000 mon.c (mon.2) 270 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:14:10.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:10 smithi072 bash[21573]: audit 2024-03-30T15:14:09.334313+0000 mon.c (mon.2) 271 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:14:10.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:10 smithi072 bash[21573]: audit 2024-03-30T15:14:09.346608+0000 mon.a (mon.0) 1668 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:14:10.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:10 smithi072 bash[21573]: audit 2024-03-30T15:14:09.610899+0000 mon.a (mon.0) 1669 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:10.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:10 smithi072 bash[21573]: audit 2024-03-30T15:14:09.648878+0000 mon.a (mon.0) 1670 : audit 1 from='client.? 172.21.15.72:0/179484884' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi072-64386-21"}]': finished 2024-03-30T15:14:10.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:10 smithi072 bash[21573]: audit 2024-03-30T15:14:09.649071+0000 mon.a (mon.0) 1671 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi072-64163-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:14:10.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:10 smithi072 bash[21573]: cluster 2024-03-30T15:14:09.656439+0000 mon.a (mon.0) 1672 : cluster 0 osdmap e192: 8 total, 8 up, 8 in 2024-03-30T15:14:10.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:10 smithi072 bash[21573]: audit 2024-03-30T15:14:09.668628+0000 mon.a (mon.0) 1673 : audit 1 from='client.? 172.21.15.72:0/179484884' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi072-64386-21"}]: dispatch 2024-03-30T15:14:10.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:10 smithi072 bash[21573]: audit 2024-03-30T15:14:09.670433+0000 mon.a (mon.0) 1674 : audit 1 from='client.? 172.21.15.72:0/3027124599' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi072-64171-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:10.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:10 smithi072 bash[21573]: audit 2024-03-30T15:14:09.670448+0000 mon.c (mon.2) 272 : audit 1 from='client.? 172.21.15.72:0/2439594461' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi072-64163-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi072-64163-28"}]: dispatch 2024-03-30T15:14:10.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:10 smithi072 bash[21573]: audit 2024-03-30T15:14:09.679595+0000 mon.a (mon.0) 1675 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi072-64163-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi072-64163-28"}]: dispatch 2024-03-30T15:14:10.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:10 smithi072 bash[28946]: audit 2024-03-30T15:14:09.670433+0000 mon.a (mon.0) 1674 : audit 1 from='client.? 172.21.15.72:0/3027124599' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi072-64171-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:10.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:10 smithi072 bash[28946]: audit 2024-03-30T15:14:09.670448+0000 mon.c (mon.2) 272 : audit 1 from='client.? 172.21.15.72:0/2439594461' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi072-64163-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi072-64163-28"}]: dispatch 2024-03-30T15:14:10.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:10 smithi072 bash[28946]: audit 2024-03-30T15:14:09.679595+0000 mon.a (mon.0) 1675 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi072-64163-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi072-64163-28"}]: dispatch 2024-03-30T15:14:10.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:10 smithi172 bash[23680]: cluster 2024-03-30T15:14:07.939757+0000 mgr.y (mgr.14526) 272 : cluster 0 pgmap v289: 299 pgs: 32 unknown, 267 active+clean; 617 KiB data, 559 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 4.5 KiB/s wr, 3 op/s 2024-03-30T15:14:10.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:10 smithi172 bash[23680]: cluster 2024-03-30T15:14:08.695642+0000 mon.a (mon.0) 1664 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:14:10.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:10 smithi172 bash[23680]: audit 2024-03-30T15:14:08.705657+0000 mon.c (mon.2) 267 : audit 1 from='client.? 172.21.15.72:0/2439594461' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi072-64163-28"}]: dispatch 2024-03-30T15:14:10.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:10 smithi172 bash[23680]: audit 2024-03-30T15:14:09.152073+0000 mon.a (mon.0) 1665 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi072-64163-28"}]: dispatch 2024-03-30T15:14:10.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:10 smithi172 bash[23680]: audit 2024-03-30T15:14:09.152747+0000 mon.c (mon.2) 268 : audit 1 from='client.? 172.21.15.72:0/2439594461' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi072-64163-28"}]: dispatch 2024-03-30T15:14:10.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:10 smithi172 bash[23680]: audit 2024-03-30T15:14:09.153032+0000 mon.a (mon.0) 1666 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi072-64163-28"}]: dispatch 2024-03-30T15:14:10.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:10 smithi172 bash[23680]: audit 2024-03-30T15:14:09.153491+0000 mon.c (mon.2) 269 : audit 1 from='client.? 172.21.15.72:0/2439594461' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi072-64163-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:10.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:10 smithi172 bash[23680]: audit 2024-03-30T15:14:09.153766+0000 mon.a (mon.0) 1667 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi072-64163-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:10.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:10 smithi172 bash[23680]: audit 2024-03-30T15:14:09.332721+0000 mon.c (mon.2) 270 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:14:10.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:10 smithi172 bash[23680]: audit 2024-03-30T15:14:09.334313+0000 mon.c (mon.2) 271 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:14:10.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:10 smithi172 bash[23680]: audit 2024-03-30T15:14:09.346608+0000 mon.a (mon.0) 1668 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:14:10.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:10 smithi172 bash[23680]: audit 2024-03-30T15:14:09.610899+0000 mon.a (mon.0) 1669 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:10.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:10 smithi172 bash[23680]: audit 2024-03-30T15:14:09.648878+0000 mon.a (mon.0) 1670 : audit 1 from='client.? 172.21.15.72:0/179484884' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi072-64386-21"}]': finished 2024-03-30T15:14:10.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:10 smithi172 bash[23680]: audit 2024-03-30T15:14:09.649071+0000 mon.a (mon.0) 1671 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi072-64163-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:14:10.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:10 smithi172 bash[23680]: cluster 2024-03-30T15:14:09.656439+0000 mon.a (mon.0) 1672 : cluster 0 osdmap e192: 8 total, 8 up, 8 in 2024-03-30T15:14:10.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:10 smithi172 bash[23680]: audit 2024-03-30T15:14:09.668628+0000 mon.a (mon.0) 1673 : audit 1 from='client.? 172.21.15.72:0/179484884' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi072-64386-21"}]: dispatch 2024-03-30T15:14:10.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:10 smithi172 bash[23680]: audit 2024-03-30T15:14:09.670433+0000 mon.a (mon.0) 1674 : audit 1 from='client.? 172.21.15.72:0/3027124599' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi072-64171-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:10.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:10 smithi172 bash[23680]: audit 2024-03-30T15:14:09.670448+0000 mon.c (mon.2) 272 : audit 1 from='client.? 172.21.15.72:0/2439594461' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi072-64163-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi072-64163-28"}]: dispatch 2024-03-30T15:14:10.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:10 smithi172 bash[23680]: audit 2024-03-30T15:14:09.679595+0000 mon.a (mon.0) 1675 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi072-64163-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi072-64163-28"}]: dispatch 2024-03-30T15:14:11.127 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleWripp: [ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2024-03-30T15:14:11.127 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapGetNamePP (2008 ms) 2024-03-30T15:14:11.127 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP (8922 ms total) 2024-03-30T15:14:11.127 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: 2024-03-30T15:14:11.127 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2024-03-30T15:14:11.127 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2024-03-30T15:14:11.127 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.SnapPP (4081 ms) 2024-03-30T15:14:11.127 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2024-03-30T15:14:11.127 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (4333 ms) 2024-03-30T15:14:11.127 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2024-03-30T15:14:11.127 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (3560 ms) 2024-03-30T15:14:11.127 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (11974 ms total) 2024-03-30T15:14:11.128 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: 2024-03-30T15:14:11.128 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [----------] Global test environment tear-down 2024-03-30T15:14:11.128 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [==========] 21 tests from 5 test suites ran. (139081 ms total) 2024-03-30T15:14:11.128 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [ PASSED ] 20 tests. 2024-03-30T15:14:11.128 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [ SKIPPED ] 1 test, listed below: 2024-03-30T15:14:11.128 INFO:tasks.workunit.client.0.smithi072.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-03-30T15:14:11.417 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:14:11 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:14:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:14:11.428 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:11 smithi072 bash[21573]: cluster 2024-03-30T15:14:09.940660+0000 mgr.y (mgr.14526) 273 : cluster 0 pgmap v292: 259 pgs: 32 unknown, 227 active+clean; 585 KiB data, 559 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:14:11.428 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:11 smithi072 bash[21573]: audit 2024-03-30T15:14:10.612796+0000 mon.a (mon.0) 1676 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:11.428 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:11 smithi072 bash[21573]: audit 2024-03-30T15:14:10.659529+0000 mon.a (mon.0) 1677 : audit 1 from='client.? 172.21.15.72:0/179484884' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi072-64386-21"}]': finished 2024-03-30T15:14:11.428 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:11 smithi072 bash[21573]: audit 2024-03-30T15:14:10.659694+0000 mon.a (mon.0) 1678 : audit 1 from='client.? 172.21.15.72:0/3027124599' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi072-64171-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:11.428 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:11 smithi072 bash[21573]: cluster 2024-03-30T15:14:11.122774+0000 mon.a (mon.0) 1679 : cluster 0 osdmap e193: 8 total, 8 up, 8 in 2024-03-30T15:14:11.428 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:11 smithi072 bash[21573]: audit 2024-03-30T15:14:11.125269+0000 mon.a (mon.0) 1680 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:11.429 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:11 smithi072 bash[28946]: cluster 2024-03-30T15:14:09.940660+0000 mgr.y (mgr.14526) 273 : cluster 0 pgmap v292: 259 pgs: 32 unknown, 227 active+clean; 585 KiB data, 559 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:14:11.429 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:11 smithi072 bash[28946]: audit 2024-03-30T15:14:10.612796+0000 mon.a (mon.0) 1676 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:11.429 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:11 smithi072 bash[28946]: audit 2024-03-30T15:14:10.659529+0000 mon.a (mon.0) 1677 : audit 1 from='client.? 172.21.15.72:0/179484884' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi072-64386-21"}]': finished 2024-03-30T15:14:11.429 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:11 smithi072 bash[28946]: audit 2024-03-30T15:14:10.659694+0000 mon.a (mon.0) 1678 : audit 1 from='client.? 172.21.15.72:0/3027124599' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi072-64171-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:11.430 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:11 smithi072 bash[28946]: cluster 2024-03-30T15:14:11.122774+0000 mon.a (mon.0) 1679 : cluster 0 osdmap e193: 8 total, 8 up, 8 in 2024-03-30T15:14:11.430 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:11 smithi072 bash[28946]: audit 2024-03-30T15:14:11.125269+0000 mon.a (mon.0) 1680 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:11.465 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:14:11 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:14:11.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:11 smithi172 bash[23680]: cluster 2024-03-30T15:14:09.940660+0000 mgr.y (mgr.14526) 273 : cluster 0 pgmap v292: 259 pgs: 32 unknown, 227 active+clean; 585 KiB data, 559 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:14:11.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:11 smithi172 bash[23680]: audit 2024-03-30T15:14:10.612796+0000 mon.a (mon.0) 1676 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:11.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:11 smithi172 bash[23680]: audit 2024-03-30T15:14:10.659529+0000 mon.a (mon.0) 1677 : audit 1 from='client.? 172.21.15.72:0/179484884' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi072-64386-21"}]': finished 2024-03-30T15:14:11.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:11 smithi172 bash[23680]: audit 2024-03-30T15:14:10.659694+0000 mon.a (mon.0) 1678 : audit 1 from='client.? 172.21.15.72:0/3027124599' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi072-64171-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:11.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:11 smithi172 bash[23680]: cluster 2024-03-30T15:14:11.122774+0000 mon.a (mon.0) 1679 : cluster 0 osdmap e193: 8 total, 8 up, 8 in 2024-03-30T15:14:11.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:11 smithi172 bash[23680]: audit 2024-03-30T15:14:11.125269+0000 mon.a (mon.0) 1680 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:11.684 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: Running main() from gmock_main.cc 2024-03-30T15:14:11.684 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [==========] Running 57 tests from 4 test suites. 2024-03-30T15:14:11.685 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [----------] Global test environment set-up. 2024-03-30T15:14:11.685 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio 2024-03-30T15:14:11.685 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAio.TooBigPP 2024-03-30T15:14:11.685 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAio.TooBigPP (17084 ms) 2024-03-30T15:14:11.685 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolQuotaPP 2024-03-30T15:14:11.685 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolQuotaPP (29233 ms) 2024-03-30T15:14:11.685 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleWritePP 2024-03-30T15:14:11.685 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleWritePP (16126 ms) 2024-03-30T15:14:11.685 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAio.WaitForSafePP 2024-03-30T15:14:11.685 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAio.WaitForSafePP (5150 ms) 2024-03-30T15:14:11.685 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP 2024-03-30T15:14:11.685 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP (4608 ms) 2024-03-30T15:14:11.685 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP2 2024-03-30T15:14:11.685 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP2 (3316 ms) 2024-03-30T15:14:11.685 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP3 2024-03-30T15:14:11.686 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP3 (3871 ms) 2024-03-30T15:14:11.686 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripSparseReadPP 2024-03-30T15:14:11.686 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripSparseReadPP (3352 ms) 2024-03-30T15:14:11.686 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsCompletePP 2024-03-30T15:14:11.686 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAio.IsCompletePP (2963 ms) 2024-03-30T15:14:11.686 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsSafePP 2024-03-30T15:14:11.686 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAio.IsSafePP (3880 ms) 2024-03-30T15:14:11.686 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAio.ReturnValuePP 2024-03-30T15:14:11.686 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAio.ReturnValuePP (2518 ms) 2024-03-30T15:14:11.686 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushPP 2024-03-30T15:14:11.686 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushPP (2594 ms) 2024-03-30T15:14:11.686 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushAsyncPP 2024-03-30T15:14:11.686 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushAsyncPP (3018 ms) 2024-03-30T15:14:11.687 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP 2024-03-30T15:14:11.687 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP (2989 ms) 2024-03-30T15:14:11.687 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP2 2024-03-30T15:14:11.687 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP2 (3016 ms) 2024-03-30T15:14:11.687 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP 2024-03-30T15:14:11.687 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP (3051 ms) 2024-03-30T15:14:11.687 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP2 2024-03-30T15:14:11.687 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP2 (3024 ms) 2024-03-30T15:14:11.687 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPPNS 2024-03-30T15:14:11.687 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPPNS (3027 ms) 2024-03-30T15:14:11.687 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPP 2024-03-30T15:14:11.687 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPP (2883 ms) 2024-03-30T15:14:11.687 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime 2024-03-30T15:14:11.687 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime (2999 ms) 2024-03-30T15:14:11.687 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime2 2024-03-30T15:14:11.688 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime2 (3025 ms) 2024-03-30T15:14:11.688 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAio.StatRemovePP 2024-03-30T15:14:11.688 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAio.StatRemovePP (3028 ms) 2024-03-30T15:14:11.688 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAio.ExecuteClassPP 2024-03-30T15:14:11.688 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAio.ExecuteClassPP (3015 ms) 2024-03-30T15:14:11.688 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAio.OmapPP 2024-03-30T15:14:11.688 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAio.OmapPP (2939 ms) 2024-03-30T15:14:11.688 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiWritePP 2024-03-30T15:14:11.688 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiWritePP (2999 ms) 2024-03-30T15:14:11.688 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAio.AioUnlockPP 2024-03-30T15:14:11.688 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAio.AioUnlockPP (3009 ms) 2024-03-30T15:14:11.688 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripAppendPP 2024-03-30T15:14:12.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:12 smithi172 bash[23680]: audit 2024-03-30T15:14:11.074584+0000 mgr.y (mgr.14526) 274 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:14:12.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:12 smithi172 bash[23680]: audit 2024-03-30T15:14:11.614619+0000 mon.a (mon.0) 1681 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:12.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:12 smithi172 bash[23680]: audit 2024-03-30T15:14:11.663430+0000 mon.a (mon.0) 1682 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi072-64163-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi072-64163-28"}]': finished 2024-03-30T15:14:12.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:12 smithi172 bash[23680]: audit 2024-03-30T15:14:11.663670+0000 mon.a (mon.0) 1683 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:12.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:12 smithi172 bash[23680]: cluster 2024-03-30T15:14:11.671905+0000 mon.a (mon.0) 1684 : cluster 0 osdmap e194: 8 total, 8 up, 8 in 2024-03-30T15:14:12.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:12 smithi172 bash[23680]: audit 2024-03-30T15:14:11.734632+0000 mon.a (mon.0) 1685 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:14:12.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:12 smithi072 bash[21573]: audit 2024-03-30T15:14:11.074584+0000 mgr.y (mgr.14526) 274 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:14:12.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:12 smithi072 bash[21573]: audit 2024-03-30T15:14:11.614619+0000 mon.a (mon.0) 1681 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:12.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:12 smithi072 bash[21573]: audit 2024-03-30T15:14:11.663430+0000 mon.a (mon.0) 1682 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi072-64163-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi072-64163-28"}]': finished 2024-03-30T15:14:12.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:12 smithi072 bash[21573]: audit 2024-03-30T15:14:11.663670+0000 mon.a (mon.0) 1683 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:12.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:12 smithi072 bash[21573]: cluster 2024-03-30T15:14:11.671905+0000 mon.a (mon.0) 1684 : cluster 0 osdmap e194: 8 total, 8 up, 8 in 2024-03-30T15:14:12.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:12 smithi072 bash[21573]: audit 2024-03-30T15:14:11.734632+0000 mon.a (mon.0) 1685 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:14:12.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:12 smithi072 bash[28946]: audit 2024-03-30T15:14:11.074584+0000 mgr.y (mgr.14526) 274 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:14:12.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:12 smithi072 bash[28946]: audit 2024-03-30T15:14:11.614619+0000 mon.a (mon.0) 1681 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:12.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:12 smithi072 bash[28946]: audit 2024-03-30T15:14:11.663430+0000 mon.a (mon.0) 1682 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi072-64163-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi072-64163-28"}]': finished 2024-03-30T15:14:12.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:12 smithi072 bash[28946]: audit 2024-03-30T15:14:11.663670+0000 mon.a (mon.0) 1683 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:12.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:12 smithi072 bash[28946]: cluster 2024-03-30T15:14:11.671905+0000 mon.a (mon.0) 1684 : cluster 0 osdmap e194: 8 total, 8 up, 8 in 2024-03-30T15:14:12.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:12 smithi072 bash[28946]: audit 2024-03-30T15:14:11.734632+0000 mon.a (mon.0) 1685 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:14:13.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:13 smithi172 bash[23680]: cluster 2024-03-30T15:14:11.941561+0000 mgr.y (mgr.14526) 275 : cluster 0 pgmap v295: 267 pgs: 23 creating+peering, 17 unknown, 227 active+clean; 585 KiB data, 568 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:14:13.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:13 smithi172 bash[23680]: audit 2024-03-30T15:14:12.616428+0000 mon.a (mon.0) 1686 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:13.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:13 smithi172 bash[23680]: audit 2024-03-30T15:14:12.674674+0000 mon.a (mon.0) 1687 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-17", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:14:13.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:13 smithi172 bash[23680]: cluster 2024-03-30T15:14:12.683179+0000 mon.a (mon.0) 1688 : cluster 0 osdmap e195: 8 total, 8 up, 8 in 2024-03-30T15:14:13.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:13 smithi172 bash[23680]: audit 2024-03-30T15:14:12.687365+0000 mon.a (mon.0) 1689 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-17"}]: dispatch 2024-03-30T15:14:13.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:13 smithi172 bash[23680]: audit 2024-03-30T15:14:12.705220+0000 mon.c (mon.2) 273 : audit 1 from='client.? 172.21.15.72:0/97405934' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi072-64171-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:13.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:13 smithi172 bash[23680]: audit 2024-03-30T15:14:12.706280+0000 mon.a (mon.0) 1690 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi072-64171-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:13.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:13 smithi072 bash[21573]: cluster 2024-03-30T15:14:11.941561+0000 mgr.y (mgr.14526) 275 : cluster 0 pgmap v295: 267 pgs: 23 creating+peering, 17 unknown, 227 active+clean; 585 KiB data, 568 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:14:13.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:13 smithi072 bash[21573]: audit 2024-03-30T15:14:12.616428+0000 mon.a (mon.0) 1686 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:13.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:13 smithi072 bash[21573]: audit 2024-03-30T15:14:12.674674+0000 mon.a (mon.0) 1687 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-17", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:14:13.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:13 smithi072 bash[21573]: cluster 2024-03-30T15:14:12.683179+0000 mon.a (mon.0) 1688 : cluster 0 osdmap e195: 8 total, 8 up, 8 in 2024-03-30T15:14:13.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:13 smithi072 bash[21573]: audit 2024-03-30T15:14:12.687365+0000 mon.a (mon.0) 1689 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-17"}]: dispatch 2024-03-30T15:14:13.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:13 smithi072 bash[21573]: audit 2024-03-30T15:14:12.705220+0000 mon.c (mon.2) 273 : audit 1 from='client.? 172.21.15.72:0/97405934' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi072-64171-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:13.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:13 smithi072 bash[21573]: audit 2024-03-30T15:14:12.706280+0000 mon.a (mon.0) 1690 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi072-64171-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:13.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:13 smithi072 bash[28946]: cluster 2024-03-30T15:14:11.941561+0000 mgr.y (mgr.14526) 275 : cluster 0 pgmap v295: 267 pgs: 23 creating+peering, 17 unknown, 227 active+clean; 585 KiB data, 568 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:14:13.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:13 smithi072 bash[28946]: audit 2024-03-30T15:14:12.616428+0000 mon.a (mon.0) 1686 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:13.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:13 smithi072 bash[28946]: audit 2024-03-30T15:14:12.674674+0000 mon.a (mon.0) 1687 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-17", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:14:13.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:13 smithi072 bash[28946]: cluster 2024-03-30T15:14:12.683179+0000 mon.a (mon.0) 1688 : cluster 0 osdmap e195: 8 total, 8 up, 8 in 2024-03-30T15:14:13.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:13 smithi072 bash[28946]: audit 2024-03-30T15:14:12.687365+0000 mon.a (mon.0) 1689 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-17"}]: dispatch 2024-03-30T15:14:13.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:13 smithi072 bash[28946]: audit 2024-03-30T15:14:12.705220+0000 mon.c (mon.2) 273 : audit 1 from='client.? 172.21.15.72:0/97405934' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi072-64171-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:13.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:13 smithi072 bash[28946]: audit 2024-03-30T15:14:12.706280+0000 mon.a (mon.0) 1690 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi072-64171-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:14.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:14 smithi172 bash[23680]: audit 2024-03-30T15:14:13.618280+0000 mon.a (mon.0) 1691 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:14.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:14 smithi172 bash[23680]: audit 2024-03-30T15:14:13.679066+0000 mon.a (mon.0) 1692 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-17"}]': finished 2024-03-30T15:14:14.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:14 smithi172 bash[23680]: audit 2024-03-30T15:14:13.679286+0000 mon.a (mon.0) 1693 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi072-64171-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:14.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:14 smithi172 bash[23680]: cluster 2024-03-30T15:14:13.693114+0000 mon.a (mon.0) 1694 : cluster 0 osdmap e196: 8 total, 8 up, 8 in 2024-03-30T15:14:14.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:14 smithi172 bash[23680]: audit 2024-03-30T15:14:13.695005+0000 mon.a (mon.0) 1695 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-17", "mode": "writeback"}]: dispatch 2024-03-30T15:14:14.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:14 smithi172 bash[23680]: audit 2024-03-30T15:14:13.700654+0000 mon.c (mon.2) 274 : audit 1 from='client.? 172.21.15.72:0/2439594461' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi072-64163-28"}]: dispatch 2024-03-30T15:14:14.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:14 smithi172 bash[23680]: audit 2024-03-30T15:14:13.701584+0000 mon.a (mon.0) 1696 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi072-64163-28"}]: dispatch 2024-03-30T15:14:14.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:14 smithi072 bash[21573]: audit 2024-03-30T15:14:13.618280+0000 mon.a (mon.0) 1691 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:14.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:14 smithi072 bash[21573]: audit 2024-03-30T15:14:13.679066+0000 mon.a (mon.0) 1692 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-17"}]': finished 2024-03-30T15:14:14.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:14 smithi072 bash[21573]: audit 2024-03-30T15:14:13.679286+0000 mon.a (mon.0) 1693 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi072-64171-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:14.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:14 smithi072 bash[21573]: cluster 2024-03-30T15:14:13.693114+0000 mon.a (mon.0) 1694 : cluster 0 osdmap e196: 8 total, 8 up, 8 in 2024-03-30T15:14:14.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:14 smithi072 bash[21573]: audit 2024-03-30T15:14:13.695005+0000 mon.a (mon.0) 1695 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-17", "mode": "writeback"}]: dispatch 2024-03-30T15:14:14.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:14 smithi072 bash[21573]: audit 2024-03-30T15:14:13.700654+0000 mon.c (mon.2) 274 : audit 1 from='client.? 172.21.15.72:0/2439594461' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi072-64163-28"}]: dispatch 2024-03-30T15:14:14.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:14 smithi072 bash[21573]: audit 2024-03-30T15:14:13.701584+0000 mon.a (mon.0) 1696 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi072-64163-28"}]: dispatch 2024-03-30T15:14:14.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:14 smithi072 bash[28946]: audit 2024-03-30T15:14:13.618280+0000 mon.a (mon.0) 1691 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:14.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:14 smithi072 bash[28946]: audit 2024-03-30T15:14:13.679066+0000 mon.a (mon.0) 1692 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-17"}]': finished 2024-03-30T15:14:14.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:14 smithi072 bash[28946]: audit 2024-03-30T15:14:13.679286+0000 mon.a (mon.0) 1693 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi072-64171-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:14.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:14 smithi072 bash[28946]: cluster 2024-03-30T15:14:13.693114+0000 mon.a (mon.0) 1694 : cluster 0 osdmap e196: 8 total, 8 up, 8 in 2024-03-30T15:14:14.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:14 smithi072 bash[28946]: audit 2024-03-30T15:14:13.695005+0000 mon.a (mon.0) 1695 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-17", "mode": "writeback"}]: dispatch 2024-03-30T15:14:14.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:14 smithi072 bash[28946]: audit 2024-03-30T15:14:13.700654+0000 mon.c (mon.2) 274 : audit 1 from='client.? 172.21.15.72:0/2439594461' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi072-64163-28"}]: dispatch 2024-03-30T15:14:14.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:14 smithi072 bash[28946]: audit 2024-03-30T15:14:13.701584+0000 mon.a (mon.0) 1696 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi072-64163-28"}]: dispatch 2024-03-30T15:14:15.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:15 smithi172 bash[23680]: cluster 2024-03-30T15:14:13.942462+0000 mgr.y (mgr.14526) 276 : cluster 0 pgmap v298: 291 pgs: 23 creating+peering, 41 unknown, 227 active+clean; 585 KiB data, 568 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:14:15.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:15 smithi172 bash[23680]: audit 2024-03-30T15:14:14.620060+0000 mon.a (mon.0) 1697 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:15.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:15 smithi172 bash[23680]: cluster 2024-03-30T15:14:14.678977+0000 mon.a (mon.0) 1698 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:14:15.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:15 smithi172 bash[23680]: cluster 2024-03-30T15:14:14.680305+0000 mon.a (mon.0) 1699 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:14:15.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:15 smithi172 bash[23680]: audit 2024-03-30T15:14:14.690094+0000 mon.a (mon.0) 1700 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-17", "mode": "writeback"}]': finished 2024-03-30T15:14:15.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:15 smithi172 bash[23680]: audit 2024-03-30T15:14:14.690302+0000 mon.a (mon.0) 1701 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi072-64163-28"}]': finished 2024-03-30T15:14:15.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:15 smithi172 bash[23680]: audit 2024-03-30T15:14:14.700326+0000 mon.c (mon.2) 275 : audit 1 from='client.? 172.21.15.72:0/2439594461' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi072-64163-28"}]: dispatch 2024-03-30T15:14:15.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:15 smithi172 bash[23680]: cluster 2024-03-30T15:14:14.701909+0000 mon.a (mon.0) 1702 : cluster 0 osdmap e197: 8 total, 8 up, 8 in 2024-03-30T15:14:15.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:15 smithi172 bash[23680]: audit 2024-03-30T15:14:14.708693+0000 mon.a (mon.0) 1703 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi072-64163-28"}]: dispatch 2024-03-30T15:14:15.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:15 smithi072 bash[21573]: cluster 2024-03-30T15:14:13.942462+0000 mgr.y (mgr.14526) 276 : cluster 0 pgmap v298: 291 pgs: 23 creating+peering, 41 unknown, 227 active+clean; 585 KiB data, 568 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:14:15.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:15 smithi072 bash[21573]: audit 2024-03-30T15:14:14.620060+0000 mon.a (mon.0) 1697 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:15.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:15 smithi072 bash[21573]: cluster 2024-03-30T15:14:14.678977+0000 mon.a (mon.0) 1698 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:14:15.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:15 smithi072 bash[21573]: cluster 2024-03-30T15:14:14.680305+0000 mon.a (mon.0) 1699 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:14:15.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:15 smithi072 bash[21573]: audit 2024-03-30T15:14:14.690094+0000 mon.a (mon.0) 1700 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-17", "mode": "writeback"}]': finished 2024-03-30T15:14:15.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:15 smithi072 bash[21573]: audit 2024-03-30T15:14:14.690302+0000 mon.a (mon.0) 1701 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi072-64163-28"}]': finished 2024-03-30T15:14:15.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:15 smithi072 bash[21573]: audit 2024-03-30T15:14:14.700326+0000 mon.c (mon.2) 275 : audit 1 from='client.? 172.21.15.72:0/2439594461' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi072-64163-28"}]: dispatch 2024-03-30T15:14:15.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:15 smithi072 bash[21573]: cluster 2024-03-30T15:14:14.701909+0000 mon.a (mon.0) 1702 : cluster 0 osdmap e197: 8 total, 8 up, 8 in 2024-03-30T15:14:15.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:15 smithi072 bash[21573]: audit 2024-03-30T15:14:14.708693+0000 mon.a (mon.0) 1703 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi072-64163-28"}]: dispatch 2024-03-30T15:14:15.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:15 smithi072 bash[28946]: cluster 2024-03-30T15:14:13.942462+0000 mgr.y (mgr.14526) 276 : cluster 0 pgmap v298: 291 pgs: 23 creating+peering, 41 unknown, 227 active+clean; 585 KiB data, 568 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:14:15.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:15 smithi072 bash[28946]: audit 2024-03-30T15:14:14.620060+0000 mon.a (mon.0) 1697 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:15.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:15 smithi072 bash[28946]: cluster 2024-03-30T15:14:14.678977+0000 mon.a (mon.0) 1698 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:14:15.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:15 smithi072 bash[28946]: cluster 2024-03-30T15:14:14.680305+0000 mon.a (mon.0) 1699 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:14:15.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:15 smithi072 bash[28946]: audit 2024-03-30T15:14:14.690094+0000 mon.a (mon.0) 1700 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-17", "mode": "writeback"}]': finished 2024-03-30T15:14:15.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:15 smithi072 bash[28946]: audit 2024-03-30T15:14:14.690302+0000 mon.a (mon.0) 1701 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi072-64163-28"}]': finished 2024-03-30T15:14:15.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:15 smithi072 bash[28946]: audit 2024-03-30T15:14:14.700326+0000 mon.c (mon.2) 275 : audit 1 from='client.? 172.21.15.72:0/2439594461' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi072-64163-28"}]: dispatch 2024-03-30T15:14:15.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:15 smithi072 bash[28946]: cluster 2024-03-30T15:14:14.701909+0000 mon.a (mon.0) 1702 : cluster 0 osdmap e197: 8 total, 8 up, 8 in 2024-03-30T15:14:15.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:15 smithi072 bash[28946]: audit 2024-03-30T15:14:14.708693+0000 mon.a (mon.0) 1703 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi072-64163-28"}]: dispatch 2024-03-30T15:14:16.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:16 smithi172 bash[23680]: audit 2024-03-30T15:14:15.188269+0000 mon.a (mon.0) 1704 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:14:16.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:16 smithi172 bash[23680]: audit 2024-03-30T15:14:15.621728+0000 mon.a (mon.0) 1705 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:16.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:16 smithi172 bash[23680]: audit 2024-03-30T15:14:15.639920+0000 mon.a (mon.0) 1706 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi072-64163-28"}]': finished 2024-03-30T15:14:16.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:16 smithi172 bash[23680]: audit 2024-03-30T15:14:15.640142+0000 mon.a (mon.0) 1707 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:14:16.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:16 smithi172 bash[23680]: cluster 2024-03-30T15:14:15.648193+0000 mon.a (mon.0) 1708 : cluster 0 osdmap e198: 8 total, 8 up, 8 in 2024-03-30T15:14:16.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:16 smithi172 bash[23680]: audit 2024-03-30T15:14:15.652498+0000 mon.a (mon.0) 1709 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-17"}]: dispatch 2024-03-30T15:14:16.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:16 smithi172 bash[23680]: audit 2024-03-30T15:14:15.656810+0000 mon.a (mon.0) 1710 : audit 1 from='client.? 172.21.15.72:0/3721623226' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi072-64171-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:16.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:16 smithi172 bash[23680]: audit 2024-03-30T15:14:15.684458+0000 mon.c (mon.2) 276 : audit 1 from='client.? 172.21.15.72:0/1861199061' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi072-64163-29"}]: dispatch 2024-03-30T15:14:16.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:16 smithi172 bash[23680]: audit 2024-03-30T15:14:15.684826+0000 mon.a (mon.0) 1711 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi072-64163-29"}]: dispatch 2024-03-30T15:14:16.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:16 smithi172 bash[23680]: audit 2024-03-30T15:14:15.685460+0000 mon.c (mon.2) 277 : audit 1 from='client.? 172.21.15.72:0/1861199061' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi072-64163-29"}]: dispatch 2024-03-30T15:14:16.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:16 smithi172 bash[23680]: audit 2024-03-30T15:14:15.685769+0000 mon.a (mon.0) 1712 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi072-64163-29"}]: dispatch 2024-03-30T15:14:16.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:16 smithi172 bash[23680]: audit 2024-03-30T15:14:15.686285+0000 mon.c (mon.2) 278 : audit 1 from='client.? 172.21.15.72:0/1861199061' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi072-64163-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:16.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:16 smithi172 bash[23680]: audit 2024-03-30T15:14:15.686577+0000 mon.a (mon.0) 1713 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi072-64163-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:16.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:16 smithi072 bash[21573]: audit 2024-03-30T15:14:15.188269+0000 mon.a (mon.0) 1704 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:14:16.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:16 smithi072 bash[21573]: audit 2024-03-30T15:14:15.621728+0000 mon.a (mon.0) 1705 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:16.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:16 smithi072 bash[21573]: audit 2024-03-30T15:14:15.639920+0000 mon.a (mon.0) 1706 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi072-64163-28"}]': finished 2024-03-30T15:14:16.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:16 smithi072 bash[21573]: audit 2024-03-30T15:14:15.640142+0000 mon.a (mon.0) 1707 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:14:16.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:16 smithi072 bash[21573]: cluster 2024-03-30T15:14:15.648193+0000 mon.a (mon.0) 1708 : cluster 0 osdmap e198: 8 total, 8 up, 8 in 2024-03-30T15:14:16.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:16 smithi072 bash[21573]: audit 2024-03-30T15:14:15.652498+0000 mon.a (mon.0) 1709 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-17"}]: dispatch 2024-03-30T15:14:16.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:16 smithi072 bash[21573]: audit 2024-03-30T15:14:15.656810+0000 mon.a (mon.0) 1710 : audit 1 from='client.? 172.21.15.72:0/3721623226' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi072-64171-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:16.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:16 smithi072 bash[21573]: audit 2024-03-30T15:14:15.684458+0000 mon.c (mon.2) 276 : audit 1 from='client.? 172.21.15.72:0/1861199061' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi072-64163-29"}]: dispatch 2024-03-30T15:14:16.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:16 smithi072 bash[21573]: audit 2024-03-30T15:14:15.684826+0000 mon.a (mon.0) 1711 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi072-64163-29"}]: dispatch 2024-03-30T15:14:16.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:16 smithi072 bash[21573]: audit 2024-03-30T15:14:15.685460+0000 mon.c (mon.2) 277 : audit 1 from='client.? 172.21.15.72:0/1861199061' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi072-64163-29"}]: dispatch 2024-03-30T15:14:16.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:16 smithi072 bash[21573]: audit 2024-03-30T15:14:15.685769+0000 mon.a (mon.0) 1712 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi072-64163-29"}]: dispatch 2024-03-30T15:14:16.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:16 smithi072 bash[21573]: audit 2024-03-30T15:14:15.686285+0000 mon.c (mon.2) 278 : audit 1 from='client.? 172.21.15.72:0/1861199061' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi072-64163-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:16.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:16 smithi072 bash[21573]: audit 2024-03-30T15:14:15.686577+0000 mon.a (mon.0) 1713 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi072-64163-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:16.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:16 smithi072 bash[28946]: audit 2024-03-30T15:14:15.188269+0000 mon.a (mon.0) 1704 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:14:16.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:16 smithi072 bash[28946]: audit 2024-03-30T15:14:15.621728+0000 mon.a (mon.0) 1705 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:16.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:16 smithi072 bash[28946]: audit 2024-03-30T15:14:15.639920+0000 mon.a (mon.0) 1706 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi072-64163-28"}]': finished 2024-03-30T15:14:16.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:16 smithi072 bash[28946]: audit 2024-03-30T15:14:15.640142+0000 mon.a (mon.0) 1707 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:14:16.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:16 smithi072 bash[28946]: cluster 2024-03-30T15:14:15.648193+0000 mon.a (mon.0) 1708 : cluster 0 osdmap e198: 8 total, 8 up, 8 in 2024-03-30T15:14:16.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:16 smithi072 bash[28946]: audit 2024-03-30T15:14:15.652498+0000 mon.a (mon.0) 1709 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-17"}]: dispatch 2024-03-30T15:14:16.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:16 smithi072 bash[28946]: audit 2024-03-30T15:14:15.656810+0000 mon.a (mon.0) 1710 : audit 1 from='client.? 172.21.15.72:0/3721623226' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi072-64171-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:16.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:16 smithi072 bash[28946]: audit 2024-03-30T15:14:15.684458+0000 mon.c (mon.2) 276 : audit 1 from='client.? 172.21.15.72:0/1861199061' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi072-64163-29"}]: dispatch 2024-03-30T15:14:16.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:16 smithi072 bash[28946]: audit 2024-03-30T15:14:15.684826+0000 mon.a (mon.0) 1711 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi072-64163-29"}]: dispatch 2024-03-30T15:14:16.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:16 smithi072 bash[28946]: audit 2024-03-30T15:14:15.685460+0000 mon.c (mon.2) 277 : audit 1 from='client.? 172.21.15.72:0/1861199061' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi072-64163-29"}]: dispatch 2024-03-30T15:14:16.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:16 smithi072 bash[28946]: audit 2024-03-30T15:14:15.685769+0000 mon.a (mon.0) 1712 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi072-64163-29"}]: dispatch 2024-03-30T15:14:16.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:16 smithi072 bash[28946]: audit 2024-03-30T15:14:15.686285+0000 mon.c (mon.2) 278 : audit 1 from='client.? 172.21.15.72:0/1861199061' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi072-64163-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:16.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:16 smithi072 bash[28946]: audit 2024-03-30T15:14:15.686577+0000 mon.a (mon.0) 1713 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi072-64163-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:17.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:17 smithi172 bash[23680]: cluster 2024-03-30T15:14:15.945046+0000 mgr.y (mgr.14526) 277 : cluster 0 pgmap v301: 291 pgs: 32 creating+peering, 259 active+clean; 585 KiB data, 577 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 3 op/s 2024-03-30T15:14:17.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:17 smithi172 bash[23680]: audit 2024-03-30T15:14:16.623514+0000 mon.a (mon.0) 1714 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:17.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:17 smithi172 bash[23680]: cluster 2024-03-30T15:14:16.641202+0000 mon.a (mon.0) 1715 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:14:17.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:17 smithi172 bash[23680]: audit 2024-03-30T15:14:16.649466+0000 mon.a (mon.0) 1716 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-17"}]': finished 2024-03-30T15:14:17.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:17 smithi172 bash[23680]: audit 2024-03-30T15:14:16.649668+0000 mon.a (mon.0) 1717 : audit 1 from='client.? 172.21.15.72:0/3721623226' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi072-64171-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:17.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:17 smithi172 bash[23680]: audit 2024-03-30T15:14:16.649879+0000 mon.a (mon.0) 1718 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi072-64163-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:14:17.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:17 smithi172 bash[23680]: cluster 2024-03-30T15:14:16.658408+0000 mon.a (mon.0) 1719 : cluster 0 osdmap e199: 8 total, 8 up, 8 in 2024-03-30T15:14:17.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:17 smithi172 bash[23680]: audit 2024-03-30T15:14:16.662716+0000 mon.c (mon.2) 279 : audit 1 from='client.? 172.21.15.72:0/1861199061' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi072-64163-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi072-64163-29"}]: dispatch 2024-03-30T15:14:17.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:17 smithi172 bash[23680]: audit 2024-03-30T15:14:16.663609+0000 mon.a (mon.0) 1720 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi072-64163-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi072-64163-29"}]: dispatch 2024-03-30T15:14:17.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:17 smithi072 bash[21573]: cluster 2024-03-30T15:14:15.945046+0000 mgr.y (mgr.14526) 277 : cluster 0 pgmap v301: 291 pgs: 32 creating+peering, 259 active+clean; 585 KiB data, 577 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 3 op/s 2024-03-30T15:14:17.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:17 smithi072 bash[21573]: audit 2024-03-30T15:14:16.623514+0000 mon.a (mon.0) 1714 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:17.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:17 smithi072 bash[21573]: cluster 2024-03-30T15:14:16.641202+0000 mon.a (mon.0) 1715 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:14:17.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:17 smithi072 bash[21573]: audit 2024-03-30T15:14:16.649466+0000 mon.a (mon.0) 1716 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-17"}]': finished 2024-03-30T15:14:17.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:17 smithi072 bash[21573]: audit 2024-03-30T15:14:16.649668+0000 mon.a (mon.0) 1717 : audit 1 from='client.? 172.21.15.72:0/3721623226' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi072-64171-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:17.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:17 smithi072 bash[21573]: audit 2024-03-30T15:14:16.649879+0000 mon.a (mon.0) 1718 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi072-64163-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:14:17.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:17 smithi072 bash[21573]: cluster 2024-03-30T15:14:16.658408+0000 mon.a (mon.0) 1719 : cluster 0 osdmap e199: 8 total, 8 up, 8 in 2024-03-30T15:14:17.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:17 smithi072 bash[21573]: audit 2024-03-30T15:14:16.662716+0000 mon.c (mon.2) 279 : audit 1 from='client.? 172.21.15.72:0/1861199061' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi072-64163-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi072-64163-29"}]: dispatch 2024-03-30T15:14:17.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:17 smithi072 bash[21573]: audit 2024-03-30T15:14:16.663609+0000 mon.a (mon.0) 1720 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi072-64163-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi072-64163-29"}]: dispatch 2024-03-30T15:14:17.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:17 smithi072 bash[28946]: cluster 2024-03-30T15:14:15.945046+0000 mgr.y (mgr.14526) 277 : cluster 0 pgmap v301: 291 pgs: 32 creating+peering, 259 active+clean; 585 KiB data, 577 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 3 op/s 2024-03-30T15:14:17.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:17 smithi072 bash[28946]: audit 2024-03-30T15:14:16.623514+0000 mon.a (mon.0) 1714 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:17.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:17 smithi072 bash[28946]: cluster 2024-03-30T15:14:16.641202+0000 mon.a (mon.0) 1715 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:14:17.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:17 smithi072 bash[28946]: audit 2024-03-30T15:14:16.649466+0000 mon.a (mon.0) 1716 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-17"}]': finished 2024-03-30T15:14:17.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:17 smithi072 bash[28946]: audit 2024-03-30T15:14:16.649668+0000 mon.a (mon.0) 1717 : audit 1 from='client.? 172.21.15.72:0/3721623226' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi072-64171-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:17.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:17 smithi072 bash[28946]: audit 2024-03-30T15:14:16.649879+0000 mon.a (mon.0) 1718 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi072-64163-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:14:17.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:17 smithi072 bash[28946]: cluster 2024-03-30T15:14:16.658408+0000 mon.a (mon.0) 1719 : cluster 0 osdmap e199: 8 total, 8 up, 8 in 2024-03-30T15:14:17.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:17 smithi072 bash[28946]: audit 2024-03-30T15:14:16.662716+0000 mon.c (mon.2) 279 : audit 1 from='client.? 172.21.15.72:0/1861199061' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi072-64163-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi072-64163-29"}]: dispatch 2024-03-30T15:14:17.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:17 smithi072 bash[28946]: audit 2024-03-30T15:14:16.663609+0000 mon.a (mon.0) 1720 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi072-64163-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi072-64163-29"}]: dispatch 2024-03-30T15:14:19.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:18 smithi172 bash[23680]: audit 2024-03-30T15:14:17.625195+0000 mon.a (mon.0) 1721 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:19.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:18 smithi172 bash[23680]: audit 2024-03-30T15:14:17.946608+0000 mon.c (mon.2) 280 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi072-64203-1", "var": "pgp_num_actual", "val": "30"}]: dispatch 2024-03-30T15:14:19.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:18 smithi172 bash[23680]: cluster 2024-03-30T15:14:18.111905+0000 mon.a (mon.0) 1722 : cluster 0 osdmap e200: 8 total, 8 up, 8 in 2024-03-30T15:14:19.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:18 smithi172 bash[23680]: audit 2024-03-30T15:14:18.115867+0000 mon.a (mon.0) 1723 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi072-64203-1", "var": "pgp_num_actual", "val": "30"}]: dispatch 2024-03-30T15:14:19.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:18 smithi072 bash[21573]: audit 2024-03-30T15:14:17.625195+0000 mon.a (mon.0) 1721 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:19.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:18 smithi072 bash[21573]: audit 2024-03-30T15:14:17.946608+0000 mon.c (mon.2) 280 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi072-64203-1", "var": "pgp_num_actual", "val": "30"}]: dispatch 2024-03-30T15:14:19.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:18 smithi072 bash[21573]: cluster 2024-03-30T15:14:18.111905+0000 mon.a (mon.0) 1722 : cluster 0 osdmap e200: 8 total, 8 up, 8 in 2024-03-30T15:14:19.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:18 smithi072 bash[21573]: audit 2024-03-30T15:14:18.115867+0000 mon.a (mon.0) 1723 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi072-64203-1", "var": "pgp_num_actual", "val": "30"}]: dispatch 2024-03-30T15:14:19.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:18 smithi072 bash[28946]: audit 2024-03-30T15:14:17.625195+0000 mon.a (mon.0) 1721 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:19.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:18 smithi072 bash[28946]: audit 2024-03-30T15:14:17.946608+0000 mon.c (mon.2) 280 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi072-64203-1", "var": "pgp_num_actual", "val": "30"}]: dispatch 2024-03-30T15:14:19.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:18 smithi072 bash[28946]: cluster 2024-03-30T15:14:18.111905+0000 mon.a (mon.0) 1722 : cluster 0 osdmap e200: 8 total, 8 up, 8 in 2024-03-30T15:14:19.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:18 smithi072 bash[28946]: audit 2024-03-30T15:14:18.115867+0000 mon.a (mon.0) 1723 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi072-64203-1", "var": "pgp_num_actual", "val": "30"}]: dispatch 2024-03-30T15:14:20.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:19 smithi172 bash[23680]: cluster 2024-03-30T15:14:17.945943+0000 mgr.y (mgr.14526) 278 : cluster 0 pgmap v304: 227 pgs: 227 active+clean; 585 KiB data, 577 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-03-30T15:14:20.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:19 smithi172 bash[23680]: audit 2024-03-30T15:14:18.977337+0000 mon.a (mon.0) 1724 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:20.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:19 smithi172 bash[23680]: audit 2024-03-30T15:14:18.979183+0000 mon.a (mon.0) 1725 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip_smithi072-64163-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi072-64163-29"}]': finished 2024-03-30T15:14:20.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:19 smithi172 bash[23680]: audit 2024-03-30T15:14:18.979243+0000 mon.a (mon.0) 1726 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi072-64203-1", "var": "pgp_num_actual", "val": "30"}]': finished 2024-03-30T15:14:20.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:19 smithi172 bash[23680]: cluster 2024-03-30T15:14:18.982384+0000 mon.a (mon.0) 1727 : cluster 0 osdmap e201: 8 total, 8 up, 8 in 2024-03-30T15:14:20.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:19 smithi172 bash[23680]: audit 2024-03-30T15:14:18.983817+0000 mon.a (mon.0) 1728 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:20.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:19 smithi172 bash[23680]: audit 2024-03-30T15:14:18.995612+0000 mon.c (mon.2) 281 : audit 1 from='client.? 172.21.15.72:0/4066455560' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi072-64171-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:20.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:19 smithi172 bash[23680]: audit 2024-03-30T15:14:19.002166+0000 mon.a (mon.0) 1729 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi072-64171-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:20.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:19 smithi072 bash[21573]: cluster 2024-03-30T15:14:17.945943+0000 mgr.y (mgr.14526) 278 : cluster 0 pgmap v304: 227 pgs: 227 active+clean; 585 KiB data, 577 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-03-30T15:14:20.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:19 smithi072 bash[21573]: audit 2024-03-30T15:14:18.977337+0000 mon.a (mon.0) 1724 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:20.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:19 smithi072 bash[21573]: audit 2024-03-30T15:14:18.979183+0000 mon.a (mon.0) 1725 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip_smithi072-64163-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi072-64163-29"}]': finished 2024-03-30T15:14:20.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:19 smithi072 bash[21573]: audit 2024-03-30T15:14:18.979243+0000 mon.a (mon.0) 1726 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi072-64203-1", "var": "pgp_num_actual", "val": "30"}]': finished 2024-03-30T15:14:20.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:19 smithi072 bash[21573]: cluster 2024-03-30T15:14:18.982384+0000 mon.a (mon.0) 1727 : cluster 0 osdmap e201: 8 total, 8 up, 8 in 2024-03-30T15:14:20.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:19 smithi072 bash[21573]: audit 2024-03-30T15:14:18.983817+0000 mon.a (mon.0) 1728 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:20.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:19 smithi072 bash[21573]: audit 2024-03-30T15:14:18.995612+0000 mon.c (mon.2) 281 : audit 1 from='client.? 172.21.15.72:0/4066455560' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi072-64171-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:20.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:19 smithi072 bash[21573]: audit 2024-03-30T15:14:19.002166+0000 mon.a (mon.0) 1729 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi072-64171-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:20.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:19 smithi072 bash[28946]: cluster 2024-03-30T15:14:17.945943+0000 mgr.y (mgr.14526) 278 : cluster 0 pgmap v304: 227 pgs: 227 active+clean; 585 KiB data, 577 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-03-30T15:14:20.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:19 smithi072 bash[28946]: audit 2024-03-30T15:14:18.977337+0000 mon.a (mon.0) 1724 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:20.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:19 smithi072 bash[28946]: audit 2024-03-30T15:14:18.979183+0000 mon.a (mon.0) 1725 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip_smithi072-64163-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi072-64163-29"}]': finished 2024-03-30T15:14:20.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:19 smithi072 bash[28946]: audit 2024-03-30T15:14:18.979243+0000 mon.a (mon.0) 1726 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi072-64203-1", "var": "pgp_num_actual", "val": "30"}]': finished 2024-03-30T15:14:20.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:19 smithi072 bash[28946]: cluster 2024-03-30T15:14:18.982384+0000 mon.a (mon.0) 1727 : cluster 0 osdmap e201: 8 total, 8 up, 8 in 2024-03-30T15:14:20.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:19 smithi072 bash[28946]: audit 2024-03-30T15:14:18.983817+0000 mon.a (mon.0) 1728 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:20.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:19 smithi072 bash[28946]: audit 2024-03-30T15:14:18.995612+0000 mon.c (mon.2) 281 : audit 1 from='client.? 172.21.15.72:0/4066455560' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi072-64171-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:20.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:19 smithi072 bash[28946]: audit 2024-03-30T15:14:19.002166+0000 mon.a (mon.0) 1729 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi072-64171-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:21.417 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:14:21 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:14:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:14:21.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:20 smithi072 bash[21573]: cluster 2024-03-30T15:14:19.946951+0000 mgr.y (mgr.14526) 279 : cluster 0 pgmap v306: 299 pgs: 72 unknown, 227 active+clean; 585 KiB data, 577 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 475 B/s wr, 1 op/s 2024-03-30T15:14:21.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:20 smithi072 bash[21573]: audit 2024-03-30T15:14:19.978970+0000 mon.a (mon.0) 1730 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:21.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:20 smithi072 bash[21573]: cluster 2024-03-30T15:14:19.979440+0000 mon.a (mon.0) 1731 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:14:21.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:20 smithi072 bash[21573]: audit 2024-03-30T15:14:19.991275+0000 mon.a (mon.0) 1732 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:21.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:20 smithi072 bash[21573]: audit 2024-03-30T15:14:19.991475+0000 mon.a (mon.0) 1733 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi072-64171-32","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:21.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:20 smithi072 bash[21573]: cluster 2024-03-30T15:14:19.999750+0000 mon.a (mon.0) 1734 : cluster 0 osdmap e202: 8 total, 8 up, 8 in 2024-03-30T15:14:21.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:20 smithi072 bash[21573]: audit 2024-03-30T15:14:20.006547+0000 mon.a (mon.0) 1735 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:14:21.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:20 smithi072 bash[21573]: audit 2024-03-30T15:14:20.129843+0000 mon.a (mon.0) 1736 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:21.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:20 smithi072 bash[21573]: audit 2024-03-30T15:14:20.716409+0000 mon.a (mon.0) 1737 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:14:21.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:20 smithi072 bash[21573]: audit 2024-03-30T15:14:20.721479+0000 mon.c (mon.2) 282 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:14:21.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:20 smithi072 bash[28946]: cluster 2024-03-30T15:14:19.946951+0000 mgr.y (mgr.14526) 279 : cluster 0 pgmap v306: 299 pgs: 72 unknown, 227 active+clean; 585 KiB data, 577 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 475 B/s wr, 1 op/s 2024-03-30T15:14:21.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:20 smithi072 bash[28946]: audit 2024-03-30T15:14:19.978970+0000 mon.a (mon.0) 1730 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:21.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:20 smithi072 bash[28946]: cluster 2024-03-30T15:14:19.979440+0000 mon.a (mon.0) 1731 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:14:21.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:20 smithi072 bash[28946]: audit 2024-03-30T15:14:19.991275+0000 mon.a (mon.0) 1732 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:21.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:20 smithi072 bash[28946]: audit 2024-03-30T15:14:19.991475+0000 mon.a (mon.0) 1733 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi072-64171-32","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:21.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:20 smithi072 bash[28946]: cluster 2024-03-30T15:14:19.999750+0000 mon.a (mon.0) 1734 : cluster 0 osdmap e202: 8 total, 8 up, 8 in 2024-03-30T15:14:21.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:20 smithi072 bash[28946]: audit 2024-03-30T15:14:20.006547+0000 mon.a (mon.0) 1735 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:14:21.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:20 smithi072 bash[28946]: audit 2024-03-30T15:14:20.129843+0000 mon.a (mon.0) 1736 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:21.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:20 smithi072 bash[28946]: audit 2024-03-30T15:14:20.716409+0000 mon.a (mon.0) 1737 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:14:21.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:20 smithi072 bash[28946]: audit 2024-03-30T15:14:20.721479+0000 mon.c (mon.2) 282 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:14:21.465 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:14:21 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:14:21.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:20 smithi172 bash[23680]: cluster 2024-03-30T15:14:19.946951+0000 mgr.y (mgr.14526) 279 : cluster 0 pgmap v306: 299 pgs: 72 unknown, 227 active+clean; 585 KiB data, 577 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 475 B/s wr, 1 op/s 2024-03-30T15:14:21.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:20 smithi172 bash[23680]: audit 2024-03-30T15:14:19.978970+0000 mon.a (mon.0) 1730 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:21.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:20 smithi172 bash[23680]: cluster 2024-03-30T15:14:19.979440+0000 mon.a (mon.0) 1731 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:14:21.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:20 smithi172 bash[23680]: audit 2024-03-30T15:14:19.991275+0000 mon.a (mon.0) 1732 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:21.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:20 smithi172 bash[23680]: audit 2024-03-30T15:14:19.991475+0000 mon.a (mon.0) 1733 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi072-64171-32","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:21.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:20 smithi172 bash[23680]: cluster 2024-03-30T15:14:19.999750+0000 mon.a (mon.0) 1734 : cluster 0 osdmap e202: 8 total, 8 up, 8 in 2024-03-30T15:14:21.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:20 smithi172 bash[23680]: audit 2024-03-30T15:14:20.006547+0000 mon.a (mon.0) 1735 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:14:21.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:20 smithi172 bash[23680]: audit 2024-03-30T15:14:20.129843+0000 mon.a (mon.0) 1736 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:21.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:20 smithi172 bash[23680]: audit 2024-03-30T15:14:20.716409+0000 mon.a (mon.0) 1737 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:14:21.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:20 smithi172 bash[23680]: audit 2024-03-30T15:14:20.721479+0000 mon.c (mon.2) 282 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:14:22.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:22 smithi072 bash[21573]: audit 2024-03-30T15:14:20.995092+0000 mon.a (mon.0) 1738 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-19", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:14:22.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:22 smithi072 bash[21573]: cluster 2024-03-30T15:14:21.004430+0000 mon.a (mon.0) 1739 : cluster 0 osdmap e203: 8 total, 8 up, 8 in 2024-03-30T15:14:22.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:22 smithi072 bash[21573]: audit 2024-03-30T15:14:21.005853+0000 mon.a (mon.0) 1740 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-19"}]: dispatch 2024-03-30T15:14:22.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:22 smithi072 bash[21573]: audit 2024-03-30T15:14:21.010464+0000 mon.c (mon.2) 283 : audit 1 from='client.? 172.21.15.72:0/1861199061' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi072-64163-29"}]: dispatch 2024-03-30T15:14:22.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:22 smithi072 bash[21573]: audit 2024-03-30T15:14:21.011457+0000 mon.a (mon.0) 1741 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi072-64163-29"}]: dispatch 2024-03-30T15:14:22.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:22 smithi072 bash[21573]: audit 2024-03-30T15:14:21.084051+0000 mgr.y (mgr.14526) 280 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:14:22.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:22 smithi072 bash[21573]: audit 2024-03-30T15:14:21.491432+0000 mon.a (mon.0) 1742 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:22.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:22 smithi072 bash[21573]: audit 2024-03-30T15:14:21.948549+0000 mon.c (mon.2) 284 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi072-64203-1", "var": "pg_num_actual", "val": "30"}]: dispatch 2024-03-30T15:14:22.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:22 smithi072 bash[21573]: audit 2024-03-30T15:14:21.951400+0000 mon.a (mon.0) 1743 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi072-64203-1", "var": "pg_num_actual", "val": "30"}]: dispatch 2024-03-30T15:14:22.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:22 smithi072 bash[28946]: audit 2024-03-30T15:14:20.995092+0000 mon.a (mon.0) 1738 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-19", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:14:22.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:22 smithi072 bash[28946]: cluster 2024-03-30T15:14:21.004430+0000 mon.a (mon.0) 1739 : cluster 0 osdmap e203: 8 total, 8 up, 8 in 2024-03-30T15:14:22.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:22 smithi072 bash[28946]: audit 2024-03-30T15:14:21.005853+0000 mon.a (mon.0) 1740 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-19"}]: dispatch 2024-03-30T15:14:22.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:22 smithi072 bash[28946]: audit 2024-03-30T15:14:21.010464+0000 mon.c (mon.2) 283 : audit 1 from='client.? 172.21.15.72:0/1861199061' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi072-64163-29"}]: dispatch 2024-03-30T15:14:22.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:22 smithi072 bash[28946]: audit 2024-03-30T15:14:21.011457+0000 mon.a (mon.0) 1741 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi072-64163-29"}]: dispatch 2024-03-30T15:14:22.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:22 smithi072 bash[28946]: audit 2024-03-30T15:14:21.084051+0000 mgr.y (mgr.14526) 280 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:14:22.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:22 smithi072 bash[28946]: audit 2024-03-30T15:14:21.491432+0000 mon.a (mon.0) 1742 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:22.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:22 smithi072 bash[28946]: audit 2024-03-30T15:14:21.948549+0000 mon.c (mon.2) 284 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi072-64203-1", "var": "pg_num_actual", "val": "30"}]: dispatch 2024-03-30T15:14:22.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:22 smithi072 bash[28946]: audit 2024-03-30T15:14:21.951400+0000 mon.a (mon.0) 1743 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi072-64203-1", "var": "pg_num_actual", "val": "30"}]: dispatch 2024-03-30T15:14:22.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:22 smithi172 bash[23680]: audit 2024-03-30T15:14:20.995092+0000 mon.a (mon.0) 1738 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-19", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:14:22.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:22 smithi172 bash[23680]: cluster 2024-03-30T15:14:21.004430+0000 mon.a (mon.0) 1739 : cluster 0 osdmap e203: 8 total, 8 up, 8 in 2024-03-30T15:14:22.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:22 smithi172 bash[23680]: audit 2024-03-30T15:14:21.005853+0000 mon.a (mon.0) 1740 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-19"}]: dispatch 2024-03-30T15:14:22.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:22 smithi172 bash[23680]: audit 2024-03-30T15:14:21.010464+0000 mon.c (mon.2) 283 : audit 1 from='client.? 172.21.15.72:0/1861199061' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi072-64163-29"}]: dispatch 2024-03-30T15:14:22.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:22 smithi172 bash[23680]: audit 2024-03-30T15:14:21.011457+0000 mon.a (mon.0) 1741 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi072-64163-29"}]: dispatch 2024-03-30T15:14:22.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:22 smithi172 bash[23680]: audit 2024-03-30T15:14:21.084051+0000 mgr.y (mgr.14526) 280 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:14:22.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:22 smithi172 bash[23680]: audit 2024-03-30T15:14:21.491432+0000 mon.a (mon.0) 1742 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:22.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:22 smithi172 bash[23680]: audit 2024-03-30T15:14:21.948549+0000 mon.c (mon.2) 284 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi072-64203-1", "var": "pg_num_actual", "val": "30"}]: dispatch 2024-03-30T15:14:22.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:22 smithi172 bash[23680]: audit 2024-03-30T15:14:21.951400+0000 mon.a (mon.0) 1743 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi072-64203-1", "var": "pg_num_actual", "val": "30"}]: dispatch 2024-03-30T15:14:23.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:23 smithi072 bash[21573]: cluster 2024-03-30T15:14:21.947801+0000 mgr.y (mgr.14526) 281 : cluster 0 pgmap v309: 259 pgs: 259 active+clean; 585 KiB data, 581 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.7 KiB/s wr, 8 op/s 2024-03-30T15:14:23.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:23 smithi072 bash[21573]: audit 2024-03-30T15:14:22.008612+0000 mon.a (mon.0) 1744 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-19"}]': finished 2024-03-30T15:14:23.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:23 smithi072 bash[21573]: audit 2024-03-30T15:14:22.008854+0000 mon.a (mon.0) 1745 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi072-64163-29"}]': finished 2024-03-30T15:14:23.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:23 smithi072 bash[21573]: audit 2024-03-30T15:14:22.009085+0000 mon.a (mon.0) 1746 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi072-64203-1", "var": "pg_num_actual", "val": "30"}]': finished 2024-03-30T15:14:23.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:23 smithi072 bash[21573]: cluster 2024-03-30T15:14:22.019207+0000 mon.a (mon.0) 1747 : cluster 0 osdmap e204: 8 total, 8 up, 8 in 2024-03-30T15:14:23.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:23 smithi072 bash[21573]: audit 2024-03-30T15:14:22.021993+0000 mon.c (mon.2) 285 : audit 1 from='client.? 172.21.15.72:0/1861199061' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi072-64163-29"}]: dispatch 2024-03-30T15:14:23.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:23 smithi072 bash[21573]: audit 2024-03-30T15:14:22.023942+0000 mon.a (mon.0) 1748 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-19", "mode": "writeback"}]: dispatch 2024-03-30T15:14:23.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:23 smithi072 bash[21573]: audit 2024-03-30T15:14:22.029178+0000 mon.a (mon.0) 1749 : audit 1 from='client.? 172.21.15.72:0/2947531242' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi072-64171-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:23.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:23 smithi072 bash[21573]: audit 2024-03-30T15:14:22.031070+0000 mon.a (mon.0) 1750 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi072-64163-29"}]: dispatch 2024-03-30T15:14:23.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:23 smithi072 bash[21573]: audit 2024-03-30T15:14:22.493174+0000 mon.a (mon.0) 1751 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:23.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:23 smithi072 bash[21573]: audit 2024-03-30T15:14:22.494816+0000 mon.a (mon.0) 1752 : audit 1 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi072-64203-1","var":"pg_num","val":"11"}]: dispatch 2024-03-30T15:14:23.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:23 smithi072 bash[28946]: cluster 2024-03-30T15:14:21.947801+0000 mgr.y (mgr.14526) 281 : cluster 0 pgmap v309: 259 pgs: 259 active+clean; 585 KiB data, 581 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.7 KiB/s wr, 8 op/s 2024-03-30T15:14:23.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:23 smithi072 bash[28946]: audit 2024-03-30T15:14:22.008612+0000 mon.a (mon.0) 1744 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-19"}]': finished 2024-03-30T15:14:23.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:23 smithi072 bash[28946]: audit 2024-03-30T15:14:22.008854+0000 mon.a (mon.0) 1745 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi072-64163-29"}]': finished 2024-03-30T15:14:23.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:23 smithi072 bash[28946]: audit 2024-03-30T15:14:22.009085+0000 mon.a (mon.0) 1746 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi072-64203-1", "var": "pg_num_actual", "val": "30"}]': finished 2024-03-30T15:14:23.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:23 smithi072 bash[28946]: cluster 2024-03-30T15:14:22.019207+0000 mon.a (mon.0) 1747 : cluster 0 osdmap e204: 8 total, 8 up, 8 in 2024-03-30T15:14:23.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:23 smithi072 bash[28946]: audit 2024-03-30T15:14:22.021993+0000 mon.c (mon.2) 285 : audit 1 from='client.? 172.21.15.72:0/1861199061' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi072-64163-29"}]: dispatch 2024-03-30T15:14:23.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:23 smithi072 bash[28946]: audit 2024-03-30T15:14:22.023942+0000 mon.a (mon.0) 1748 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-19", "mode": "writeback"}]: dispatch 2024-03-30T15:14:23.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:23 smithi072 bash[28946]: audit 2024-03-30T15:14:22.029178+0000 mon.a (mon.0) 1749 : audit 1 from='client.? 172.21.15.72:0/2947531242' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi072-64171-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:23.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:23 smithi072 bash[28946]: audit 2024-03-30T15:14:22.031070+0000 mon.a (mon.0) 1750 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi072-64163-29"}]: dispatch 2024-03-30T15:14:23.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:23 smithi072 bash[28946]: audit 2024-03-30T15:14:22.493174+0000 mon.a (mon.0) 1751 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:23.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:23 smithi072 bash[28946]: audit 2024-03-30T15:14:22.494816+0000 mon.a (mon.0) 1752 : audit 1 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi072-64203-1","var":"pg_num","val":"11"}]: dispatch 2024-03-30T15:14:23.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:23 smithi172 bash[23680]: cluster 2024-03-30T15:14:21.947801+0000 mgr.y (mgr.14526) 281 : cluster 0 pgmap v309: 259 pgs: 259 active+clean; 585 KiB data, 581 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.7 KiB/s wr, 8 op/s 2024-03-30T15:14:23.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:23 smithi172 bash[23680]: audit 2024-03-30T15:14:22.008612+0000 mon.a (mon.0) 1744 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-19"}]': finished 2024-03-30T15:14:23.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:23 smithi172 bash[23680]: audit 2024-03-30T15:14:22.008854+0000 mon.a (mon.0) 1745 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi072-64163-29"}]': finished 2024-03-30T15:14:23.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:23 smithi172 bash[23680]: audit 2024-03-30T15:14:22.009085+0000 mon.a (mon.0) 1746 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi072-64203-1", "var": "pg_num_actual", "val": "30"}]': finished 2024-03-30T15:14:23.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:23 smithi172 bash[23680]: cluster 2024-03-30T15:14:22.019207+0000 mon.a (mon.0) 1747 : cluster 0 osdmap e204: 8 total, 8 up, 8 in 2024-03-30T15:14:23.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:23 smithi172 bash[23680]: audit 2024-03-30T15:14:22.021993+0000 mon.c (mon.2) 285 : audit 1 from='client.? 172.21.15.72:0/1861199061' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi072-64163-29"}]: dispatch 2024-03-30T15:14:23.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:23 smithi172 bash[23680]: audit 2024-03-30T15:14:22.023942+0000 mon.a (mon.0) 1748 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-19", "mode": "writeback"}]: dispatch 2024-03-30T15:14:23.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:23 smithi172 bash[23680]: audit 2024-03-30T15:14:22.029178+0000 mon.a (mon.0) 1749 : audit 1 from='client.? 172.21.15.72:0/2947531242' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi072-64171-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:23.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:23 smithi172 bash[23680]: audit 2024-03-30T15:14:22.031070+0000 mon.a (mon.0) 1750 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi072-64163-29"}]: dispatch 2024-03-30T15:14:23.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:23 smithi172 bash[23680]: audit 2024-03-30T15:14:22.493174+0000 mon.a (mon.0) 1751 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:23.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:23 smithi172 bash[23680]: audit 2024-03-30T15:14:22.494816+0000 mon.a (mon.0) 1752 : audit 1 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi072-64203-1","var":"pg_num","val":"11"}]: dispatch 2024-03-30T15:14:24.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:24 smithi072 bash[21573]: cluster 2024-03-30T15:14:23.010087+0000 mon.a (mon.0) 1753 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:14:24.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:24 smithi072 bash[21573]: audit 2024-03-30T15:14:23.012705+0000 mon.a (mon.0) 1754 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-19", "mode": "writeback"}]': finished 2024-03-30T15:14:24.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:24 smithi072 bash[21573]: audit 2024-03-30T15:14:23.012972+0000 mon.a (mon.0) 1755 : audit 1 from='client.? 172.21.15.72:0/2947531242' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi072-64171-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:24.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:24 smithi072 bash[21573]: audit 2024-03-30T15:14:23.013214+0000 mon.a (mon.0) 1756 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi072-64163-29"}]': finished 2024-03-30T15:14:24.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:24 smithi072 bash[21573]: audit 2024-03-30T15:14:23.013444+0000 mon.a (mon.0) 1757 : audit 1 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi072-64203-1","var":"pg_num","val":"11"}]': finished 2024-03-30T15:14:24.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:24 smithi072 bash[21573]: cluster 2024-03-30T15:14:23.022776+0000 mon.a (mon.0) 1758 : cluster 0 osdmap e205: 8 total, 8 up, 8 in 2024-03-30T15:14:24.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:24 smithi072 bash[21573]: audit 2024-03-30T15:14:23.024381+0000 mon.a (mon.0) 1759 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:24.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:24 smithi072 bash[21573]: audit 2024-03-30T15:14:23.026879+0000 mon.a (mon.0) 1760 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:24.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:24 smithi072 bash[21573]: audit 2024-03-30T15:14:23.040938+0000 mon.a (mon.0) 1761 : audit 1 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi072-64203-1","var":"pgp_num","val":"11"}]: dispatch 2024-03-30T15:14:24.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:24 smithi072 bash[21573]: audit 2024-03-30T15:14:23.072902+0000 mon.c (mon.2) 286 : audit 1 from='client.? 172.21.15.72:0/3024719314' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi072-64163-30"}]: dispatch 2024-03-30T15:14:24.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:24 smithi072 bash[21573]: audit 2024-03-30T15:14:23.073259+0000 mon.a (mon.0) 1762 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi072-64163-30"}]: dispatch 2024-03-30T15:14:24.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:24 smithi072 bash[21573]: audit 2024-03-30T15:14:23.073810+0000 mon.c (mon.2) 287 : audit 1 from='client.? 172.21.15.72:0/3024719314' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi072-64163-30"}]: dispatch 2024-03-30T15:14:24.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:24 smithi072 bash[21573]: audit 2024-03-30T15:14:23.074209+0000 mon.a (mon.0) 1763 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi072-64163-30"}]: dispatch 2024-03-30T15:14:24.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:24 smithi072 bash[21573]: audit 2024-03-30T15:14:23.074737+0000 mon.c (mon.2) 288 : audit 1 from='client.? 172.21.15.72:0/3024719314' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi072-64163-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:24.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:24 smithi072 bash[21573]: audit 2024-03-30T15:14:23.075040+0000 mon.a (mon.0) 1764 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi072-64163-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:24.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:24 smithi072 bash[28946]: cluster 2024-03-30T15:14:23.010087+0000 mon.a (mon.0) 1753 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:14:24.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:24 smithi072 bash[28946]: audit 2024-03-30T15:14:23.012705+0000 mon.a (mon.0) 1754 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-19", "mode": "writeback"}]': finished 2024-03-30T15:14:24.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:24 smithi072 bash[28946]: audit 2024-03-30T15:14:23.012972+0000 mon.a (mon.0) 1755 : audit 1 from='client.? 172.21.15.72:0/2947531242' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi072-64171-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:24.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:24 smithi072 bash[28946]: audit 2024-03-30T15:14:23.013214+0000 mon.a (mon.0) 1756 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi072-64163-29"}]': finished 2024-03-30T15:14:24.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:24 smithi072 bash[28946]: audit 2024-03-30T15:14:23.013444+0000 mon.a (mon.0) 1757 : audit 1 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi072-64203-1","var":"pg_num","val":"11"}]': finished 2024-03-30T15:14:24.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:24 smithi072 bash[28946]: cluster 2024-03-30T15:14:23.022776+0000 mon.a (mon.0) 1758 : cluster 0 osdmap e205: 8 total, 8 up, 8 in 2024-03-30T15:14:24.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:24 smithi072 bash[28946]: audit 2024-03-30T15:14:23.024381+0000 mon.a (mon.0) 1759 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:24.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:24 smithi072 bash[28946]: audit 2024-03-30T15:14:23.026879+0000 mon.a (mon.0) 1760 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:24.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:24 smithi072 bash[28946]: audit 2024-03-30T15:14:23.040938+0000 mon.a (mon.0) 1761 : audit 1 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi072-64203-1","var":"pgp_num","val":"11"}]: dispatch 2024-03-30T15:14:24.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:24 smithi072 bash[28946]: audit 2024-03-30T15:14:23.072902+0000 mon.c (mon.2) 286 : audit 1 from='client.? 172.21.15.72:0/3024719314' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi072-64163-30"}]: dispatch 2024-03-30T15:14:24.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:24 smithi072 bash[28946]: audit 2024-03-30T15:14:23.073259+0000 mon.a (mon.0) 1762 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi072-64163-30"}]: dispatch 2024-03-30T15:14:24.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:24 smithi072 bash[28946]: audit 2024-03-30T15:14:23.073810+0000 mon.c (mon.2) 287 : audit 1 from='client.? 172.21.15.72:0/3024719314' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi072-64163-30"}]: dispatch 2024-03-30T15:14:24.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:24 smithi072 bash[28946]: audit 2024-03-30T15:14:23.074209+0000 mon.a (mon.0) 1763 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi072-64163-30"}]: dispatch 2024-03-30T15:14:24.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:24 smithi072 bash[28946]: audit 2024-03-30T15:14:23.074737+0000 mon.c (mon.2) 288 : audit 1 from='client.? 172.21.15.72:0/3024719314' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi072-64163-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:24.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:24 smithi072 bash[28946]: audit 2024-03-30T15:14:23.075040+0000 mon.a (mon.0) 1764 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi072-64163-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:24.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:24 smithi072 bash[21573]: audit 2024-03-30T15:14:23.099926+0000 mon.a (mon.0) 1765 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:14:24.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:24 smithi072 bash[21573]: audit 2024-03-30T15:14:23.525867+0000 mon.a (mon.0) 1766 : audit 1 from='client.? 172.21.15.72:0/2947531242' entity='client.admin' cmd=[{ 2024-03-30T15:14:24.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:24 smithi072 bash[21573]: audit 2024-03-30T15:14:23.525942+0000 mon.a (mon.0) 1767 : audit 1 "prefix": "osd pool set", 2024-03-30T15:14:24.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:24 smithi072 bash[21573]: audit 2024-03-30T15:14:23.525995+0000 mon.a (mon.0) 1768 : audit 1 "pool": "PoolEIOFlag_smithi072-64171-33", 2024-03-30T15:14:24.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:24 smithi072 bash[21573]: audit 2024-03-30T15:14:23.526043+0000 mon.a (mon.0) 1769 : audit 1 "var": "eio", 2024-03-30T15:14:24.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:24 smithi072 bash[21573]: audit 2024-03-30T15:14:23.526126+0000 mon.a (mon.0) 1770 : audit 1 "val": "true" 2024-03-30T15:14:24.421 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:24 smithi072 bash[21573]: audit 2024-03-30T15:14:23.526176+0000 mon.a (mon.0) 1771 : audit 1 }]: dispatch 2024-03-30T15:14:24.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:24 smithi072 bash[28946]: audit 2024-03-30T15:14:23.099926+0000 mon.a (mon.0) 1765 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:14:24.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:24 smithi072 bash[28946]: audit 2024-03-30T15:14:23.525867+0000 mon.a (mon.0) 1766 : audit 1 from='client.? 172.21.15.72:0/2947531242' entity='client.admin' cmd=[{ 2024-03-30T15:14:24.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:24 smithi072 bash[28946]: audit 2024-03-30T15:14:23.525942+0000 mon.a (mon.0) 1767 : audit 1 "prefix": "osd pool set", 2024-03-30T15:14:24.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:24 smithi072 bash[28946]: audit 2024-03-30T15:14:23.525995+0000 mon.a (mon.0) 1768 : audit 1 "pool": "PoolEIOFlag_smithi072-64171-33", 2024-03-30T15:14:24.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:24 smithi072 bash[28946]: audit 2024-03-30T15:14:23.526043+0000 mon.a (mon.0) 1769 : audit 1 "var": "eio", 2024-03-30T15:14:24.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:24 smithi072 bash[28946]: audit 2024-03-30T15:14:23.526126+0000 mon.a (mon.0) 1770 : audit 1 "val": "true" 2024-03-30T15:14:24.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:24 smithi072 bash[28946]: audit 2024-03-30T15:14:23.526176+0000 mon.a (mon.0) 1771 : audit 1 }]: dispatch 2024-03-30T15:14:24.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:24 smithi172 bash[23680]: cluster 2024-03-30T15:14:23.010087+0000 mon.a (mon.0) 1753 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:14:24.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:24 smithi172 bash[23680]: audit 2024-03-30T15:14:23.012705+0000 mon.a (mon.0) 1754 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-19", "mode": "writeback"}]': finished 2024-03-30T15:14:24.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:24 smithi172 bash[23680]: audit 2024-03-30T15:14:23.012972+0000 mon.a (mon.0) 1755 : audit 1 from='client.? 172.21.15.72:0/2947531242' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi072-64171-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:24.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:24 smithi172 bash[23680]: audit 2024-03-30T15:14:23.013214+0000 mon.a (mon.0) 1756 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi072-64163-29"}]': finished 2024-03-30T15:14:24.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:24 smithi172 bash[23680]: audit 2024-03-30T15:14:23.013444+0000 mon.a (mon.0) 1757 : audit 1 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi072-64203-1","var":"pg_num","val":"11"}]': finished 2024-03-30T15:14:24.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:24 smithi172 bash[23680]: cluster 2024-03-30T15:14:23.022776+0000 mon.a (mon.0) 1758 : cluster 0 osdmap e205: 8 total, 8 up, 8 in 2024-03-30T15:14:24.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:24 smithi172 bash[23680]: audit 2024-03-30T15:14:23.024381+0000 mon.a (mon.0) 1759 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:24.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:24 smithi172 bash[23680]: audit 2024-03-30T15:14:23.026879+0000 mon.a (mon.0) 1760 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:24.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:24 smithi172 bash[23680]: audit 2024-03-30T15:14:23.040938+0000 mon.a (mon.0) 1761 : audit 1 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi072-64203-1","var":"pgp_num","val":"11"}]: dispatch 2024-03-30T15:14:24.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:24 smithi172 bash[23680]: audit 2024-03-30T15:14:23.072902+0000 mon.c (mon.2) 286 : audit 1 from='client.? 172.21.15.72:0/3024719314' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi072-64163-30"}]: dispatch 2024-03-30T15:14:24.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:24 smithi172 bash[23680]: audit 2024-03-30T15:14:23.073259+0000 mon.a (mon.0) 1762 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi072-64163-30"}]: dispatch 2024-03-30T15:14:24.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:24 smithi172 bash[23680]: audit 2024-03-30T15:14:23.073810+0000 mon.c (mon.2) 287 : audit 1 from='client.? 172.21.15.72:0/3024719314' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi072-64163-30"}]: dispatch 2024-03-30T15:14:24.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:24 smithi172 bash[23680]: audit 2024-03-30T15:14:23.074209+0000 mon.a (mon.0) 1763 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi072-64163-30"}]: dispatch 2024-03-30T15:14:24.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:24 smithi172 bash[23680]: audit 2024-03-30T15:14:23.074737+0000 mon.c (mon.2) 288 : audit 1 from='client.? 172.21.15.72:0/3024719314' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi072-64163-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:24.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:24 smithi172 bash[23680]: audit 2024-03-30T15:14:23.075040+0000 mon.a (mon.0) 1764 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi072-64163-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:24.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:24 smithi172 bash[23680]: audit 2024-03-30T15:14:23.099926+0000 mon.a (mon.0) 1765 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:14:24.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:24 smithi172 bash[23680]: audit 2024-03-30T15:14:23.525867+0000 mon.a (mon.0) 1766 : audit 1 from='client.? 172.21.15.72:0/2947531242' entity='client.admin' cmd=[{ 2024-03-30T15:14:24.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:24 smithi172 bash[23680]: audit 2024-03-30T15:14:23.525942+0000 mon.a (mon.0) 1767 : audit 1 "prefix": "osd pool set", 2024-03-30T15:14:24.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:24 smithi172 bash[23680]: audit 2024-03-30T15:14:23.525995+0000 mon.a (mon.0) 1768 : audit 1 "pool": "PoolEIOFlag_smithi072-64171-33", 2024-03-30T15:14:24.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:24 smithi172 bash[23680]: audit 2024-03-30T15:14:23.526043+0000 mon.a (mon.0) 1769 : audit 1 "var": "eio", 2024-03-30T15:14:24.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:24 smithi172 bash[23680]: audit 2024-03-30T15:14:23.526126+0000 mon.a (mon.0) 1770 : audit 1 "val": "true" 2024-03-30T15:14:24.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:24 smithi172 bash[23680]: audit 2024-03-30T15:14:23.526176+0000 mon.a (mon.0) 1771 : audit 1 }]: dispatch 2024-03-30T15:14:25.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:25 smithi072 bash[21573]: cluster 2024-03-30T15:14:23.948878+0000 mgr.y (mgr.14526) 282 : cluster 0 pgmap v312: 291 pgs: 32 unknown, 259 active+clean; 585 KiB data, 581 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s 2024-03-30T15:14:25.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:25 smithi072 bash[21573]: audit 2024-03-30T15:14:24.041904+0000 mon.a (mon.0) 1772 : audit 1 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi072-64203-1","var":"pgp_num","val":"11"}]': finished 2024-03-30T15:14:25.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:25 smithi072 bash[21573]: audit 2024-03-30T15:14:24.042127+0000 mon.a (mon.0) 1773 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi072-64163-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:14:25.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:25 smithi072 bash[21573]: audit 2024-03-30T15:14:24.042339+0000 mon.a (mon.0) 1774 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:14:25.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:25 smithi072 bash[21573]: audit 2024-03-30T15:14:24.042518+0000 mon.a (mon.0) 1775 : audit 1 from='client.? 172.21.15.72:0/2947531242' entity='client.admin' cmd='[{ 2024-03-30T15:14:25.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:25 smithi072 bash[21573]: audit 2024-03-30T15:14:24.042568+0000 mon.a (mon.0) 1776 : audit 1 "prefix": "osd pool set", 2024-03-30T15:14:25.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:25 smithi072 bash[21573]: audit 2024-03-30T15:14:24.042613+0000 mon.a (mon.0) 1777 : audit 1 "pool": "PoolEIOFlag_smithi072-64171-33", 2024-03-30T15:14:25.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:25 smithi072 bash[21573]: audit 2024-03-30T15:14:24.042650+0000 mon.a (mon.0) 1778 : audit 1 "var": "eio", 2024-03-30T15:14:25.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:25 smithi072 bash[21573]: audit 2024-03-30T15:14:24.042686+0000 mon.a (mon.0) 1779 : audit 1 "val": "true" 2024-03-30T15:14:25.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:25 smithi072 bash[21573]: audit 2024-03-30T15:14:24.042727+0000 mon.a (mon.0) 1780 : audit 1 }]': finished 2024-03-30T15:14:25.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:25 smithi072 bash[21573]: cluster 2024-03-30T15:14:24.051759+0000 mon.a (mon.0) 1781 : cluster 0 osdmap e206: 8 total, 8 up, 8 in 2024-03-30T15:14:25.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:25 smithi072 bash[21573]: audit 2024-03-30T15:14:24.052553+0000 mon.c (mon.2) 289 : audit 1 from='client.? 172.21.15.72:0/3024719314' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi072-64163-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi072-64163-30"}]: dispatch 2024-03-30T15:14:25.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:25 smithi072 bash[21573]: audit 2024-03-30T15:14:24.057651+0000 mon.a (mon.0) 1782 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:25.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:25 smithi072 bash[21573]: audit 2024-03-30T15:14:24.058262+0000 mon.a (mon.0) 1783 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-19"}]: dispatch 2024-03-30T15:14:25.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:25 smithi072 bash[21573]: audit 2024-03-30T15:14:24.059148+0000 mon.a (mon.0) 1784 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi072-64163-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi072-64163-30"}]: dispatch 2024-03-30T15:14:25.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:25 smithi072 bash[28946]: cluster 2024-03-30T15:14:23.948878+0000 mgr.y (mgr.14526) 282 : cluster 0 pgmap v312: 291 pgs: 32 unknown, 259 active+clean; 585 KiB data, 581 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s 2024-03-30T15:14:25.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:25 smithi072 bash[28946]: audit 2024-03-30T15:14:24.041904+0000 mon.a (mon.0) 1772 : audit 1 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi072-64203-1","var":"pgp_num","val":"11"}]': finished 2024-03-30T15:14:25.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:25 smithi072 bash[28946]: audit 2024-03-30T15:14:24.042127+0000 mon.a (mon.0) 1773 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi072-64163-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:14:25.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:25 smithi072 bash[28946]: audit 2024-03-30T15:14:24.042339+0000 mon.a (mon.0) 1774 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:14:25.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:25 smithi072 bash[28946]: audit 2024-03-30T15:14:24.042518+0000 mon.a (mon.0) 1775 : audit 1 from='client.? 172.21.15.72:0/2947531242' entity='client.admin' cmd='[{ 2024-03-30T15:14:25.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:25 smithi072 bash[28946]: audit 2024-03-30T15:14:24.042568+0000 mon.a (mon.0) 1776 : audit 1 "prefix": "osd pool set", 2024-03-30T15:14:25.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:25 smithi072 bash[28946]: audit 2024-03-30T15:14:24.042613+0000 mon.a (mon.0) 1777 : audit 1 "pool": "PoolEIOFlag_smithi072-64171-33", 2024-03-30T15:14:25.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:25 smithi072 bash[28946]: audit 2024-03-30T15:14:24.042650+0000 mon.a (mon.0) 1778 : audit 1 "var": "eio", 2024-03-30T15:14:25.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:25 smithi072 bash[28946]: audit 2024-03-30T15:14:24.042686+0000 mon.a (mon.0) 1779 : audit 1 "val": "true" 2024-03-30T15:14:25.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:25 smithi072 bash[28946]: audit 2024-03-30T15:14:24.042727+0000 mon.a (mon.0) 1780 : audit 1 }]': finished 2024-03-30T15:14:25.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:25 smithi072 bash[28946]: cluster 2024-03-30T15:14:24.051759+0000 mon.a (mon.0) 1781 : cluster 0 osdmap e206: 8 total, 8 up, 8 in 2024-03-30T15:14:25.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:25 smithi072 bash[28946]: audit 2024-03-30T15:14:24.052553+0000 mon.c (mon.2) 289 : audit 1 from='client.? 172.21.15.72:0/3024719314' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi072-64163-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi072-64163-30"}]: dispatch 2024-03-30T15:14:25.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:25 smithi072 bash[28946]: audit 2024-03-30T15:14:24.057651+0000 mon.a (mon.0) 1782 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:25.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:25 smithi072 bash[28946]: audit 2024-03-30T15:14:24.058262+0000 mon.a (mon.0) 1783 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-19"}]: dispatch 2024-03-30T15:14:25.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:25 smithi072 bash[28946]: audit 2024-03-30T15:14:24.059148+0000 mon.a (mon.0) 1784 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi072-64163-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi072-64163-30"}]: dispatch 2024-03-30T15:14:25.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:25 smithi172 bash[23680]: cluster 2024-03-30T15:14:23.948878+0000 mgr.y (mgr.14526) 282 : cluster 0 pgmap v312: 291 pgs: 32 unknown, 259 active+clean; 585 KiB data, 581 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s 2024-03-30T15:14:25.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:25 smithi172 bash[23680]: audit 2024-03-30T15:14:24.041904+0000 mon.a (mon.0) 1772 : audit 1 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi072-64203-1","var":"pgp_num","val":"11"}]': finished 2024-03-30T15:14:25.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:25 smithi172 bash[23680]: audit 2024-03-30T15:14:24.042127+0000 mon.a (mon.0) 1773 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi072-64163-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:14:25.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:25 smithi172 bash[23680]: audit 2024-03-30T15:14:24.042339+0000 mon.a (mon.0) 1774 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:14:25.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:25 smithi172 bash[23680]: audit 2024-03-30T15:14:24.042518+0000 mon.a (mon.0) 1775 : audit 1 from='client.? 172.21.15.72:0/2947531242' entity='client.admin' cmd='[{ 2024-03-30T15:14:25.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:25 smithi172 bash[23680]: audit 2024-03-30T15:14:24.042568+0000 mon.a (mon.0) 1776 : audit 1 "prefix": "osd pool set", 2024-03-30T15:14:25.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:25 smithi172 bash[23680]: audit 2024-03-30T15:14:24.042613+0000 mon.a (mon.0) 1777 : audit 1 "pool": "PoolEIOFlag_smithi072-64171-33", 2024-03-30T15:14:25.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:25 smithi172 bash[23680]: audit 2024-03-30T15:14:24.042650+0000 mon.a (mon.0) 1778 : audit 1 "var": "eio", 2024-03-30T15:14:25.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:25 smithi172 bash[23680]: audit 2024-03-30T15:14:24.042686+0000 mon.a (mon.0) 1779 : audit 1 "val": "true" 2024-03-30T15:14:25.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:25 smithi172 bash[23680]: audit 2024-03-30T15:14:24.042727+0000 mon.a (mon.0) 1780 : audit 1 }]': finished 2024-03-30T15:14:25.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:25 smithi172 bash[23680]: cluster 2024-03-30T15:14:24.051759+0000 mon.a (mon.0) 1781 : cluster 0 osdmap e206: 8 total, 8 up, 8 in 2024-03-30T15:14:25.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:25 smithi172 bash[23680]: audit 2024-03-30T15:14:24.052553+0000 mon.c (mon.2) 289 : audit 1 from='client.? 172.21.15.72:0/3024719314' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi072-64163-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi072-64163-30"}]: dispatch 2024-03-30T15:14:25.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:25 smithi172 bash[23680]: audit 2024-03-30T15:14:24.057651+0000 mon.a (mon.0) 1782 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:25.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:25 smithi172 bash[23680]: audit 2024-03-30T15:14:24.058262+0000 mon.a (mon.0) 1783 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-19"}]: dispatch 2024-03-30T15:14:25.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:25 smithi172 bash[23680]: audit 2024-03-30T15:14:24.059148+0000 mon.a (mon.0) 1784 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi072-64163-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi072-64163-30"}]: dispatch 2024-03-30T15:14:26.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:26 smithi072 bash[21573]: cluster 2024-03-30T15:14:25.042970+0000 mon.a (mon.0) 1785 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:14:26.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:26 smithi072 bash[21573]: audit 2024-03-30T15:14:25.045561+0000 mon.a (mon.0) 1786 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-19"}]': finished 2024-03-30T15:14:26.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:26 smithi072 bash[21573]: cluster 2024-03-30T15:14:25.499678+0000 mon.a (mon.0) 1787 : cluster 0 osdmap e207: 8 total, 8 up, 8 in 2024-03-30T15:14:26.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:26 smithi072 bash[21573]: audit 2024-03-30T15:14:25.501860+0000 mon.a (mon.0) 1788 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:26.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:26 smithi072 bash[21573]: audit 2024-03-30T15:14:25.951797+0000 mon.c (mon.2) 290 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi072-64203-1", "var": "pgp_num_actual", "val": "29"}]: dispatch 2024-03-30T15:14:26.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:26 smithi072 bash[21573]: cluster 2024-03-30T15:14:25.951866+0000 mon.a (mon.0) 1789 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:14:26.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:26 smithi072 bash[21573]: audit 2024-03-30T15:14:25.955668+0000 mon.a (mon.0) 1790 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi072-64203-1", "var": "pgp_num_actual", "val": "29"}]: dispatch 2024-03-30T15:14:26.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:26 smithi072 bash[21573]: audit 2024-03-30T15:14:26.049416+0000 mon.a (mon.0) 1791 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi072-64163-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi072-64163-30"}]': finished 2024-03-30T15:14:26.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:26 smithi072 bash[21573]: audit 2024-03-30T15:14:26.049701+0000 mon.a (mon.0) 1792 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi072-64203-1", "var": "pgp_num_actual", "val": "29"}]': finished 2024-03-30T15:14:26.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:26 smithi072 bash[21573]: cluster 2024-03-30T15:14:26.061433+0000 mon.a (mon.0) 1793 : cluster 0 osdmap e208: 8 total, 8 up, 8 in 2024-03-30T15:14:26.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:26 smithi072 bash[21573]: audit 2024-03-30T15:14:26.064661+0000 mon.c (mon.2) 291 : audit 1 from='client.? 172.21.15.72:0/2919540436' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi072-64171-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:26.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:26 smithi072 bash[21573]: audit 2024-03-30T15:14:26.066268+0000 mon.a (mon.0) 1794 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi072-64171-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:26.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:26 smithi072 bash[28946]: cluster 2024-03-30T15:14:25.042970+0000 mon.a (mon.0) 1785 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:14:26.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:26 smithi072 bash[28946]: audit 2024-03-30T15:14:25.045561+0000 mon.a (mon.0) 1786 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-19"}]': finished 2024-03-30T15:14:26.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:26 smithi072 bash[28946]: cluster 2024-03-30T15:14:25.499678+0000 mon.a (mon.0) 1787 : cluster 0 osdmap e207: 8 total, 8 up, 8 in 2024-03-30T15:14:26.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:26 smithi072 bash[28946]: audit 2024-03-30T15:14:25.501860+0000 mon.a (mon.0) 1788 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:26.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:26 smithi072 bash[28946]: audit 2024-03-30T15:14:25.951797+0000 mon.c (mon.2) 290 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi072-64203-1", "var": "pgp_num_actual", "val": "29"}]: dispatch 2024-03-30T15:14:26.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:26 smithi072 bash[28946]: cluster 2024-03-30T15:14:25.951866+0000 mon.a (mon.0) 1789 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:14:26.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:26 smithi072 bash[28946]: audit 2024-03-30T15:14:25.955668+0000 mon.a (mon.0) 1790 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi072-64203-1", "var": "pgp_num_actual", "val": "29"}]: dispatch 2024-03-30T15:14:26.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:26 smithi072 bash[28946]: audit 2024-03-30T15:14:26.049416+0000 mon.a (mon.0) 1791 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi072-64163-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi072-64163-30"}]': finished 2024-03-30T15:14:26.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:26 smithi072 bash[28946]: audit 2024-03-30T15:14:26.049701+0000 mon.a (mon.0) 1792 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi072-64203-1", "var": "pgp_num_actual", "val": "29"}]': finished 2024-03-30T15:14:26.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:26 smithi072 bash[28946]: cluster 2024-03-30T15:14:26.061433+0000 mon.a (mon.0) 1793 : cluster 0 osdmap e208: 8 total, 8 up, 8 in 2024-03-30T15:14:26.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:26 smithi072 bash[28946]: audit 2024-03-30T15:14:26.064661+0000 mon.c (mon.2) 291 : audit 1 from='client.? 172.21.15.72:0/2919540436' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi072-64171-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:26.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:26 smithi072 bash[28946]: audit 2024-03-30T15:14:26.066268+0000 mon.a (mon.0) 1794 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi072-64171-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:26.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:26 smithi172 bash[23680]: cluster 2024-03-30T15:14:25.042970+0000 mon.a (mon.0) 1785 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:14:26.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:26 smithi172 bash[23680]: audit 2024-03-30T15:14:25.045561+0000 mon.a (mon.0) 1786 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-19"}]': finished 2024-03-30T15:14:26.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:26 smithi172 bash[23680]: cluster 2024-03-30T15:14:25.499678+0000 mon.a (mon.0) 1787 : cluster 0 osdmap e207: 8 total, 8 up, 8 in 2024-03-30T15:14:26.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:26 smithi172 bash[23680]: audit 2024-03-30T15:14:25.501860+0000 mon.a (mon.0) 1788 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:26.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:26 smithi172 bash[23680]: audit 2024-03-30T15:14:25.951797+0000 mon.c (mon.2) 290 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi072-64203-1", "var": "pgp_num_actual", "val": "29"}]: dispatch 2024-03-30T15:14:26.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:26 smithi172 bash[23680]: cluster 2024-03-30T15:14:25.951866+0000 mon.a (mon.0) 1789 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:14:26.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:26 smithi172 bash[23680]: audit 2024-03-30T15:14:25.955668+0000 mon.a (mon.0) 1790 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi072-64203-1", "var": "pgp_num_actual", "val": "29"}]: dispatch 2024-03-30T15:14:26.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:26 smithi172 bash[23680]: audit 2024-03-30T15:14:26.049416+0000 mon.a (mon.0) 1791 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi072-64163-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi072-64163-30"}]': finished 2024-03-30T15:14:26.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:26 smithi172 bash[23680]: audit 2024-03-30T15:14:26.049701+0000 mon.a (mon.0) 1792 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi072-64203-1", "var": "pgp_num_actual", "val": "29"}]': finished 2024-03-30T15:14:26.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:26 smithi172 bash[23680]: cluster 2024-03-30T15:14:26.061433+0000 mon.a (mon.0) 1793 : cluster 0 osdmap e208: 8 total, 8 up, 8 in 2024-03-30T15:14:26.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:26 smithi172 bash[23680]: audit 2024-03-30T15:14:26.064661+0000 mon.c (mon.2) 291 : audit 1 from='client.? 172.21.15.72:0/2919540436' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi072-64171-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:26.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:26 smithi172 bash[23680]: audit 2024-03-30T15:14:26.066268+0000 mon.a (mon.0) 1794 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi072-64171-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:27.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:27 smithi072 bash[21573]: cluster 2024-03-30T15:14:25.951159+0000 mgr.y (mgr.14526) 283 : cluster 0 pgmap v315: 258 pgs: 258 active+clean; 585 KiB data, 570 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-30T15:14:27.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:27 smithi072 bash[21573]: audit 2024-03-30T15:14:26.503588+0000 mon.a (mon.0) 1795 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:27.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:27 smithi072 bash[21573]: audit 2024-03-30T15:14:27.053562+0000 mon.a (mon.0) 1796 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiReads_smithi072-64171-34","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:27.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:27 smithi072 bash[21573]: cluster 2024-03-30T15:14:27.062895+0000 mon.a (mon.0) 1797 : cluster 0 osdmap e209: 8 total, 8 up, 8 in 2024-03-30T15:14:27.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:27 smithi072 bash[21573]: audit 2024-03-30T15:14:27.067518+0000 mon.a (mon.0) 1798 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:27.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:27 smithi072 bash[21573]: audit 2024-03-30T15:14:27.505076+0000 mon.a (mon.0) 1799 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:27.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:27 smithi072 bash[28946]: cluster 2024-03-30T15:14:25.951159+0000 mgr.y (mgr.14526) 283 : cluster 0 pgmap v315: 258 pgs: 258 active+clean; 585 KiB data, 570 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-30T15:14:27.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:27 smithi072 bash[28946]: audit 2024-03-30T15:14:26.503588+0000 mon.a (mon.0) 1795 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:27.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:27 smithi072 bash[28946]: audit 2024-03-30T15:14:27.053562+0000 mon.a (mon.0) 1796 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiReads_smithi072-64171-34","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:27.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:27 smithi072 bash[28946]: cluster 2024-03-30T15:14:27.062895+0000 mon.a (mon.0) 1797 : cluster 0 osdmap e209: 8 total, 8 up, 8 in 2024-03-30T15:14:27.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:27 smithi072 bash[28946]: audit 2024-03-30T15:14:27.067518+0000 mon.a (mon.0) 1798 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:27.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:27 smithi072 bash[28946]: audit 2024-03-30T15:14:27.505076+0000 mon.a (mon.0) 1799 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:27.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:27 smithi172 bash[23680]: cluster 2024-03-30T15:14:25.951159+0000 mgr.y (mgr.14526) 283 : cluster 0 pgmap v315: 258 pgs: 258 active+clean; 585 KiB data, 570 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-30T15:14:27.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:27 smithi172 bash[23680]: audit 2024-03-30T15:14:26.503588+0000 mon.a (mon.0) 1795 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:27.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:27 smithi172 bash[23680]: audit 2024-03-30T15:14:27.053562+0000 mon.a (mon.0) 1796 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiReads_smithi072-64171-34","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:27.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:27 smithi172 bash[23680]: cluster 2024-03-30T15:14:27.062895+0000 mon.a (mon.0) 1797 : cluster 0 osdmap e209: 8 total, 8 up, 8 in 2024-03-30T15:14:27.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:27 smithi172 bash[23680]: audit 2024-03-30T15:14:27.067518+0000 mon.a (mon.0) 1798 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:27.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:27 smithi172 bash[23680]: audit 2024-03-30T15:14:27.505076+0000 mon.a (mon.0) 1799 : audit 0 from='client.? 172.21.15.72:0/1819655886' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-03-30T15:14:29.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:29 smithi072 bash[21573]: cluster 2024-03-30T15:14:27.952151+0000 mgr.y (mgr.14526) 284 : cluster 0 pgmap v318: 298 pgs: 72 unknown, 226 active+clean; 585 KiB data, 570 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:14:29.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:29 smithi072 bash[21573]: audit 2024-03-30T15:14:28.056728+0000 mon.a (mon.0) 1800 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:29.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:29 smithi072 bash[21573]: cluster 2024-03-30T15:14:28.065305+0000 mon.a (mon.0) 1801 : cluster 0 osdmap e210: 8 total, 8 up, 8 in 2024-03-30T15:14:29.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:29 smithi072 bash[21573]: audit 2024-03-30T15:14:28.081477+0000 mon.c (mon.2) 292 : audit 1 from='client.? 172.21.15.72:0/3024719314' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi072-64163-30"}]: dispatch 2024-03-30T15:14:29.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:29 smithi072 bash[21573]: audit 2024-03-30T15:14:28.085077+0000 mon.a (mon.0) 1802 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi072-64163-30"}]: dispatch 2024-03-30T15:14:29.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:29 smithi072 bash[21573]: audit 2024-03-30T15:14:28.126931+0000 mon.c (mon.2) 293 : audit 1 from='client.? 172.21.15.72:0/2427197094' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi072-64203-2"}]: dispatch 2024-03-30T15:14:29.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:29 smithi072 bash[21573]: audit 2024-03-30T15:14:28.127659+0000 mon.a (mon.0) 1803 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi072-64203-2"}]: dispatch 2024-03-30T15:14:29.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:29 smithi072 bash[21573]: audit 2024-03-30T15:14:28.129528+0000 mon.c (mon.2) 294 : audit 1 from='client.? 172.21.15.72:0/2427197094' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi072-64203-2"}]: dispatch 2024-03-30T15:14:29.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:29 smithi072 bash[21573]: audit 2024-03-30T15:14:28.130835+0000 mon.a (mon.0) 1804 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi072-64203-2"}]: dispatch 2024-03-30T15:14:29.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:29 smithi072 bash[21573]: audit 2024-03-30T15:14:28.131902+0000 mon.c (mon.2) 295 : audit 1 from='client.? 172.21.15.72:0/2427197094' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi072-64203-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:29.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:29 smithi072 bash[21573]: audit 2024-03-30T15:14:28.132561+0000 mon.a (mon.0) 1805 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi072-64203-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:29.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:29 smithi072 bash[21573]: audit 2024-03-30T15:14:28.580138+0000 mon.a (mon.0) 1806 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:14:29.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:29 smithi072 bash[28946]: cluster 2024-03-30T15:14:27.952151+0000 mgr.y (mgr.14526) 284 : cluster 0 pgmap v318: 298 pgs: 72 unknown, 226 active+clean; 585 KiB data, 570 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:14:29.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:29 smithi072 bash[28946]: audit 2024-03-30T15:14:28.056728+0000 mon.a (mon.0) 1800 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:29.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:29 smithi072 bash[28946]: cluster 2024-03-30T15:14:28.065305+0000 mon.a (mon.0) 1801 : cluster 0 osdmap e210: 8 total, 8 up, 8 in 2024-03-30T15:14:29.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:29 smithi072 bash[28946]: audit 2024-03-30T15:14:28.081477+0000 mon.c (mon.2) 292 : audit 1 from='client.? 172.21.15.72:0/3024719314' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi072-64163-30"}]: dispatch 2024-03-30T15:14:29.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:29 smithi072 bash[28946]: audit 2024-03-30T15:14:28.085077+0000 mon.a (mon.0) 1802 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi072-64163-30"}]: dispatch 2024-03-30T15:14:29.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:29 smithi072 bash[28946]: audit 2024-03-30T15:14:28.126931+0000 mon.c (mon.2) 293 : audit 1 from='client.? 172.21.15.72:0/2427197094' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi072-64203-2"}]: dispatch 2024-03-30T15:14:29.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:29 smithi072 bash[28946]: audit 2024-03-30T15:14:28.127659+0000 mon.a (mon.0) 1803 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi072-64203-2"}]: dispatch 2024-03-30T15:14:29.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:29 smithi072 bash[28946]: audit 2024-03-30T15:14:28.129528+0000 mon.c (mon.2) 294 : audit 1 from='client.? 172.21.15.72:0/2427197094' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi072-64203-2"}]: dispatch 2024-03-30T15:14:29.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:29 smithi072 bash[28946]: audit 2024-03-30T15:14:28.130835+0000 mon.a (mon.0) 1804 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi072-64203-2"}]: dispatch 2024-03-30T15:14:29.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:29 smithi072 bash[28946]: audit 2024-03-30T15:14:28.131902+0000 mon.c (mon.2) 295 : audit 1 from='client.? 172.21.15.72:0/2427197094' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi072-64203-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:29.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:29 smithi072 bash[28946]: audit 2024-03-30T15:14:28.132561+0000 mon.a (mon.0) 1805 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi072-64203-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:29.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:29 smithi072 bash[28946]: audit 2024-03-30T15:14:28.580138+0000 mon.a (mon.0) 1806 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:14:29.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:29 smithi172 bash[23680]: cluster 2024-03-30T15:14:27.952151+0000 mgr.y (mgr.14526) 284 : cluster 0 pgmap v318: 298 pgs: 72 unknown, 226 active+clean; 585 KiB data, 570 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:14:29.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:29 smithi172 bash[23680]: audit 2024-03-30T15:14:28.056728+0000 mon.a (mon.0) 1800 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:29.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:29 smithi172 bash[23680]: cluster 2024-03-30T15:14:28.065305+0000 mon.a (mon.0) 1801 : cluster 0 osdmap e210: 8 total, 8 up, 8 in 2024-03-30T15:14:29.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:29 smithi172 bash[23680]: audit 2024-03-30T15:14:28.081477+0000 mon.c (mon.2) 292 : audit 1 from='client.? 172.21.15.72:0/3024719314' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi072-64163-30"}]: dispatch 2024-03-30T15:14:29.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:29 smithi172 bash[23680]: audit 2024-03-30T15:14:28.085077+0000 mon.a (mon.0) 1802 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi072-64163-30"}]: dispatch 2024-03-30T15:14:29.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:29 smithi172 bash[23680]: audit 2024-03-30T15:14:28.126931+0000 mon.c (mon.2) 293 : audit 1 from='client.? 172.21.15.72:0/2427197094' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi072-64203-2"}]: dispatch 2024-03-30T15:14:29.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:29 smithi172 bash[23680]: audit 2024-03-30T15:14:28.127659+0000 mon.a (mon.0) 1803 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi072-64203-2"}]: dispatch 2024-03-30T15:14:29.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:29 smithi172 bash[23680]: audit 2024-03-30T15:14:28.129528+0000 mon.c (mon.2) 294 : audit 1 from='client.? 172.21.15.72:0/2427197094' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi072-64203-2"}]: dispatch 2024-03-30T15:14:29.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:29 smithi172 bash[23680]: audit 2024-03-30T15:14:28.130835+0000 mon.a (mon.0) 1804 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi072-64203-2"}]: dispatch 2024-03-30T15:14:29.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:29 smithi172 bash[23680]: audit 2024-03-30T15:14:28.131902+0000 mon.c (mon.2) 295 : audit 1 from='client.? 172.21.15.72:0/2427197094' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi072-64203-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:29.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:29 smithi172 bash[23680]: audit 2024-03-30T15:14:28.132561+0000 mon.a (mon.0) 1805 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi072-64203-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:29.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:29 smithi172 bash[23680]: audit 2024-03-30T15:14:28.580138+0000 mon.a (mon.0) 1806 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:14:30.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:30 smithi072 bash[21573]: audit 2024-03-30T15:14:29.060252+0000 mon.a (mon.0) 1807 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi072-64163-30"}]': finished 2024-03-30T15:14:30.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:30 smithi072 bash[21573]: audit 2024-03-30T15:14:29.060499+0000 mon.a (mon.0) 1808 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi072-64203-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:14:30.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:30 smithi072 bash[21573]: audit 2024-03-30T15:14:29.060755+0000 mon.a (mon.0) 1809 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-21", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:14:30.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:30 smithi072 bash[21573]: cluster 2024-03-30T15:14:29.068642+0000 mon.a (mon.0) 1810 : cluster 0 osdmap e211: 8 total, 8 up, 8 in 2024-03-30T15:14:30.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:30 smithi072 bash[21573]: audit 2024-03-30T15:14:29.069037+0000 mon.c (mon.2) 296 : audit 1 from='client.? 172.21.15.72:0/3024719314' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi072-64163-30"}]: dispatch 2024-03-30T15:14:30.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:30 smithi072 bash[21573]: audit 2024-03-30T15:14:29.070862+0000 mon.a (mon.0) 1811 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-21"}]: dispatch 2024-03-30T15:14:30.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:30 smithi072 bash[21573]: audit 2024-03-30T15:14:29.073282+0000 mon.c (mon.2) 297 : audit 1 from='client.? 172.21.15.72:0/2427197094' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi072-64203-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi072-64203-2"}]: dispatch 2024-03-30T15:14:30.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:30 smithi072 bash[21573]: audit 2024-03-30T15:14:29.077298+0000 mon.a (mon.0) 1812 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi072-64163-30"}]: dispatch 2024-03-30T15:14:30.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:30 smithi072 bash[21573]: audit 2024-03-30T15:14:29.087932+0000 mon.a (mon.0) 1813 : audit 1 from='client.? 172.21.15.72:0/10228515' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi072-64171-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:30.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:30 smithi072 bash[21573]: audit 2024-03-30T15:14:29.093103+0000 mon.a (mon.0) 1814 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi072-64203-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi072-64203-2"}]: dispatch 2024-03-30T15:14:30.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:30 smithi072 bash[21573]: audit 2024-03-30T15:14:30.065023+0000 mon.a (mon.0) 1815 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-21"}]': finished 2024-03-30T15:14:30.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:30 smithi072 bash[28946]: audit 2024-03-30T15:14:29.060252+0000 mon.a (mon.0) 1807 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi072-64163-30"}]': finished 2024-03-30T15:14:30.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:30 smithi072 bash[28946]: audit 2024-03-30T15:14:29.060499+0000 mon.a (mon.0) 1808 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi072-64203-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:14:30.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:30 smithi072 bash[28946]: audit 2024-03-30T15:14:29.060755+0000 mon.a (mon.0) 1809 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-21", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:14:30.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:30 smithi072 bash[28946]: cluster 2024-03-30T15:14:29.068642+0000 mon.a (mon.0) 1810 : cluster 0 osdmap e211: 8 total, 8 up, 8 in 2024-03-30T15:14:30.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:30 smithi072 bash[28946]: audit 2024-03-30T15:14:29.069037+0000 mon.c (mon.2) 296 : audit 1 from='client.? 172.21.15.72:0/3024719314' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi072-64163-30"}]: dispatch 2024-03-30T15:14:30.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:30 smithi072 bash[28946]: audit 2024-03-30T15:14:29.070862+0000 mon.a (mon.0) 1811 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-21"}]: dispatch 2024-03-30T15:14:30.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:30 smithi072 bash[28946]: audit 2024-03-30T15:14:29.073282+0000 mon.c (mon.2) 297 : audit 1 from='client.? 172.21.15.72:0/2427197094' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi072-64203-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi072-64203-2"}]: dispatch 2024-03-30T15:14:30.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:30 smithi072 bash[28946]: audit 2024-03-30T15:14:29.077298+0000 mon.a (mon.0) 1812 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi072-64163-30"}]: dispatch 2024-03-30T15:14:30.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:30 smithi072 bash[28946]: audit 2024-03-30T15:14:29.087932+0000 mon.a (mon.0) 1813 : audit 1 from='client.? 172.21.15.72:0/10228515' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi072-64171-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:30.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:30 smithi072 bash[28946]: audit 2024-03-30T15:14:29.093103+0000 mon.a (mon.0) 1814 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi072-64203-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi072-64203-2"}]: dispatch 2024-03-30T15:14:30.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:30 smithi072 bash[28946]: audit 2024-03-30T15:14:30.065023+0000 mon.a (mon.0) 1815 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-21"}]': finished 2024-03-30T15:14:30.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:30 smithi172 bash[23680]: audit 2024-03-30T15:14:29.060252+0000 mon.a (mon.0) 1807 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi072-64163-30"}]': finished 2024-03-30T15:14:30.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:30 smithi172 bash[23680]: audit 2024-03-30T15:14:29.060499+0000 mon.a (mon.0) 1808 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi072-64203-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:14:30.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:30 smithi172 bash[23680]: audit 2024-03-30T15:14:29.060755+0000 mon.a (mon.0) 1809 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-21", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:14:30.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:30 smithi172 bash[23680]: cluster 2024-03-30T15:14:29.068642+0000 mon.a (mon.0) 1810 : cluster 0 osdmap e211: 8 total, 8 up, 8 in 2024-03-30T15:14:30.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:30 smithi172 bash[23680]: audit 2024-03-30T15:14:29.069037+0000 mon.c (mon.2) 296 : audit 1 from='client.? 172.21.15.72:0/3024719314' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi072-64163-30"}]: dispatch 2024-03-30T15:14:30.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:30 smithi172 bash[23680]: audit 2024-03-30T15:14:29.070862+0000 mon.a (mon.0) 1811 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-21"}]: dispatch 2024-03-30T15:14:30.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:30 smithi172 bash[23680]: audit 2024-03-30T15:14:29.073282+0000 mon.c (mon.2) 297 : audit 1 from='client.? 172.21.15.72:0/2427197094' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi072-64203-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi072-64203-2"}]: dispatch 2024-03-30T15:14:30.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:30 smithi172 bash[23680]: audit 2024-03-30T15:14:29.077298+0000 mon.a (mon.0) 1812 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi072-64163-30"}]: dispatch 2024-03-30T15:14:30.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:30 smithi172 bash[23680]: audit 2024-03-30T15:14:29.087932+0000 mon.a (mon.0) 1813 : audit 1 from='client.? 172.21.15.72:0/10228515' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi072-64171-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:30.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:30 smithi172 bash[23680]: audit 2024-03-30T15:14:29.093103+0000 mon.a (mon.0) 1814 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi072-64203-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi072-64203-2"}]: dispatch 2024-03-30T15:14:30.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:30 smithi172 bash[23680]: audit 2024-03-30T15:14:30.065023+0000 mon.a (mon.0) 1815 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-21"}]': finished 2024-03-30T15:14:31.417 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:14:31 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:14:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:14:31.465 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:14:31 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:14:31.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:31 smithi072 bash[21573]: cluster 2024-03-30T15:14:29.952988+0000 mgr.y (mgr.14526) 285 : cluster 0 pgmap v321: 260 pgs: 64 unknown, 196 active+clean; 583 KiB data, 570 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:14:31.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:31 smithi072 bash[21573]: audit 2024-03-30T15:14:30.065196+0000 mon.a (mon.0) 1816 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi072-64163-30"}]': finished 2024-03-30T15:14:31.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:31 smithi072 bash[21573]: audit 2024-03-30T15:14:30.065379+0000 mon.a (mon.0) 1817 : audit 1 from='client.? 172.21.15.72:0/10228515' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi072-64171-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:31.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:31 smithi072 bash[21573]: audit 2024-03-30T15:14:30.122710+0000 mon.c (mon.2) 298 : audit 1 from='client.? 172.21.15.72:0/508501327' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi072-64163-31"}]: dispatch 2024-03-30T15:14:31.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:31 smithi072 bash[21573]: cluster 2024-03-30T15:14:30.524732+0000 mon.a (mon.0) 1818 : cluster 0 osdmap e212: 8 total, 8 up, 8 in 2024-03-30T15:14:31.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:31 smithi072 bash[21573]: audit 2024-03-30T15:14:30.527091+0000 mon.a (mon.0) 1819 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-21", "mode": "writeback"}]: dispatch 2024-03-30T15:14:31.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:31 smithi072 bash[21573]: audit 2024-03-30T15:14:30.541789+0000 mon.a (mon.0) 1820 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi072-64163-31"}]: dispatch 2024-03-30T15:14:31.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:31 smithi072 bash[21573]: audit 2024-03-30T15:14:30.545806+0000 mon.c (mon.2) 299 : audit 1 from='client.? 172.21.15.72:0/508501327' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi072-64163-31"}]: dispatch 2024-03-30T15:14:31.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:31 smithi072 bash[21573]: audit 2024-03-30T15:14:30.546142+0000 mon.a (mon.0) 1821 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi072-64163-31"}]: dispatch 2024-03-30T15:14:31.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:31 smithi072 bash[21573]: audit 2024-03-30T15:14:30.546659+0000 mon.c (mon.2) 300 : audit 1 from='client.? 172.21.15.72:0/508501327' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi072-64163-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:31.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:31 smithi072 bash[21573]: audit 2024-03-30T15:14:30.546950+0000 mon.a (mon.0) 1822 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi072-64163-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:31.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:31 smithi072 bash[21573]: cluster 2024-03-30T15:14:30.952913+0000 mon.a (mon.0) 1823 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:14:31.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:31 smithi072 bash[21573]: cluster 2024-03-30T15:14:31.065692+0000 mon.a (mon.0) 1824 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:14:31.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:31 smithi072 bash[21573]: audit 2024-03-30T15:14:31.068310+0000 mon.a (mon.0) 1825 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi072-64203-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi072-64203-2"}]': finished 2024-03-30T15:14:31.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:31 smithi072 bash[21573]: audit 2024-03-30T15:14:31.068597+0000 mon.a (mon.0) 1826 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-21", "mode": "writeback"}]': finished 2024-03-30T15:14:31.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:31 smithi072 bash[28946]: cluster 2024-03-30T15:14:29.952988+0000 mgr.y (mgr.14526) 285 : cluster 0 pgmap v321: 260 pgs: 64 unknown, 196 active+clean; 583 KiB data, 570 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:14:31.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:31 smithi072 bash[28946]: audit 2024-03-30T15:14:30.065196+0000 mon.a (mon.0) 1816 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi072-64163-30"}]': finished 2024-03-30T15:14:31.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:31 smithi072 bash[28946]: audit 2024-03-30T15:14:30.065379+0000 mon.a (mon.0) 1817 : audit 1 from='client.? 172.21.15.72:0/10228515' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi072-64171-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:31.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:31 smithi072 bash[28946]: audit 2024-03-30T15:14:30.122710+0000 mon.c (mon.2) 298 : audit 1 from='client.? 172.21.15.72:0/508501327' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi072-64163-31"}]: dispatch 2024-03-30T15:14:31.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:31 smithi072 bash[28946]: cluster 2024-03-30T15:14:30.524732+0000 mon.a (mon.0) 1818 : cluster 0 osdmap e212: 8 total, 8 up, 8 in 2024-03-30T15:14:31.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:31 smithi072 bash[28946]: audit 2024-03-30T15:14:30.527091+0000 mon.a (mon.0) 1819 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-21", "mode": "writeback"}]: dispatch 2024-03-30T15:14:31.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:31 smithi072 bash[28946]: audit 2024-03-30T15:14:30.541789+0000 mon.a (mon.0) 1820 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi072-64163-31"}]: dispatch 2024-03-30T15:14:31.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:31 smithi072 bash[28946]: audit 2024-03-30T15:14:30.545806+0000 mon.c (mon.2) 299 : audit 1 from='client.? 172.21.15.72:0/508501327' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi072-64163-31"}]: dispatch 2024-03-30T15:14:31.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:31 smithi072 bash[28946]: audit 2024-03-30T15:14:30.546142+0000 mon.a (mon.0) 1821 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi072-64163-31"}]: dispatch 2024-03-30T15:14:31.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:31 smithi072 bash[28946]: audit 2024-03-30T15:14:30.546659+0000 mon.c (mon.2) 300 : audit 1 from='client.? 172.21.15.72:0/508501327' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi072-64163-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:31.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:31 smithi072 bash[28946]: audit 2024-03-30T15:14:30.546950+0000 mon.a (mon.0) 1822 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi072-64163-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:31.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:31 smithi072 bash[28946]: cluster 2024-03-30T15:14:30.952913+0000 mon.a (mon.0) 1823 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:14:31.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:31 smithi072 bash[28946]: cluster 2024-03-30T15:14:31.065692+0000 mon.a (mon.0) 1824 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:14:31.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:31 smithi072 bash[28946]: audit 2024-03-30T15:14:31.068310+0000 mon.a (mon.0) 1825 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi072-64203-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi072-64203-2"}]': finished 2024-03-30T15:14:31.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:31 smithi072 bash[28946]: audit 2024-03-30T15:14:31.068597+0000 mon.a (mon.0) 1826 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-21", "mode": "writeback"}]': finished 2024-03-30T15:14:31.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:31 smithi072 bash[21573]: audit 2024-03-30T15:14:31.068785+0000 mon.a (mon.0) 1827 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi072-64163-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:14:31.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:31 smithi072 bash[21573]: cluster 2024-03-30T15:14:31.078101+0000 mon.a (mon.0) 1828 : cluster 0 osdmap e213: 8 total, 8 up, 8 in 2024-03-30T15:14:31.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:31 smithi072 bash[21573]: audit 2024-03-30T15:14:31.082649+0000 mon.c (mon.2) 301 : audit 1 from='client.? 172.21.15.72:0/508501327' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi072-64163-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi072-64163-31"}]: dispatch 2024-03-30T15:14:31.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:31 smithi072 bash[21573]: audit 2024-03-30T15:14:31.096459+0000 mon.a (mon.0) 1829 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi072-64163-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi072-64163-31"}]: dispatch 2024-03-30T15:14:31.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:31 smithi072 bash[28946]: audit 2024-03-30T15:14:31.068785+0000 mon.a (mon.0) 1827 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi072-64163-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:14:31.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:31 smithi072 bash[28946]: cluster 2024-03-30T15:14:31.078101+0000 mon.a (mon.0) 1828 : cluster 0 osdmap e213: 8 total, 8 up, 8 in 2024-03-30T15:14:31.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:31 smithi072 bash[28946]: audit 2024-03-30T15:14:31.082649+0000 mon.c (mon.2) 301 : audit 1 from='client.? 172.21.15.72:0/508501327' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi072-64163-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi072-64163-31"}]: dispatch 2024-03-30T15:14:31.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:31 smithi072 bash[28946]: audit 2024-03-30T15:14:31.096459+0000 mon.a (mon.0) 1829 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi072-64163-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi072-64163-31"}]: dispatch 2024-03-30T15:14:31.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:31 smithi172 bash[23680]: cluster 2024-03-30T15:14:29.952988+0000 mgr.y (mgr.14526) 285 : cluster 0 pgmap v321: 260 pgs: 64 unknown, 196 active+clean; 583 KiB data, 570 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:14:31.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:31 smithi172 bash[23680]: audit 2024-03-30T15:14:30.065196+0000 mon.a (mon.0) 1816 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi072-64163-30"}]': finished 2024-03-30T15:14:31.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:31 smithi172 bash[23680]: audit 2024-03-30T15:14:30.065379+0000 mon.a (mon.0) 1817 : audit 1 from='client.? 172.21.15.72:0/10228515' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi072-64171-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:31.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:31 smithi172 bash[23680]: audit 2024-03-30T15:14:30.122710+0000 mon.c (mon.2) 298 : audit 1 from='client.? 172.21.15.72:0/508501327' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi072-64163-31"}]: dispatch 2024-03-30T15:14:31.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:31 smithi172 bash[23680]: cluster 2024-03-30T15:14:30.524732+0000 mon.a (mon.0) 1818 : cluster 0 osdmap e212: 8 total, 8 up, 8 in 2024-03-30T15:14:31.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:31 smithi172 bash[23680]: audit 2024-03-30T15:14:30.527091+0000 mon.a (mon.0) 1819 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-21", "mode": "writeback"}]: dispatch 2024-03-30T15:14:31.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:31 smithi172 bash[23680]: audit 2024-03-30T15:14:30.541789+0000 mon.a (mon.0) 1820 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi072-64163-31"}]: dispatch 2024-03-30T15:14:31.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:31 smithi172 bash[23680]: audit 2024-03-30T15:14:30.545806+0000 mon.c (mon.2) 299 : audit 1 from='client.? 172.21.15.72:0/508501327' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi072-64163-31"}]: dispatch 2024-03-30T15:14:31.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:31 smithi172 bash[23680]: audit 2024-03-30T15:14:30.546142+0000 mon.a (mon.0) 1821 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi072-64163-31"}]: dispatch 2024-03-30T15:14:31.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:31 smithi172 bash[23680]: audit 2024-03-30T15:14:30.546659+0000 mon.c (mon.2) 300 : audit 1 from='client.? 172.21.15.72:0/508501327' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi072-64163-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:31.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:31 smithi172 bash[23680]: audit 2024-03-30T15:14:30.546950+0000 mon.a (mon.0) 1822 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi072-64163-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:31.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:31 smithi172 bash[23680]: cluster 2024-03-30T15:14:30.952913+0000 mon.a (mon.0) 1823 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:14:31.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:31 smithi172 bash[23680]: cluster 2024-03-30T15:14:31.065692+0000 mon.a (mon.0) 1824 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:14:31.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:31 smithi172 bash[23680]: audit 2024-03-30T15:14:31.068310+0000 mon.a (mon.0) 1825 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi072-64203-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi072-64203-2"}]': finished 2024-03-30T15:14:31.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:31 smithi172 bash[23680]: audit 2024-03-30T15:14:31.068597+0000 mon.a (mon.0) 1826 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-21", "mode": "writeback"}]': finished 2024-03-30T15:14:31.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:31 smithi172 bash[23680]: audit 2024-03-30T15:14:31.068785+0000 mon.a (mon.0) 1827 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi072-64163-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:14:31.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:31 smithi172 bash[23680]: cluster 2024-03-30T15:14:31.078101+0000 mon.a (mon.0) 1828 : cluster 0 osdmap e213: 8 total, 8 up, 8 in 2024-03-30T15:14:31.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:31 smithi172 bash[23680]: audit 2024-03-30T15:14:31.082649+0000 mon.c (mon.2) 301 : audit 1 from='client.? 172.21.15.72:0/508501327' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi072-64163-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi072-64163-31"}]: dispatch 2024-03-30T15:14:31.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:31 smithi172 bash[23680]: audit 2024-03-30T15:14:31.096459+0000 mon.a (mon.0) 1829 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi072-64163-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi072-64163-31"}]: dispatch 2024-03-30T15:14:32.206 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosA: : entry=15 expected=15 2024-03-30T15:14:32.207 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : seek to 25:02547ec2:::1:head 2024-03-30T15:14:32.207 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : cursor()=25:02547ec2:::1:head expected=25:02547ec2:::1:head 2024-03-30T15:14:32.207 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > 25:02547ec2:::1:head -> 1 2024-03-30T15:14:32.207 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : entry=1 expected=1 2024-03-30T15:14:32.207 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : seek to 25:cfc208b3:::3:head 2024-03-30T15:14:32.207 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : cursor()=25:cfc208b3:::3:head expected=25:cfc208b3:::3:head 2024-03-30T15:14:32.207 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > 25:cfc208b3:::3:head -> 3 2024-03-30T15:14:32.207 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : entry=3 expected=3 2024-03-30T15:14:32.207 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : seek to 25:c4fdafeb:::6:head 2024-03-30T15:14:32.207 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : cursor()=25:c4fdafeb:::6:head expected=25:c4fdafeb:::6:head 2024-03-30T15:14:32.207 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > 25:c4fdafeb:::6:head -> 6 2024-03-30T15:14:32.207 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : entry=6 expected=6 2024-03-30T15:14:32.207 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : seek to 25:bd63b0f1:::8:head 2024-03-30T15:14:32.208 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : cursor()=25:bd63b0f1:::8:head expected=25:bd63b0f1:::8:head 2024-03-30T15:14:32.208 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > 25:bd63b0f1:::8:head -> 8 2024-03-30T15:14:32.208 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : entry=8 expected=8 2024-03-30T15:14:32.208 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : seek to 25:5c6b0b28:::7:head 2024-03-30T15:14:32.208 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : cursor()=25:5c6b0b28:::7:head expected=25:5c6b0b28:::7:head 2024-03-30T15:14:32.208 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > 25:5c6b0b28:::7:head -> 7 2024-03-30T15:14:32.208 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : entry=7 expected=7 2024-03-30T15:14:32.208 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : seek to 25:566253c9:::13:head 2024-03-30T15:14:32.208 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : cursor()=25:566253c9:::13:head expected=25:566253c9:::13:head 2024-03-30T15:14:32.208 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > 25:566253c9:::13:head -> 13 2024-03-30T15:14:32.208 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : entry=13 expected=13 2024-03-30T15:14:32.208 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : seek to 25:6cac518f:::0:head 2024-03-30T15:14:32.208 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : cursor()=25:6cac518f:::0:head expected=25:6cac518f:::0:head 2024-03-30T15:14:32.208 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > 25:6cac518f:::0:head -> 0 2024-03-30T15:14:32.208 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : entry=0 expected=0 2024-03-30T15:14:32.209 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : seek to 25:62a1935d:::14:head 2024-03-30T15:14:32.209 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : cursor()=25:62a1935d:::14:head expected=25:62a1935d:::14:head 2024-03-30T15:14:32.209 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: > 25:62a1935d:::14:head -> 14 2024-03-30T15:14:32.209 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: : entry=14 expected=14 2024-03-30T15:14:32.209 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: [ OK ] LibRadosList.ListObjectsCursor (241 ms) 2024-03-30T15:14:32.209 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjects 2024-03-30T15:14:32.209 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: [ OK ] LibRadosList.EnumerateObjects (130471 ms) 2024-03-30T15:14:32.209 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjectsSplit 2024-03-30T15:14:32.209 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: split 0/5 -> MIN 25:33333333::::head 2024-03-30T15:14:32.209 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: split 1/5 -> 25:33333333::::head 25:66666666::::head 2024-03-30T15:14:32.209 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: split 2/5 -> 25:66666666::::head 25:99999999::::head 2024-03-30T15:14:32.209 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: split 3/5 -> 25:99999999::::head 25:cccccccc::::head 2024-03-30T15:14:32.209 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: split 4/5 -> 25:cccccccc::::head MAX 2024-03-30T15:14:32.209 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: [ OK ] LibRadosList.EnumerateObjectsSplit (7513 ms) 2024-03-30T15:14:32.209 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: [----------] 7 tests from LibRadosList (138559 ms total) 2024-03-30T15:14:32.210 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: 2024-03-30T15:14:32.210 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: [----------] 3 tests from LibRadosListEC 2024-03-30T15:14:32.210 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: [ RUN ] LibRadosListEC.ListObjects 2024-03-30T15:14:32.210 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: [ OK ] LibRadosListEC.ListObjects (1058 ms) 2024-03-30T15:14:32.210 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsNS 2024-03-30T15:14:32.210 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: myset foo1,foo2,foo3 2024-03-30T15:14:32.210 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: foo1 2024-03-30T15:14:32.210 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: foo2 2024-03-30T15:14:32.210 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: foo3 2024-03-30T15:14:32.210 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: myset foo1,foo4,foo5 2024-03-30T15:14:32.210 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: foo4 2024-03-30T15:14:32.210 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: foo5 2024-03-30T15:14:32.210 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: foo1 2024-03-30T15:14:32.210 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: myset foo6,foo7 2024-03-30T15:14:32.210 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: foo7 2024-03-30T15:14:32.211 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: foo6 2024-03-30T15:14:32.211 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-03-30T15:14:32.211 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: ns1:foo4 2024-03-30T15:14:32.211 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: ns1:foo5 2024-03-30T15:14:32.211 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: ns2:foo7 2024-03-30T15:14:32.211 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: ns2:foo6 2024-03-30T15:14:32.211 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: ns1:foo1 2024-03-30T15:14:32.212 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: :foo1 2024-03-30T15:14:32.212 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: :foo2 2024-03-30T15:14:32.212 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: :foo3 2024-03-30T15:14:32.212 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsNS (70 ms) 2024-03-30T15:14:32.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:32 smithi072 bash[21573]: audit 2024-03-30T15:14:31.092321+0000 mgr.y (mgr.14526) 286 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:14:32.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:32 smithi072 bash[21573]: audit 2024-03-30T15:14:31.568566+0000 mon.a (mon.0) 1830 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:14:32.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:32 smithi072 bash[21573]: audit 2024-03-30T15:14:32.073753+0000 mon.a (mon.0) 1831 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:14:32.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:32 smithi072 bash[21573]: cluster 2024-03-30T15:14:32.547983+0000 mon.a (mon.0) 1832 : cluster 0 osdmap e214: 8 total, 8 up, 8 in 2024-03-30T15:14:32.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:32 smithi072 bash[21573]: audit 2024-03-30T15:14:32.548694+0000 mon.a (mon.0) 1833 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-21"}]: dispatch 2024-03-30T15:14:32.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:32 smithi072 bash[21573]: audit 2024-03-30T15:14:32.549844+0000 mon.a (mon.0) 1834 : audit 1 from='client.? 172.21.15.72:0/2697918199' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi072-64171-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:32.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:32 smithi072 bash[28946]: audit 2024-03-30T15:14:31.092321+0000 mgr.y (mgr.14526) 286 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:14:32.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:32 smithi072 bash[28946]: audit 2024-03-30T15:14:31.568566+0000 mon.a (mon.0) 1830 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:14:32.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:32 smithi072 bash[28946]: audit 2024-03-30T15:14:32.073753+0000 mon.a (mon.0) 1831 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:14:32.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:32 smithi072 bash[28946]: cluster 2024-03-30T15:14:32.547983+0000 mon.a (mon.0) 1832 : cluster 0 osdmap e214: 8 total, 8 up, 8 in 2024-03-30T15:14:32.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:32 smithi072 bash[28946]: audit 2024-03-30T15:14:32.548694+0000 mon.a (mon.0) 1833 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-21"}]: dispatch 2024-03-30T15:14:32.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:32 smithi072 bash[28946]: audit 2024-03-30T15:14:32.549844+0000 mon.a (mon.0) 1834 : audit 1 from='client.? 172.21.15.72:0/2697918199' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi072-64171-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:32.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:32 smithi172 bash[23680]: audit 2024-03-30T15:14:31.092321+0000 mgr.y (mgr.14526) 286 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:14:32.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:32 smithi172 bash[23680]: audit 2024-03-30T15:14:31.568566+0000 mon.a (mon.0) 1830 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:14:32.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:32 smithi172 bash[23680]: audit 2024-03-30T15:14:32.073753+0000 mon.a (mon.0) 1831 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:14:32.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:32 smithi172 bash[23680]: cluster 2024-03-30T15:14:32.547983+0000 mon.a (mon.0) 1832 : cluster 0 osdmap e214: 8 total, 8 up, 8 in 2024-03-30T15:14:32.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:32 smithi172 bash[23680]: audit 2024-03-30T15:14:32.548694+0000 mon.a (mon.0) 1833 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-21"}]: dispatch 2024-03-30T15:14:32.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:32 smithi172 bash[23680]: audit 2024-03-30T15:14:32.549844+0000 mon.a (mon.0) 1834 : audit 1 from='client.? 172.21.15.72:0/2697918199' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi072-64171-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:33.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:33 smithi072 bash[21573]: cluster 2024-03-30T15:14:31.953785+0000 mgr.y (mgr.14526) 287 : cluster 0 pgmap v324: 236 pgs: 8 unknown, 228 active+clean; 583 KiB data, 570 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:14:33.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:33 smithi072 bash[21573]: cluster 2024-03-30T15:14:33.074703+0000 mon.a (mon.0) 1835 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:14:33.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:33 smithi072 bash[21573]: audit 2024-03-30T15:14:33.077353+0000 mon.a (mon.0) 1836 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi072-64163-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi072-64163-31"}]': finished 2024-03-30T15:14:33.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:33 smithi072 bash[21573]: audit 2024-03-30T15:14:33.077572+0000 mon.a (mon.0) 1837 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-21"}]': finished 2024-03-30T15:14:33.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:33 smithi072 bash[21573]: audit 2024-03-30T15:14:33.077769+0000 mon.a (mon.0) 1838 : audit 1 from='client.? 172.21.15.72:0/2697918199' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi072-64171-36","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:33.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:33 smithi072 bash[21573]: cluster 2024-03-30T15:14:33.084618+0000 mon.a (mon.0) 1839 : cluster 0 osdmap e215: 8 total, 8 up, 8 in 2024-03-30T15:14:33.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:33 smithi072 bash[21573]: audit 2024-03-30T15:14:33.091895+0000 mon.c (mon.2) 302 : audit 1 from='client.? 172.21.15.72:0/2427197094' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi072-64203-2"}]: dispatch 2024-03-30T15:14:33.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:33 smithi072 bash[21573]: audit 2024-03-30T15:14:33.093405+0000 mon.a (mon.0) 1840 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi072-64203-2"}]: dispatch 2024-03-30T15:14:33.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:33 smithi072 bash[28946]: cluster 2024-03-30T15:14:31.953785+0000 mgr.y (mgr.14526) 287 : cluster 0 pgmap v324: 236 pgs: 8 unknown, 228 active+clean; 583 KiB data, 570 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:14:33.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:33 smithi072 bash[28946]: cluster 2024-03-30T15:14:33.074703+0000 mon.a (mon.0) 1835 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:14:33.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:33 smithi072 bash[28946]: audit 2024-03-30T15:14:33.077353+0000 mon.a (mon.0) 1836 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi072-64163-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi072-64163-31"}]': finished 2024-03-30T15:14:33.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:33 smithi072 bash[28946]: audit 2024-03-30T15:14:33.077572+0000 mon.a (mon.0) 1837 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-21"}]': finished 2024-03-30T15:14:33.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:33 smithi072 bash[28946]: audit 2024-03-30T15:14:33.077769+0000 mon.a (mon.0) 1838 : audit 1 from='client.? 172.21.15.72:0/2697918199' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi072-64171-36","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:33.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:33 smithi072 bash[28946]: cluster 2024-03-30T15:14:33.084618+0000 mon.a (mon.0) 1839 : cluster 0 osdmap e215: 8 total, 8 up, 8 in 2024-03-30T15:14:33.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:33 smithi072 bash[28946]: audit 2024-03-30T15:14:33.091895+0000 mon.c (mon.2) 302 : audit 1 from='client.? 172.21.15.72:0/2427197094' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi072-64203-2"}]: dispatch 2024-03-30T15:14:33.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:33 smithi072 bash[28946]: audit 2024-03-30T15:14:33.093405+0000 mon.a (mon.0) 1840 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi072-64203-2"}]: dispatch 2024-03-30T15:14:33.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:33 smithi172 bash[23680]: cluster 2024-03-30T15:14:31.953785+0000 mgr.y (mgr.14526) 287 : cluster 0 pgmap v324: 236 pgs: 8 unknown, 228 active+clean; 583 KiB data, 570 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:14:33.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:33 smithi172 bash[23680]: cluster 2024-03-30T15:14:33.074703+0000 mon.a (mon.0) 1835 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:14:33.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:33 smithi172 bash[23680]: audit 2024-03-30T15:14:33.077353+0000 mon.a (mon.0) 1836 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi072-64163-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi072-64163-31"}]': finished 2024-03-30T15:14:33.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:33 smithi172 bash[23680]: audit 2024-03-30T15:14:33.077572+0000 mon.a (mon.0) 1837 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-21"}]': finished 2024-03-30T15:14:33.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:33 smithi172 bash[23680]: audit 2024-03-30T15:14:33.077769+0000 mon.a (mon.0) 1838 : audit 1 from='client.? 172.21.15.72:0/2697918199' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi072-64171-36","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:33.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:33 smithi172 bash[23680]: cluster 2024-03-30T15:14:33.084618+0000 mon.a (mon.0) 1839 : cluster 0 osdmap e215: 8 total, 8 up, 8 in 2024-03-30T15:14:33.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:33 smithi172 bash[23680]: audit 2024-03-30T15:14:33.091895+0000 mon.c (mon.2) 302 : audit 1 from='client.? 172.21.15.72:0/2427197094' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi072-64203-2"}]: dispatch 2024-03-30T15:14:33.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:33 smithi172 bash[23680]: audit 2024-03-30T15:14:33.093405+0000 mon.a (mon.0) 1840 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi072-64203-2"}]: dispatch 2024-03-30T15:14:35.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:35 smithi072 bash[21573]: cluster 2024-03-30T15:14:33.954651+0000 mgr.y (mgr.14526) 288 : cluster 0 pgmap v327: 268 pgs: 40 unknown, 228 active+clean; 583 KiB data, 570 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:14:35.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:35 smithi072 bash[21573]: audit 2024-03-30T15:14:34.081525+0000 mon.a (mon.0) 1841 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi072-64203-2"}]': finished 2024-03-30T15:14:35.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:35 smithi072 bash[21573]: cluster 2024-03-30T15:14:34.090533+0000 mon.a (mon.0) 1842 : cluster 0 osdmap e216: 8 total, 8 up, 8 in 2024-03-30T15:14:35.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:35 smithi072 bash[21573]: audit 2024-03-30T15:14:34.093294+0000 mon.c (mon.2) 303 : audit 1 from='client.? 172.21.15.72:0/2427197094' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi072-64203-2"}]: dispatch 2024-03-30T15:14:35.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:35 smithi072 bash[21573]: audit 2024-03-30T15:14:34.095458+0000 mon.c (mon.2) 304 : audit 1 from='client.? 172.21.15.72:0/2055633420' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi072-64171-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:35.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:35 smithi072 bash[21573]: audit 2024-03-30T15:14:34.096565+0000 mon.a (mon.0) 1843 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi072-64203-2"}]: dispatch 2024-03-30T15:14:35.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:35 smithi072 bash[21573]: audit 2024-03-30T15:14:34.547757+0000 mon.a (mon.0) 1844 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi072-64171-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:35.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:35 smithi072 bash[28946]: cluster 2024-03-30T15:14:33.954651+0000 mgr.y (mgr.14526) 288 : cluster 0 pgmap v327: 268 pgs: 40 unknown, 228 active+clean; 583 KiB data, 570 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:14:35.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:35 smithi072 bash[28946]: audit 2024-03-30T15:14:34.081525+0000 mon.a (mon.0) 1841 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi072-64203-2"}]': finished 2024-03-30T15:14:35.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:35 smithi072 bash[28946]: cluster 2024-03-30T15:14:34.090533+0000 mon.a (mon.0) 1842 : cluster 0 osdmap e216: 8 total, 8 up, 8 in 2024-03-30T15:14:35.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:35 smithi072 bash[28946]: audit 2024-03-30T15:14:34.093294+0000 mon.c (mon.2) 303 : audit 1 from='client.? 172.21.15.72:0/2427197094' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi072-64203-2"}]: dispatch 2024-03-30T15:14:35.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:35 smithi072 bash[28946]: audit 2024-03-30T15:14:34.095458+0000 mon.c (mon.2) 304 : audit 1 from='client.? 172.21.15.72:0/2055633420' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi072-64171-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:35.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:35 smithi072 bash[28946]: audit 2024-03-30T15:14:34.096565+0000 mon.a (mon.0) 1843 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi072-64203-2"}]: dispatch 2024-03-30T15:14:35.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:35 smithi072 bash[28946]: audit 2024-03-30T15:14:34.547757+0000 mon.a (mon.0) 1844 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi072-64171-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:35.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:35 smithi172 bash[23680]: cluster 2024-03-30T15:14:33.954651+0000 mgr.y (mgr.14526) 288 : cluster 0 pgmap v327: 268 pgs: 40 unknown, 228 active+clean; 583 KiB data, 570 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:14:35.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:35 smithi172 bash[23680]: audit 2024-03-30T15:14:34.081525+0000 mon.a (mon.0) 1841 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi072-64203-2"}]': finished 2024-03-30T15:14:35.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:35 smithi172 bash[23680]: cluster 2024-03-30T15:14:34.090533+0000 mon.a (mon.0) 1842 : cluster 0 osdmap e216: 8 total, 8 up, 8 in 2024-03-30T15:14:35.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:35 smithi172 bash[23680]: audit 2024-03-30T15:14:34.093294+0000 mon.c (mon.2) 303 : audit 1 from='client.? 172.21.15.72:0/2427197094' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi072-64203-2"}]: dispatch 2024-03-30T15:14:35.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:35 smithi172 bash[23680]: audit 2024-03-30T15:14:34.095458+0000 mon.c (mon.2) 304 : audit 1 from='client.? 172.21.15.72:0/2055633420' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi072-64171-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:35.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:35 smithi172 bash[23680]: audit 2024-03-30T15:14:34.096565+0000 mon.a (mon.0) 1843 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi072-64203-2"}]: dispatch 2024-03-30T15:14:35.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:35 smithi172 bash[23680]: audit 2024-03-30T15:14:34.547757+0000 mon.a (mon.0) 1844 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi072-64171-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:36.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:36 smithi072 bash[21573]: audit 2024-03-30T15:14:35.086823+0000 mon.a (mon.0) 1845 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi072-64203-2"}]': finished 2024-03-30T15:14:36.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:36 smithi072 bash[21573]: audit 2024-03-30T15:14:35.087056+0000 mon.a (mon.0) 1846 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi072-64171-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:36.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:36 smithi072 bash[21573]: cluster 2024-03-30T15:14:35.097927+0000 mon.a (mon.0) 1847 : cluster 0 osdmap e217: 8 total, 8 up, 8 in 2024-03-30T15:14:36.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:36 smithi072 bash[21573]: audit 2024-03-30T15:14:35.102696+0000 mon.c (mon.2) 305 : audit 1 from='client.? 172.21.15.72:0/508501327' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi072-64163-31"}]: dispatch 2024-03-30T15:14:36.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:36 smithi072 bash[21573]: audit 2024-03-30T15:14:35.103404+0000 mon.a (mon.0) 1848 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:36.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:36 smithi072 bash[21573]: audit 2024-03-30T15:14:35.144251+0000 mon.a (mon.0) 1849 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi072-64163-31"}]: dispatch 2024-03-30T15:14:36.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:36 smithi072 bash[21573]: audit 2024-03-30T15:14:35.756595+0000 mon.c (mon.2) 306 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:14:36.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:36 smithi072 bash[21573]: audit 2024-03-30T15:14:36.091481+0000 mon.a (mon.0) 1850 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:36.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:36 smithi072 bash[21573]: audit 2024-03-30T15:14:36.091703+0000 mon.a (mon.0) 1851 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi072-64163-31"}]': finished 2024-03-30T15:14:36.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:36 smithi072 bash[21573]: cluster 2024-03-30T15:14:36.095996+0000 mon.a (mon.0) 1852 : cluster 0 osdmap e218: 8 total, 8 up, 8 in 2024-03-30T15:14:36.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:36 smithi072 bash[21573]: audit 2024-03-30T15:14:36.100543+0000 mon.c (mon.2) 307 : audit 1 from='client.? 172.21.15.72:0/508501327' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi072-64163-31"}]: dispatch 2024-03-30T15:14:36.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:36 smithi072 bash[21573]: audit 2024-03-30T15:14:36.103599+0000 mon.c (mon.2) 308 : audit 1 from='client.? 172.21.15.72:0/1324482081' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi072-64171-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:36.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:36 smithi072 bash[21573]: audit 2024-03-30T15:14:36.103620+0000 mon.a (mon.0) 1853 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi072-64163-31"}]: dispatch 2024-03-30T15:14:36.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:36 smithi072 bash[21573]: audit 2024-03-30T15:14:36.113279+0000 mon.c (mon.2) 309 : audit 1 from='client.? 172.21.15.72:0/4141912362' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64203-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:36.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:36 smithi072 bash[21573]: audit 2024-03-30T15:14:36.121135+0000 mon.a (mon.0) 1854 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi072-64171-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:36.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:36 smithi072 bash[21573]: audit 2024-03-30T15:14:36.123766+0000 mon.a (mon.0) 1855 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64203-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:36.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:36 smithi072 bash[28946]: audit 2024-03-30T15:14:35.086823+0000 mon.a (mon.0) 1845 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi072-64203-2"}]': finished 2024-03-30T15:14:36.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:36 smithi072 bash[28946]: audit 2024-03-30T15:14:35.087056+0000 mon.a (mon.0) 1846 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi072-64171-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:36.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:36 smithi072 bash[28946]: cluster 2024-03-30T15:14:35.097927+0000 mon.a (mon.0) 1847 : cluster 0 osdmap e217: 8 total, 8 up, 8 in 2024-03-30T15:14:36.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:36 smithi072 bash[28946]: audit 2024-03-30T15:14:35.102696+0000 mon.c (mon.2) 305 : audit 1 from='client.? 172.21.15.72:0/508501327' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi072-64163-31"}]: dispatch 2024-03-30T15:14:36.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:36 smithi072 bash[28946]: audit 2024-03-30T15:14:35.103404+0000 mon.a (mon.0) 1848 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:36.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:36 smithi072 bash[28946]: audit 2024-03-30T15:14:35.144251+0000 mon.a (mon.0) 1849 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi072-64163-31"}]: dispatch 2024-03-30T15:14:36.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:36 smithi072 bash[28946]: audit 2024-03-30T15:14:35.756595+0000 mon.c (mon.2) 306 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:14:36.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:36 smithi072 bash[28946]: audit 2024-03-30T15:14:36.091481+0000 mon.a (mon.0) 1850 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:36.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:36 smithi072 bash[28946]: audit 2024-03-30T15:14:36.091703+0000 mon.a (mon.0) 1851 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi072-64163-31"}]': finished 2024-03-30T15:14:36.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:36 smithi072 bash[28946]: cluster 2024-03-30T15:14:36.095996+0000 mon.a (mon.0) 1852 : cluster 0 osdmap e218: 8 total, 8 up, 8 in 2024-03-30T15:14:36.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:36 smithi072 bash[28946]: audit 2024-03-30T15:14:36.100543+0000 mon.c (mon.2) 307 : audit 1 from='client.? 172.21.15.72:0/508501327' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi072-64163-31"}]: dispatch 2024-03-30T15:14:36.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:36 smithi072 bash[28946]: audit 2024-03-30T15:14:36.103599+0000 mon.c (mon.2) 308 : audit 1 from='client.? 172.21.15.72:0/1324482081' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi072-64171-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:36.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:36 smithi072 bash[28946]: audit 2024-03-30T15:14:36.103620+0000 mon.a (mon.0) 1853 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi072-64163-31"}]: dispatch 2024-03-30T15:14:36.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:36 smithi072 bash[28946]: audit 2024-03-30T15:14:36.113279+0000 mon.c (mon.2) 309 : audit 1 from='client.? 172.21.15.72:0/4141912362' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64203-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:36.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:36 smithi072 bash[28946]: audit 2024-03-30T15:14:36.121135+0000 mon.a (mon.0) 1854 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi072-64171-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:36.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:36 smithi072 bash[28946]: audit 2024-03-30T15:14:36.123766+0000 mon.a (mon.0) 1855 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64203-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:36.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:36 smithi172 bash[23680]: audit 2024-03-30T15:14:35.086823+0000 mon.a (mon.0) 1845 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi072-64203-2"}]': finished 2024-03-30T15:14:36.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:36 smithi172 bash[23680]: audit 2024-03-30T15:14:35.087056+0000 mon.a (mon.0) 1846 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi072-64171-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:36.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:36 smithi172 bash[23680]: cluster 2024-03-30T15:14:35.097927+0000 mon.a (mon.0) 1847 : cluster 0 osdmap e217: 8 total, 8 up, 8 in 2024-03-30T15:14:36.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:36 smithi172 bash[23680]: audit 2024-03-30T15:14:35.102696+0000 mon.c (mon.2) 305 : audit 1 from='client.? 172.21.15.72:0/508501327' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi072-64163-31"}]: dispatch 2024-03-30T15:14:36.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:36 smithi172 bash[23680]: audit 2024-03-30T15:14:35.103404+0000 mon.a (mon.0) 1848 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:36.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:36 smithi172 bash[23680]: audit 2024-03-30T15:14:35.144251+0000 mon.a (mon.0) 1849 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi072-64163-31"}]: dispatch 2024-03-30T15:14:36.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:36 smithi172 bash[23680]: audit 2024-03-30T15:14:35.756595+0000 mon.c (mon.2) 306 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:14:36.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:36 smithi172 bash[23680]: audit 2024-03-30T15:14:36.091481+0000 mon.a (mon.0) 1850 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:36.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:36 smithi172 bash[23680]: audit 2024-03-30T15:14:36.091703+0000 mon.a (mon.0) 1851 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi072-64163-31"}]': finished 2024-03-30T15:14:36.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:36 smithi172 bash[23680]: cluster 2024-03-30T15:14:36.095996+0000 mon.a (mon.0) 1852 : cluster 0 osdmap e218: 8 total, 8 up, 8 in 2024-03-30T15:14:36.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:36 smithi172 bash[23680]: audit 2024-03-30T15:14:36.100543+0000 mon.c (mon.2) 307 : audit 1 from='client.? 172.21.15.72:0/508501327' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi072-64163-31"}]: dispatch 2024-03-30T15:14:36.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:36 smithi172 bash[23680]: audit 2024-03-30T15:14:36.103599+0000 mon.c (mon.2) 308 : audit 1 from='client.? 172.21.15.72:0/1324482081' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi072-64171-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:36.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:36 smithi172 bash[23680]: audit 2024-03-30T15:14:36.103620+0000 mon.a (mon.0) 1853 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi072-64163-31"}]: dispatch 2024-03-30T15:14:36.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:36 smithi172 bash[23680]: audit 2024-03-30T15:14:36.113279+0000 mon.c (mon.2) 309 : audit 1 from='client.? 172.21.15.72:0/4141912362' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64203-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:36.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:36 smithi172 bash[23680]: audit 2024-03-30T15:14:36.121135+0000 mon.a (mon.0) 1854 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi072-64171-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:36.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:36 smithi172 bash[23680]: audit 2024-03-30T15:14:36.123766+0000 mon.a (mon.0) 1855 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64203-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:37.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:37 smithi072 bash[21573]: cluster 2024-03-30T15:14:35.956446+0000 mgr.y (mgr.14526) 289 : cluster 0 pgmap v330: 292 pgs: 32 creating+peering, 260 active+clean; 584 KiB data, 571 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-03-30T15:14:37.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:37 smithi072 bash[21573]: audit 2024-03-30T15:14:37.095803+0000 mon.a (mon.0) 1856 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi072-64163-31"}]': finished 2024-03-30T15:14:37.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:37 smithi072 bash[21573]: audit 2024-03-30T15:14:37.095948+0000 mon.a (mon.0) 1857 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi072-64171-38","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:37.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:37 smithi072 bash[21573]: audit 2024-03-30T15:14:37.096138+0000 mon.a (mon.0) 1858 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64203-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:37.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:37 smithi072 bash[21573]: cluster 2024-03-30T15:14:37.104937+0000 mon.a (mon.0) 1859 : cluster 0 osdmap e219: 8 total, 8 up, 8 in 2024-03-30T15:14:37.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:37 smithi072 bash[28946]: cluster 2024-03-30T15:14:35.956446+0000 mgr.y (mgr.14526) 289 : cluster 0 pgmap v330: 292 pgs: 32 creating+peering, 260 active+clean; 584 KiB data, 571 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-03-30T15:14:37.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:37 smithi072 bash[28946]: audit 2024-03-30T15:14:37.095803+0000 mon.a (mon.0) 1856 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi072-64163-31"}]': finished 2024-03-30T15:14:37.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:37 smithi072 bash[28946]: audit 2024-03-30T15:14:37.095948+0000 mon.a (mon.0) 1857 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi072-64171-38","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:37.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:37 smithi072 bash[28946]: audit 2024-03-30T15:14:37.096138+0000 mon.a (mon.0) 1858 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64203-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:37.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:37 smithi072 bash[28946]: cluster 2024-03-30T15:14:37.104937+0000 mon.a (mon.0) 1859 : cluster 0 osdmap e219: 8 total, 8 up, 8 in 2024-03-30T15:14:37.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:37 smithi172 bash[23680]: cluster 2024-03-30T15:14:35.956446+0000 mgr.y (mgr.14526) 289 : cluster 0 pgmap v330: 292 pgs: 32 creating+peering, 260 active+clean; 584 KiB data, 571 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-03-30T15:14:37.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:37 smithi172 bash[23680]: audit 2024-03-30T15:14:37.095803+0000 mon.a (mon.0) 1856 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi072-64163-31"}]': finished 2024-03-30T15:14:37.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:37 smithi172 bash[23680]: audit 2024-03-30T15:14:37.095948+0000 mon.a (mon.0) 1857 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi072-64171-38","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:37.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:37 smithi172 bash[23680]: audit 2024-03-30T15:14:37.096138+0000 mon.a (mon.0) 1858 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64203-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:37.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:37 smithi172 bash[23680]: cluster 2024-03-30T15:14:37.104937+0000 mon.a (mon.0) 1859 : cluster 0 osdmap e219: 8 total, 8 up, 8 in 2024-03-30T15:14:38.116 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsStart 2024-03-30T15:14:38.116 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: 1 0 2024-03-30T15:14:38.116 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: 10 0 2024-03-30T15:14:38.116 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: 13 0 2024-03-30T15:14:38.116 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: 7 0 2024-03-30T15:14:38.116 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: 14 0 2024-03-30T15:14:38.116 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: 0 0 2024-03-30T15:14:38.116 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: 15 0 2024-03-30T15:14:38.117 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: 11 0 2024-03-30T15:14:38.117 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: 5 0 2024-03-30T15:14:38.117 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: 8 0 2024-03-30T15:14:38.117 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: 6 0 2024-03-30T15:14:38.117 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: 3 0 2024-03-30T15:14:38.117 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: 4 0 2024-03-30T15:14:38.117 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: 12 0 2024-03-30T15:14:38.117 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: 9 0 2024-03-30T15:14:38.117 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: 2 0 2024-03-30T15:14:38.117 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-03-30T15:14:38.117 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsStart (98 ms) 2024-03-30T15:14:38.117 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: [----------] 3 tests from LibRadosListEC (1226 ms total) 2024-03-30T15:14:38.117 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: 2024-03-30T15:14:38.117 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: [----------] 1 test from LibRadosListNP 2024-03-30T15:14:38.118 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: [ RUN ] LibRadosListNP.ListObjectsError 2024-03-30T15:14:38.118 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: [ OK ] LibRadosListNP.ListObjectsError (3011 ms) 2024-03-30T15:14:38.118 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: [----------] 1 test from LibRadosListNP (3011 ms total) 2024-03-30T15:14:38.118 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: 2024-03-30T15:14:38.118 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: [----------] Global test environment tear-down 2024-03-30T15:14:38.118 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: [==========] 11 tests from 3 test suites ran. (166138 ms total) 2024-03-30T15:14:38.118 INFO:tasks.workunit.client.0.smithi072.stdout: api_list: [ PASSED ] 11 tests. 2024-03-30T15:14:38.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:38 smithi072 bash[21573]: audit 2024-03-30T15:14:37.152479+0000 mon.a (mon.0) 1860 : audit 1 from='client.? 172.21.15.72:0/2197498624' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi072-64163-32"}]: dispatch 2024-03-30T15:14:38.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:38 smithi072 bash[21573]: audit 2024-03-30T15:14:37.153815+0000 mon.a (mon.0) 1861 : audit 1 from='client.? 172.21.15.72:0/2197498624' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi072-64163-32"}]: dispatch 2024-03-30T15:14:38.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:38 smithi072 bash[21573]: audit 2024-03-30T15:14:37.154361+0000 mon.a (mon.0) 1862 : audit 1 from='client.? 172.21.15.72:0/2197498624' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi072-64163-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:38.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:38 smithi072 bash[21573]: audit 2024-03-30T15:14:37.165489+0000 mon.c (mon.2) 310 : audit 1 from='client.? 172.21.15.72:0/4141912362' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi072-64203-3","pool2":"test-rados-api-smithi072-64203-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-03-30T15:14:38.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:38 smithi072 bash[21573]: audit 2024-03-30T15:14:37.166604+0000 mon.a (mon.0) 1863 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi072-64203-3","pool2":"test-rados-api-smithi072-64203-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-03-30T15:14:38.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:38 smithi072 bash[21573]: audit 2024-03-30T15:14:37.177661+0000 mon.a (mon.0) 1864 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:14:38.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:38 smithi072 bash[21573]: audit 2024-03-30T15:14:38.100404+0000 mon.a (mon.0) 1865 : audit 1 from='client.? 172.21.15.72:0/2197498624' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi072-64163-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:14:38.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:38 smithi072 bash[21573]: audit 2024-03-30T15:14:38.100624+0000 mon.a (mon.0) 1866 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi072-64203-3","pool2":"test-rados-api-smithi072-64203-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2024-03-30T15:14:38.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:38 smithi072 bash[21573]: audit 2024-03-30T15:14:38.100820+0000 mon.a (mon.0) 1867 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-23", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:14:38.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:38 smithi072 bash[21573]: cluster 2024-03-30T15:14:38.109791+0000 mon.a (mon.0) 1868 : cluster 0 osdmap e220: 8 total, 8 up, 8 in 2024-03-30T15:14:38.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:38 smithi072 bash[21573]: audit 2024-03-30T15:14:38.117464+0000 mon.a (mon.0) 1869 : audit 1 from='client.? 172.21.15.72:0/2197498624' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi072-64163-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi072-64163-32"}]: dispatch 2024-03-30T15:14:38.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:38 smithi072 bash[21573]: audit 2024-03-30T15:14:38.118281+0000 mon.a (mon.0) 1870 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-23"}]: dispatch 2024-03-30T15:14:38.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:38 smithi072 bash[28946]: audit 2024-03-30T15:14:37.152479+0000 mon.a (mon.0) 1860 : audit 1 from='client.? 172.21.15.72:0/2197498624' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi072-64163-32"}]: dispatch 2024-03-30T15:14:38.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:38 smithi072 bash[28946]: audit 2024-03-30T15:14:37.153815+0000 mon.a (mon.0) 1861 : audit 1 from='client.? 172.21.15.72:0/2197498624' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi072-64163-32"}]: dispatch 2024-03-30T15:14:38.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:38 smithi072 bash[28946]: audit 2024-03-30T15:14:37.154361+0000 mon.a (mon.0) 1862 : audit 1 from='client.? 172.21.15.72:0/2197498624' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi072-64163-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:38.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:38 smithi072 bash[28946]: audit 2024-03-30T15:14:37.165489+0000 mon.c (mon.2) 310 : audit 1 from='client.? 172.21.15.72:0/4141912362' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi072-64203-3","pool2":"test-rados-api-smithi072-64203-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-03-30T15:14:38.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:38 smithi072 bash[28946]: audit 2024-03-30T15:14:37.166604+0000 mon.a (mon.0) 1863 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi072-64203-3","pool2":"test-rados-api-smithi072-64203-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-03-30T15:14:38.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:38 smithi072 bash[28946]: audit 2024-03-30T15:14:37.177661+0000 mon.a (mon.0) 1864 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:14:38.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:38 smithi072 bash[28946]: audit 2024-03-30T15:14:38.100404+0000 mon.a (mon.0) 1865 : audit 1 from='client.? 172.21.15.72:0/2197498624' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi072-64163-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:14:38.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:38 smithi072 bash[28946]: audit 2024-03-30T15:14:38.100624+0000 mon.a (mon.0) 1866 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi072-64203-3","pool2":"test-rados-api-smithi072-64203-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2024-03-30T15:14:38.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:38 smithi072 bash[28946]: audit 2024-03-30T15:14:38.100820+0000 mon.a (mon.0) 1867 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-23", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:14:38.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:38 smithi072 bash[28946]: cluster 2024-03-30T15:14:38.109791+0000 mon.a (mon.0) 1868 : cluster 0 osdmap e220: 8 total, 8 up, 8 in 2024-03-30T15:14:38.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:38 smithi072 bash[28946]: audit 2024-03-30T15:14:38.117464+0000 mon.a (mon.0) 1869 : audit 1 from='client.? 172.21.15.72:0/2197498624' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi072-64163-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi072-64163-32"}]: dispatch 2024-03-30T15:14:38.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:38 smithi072 bash[28946]: audit 2024-03-30T15:14:38.118281+0000 mon.a (mon.0) 1870 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-23"}]: dispatch 2024-03-30T15:14:38.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:38 smithi172 bash[23680]: audit 2024-03-30T15:14:37.152479+0000 mon.a (mon.0) 1860 : audit 1 from='client.? 172.21.15.72:0/2197498624' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi072-64163-32"}]: dispatch 2024-03-30T15:14:38.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:38 smithi172 bash[23680]: audit 2024-03-30T15:14:37.153815+0000 mon.a (mon.0) 1861 : audit 1 from='client.? 172.21.15.72:0/2197498624' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi072-64163-32"}]: dispatch 2024-03-30T15:14:38.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:38 smithi172 bash[23680]: audit 2024-03-30T15:14:37.154361+0000 mon.a (mon.0) 1862 : audit 1 from='client.? 172.21.15.72:0/2197498624' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi072-64163-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:38.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:38 smithi172 bash[23680]: audit 2024-03-30T15:14:37.165489+0000 mon.c (mon.2) 310 : audit 1 from='client.? 172.21.15.72:0/4141912362' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi072-64203-3","pool2":"test-rados-api-smithi072-64203-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-03-30T15:14:38.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:38 smithi172 bash[23680]: audit 2024-03-30T15:14:37.166604+0000 mon.a (mon.0) 1863 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi072-64203-3","pool2":"test-rados-api-smithi072-64203-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-03-30T15:14:38.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:38 smithi172 bash[23680]: audit 2024-03-30T15:14:37.177661+0000 mon.a (mon.0) 1864 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:14:38.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:38 smithi172 bash[23680]: audit 2024-03-30T15:14:38.100404+0000 mon.a (mon.0) 1865 : audit 1 from='client.? 172.21.15.72:0/2197498624' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi072-64163-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:14:38.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:38 smithi172 bash[23680]: audit 2024-03-30T15:14:38.100624+0000 mon.a (mon.0) 1866 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi072-64203-3","pool2":"test-rados-api-smithi072-64203-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2024-03-30T15:14:38.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:38 smithi172 bash[23680]: audit 2024-03-30T15:14:38.100820+0000 mon.a (mon.0) 1867 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-23", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:14:38.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:38 smithi172 bash[23680]: cluster 2024-03-30T15:14:38.109791+0000 mon.a (mon.0) 1868 : cluster 0 osdmap e220: 8 total, 8 up, 8 in 2024-03-30T15:14:38.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:38 smithi172 bash[23680]: audit 2024-03-30T15:14:38.117464+0000 mon.a (mon.0) 1869 : audit 1 from='client.? 172.21.15.72:0/2197498624' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi072-64163-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi072-64163-32"}]: dispatch 2024-03-30T15:14:38.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:38 smithi172 bash[23680]: audit 2024-03-30T15:14:38.118281+0000 mon.a (mon.0) 1870 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-23"}]: dispatch 2024-03-30T15:14:39.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:39 smithi072 bash[21573]: cluster 2024-03-30T15:14:37.957400+0000 mgr.y (mgr.14526) 290 : cluster 0 pgmap v333: 356 pgs: 64 unknown, 32 creating+peering, 260 active+clean; 584 KiB data, 571 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-03-30T15:14:39.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:39 smithi072 bash[21573]: cluster 2024-03-30T15:14:38.155470+0000 mon.a (mon.0) 1871 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:14:39.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:39 smithi072 bash[21573]: audit 2024-03-30T15:14:39.104053+0000 mon.a (mon.0) 1872 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-23"}]': finished 2024-03-30T15:14:39.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:39 smithi072 bash[28946]: cluster 2024-03-30T15:14:37.957400+0000 mgr.y (mgr.14526) 290 : cluster 0 pgmap v333: 356 pgs: 64 unknown, 32 creating+peering, 260 active+clean; 584 KiB data, 571 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-03-30T15:14:39.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:39 smithi072 bash[28946]: cluster 2024-03-30T15:14:38.155470+0000 mon.a (mon.0) 1871 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:14:39.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:39 smithi072 bash[28946]: audit 2024-03-30T15:14:39.104053+0000 mon.a (mon.0) 1872 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-23"}]': finished 2024-03-30T15:14:39.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:39 smithi172 bash[23680]: cluster 2024-03-30T15:14:37.957400+0000 mgr.y (mgr.14526) 290 : cluster 0 pgmap v333: 356 pgs: 64 unknown, 32 creating+peering, 260 active+clean; 584 KiB data, 571 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-03-30T15:14:39.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:39 smithi172 bash[23680]: cluster 2024-03-30T15:14:38.155470+0000 mon.a (mon.0) 1871 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:14:39.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:39 smithi172 bash[23680]: audit 2024-03-30T15:14:39.104053+0000 mon.a (mon.0) 1872 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-23"}]': finished 2024-03-30T15:14:40.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:40 smithi072 bash[21573]: cluster 2024-03-30T15:14:39.567539+0000 mon.a (mon.0) 1873 : cluster 0 osdmap e221: 8 total, 8 up, 8 in 2024-03-30T15:14:40.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:40 smithi072 bash[21573]: audit 2024-03-30T15:14:39.569677+0000 mon.a (mon.0) 1874 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-23", "mode": "writeback"}]: dispatch 2024-03-30T15:14:40.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:40 smithi072 bash[21573]: cluster 2024-03-30T15:14:40.104798+0000 mon.a (mon.0) 1875 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:14:40.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:40 smithi072 bash[21573]: audit 2024-03-30T15:14:40.107630+0000 mon.a (mon.0) 1876 : audit 1 from='client.? 172.21.15.72:0/2197498624' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsComplete_smithi072-64163-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi072-64163-32"}]': finished 2024-03-30T15:14:40.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:40 smithi072 bash[21573]: audit 2024-03-30T15:14:40.107820+0000 mon.a (mon.0) 1877 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-23", "mode": "writeback"}]': finished 2024-03-30T15:14:40.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:40 smithi072 bash[21573]: cluster 2024-03-30T15:14:40.117960+0000 mon.a (mon.0) 1878 : cluster 0 osdmap e222: 8 total, 8 up, 8 in 2024-03-30T15:14:40.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:40 smithi072 bash[28946]: cluster 2024-03-30T15:14:39.567539+0000 mon.a (mon.0) 1873 : cluster 0 osdmap e221: 8 total, 8 up, 8 in 2024-03-30T15:14:40.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:40 smithi072 bash[28946]: audit 2024-03-30T15:14:39.569677+0000 mon.a (mon.0) 1874 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-23", "mode": "writeback"}]: dispatch 2024-03-30T15:14:40.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:40 smithi072 bash[28946]: cluster 2024-03-30T15:14:40.104798+0000 mon.a (mon.0) 1875 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:14:40.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:40 smithi072 bash[28946]: audit 2024-03-30T15:14:40.107630+0000 mon.a (mon.0) 1876 : audit 1 from='client.? 172.21.15.72:0/2197498624' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsComplete_smithi072-64163-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi072-64163-32"}]': finished 2024-03-30T15:14:40.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:40 smithi072 bash[28946]: audit 2024-03-30T15:14:40.107820+0000 mon.a (mon.0) 1877 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-23", "mode": "writeback"}]': finished 2024-03-30T15:14:40.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:40 smithi072 bash[28946]: cluster 2024-03-30T15:14:40.117960+0000 mon.a (mon.0) 1878 : cluster 0 osdmap e222: 8 total, 8 up, 8 in 2024-03-30T15:14:40.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:40 smithi172 bash[23680]: cluster 2024-03-30T15:14:39.567539+0000 mon.a (mon.0) 1873 : cluster 0 osdmap e221: 8 total, 8 up, 8 in 2024-03-30T15:14:40.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:40 smithi172 bash[23680]: audit 2024-03-30T15:14:39.569677+0000 mon.a (mon.0) 1874 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-23", "mode": "writeback"}]: dispatch 2024-03-30T15:14:40.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:40 smithi172 bash[23680]: cluster 2024-03-30T15:14:40.104798+0000 mon.a (mon.0) 1875 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:14:40.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:40 smithi172 bash[23680]: audit 2024-03-30T15:14:40.107630+0000 mon.a (mon.0) 1876 : audit 1 from='client.? 172.21.15.72:0/2197498624' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsComplete_smithi072-64163-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi072-64163-32"}]': finished 2024-03-30T15:14:40.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:40 smithi172 bash[23680]: audit 2024-03-30T15:14:40.107820+0000 mon.a (mon.0) 1877 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-23", "mode": "writeback"}]': finished 2024-03-30T15:14:40.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:40 smithi172 bash[23680]: cluster 2024-03-30T15:14:40.117960+0000 mon.a (mon.0) 1878 : cluster 0 osdmap e222: 8 total, 8 up, 8 in 2024-03-30T15:14:41.417 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:14:41 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:14:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:14:41.464 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:14:41 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:14:41.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:41 smithi072 bash[21573]: cluster 2024-03-30T15:14:39.958243+0000 mgr.y (mgr.14526) 291 : cluster 0 pgmap v336: 260 pgs: 32 creating+peering, 228 active+clean; 584 KiB data, 571 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:14:41.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:41 smithi072 bash[21573]: cluster 2024-03-30T15:14:41.120041+0000 mon.a (mon.0) 1879 : cluster 0 osdmap e223: 8 total, 8 up, 8 in 2024-03-30T15:14:41.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:41 smithi072 bash[21573]: audit 2024-03-30T15:14:41.140307+0000 mon.c (mon.2) 311 : audit 1 from='client.? 172.21.15.72:0/3643135681' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi072-64171-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:41.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:41 smithi072 bash[21573]: audit 2024-03-30T15:14:41.141560+0000 mon.a (mon.0) 1880 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi072-64171-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:41.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:41 smithi072 bash[21573]: audit 2024-03-30T15:14:41.193936+0000 mon.a (mon.0) 1881 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:14:41.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:41 smithi072 bash[28946]: cluster 2024-03-30T15:14:39.958243+0000 mgr.y (mgr.14526) 291 : cluster 0 pgmap v336: 260 pgs: 32 creating+peering, 228 active+clean; 584 KiB data, 571 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:14:41.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:41 smithi072 bash[28946]: cluster 2024-03-30T15:14:41.120041+0000 mon.a (mon.0) 1879 : cluster 0 osdmap e223: 8 total, 8 up, 8 in 2024-03-30T15:14:41.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:41 smithi072 bash[28946]: audit 2024-03-30T15:14:41.140307+0000 mon.c (mon.2) 311 : audit 1 from='client.? 172.21.15.72:0/3643135681' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi072-64171-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:41.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:41 smithi072 bash[28946]: audit 2024-03-30T15:14:41.141560+0000 mon.a (mon.0) 1880 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi072-64171-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:41.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:41 smithi072 bash[28946]: audit 2024-03-30T15:14:41.193936+0000 mon.a (mon.0) 1881 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:14:41.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:41 smithi172 bash[23680]: cluster 2024-03-30T15:14:39.958243+0000 mgr.y (mgr.14526) 291 : cluster 0 pgmap v336: 260 pgs: 32 creating+peering, 228 active+clean; 584 KiB data, 571 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:14:41.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:41 smithi172 bash[23680]: cluster 2024-03-30T15:14:41.120041+0000 mon.a (mon.0) 1879 : cluster 0 osdmap e223: 8 total, 8 up, 8 in 2024-03-30T15:14:41.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:41 smithi172 bash[23680]: audit 2024-03-30T15:14:41.140307+0000 mon.c (mon.2) 311 : audit 1 from='client.? 172.21.15.72:0/3643135681' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi072-64171-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:41.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:41 smithi172 bash[23680]: audit 2024-03-30T15:14:41.141560+0000 mon.a (mon.0) 1880 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi072-64171-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:41.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:41 smithi172 bash[23680]: audit 2024-03-30T15:14:41.193936+0000 mon.a (mon.0) 1881 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:14:42.646 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:42 smithi072 bash[21573]: audit 2024-03-30T15:14:41.099947+0000 mgr.y (mgr.14526) 292 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:14:42.646 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:42 smithi072 bash[21573]: audit 2024-03-30T15:14:42.116714+0000 mon.a (mon.0) 1882 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi072-64171-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:42.646 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:42 smithi072 bash[21573]: audit 2024-03-30T15:14:42.116944+0000 mon.a (mon.0) 1883 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:14:42.646 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:42 smithi072 bash[21573]: cluster 2024-03-30T15:14:42.124359+0000 mon.a (mon.0) 1884 : cluster 0 osdmap e224: 8 total, 8 up, 8 in 2024-03-30T15:14:42.646 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:42 smithi072 bash[21573]: audit 2024-03-30T15:14:42.126068+0000 mon.a (mon.0) 1885 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-23"}]: dispatch 2024-03-30T15:14:42.646 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:42 smithi072 bash[21573]: audit 2024-03-30T15:14:42.128331+0000 mon.a (mon.0) 1886 : audit 1 from='client.? 172.21.15.72:0/2197498624' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi072-64163-32"}]: dispatch 2024-03-30T15:14:42.647 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:42 smithi072 bash[28946]: audit 2024-03-30T15:14:41.099947+0000 mgr.y (mgr.14526) 292 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:14:42.647 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:42 smithi072 bash[28946]: audit 2024-03-30T15:14:42.116714+0000 mon.a (mon.0) 1882 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi072-64171-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:42.647 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:42 smithi072 bash[28946]: audit 2024-03-30T15:14:42.116944+0000 mon.a (mon.0) 1883 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:14:42.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:42 smithi072 bash[28946]: cluster 2024-03-30T15:14:42.124359+0000 mon.a (mon.0) 1884 : cluster 0 osdmap e224: 8 total, 8 up, 8 in 2024-03-30T15:14:42.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:42 smithi072 bash[28946]: audit 2024-03-30T15:14:42.126068+0000 mon.a (mon.0) 1885 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-23"}]: dispatch 2024-03-30T15:14:42.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:42 smithi072 bash[28946]: audit 2024-03-30T15:14:42.128331+0000 mon.a (mon.0) 1886 : audit 1 from='client.? 172.21.15.72:0/2197498624' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi072-64163-32"}]: dispatch 2024-03-30T15:14:42.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:42 smithi172 bash[23680]: audit 2024-03-30T15:14:41.099947+0000 mgr.y (mgr.14526) 292 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:14:42.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:42 smithi172 bash[23680]: audit 2024-03-30T15:14:42.116714+0000 mon.a (mon.0) 1882 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi072-64171-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:42.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:42 smithi172 bash[23680]: audit 2024-03-30T15:14:42.116944+0000 mon.a (mon.0) 1883 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:14:42.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:42 smithi172 bash[23680]: cluster 2024-03-30T15:14:42.124359+0000 mon.a (mon.0) 1884 : cluster 0 osdmap e224: 8 total, 8 up, 8 in 2024-03-30T15:14:42.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:42 smithi172 bash[23680]: audit 2024-03-30T15:14:42.126068+0000 mon.a (mon.0) 1885 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-23"}]: dispatch 2024-03-30T15:14:42.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:42 smithi172 bash[23680]: audit 2024-03-30T15:14:42.128331+0000 mon.a (mon.0) 1886 : audit 1 from='client.? 172.21.15.72:0/2197498624' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi072-64163-32"}]: dispatch 2024-03-30T15:14:43.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:43 smithi072 bash[28946]: cluster 2024-03-30T15:14:41.959151+0000 mgr.y (mgr.14526) 293 : cluster 0 pgmap v339: 268 pgs: 32 unknown, 8 creating+peering, 228 active+clean; 584 KiB data, 572 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-30T15:14:43.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:43 smithi072 bash[28946]: cluster 2024-03-30T15:14:43.117927+0000 mon.a (mon.0) 1887 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:14:43.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:43 smithi072 bash[28946]: audit 2024-03-30T15:14:43.120452+0000 mon.a (mon.0) 1888 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-23"}]': finished 2024-03-30T15:14:43.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:43 smithi072 bash[28946]: audit 2024-03-30T15:14:43.120728+0000 mon.a (mon.0) 1889 : audit 1 from='client.? 172.21.15.72:0/2197498624' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi072-64163-32"}]': finished 2024-03-30T15:14:43.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:43 smithi072 bash[28946]: cluster 2024-03-30T15:14:43.129115+0000 mon.a (mon.0) 1890 : cluster 0 osdmap e225: 8 total, 8 up, 8 in 2024-03-30T15:14:43.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:43 smithi072 bash[28946]: audit 2024-03-30T15:14:43.140504+0000 mon.a (mon.0) 1891 : audit 1 from='client.? 172.21.15.72:0/2197498624' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi072-64163-32"}]: dispatch 2024-03-30T15:14:43.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:43 smithi072 bash[28946]: audit 2024-03-30T15:14:43.143704+0000 mon.a (mon.0) 1892 : audit 1 from='client.? 172.21.15.72:0/236664571' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi072-64171-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:43.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:43 smithi072 bash[21573]: cluster 2024-03-30T15:14:41.959151+0000 mgr.y (mgr.14526) 293 : cluster 0 pgmap v339: 268 pgs: 32 unknown, 8 creating+peering, 228 active+clean; 584 KiB data, 572 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-30T15:14:43.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:43 smithi072 bash[21573]: cluster 2024-03-30T15:14:43.117927+0000 mon.a (mon.0) 1887 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:14:43.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:43 smithi072 bash[21573]: audit 2024-03-30T15:14:43.120452+0000 mon.a (mon.0) 1888 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-23"}]': finished 2024-03-30T15:14:43.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:43 smithi072 bash[21573]: audit 2024-03-30T15:14:43.120728+0000 mon.a (mon.0) 1889 : audit 1 from='client.? 172.21.15.72:0/2197498624' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi072-64163-32"}]': finished 2024-03-30T15:14:43.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:43 smithi072 bash[21573]: cluster 2024-03-30T15:14:43.129115+0000 mon.a (mon.0) 1890 : cluster 0 osdmap e225: 8 total, 8 up, 8 in 2024-03-30T15:14:43.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:43 smithi072 bash[21573]: audit 2024-03-30T15:14:43.140504+0000 mon.a (mon.0) 1891 : audit 1 from='client.? 172.21.15.72:0/2197498624' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi072-64163-32"}]: dispatch 2024-03-30T15:14:43.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:43 smithi072 bash[21573]: audit 2024-03-30T15:14:43.143704+0000 mon.a (mon.0) 1892 : audit 1 from='client.? 172.21.15.72:0/236664571' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi072-64171-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:43.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:43 smithi172 bash[23680]: cluster 2024-03-30T15:14:41.959151+0000 mgr.y (mgr.14526) 293 : cluster 0 pgmap v339: 268 pgs: 32 unknown, 8 creating+peering, 228 active+clean; 584 KiB data, 572 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-30T15:14:43.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:43 smithi172 bash[23680]: cluster 2024-03-30T15:14:43.117927+0000 mon.a (mon.0) 1887 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:14:43.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:43 smithi172 bash[23680]: audit 2024-03-30T15:14:43.120452+0000 mon.a (mon.0) 1888 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-23"}]': finished 2024-03-30T15:14:43.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:43 smithi172 bash[23680]: audit 2024-03-30T15:14:43.120728+0000 mon.a (mon.0) 1889 : audit 1 from='client.? 172.21.15.72:0/2197498624' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi072-64163-32"}]': finished 2024-03-30T15:14:43.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:43 smithi172 bash[23680]: cluster 2024-03-30T15:14:43.129115+0000 mon.a (mon.0) 1890 : cluster 0 osdmap e225: 8 total, 8 up, 8 in 2024-03-30T15:14:43.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:43 smithi172 bash[23680]: audit 2024-03-30T15:14:43.140504+0000 mon.a (mon.0) 1891 : audit 1 from='client.? 172.21.15.72:0/2197498624' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi072-64163-32"}]: dispatch 2024-03-30T15:14:43.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:43 smithi172 bash[23680]: audit 2024-03-30T15:14:43.143704+0000 mon.a (mon.0) 1892 : audit 1 from='client.? 172.21.15.72:0/236664571' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi072-64171-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:45.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:45 smithi072 bash[21573]: cluster 2024-03-30T15:14:43.960048+0000 mgr.y (mgr.14526) 294 : cluster 0 pgmap v342: 292 pgs: 64 unknown, 228 active+clean; 584 KiB data, 572 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-30T15:14:45.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:45 smithi072 bash[21573]: audit 2024-03-30T15:14:44.124406+0000 mon.a (mon.0) 1893 : audit 1 from='client.? 172.21.15.72:0/2197498624' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi072-64163-32"}]': finished 2024-03-30T15:14:45.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:45 smithi072 bash[21573]: audit 2024-03-30T15:14:44.124637+0000 mon.a (mon.0) 1894 : audit 1 from='client.? 172.21.15.72:0/236664571' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi072-64171-40","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:45.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:45 smithi072 bash[21573]: cluster 2024-03-30T15:14:44.132825+0000 mon.a (mon.0) 1895 : cluster 0 osdmap e226: 8 total, 8 up, 8 in 2024-03-30T15:14:45.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:45 smithi072 bash[21573]: audit 2024-03-30T15:14:44.614512+0000 mon.c (mon.2) 312 : audit 1 from='client.? 172.21.15.72:0/24181956' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi072-64163-33"}]: dispatch 2024-03-30T15:14:45.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:45 smithi072 bash[21573]: cluster 2024-03-30T15:14:45.004608+0000 mon.a (mon.0) 1896 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:14:45.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:45 smithi072 bash[21573]: audit 2024-03-30T15:14:45.006519+0000 mon.a (mon.0) 1897 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi072-64163-33"}]: dispatch 2024-03-30T15:14:45.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:45 smithi072 bash[21573]: audit 2024-03-30T15:14:45.007786+0000 mon.c (mon.2) 313 : audit 1 from='client.? 172.21.15.72:0/24181956' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi072-64163-33"}]: dispatch 2024-03-30T15:14:45.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:45 smithi072 bash[21573]: audit 2024-03-30T15:14:45.015338+0000 mon.a (mon.0) 1898 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi072-64163-33"}]: dispatch 2024-03-30T15:14:45.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:45 smithi072 bash[21573]: audit 2024-03-30T15:14:45.016630+0000 mon.c (mon.2) 314 : audit 1 from='client.? 172.21.15.72:0/24181956' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi072-64163-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:45.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:45 smithi072 bash[21573]: audit 2024-03-30T15:14:45.017424+0000 mon.a (mon.0) 1899 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi072-64163-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:45.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:45 smithi072 bash[28946]: cluster 2024-03-30T15:14:43.960048+0000 mgr.y (mgr.14526) 294 : cluster 0 pgmap v342: 292 pgs: 64 unknown, 228 active+clean; 584 KiB data, 572 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-30T15:14:45.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:45 smithi072 bash[28946]: audit 2024-03-30T15:14:44.124406+0000 mon.a (mon.0) 1893 : audit 1 from='client.? 172.21.15.72:0/2197498624' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi072-64163-32"}]': finished 2024-03-30T15:14:45.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:45 smithi072 bash[28946]: audit 2024-03-30T15:14:44.124637+0000 mon.a (mon.0) 1894 : audit 1 from='client.? 172.21.15.72:0/236664571' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi072-64171-40","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:45.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:45 smithi072 bash[28946]: cluster 2024-03-30T15:14:44.132825+0000 mon.a (mon.0) 1895 : cluster 0 osdmap e226: 8 total, 8 up, 8 in 2024-03-30T15:14:45.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:45 smithi072 bash[28946]: audit 2024-03-30T15:14:44.614512+0000 mon.c (mon.2) 312 : audit 1 from='client.? 172.21.15.72:0/24181956' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi072-64163-33"}]: dispatch 2024-03-30T15:14:45.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:45 smithi072 bash[28946]: cluster 2024-03-30T15:14:45.004608+0000 mon.a (mon.0) 1896 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:14:45.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:45 smithi072 bash[28946]: audit 2024-03-30T15:14:45.006519+0000 mon.a (mon.0) 1897 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi072-64163-33"}]: dispatch 2024-03-30T15:14:45.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:45 smithi072 bash[28946]: audit 2024-03-30T15:14:45.007786+0000 mon.c (mon.2) 313 : audit 1 from='client.? 172.21.15.72:0/24181956' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi072-64163-33"}]: dispatch 2024-03-30T15:14:45.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:45 smithi072 bash[28946]: audit 2024-03-30T15:14:45.015338+0000 mon.a (mon.0) 1898 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi072-64163-33"}]: dispatch 2024-03-30T15:14:45.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:45 smithi072 bash[28946]: audit 2024-03-30T15:14:45.016630+0000 mon.c (mon.2) 314 : audit 1 from='client.? 172.21.15.72:0/24181956' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi072-64163-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:45.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:45 smithi072 bash[28946]: audit 2024-03-30T15:14:45.017424+0000 mon.a (mon.0) 1899 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi072-64163-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:45.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:45 smithi172 bash[23680]: cluster 2024-03-30T15:14:43.960048+0000 mgr.y (mgr.14526) 294 : cluster 0 pgmap v342: 292 pgs: 64 unknown, 228 active+clean; 584 KiB data, 572 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-30T15:14:45.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:45 smithi172 bash[23680]: audit 2024-03-30T15:14:44.124406+0000 mon.a (mon.0) 1893 : audit 1 from='client.? 172.21.15.72:0/2197498624' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi072-64163-32"}]': finished 2024-03-30T15:14:45.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:45 smithi172 bash[23680]: audit 2024-03-30T15:14:44.124637+0000 mon.a (mon.0) 1894 : audit 1 from='client.? 172.21.15.72:0/236664571' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi072-64171-40","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:45.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:45 smithi172 bash[23680]: cluster 2024-03-30T15:14:44.132825+0000 mon.a (mon.0) 1895 : cluster 0 osdmap e226: 8 total, 8 up, 8 in 2024-03-30T15:14:45.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:45 smithi172 bash[23680]: audit 2024-03-30T15:14:44.614512+0000 mon.c (mon.2) 312 : audit 1 from='client.? 172.21.15.72:0/24181956' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi072-64163-33"}]: dispatch 2024-03-30T15:14:45.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:45 smithi172 bash[23680]: cluster 2024-03-30T15:14:45.004608+0000 mon.a (mon.0) 1896 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:14:45.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:45 smithi172 bash[23680]: audit 2024-03-30T15:14:45.006519+0000 mon.a (mon.0) 1897 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi072-64163-33"}]: dispatch 2024-03-30T15:14:45.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:45 smithi172 bash[23680]: audit 2024-03-30T15:14:45.007786+0000 mon.c (mon.2) 313 : audit 1 from='client.? 172.21.15.72:0/24181956' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi072-64163-33"}]: dispatch 2024-03-30T15:14:45.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:45 smithi172 bash[23680]: audit 2024-03-30T15:14:45.015338+0000 mon.a (mon.0) 1898 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi072-64163-33"}]: dispatch 2024-03-30T15:14:45.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:45 smithi172 bash[23680]: audit 2024-03-30T15:14:45.016630+0000 mon.c (mon.2) 314 : audit 1 from='client.? 172.21.15.72:0/24181956' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi072-64163-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:45.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:45 smithi172 bash[23680]: audit 2024-03-30T15:14:45.017424+0000 mon.a (mon.0) 1899 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi072-64163-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:46.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:46 smithi072 bash[21573]: audit 2024-03-30T15:14:45.128290+0000 mon.a (mon.0) 1900 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi072-64163-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:14:46.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:46 smithi072 bash[21573]: cluster 2024-03-30T15:14:45.135622+0000 mon.a (mon.0) 1901 : cluster 0 osdmap e227: 8 total, 8 up, 8 in 2024-03-30T15:14:46.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:46 smithi072 bash[21573]: audit 2024-03-30T15:14:45.145416+0000 mon.c (mon.2) 315 : audit 1 from='client.? 172.21.15.72:0/24181956' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi072-64163-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi072-64163-33"}]: dispatch 2024-03-30T15:14:46.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:46 smithi072 bash[21573]: audit 2024-03-30T15:14:45.145837+0000 mon.c (mon.2) 316 : audit 1 from='client.? 172.21.15.72:0/3403957975' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi072-64171-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:46.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:46 smithi072 bash[21573]: audit 2024-03-30T15:14:45.146779+0000 mon.a (mon.0) 1902 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:46.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:46 smithi072 bash[21573]: audit 2024-03-30T15:14:45.170406+0000 mon.a (mon.0) 1903 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi072-64163-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi072-64163-33"}]: dispatch 2024-03-30T15:14:46.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:46 smithi072 bash[21573]: audit 2024-03-30T15:14:45.171256+0000 mon.a (mon.0) 1904 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi072-64171-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:46.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:46 smithi072 bash[21573]: audit 2024-03-30T15:14:46.132560+0000 mon.a (mon.0) 1905 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:46.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:46 smithi072 bash[28946]: audit 2024-03-30T15:14:45.128290+0000 mon.a (mon.0) 1900 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi072-64163-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:14:46.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:46 smithi072 bash[28946]: cluster 2024-03-30T15:14:45.135622+0000 mon.a (mon.0) 1901 : cluster 0 osdmap e227: 8 total, 8 up, 8 in 2024-03-30T15:14:46.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:46 smithi072 bash[28946]: audit 2024-03-30T15:14:45.145416+0000 mon.c (mon.2) 315 : audit 1 from='client.? 172.21.15.72:0/24181956' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi072-64163-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi072-64163-33"}]: dispatch 2024-03-30T15:14:46.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:46 smithi072 bash[28946]: audit 2024-03-30T15:14:45.145837+0000 mon.c (mon.2) 316 : audit 1 from='client.? 172.21.15.72:0/3403957975' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi072-64171-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:46.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:46 smithi072 bash[28946]: audit 2024-03-30T15:14:45.146779+0000 mon.a (mon.0) 1902 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:46.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:46 smithi072 bash[28946]: audit 2024-03-30T15:14:45.170406+0000 mon.a (mon.0) 1903 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi072-64163-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi072-64163-33"}]: dispatch 2024-03-30T15:14:46.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:46 smithi072 bash[28946]: audit 2024-03-30T15:14:45.171256+0000 mon.a (mon.0) 1904 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi072-64171-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:46.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:46 smithi072 bash[28946]: audit 2024-03-30T15:14:46.132560+0000 mon.a (mon.0) 1905 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:46.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:46 smithi172 bash[23680]: audit 2024-03-30T15:14:45.128290+0000 mon.a (mon.0) 1900 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi072-64163-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:14:46.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:46 smithi172 bash[23680]: cluster 2024-03-30T15:14:45.135622+0000 mon.a (mon.0) 1901 : cluster 0 osdmap e227: 8 total, 8 up, 8 in 2024-03-30T15:14:46.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:46 smithi172 bash[23680]: audit 2024-03-30T15:14:45.145416+0000 mon.c (mon.2) 315 : audit 1 from='client.? 172.21.15.72:0/24181956' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi072-64163-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi072-64163-33"}]: dispatch 2024-03-30T15:14:46.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:46 smithi172 bash[23680]: audit 2024-03-30T15:14:45.145837+0000 mon.c (mon.2) 316 : audit 1 from='client.? 172.21.15.72:0/3403957975' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi072-64171-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:46.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:46 smithi172 bash[23680]: audit 2024-03-30T15:14:45.146779+0000 mon.a (mon.0) 1902 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:46.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:46 smithi172 bash[23680]: audit 2024-03-30T15:14:45.170406+0000 mon.a (mon.0) 1903 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi072-64163-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi072-64163-33"}]: dispatch 2024-03-30T15:14:46.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:46 smithi172 bash[23680]: audit 2024-03-30T15:14:45.171256+0000 mon.a (mon.0) 1904 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi072-64171-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:46.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:46 smithi172 bash[23680]: audit 2024-03-30T15:14:46.132560+0000 mon.a (mon.0) 1905 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:47.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:47 smithi072 bash[28946]: cluster 2024-03-30T15:14:45.962622+0000 mgr.y (mgr.14526) 295 : cluster 0 pgmap v345: 324 pgs: 64 creating+peering, 260 active+clean; 584 KiB data, 581 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:14:47.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:47 smithi072 bash[28946]: audit 2024-03-30T15:14:46.132730+0000 mon.a (mon.0) 1906 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi072-64171-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:47.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:47 smithi072 bash[28946]: cluster 2024-03-30T15:14:46.602423+0000 mon.a (mon.0) 1907 : cluster 0 osdmap e228: 8 total, 8 up, 8 in 2024-03-30T15:14:47.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:47 smithi072 bash[28946]: audit 2024-03-30T15:14:47.136896+0000 mon.a (mon.0) 1908 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafe_smithi072-64163-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi072-64163-33"}]': finished 2024-03-30T15:14:47.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:47 smithi072 bash[28946]: cluster 2024-03-30T15:14:47.149577+0000 mon.a (mon.0) 1909 : cluster 0 osdmap e229: 8 total, 8 up, 8 in 2024-03-30T15:14:47.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:47 smithi072 bash[28946]: audit 2024-03-30T15:14:47.169723+0000 mon.c (mon.2) 317 : audit 1 from='client.? 172.21.15.72:0/1795472743' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi072-64171-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:47.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:47 smithi072 bash[28946]: audit 2024-03-30T15:14:47.174222+0000 mon.a (mon.0) 1910 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi072-64171-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:47.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:47 smithi072 bash[28946]: audit 2024-03-30T15:14:47.184779+0000 mon.a (mon.0) 1911 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:14:47.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:47 smithi072 bash[21573]: cluster 2024-03-30T15:14:45.962622+0000 mgr.y (mgr.14526) 295 : cluster 0 pgmap v345: 324 pgs: 64 creating+peering, 260 active+clean; 584 KiB data, 581 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:14:47.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:47 smithi072 bash[21573]: audit 2024-03-30T15:14:46.132730+0000 mon.a (mon.0) 1906 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi072-64171-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:47.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:47 smithi072 bash[21573]: cluster 2024-03-30T15:14:46.602423+0000 mon.a (mon.0) 1907 : cluster 0 osdmap e228: 8 total, 8 up, 8 in 2024-03-30T15:14:47.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:47 smithi072 bash[21573]: audit 2024-03-30T15:14:47.136896+0000 mon.a (mon.0) 1908 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafe_smithi072-64163-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi072-64163-33"}]': finished 2024-03-30T15:14:47.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:47 smithi072 bash[21573]: cluster 2024-03-30T15:14:47.149577+0000 mon.a (mon.0) 1909 : cluster 0 osdmap e229: 8 total, 8 up, 8 in 2024-03-30T15:14:47.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:47 smithi072 bash[21573]: audit 2024-03-30T15:14:47.169723+0000 mon.c (mon.2) 317 : audit 1 from='client.? 172.21.15.72:0/1795472743' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi072-64171-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:47.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:47 smithi072 bash[21573]: audit 2024-03-30T15:14:47.174222+0000 mon.a (mon.0) 1910 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi072-64171-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:47.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:47 smithi072 bash[21573]: audit 2024-03-30T15:14:47.184779+0000 mon.a (mon.0) 1911 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:14:47.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:47 smithi172 bash[23680]: cluster 2024-03-30T15:14:45.962622+0000 mgr.y (mgr.14526) 295 : cluster 0 pgmap v345: 324 pgs: 64 creating+peering, 260 active+clean; 584 KiB data, 581 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:14:47.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:47 smithi172 bash[23680]: audit 2024-03-30T15:14:46.132730+0000 mon.a (mon.0) 1906 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi072-64171-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:47.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:47 smithi172 bash[23680]: cluster 2024-03-30T15:14:46.602423+0000 mon.a (mon.0) 1907 : cluster 0 osdmap e228: 8 total, 8 up, 8 in 2024-03-30T15:14:47.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:47 smithi172 bash[23680]: audit 2024-03-30T15:14:47.136896+0000 mon.a (mon.0) 1908 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafe_smithi072-64163-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi072-64163-33"}]': finished 2024-03-30T15:14:47.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:47 smithi172 bash[23680]: cluster 2024-03-30T15:14:47.149577+0000 mon.a (mon.0) 1909 : cluster 0 osdmap e229: 8 total, 8 up, 8 in 2024-03-30T15:14:47.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:47 smithi172 bash[23680]: audit 2024-03-30T15:14:47.169723+0000 mon.c (mon.2) 317 : audit 1 from='client.? 172.21.15.72:0/1795472743' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi072-64171-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:47.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:47 smithi172 bash[23680]: audit 2024-03-30T15:14:47.174222+0000 mon.a (mon.0) 1910 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi072-64171-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:47.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:47 smithi172 bash[23680]: audit 2024-03-30T15:14:47.184779+0000 mon.a (mon.0) 1911 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:14:49.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:49 smithi072 bash[21573]: cluster 2024-03-30T15:14:47.963254+0000 mgr.y (mgr.14526) 296 : cluster 0 pgmap v348: 364 pgs: 40 unknown, 64 creating+peering, 260 active+clean; 584 KiB data, 581 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:14:49.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:49 smithi072 bash[21573]: audit 2024-03-30T15:14:48.139699+0000 mon.a (mon.0) 1912 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi072-64171-42","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:49.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:49 smithi072 bash[21573]: audit 2024-03-30T15:14:48.139953+0000 mon.a (mon.0) 1913 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-25", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:14:49.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:49 smithi072 bash[21573]: cluster 2024-03-30T15:14:48.149723+0000 mon.a (mon.0) 1914 : cluster 0 osdmap e230: 8 total, 8 up, 8 in 2024-03-30T15:14:49.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:49 smithi072 bash[21573]: audit 2024-03-30T15:14:48.165775+0000 mon.a (mon.0) 1915 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-25"}]: dispatch 2024-03-30T15:14:49.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:49 smithi072 bash[28946]: cluster 2024-03-30T15:14:47.963254+0000 mgr.y (mgr.14526) 296 : cluster 0 pgmap v348: 364 pgs: 40 unknown, 64 creating+peering, 260 active+clean; 584 KiB data, 581 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:14:49.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:49 smithi072 bash[28946]: audit 2024-03-30T15:14:48.139699+0000 mon.a (mon.0) 1912 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi072-64171-42","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:49.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:49 smithi072 bash[28946]: audit 2024-03-30T15:14:48.139953+0000 mon.a (mon.0) 1913 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-25", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:14:49.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:49 smithi072 bash[28946]: cluster 2024-03-30T15:14:48.149723+0000 mon.a (mon.0) 1914 : cluster 0 osdmap e230: 8 total, 8 up, 8 in 2024-03-30T15:14:49.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:49 smithi072 bash[28946]: audit 2024-03-30T15:14:48.165775+0000 mon.a (mon.0) 1915 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-25"}]: dispatch 2024-03-30T15:14:49.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:49 smithi172 bash[23680]: cluster 2024-03-30T15:14:47.963254+0000 mgr.y (mgr.14526) 296 : cluster 0 pgmap v348: 364 pgs: 40 unknown, 64 creating+peering, 260 active+clean; 584 KiB data, 581 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:14:49.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:49 smithi172 bash[23680]: audit 2024-03-30T15:14:48.139699+0000 mon.a (mon.0) 1912 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi072-64171-42","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:49.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:49 smithi172 bash[23680]: audit 2024-03-30T15:14:48.139953+0000 mon.a (mon.0) 1913 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-25", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:14:49.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:49 smithi172 bash[23680]: cluster 2024-03-30T15:14:48.149723+0000 mon.a (mon.0) 1914 : cluster 0 osdmap e230: 8 total, 8 up, 8 in 2024-03-30T15:14:49.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:49 smithi172 bash[23680]: audit 2024-03-30T15:14:48.165775+0000 mon.a (mon.0) 1915 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-25"}]: dispatch 2024-03-30T15:14:50.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:50 smithi072 bash[21573]: audit 2024-03-30T15:14:49.145447+0000 mon.a (mon.0) 1916 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-25"}]': finished 2024-03-30T15:14:50.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:50 smithi072 bash[21573]: cluster 2024-03-30T15:14:49.152282+0000 mon.a (mon.0) 1917 : cluster 0 osdmap e231: 8 total, 8 up, 8 in 2024-03-30T15:14:50.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:50 smithi072 bash[21573]: audit 2024-03-30T15:14:49.159179+0000 mon.a (mon.0) 1918 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-25", "mode": "writeback"}]: dispatch 2024-03-30T15:14:50.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:50 smithi072 bash[21573]: audit 2024-03-30T15:14:49.161647+0000 mon.c (mon.2) 318 : audit 1 from='client.? 172.21.15.72:0/24181956' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi072-64163-33"}]: dispatch 2024-03-30T15:14:50.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:50 smithi072 bash[21573]: audit 2024-03-30T15:14:49.163980+0000 mon.c (mon.2) 319 : audit 1 from='client.? 172.21.15.72:0/482468533' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi072-64171-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:50.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:50 smithi072 bash[21573]: audit 2024-03-30T15:14:49.180605+0000 mon.a (mon.0) 1919 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi072-64163-33"}]: dispatch 2024-03-30T15:14:50.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:50 smithi072 bash[21573]: audit 2024-03-30T15:14:49.181396+0000 mon.a (mon.0) 1920 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi072-64171-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:50.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:50 smithi072 bash[21573]: cluster 2024-03-30T15:14:50.146152+0000 mon.a (mon.0) 1921 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:14:50.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:50 smithi072 bash[21573]: audit 2024-03-30T15:14:50.148833+0000 mon.a (mon.0) 1922 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-25", "mode": "writeback"}]': finished 2024-03-30T15:14:50.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:50 smithi072 bash[21573]: audit 2024-03-30T15:14:50.148997+0000 mon.a (mon.0) 1923 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi072-64163-33"}]': finished 2024-03-30T15:14:50.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:50 smithi072 bash[21573]: audit 2024-03-30T15:14:50.149243+0000 mon.a (mon.0) 1924 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi072-64171-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:50.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:50 smithi072 bash[21573]: cluster 2024-03-30T15:14:50.158895+0000 mon.a (mon.0) 1925 : cluster 0 osdmap e232: 8 total, 8 up, 8 in 2024-03-30T15:14:50.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:50 smithi072 bash[28946]: audit 2024-03-30T15:14:49.145447+0000 mon.a (mon.0) 1916 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-25"}]': finished 2024-03-30T15:14:50.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:50 smithi072 bash[28946]: cluster 2024-03-30T15:14:49.152282+0000 mon.a (mon.0) 1917 : cluster 0 osdmap e231: 8 total, 8 up, 8 in 2024-03-30T15:14:50.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:50 smithi072 bash[28946]: audit 2024-03-30T15:14:49.159179+0000 mon.a (mon.0) 1918 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-25", "mode": "writeback"}]: dispatch 2024-03-30T15:14:50.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:50 smithi072 bash[28946]: audit 2024-03-30T15:14:49.161647+0000 mon.c (mon.2) 318 : audit 1 from='client.? 172.21.15.72:0/24181956' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi072-64163-33"}]: dispatch 2024-03-30T15:14:50.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:50 smithi072 bash[28946]: audit 2024-03-30T15:14:49.163980+0000 mon.c (mon.2) 319 : audit 1 from='client.? 172.21.15.72:0/482468533' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi072-64171-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:50.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:50 smithi072 bash[28946]: audit 2024-03-30T15:14:49.180605+0000 mon.a (mon.0) 1919 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi072-64163-33"}]: dispatch 2024-03-30T15:14:50.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:50 smithi072 bash[28946]: audit 2024-03-30T15:14:49.181396+0000 mon.a (mon.0) 1920 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi072-64171-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:50.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:50 smithi072 bash[28946]: cluster 2024-03-30T15:14:50.146152+0000 mon.a (mon.0) 1921 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:14:50.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:50 smithi072 bash[28946]: audit 2024-03-30T15:14:50.148833+0000 mon.a (mon.0) 1922 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-25", "mode": "writeback"}]': finished 2024-03-30T15:14:50.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:50 smithi072 bash[28946]: audit 2024-03-30T15:14:50.148997+0000 mon.a (mon.0) 1923 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi072-64163-33"}]': finished 2024-03-30T15:14:50.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:50 smithi072 bash[28946]: audit 2024-03-30T15:14:50.149243+0000 mon.a (mon.0) 1924 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi072-64171-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:50.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:50 smithi072 bash[28946]: cluster 2024-03-30T15:14:50.158895+0000 mon.a (mon.0) 1925 : cluster 0 osdmap e232: 8 total, 8 up, 8 in 2024-03-30T15:14:50.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:50 smithi172 bash[23680]: audit 2024-03-30T15:14:49.145447+0000 mon.a (mon.0) 1916 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-25"}]': finished 2024-03-30T15:14:50.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:50 smithi172 bash[23680]: cluster 2024-03-30T15:14:49.152282+0000 mon.a (mon.0) 1917 : cluster 0 osdmap e231: 8 total, 8 up, 8 in 2024-03-30T15:14:50.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:50 smithi172 bash[23680]: audit 2024-03-30T15:14:49.159179+0000 mon.a (mon.0) 1918 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-25", "mode": "writeback"}]: dispatch 2024-03-30T15:14:50.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:50 smithi172 bash[23680]: audit 2024-03-30T15:14:49.161647+0000 mon.c (mon.2) 318 : audit 1 from='client.? 172.21.15.72:0/24181956' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi072-64163-33"}]: dispatch 2024-03-30T15:14:50.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:50 smithi172 bash[23680]: audit 2024-03-30T15:14:49.163980+0000 mon.c (mon.2) 319 : audit 1 from='client.? 172.21.15.72:0/482468533' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi072-64171-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:50.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:50 smithi172 bash[23680]: audit 2024-03-30T15:14:49.180605+0000 mon.a (mon.0) 1919 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi072-64163-33"}]: dispatch 2024-03-30T15:14:50.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:50 smithi172 bash[23680]: audit 2024-03-30T15:14:49.181396+0000 mon.a (mon.0) 1920 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi072-64171-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:50.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:50 smithi172 bash[23680]: cluster 2024-03-30T15:14:50.146152+0000 mon.a (mon.0) 1921 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:14:50.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:50 smithi172 bash[23680]: audit 2024-03-30T15:14:50.148833+0000 mon.a (mon.0) 1922 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-25", "mode": "writeback"}]': finished 2024-03-30T15:14:50.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:50 smithi172 bash[23680]: audit 2024-03-30T15:14:50.148997+0000 mon.a (mon.0) 1923 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi072-64163-33"}]': finished 2024-03-30T15:14:50.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:50 smithi172 bash[23680]: audit 2024-03-30T15:14:50.149243+0000 mon.a (mon.0) 1924 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi072-64171-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:50.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:50 smithi172 bash[23680]: cluster 2024-03-30T15:14:50.158895+0000 mon.a (mon.0) 1925 : cluster 0 osdmap e232: 8 total, 8 up, 8 in 2024-03-30T15:14:51.417 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:14:51 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:14:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:14:51.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:51 smithi072 bash[21573]: cluster 2024-03-30T15:14:49.964217+0000 mgr.y (mgr.14526) 297 : cluster 0 pgmap v351: 388 pgs: 64 unknown, 64 creating+peering, 260 active+clean; 584 KiB data, 581 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:14:51.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:51 smithi072 bash[21573]: audit 2024-03-30T15:14:50.163379+0000 mon.c (mon.2) 320 : audit 1 from='client.? 172.21.15.72:0/24181956' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi072-64163-33"}]: dispatch 2024-03-30T15:14:51.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:51 smithi072 bash[21573]: cluster 2024-03-30T15:14:50.165257+0000 mon.a (mon.0) 1926 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:14:51.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:51 smithi072 bash[21573]: audit 2024-03-30T15:14:50.165625+0000 mon.a (mon.0) 1927 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi072-64163-33"}]: dispatch 2024-03-30T15:14:51.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:51 smithi072 bash[21573]: audit 2024-03-30T15:14:50.239248+0000 mon.a (mon.0) 1928 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:14:51.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:51 smithi072 bash[21573]: audit 2024-03-30T15:14:50.799001+0000 mon.a (mon.0) 1929 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:14:51.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:51 smithi072 bash[21573]: audit 2024-03-30T15:14:50.802400+0000 mon.c (mon.2) 321 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:14:51.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:51 smithi072 bash[21573]: audit 2024-03-30T15:14:51.048479+0000 mon.a (mon.0) 1930 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi072-64163-33"}]': finished 2024-03-30T15:14:51.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:51 smithi072 bash[21573]: audit 2024-03-30T15:14:51.048755+0000 mon.a (mon.0) 1931 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:14:51.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:51 smithi072 bash[21573]: cluster 2024-03-30T15:14:51.055742+0000 mon.a (mon.0) 1932 : cluster 0 osdmap e233: 8 total, 8 up, 8 in 2024-03-30T15:14:51.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:51 smithi072 bash[21573]: audit 2024-03-30T15:14:51.059115+0000 mon.a (mon.0) 1933 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-25"}]: dispatch 2024-03-30T15:14:51.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:51 smithi072 bash[21573]: audit 2024-03-30T15:14:51.090558+0000 mon.c (mon.2) 322 : audit 1 from='client.? 172.21.15.72:0/3001007753' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi072-64163-34"}]: dispatch 2024-03-30T15:14:51.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:51 smithi072 bash[21573]: audit 2024-03-30T15:14:51.090903+0000 mon.a (mon.0) 1934 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi072-64163-34"}]: dispatch 2024-03-30T15:14:51.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:51 smithi072 bash[21573]: audit 2024-03-30T15:14:51.092171+0000 mon.c (mon.2) 323 : audit 1 from='client.? 172.21.15.72:0/3001007753' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi072-64163-34"}]: dispatch 2024-03-30T15:14:51.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:51 smithi072 bash[21573]: audit 2024-03-30T15:14:51.092510+0000 mon.a (mon.0) 1935 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi072-64163-34"}]: dispatch 2024-03-30T15:14:51.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:51 smithi072 bash[21573]: audit 2024-03-30T15:14:51.093081+0000 mon.c (mon.2) 324 : audit 1 from='client.? 172.21.15.72:0/3001007753' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi072-64163-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:51.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:51 smithi072 bash[21573]: audit 2024-03-30T15:14:51.093420+0000 mon.a (mon.0) 1936 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi072-64163-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:51.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:51 smithi072 bash[28946]: cluster 2024-03-30T15:14:49.964217+0000 mgr.y (mgr.14526) 297 : cluster 0 pgmap v351: 388 pgs: 64 unknown, 64 creating+peering, 260 active+clean; 584 KiB data, 581 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:14:51.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:51 smithi072 bash[28946]: audit 2024-03-30T15:14:50.163379+0000 mon.c (mon.2) 320 : audit 1 from='client.? 172.21.15.72:0/24181956' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi072-64163-33"}]: dispatch 2024-03-30T15:14:51.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:51 smithi072 bash[28946]: cluster 2024-03-30T15:14:50.165257+0000 mon.a (mon.0) 1926 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:14:51.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:51 smithi072 bash[28946]: audit 2024-03-30T15:14:50.165625+0000 mon.a (mon.0) 1927 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi072-64163-33"}]: dispatch 2024-03-30T15:14:51.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:51 smithi072 bash[28946]: audit 2024-03-30T15:14:50.239248+0000 mon.a (mon.0) 1928 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:14:51.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:51 smithi072 bash[28946]: audit 2024-03-30T15:14:50.799001+0000 mon.a (mon.0) 1929 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:14:51.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:51 smithi072 bash[28946]: audit 2024-03-30T15:14:50.802400+0000 mon.c (mon.2) 321 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:14:51.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:51 smithi072 bash[28946]: audit 2024-03-30T15:14:51.048479+0000 mon.a (mon.0) 1930 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi072-64163-33"}]': finished 2024-03-30T15:14:51.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:51 smithi072 bash[28946]: audit 2024-03-30T15:14:51.048755+0000 mon.a (mon.0) 1931 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:14:51.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:51 smithi072 bash[28946]: cluster 2024-03-30T15:14:51.055742+0000 mon.a (mon.0) 1932 : cluster 0 osdmap e233: 8 total, 8 up, 8 in 2024-03-30T15:14:51.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:51 smithi072 bash[28946]: audit 2024-03-30T15:14:51.059115+0000 mon.a (mon.0) 1933 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-25"}]: dispatch 2024-03-30T15:14:51.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:51 smithi072 bash[28946]: audit 2024-03-30T15:14:51.090558+0000 mon.c (mon.2) 322 : audit 1 from='client.? 172.21.15.72:0/3001007753' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi072-64163-34"}]: dispatch 2024-03-30T15:14:51.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:51 smithi072 bash[28946]: audit 2024-03-30T15:14:51.090903+0000 mon.a (mon.0) 1934 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi072-64163-34"}]: dispatch 2024-03-30T15:14:51.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:51 smithi072 bash[28946]: audit 2024-03-30T15:14:51.092171+0000 mon.c (mon.2) 323 : audit 1 from='client.? 172.21.15.72:0/3001007753' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi072-64163-34"}]: dispatch 2024-03-30T15:14:51.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:51 smithi072 bash[28946]: audit 2024-03-30T15:14:51.092510+0000 mon.a (mon.0) 1935 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi072-64163-34"}]: dispatch 2024-03-30T15:14:51.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:51 smithi072 bash[28946]: audit 2024-03-30T15:14:51.093081+0000 mon.c (mon.2) 324 : audit 1 from='client.? 172.21.15.72:0/3001007753' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi072-64163-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:51.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:51 smithi072 bash[28946]: audit 2024-03-30T15:14:51.093420+0000 mon.a (mon.0) 1936 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi072-64163-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:51.464 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:14:51 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:14:51.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:51 smithi172 bash[23680]: cluster 2024-03-30T15:14:49.964217+0000 mgr.y (mgr.14526) 297 : cluster 0 pgmap v351: 388 pgs: 64 unknown, 64 creating+peering, 260 active+clean; 584 KiB data, 581 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:14:51.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:51 smithi172 bash[23680]: audit 2024-03-30T15:14:50.163379+0000 mon.c (mon.2) 320 : audit 1 from='client.? 172.21.15.72:0/24181956' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi072-64163-33"}]: dispatch 2024-03-30T15:14:51.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:51 smithi172 bash[23680]: cluster 2024-03-30T15:14:50.165257+0000 mon.a (mon.0) 1926 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:14:51.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:51 smithi172 bash[23680]: audit 2024-03-30T15:14:50.165625+0000 mon.a (mon.0) 1927 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi072-64163-33"}]: dispatch 2024-03-30T15:14:51.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:51 smithi172 bash[23680]: audit 2024-03-30T15:14:50.239248+0000 mon.a (mon.0) 1928 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:14:51.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:51 smithi172 bash[23680]: audit 2024-03-30T15:14:50.799001+0000 mon.a (mon.0) 1929 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:14:51.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:51 smithi172 bash[23680]: audit 2024-03-30T15:14:50.802400+0000 mon.c (mon.2) 321 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:14:51.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:51 smithi172 bash[23680]: audit 2024-03-30T15:14:51.048479+0000 mon.a (mon.0) 1930 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi072-64163-33"}]': finished 2024-03-30T15:14:51.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:51 smithi172 bash[23680]: audit 2024-03-30T15:14:51.048755+0000 mon.a (mon.0) 1931 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:14:51.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:51 smithi172 bash[23680]: cluster 2024-03-30T15:14:51.055742+0000 mon.a (mon.0) 1932 : cluster 0 osdmap e233: 8 total, 8 up, 8 in 2024-03-30T15:14:51.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:51 smithi172 bash[23680]: audit 2024-03-30T15:14:51.059115+0000 mon.a (mon.0) 1933 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-25"}]: dispatch 2024-03-30T15:14:51.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:51 smithi172 bash[23680]: audit 2024-03-30T15:14:51.090558+0000 mon.c (mon.2) 322 : audit 1 from='client.? 172.21.15.72:0/3001007753' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi072-64163-34"}]: dispatch 2024-03-30T15:14:51.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:51 smithi172 bash[23680]: audit 2024-03-30T15:14:51.090903+0000 mon.a (mon.0) 1934 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi072-64163-34"}]: dispatch 2024-03-30T15:14:51.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:51 smithi172 bash[23680]: audit 2024-03-30T15:14:51.092171+0000 mon.c (mon.2) 323 : audit 1 from='client.? 172.21.15.72:0/3001007753' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi072-64163-34"}]: dispatch 2024-03-30T15:14:51.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:51 smithi172 bash[23680]: audit 2024-03-30T15:14:51.092510+0000 mon.a (mon.0) 1935 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi072-64163-34"}]: dispatch 2024-03-30T15:14:51.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:51 smithi172 bash[23680]: audit 2024-03-30T15:14:51.093081+0000 mon.c (mon.2) 324 : audit 1 from='client.? 172.21.15.72:0/3001007753' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi072-64163-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:51.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:51 smithi172 bash[23680]: audit 2024-03-30T15:14:51.093420+0000 mon.a (mon.0) 1936 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi072-64163-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:52.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:52 smithi172 bash[23680]: audit 2024-03-30T15:14:51.108162+0000 mgr.y (mgr.14526) 298 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:14:52.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:52 smithi172 bash[23680]: cluster 2024-03-30T15:14:52.048885+0000 mon.a (mon.0) 1937 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:14:52.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:52 smithi172 bash[23680]: audit 2024-03-30T15:14:52.051377+0000 mon.a (mon.0) 1938 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-25"}]': finished 2024-03-30T15:14:52.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:52 smithi172 bash[23680]: audit 2024-03-30T15:14:52.051641+0000 mon.a (mon.0) 1939 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi072-64163-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:14:52.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:52 smithi172 bash[23680]: cluster 2024-03-30T15:14:52.059495+0000 mon.a (mon.0) 1940 : cluster 0 osdmap e234: 8 total, 8 up, 8 in 2024-03-30T15:14:52.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:52 smithi172 bash[23680]: audit 2024-03-30T15:14:52.062167+0000 mon.c (mon.2) 325 : audit 1 from='client.? 172.21.15.72:0/3001007753' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi072-64163-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi072-64163-34"}]: dispatch 2024-03-30T15:14:52.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:52 smithi172 bash[23680]: audit 2024-03-30T15:14:52.063193+0000 mon.a (mon.0) 1941 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi072-64163-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi072-64163-34"}]: dispatch 2024-03-30T15:14:52.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:52 smithi072 bash[21573]: audit 2024-03-30T15:14:51.108162+0000 mgr.y (mgr.14526) 298 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:14:52.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:52 smithi072 bash[21573]: cluster 2024-03-30T15:14:52.048885+0000 mon.a (mon.0) 1937 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:14:52.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:52 smithi072 bash[21573]: audit 2024-03-30T15:14:52.051377+0000 mon.a (mon.0) 1938 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-25"}]': finished 2024-03-30T15:14:52.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:52 smithi072 bash[21573]: audit 2024-03-30T15:14:52.051641+0000 mon.a (mon.0) 1939 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi072-64163-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:14:52.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:52 smithi072 bash[21573]: cluster 2024-03-30T15:14:52.059495+0000 mon.a (mon.0) 1940 : cluster 0 osdmap e234: 8 total, 8 up, 8 in 2024-03-30T15:14:52.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:52 smithi072 bash[21573]: audit 2024-03-30T15:14:52.062167+0000 mon.c (mon.2) 325 : audit 1 from='client.? 172.21.15.72:0/3001007753' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi072-64163-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi072-64163-34"}]: dispatch 2024-03-30T15:14:52.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:52 smithi072 bash[21573]: audit 2024-03-30T15:14:52.063193+0000 mon.a (mon.0) 1941 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi072-64163-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi072-64163-34"}]: dispatch 2024-03-30T15:14:52.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:52 smithi072 bash[28946]: audit 2024-03-30T15:14:51.108162+0000 mgr.y (mgr.14526) 298 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:14:52.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:52 smithi072 bash[28946]: cluster 2024-03-30T15:14:52.048885+0000 mon.a (mon.0) 1937 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:14:52.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:52 smithi072 bash[28946]: audit 2024-03-30T15:14:52.051377+0000 mon.a (mon.0) 1938 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-25"}]': finished 2024-03-30T15:14:52.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:52 smithi072 bash[28946]: audit 2024-03-30T15:14:52.051641+0000 mon.a (mon.0) 1939 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi072-64163-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:14:52.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:52 smithi072 bash[28946]: cluster 2024-03-30T15:14:52.059495+0000 mon.a (mon.0) 1940 : cluster 0 osdmap e234: 8 total, 8 up, 8 in 2024-03-30T15:14:52.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:52 smithi072 bash[28946]: audit 2024-03-30T15:14:52.062167+0000 mon.c (mon.2) 325 : audit 1 from='client.? 172.21.15.72:0/3001007753' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi072-64163-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi072-64163-34"}]: dispatch 2024-03-30T15:14:52.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:52 smithi072 bash[28946]: audit 2024-03-30T15:14:52.063193+0000 mon.a (mon.0) 1941 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi072-64163-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi072-64163-34"}]: dispatch 2024-03-30T15:14:54.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:53 smithi172 bash[23680]: cluster 2024-03-30T15:14:51.965160+0000 mgr.y (mgr.14526) 299 : cluster 0 pgmap v354: 356 pgs: 356 active+clean; 584 KiB data, 590 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 3 op/s 2024-03-30T15:14:54.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:53 smithi072 bash[21573]: cluster 2024-03-30T15:14:51.965160+0000 mgr.y (mgr.14526) 299 : cluster 0 pgmap v354: 356 pgs: 356 active+clean; 584 KiB data, 590 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 3 op/s 2024-03-30T15:14:54.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:53 smithi072 bash[28946]: cluster 2024-03-30T15:14:51.965160+0000 mgr.y (mgr.14526) 299 : cluster 0 pgmap v354: 356 pgs: 356 active+clean; 584 KiB data, 590 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 3 op/s 2024-03-30T15:14:55.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:54 smithi172 bash[23680]: cluster 2024-03-30T15:14:53.519791+0000 mon.a (mon.0) 1942 : cluster 0 osdmap e235: 8 total, 8 up, 8 in 2024-03-30T15:14:55.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:54 smithi172 bash[23680]: cluster 2024-03-30T15:14:53.965753+0000 mgr.y (mgr.14526) 300 : cluster 0 pgmap v357: 260 pgs: 260 active+clean; 584 KiB data, 590 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-30T15:14:55.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:54 smithi172 bash[23680]: audit 2024-03-30T15:14:54.059308+0000 mon.a (mon.0) 1943 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValue_smithi072-64163-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi072-64163-34"}]': finished 2024-03-30T15:14:55.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:54 smithi172 bash[23680]: cluster 2024-03-30T15:14:54.067299+0000 mon.a (mon.0) 1944 : cluster 0 osdmap e236: 8 total, 8 up, 8 in 2024-03-30T15:14:55.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:54 smithi172 bash[23680]: audit 2024-03-30T15:14:54.091615+0000 mon.a (mon.0) 1945 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:55.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:54 smithi072 bash[21573]: cluster 2024-03-30T15:14:53.519791+0000 mon.a (mon.0) 1942 : cluster 0 osdmap e235: 8 total, 8 up, 8 in 2024-03-30T15:14:55.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:54 smithi072 bash[21573]: cluster 2024-03-30T15:14:53.965753+0000 mgr.y (mgr.14526) 300 : cluster 0 pgmap v357: 260 pgs: 260 active+clean; 584 KiB data, 590 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-30T15:14:55.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:54 smithi072 bash[21573]: audit 2024-03-30T15:14:54.059308+0000 mon.a (mon.0) 1943 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValue_smithi072-64163-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi072-64163-34"}]': finished 2024-03-30T15:14:55.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:54 smithi072 bash[21573]: cluster 2024-03-30T15:14:54.067299+0000 mon.a (mon.0) 1944 : cluster 0 osdmap e236: 8 total, 8 up, 8 in 2024-03-30T15:14:55.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:54 smithi072 bash[21573]: audit 2024-03-30T15:14:54.091615+0000 mon.a (mon.0) 1945 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:55.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:54 smithi072 bash[28946]: cluster 2024-03-30T15:14:53.519791+0000 mon.a (mon.0) 1942 : cluster 0 osdmap e235: 8 total, 8 up, 8 in 2024-03-30T15:14:55.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:54 smithi072 bash[28946]: cluster 2024-03-30T15:14:53.965753+0000 mgr.y (mgr.14526) 300 : cluster 0 pgmap v357: 260 pgs: 260 active+clean; 584 KiB data, 590 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-30T15:14:55.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:54 smithi072 bash[28946]: audit 2024-03-30T15:14:54.059308+0000 mon.a (mon.0) 1943 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValue_smithi072-64163-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi072-64163-34"}]': finished 2024-03-30T15:14:55.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:54 smithi072 bash[28946]: cluster 2024-03-30T15:14:54.067299+0000 mon.a (mon.0) 1944 : cluster 0 osdmap e236: 8 total, 8 up, 8 in 2024-03-30T15:14:55.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:54 smithi072 bash[28946]: audit 2024-03-30T15:14:54.091615+0000 mon.a (mon.0) 1945 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:56.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:56 smithi072 bash[21573]: audit 2024-03-30T15:14:55.062426+0000 mon.a (mon.0) 1946 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:56.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:56 smithi072 bash[21573]: cluster 2024-03-30T15:14:55.070015+0000 mon.a (mon.0) 1947 : cluster 0 osdmap e237: 8 total, 8 up, 8 in 2024-03-30T15:14:56.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:56 smithi072 bash[21573]: cluster 2024-03-30T15:14:56.047448+0000 mon.a (mon.0) 1948 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:14:56.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:56 smithi072 bash[28946]: audit 2024-03-30T15:14:55.062426+0000 mon.a (mon.0) 1946 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:56.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:56 smithi072 bash[28946]: cluster 2024-03-30T15:14:55.070015+0000 mon.a (mon.0) 1947 : cluster 0 osdmap e237: 8 total, 8 up, 8 in 2024-03-30T15:14:56.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:56 smithi072 bash[28946]: cluster 2024-03-30T15:14:56.047448+0000 mon.a (mon.0) 1948 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:14:56.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:56 smithi172 bash[23680]: audit 2024-03-30T15:14:55.062426+0000 mon.a (mon.0) 1946 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:56.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:56 smithi172 bash[23680]: cluster 2024-03-30T15:14:55.070015+0000 mon.a (mon.0) 1947 : cluster 0 osdmap e237: 8 total, 8 up, 8 in 2024-03-30T15:14:56.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:56 smithi172 bash[23680]: cluster 2024-03-30T15:14:56.047448+0000 mon.a (mon.0) 1948 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:14:57.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:57 smithi072 bash[21573]: cluster 2024-03-30T15:14:55.967764+0000 mgr.y (mgr.14526) 301 : cluster 0 pgmap v360: 236 pgs: 236 active+clean; 584 KiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T15:14:57.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:57 smithi072 bash[21573]: cluster 2024-03-30T15:14:56.084088+0000 mon.a (mon.0) 1949 : cluster 0 osdmap e238: 8 total, 8 up, 8 in 2024-03-30T15:14:57.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:57 smithi072 bash[21573]: audit 2024-03-30T15:14:56.086319+0000 mon.c (mon.2) 326 : audit 1 from='client.? 172.21.15.72:0/3001007753' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi072-64163-34"}]: dispatch 2024-03-30T15:14:57.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:57 smithi072 bash[21573]: audit 2024-03-30T15:14:56.088386+0000 mon.a (mon.0) 1950 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi072-64163-34"}]: dispatch 2024-03-30T15:14:57.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:57 smithi072 bash[21573]: audit 2024-03-30T15:14:56.088714+0000 mon.a (mon.0) 1951 : audit 1 from='client.? 172.21.15.72:0/2182539287' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi072-64171-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:57.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:57 smithi072 bash[21573]: audit 2024-03-30T15:14:56.126456+0000 mon.a (mon.0) 1952 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:14:57.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:57 smithi072 bash[28946]: cluster 2024-03-30T15:14:55.967764+0000 mgr.y (mgr.14526) 301 : cluster 0 pgmap v360: 236 pgs: 236 active+clean; 584 KiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T15:14:57.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:57 smithi072 bash[28946]: cluster 2024-03-30T15:14:56.084088+0000 mon.a (mon.0) 1949 : cluster 0 osdmap e238: 8 total, 8 up, 8 in 2024-03-30T15:14:57.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:57 smithi072 bash[28946]: audit 2024-03-30T15:14:56.086319+0000 mon.c (mon.2) 326 : audit 1 from='client.? 172.21.15.72:0/3001007753' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi072-64163-34"}]: dispatch 2024-03-30T15:14:57.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:57 smithi072 bash[28946]: audit 2024-03-30T15:14:56.088386+0000 mon.a (mon.0) 1950 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi072-64163-34"}]: dispatch 2024-03-30T15:14:57.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:57 smithi072 bash[28946]: audit 2024-03-30T15:14:56.088714+0000 mon.a (mon.0) 1951 : audit 1 from='client.? 172.21.15.72:0/2182539287' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi072-64171-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:57.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:57 smithi072 bash[28946]: audit 2024-03-30T15:14:56.126456+0000 mon.a (mon.0) 1952 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:14:57.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:57 smithi172 bash[23680]: cluster 2024-03-30T15:14:55.967764+0000 mgr.y (mgr.14526) 301 : cluster 0 pgmap v360: 236 pgs: 236 active+clean; 584 KiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T15:14:57.493 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:57 smithi172 bash[23680]: cluster 2024-03-30T15:14:56.084088+0000 mon.a (mon.0) 1949 : cluster 0 osdmap e238: 8 total, 8 up, 8 in 2024-03-30T15:14:57.493 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:57 smithi172 bash[23680]: audit 2024-03-30T15:14:56.086319+0000 mon.c (mon.2) 326 : audit 1 from='client.? 172.21.15.72:0/3001007753' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi072-64163-34"}]: dispatch 2024-03-30T15:14:57.493 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:57 smithi172 bash[23680]: audit 2024-03-30T15:14:56.088386+0000 mon.a (mon.0) 1950 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi072-64163-34"}]: dispatch 2024-03-30T15:14:57.493 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:57 smithi172 bash[23680]: audit 2024-03-30T15:14:56.088714+0000 mon.a (mon.0) 1951 : audit 1 from='client.? 172.21.15.72:0/2182539287' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi072-64171-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:14:57.493 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:57 smithi172 bash[23680]: audit 2024-03-30T15:14:56.126456+0000 mon.a (mon.0) 1952 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:14:58.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:58 smithi072 bash[28946]: audit 2024-03-30T15:14:57.077235+0000 mon.a (mon.0) 1953 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi072-64163-34"}]': finished 2024-03-30T15:14:58.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:58 smithi072 bash[28946]: audit 2024-03-30T15:14:57.077424+0000 mon.a (mon.0) 1954 : audit 1 from='client.? 172.21.15.72:0/2182539287' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi072-64171-44","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:58.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:58 smithi072 bash[28946]: audit 2024-03-30T15:14:57.077595+0000 mon.a (mon.0) 1955 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-27", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:14:58.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:58 smithi072 bash[28946]: audit 2024-03-30T15:14:57.087369+0000 mon.c (mon.2) 327 : audit 1 from='client.? 172.21.15.72:0/3001007753' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi072-64163-34"}]: dispatch 2024-03-30T15:14:58.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:58 smithi072 bash[28946]: cluster 2024-03-30T15:14:57.089715+0000 mon.a (mon.0) 1956 : cluster 0 osdmap e239: 8 total, 8 up, 8 in 2024-03-30T15:14:58.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:58 smithi072 bash[28946]: audit 2024-03-30T15:14:57.092594+0000 mon.a (mon.0) 1957 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi072-64163-34"}]: dispatch 2024-03-30T15:14:58.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:58 smithi072 bash[28946]: audit 2024-03-30T15:14:57.093628+0000 mon.a (mon.0) 1958 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-27"}]: dispatch 2024-03-30T15:14:58.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:58 smithi072 bash[28946]: audit 2024-03-30T15:14:58.080957+0000 mon.a (mon.0) 1959 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi072-64163-34"}]': finished 2024-03-30T15:14:58.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:58 smithi072 bash[28946]: audit 2024-03-30T15:14:58.081238+0000 mon.a (mon.0) 1960 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-27"}]': finished 2024-03-30T15:14:58.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:58 smithi072 bash[28946]: cluster 2024-03-30T15:14:58.088089+0000 mon.a (mon.0) 1961 : cluster 0 osdmap e240: 8 total, 8 up, 8 in 2024-03-30T15:14:58.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:58 smithi072 bash[28946]: audit 2024-03-30T15:14:58.090912+0000 mon.a (mon.0) 1962 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-27", "mode": "writeback"}]: dispatch 2024-03-30T15:14:58.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:58 smithi072 bash[21573]: audit 2024-03-30T15:14:57.077235+0000 mon.a (mon.0) 1953 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi072-64163-34"}]': finished 2024-03-30T15:14:58.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:58 smithi072 bash[21573]: audit 2024-03-30T15:14:57.077424+0000 mon.a (mon.0) 1954 : audit 1 from='client.? 172.21.15.72:0/2182539287' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi072-64171-44","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:58.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:58 smithi072 bash[21573]: audit 2024-03-30T15:14:57.077595+0000 mon.a (mon.0) 1955 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-27", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:14:58.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:58 smithi072 bash[21573]: audit 2024-03-30T15:14:57.087369+0000 mon.c (mon.2) 327 : audit 1 from='client.? 172.21.15.72:0/3001007753' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi072-64163-34"}]: dispatch 2024-03-30T15:14:58.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:58 smithi072 bash[21573]: cluster 2024-03-30T15:14:57.089715+0000 mon.a (mon.0) 1956 : cluster 0 osdmap e239: 8 total, 8 up, 8 in 2024-03-30T15:14:58.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:58 smithi072 bash[21573]: audit 2024-03-30T15:14:57.092594+0000 mon.a (mon.0) 1957 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi072-64163-34"}]: dispatch 2024-03-30T15:14:58.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:58 smithi072 bash[21573]: audit 2024-03-30T15:14:57.093628+0000 mon.a (mon.0) 1958 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-27"}]: dispatch 2024-03-30T15:14:58.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:58 smithi072 bash[21573]: audit 2024-03-30T15:14:58.080957+0000 mon.a (mon.0) 1959 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi072-64163-34"}]': finished 2024-03-30T15:14:58.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:58 smithi072 bash[21573]: audit 2024-03-30T15:14:58.081238+0000 mon.a (mon.0) 1960 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-27"}]': finished 2024-03-30T15:14:58.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:58 smithi072 bash[21573]: cluster 2024-03-30T15:14:58.088089+0000 mon.a (mon.0) 1961 : cluster 0 osdmap e240: 8 total, 8 up, 8 in 2024-03-30T15:14:58.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:58 smithi072 bash[21573]: audit 2024-03-30T15:14:58.090912+0000 mon.a (mon.0) 1962 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-27", "mode": "writeback"}]: dispatch 2024-03-30T15:14:58.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:58 smithi172 bash[23680]: audit 2024-03-30T15:14:57.077235+0000 mon.a (mon.0) 1953 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi072-64163-34"}]': finished 2024-03-30T15:14:58.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:58 smithi172 bash[23680]: audit 2024-03-30T15:14:57.077424+0000 mon.a (mon.0) 1954 : audit 1 from='client.? 172.21.15.72:0/2182539287' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi072-64171-44","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:14:58.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:58 smithi172 bash[23680]: audit 2024-03-30T15:14:57.077595+0000 mon.a (mon.0) 1955 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-27", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:14:58.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:58 smithi172 bash[23680]: audit 2024-03-30T15:14:57.087369+0000 mon.c (mon.2) 327 : audit 1 from='client.? 172.21.15.72:0/3001007753' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi072-64163-34"}]: dispatch 2024-03-30T15:14:58.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:58 smithi172 bash[23680]: cluster 2024-03-30T15:14:57.089715+0000 mon.a (mon.0) 1956 : cluster 0 osdmap e239: 8 total, 8 up, 8 in 2024-03-30T15:14:58.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:58 smithi172 bash[23680]: audit 2024-03-30T15:14:57.092594+0000 mon.a (mon.0) 1957 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi072-64163-34"}]: dispatch 2024-03-30T15:14:58.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:58 smithi172 bash[23680]: audit 2024-03-30T15:14:57.093628+0000 mon.a (mon.0) 1958 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-27"}]: dispatch 2024-03-30T15:14:58.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:58 smithi172 bash[23680]: audit 2024-03-30T15:14:58.080957+0000 mon.a (mon.0) 1959 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi072-64163-34"}]': finished 2024-03-30T15:14:58.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:58 smithi172 bash[23680]: audit 2024-03-30T15:14:58.081238+0000 mon.a (mon.0) 1960 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-27"}]': finished 2024-03-30T15:14:58.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:58 smithi172 bash[23680]: cluster 2024-03-30T15:14:58.088089+0000 mon.a (mon.0) 1961 : cluster 0 osdmap e240: 8 total, 8 up, 8 in 2024-03-30T15:14:58.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:58 smithi172 bash[23680]: audit 2024-03-30T15:14:58.090912+0000 mon.a (mon.0) 1962 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-27", "mode": "writeback"}]: dispatch 2024-03-30T15:14:59.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:59 smithi072 bash[21573]: cluster 2024-03-30T15:14:57.968593+0000 mgr.y (mgr.14526) 302 : cluster 0 pgmap v363: 260 pgs: 32 unknown, 228 active+clean; 584 KiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:14:59.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:59 smithi072 bash[21573]: audit 2024-03-30T15:14:58.126695+0000 mon.c (mon.2) 328 : audit 1 from='client.? 172.21.15.72:0/757245019' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi072-64163-35"}]: dispatch 2024-03-30T15:14:59.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:59 smithi072 bash[21573]: audit 2024-03-30T15:14:58.556058+0000 mon.a (mon.0) 1963 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi072-64163-35"}]: dispatch 2024-03-30T15:14:59.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:59 smithi072 bash[21573]: audit 2024-03-30T15:14:58.557216+0000 mon.c (mon.2) 329 : audit 1 from='client.? 172.21.15.72:0/757245019' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi072-64163-35"}]: dispatch 2024-03-30T15:14:59.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:59 smithi072 bash[21573]: audit 2024-03-30T15:14:58.557756+0000 mon.a (mon.0) 1964 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi072-64163-35"}]: dispatch 2024-03-30T15:14:59.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:59 smithi072 bash[21573]: audit 2024-03-30T15:14:58.558720+0000 mon.c (mon.2) 330 : audit 1 from='client.? 172.21.15.72:0/757245019' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi072-64163-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:59.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:59 smithi072 bash[21573]: audit 2024-03-30T15:14:58.559289+0000 mon.a (mon.0) 1965 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi072-64163-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:59.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:59 smithi072 bash[21573]: cluster 2024-03-30T15:14:59.082366+0000 mon.a (mon.0) 1966 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:14:59.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:59 smithi072 bash[21573]: audit 2024-03-30T15:14:59.085189+0000 mon.a (mon.0) 1967 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-27", "mode": "writeback"}]': finished 2024-03-30T15:14:59.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:59 smithi072 bash[21573]: audit 2024-03-30T15:14:59.085419+0000 mon.a (mon.0) 1968 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi072-64163-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:14:59.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:59 smithi072 bash[21573]: audit 2024-03-30T15:14:59.097872+0000 mon.c (mon.2) 331 : audit 1 from='client.? 172.21.15.72:0/757245019' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi072-64163-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi072-64163-35"}]: dispatch 2024-03-30T15:14:59.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:14:59 smithi072 bash[21573]: cluster 2024-03-30T15:14:59.099079+0000 mon.a (mon.0) 1969 : cluster 0 osdmap e241: 8 total, 8 up, 8 in 2024-03-30T15:14:59.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:59 smithi072 bash[28946]: cluster 2024-03-30T15:14:57.968593+0000 mgr.y (mgr.14526) 302 : cluster 0 pgmap v363: 260 pgs: 32 unknown, 228 active+clean; 584 KiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:14:59.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:59 smithi072 bash[28946]: audit 2024-03-30T15:14:58.126695+0000 mon.c (mon.2) 328 : audit 1 from='client.? 172.21.15.72:0/757245019' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi072-64163-35"}]: dispatch 2024-03-30T15:14:59.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:59 smithi072 bash[28946]: audit 2024-03-30T15:14:58.556058+0000 mon.a (mon.0) 1963 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi072-64163-35"}]: dispatch 2024-03-30T15:14:59.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:59 smithi072 bash[28946]: audit 2024-03-30T15:14:58.557216+0000 mon.c (mon.2) 329 : audit 1 from='client.? 172.21.15.72:0/757245019' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi072-64163-35"}]: dispatch 2024-03-30T15:14:59.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:59 smithi072 bash[28946]: audit 2024-03-30T15:14:58.557756+0000 mon.a (mon.0) 1964 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi072-64163-35"}]: dispatch 2024-03-30T15:14:59.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:59 smithi072 bash[28946]: audit 2024-03-30T15:14:58.558720+0000 mon.c (mon.2) 330 : audit 1 from='client.? 172.21.15.72:0/757245019' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi072-64163-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:59.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:59 smithi072 bash[28946]: audit 2024-03-30T15:14:58.559289+0000 mon.a (mon.0) 1965 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi072-64163-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:59.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:59 smithi072 bash[28946]: cluster 2024-03-30T15:14:59.082366+0000 mon.a (mon.0) 1966 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:14:59.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:59 smithi072 bash[28946]: audit 2024-03-30T15:14:59.085189+0000 mon.a (mon.0) 1967 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-27", "mode": "writeback"}]': finished 2024-03-30T15:14:59.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:59 smithi072 bash[28946]: audit 2024-03-30T15:14:59.085419+0000 mon.a (mon.0) 1968 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi072-64163-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:14:59.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:59 smithi072 bash[28946]: audit 2024-03-30T15:14:59.097872+0000 mon.c (mon.2) 331 : audit 1 from='client.? 172.21.15.72:0/757245019' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi072-64163-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi072-64163-35"}]: dispatch 2024-03-30T15:14:59.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:14:59 smithi072 bash[28946]: cluster 2024-03-30T15:14:59.099079+0000 mon.a (mon.0) 1969 : cluster 0 osdmap e241: 8 total, 8 up, 8 in 2024-03-30T15:14:59.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:59 smithi172 bash[23680]: cluster 2024-03-30T15:14:57.968593+0000 mgr.y (mgr.14526) 302 : cluster 0 pgmap v363: 260 pgs: 32 unknown, 228 active+clean; 584 KiB data, 599 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:14:59.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:59 smithi172 bash[23680]: audit 2024-03-30T15:14:58.126695+0000 mon.c (mon.2) 328 : audit 1 from='client.? 172.21.15.72:0/757245019' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi072-64163-35"}]: dispatch 2024-03-30T15:14:59.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:59 smithi172 bash[23680]: audit 2024-03-30T15:14:58.556058+0000 mon.a (mon.0) 1963 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi072-64163-35"}]: dispatch 2024-03-30T15:14:59.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:59 smithi172 bash[23680]: audit 2024-03-30T15:14:58.557216+0000 mon.c (mon.2) 329 : audit 1 from='client.? 172.21.15.72:0/757245019' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi072-64163-35"}]: dispatch 2024-03-30T15:14:59.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:59 smithi172 bash[23680]: audit 2024-03-30T15:14:58.557756+0000 mon.a (mon.0) 1964 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi072-64163-35"}]: dispatch 2024-03-30T15:14:59.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:59 smithi172 bash[23680]: audit 2024-03-30T15:14:58.558720+0000 mon.c (mon.2) 330 : audit 1 from='client.? 172.21.15.72:0/757245019' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi072-64163-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:59.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:59 smithi172 bash[23680]: audit 2024-03-30T15:14:58.559289+0000 mon.a (mon.0) 1965 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi072-64163-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:14:59.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:59 smithi172 bash[23680]: cluster 2024-03-30T15:14:59.082366+0000 mon.a (mon.0) 1966 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:14:59.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:59 smithi172 bash[23680]: audit 2024-03-30T15:14:59.085189+0000 mon.a (mon.0) 1967 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-27", "mode": "writeback"}]': finished 2024-03-30T15:14:59.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:59 smithi172 bash[23680]: audit 2024-03-30T15:14:59.085419+0000 mon.a (mon.0) 1968 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi072-64163-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:14:59.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:59 smithi172 bash[23680]: audit 2024-03-30T15:14:59.097872+0000 mon.c (mon.2) 331 : audit 1 from='client.? 172.21.15.72:0/757245019' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi072-64163-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi072-64163-35"}]: dispatch 2024-03-30T15:14:59.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:14:59 smithi172 bash[23680]: cluster 2024-03-30T15:14:59.099079+0000 mon.a (mon.0) 1969 : cluster 0 osdmap e241: 8 total, 8 up, 8 in 2024-03-30T15:15:00.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:00 smithi072 bash[21573]: audit 2024-03-30T15:14:59.108024+0000 mon.c (mon.2) 332 : audit 1 from='client.? 172.21.15.72:0/1329575174' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi072-64171-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:15:00.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:00 smithi072 bash[21573]: audit 2024-03-30T15:14:59.109334+0000 mon.a (mon.0) 1970 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi072-64163-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi072-64163-35"}]: dispatch 2024-03-30T15:15:00.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:00 smithi072 bash[21573]: audit 2024-03-30T15:14:59.111467+0000 mon.a (mon.0) 1971 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi072-64171-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:15:00.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:00 smithi072 bash[21573]: audit 2024-03-30T15:15:00.089031+0000 mon.a (mon.0) 1972 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi072-64171-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:15:00.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:00 smithi072 bash[28946]: audit 2024-03-30T15:14:59.108024+0000 mon.c (mon.2) 332 : audit 1 from='client.? 172.21.15.72:0/1329575174' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi072-64171-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:15:00.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:00 smithi072 bash[28946]: audit 2024-03-30T15:14:59.109334+0000 mon.a (mon.0) 1970 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi072-64163-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi072-64163-35"}]: dispatch 2024-03-30T15:15:00.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:00 smithi072 bash[28946]: audit 2024-03-30T15:14:59.111467+0000 mon.a (mon.0) 1971 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi072-64171-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:15:00.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:00 smithi072 bash[28946]: audit 2024-03-30T15:15:00.089031+0000 mon.a (mon.0) 1972 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi072-64171-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:15:00.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:00 smithi172 bash[23680]: audit 2024-03-30T15:14:59.108024+0000 mon.c (mon.2) 332 : audit 1 from='client.? 172.21.15.72:0/1329575174' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi072-64171-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:15:00.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:00 smithi172 bash[23680]: audit 2024-03-30T15:14:59.109334+0000 mon.a (mon.0) 1970 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi072-64163-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi072-64163-35"}]: dispatch 2024-03-30T15:15:00.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:00 smithi172 bash[23680]: audit 2024-03-30T15:14:59.111467+0000 mon.a (mon.0) 1971 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi072-64171-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:15:00.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:00 smithi172 bash[23680]: audit 2024-03-30T15:15:00.089031+0000 mon.a (mon.0) 1972 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi072-64171-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:15:01.417 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:15:01 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:15:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:15:01.464 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:15:01 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:15:01.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:01 smithi072 bash[21573]: cluster 2024-03-30T15:14:59.969452+0000 mgr.y (mgr.14526) 303 : cluster 0 pgmap v366: 260 pgs: 32 unknown, 228 active+clean; 584 KiB data, 599 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:15:01.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:01 smithi072 bash[21573]: cluster 2024-03-30T15:15:00.552426+0000 mon.a (mon.0) 1973 : cluster 0 osdmap e242: 8 total, 8 up, 8 in 2024-03-30T15:15:01.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:01 smithi072 bash[21573]: audit 2024-03-30T15:15:00.591561+0000 mon.a (mon.0) 1974 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:15:01.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:01 smithi072 bash[21573]: cluster 2024-03-30T15:15:01.049297+0000 mon.a (mon.0) 1975 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:15:01.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:01 smithi072 bash[21573]: audit 2024-03-30T15:15:01.092154+0000 mon.a (mon.0) 1976 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "Flush_smithi072-64163-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi072-64163-35"}]': finished 2024-03-30T15:15:01.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:01 smithi072 bash[21573]: audit 2024-03-30T15:15:01.092389+0000 mon.a (mon.0) 1977 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:15:01.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:01 smithi072 bash[21573]: cluster 2024-03-30T15:15:01.100155+0000 mon.a (mon.0) 1978 : cluster 0 osdmap e243: 8 total, 8 up, 8 in 2024-03-30T15:15:01.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:01 smithi072 bash[21573]: audit 2024-03-30T15:15:01.101605+0000 mon.a (mon.0) 1979 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-27"}]: dispatch 2024-03-30T15:15:01.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:01 smithi072 bash[21573]: audit 2024-03-30T15:15:01.148999+0000 mon.a (mon.0) 1980 : audit 1 from='client.? 172.21.15.72:0/4244890885' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi072-64171-46"}]: dispatch 2024-03-30T15:15:01.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:01 smithi072 bash[21573]: audit 2024-03-30T15:15:01.150195+0000 mon.a (mon.0) 1981 : audit 1 from='client.? 172.21.15.72:0/4244890885' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi072-64171-46"}]: dispatch 2024-03-30T15:15:01.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:01 smithi072 bash[21573]: audit 2024-03-30T15:15:01.150547+0000 mon.a (mon.0) 1982 : audit 1 from='client.? 172.21.15.72:0/4244890885' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi072-64171-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:01.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:01 smithi072 bash[28946]: cluster 2024-03-30T15:14:59.969452+0000 mgr.y (mgr.14526) 303 : cluster 0 pgmap v366: 260 pgs: 32 unknown, 228 active+clean; 584 KiB data, 599 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:15:01.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:01 smithi072 bash[28946]: cluster 2024-03-30T15:15:00.552426+0000 mon.a (mon.0) 1973 : cluster 0 osdmap e242: 8 total, 8 up, 8 in 2024-03-30T15:15:01.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:01 smithi072 bash[28946]: audit 2024-03-30T15:15:00.591561+0000 mon.a (mon.0) 1974 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:15:01.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:01 smithi072 bash[28946]: cluster 2024-03-30T15:15:01.049297+0000 mon.a (mon.0) 1975 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:15:01.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:01 smithi072 bash[28946]: audit 2024-03-30T15:15:01.092154+0000 mon.a (mon.0) 1976 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "Flush_smithi072-64163-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi072-64163-35"}]': finished 2024-03-30T15:15:01.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:01 smithi072 bash[28946]: audit 2024-03-30T15:15:01.092389+0000 mon.a (mon.0) 1977 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:15:01.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:01 smithi072 bash[28946]: cluster 2024-03-30T15:15:01.100155+0000 mon.a (mon.0) 1978 : cluster 0 osdmap e243: 8 total, 8 up, 8 in 2024-03-30T15:15:01.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:01 smithi072 bash[28946]: audit 2024-03-30T15:15:01.101605+0000 mon.a (mon.0) 1979 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-27"}]: dispatch 2024-03-30T15:15:01.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:01 smithi072 bash[28946]: audit 2024-03-30T15:15:01.148999+0000 mon.a (mon.0) 1980 : audit 1 from='client.? 172.21.15.72:0/4244890885' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi072-64171-46"}]: dispatch 2024-03-30T15:15:01.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:01 smithi072 bash[28946]: audit 2024-03-30T15:15:01.150195+0000 mon.a (mon.0) 1981 : audit 1 from='client.? 172.21.15.72:0/4244890885' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi072-64171-46"}]: dispatch 2024-03-30T15:15:01.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:01 smithi072 bash[28946]: audit 2024-03-30T15:15:01.150547+0000 mon.a (mon.0) 1982 : audit 1 from='client.? 172.21.15.72:0/4244890885' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi072-64171-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:01.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:01 smithi172 bash[23680]: cluster 2024-03-30T15:14:59.969452+0000 mgr.y (mgr.14526) 303 : cluster 0 pgmap v366: 260 pgs: 32 unknown, 228 active+clean; 584 KiB data, 599 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:15:01.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:01 smithi172 bash[23680]: cluster 2024-03-30T15:15:00.552426+0000 mon.a (mon.0) 1973 : cluster 0 osdmap e242: 8 total, 8 up, 8 in 2024-03-30T15:15:01.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:01 smithi172 bash[23680]: audit 2024-03-30T15:15:00.591561+0000 mon.a (mon.0) 1974 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:15:01.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:01 smithi172 bash[23680]: cluster 2024-03-30T15:15:01.049297+0000 mon.a (mon.0) 1975 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:15:01.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:01 smithi172 bash[23680]: audit 2024-03-30T15:15:01.092154+0000 mon.a (mon.0) 1976 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "Flush_smithi072-64163-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi072-64163-35"}]': finished 2024-03-30T15:15:01.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:01 smithi172 bash[23680]: audit 2024-03-30T15:15:01.092389+0000 mon.a (mon.0) 1977 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:15:01.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:01 smithi172 bash[23680]: cluster 2024-03-30T15:15:01.100155+0000 mon.a (mon.0) 1978 : cluster 0 osdmap e243: 8 total, 8 up, 8 in 2024-03-30T15:15:01.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:01 smithi172 bash[23680]: audit 2024-03-30T15:15:01.101605+0000 mon.a (mon.0) 1979 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-27"}]: dispatch 2024-03-30T15:15:01.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:01 smithi172 bash[23680]: audit 2024-03-30T15:15:01.148999+0000 mon.a (mon.0) 1980 : audit 1 from='client.? 172.21.15.72:0/4244890885' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi072-64171-46"}]: dispatch 2024-03-30T15:15:01.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:01 smithi172 bash[23680]: audit 2024-03-30T15:15:01.150195+0000 mon.a (mon.0) 1981 : audit 1 from='client.? 172.21.15.72:0/4244890885' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi072-64171-46"}]: dispatch 2024-03-30T15:15:01.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:01 smithi172 bash[23680]: audit 2024-03-30T15:15:01.150547+0000 mon.a (mon.0) 1982 : audit 1 from='client.? 172.21.15.72:0/4244890885' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi072-64171-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:02.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:02 smithi072 bash[21573]: audit 2024-03-30T15:15:01.115887+0000 mgr.y (mgr.14526) 304 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:15:02.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:02 smithi072 bash[21573]: cluster 2024-03-30T15:15:02.092768+0000 mon.a (mon.0) 1983 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:15:02.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:02 smithi072 bash[21573]: audit 2024-03-30T15:15:02.095328+0000 mon.a (mon.0) 1984 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-27"}]': finished 2024-03-30T15:15:02.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:02 smithi072 bash[21573]: audit 2024-03-30T15:15:02.095621+0000 mon.a (mon.0) 1985 : audit 1 from='client.? 172.21.15.72:0/4244890885' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi072-64171-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:15:02.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:02 smithi072 bash[21573]: cluster 2024-03-30T15:15:02.103910+0000 mon.a (mon.0) 1986 : cluster 0 osdmap e244: 8 total, 8 up, 8 in 2024-03-30T15:15:02.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:02 smithi072 bash[21573]: audit 2024-03-30T15:15:02.105191+0000 mon.a (mon.0) 1987 : audit 1 from='client.? 172.21.15.72:0/4244890885' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi072-64171-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi072-64171-46"}]: dispatch 2024-03-30T15:15:02.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:02 smithi072 bash[28946]: audit 2024-03-30T15:15:01.115887+0000 mgr.y (mgr.14526) 304 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:15:02.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:02 smithi072 bash[28946]: cluster 2024-03-30T15:15:02.092768+0000 mon.a (mon.0) 1983 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:15:02.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:02 smithi072 bash[28946]: audit 2024-03-30T15:15:02.095328+0000 mon.a (mon.0) 1984 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-27"}]': finished 2024-03-30T15:15:02.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:02 smithi072 bash[28946]: audit 2024-03-30T15:15:02.095621+0000 mon.a (mon.0) 1985 : audit 1 from='client.? 172.21.15.72:0/4244890885' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi072-64171-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:15:02.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:02 smithi072 bash[28946]: cluster 2024-03-30T15:15:02.103910+0000 mon.a (mon.0) 1986 : cluster 0 osdmap e244: 8 total, 8 up, 8 in 2024-03-30T15:15:02.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:02 smithi072 bash[28946]: audit 2024-03-30T15:15:02.105191+0000 mon.a (mon.0) 1987 : audit 1 from='client.? 172.21.15.72:0/4244890885' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi072-64171-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi072-64171-46"}]: dispatch 2024-03-30T15:15:02.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:02 smithi172 bash[23680]: audit 2024-03-30T15:15:01.115887+0000 mgr.y (mgr.14526) 304 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:15:02.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:02 smithi172 bash[23680]: cluster 2024-03-30T15:15:02.092768+0000 mon.a (mon.0) 1983 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:15:02.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:02 smithi172 bash[23680]: audit 2024-03-30T15:15:02.095328+0000 mon.a (mon.0) 1984 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-27"}]': finished 2024-03-30T15:15:02.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:02 smithi172 bash[23680]: audit 2024-03-30T15:15:02.095621+0000 mon.a (mon.0) 1985 : audit 1 from='client.? 172.21.15.72:0/4244890885' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi072-64171-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:15:02.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:02 smithi172 bash[23680]: cluster 2024-03-30T15:15:02.103910+0000 mon.a (mon.0) 1986 : cluster 0 osdmap e244: 8 total, 8 up, 8 in 2024-03-30T15:15:02.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:02 smithi172 bash[23680]: audit 2024-03-30T15:15:02.105191+0000 mon.a (mon.0) 1987 : audit 1 from='client.? 172.21.15.72:0/4244890885' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi072-64171-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi072-64171-46"}]: dispatch 2024-03-30T15:15:04.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:04 smithi072 bash[21573]: cluster 2024-03-30T15:15:01.970236+0000 mgr.y (mgr.14526) 305 : cluster 0 pgmap v369: 236 pgs: 8 unknown, 228 active+clean; 584 KiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 3 op/s 2024-03-30T15:15:04.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:04 smithi072 bash[21573]: cluster 2024-03-30T15:15:03.559353+0000 mon.a (mon.0) 1988 : cluster 0 osdmap e245: 8 total, 8 up, 8 in 2024-03-30T15:15:04.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:04 smithi072 bash[28946]: cluster 2024-03-30T15:15:01.970236+0000 mgr.y (mgr.14526) 305 : cluster 0 pgmap v369: 236 pgs: 8 unknown, 228 active+clean; 584 KiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 3 op/s 2024-03-30T15:15:04.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:04 smithi072 bash[28946]: cluster 2024-03-30T15:15:03.559353+0000 mon.a (mon.0) 1988 : cluster 0 osdmap e245: 8 total, 8 up, 8 in 2024-03-30T15:15:04.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:04 smithi172 bash[23680]: cluster 2024-03-30T15:15:01.970236+0000 mgr.y (mgr.14526) 305 : cluster 0 pgmap v369: 236 pgs: 8 unknown, 228 active+clean; 584 KiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 3 op/s 2024-03-30T15:15:04.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:04 smithi172 bash[23680]: cluster 2024-03-30T15:15:03.559353+0000 mon.a (mon.0) 1988 : cluster 0 osdmap e245: 8 total, 8 up, 8 in 2024-03-30T15:15:05.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:05 smithi072 bash[21573]: audit 2024-03-30T15:15:03.560886+0000 mon.c (mon.2) 333 : audit 1 from='client.? 172.21.15.72:0/757245019' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi072-64163-35"}]: dispatch 2024-03-30T15:15:05.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:05 smithi072 bash[21573]: cluster 2024-03-30T15:15:03.970948+0000 mgr.y (mgr.14526) 306 : cluster 0 pgmap v372: 196 pgs: 196 active+clean; 584 KiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-30T15:15:05.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:05 smithi072 bash[21573]: audit 2024-03-30T15:15:04.005508+0000 mon.a (mon.0) 1989 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi072-64163-35"}]: dispatch 2024-03-30T15:15:05.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:05 smithi072 bash[21573]: audit 2024-03-30T15:15:04.108169+0000 mon.a (mon.0) 1990 : audit 1 from='client.? 172.21.15.72:0/4244890885' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi072-64171-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi072-64171-46"}]': finished 2024-03-30T15:15:05.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:05 smithi072 bash[21573]: audit 2024-03-30T15:15:04.108369+0000 mon.a (mon.0) 1991 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi072-64163-35"}]': finished 2024-03-30T15:15:05.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:05 smithi072 bash[21573]: cluster 2024-03-30T15:15:04.116180+0000 mon.a (mon.0) 1992 : cluster 0 osdmap e246: 8 total, 8 up, 8 in 2024-03-30T15:15:05.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:05 smithi072 bash[21573]: audit 2024-03-30T15:15:04.121448+0000 mon.c (mon.2) 334 : audit 1 from='client.? 172.21.15.72:0/757245019' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi072-64163-35"}]: dispatch 2024-03-30T15:15:05.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:05 smithi072 bash[21573]: audit 2024-03-30T15:15:04.141655+0000 mon.a (mon.0) 1993 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi072-64163-35"}]: dispatch 2024-03-30T15:15:05.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:05 smithi072 bash[21573]: audit 2024-03-30T15:15:04.143039+0000 mon.a (mon.0) 1994 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:15:05.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:05 smithi072 bash[28946]: audit 2024-03-30T15:15:03.560886+0000 mon.c (mon.2) 333 : audit 1 from='client.? 172.21.15.72:0/757245019' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi072-64163-35"}]: dispatch 2024-03-30T15:15:05.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:05 smithi072 bash[28946]: cluster 2024-03-30T15:15:03.970948+0000 mgr.y (mgr.14526) 306 : cluster 0 pgmap v372: 196 pgs: 196 active+clean; 584 KiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-30T15:15:05.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:05 smithi072 bash[28946]: audit 2024-03-30T15:15:04.005508+0000 mon.a (mon.0) 1989 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi072-64163-35"}]: dispatch 2024-03-30T15:15:05.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:05 smithi072 bash[28946]: audit 2024-03-30T15:15:04.108169+0000 mon.a (mon.0) 1990 : audit 1 from='client.? 172.21.15.72:0/4244890885' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi072-64171-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi072-64171-46"}]': finished 2024-03-30T15:15:05.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:05 smithi072 bash[28946]: audit 2024-03-30T15:15:04.108369+0000 mon.a (mon.0) 1991 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi072-64163-35"}]': finished 2024-03-30T15:15:05.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:05 smithi072 bash[28946]: cluster 2024-03-30T15:15:04.116180+0000 mon.a (mon.0) 1992 : cluster 0 osdmap e246: 8 total, 8 up, 8 in 2024-03-30T15:15:05.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:05 smithi072 bash[28946]: audit 2024-03-30T15:15:04.121448+0000 mon.c (mon.2) 334 : audit 1 from='client.? 172.21.15.72:0/757245019' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi072-64163-35"}]: dispatch 2024-03-30T15:15:05.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:05 smithi072 bash[28946]: audit 2024-03-30T15:15:04.141655+0000 mon.a (mon.0) 1993 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi072-64163-35"}]: dispatch 2024-03-30T15:15:05.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:05 smithi072 bash[28946]: audit 2024-03-30T15:15:04.143039+0000 mon.a (mon.0) 1994 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:15:05.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:05 smithi172 bash[23680]: audit 2024-03-30T15:15:03.560886+0000 mon.c (mon.2) 333 : audit 1 from='client.? 172.21.15.72:0/757245019' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi072-64163-35"}]: dispatch 2024-03-30T15:15:05.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:05 smithi172 bash[23680]: cluster 2024-03-30T15:15:03.970948+0000 mgr.y (mgr.14526) 306 : cluster 0 pgmap v372: 196 pgs: 196 active+clean; 584 KiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-30T15:15:05.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:05 smithi172 bash[23680]: audit 2024-03-30T15:15:04.005508+0000 mon.a (mon.0) 1989 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi072-64163-35"}]: dispatch 2024-03-30T15:15:05.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:05 smithi172 bash[23680]: audit 2024-03-30T15:15:04.108169+0000 mon.a (mon.0) 1990 : audit 1 from='client.? 172.21.15.72:0/4244890885' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi072-64171-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi072-64171-46"}]': finished 2024-03-30T15:15:05.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:05 smithi172 bash[23680]: audit 2024-03-30T15:15:04.108369+0000 mon.a (mon.0) 1991 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi072-64163-35"}]': finished 2024-03-30T15:15:05.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:05 smithi172 bash[23680]: cluster 2024-03-30T15:15:04.116180+0000 mon.a (mon.0) 1992 : cluster 0 osdmap e246: 8 total, 8 up, 8 in 2024-03-30T15:15:05.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:05 smithi172 bash[23680]: audit 2024-03-30T15:15:04.121448+0000 mon.c (mon.2) 334 : audit 1 from='client.? 172.21.15.72:0/757245019' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi072-64163-35"}]: dispatch 2024-03-30T15:15:05.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:05 smithi172 bash[23680]: audit 2024-03-30T15:15:04.141655+0000 mon.a (mon.0) 1993 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi072-64163-35"}]: dispatch 2024-03-30T15:15:05.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:05 smithi172 bash[23680]: audit 2024-03-30T15:15:04.143039+0000 mon.a (mon.0) 1994 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:15:06.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:06 smithi072 bash[21573]: audit 2024-03-30T15:15:05.111868+0000 mon.a (mon.0) 1995 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"Flush_smithi072-64163-35"}]': finished 2024-03-30T15:15:06.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:06 smithi072 bash[21573]: audit 2024-03-30T15:15:05.112052+0000 mon.a (mon.0) 1996 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:15:06.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:06 smithi072 bash[21573]: cluster 2024-03-30T15:15:05.120163+0000 mon.a (mon.0) 1997 : cluster 0 osdmap e247: 8 total, 8 up, 8 in 2024-03-30T15:15:06.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:06 smithi072 bash[21573]: audit 2024-03-30T15:15:05.193815+0000 mon.a (mon.0) 1998 : audit 1 from='client.? 172.21.15.72:0/1927332645' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi072-64163-36"}]: dispatch 2024-03-30T15:15:06.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:06 smithi072 bash[21573]: audit 2024-03-30T15:15:05.195106+0000 mon.a (mon.0) 1999 : audit 1 from='client.? 172.21.15.72:0/1927332645' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi072-64163-36"}]: dispatch 2024-03-30T15:15:06.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:06 smithi072 bash[21573]: audit 2024-03-30T15:15:05.195461+0000 mon.a (mon.0) 2000 : audit 1 from='client.? 172.21.15.72:0/1927332645' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi072-64163-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:06.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:06 smithi072 bash[21573]: audit 2024-03-30T15:15:05.847676+0000 mon.a (mon.0) 2001 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:15:06.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:06 smithi072 bash[21573]: audit 2024-03-30T15:15:05.852784+0000 mon.c (mon.2) 335 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:15:06.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:06 smithi072 bash[21573]: cluster 2024-03-30T15:15:06.050779+0000 mon.a (mon.0) 2002 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:15:06.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:06 smithi072 bash[21573]: audit 2024-03-30T15:15:06.056125+0000 mon.a (mon.0) 2003 : audit 1 from='client.? 172.21.15.72:0/1927332645' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi072-64163-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:15:06.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:06 smithi072 bash[21573]: cluster 2024-03-30T15:15:06.065610+0000 mon.a (mon.0) 2004 : cluster 0 osdmap e248: 8 total, 8 up, 8 in 2024-03-30T15:15:06.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:06 smithi072 bash[21573]: audit 2024-03-30T15:15:06.073765+0000 mon.a (mon.0) 2005 : audit 1 from='client.? 172.21.15.72:0/1927332645' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsync_smithi072-64163-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi072-64163-36"}]: dispatch 2024-03-30T15:15:06.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:06 smithi072 bash[21573]: audit 2024-03-30T15:15:06.075612+0000 mon.a (mon.0) 2006 : audit 1 from='client.? 172.21.15.72:0/4244890885' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi072-64171-46"}]: dispatch 2024-03-30T15:15:06.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:06 smithi072 bash[28946]: audit 2024-03-30T15:15:05.111868+0000 mon.a (mon.0) 1995 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"Flush_smithi072-64163-35"}]': finished 2024-03-30T15:15:06.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:06 smithi072 bash[28946]: audit 2024-03-30T15:15:05.112052+0000 mon.a (mon.0) 1996 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:15:06.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:06 smithi072 bash[28946]: cluster 2024-03-30T15:15:05.120163+0000 mon.a (mon.0) 1997 : cluster 0 osdmap e247: 8 total, 8 up, 8 in 2024-03-30T15:15:06.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:06 smithi072 bash[28946]: audit 2024-03-30T15:15:05.193815+0000 mon.a (mon.0) 1998 : audit 1 from='client.? 172.21.15.72:0/1927332645' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi072-64163-36"}]: dispatch 2024-03-30T15:15:06.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:06 smithi072 bash[28946]: audit 2024-03-30T15:15:05.195106+0000 mon.a (mon.0) 1999 : audit 1 from='client.? 172.21.15.72:0/1927332645' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi072-64163-36"}]: dispatch 2024-03-30T15:15:06.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:06 smithi072 bash[28946]: audit 2024-03-30T15:15:05.195461+0000 mon.a (mon.0) 2000 : audit 1 from='client.? 172.21.15.72:0/1927332645' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi072-64163-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:06.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:06 smithi072 bash[28946]: audit 2024-03-30T15:15:05.847676+0000 mon.a (mon.0) 2001 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:15:06.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:06 smithi072 bash[28946]: audit 2024-03-30T15:15:05.852784+0000 mon.c (mon.2) 335 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:15:06.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:06 smithi072 bash[28946]: cluster 2024-03-30T15:15:06.050779+0000 mon.a (mon.0) 2002 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:15:06.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:06 smithi072 bash[28946]: audit 2024-03-30T15:15:06.056125+0000 mon.a (mon.0) 2003 : audit 1 from='client.? 172.21.15.72:0/1927332645' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi072-64163-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:15:06.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:06 smithi072 bash[28946]: cluster 2024-03-30T15:15:06.065610+0000 mon.a (mon.0) 2004 : cluster 0 osdmap e248: 8 total, 8 up, 8 in 2024-03-30T15:15:06.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:06 smithi072 bash[28946]: audit 2024-03-30T15:15:06.073765+0000 mon.a (mon.0) 2005 : audit 1 from='client.? 172.21.15.72:0/1927332645' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsync_smithi072-64163-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi072-64163-36"}]: dispatch 2024-03-30T15:15:06.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:06 smithi072 bash[28946]: audit 2024-03-30T15:15:06.075612+0000 mon.a (mon.0) 2006 : audit 1 from='client.? 172.21.15.72:0/4244890885' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi072-64171-46"}]: dispatch 2024-03-30T15:15:06.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:06 smithi172 bash[23680]: audit 2024-03-30T15:15:05.111868+0000 mon.a (mon.0) 1995 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"Flush_smithi072-64163-35"}]': finished 2024-03-30T15:15:06.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:06 smithi172 bash[23680]: audit 2024-03-30T15:15:05.112052+0000 mon.a (mon.0) 1996 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:15:06.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:06 smithi172 bash[23680]: cluster 2024-03-30T15:15:05.120163+0000 mon.a (mon.0) 1997 : cluster 0 osdmap e247: 8 total, 8 up, 8 in 2024-03-30T15:15:06.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:06 smithi172 bash[23680]: audit 2024-03-30T15:15:05.193815+0000 mon.a (mon.0) 1998 : audit 1 from='client.? 172.21.15.72:0/1927332645' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi072-64163-36"}]: dispatch 2024-03-30T15:15:06.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:06 smithi172 bash[23680]: audit 2024-03-30T15:15:05.195106+0000 mon.a (mon.0) 1999 : audit 1 from='client.? 172.21.15.72:0/1927332645' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi072-64163-36"}]: dispatch 2024-03-30T15:15:06.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:06 smithi172 bash[23680]: audit 2024-03-30T15:15:05.195461+0000 mon.a (mon.0) 2000 : audit 1 from='client.? 172.21.15.72:0/1927332645' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi072-64163-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:06.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:06 smithi172 bash[23680]: audit 2024-03-30T15:15:05.847676+0000 mon.a (mon.0) 2001 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:15:06.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:06 smithi172 bash[23680]: audit 2024-03-30T15:15:05.852784+0000 mon.c (mon.2) 335 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:15:06.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:06 smithi172 bash[23680]: cluster 2024-03-30T15:15:06.050779+0000 mon.a (mon.0) 2002 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:15:06.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:06 smithi172 bash[23680]: audit 2024-03-30T15:15:06.056125+0000 mon.a (mon.0) 2003 : audit 1 from='client.? 172.21.15.72:0/1927332645' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi072-64163-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:15:06.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:06 smithi172 bash[23680]: cluster 2024-03-30T15:15:06.065610+0000 mon.a (mon.0) 2004 : cluster 0 osdmap e248: 8 total, 8 up, 8 in 2024-03-30T15:15:06.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:06 smithi172 bash[23680]: audit 2024-03-30T15:15:06.073765+0000 mon.a (mon.0) 2005 : audit 1 from='client.? 172.21.15.72:0/1927332645' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsync_smithi072-64163-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi072-64163-36"}]: dispatch 2024-03-30T15:15:06.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:06 smithi172 bash[23680]: audit 2024-03-30T15:15:06.075612+0000 mon.a (mon.0) 2006 : audit 1 from='client.? 172.21.15.72:0/4244890885' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi072-64171-46"}]: dispatch 2024-03-30T15:15:07.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:07 smithi072 bash[21573]: cluster 2024-03-30T15:15:05.973044+0000 mgr.y (mgr.14526) 307 : cluster 0 pgmap v375: 236 pgs: 236 active+clean; 4.6 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T15:15:07.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:07 smithi072 bash[21573]: audit 2024-03-30T15:15:07.061341+0000 mon.a (mon.0) 2007 : audit 1 from='client.? 172.21.15.72:0/4244890885' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi072-64171-46"}]': finished 2024-03-30T15:15:07.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:07 smithi072 bash[28946]: cluster 2024-03-30T15:15:05.973044+0000 mgr.y (mgr.14526) 307 : cluster 0 pgmap v375: 236 pgs: 236 active+clean; 4.6 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T15:15:07.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:07 smithi072 bash[28946]: audit 2024-03-30T15:15:07.061341+0000 mon.a (mon.0) 2007 : audit 1 from='client.? 172.21.15.72:0/4244890885' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi072-64171-46"}]': finished 2024-03-30T15:15:07.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:07 smithi172 bash[23680]: cluster 2024-03-30T15:15:05.973044+0000 mgr.y (mgr.14526) 307 : cluster 0 pgmap v375: 236 pgs: 236 active+clean; 4.6 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T15:15:07.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:07 smithi172 bash[23680]: audit 2024-03-30T15:15:07.061341+0000 mon.a (mon.0) 2007 : audit 1 from='client.? 172.21.15.72:0/4244890885' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi072-64171-46"}]': finished 2024-03-30T15:15:08.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:08 smithi072 bash[21573]: cluster 2024-03-30T15:15:07.522578+0000 mon.a (mon.0) 2008 : cluster 0 osdmap e249: 8 total, 8 up, 8 in 2024-03-30T15:15:08.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:08 smithi072 bash[21573]: audit 2024-03-30T15:15:07.524610+0000 mon.a (mon.0) 2009 : audit 1 from='client.? 172.21.15.72:0/4244890885' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi072-64171-46"}]: dispatch 2024-03-30T15:15:08.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:08 smithi072 bash[21573]: audit 2024-03-30T15:15:07.533897+0000 mon.a (mon.0) 2010 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:15:08.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:08 smithi072 bash[21573]: audit 2024-03-30T15:15:08.065110+0000 mon.a (mon.0) 2011 : audit 1 from='client.? 172.21.15.72:0/1927332645' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsync_smithi072-64163-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi072-64163-36"}]': finished 2024-03-30T15:15:08.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:08 smithi072 bash[21573]: audit 2024-03-30T15:15:08.065335+0000 mon.a (mon.0) 2012 : audit 1 from='client.? 172.21.15.72:0/4244890885' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi072-64171-46"}]': finished 2024-03-30T15:15:08.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:08 smithi072 bash[21573]: audit 2024-03-30T15:15:08.065532+0000 mon.a (mon.0) 2013 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-29", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:15:08.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:08 smithi072 bash[21573]: cluster 2024-03-30T15:15:08.074011+0000 mon.a (mon.0) 2014 : cluster 0 osdmap e250: 8 total, 8 up, 8 in 2024-03-30T15:15:08.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:08 smithi072 bash[21573]: audit 2024-03-30T15:15:08.078997+0000 mon.a (mon.0) 2015 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-29"}]: dispatch 2024-03-30T15:15:08.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:08 smithi072 bash[21573]: audit 2024-03-30T15:15:08.126322+0000 mon.c (mon.2) 336 : audit 1 from='client.? 172.21.15.72:0/1029619303' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi072-64171-47"}]: dispatch 2024-03-30T15:15:08.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:08 smithi072 bash[21573]: audit 2024-03-30T15:15:08.126712+0000 mon.a (mon.0) 2016 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi072-64171-47"}]: dispatch 2024-03-30T15:15:08.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:08 smithi072 bash[21573]: audit 2024-03-30T15:15:08.127466+0000 mon.c (mon.2) 337 : audit 1 from='client.? 172.21.15.72:0/1029619303' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi072-64171-47"}]: dispatch 2024-03-30T15:15:08.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:08 smithi072 bash[21573]: audit 2024-03-30T15:15:08.127811+0000 mon.a (mon.0) 2017 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi072-64171-47"}]: dispatch 2024-03-30T15:15:08.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:08 smithi072 bash[21573]: audit 2024-03-30T15:15:08.128322+0000 mon.c (mon.2) 338 : audit 1 from='client.? 172.21.15.72:0/1029619303' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi072-64171-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:08.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:08 smithi072 bash[21573]: audit 2024-03-30T15:15:08.128615+0000 mon.a (mon.0) 2018 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi072-64171-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:08.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:08 smithi072 bash[28946]: cluster 2024-03-30T15:15:07.522578+0000 mon.a (mon.0) 2008 : cluster 0 osdmap e249: 8 total, 8 up, 8 in 2024-03-30T15:15:08.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:08 smithi072 bash[28946]: audit 2024-03-30T15:15:07.524610+0000 mon.a (mon.0) 2009 : audit 1 from='client.? 172.21.15.72:0/4244890885' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi072-64171-46"}]: dispatch 2024-03-30T15:15:08.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:08 smithi072 bash[28946]: audit 2024-03-30T15:15:07.533897+0000 mon.a (mon.0) 2010 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:15:08.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:08 smithi072 bash[28946]: audit 2024-03-30T15:15:08.065110+0000 mon.a (mon.0) 2011 : audit 1 from='client.? 172.21.15.72:0/1927332645' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsync_smithi072-64163-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi072-64163-36"}]': finished 2024-03-30T15:15:08.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:08 smithi072 bash[28946]: audit 2024-03-30T15:15:08.065335+0000 mon.a (mon.0) 2012 : audit 1 from='client.? 172.21.15.72:0/4244890885' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi072-64171-46"}]': finished 2024-03-30T15:15:08.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:08 smithi072 bash[28946]: audit 2024-03-30T15:15:08.065532+0000 mon.a (mon.0) 2013 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-29", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:15:08.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:08 smithi072 bash[28946]: cluster 2024-03-30T15:15:08.074011+0000 mon.a (mon.0) 2014 : cluster 0 osdmap e250: 8 total, 8 up, 8 in 2024-03-30T15:15:08.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:08 smithi072 bash[28946]: audit 2024-03-30T15:15:08.078997+0000 mon.a (mon.0) 2015 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-29"}]: dispatch 2024-03-30T15:15:08.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:08 smithi072 bash[28946]: audit 2024-03-30T15:15:08.126322+0000 mon.c (mon.2) 336 : audit 1 from='client.? 172.21.15.72:0/1029619303' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi072-64171-47"}]: dispatch 2024-03-30T15:15:08.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:08 smithi072 bash[28946]: audit 2024-03-30T15:15:08.126712+0000 mon.a (mon.0) 2016 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi072-64171-47"}]: dispatch 2024-03-30T15:15:08.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:08 smithi072 bash[28946]: audit 2024-03-30T15:15:08.127466+0000 mon.c (mon.2) 337 : audit 1 from='client.? 172.21.15.72:0/1029619303' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi072-64171-47"}]: dispatch 2024-03-30T15:15:08.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:08 smithi072 bash[28946]: audit 2024-03-30T15:15:08.127811+0000 mon.a (mon.0) 2017 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi072-64171-47"}]: dispatch 2024-03-30T15:15:08.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:08 smithi072 bash[28946]: audit 2024-03-30T15:15:08.128322+0000 mon.c (mon.2) 338 : audit 1 from='client.? 172.21.15.72:0/1029619303' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi072-64171-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:08.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:08 smithi072 bash[28946]: audit 2024-03-30T15:15:08.128615+0000 mon.a (mon.0) 2018 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi072-64171-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:08.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:08 smithi172 bash[23680]: cluster 2024-03-30T15:15:07.522578+0000 mon.a (mon.0) 2008 : cluster 0 osdmap e249: 8 total, 8 up, 8 in 2024-03-30T15:15:08.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:08 smithi172 bash[23680]: audit 2024-03-30T15:15:07.524610+0000 mon.a (mon.0) 2009 : audit 1 from='client.? 172.21.15.72:0/4244890885' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi072-64171-46"}]: dispatch 2024-03-30T15:15:08.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:08 smithi172 bash[23680]: audit 2024-03-30T15:15:07.533897+0000 mon.a (mon.0) 2010 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:15:08.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:08 smithi172 bash[23680]: audit 2024-03-30T15:15:08.065110+0000 mon.a (mon.0) 2011 : audit 1 from='client.? 172.21.15.72:0/1927332645' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsync_smithi072-64163-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi072-64163-36"}]': finished 2024-03-30T15:15:08.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:08 smithi172 bash[23680]: audit 2024-03-30T15:15:08.065335+0000 mon.a (mon.0) 2012 : audit 1 from='client.? 172.21.15.72:0/4244890885' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi072-64171-46"}]': finished 2024-03-30T15:15:08.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:08 smithi172 bash[23680]: audit 2024-03-30T15:15:08.065532+0000 mon.a (mon.0) 2013 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-29", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:15:08.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:08 smithi172 bash[23680]: cluster 2024-03-30T15:15:08.074011+0000 mon.a (mon.0) 2014 : cluster 0 osdmap e250: 8 total, 8 up, 8 in 2024-03-30T15:15:08.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:08 smithi172 bash[23680]: audit 2024-03-30T15:15:08.078997+0000 mon.a (mon.0) 2015 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-29"}]: dispatch 2024-03-30T15:15:08.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:08 smithi172 bash[23680]: audit 2024-03-30T15:15:08.126322+0000 mon.c (mon.2) 336 : audit 1 from='client.? 172.21.15.72:0/1029619303' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi072-64171-47"}]: dispatch 2024-03-30T15:15:08.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:08 smithi172 bash[23680]: audit 2024-03-30T15:15:08.126712+0000 mon.a (mon.0) 2016 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi072-64171-47"}]: dispatch 2024-03-30T15:15:08.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:08 smithi172 bash[23680]: audit 2024-03-30T15:15:08.127466+0000 mon.c (mon.2) 337 : audit 1 from='client.? 172.21.15.72:0/1029619303' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi072-64171-47"}]: dispatch 2024-03-30T15:15:08.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:08 smithi172 bash[23680]: audit 2024-03-30T15:15:08.127811+0000 mon.a (mon.0) 2017 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi072-64171-47"}]: dispatch 2024-03-30T15:15:08.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:08 smithi172 bash[23680]: audit 2024-03-30T15:15:08.128322+0000 mon.c (mon.2) 338 : audit 1 from='client.? 172.21.15.72:0/1029619303' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi072-64171-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:08.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:08 smithi172 bash[23680]: audit 2024-03-30T15:15:08.128615+0000 mon.a (mon.0) 2018 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi072-64171-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:09.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:09 smithi072 bash[28946]: cluster 2024-03-30T15:15:07.973859+0000 mgr.y (mgr.14526) 308 : cluster 0 pgmap v378: 228 pgs: 228 active+clean; 4.6 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 KiB/s wr, 1 op/s 2024-03-30T15:15:09.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:09 smithi072 bash[28946]: audit 2024-03-30T15:15:09.069486+0000 mon.a (mon.0) 2019 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-29"}]': finished 2024-03-30T15:15:09.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:09 smithi072 bash[28946]: audit 2024-03-30T15:15:09.069704+0000 mon.a (mon.0) 2020 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi072-64171-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:15:09.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:09 smithi072 bash[28946]: cluster 2024-03-30T15:15:09.078158+0000 mon.a (mon.0) 2021 : cluster 0 osdmap e251: 8 total, 8 up, 8 in 2024-03-30T15:15:09.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:09 smithi072 bash[28946]: audit 2024-03-30T15:15:09.080343+0000 mon.a (mon.0) 2022 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-29", "mode": "writeback"}]: dispatch 2024-03-30T15:15:09.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:09 smithi072 bash[28946]: audit 2024-03-30T15:15:09.081595+0000 mon.c (mon.2) 339 : audit 1 from='client.? 172.21.15.72:0/1029619303' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi072-64171-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi072-64171-47"}]: dispatch 2024-03-30T15:15:09.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:09 smithi072 bash[28946]: audit 2024-03-30T15:15:09.082541+0000 mon.a (mon.0) 2023 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi072-64171-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi072-64171-47"}]: dispatch 2024-03-30T15:15:09.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:09 smithi072 bash[28946]: audit 2024-03-30T15:15:09.443311+0000 mon.c (mon.2) 340 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:15:09.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:09 smithi072 bash[21573]: cluster 2024-03-30T15:15:07.973859+0000 mgr.y (mgr.14526) 308 : cluster 0 pgmap v378: 228 pgs: 228 active+clean; 4.6 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 KiB/s wr, 1 op/s 2024-03-30T15:15:09.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:09 smithi072 bash[21573]: audit 2024-03-30T15:15:09.069486+0000 mon.a (mon.0) 2019 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-29"}]': finished 2024-03-30T15:15:09.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:09 smithi072 bash[21573]: audit 2024-03-30T15:15:09.069704+0000 mon.a (mon.0) 2020 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi072-64171-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:15:09.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:09 smithi072 bash[21573]: cluster 2024-03-30T15:15:09.078158+0000 mon.a (mon.0) 2021 : cluster 0 osdmap e251: 8 total, 8 up, 8 in 2024-03-30T15:15:09.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:09 smithi072 bash[21573]: audit 2024-03-30T15:15:09.080343+0000 mon.a (mon.0) 2022 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-29", "mode": "writeback"}]: dispatch 2024-03-30T15:15:09.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:09 smithi072 bash[21573]: audit 2024-03-30T15:15:09.081595+0000 mon.c (mon.2) 339 : audit 1 from='client.? 172.21.15.72:0/1029619303' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi072-64171-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi072-64171-47"}]: dispatch 2024-03-30T15:15:09.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:09 smithi072 bash[21573]: audit 2024-03-30T15:15:09.082541+0000 mon.a (mon.0) 2023 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi072-64171-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi072-64171-47"}]: dispatch 2024-03-30T15:15:09.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:09 smithi072 bash[21573]: audit 2024-03-30T15:15:09.443311+0000 mon.c (mon.2) 340 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:15:09.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:09 smithi172 bash[23680]: cluster 2024-03-30T15:15:07.973859+0000 mgr.y (mgr.14526) 308 : cluster 0 pgmap v378: 228 pgs: 228 active+clean; 4.6 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 KiB/s wr, 1 op/s 2024-03-30T15:15:09.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:09 smithi172 bash[23680]: audit 2024-03-30T15:15:09.069486+0000 mon.a (mon.0) 2019 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-29"}]': finished 2024-03-30T15:15:09.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:09 smithi172 bash[23680]: audit 2024-03-30T15:15:09.069704+0000 mon.a (mon.0) 2020 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi072-64171-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:15:09.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:09 smithi172 bash[23680]: cluster 2024-03-30T15:15:09.078158+0000 mon.a (mon.0) 2021 : cluster 0 osdmap e251: 8 total, 8 up, 8 in 2024-03-30T15:15:09.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:09 smithi172 bash[23680]: audit 2024-03-30T15:15:09.080343+0000 mon.a (mon.0) 2022 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-29", "mode": "writeback"}]: dispatch 2024-03-30T15:15:09.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:09 smithi172 bash[23680]: audit 2024-03-30T15:15:09.081595+0000 mon.c (mon.2) 339 : audit 1 from='client.? 172.21.15.72:0/1029619303' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi072-64171-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi072-64171-47"}]: dispatch 2024-03-30T15:15:09.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:09 smithi172 bash[23680]: audit 2024-03-30T15:15:09.082541+0000 mon.a (mon.0) 2023 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi072-64171-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi072-64171-47"}]: dispatch 2024-03-30T15:15:09.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:09 smithi172 bash[23680]: audit 2024-03-30T15:15:09.443311+0000 mon.c (mon.2) 340 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:15:10.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:10 smithi072 bash[21573]: cluster 2024-03-30T15:15:10.070313+0000 mon.a (mon.0) 2024 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:15:10.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:10 smithi072 bash[21573]: audit 2024-03-30T15:15:10.072384+0000 mon.a (mon.0) 2025 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-29", "mode": "writeback"}]': finished 2024-03-30T15:15:10.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:10 smithi072 bash[21573]: audit 2024-03-30T15:15:10.178520+0000 mon.c (mon.2) 341 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:15:10.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:10 smithi072 bash[21573]: audit 2024-03-30T15:15:10.180127+0000 mon.c (mon.2) 342 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:15:10.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:10 smithi072 bash[21573]: cluster 2024-03-30T15:15:10.523109+0000 mon.a (mon.0) 2026 : cluster 0 osdmap e252: 8 total, 8 up, 8 in 2024-03-30T15:15:10.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:10 smithi072 bash[21573]: audit 2024-03-30T15:15:10.525794+0000 mon.a (mon.0) 2027 : audit 1 from='client.? 172.21.15.72:0/1927332645' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi072-64163-36"}]: dispatch 2024-03-30T15:15:10.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:10 smithi072 bash[21573]: audit 2024-03-30T15:15:10.534824+0000 mon.a (mon.0) 2028 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:15:10.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:10 smithi072 bash[28946]: cluster 2024-03-30T15:15:10.070313+0000 mon.a (mon.0) 2024 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:15:10.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:10 smithi072 bash[28946]: audit 2024-03-30T15:15:10.072384+0000 mon.a (mon.0) 2025 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-29", "mode": "writeback"}]': finished 2024-03-30T15:15:10.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:10 smithi072 bash[28946]: audit 2024-03-30T15:15:10.178520+0000 mon.c (mon.2) 341 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:15:10.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:10 smithi072 bash[28946]: audit 2024-03-30T15:15:10.180127+0000 mon.c (mon.2) 342 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:15:10.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:10 smithi072 bash[28946]: cluster 2024-03-30T15:15:10.523109+0000 mon.a (mon.0) 2026 : cluster 0 osdmap e252: 8 total, 8 up, 8 in 2024-03-30T15:15:10.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:10 smithi072 bash[28946]: audit 2024-03-30T15:15:10.525794+0000 mon.a (mon.0) 2027 : audit 1 from='client.? 172.21.15.72:0/1927332645' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi072-64163-36"}]: dispatch 2024-03-30T15:15:10.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:10 smithi072 bash[28946]: audit 2024-03-30T15:15:10.534824+0000 mon.a (mon.0) 2028 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:15:10.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:10 smithi172 bash[23680]: cluster 2024-03-30T15:15:10.070313+0000 mon.a (mon.0) 2024 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:15:10.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:10 smithi172 bash[23680]: audit 2024-03-30T15:15:10.072384+0000 mon.a (mon.0) 2025 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-29", "mode": "writeback"}]': finished 2024-03-30T15:15:10.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:10 smithi172 bash[23680]: audit 2024-03-30T15:15:10.178520+0000 mon.c (mon.2) 341 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:15:10.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:10 smithi172 bash[23680]: audit 2024-03-30T15:15:10.180127+0000 mon.c (mon.2) 342 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:15:10.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:10 smithi172 bash[23680]: cluster 2024-03-30T15:15:10.523109+0000 mon.a (mon.0) 2026 : cluster 0 osdmap e252: 8 total, 8 up, 8 in 2024-03-30T15:15:10.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:10 smithi172 bash[23680]: audit 2024-03-30T15:15:10.525794+0000 mon.a (mon.0) 2027 : audit 1 from='client.? 172.21.15.72:0/1927332645' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi072-64163-36"}]: dispatch 2024-03-30T15:15:10.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:10 smithi172 bash[23680]: audit 2024-03-30T15:15:10.534824+0000 mon.a (mon.0) 2028 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:15:11.417 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:15:11 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:15:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:15:11.464 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:15:11 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:15:11.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:11 smithi072 bash[21573]: cluster 2024-03-30T15:15:09.974683+0000 mgr.y (mgr.14526) 309 : cluster 0 pgmap v381: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 620 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:15:11.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:11 smithi072 bash[21573]: cluster 2024-03-30T15:15:11.053509+0000 mon.a (mon.0) 2029 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:15:11.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:11 smithi072 bash[21573]: audit 2024-03-30T15:15:11.077043+0000 mon.a (mon.0) 2030 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi072-64171-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi072-64171-47"}]': finished 2024-03-30T15:15:11.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:11 smithi072 bash[21573]: audit 2024-03-30T15:15:11.077264+0000 mon.a (mon.0) 2031 : audit 1 from='client.? 172.21.15.72:0/1927332645' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi072-64163-36"}]': finished 2024-03-30T15:15:11.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:11 smithi072 bash[21573]: cluster 2024-03-30T15:15:11.083465+0000 mon.a (mon.0) 2032 : cluster 0 osdmap e253: 8 total, 8 up, 8 in 2024-03-30T15:15:11.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:11 smithi072 bash[21573]: audit 2024-03-30T15:15:11.087325+0000 mon.a (mon.0) 2033 : audit 1 from='client.? 172.21.15.72:0/1927332645' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi072-64163-36"}]: dispatch 2024-03-30T15:15:11.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:11 smithi072 bash[28946]: cluster 2024-03-30T15:15:09.974683+0000 mgr.y (mgr.14526) 309 : cluster 0 pgmap v381: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 620 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:15:11.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:11 smithi072 bash[28946]: cluster 2024-03-30T15:15:11.053509+0000 mon.a (mon.0) 2029 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:15:11.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:11 smithi072 bash[28946]: audit 2024-03-30T15:15:11.077043+0000 mon.a (mon.0) 2030 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi072-64171-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi072-64171-47"}]': finished 2024-03-30T15:15:11.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:11 smithi072 bash[28946]: audit 2024-03-30T15:15:11.077264+0000 mon.a (mon.0) 2031 : audit 1 from='client.? 172.21.15.72:0/1927332645' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi072-64163-36"}]': finished 2024-03-30T15:15:11.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:11 smithi072 bash[28946]: cluster 2024-03-30T15:15:11.083465+0000 mon.a (mon.0) 2032 : cluster 0 osdmap e253: 8 total, 8 up, 8 in 2024-03-30T15:15:11.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:11 smithi072 bash[28946]: audit 2024-03-30T15:15:11.087325+0000 mon.a (mon.0) 2033 : audit 1 from='client.? 172.21.15.72:0/1927332645' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi072-64163-36"}]: dispatch 2024-03-30T15:15:11.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:11 smithi172 bash[23680]: cluster 2024-03-30T15:15:09.974683+0000 mgr.y (mgr.14526) 309 : cluster 0 pgmap v381: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 620 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:15:11.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:11 smithi172 bash[23680]: cluster 2024-03-30T15:15:11.053509+0000 mon.a (mon.0) 2029 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:15:11.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:11 smithi172 bash[23680]: audit 2024-03-30T15:15:11.077043+0000 mon.a (mon.0) 2030 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi072-64171-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi072-64171-47"}]': finished 2024-03-30T15:15:11.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:11 smithi172 bash[23680]: audit 2024-03-30T15:15:11.077264+0000 mon.a (mon.0) 2031 : audit 1 from='client.? 172.21.15.72:0/1927332645' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi072-64163-36"}]': finished 2024-03-30T15:15:11.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:11 smithi172 bash[23680]: cluster 2024-03-30T15:15:11.083465+0000 mon.a (mon.0) 2032 : cluster 0 osdmap e253: 8 total, 8 up, 8 in 2024-03-30T15:15:11.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:11 smithi172 bash[23680]: audit 2024-03-30T15:15:11.087325+0000 mon.a (mon.0) 2033 : audit 1 from='client.? 172.21.15.72:0/1927332645' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi072-64163-36"}]: dispatch 2024-03-30T15:15:12.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:12 smithi072 bash[21573]: audit 2024-03-30T15:15:11.123925+0000 mgr.y (mgr.14526) 310 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:15:12.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:12 smithi072 bash[21573]: audit 2024-03-30T15:15:12.080665+0000 mon.a (mon.0) 2034 : audit 1 from='client.? 172.21.15.72:0/1927332645' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi072-64163-36"}]': finished 2024-03-30T15:15:12.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:12 smithi072 bash[21573]: cluster 2024-03-30T15:15:12.088225+0000 mon.a (mon.0) 2035 : cluster 0 osdmap e254: 8 total, 8 up, 8 in 2024-03-30T15:15:12.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:12 smithi072 bash[21573]: audit 2024-03-30T15:15:12.141822+0000 mon.a (mon.0) 2036 : audit 1 from='client.? 172.21.15.72:0/899819469' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi072-64163-37"}]: dispatch 2024-03-30T15:15:12.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:12 smithi072 bash[21573]: audit 2024-03-30T15:15:12.143002+0000 mon.a (mon.0) 2037 : audit 1 from='client.? 172.21.15.72:0/899819469' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi072-64163-37"}]: dispatch 2024-03-30T15:15:12.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:12 smithi072 bash[21573]: audit 2024-03-30T15:15:12.143426+0000 mon.a (mon.0) 2038 : audit 1 from='client.? 172.21.15.72:0/899819469' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi072-64163-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:12.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:12 smithi072 bash[28946]: audit 2024-03-30T15:15:11.123925+0000 mgr.y (mgr.14526) 310 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:15:12.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:12 smithi072 bash[28946]: audit 2024-03-30T15:15:12.080665+0000 mon.a (mon.0) 2034 : audit 1 from='client.? 172.21.15.72:0/1927332645' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi072-64163-36"}]': finished 2024-03-30T15:15:12.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:12 smithi072 bash[28946]: cluster 2024-03-30T15:15:12.088225+0000 mon.a (mon.0) 2035 : cluster 0 osdmap e254: 8 total, 8 up, 8 in 2024-03-30T15:15:12.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:12 smithi072 bash[28946]: audit 2024-03-30T15:15:12.141822+0000 mon.a (mon.0) 2036 : audit 1 from='client.? 172.21.15.72:0/899819469' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi072-64163-37"}]: dispatch 2024-03-30T15:15:12.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:12 smithi072 bash[28946]: audit 2024-03-30T15:15:12.143002+0000 mon.a (mon.0) 2037 : audit 1 from='client.? 172.21.15.72:0/899819469' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi072-64163-37"}]: dispatch 2024-03-30T15:15:12.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:12 smithi072 bash[28946]: audit 2024-03-30T15:15:12.143426+0000 mon.a (mon.0) 2038 : audit 1 from='client.? 172.21.15.72:0/899819469' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi072-64163-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:12.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:12 smithi172 bash[23680]: audit 2024-03-30T15:15:11.123925+0000 mgr.y (mgr.14526) 310 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:15:12.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:12 smithi172 bash[23680]: audit 2024-03-30T15:15:12.080665+0000 mon.a (mon.0) 2034 : audit 1 from='client.? 172.21.15.72:0/1927332645' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi072-64163-36"}]': finished 2024-03-30T15:15:12.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:12 smithi172 bash[23680]: cluster 2024-03-30T15:15:12.088225+0000 mon.a (mon.0) 2035 : cluster 0 osdmap e254: 8 total, 8 up, 8 in 2024-03-30T15:15:12.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:12 smithi172 bash[23680]: audit 2024-03-30T15:15:12.141822+0000 mon.a (mon.0) 2036 : audit 1 from='client.? 172.21.15.72:0/899819469' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi072-64163-37"}]: dispatch 2024-03-30T15:15:12.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:12 smithi172 bash[23680]: audit 2024-03-30T15:15:12.143002+0000 mon.a (mon.0) 2037 : audit 1 from='client.? 172.21.15.72:0/899819469' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi072-64163-37"}]: dispatch 2024-03-30T15:15:12.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:12 smithi172 bash[23680]: audit 2024-03-30T15:15:12.143426+0000 mon.a (mon.0) 2038 : audit 1 from='client.? 172.21.15.72:0/899819469' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi072-64163-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:13.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:13 smithi072 bash[21573]: cluster 2024-03-30T15:15:11.975630+0000 mgr.y (mgr.14526) 311 : cluster 0 pgmap v384: 236 pgs: 8 unknown, 228 active+clean; 8.6 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-30T15:15:13.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:13 smithi072 bash[21573]: audit 2024-03-30T15:15:13.083599+0000 mon.a (mon.0) 2039 : audit 1 from='client.? 172.21.15.72:0/899819469' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi072-64163-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:15:13.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:13 smithi072 bash[21573]: cluster 2024-03-30T15:15:13.091838+0000 mon.a (mon.0) 2040 : cluster 0 osdmap e255: 8 total, 8 up, 8 in 2024-03-30T15:15:13.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:13 smithi072 bash[21573]: audit 2024-03-30T15:15:13.093585+0000 mon.a (mon.0) 2041 : audit 1 from='client.? 172.21.15.72:0/899819469' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi072-64163-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi072-64163-37"}]: dispatch 2024-03-30T15:15:13.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:13 smithi072 bash[21573]: audit 2024-03-30T15:15:13.099323+0000 mon.c (mon.2) 343 : audit 1 from='client.? 172.21.15.72:0/1029619303' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi072-64171-47"}]: dispatch 2024-03-30T15:15:13.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:13 smithi072 bash[21573]: audit 2024-03-30T15:15:13.100481+0000 mon.a (mon.0) 2042 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi072-64171-47"}]: dispatch 2024-03-30T15:15:13.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:13 smithi072 bash[21573]: audit 2024-03-30T15:15:13.200463+0000 mon.a (mon.0) 2043 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:15:13.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:13 smithi072 bash[28946]: cluster 2024-03-30T15:15:11.975630+0000 mgr.y (mgr.14526) 311 : cluster 0 pgmap v384: 236 pgs: 8 unknown, 228 active+clean; 8.6 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-30T15:15:13.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:13 smithi072 bash[28946]: audit 2024-03-30T15:15:13.083599+0000 mon.a (mon.0) 2039 : audit 1 from='client.? 172.21.15.72:0/899819469' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi072-64163-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:15:13.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:13 smithi072 bash[28946]: cluster 2024-03-30T15:15:13.091838+0000 mon.a (mon.0) 2040 : cluster 0 osdmap e255: 8 total, 8 up, 8 in 2024-03-30T15:15:13.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:13 smithi072 bash[28946]: audit 2024-03-30T15:15:13.093585+0000 mon.a (mon.0) 2041 : audit 1 from='client.? 172.21.15.72:0/899819469' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi072-64163-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi072-64163-37"}]: dispatch 2024-03-30T15:15:13.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:13 smithi072 bash[28946]: audit 2024-03-30T15:15:13.099323+0000 mon.c (mon.2) 343 : audit 1 from='client.? 172.21.15.72:0/1029619303' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi072-64171-47"}]: dispatch 2024-03-30T15:15:13.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:13 smithi072 bash[28946]: audit 2024-03-30T15:15:13.100481+0000 mon.a (mon.0) 2042 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi072-64171-47"}]: dispatch 2024-03-30T15:15:13.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:13 smithi072 bash[28946]: audit 2024-03-30T15:15:13.200463+0000 mon.a (mon.0) 2043 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:15:13.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:13 smithi172 bash[23680]: cluster 2024-03-30T15:15:11.975630+0000 mgr.y (mgr.14526) 311 : cluster 0 pgmap v384: 236 pgs: 8 unknown, 228 active+clean; 8.6 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-30T15:15:13.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:13 smithi172 bash[23680]: audit 2024-03-30T15:15:13.083599+0000 mon.a (mon.0) 2039 : audit 1 from='client.? 172.21.15.72:0/899819469' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi072-64163-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:15:13.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:13 smithi172 bash[23680]: cluster 2024-03-30T15:15:13.091838+0000 mon.a (mon.0) 2040 : cluster 0 osdmap e255: 8 total, 8 up, 8 in 2024-03-30T15:15:13.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:13 smithi172 bash[23680]: audit 2024-03-30T15:15:13.093585+0000 mon.a (mon.0) 2041 : audit 1 from='client.? 172.21.15.72:0/899819469' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi072-64163-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi072-64163-37"}]: dispatch 2024-03-30T15:15:13.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:13 smithi172 bash[23680]: audit 2024-03-30T15:15:13.099323+0000 mon.c (mon.2) 343 : audit 1 from='client.? 172.21.15.72:0/1029619303' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi072-64171-47"}]: dispatch 2024-03-30T15:15:13.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:13 smithi172 bash[23680]: audit 2024-03-30T15:15:13.100481+0000 mon.a (mon.0) 2042 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi072-64171-47"}]: dispatch 2024-03-30T15:15:13.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:13 smithi172 bash[23680]: audit 2024-03-30T15:15:13.200463+0000 mon.a (mon.0) 2043 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:15:15.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:15 smithi072 bash[21573]: cluster 2024-03-30T15:15:13.976497+0000 mgr.y (mgr.14526) 312 : cluster 0 pgmap v387: 228 pgs: 228 active+clean; 8.6 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-30T15:15:15.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:15 smithi072 bash[21573]: audit 2024-03-30T15:15:14.088565+0000 mon.a (mon.0) 2044 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi072-64171-47"}]': finished 2024-03-30T15:15:15.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:15 smithi072 bash[21573]: audit 2024-03-30T15:15:14.088767+0000 mon.a (mon.0) 2045 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:15:15.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:15 smithi072 bash[21573]: audit 2024-03-30T15:15:14.098084+0000 mon.c (mon.2) 344 : audit 1 from='client.? 172.21.15.72:0/1029619303' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi072-64171-47"}]: dispatch 2024-03-30T15:15:15.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:15 smithi072 bash[21573]: cluster 2024-03-30T15:15:14.551365+0000 mon.a (mon.0) 2046 : cluster 0 osdmap e256: 8 total, 8 up, 8 in 2024-03-30T15:15:15.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:15 smithi072 bash[21573]: audit 2024-03-30T15:15:14.552283+0000 mon.a (mon.0) 2047 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-29"}]: dispatch 2024-03-30T15:15:15.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:15 smithi072 bash[21573]: audit 2024-03-30T15:15:14.552668+0000 mon.a (mon.0) 2048 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi072-64171-47"}]: dispatch 2024-03-30T15:15:15.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:15 smithi072 bash[28946]: cluster 2024-03-30T15:15:13.976497+0000 mgr.y (mgr.14526) 312 : cluster 0 pgmap v387: 228 pgs: 228 active+clean; 8.6 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-30T15:15:15.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:15 smithi072 bash[28946]: audit 2024-03-30T15:15:14.088565+0000 mon.a (mon.0) 2044 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi072-64171-47"}]': finished 2024-03-30T15:15:15.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:15 smithi072 bash[28946]: audit 2024-03-30T15:15:14.088767+0000 mon.a (mon.0) 2045 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:15:15.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:15 smithi072 bash[28946]: audit 2024-03-30T15:15:14.098084+0000 mon.c (mon.2) 344 : audit 1 from='client.? 172.21.15.72:0/1029619303' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi072-64171-47"}]: dispatch 2024-03-30T15:15:15.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:15 smithi072 bash[28946]: cluster 2024-03-30T15:15:14.551365+0000 mon.a (mon.0) 2046 : cluster 0 osdmap e256: 8 total, 8 up, 8 in 2024-03-30T15:15:15.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:15 smithi072 bash[28946]: audit 2024-03-30T15:15:14.552283+0000 mon.a (mon.0) 2047 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-29"}]: dispatch 2024-03-30T15:15:15.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:15 smithi072 bash[28946]: audit 2024-03-30T15:15:14.552668+0000 mon.a (mon.0) 2048 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi072-64171-47"}]: dispatch 2024-03-30T15:15:15.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:15 smithi172 bash[23680]: cluster 2024-03-30T15:15:13.976497+0000 mgr.y (mgr.14526) 312 : cluster 0 pgmap v387: 228 pgs: 228 active+clean; 8.6 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-30T15:15:15.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:15 smithi172 bash[23680]: audit 2024-03-30T15:15:14.088565+0000 mon.a (mon.0) 2044 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi072-64171-47"}]': finished 2024-03-30T15:15:15.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:15 smithi172 bash[23680]: audit 2024-03-30T15:15:14.088767+0000 mon.a (mon.0) 2045 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:15:15.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:15 smithi172 bash[23680]: audit 2024-03-30T15:15:14.098084+0000 mon.c (mon.2) 344 : audit 1 from='client.? 172.21.15.72:0/1029619303' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi072-64171-47"}]: dispatch 2024-03-30T15:15:15.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:15 smithi172 bash[23680]: cluster 2024-03-30T15:15:14.551365+0000 mon.a (mon.0) 2046 : cluster 0 osdmap e256: 8 total, 8 up, 8 in 2024-03-30T15:15:15.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:15 smithi172 bash[23680]: audit 2024-03-30T15:15:14.552283+0000 mon.a (mon.0) 2047 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-29"}]: dispatch 2024-03-30T15:15:15.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:15 smithi172 bash[23680]: audit 2024-03-30T15:15:14.552668+0000 mon.a (mon.0) 2048 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi072-64171-47"}]: dispatch 2024-03-30T15:15:16.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:16 smithi072 bash[21573]: cluster 2024-03-30T15:15:15.089980+0000 mon.a (mon.0) 2049 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:15:16.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:16 smithi072 bash[21573]: audit 2024-03-30T15:15:15.092558+0000 mon.a (mon.0) 2050 : audit 1 from='client.? 172.21.15.72:0/899819469' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi072-64163-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi072-64163-37"}]': finished 2024-03-30T15:15:16.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:16 smithi072 bash[21573]: audit 2024-03-30T15:15:15.092786+0000 mon.a (mon.0) 2051 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-29"}]': finished 2024-03-30T15:15:16.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:16 smithi072 bash[21573]: audit 2024-03-30T15:15:15.092974+0000 mon.a (mon.0) 2052 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi072-64171-47"}]': finished 2024-03-30T15:15:16.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:16 smithi072 bash[21573]: cluster 2024-03-30T15:15:15.101028+0000 mon.a (mon.0) 2053 : cluster 0 osdmap e257: 8 total, 8 up, 8 in 2024-03-30T15:15:16.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:16 smithi072 bash[21573]: audit 2024-03-30T15:15:15.148184+0000 mon.c (mon.2) 345 : audit 1 from='client.? 172.21.15.72:0/2481842461' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi072-64171-48"}]: dispatch 2024-03-30T15:15:16.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:16 smithi072 bash[21573]: audit 2024-03-30T15:15:15.148691+0000 mon.a (mon.0) 2054 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi072-64171-48"}]: dispatch 2024-03-30T15:15:16.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:16 smithi072 bash[21573]: audit 2024-03-30T15:15:15.149602+0000 mon.c (mon.2) 346 : audit 1 from='client.? 172.21.15.72:0/2481842461' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi072-64171-48"}]: dispatch 2024-03-30T15:15:16.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:16 smithi072 bash[21573]: audit 2024-03-30T15:15:15.150032+0000 mon.a (mon.0) 2055 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi072-64171-48"}]: dispatch 2024-03-30T15:15:16.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:16 smithi072 bash[21573]: audit 2024-03-30T15:15:15.150744+0000 mon.c (mon.2) 347 : audit 1 from='client.? 172.21.15.72:0/2481842461' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi072-64171-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:16.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:16 smithi072 bash[21573]: audit 2024-03-30T15:15:15.151179+0000 mon.a (mon.0) 2056 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi072-64171-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:16.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:16 smithi072 bash[21573]: cluster 2024-03-30T15:15:16.055058+0000 mon.a (mon.0) 2057 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:15:16.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:16 smithi072 bash[21573]: audit 2024-03-30T15:15:16.095589+0000 mon.a (mon.0) 2058 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi072-64171-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:15:16.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:16 smithi072 bash[21573]: cluster 2024-03-30T15:15:16.104810+0000 mon.a (mon.0) 2059 : cluster 0 osdmap e258: 8 total, 8 up, 8 in 2024-03-30T15:15:16.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:16 smithi072 bash[21573]: audit 2024-03-30T15:15:16.107203+0000 mon.c (mon.2) 348 : audit 1 from='client.? 172.21.15.72:0/2481842461' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi072-64171-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi072-64171-48"}]: dispatch 2024-03-30T15:15:16.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:16 smithi072 bash[28946]: cluster 2024-03-30T15:15:15.089980+0000 mon.a (mon.0) 2049 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:15:16.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:16 smithi072 bash[28946]: audit 2024-03-30T15:15:15.092558+0000 mon.a (mon.0) 2050 : audit 1 from='client.? 172.21.15.72:0/899819469' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi072-64163-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi072-64163-37"}]': finished 2024-03-30T15:15:16.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:16 smithi072 bash[28946]: audit 2024-03-30T15:15:15.092786+0000 mon.a (mon.0) 2051 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-29"}]': finished 2024-03-30T15:15:16.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:16 smithi072 bash[28946]: audit 2024-03-30T15:15:15.092974+0000 mon.a (mon.0) 2052 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi072-64171-47"}]': finished 2024-03-30T15:15:16.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:16 smithi072 bash[28946]: cluster 2024-03-30T15:15:15.101028+0000 mon.a (mon.0) 2053 : cluster 0 osdmap e257: 8 total, 8 up, 8 in 2024-03-30T15:15:16.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:16 smithi072 bash[28946]: audit 2024-03-30T15:15:15.148184+0000 mon.c (mon.2) 345 : audit 1 from='client.? 172.21.15.72:0/2481842461' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi072-64171-48"}]: dispatch 2024-03-30T15:15:16.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:16 smithi072 bash[28946]: audit 2024-03-30T15:15:15.148691+0000 mon.a (mon.0) 2054 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi072-64171-48"}]: dispatch 2024-03-30T15:15:16.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:16 smithi072 bash[28946]: audit 2024-03-30T15:15:15.149602+0000 mon.c (mon.2) 346 : audit 1 from='client.? 172.21.15.72:0/2481842461' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi072-64171-48"}]: dispatch 2024-03-30T15:15:16.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:16 smithi072 bash[28946]: audit 2024-03-30T15:15:15.150032+0000 mon.a (mon.0) 2055 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi072-64171-48"}]: dispatch 2024-03-30T15:15:16.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:16 smithi072 bash[28946]: audit 2024-03-30T15:15:15.150744+0000 mon.c (mon.2) 347 : audit 1 from='client.? 172.21.15.72:0/2481842461' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi072-64171-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:16.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:16 smithi072 bash[28946]: audit 2024-03-30T15:15:15.151179+0000 mon.a (mon.0) 2056 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi072-64171-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:16.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:16 smithi072 bash[28946]: cluster 2024-03-30T15:15:16.055058+0000 mon.a (mon.0) 2057 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:15:16.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:16 smithi072 bash[28946]: audit 2024-03-30T15:15:16.095589+0000 mon.a (mon.0) 2058 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi072-64171-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:15:16.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:16 smithi072 bash[28946]: cluster 2024-03-30T15:15:16.104810+0000 mon.a (mon.0) 2059 : cluster 0 osdmap e258: 8 total, 8 up, 8 in 2024-03-30T15:15:16.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:16 smithi072 bash[28946]: audit 2024-03-30T15:15:16.107203+0000 mon.c (mon.2) 348 : audit 1 from='client.? 172.21.15.72:0/2481842461' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi072-64171-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi072-64171-48"}]: dispatch 2024-03-30T15:15:16.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:16 smithi172 bash[23680]: cluster 2024-03-30T15:15:15.089980+0000 mon.a (mon.0) 2049 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:15:16.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:16 smithi172 bash[23680]: audit 2024-03-30T15:15:15.092558+0000 mon.a (mon.0) 2050 : audit 1 from='client.? 172.21.15.72:0/899819469' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi072-64163-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi072-64163-37"}]': finished 2024-03-30T15:15:16.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:16 smithi172 bash[23680]: audit 2024-03-30T15:15:15.092786+0000 mon.a (mon.0) 2051 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-29"}]': finished 2024-03-30T15:15:16.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:16 smithi172 bash[23680]: audit 2024-03-30T15:15:15.092974+0000 mon.a (mon.0) 2052 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi072-64171-47"}]': finished 2024-03-30T15:15:16.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:16 smithi172 bash[23680]: cluster 2024-03-30T15:15:15.101028+0000 mon.a (mon.0) 2053 : cluster 0 osdmap e257: 8 total, 8 up, 8 in 2024-03-30T15:15:16.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:16 smithi172 bash[23680]: audit 2024-03-30T15:15:15.148184+0000 mon.c (mon.2) 345 : audit 1 from='client.? 172.21.15.72:0/2481842461' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi072-64171-48"}]: dispatch 2024-03-30T15:15:16.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:16 smithi172 bash[23680]: audit 2024-03-30T15:15:15.148691+0000 mon.a (mon.0) 2054 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi072-64171-48"}]: dispatch 2024-03-30T15:15:16.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:16 smithi172 bash[23680]: audit 2024-03-30T15:15:15.149602+0000 mon.c (mon.2) 346 : audit 1 from='client.? 172.21.15.72:0/2481842461' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi072-64171-48"}]: dispatch 2024-03-30T15:15:16.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:16 smithi172 bash[23680]: audit 2024-03-30T15:15:15.150032+0000 mon.a (mon.0) 2055 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi072-64171-48"}]: dispatch 2024-03-30T15:15:16.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:16 smithi172 bash[23680]: audit 2024-03-30T15:15:15.150744+0000 mon.c (mon.2) 347 : audit 1 from='client.? 172.21.15.72:0/2481842461' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi072-64171-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:16.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:16 smithi172 bash[23680]: audit 2024-03-30T15:15:15.151179+0000 mon.a (mon.0) 2056 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi072-64171-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:16.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:16 smithi172 bash[23680]: cluster 2024-03-30T15:15:16.055058+0000 mon.a (mon.0) 2057 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:15:16.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:16 smithi172 bash[23680]: audit 2024-03-30T15:15:16.095589+0000 mon.a (mon.0) 2058 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi072-64171-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:15:16.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:16 smithi172 bash[23680]: cluster 2024-03-30T15:15:16.104810+0000 mon.a (mon.0) 2059 : cluster 0 osdmap e258: 8 total, 8 up, 8 in 2024-03-30T15:15:16.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:16 smithi172 bash[23680]: audit 2024-03-30T15:15:16.107203+0000 mon.c (mon.2) 348 : audit 1 from='client.? 172.21.15.72:0/2481842461' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi072-64171-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi072-64171-48"}]: dispatch 2024-03-30T15:15:17.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:17 smithi072 bash[21573]: cluster 2024-03-30T15:15:15.978811+0000 mgr.y (mgr.14526) 313 : cluster 0 pgmap v390: 236 pgs: 8 creating+peering, 228 active+clean; 4.6 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 10 KiB/s rd, 1024 KiB/s wr, 20 op/s 2024-03-30T15:15:17.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:17 smithi072 bash[21573]: audit 2024-03-30T15:15:16.121098+0000 mon.a (mon.0) 2060 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi072-64171-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi072-64171-48"}]: dispatch 2024-03-30T15:15:17.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:17 smithi072 bash[21573]: cluster 2024-03-30T15:15:17.559418+0000 mon.a (mon.0) 2061 : cluster 0 osdmap e259: 8 total, 8 up, 8 in 2024-03-30T15:15:17.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:17 smithi072 bash[21573]: audit 2024-03-30T15:15:17.561814+0000 mon.a (mon.0) 2062 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:15:17.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:17 smithi072 bash[21573]: audit 2024-03-30T15:15:17.562100+0000 mon.a (mon.0) 2063 : audit 1 from='client.? 172.21.15.72:0/899819469' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi072-64163-37"}]: dispatch 2024-03-30T15:15:17.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:17 smithi072 bash[28946]: cluster 2024-03-30T15:15:15.978811+0000 mgr.y (mgr.14526) 313 : cluster 0 pgmap v390: 236 pgs: 8 creating+peering, 228 active+clean; 4.6 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 10 KiB/s rd, 1024 KiB/s wr, 20 op/s 2024-03-30T15:15:17.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:17 smithi072 bash[28946]: audit 2024-03-30T15:15:16.121098+0000 mon.a (mon.0) 2060 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi072-64171-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi072-64171-48"}]: dispatch 2024-03-30T15:15:17.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:17 smithi072 bash[28946]: cluster 2024-03-30T15:15:17.559418+0000 mon.a (mon.0) 2061 : cluster 0 osdmap e259: 8 total, 8 up, 8 in 2024-03-30T15:15:17.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:17 smithi072 bash[28946]: audit 2024-03-30T15:15:17.561814+0000 mon.a (mon.0) 2062 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:15:17.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:17 smithi072 bash[28946]: audit 2024-03-30T15:15:17.562100+0000 mon.a (mon.0) 2063 : audit 1 from='client.? 172.21.15.72:0/899819469' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi072-64163-37"}]: dispatch 2024-03-30T15:15:17.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:17 smithi172 bash[23680]: cluster 2024-03-30T15:15:15.978811+0000 mgr.y (mgr.14526) 313 : cluster 0 pgmap v390: 236 pgs: 8 creating+peering, 228 active+clean; 4.6 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 10 KiB/s rd, 1024 KiB/s wr, 20 op/s 2024-03-30T15:15:17.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:17 smithi172 bash[23680]: audit 2024-03-30T15:15:16.121098+0000 mon.a (mon.0) 2060 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi072-64171-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi072-64171-48"}]: dispatch 2024-03-30T15:15:17.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:17 smithi172 bash[23680]: cluster 2024-03-30T15:15:17.559418+0000 mon.a (mon.0) 2061 : cluster 0 osdmap e259: 8 total, 8 up, 8 in 2024-03-30T15:15:17.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:17 smithi172 bash[23680]: audit 2024-03-30T15:15:17.561814+0000 mon.a (mon.0) 2062 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:15:17.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:17 smithi172 bash[23680]: audit 2024-03-30T15:15:17.562100+0000 mon.a (mon.0) 2063 : audit 1 from='client.? 172.21.15.72:0/899819469' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi072-64163-37"}]: dispatch 2024-03-30T15:15:19.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:19 smithi072 bash[21573]: cluster 2024-03-30T15:15:17.979613+0000 mgr.y (mgr.14526) 314 : cluster 0 pgmap v393: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 621 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:15:19.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:19 smithi072 bash[21573]: audit 2024-03-30T15:15:18.103841+0000 mon.a (mon.0) 2064 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi072-64171-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi072-64171-48"}]': finished 2024-03-30T15:15:19.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:19 smithi072 bash[21573]: audit 2024-03-30T15:15:18.104091+0000 mon.a (mon.0) 2065 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:15:19.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:19 smithi072 bash[21573]: audit 2024-03-30T15:15:18.104296+0000 mon.a (mon.0) 2066 : audit 1 from='client.? 172.21.15.72:0/899819469' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi072-64163-37"}]': finished 2024-03-30T15:15:19.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:19 smithi072 bash[21573]: cluster 2024-03-30T15:15:18.113067+0000 mon.a (mon.0) 2067 : cluster 0 osdmap e260: 8 total, 8 up, 8 in 2024-03-30T15:15:19.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:19 smithi072 bash[21573]: audit 2024-03-30T15:15:18.114595+0000 mon.a (mon.0) 2068 : audit 1 from='client.? 172.21.15.72:0/899819469' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi072-64163-37"}]: dispatch 2024-03-30T15:15:19.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:19 smithi072 bash[21573]: audit 2024-03-30T15:15:18.116754+0000 mon.a (mon.0) 2069 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:15:19.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:19 smithi072 bash[28946]: cluster 2024-03-30T15:15:17.979613+0000 mgr.y (mgr.14526) 314 : cluster 0 pgmap v393: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 621 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:15:19.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:19 smithi072 bash[28946]: audit 2024-03-30T15:15:18.103841+0000 mon.a (mon.0) 2064 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi072-64171-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi072-64171-48"}]': finished 2024-03-30T15:15:19.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:19 smithi072 bash[28946]: audit 2024-03-30T15:15:18.104091+0000 mon.a (mon.0) 2065 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:15:19.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:19 smithi072 bash[28946]: audit 2024-03-30T15:15:18.104296+0000 mon.a (mon.0) 2066 : audit 1 from='client.? 172.21.15.72:0/899819469' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi072-64163-37"}]': finished 2024-03-30T15:15:19.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:19 smithi072 bash[28946]: cluster 2024-03-30T15:15:18.113067+0000 mon.a (mon.0) 2067 : cluster 0 osdmap e260: 8 total, 8 up, 8 in 2024-03-30T15:15:19.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:19 smithi072 bash[28946]: audit 2024-03-30T15:15:18.114595+0000 mon.a (mon.0) 2068 : audit 1 from='client.? 172.21.15.72:0/899819469' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi072-64163-37"}]: dispatch 2024-03-30T15:15:19.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:19 smithi072 bash[28946]: audit 2024-03-30T15:15:18.116754+0000 mon.a (mon.0) 2069 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:15:19.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:19 smithi172 bash[23680]: cluster 2024-03-30T15:15:17.979613+0000 mgr.y (mgr.14526) 314 : cluster 0 pgmap v393: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 621 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:15:19.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:19 smithi172 bash[23680]: audit 2024-03-30T15:15:18.103841+0000 mon.a (mon.0) 2064 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi072-64171-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi072-64171-48"}]': finished 2024-03-30T15:15:19.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:19 smithi172 bash[23680]: audit 2024-03-30T15:15:18.104091+0000 mon.a (mon.0) 2065 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:15:19.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:19 smithi172 bash[23680]: audit 2024-03-30T15:15:18.104296+0000 mon.a (mon.0) 2066 : audit 1 from='client.? 172.21.15.72:0/899819469' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi072-64163-37"}]': finished 2024-03-30T15:15:19.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:19 smithi172 bash[23680]: cluster 2024-03-30T15:15:18.113067+0000 mon.a (mon.0) 2067 : cluster 0 osdmap e260: 8 total, 8 up, 8 in 2024-03-30T15:15:19.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:19 smithi172 bash[23680]: audit 2024-03-30T15:15:18.114595+0000 mon.a (mon.0) 2068 : audit 1 from='client.? 172.21.15.72:0/899819469' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi072-64163-37"}]: dispatch 2024-03-30T15:15:19.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:19 smithi172 bash[23680]: audit 2024-03-30T15:15:18.116754+0000 mon.a (mon.0) 2069 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:15:20.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:20 smithi072 bash[21573]: audit 2024-03-30T15:15:19.107370+0000 mon.a (mon.0) 2070 : audit 1 from='client.? 172.21.15.72:0/899819469' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi072-64163-37"}]': finished 2024-03-30T15:15:20.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:20 smithi072 bash[21573]: audit 2024-03-30T15:15:19.107519+0000 mon.a (mon.0) 2071 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-31", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:15:20.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:20 smithi072 bash[21573]: cluster 2024-03-30T15:15:19.115601+0000 mon.a (mon.0) 2072 : cluster 0 osdmap e261: 8 total, 8 up, 8 in 2024-03-30T15:15:20.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:20 smithi072 bash[21573]: audit 2024-03-30T15:15:19.118387+0000 mon.a (mon.0) 2073 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-31"}]: dispatch 2024-03-30T15:15:20.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:20 smithi072 bash[21573]: audit 2024-03-30T15:15:19.158761+0000 mon.c (mon.2) 349 : audit 1 from='client.? 172.21.15.72:0/2399891923' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi072-64163-38"}]: dispatch 2024-03-30T15:15:20.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:20 smithi072 bash[21573]: audit 2024-03-30T15:15:19.159139+0000 mon.a (mon.0) 2074 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi072-64163-38"}]: dispatch 2024-03-30T15:15:20.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:20 smithi072 bash[21573]: audit 2024-03-30T15:15:19.159936+0000 mon.c (mon.2) 350 : audit 1 from='client.? 172.21.15.72:0/2399891923' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi072-64163-38"}]: dispatch 2024-03-30T15:15:20.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:20 smithi072 bash[21573]: audit 2024-03-30T15:15:19.160270+0000 mon.a (mon.0) 2075 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi072-64163-38"}]: dispatch 2024-03-30T15:15:20.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:20 smithi072 bash[21573]: audit 2024-03-30T15:15:19.160806+0000 mon.c (mon.2) 351 : audit 1 from='client.? 172.21.15.72:0/2399891923' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi072-64163-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:20.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:20 smithi072 bash[21573]: audit 2024-03-30T15:15:19.161181+0000 mon.a (mon.0) 2076 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi072-64163-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:20.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:20 smithi072 bash[28946]: audit 2024-03-30T15:15:19.107370+0000 mon.a (mon.0) 2070 : audit 1 from='client.? 172.21.15.72:0/899819469' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi072-64163-37"}]': finished 2024-03-30T15:15:20.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:20 smithi072 bash[28946]: audit 2024-03-30T15:15:19.107519+0000 mon.a (mon.0) 2071 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-31", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:15:20.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:20 smithi072 bash[28946]: cluster 2024-03-30T15:15:19.115601+0000 mon.a (mon.0) 2072 : cluster 0 osdmap e261: 8 total, 8 up, 8 in 2024-03-30T15:15:20.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:20 smithi072 bash[28946]: audit 2024-03-30T15:15:19.118387+0000 mon.a (mon.0) 2073 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-31"}]: dispatch 2024-03-30T15:15:20.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:20 smithi072 bash[28946]: audit 2024-03-30T15:15:19.158761+0000 mon.c (mon.2) 349 : audit 1 from='client.? 172.21.15.72:0/2399891923' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi072-64163-38"}]: dispatch 2024-03-30T15:15:20.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:20 smithi072 bash[28946]: audit 2024-03-30T15:15:19.159139+0000 mon.a (mon.0) 2074 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi072-64163-38"}]: dispatch 2024-03-30T15:15:20.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:20 smithi072 bash[28946]: audit 2024-03-30T15:15:19.159936+0000 mon.c (mon.2) 350 : audit 1 from='client.? 172.21.15.72:0/2399891923' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi072-64163-38"}]: dispatch 2024-03-30T15:15:20.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:20 smithi072 bash[28946]: audit 2024-03-30T15:15:19.160270+0000 mon.a (mon.0) 2075 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi072-64163-38"}]: dispatch 2024-03-30T15:15:20.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:20 smithi072 bash[28946]: audit 2024-03-30T15:15:19.160806+0000 mon.c (mon.2) 351 : audit 1 from='client.? 172.21.15.72:0/2399891923' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi072-64163-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:20.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:20 smithi072 bash[28946]: audit 2024-03-30T15:15:19.161181+0000 mon.a (mon.0) 2076 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi072-64163-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:20.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:20 smithi172 bash[23680]: audit 2024-03-30T15:15:19.107370+0000 mon.a (mon.0) 2070 : audit 1 from='client.? 172.21.15.72:0/899819469' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi072-64163-37"}]': finished 2024-03-30T15:15:20.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:20 smithi172 bash[23680]: audit 2024-03-30T15:15:19.107519+0000 mon.a (mon.0) 2071 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-31", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:15:20.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:20 smithi172 bash[23680]: cluster 2024-03-30T15:15:19.115601+0000 mon.a (mon.0) 2072 : cluster 0 osdmap e261: 8 total, 8 up, 8 in 2024-03-30T15:15:20.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:20 smithi172 bash[23680]: audit 2024-03-30T15:15:19.118387+0000 mon.a (mon.0) 2073 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-31"}]: dispatch 2024-03-30T15:15:20.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:20 smithi172 bash[23680]: audit 2024-03-30T15:15:19.158761+0000 mon.c (mon.2) 349 : audit 1 from='client.? 172.21.15.72:0/2399891923' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi072-64163-38"}]: dispatch 2024-03-30T15:15:20.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:20 smithi172 bash[23680]: audit 2024-03-30T15:15:19.159139+0000 mon.a (mon.0) 2074 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi072-64163-38"}]: dispatch 2024-03-30T15:15:20.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:20 smithi172 bash[23680]: audit 2024-03-30T15:15:19.159936+0000 mon.c (mon.2) 350 : audit 1 from='client.? 172.21.15.72:0/2399891923' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi072-64163-38"}]: dispatch 2024-03-30T15:15:20.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:20 smithi172 bash[23680]: audit 2024-03-30T15:15:19.160270+0000 mon.a (mon.0) 2075 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi072-64163-38"}]: dispatch 2024-03-30T15:15:20.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:20 smithi172 bash[23680]: audit 2024-03-30T15:15:19.160806+0000 mon.c (mon.2) 351 : audit 1 from='client.? 172.21.15.72:0/2399891923' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi072-64163-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:20.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:20 smithi172 bash[23680]: audit 2024-03-30T15:15:19.161181+0000 mon.a (mon.0) 2076 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi072-64163-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:21.417 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:15:21 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:15:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:15:21.464 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:15:21 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:15:21.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:21 smithi072 bash[21573]: cluster 2024-03-30T15:15:19.980451+0000 mgr.y (mgr.14526) 315 : cluster 0 pgmap v396: 236 pgs: 40 unknown, 196 active+clean; 4.6 MiB data, 621 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:15:21.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:21 smithi072 bash[21573]: audit 2024-03-30T15:15:20.110183+0000 mon.a (mon.0) 2077 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-31"}]': finished 2024-03-30T15:15:21.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:21 smithi072 bash[21573]: audit 2024-03-30T15:15:20.110369+0000 mon.a (mon.0) 2078 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi072-64163-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:15:21.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:21 smithi072 bash[21573]: cluster 2024-03-30T15:15:20.117722+0000 mon.a (mon.0) 2079 : cluster 0 osdmap e262: 8 total, 8 up, 8 in 2024-03-30T15:15:21.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:21 smithi072 bash[21573]: audit 2024-03-30T15:15:20.119374+0000 mon.c (mon.2) 352 : audit 1 from='client.? 172.21.15.72:0/2399891923' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi072-64163-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi072-64163-38"}]: dispatch 2024-03-30T15:15:21.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:21 smithi072 bash[21573]: audit 2024-03-30T15:15:20.122071+0000 mon.c (mon.2) 353 : audit 1 from='client.? 172.21.15.72:0/2481842461' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi072-64171-48"}]: dispatch 2024-03-30T15:15:21.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:21 smithi072 bash[21573]: audit 2024-03-30T15:15:20.122587+0000 mon.a (mon.0) 2080 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-31", "mode": "writeback"}]: dispatch 2024-03-30T15:15:21.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:21 smithi072 bash[21573]: audit 2024-03-30T15:15:20.123376+0000 mon.a (mon.0) 2081 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi072-64163-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi072-64163-38"}]: dispatch 2024-03-30T15:15:21.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:21 smithi072 bash[21573]: audit 2024-03-30T15:15:20.124357+0000 mon.a (mon.0) 2082 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi072-64171-48"}]: dispatch 2024-03-30T15:15:21.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:21 smithi072 bash[21573]: audit 2024-03-30T15:15:20.887881+0000 mon.c (mon.2) 354 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:15:21.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:21 smithi072 bash[21573]: cluster 2024-03-30T15:15:21.059636+0000 mon.a (mon.0) 2083 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:15:21.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:21 smithi072 bash[21573]: cluster 2024-03-30T15:15:21.061552+0000 mon.a (mon.0) 2084 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:15:21.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:21 smithi072 bash[21573]: audit 2024-03-30T15:15:21.064387+0000 mon.a (mon.0) 2085 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-31", "mode": "writeback"}]': finished 2024-03-30T15:15:21.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:21 smithi072 bash[21573]: audit 2024-03-30T15:15:21.064520+0000 mon.a (mon.0) 2086 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi072-64171-48"}]': finished 2024-03-30T15:15:21.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:21 smithi072 bash[28946]: cluster 2024-03-30T15:15:19.980451+0000 mgr.y (mgr.14526) 315 : cluster 0 pgmap v396: 236 pgs: 40 unknown, 196 active+clean; 4.6 MiB data, 621 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:15:21.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:21 smithi072 bash[28946]: audit 2024-03-30T15:15:20.110183+0000 mon.a (mon.0) 2077 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-31"}]': finished 2024-03-30T15:15:21.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:21 smithi072 bash[28946]: audit 2024-03-30T15:15:20.110369+0000 mon.a (mon.0) 2078 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi072-64163-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:15:21.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:21 smithi072 bash[28946]: cluster 2024-03-30T15:15:20.117722+0000 mon.a (mon.0) 2079 : cluster 0 osdmap e262: 8 total, 8 up, 8 in 2024-03-30T15:15:21.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:21 smithi072 bash[28946]: audit 2024-03-30T15:15:20.119374+0000 mon.c (mon.2) 352 : audit 1 from='client.? 172.21.15.72:0/2399891923' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi072-64163-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi072-64163-38"}]: dispatch 2024-03-30T15:15:21.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:21 smithi072 bash[28946]: audit 2024-03-30T15:15:20.122071+0000 mon.c (mon.2) 353 : audit 1 from='client.? 172.21.15.72:0/2481842461' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi072-64171-48"}]: dispatch 2024-03-30T15:15:21.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:21 smithi072 bash[28946]: audit 2024-03-30T15:15:20.122587+0000 mon.a (mon.0) 2080 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-31", "mode": "writeback"}]: dispatch 2024-03-30T15:15:21.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:21 smithi072 bash[28946]: audit 2024-03-30T15:15:20.123376+0000 mon.a (mon.0) 2081 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi072-64163-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi072-64163-38"}]: dispatch 2024-03-30T15:15:21.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:21 smithi072 bash[28946]: audit 2024-03-30T15:15:20.124357+0000 mon.a (mon.0) 2082 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi072-64171-48"}]: dispatch 2024-03-30T15:15:21.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:21 smithi072 bash[28946]: audit 2024-03-30T15:15:20.887881+0000 mon.c (mon.2) 354 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:15:21.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:21 smithi072 bash[28946]: cluster 2024-03-30T15:15:21.059636+0000 mon.a (mon.0) 2083 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:15:21.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:21 smithi072 bash[28946]: cluster 2024-03-30T15:15:21.061552+0000 mon.a (mon.0) 2084 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:15:21.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:21 smithi072 bash[28946]: audit 2024-03-30T15:15:21.064387+0000 mon.a (mon.0) 2085 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-31", "mode": "writeback"}]': finished 2024-03-30T15:15:21.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:21 smithi072 bash[28946]: audit 2024-03-30T15:15:21.064520+0000 mon.a (mon.0) 2086 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi072-64171-48"}]': finished 2024-03-30T15:15:21.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:21 smithi172 bash[23680]: cluster 2024-03-30T15:15:19.980451+0000 mgr.y (mgr.14526) 315 : cluster 0 pgmap v396: 236 pgs: 40 unknown, 196 active+clean; 4.6 MiB data, 621 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:15:21.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:21 smithi172 bash[23680]: audit 2024-03-30T15:15:20.110183+0000 mon.a (mon.0) 2077 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-31"}]': finished 2024-03-30T15:15:21.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:21 smithi172 bash[23680]: audit 2024-03-30T15:15:20.110369+0000 mon.a (mon.0) 2078 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi072-64163-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:15:21.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:21 smithi172 bash[23680]: cluster 2024-03-30T15:15:20.117722+0000 mon.a (mon.0) 2079 : cluster 0 osdmap e262: 8 total, 8 up, 8 in 2024-03-30T15:15:21.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:21 smithi172 bash[23680]: audit 2024-03-30T15:15:20.119374+0000 mon.c (mon.2) 352 : audit 1 from='client.? 172.21.15.72:0/2399891923' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi072-64163-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi072-64163-38"}]: dispatch 2024-03-30T15:15:21.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:21 smithi172 bash[23680]: audit 2024-03-30T15:15:20.122071+0000 mon.c (mon.2) 353 : audit 1 from='client.? 172.21.15.72:0/2481842461' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi072-64171-48"}]: dispatch 2024-03-30T15:15:21.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:21 smithi172 bash[23680]: audit 2024-03-30T15:15:20.122587+0000 mon.a (mon.0) 2080 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-31", "mode": "writeback"}]: dispatch 2024-03-30T15:15:21.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:21 smithi172 bash[23680]: audit 2024-03-30T15:15:20.123376+0000 mon.a (mon.0) 2081 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi072-64163-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi072-64163-38"}]: dispatch 2024-03-30T15:15:21.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:21 smithi172 bash[23680]: audit 2024-03-30T15:15:20.124357+0000 mon.a (mon.0) 2082 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi072-64171-48"}]: dispatch 2024-03-30T15:15:21.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:21 smithi172 bash[23680]: audit 2024-03-30T15:15:20.887881+0000 mon.c (mon.2) 354 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:15:21.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:21 smithi172 bash[23680]: cluster 2024-03-30T15:15:21.059636+0000 mon.a (mon.0) 2083 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:15:21.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:21 smithi172 bash[23680]: cluster 2024-03-30T15:15:21.061552+0000 mon.a (mon.0) 2084 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:15:21.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:21 smithi172 bash[23680]: audit 2024-03-30T15:15:21.064387+0000 mon.a (mon.0) 2085 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-31", "mode": "writeback"}]': finished 2024-03-30T15:15:21.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:21 smithi172 bash[23680]: audit 2024-03-30T15:15:21.064520+0000 mon.a (mon.0) 2086 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi072-64171-48"}]': finished 2024-03-30T15:15:22.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:22 smithi072 bash[21573]: audit 2024-03-30T15:15:21.080568+0000 mon.c (mon.2) 355 : audit 1 from='client.? 172.21.15.72:0/2481842461' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi072-64171-48"}]: dispatch 2024-03-30T15:15:22.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:22 smithi072 bash[21573]: audit 2024-03-30T15:15:21.128413+0000 mgr.y (mgr.14526) 316 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:15:22.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:22 smithi072 bash[21573]: cluster 2024-03-30T15:15:21.523398+0000 mon.a (mon.0) 2087 : cluster 0 osdmap e263: 8 total, 8 up, 8 in 2024-03-30T15:15:22.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:22 smithi072 bash[21573]: audit 2024-03-30T15:15:21.530926+0000 mon.a (mon.0) 2088 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi072-64171-48"}]: dispatch 2024-03-30T15:15:22.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:22 smithi072 bash[21573]: audit 2024-03-30T15:15:21.698047+0000 mon.a (mon.0) 2089 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:15:22.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:22 smithi072 bash[21573]: audit 2024-03-30T15:15:22.069122+0000 mon.a (mon.0) 2090 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStat_smithi072-64163-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi072-64163-38"}]': finished 2024-03-30T15:15:22.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:22 smithi072 bash[21573]: audit 2024-03-30T15:15:22.069350+0000 mon.a (mon.0) 2091 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi072-64171-48"}]': finished 2024-03-30T15:15:22.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:22 smithi072 bash[21573]: audit 2024-03-30T15:15:22.069501+0000 mon.a (mon.0) 2092 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:15:22.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:22 smithi072 bash[21573]: cluster 2024-03-30T15:15:22.078085+0000 mon.a (mon.0) 2093 : cluster 0 osdmap e264: 8 total, 8 up, 8 in 2024-03-30T15:15:22.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:22 smithi072 bash[21573]: audit 2024-03-30T15:15:22.080597+0000 mon.a (mon.0) 2094 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-31"}]: dispatch 2024-03-30T15:15:22.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:22 smithi072 bash[21573]: audit 2024-03-30T15:15:22.115291+0000 mon.c (mon.2) 356 : audit 1 from='client.? 172.21.15.72:0/2664613795' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi072-64171-49"}]: dispatch 2024-03-30T15:15:22.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:22 smithi072 bash[21573]: audit 2024-03-30T15:15:22.116023+0000 mon.a (mon.0) 2095 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi072-64171-49"}]: dispatch 2024-03-30T15:15:22.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:22 smithi072 bash[21573]: audit 2024-03-30T15:15:22.116784+0000 mon.c (mon.2) 357 : audit 1 from='client.? 172.21.15.72:0/2664613795' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi072-64171-49"}]: dispatch 2024-03-30T15:15:22.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:22 smithi072 bash[21573]: audit 2024-03-30T15:15:22.117183+0000 mon.a (mon.0) 2096 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi072-64171-49"}]: dispatch 2024-03-30T15:15:22.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:22 smithi072 bash[21573]: audit 2024-03-30T15:15:22.117770+0000 mon.c (mon.2) 358 : audit 1 from='client.? 172.21.15.72:0/2664613795' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi072-64171-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:22.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:22 smithi072 bash[21573]: audit 2024-03-30T15:15:22.118099+0000 mon.a (mon.0) 2097 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi072-64171-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:22.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:22 smithi072 bash[28946]: audit 2024-03-30T15:15:21.080568+0000 mon.c (mon.2) 355 : audit 1 from='client.? 172.21.15.72:0/2481842461' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi072-64171-48"}]: dispatch 2024-03-30T15:15:22.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:22 smithi072 bash[28946]: audit 2024-03-30T15:15:21.128413+0000 mgr.y (mgr.14526) 316 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:15:22.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:22 smithi072 bash[28946]: cluster 2024-03-30T15:15:21.523398+0000 mon.a (mon.0) 2087 : cluster 0 osdmap e263: 8 total, 8 up, 8 in 2024-03-30T15:15:22.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:22 smithi072 bash[28946]: audit 2024-03-30T15:15:21.530926+0000 mon.a (mon.0) 2088 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi072-64171-48"}]: dispatch 2024-03-30T15:15:22.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:22 smithi072 bash[28946]: audit 2024-03-30T15:15:21.698047+0000 mon.a (mon.0) 2089 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:15:22.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:22 smithi072 bash[28946]: audit 2024-03-30T15:15:22.069122+0000 mon.a (mon.0) 2090 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStat_smithi072-64163-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi072-64163-38"}]': finished 2024-03-30T15:15:22.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:22 smithi072 bash[28946]: audit 2024-03-30T15:15:22.069350+0000 mon.a (mon.0) 2091 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi072-64171-48"}]': finished 2024-03-30T15:15:22.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:22 smithi072 bash[28946]: audit 2024-03-30T15:15:22.069501+0000 mon.a (mon.0) 2092 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:15:22.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:22 smithi072 bash[28946]: cluster 2024-03-30T15:15:22.078085+0000 mon.a (mon.0) 2093 : cluster 0 osdmap e264: 8 total, 8 up, 8 in 2024-03-30T15:15:22.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:22 smithi072 bash[28946]: audit 2024-03-30T15:15:22.080597+0000 mon.a (mon.0) 2094 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-31"}]: dispatch 2024-03-30T15:15:22.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:22 smithi072 bash[28946]: audit 2024-03-30T15:15:22.115291+0000 mon.c (mon.2) 356 : audit 1 from='client.? 172.21.15.72:0/2664613795' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi072-64171-49"}]: dispatch 2024-03-30T15:15:22.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:22 smithi072 bash[28946]: audit 2024-03-30T15:15:22.116023+0000 mon.a (mon.0) 2095 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi072-64171-49"}]: dispatch 2024-03-30T15:15:22.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:22 smithi072 bash[28946]: audit 2024-03-30T15:15:22.116784+0000 mon.c (mon.2) 357 : audit 1 from='client.? 172.21.15.72:0/2664613795' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi072-64171-49"}]: dispatch 2024-03-30T15:15:22.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:22 smithi072 bash[28946]: audit 2024-03-30T15:15:22.117183+0000 mon.a (mon.0) 2096 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi072-64171-49"}]: dispatch 2024-03-30T15:15:22.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:22 smithi072 bash[28946]: audit 2024-03-30T15:15:22.117770+0000 mon.c (mon.2) 358 : audit 1 from='client.? 172.21.15.72:0/2664613795' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi072-64171-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:22.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:22 smithi072 bash[28946]: audit 2024-03-30T15:15:22.118099+0000 mon.a (mon.0) 2097 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi072-64171-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:22.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:22 smithi172 bash[23680]: audit 2024-03-30T15:15:21.080568+0000 mon.c (mon.2) 355 : audit 1 from='client.? 172.21.15.72:0/2481842461' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi072-64171-48"}]: dispatch 2024-03-30T15:15:22.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:22 smithi172 bash[23680]: audit 2024-03-30T15:15:21.128413+0000 mgr.y (mgr.14526) 316 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:15:22.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:22 smithi172 bash[23680]: cluster 2024-03-30T15:15:21.523398+0000 mon.a (mon.0) 2087 : cluster 0 osdmap e263: 8 total, 8 up, 8 in 2024-03-30T15:15:22.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:22 smithi172 bash[23680]: audit 2024-03-30T15:15:21.530926+0000 mon.a (mon.0) 2088 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi072-64171-48"}]: dispatch 2024-03-30T15:15:22.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:22 smithi172 bash[23680]: audit 2024-03-30T15:15:21.698047+0000 mon.a (mon.0) 2089 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:15:22.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:22 smithi172 bash[23680]: audit 2024-03-30T15:15:22.069122+0000 mon.a (mon.0) 2090 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStat_smithi072-64163-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi072-64163-38"}]': finished 2024-03-30T15:15:22.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:22 smithi172 bash[23680]: audit 2024-03-30T15:15:22.069350+0000 mon.a (mon.0) 2091 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi072-64171-48"}]': finished 2024-03-30T15:15:22.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:22 smithi172 bash[23680]: audit 2024-03-30T15:15:22.069501+0000 mon.a (mon.0) 2092 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:15:22.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:22 smithi172 bash[23680]: cluster 2024-03-30T15:15:22.078085+0000 mon.a (mon.0) 2093 : cluster 0 osdmap e264: 8 total, 8 up, 8 in 2024-03-30T15:15:22.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:22 smithi172 bash[23680]: audit 2024-03-30T15:15:22.080597+0000 mon.a (mon.0) 2094 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-31"}]: dispatch 2024-03-30T15:15:22.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:22 smithi172 bash[23680]: audit 2024-03-30T15:15:22.115291+0000 mon.c (mon.2) 356 : audit 1 from='client.? 172.21.15.72:0/2664613795' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi072-64171-49"}]: dispatch 2024-03-30T15:15:22.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:22 smithi172 bash[23680]: audit 2024-03-30T15:15:22.116023+0000 mon.a (mon.0) 2095 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi072-64171-49"}]: dispatch 2024-03-30T15:15:22.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:22 smithi172 bash[23680]: audit 2024-03-30T15:15:22.116784+0000 mon.c (mon.2) 357 : audit 1 from='client.? 172.21.15.72:0/2664613795' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi072-64171-49"}]: dispatch 2024-03-30T15:15:22.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:22 smithi172 bash[23680]: audit 2024-03-30T15:15:22.117183+0000 mon.a (mon.0) 2096 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi072-64171-49"}]: dispatch 2024-03-30T15:15:22.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:22 smithi172 bash[23680]: audit 2024-03-30T15:15:22.117770+0000 mon.c (mon.2) 358 : audit 1 from='client.? 172.21.15.72:0/2664613795' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi072-64171-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:22.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:22 smithi172 bash[23680]: audit 2024-03-30T15:15:22.118099+0000 mon.a (mon.0) 2097 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi072-64171-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:23.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:23 smithi072 bash[21573]: cluster 2024-03-30T15:15:21.981235+0000 mgr.y (mgr.14526) 317 : cluster 0 pgmap v399: 228 pgs: 228 active+clean; 4.6 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:15:23.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:23 smithi072 bash[21573]: cluster 2024-03-30T15:15:23.069779+0000 mon.a (mon.0) 2098 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:15:23.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:23 smithi072 bash[21573]: audit 2024-03-30T15:15:23.072271+0000 mon.a (mon.0) 2099 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-31"}]': finished 2024-03-30T15:15:23.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:23 smithi072 bash[21573]: audit 2024-03-30T15:15:23.072455+0000 mon.a (mon.0) 2100 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi072-64171-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:15:23.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:23 smithi072 bash[21573]: cluster 2024-03-30T15:15:23.080696+0000 mon.a (mon.0) 2101 : cluster 0 osdmap e265: 8 total, 8 up, 8 in 2024-03-30T15:15:23.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:23 smithi072 bash[21573]: audit 2024-03-30T15:15:23.084601+0000 mon.c (mon.2) 359 : audit 1 from='client.? 172.21.15.72:0/2664613795' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi072-64171-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi072-64171-49"}]: dispatch 2024-03-30T15:15:23.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:23 smithi072 bash[21573]: audit 2024-03-30T15:15:23.089265+0000 mon.a (mon.0) 2102 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi072-64171-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi072-64171-49"}]: dispatch 2024-03-30T15:15:23.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:23 smithi072 bash[28946]: cluster 2024-03-30T15:15:21.981235+0000 mgr.y (mgr.14526) 317 : cluster 0 pgmap v399: 228 pgs: 228 active+clean; 4.6 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:15:23.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:23 smithi072 bash[28946]: cluster 2024-03-30T15:15:23.069779+0000 mon.a (mon.0) 2098 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:15:23.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:23 smithi072 bash[28946]: audit 2024-03-30T15:15:23.072271+0000 mon.a (mon.0) 2099 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-31"}]': finished 2024-03-30T15:15:23.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:23 smithi072 bash[28946]: audit 2024-03-30T15:15:23.072455+0000 mon.a (mon.0) 2100 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi072-64171-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:15:23.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:23 smithi072 bash[28946]: cluster 2024-03-30T15:15:23.080696+0000 mon.a (mon.0) 2101 : cluster 0 osdmap e265: 8 total, 8 up, 8 in 2024-03-30T15:15:23.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:23 smithi072 bash[28946]: audit 2024-03-30T15:15:23.084601+0000 mon.c (mon.2) 359 : audit 1 from='client.? 172.21.15.72:0/2664613795' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi072-64171-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi072-64171-49"}]: dispatch 2024-03-30T15:15:23.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:23 smithi072 bash[28946]: audit 2024-03-30T15:15:23.089265+0000 mon.a (mon.0) 2102 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi072-64171-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi072-64171-49"}]: dispatch 2024-03-30T15:15:23.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:23 smithi172 bash[23680]: cluster 2024-03-30T15:15:21.981235+0000 mgr.y (mgr.14526) 317 : cluster 0 pgmap v399: 228 pgs: 228 active+clean; 4.6 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:15:23.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:23 smithi172 bash[23680]: cluster 2024-03-30T15:15:23.069779+0000 mon.a (mon.0) 2098 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:15:23.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:23 smithi172 bash[23680]: audit 2024-03-30T15:15:23.072271+0000 mon.a (mon.0) 2099 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-31"}]': finished 2024-03-30T15:15:23.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:23 smithi172 bash[23680]: audit 2024-03-30T15:15:23.072455+0000 mon.a (mon.0) 2100 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi072-64171-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:15:23.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:23 smithi172 bash[23680]: cluster 2024-03-30T15:15:23.080696+0000 mon.a (mon.0) 2101 : cluster 0 osdmap e265: 8 total, 8 up, 8 in 2024-03-30T15:15:23.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:23 smithi172 bash[23680]: audit 2024-03-30T15:15:23.084601+0000 mon.c (mon.2) 359 : audit 1 from='client.? 172.21.15.72:0/2664613795' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi072-64171-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi072-64171-49"}]: dispatch 2024-03-30T15:15:23.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:23 smithi172 bash[23680]: audit 2024-03-30T15:15:23.089265+0000 mon.a (mon.0) 2102 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi072-64171-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi072-64171-49"}]: dispatch 2024-03-30T15:15:25.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:25 smithi072 bash[21573]: cluster 2024-03-30T15:15:23.982153+0000 mgr.y (mgr.14526) 318 : cluster 0 pgmap v402: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:15:25.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:25 smithi072 bash[21573]: cluster 2024-03-30T15:15:24.536613+0000 mon.a (mon.0) 2103 : cluster 0 osdmap e266: 8 total, 8 up, 8 in 2024-03-30T15:15:25.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:25 smithi072 bash[21573]: audit 2024-03-30T15:15:24.537698+0000 mon.c (mon.2) 360 : audit 1 from='client.? 172.21.15.72:0/2399891923' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi072-64163-38"}]: dispatch 2024-03-30T15:15:25.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:25 smithi072 bash[21573]: audit 2024-03-30T15:15:24.983712+0000 mon.a (mon.0) 2104 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi072-64163-38"}]: dispatch 2024-03-30T15:15:25.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:25 smithi072 bash[28946]: cluster 2024-03-30T15:15:23.982153+0000 mgr.y (mgr.14526) 318 : cluster 0 pgmap v402: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:15:25.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:25 smithi072 bash[28946]: cluster 2024-03-30T15:15:24.536613+0000 mon.a (mon.0) 2103 : cluster 0 osdmap e266: 8 total, 8 up, 8 in 2024-03-30T15:15:25.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:25 smithi072 bash[28946]: audit 2024-03-30T15:15:24.537698+0000 mon.c (mon.2) 360 : audit 1 from='client.? 172.21.15.72:0/2399891923' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi072-64163-38"}]: dispatch 2024-03-30T15:15:25.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:25 smithi072 bash[28946]: audit 2024-03-30T15:15:24.983712+0000 mon.a (mon.0) 2104 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi072-64163-38"}]: dispatch 2024-03-30T15:15:25.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:25 smithi172 bash[23680]: cluster 2024-03-30T15:15:23.982153+0000 mgr.y (mgr.14526) 318 : cluster 0 pgmap v402: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:15:25.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:25 smithi172 bash[23680]: cluster 2024-03-30T15:15:24.536613+0000 mon.a (mon.0) 2103 : cluster 0 osdmap e266: 8 total, 8 up, 8 in 2024-03-30T15:15:25.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:25 smithi172 bash[23680]: audit 2024-03-30T15:15:24.537698+0000 mon.c (mon.2) 360 : audit 1 from='client.? 172.21.15.72:0/2399891923' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi072-64163-38"}]: dispatch 2024-03-30T15:15:25.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:25 smithi172 bash[23680]: audit 2024-03-30T15:15:24.983712+0000 mon.a (mon.0) 2104 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi072-64163-38"}]: dispatch 2024-03-30T15:15:26.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:26 smithi072 bash[21573]: audit 2024-03-30T15:15:25.087381+0000 mon.a (mon.0) 2105 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi072-64171-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi072-64171-49"}]': finished 2024-03-30T15:15:26.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:26 smithi072 bash[21573]: audit 2024-03-30T15:15:25.087643+0000 mon.a (mon.0) 2106 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi072-64163-38"}]': finished 2024-03-30T15:15:26.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:26 smithi072 bash[21573]: cluster 2024-03-30T15:15:25.094779+0000 mon.a (mon.0) 2107 : cluster 0 osdmap e267: 8 total, 8 up, 8 in 2024-03-30T15:15:26.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:26 smithi072 bash[21573]: audit 2024-03-30T15:15:25.102600+0000 mon.c (mon.2) 361 : audit 1 from='client.? 172.21.15.72:0/2399891923' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi072-64163-38"}]: dispatch 2024-03-30T15:15:26.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:26 smithi072 bash[21573]: audit 2024-03-30T15:15:25.117067+0000 mon.a (mon.0) 2108 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:15:26.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:26 smithi072 bash[21573]: audit 2024-03-30T15:15:25.118167+0000 mon.a (mon.0) 2109 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi072-64163-38"}]: dispatch 2024-03-30T15:15:26.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:26 smithi072 bash[28946]: audit 2024-03-30T15:15:25.087381+0000 mon.a (mon.0) 2105 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi072-64171-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi072-64171-49"}]': finished 2024-03-30T15:15:26.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:26 smithi072 bash[28946]: audit 2024-03-30T15:15:25.087643+0000 mon.a (mon.0) 2106 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi072-64163-38"}]': finished 2024-03-30T15:15:26.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:26 smithi072 bash[28946]: cluster 2024-03-30T15:15:25.094779+0000 mon.a (mon.0) 2107 : cluster 0 osdmap e267: 8 total, 8 up, 8 in 2024-03-30T15:15:26.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:26 smithi072 bash[28946]: audit 2024-03-30T15:15:25.102600+0000 mon.c (mon.2) 361 : audit 1 from='client.? 172.21.15.72:0/2399891923' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi072-64163-38"}]: dispatch 2024-03-30T15:15:26.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:26 smithi072 bash[28946]: audit 2024-03-30T15:15:25.117067+0000 mon.a (mon.0) 2108 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:15:26.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:26 smithi072 bash[28946]: audit 2024-03-30T15:15:25.118167+0000 mon.a (mon.0) 2109 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi072-64163-38"}]: dispatch 2024-03-30T15:15:26.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:26 smithi172 bash[23680]: audit 2024-03-30T15:15:25.087381+0000 mon.a (mon.0) 2105 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi072-64171-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi072-64171-49"}]': finished 2024-03-30T15:15:26.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:26 smithi172 bash[23680]: audit 2024-03-30T15:15:25.087643+0000 mon.a (mon.0) 2106 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi072-64163-38"}]': finished 2024-03-30T15:15:26.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:26 smithi172 bash[23680]: cluster 2024-03-30T15:15:25.094779+0000 mon.a (mon.0) 2107 : cluster 0 osdmap e267: 8 total, 8 up, 8 in 2024-03-30T15:15:26.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:26 smithi172 bash[23680]: audit 2024-03-30T15:15:25.102600+0000 mon.c (mon.2) 361 : audit 1 from='client.? 172.21.15.72:0/2399891923' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi072-64163-38"}]: dispatch 2024-03-30T15:15:26.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:26 smithi172 bash[23680]: audit 2024-03-30T15:15:25.117067+0000 mon.a (mon.0) 2108 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:15:26.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:26 smithi172 bash[23680]: audit 2024-03-30T15:15:25.118167+0000 mon.a (mon.0) 2109 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi072-64163-38"}]: dispatch 2024-03-30T15:15:27.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:27 smithi072 bash[21573]: cluster 2024-03-30T15:15:25.984343+0000 mgr.y (mgr.14526) 319 : cluster 0 pgmap v405: 236 pgs: 40 creating+peering, 196 active+clean; 4.6 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:15:27.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:27 smithi072 bash[21573]: cluster 2024-03-30T15:15:26.089561+0000 mon.a (mon.0) 2110 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:15:27.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:27 smithi072 bash[21573]: audit 2024-03-30T15:15:26.091262+0000 mon.a (mon.0) 2111 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:15:27.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:27 smithi072 bash[21573]: audit 2024-03-30T15:15:26.091426+0000 mon.a (mon.0) 2112 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi072-64163-38"}]': finished 2024-03-30T15:15:27.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:27 smithi072 bash[21573]: cluster 2024-03-30T15:15:26.100059+0000 mon.a (mon.0) 2113 : cluster 0 osdmap e268: 8 total, 8 up, 8 in 2024-03-30T15:15:27.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:27 smithi072 bash[21573]: audit 2024-03-30T15:15:26.130140+0000 mon.a (mon.0) 2114 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:15:27.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:27 smithi072 bash[21573]: audit 2024-03-30T15:15:26.151882+0000 mon.c (mon.2) 362 : audit 1 from='client.? 172.21.15.72:0/1172191487' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi072-64163-39"}]: dispatch 2024-03-30T15:15:27.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:27 smithi072 bash[21573]: audit 2024-03-30T15:15:26.152315+0000 mon.a (mon.0) 2115 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi072-64163-39"}]: dispatch 2024-03-30T15:15:27.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:27 smithi072 bash[21573]: audit 2024-03-30T15:15:26.153453+0000 mon.c (mon.2) 363 : audit 1 from='client.? 172.21.15.72:0/1172191487' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi072-64163-39"}]: dispatch 2024-03-30T15:15:27.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:27 smithi072 bash[21573]: audit 2024-03-30T15:15:26.153929+0000 mon.a (mon.0) 2116 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi072-64163-39"}]: dispatch 2024-03-30T15:15:27.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:27 smithi072 bash[21573]: audit 2024-03-30T15:15:26.154703+0000 mon.c (mon.2) 364 : audit 1 from='client.? 172.21.15.72:0/1172191487' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi072-64163-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:27.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:27 smithi072 bash[21573]: audit 2024-03-30T15:15:26.155439+0000 mon.a (mon.0) 2117 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi072-64163-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:27.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:27 smithi072 bash[28946]: cluster 2024-03-30T15:15:25.984343+0000 mgr.y (mgr.14526) 319 : cluster 0 pgmap v405: 236 pgs: 40 creating+peering, 196 active+clean; 4.6 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:15:27.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:27 smithi072 bash[28946]: cluster 2024-03-30T15:15:26.089561+0000 mon.a (mon.0) 2110 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:15:27.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:27 smithi072 bash[28946]: audit 2024-03-30T15:15:26.091262+0000 mon.a (mon.0) 2111 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:15:27.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:27 smithi072 bash[28946]: audit 2024-03-30T15:15:26.091426+0000 mon.a (mon.0) 2112 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi072-64163-38"}]': finished 2024-03-30T15:15:27.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:27 smithi072 bash[28946]: cluster 2024-03-30T15:15:26.100059+0000 mon.a (mon.0) 2113 : cluster 0 osdmap e268: 8 total, 8 up, 8 in 2024-03-30T15:15:27.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:27 smithi072 bash[28946]: audit 2024-03-30T15:15:26.130140+0000 mon.a (mon.0) 2114 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:15:27.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:27 smithi072 bash[28946]: audit 2024-03-30T15:15:26.151882+0000 mon.c (mon.2) 362 : audit 1 from='client.? 172.21.15.72:0/1172191487' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi072-64163-39"}]: dispatch 2024-03-30T15:15:27.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:27 smithi072 bash[28946]: audit 2024-03-30T15:15:26.152315+0000 mon.a (mon.0) 2115 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi072-64163-39"}]: dispatch 2024-03-30T15:15:27.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:27 smithi072 bash[28946]: audit 2024-03-30T15:15:26.153453+0000 mon.c (mon.2) 363 : audit 1 from='client.? 172.21.15.72:0/1172191487' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi072-64163-39"}]: dispatch 2024-03-30T15:15:27.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:27 smithi072 bash[28946]: audit 2024-03-30T15:15:26.153929+0000 mon.a (mon.0) 2116 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi072-64163-39"}]: dispatch 2024-03-30T15:15:27.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:27 smithi072 bash[28946]: audit 2024-03-30T15:15:26.154703+0000 mon.c (mon.2) 364 : audit 1 from='client.? 172.21.15.72:0/1172191487' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi072-64163-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:27.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:27 smithi072 bash[28946]: audit 2024-03-30T15:15:26.155439+0000 mon.a (mon.0) 2117 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi072-64163-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:27.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:27 smithi172 bash[23680]: cluster 2024-03-30T15:15:25.984343+0000 mgr.y (mgr.14526) 319 : cluster 0 pgmap v405: 236 pgs: 40 creating+peering, 196 active+clean; 4.6 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:15:27.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:27 smithi172 bash[23680]: cluster 2024-03-30T15:15:26.089561+0000 mon.a (mon.0) 2110 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:15:27.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:27 smithi172 bash[23680]: audit 2024-03-30T15:15:26.091262+0000 mon.a (mon.0) 2111 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:15:27.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:27 smithi172 bash[23680]: audit 2024-03-30T15:15:26.091426+0000 mon.a (mon.0) 2112 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi072-64163-38"}]': finished 2024-03-30T15:15:27.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:27 smithi172 bash[23680]: cluster 2024-03-30T15:15:26.100059+0000 mon.a (mon.0) 2113 : cluster 0 osdmap e268: 8 total, 8 up, 8 in 2024-03-30T15:15:27.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:27 smithi172 bash[23680]: audit 2024-03-30T15:15:26.130140+0000 mon.a (mon.0) 2114 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:15:27.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:27 smithi172 bash[23680]: audit 2024-03-30T15:15:26.151882+0000 mon.c (mon.2) 362 : audit 1 from='client.? 172.21.15.72:0/1172191487' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi072-64163-39"}]: dispatch 2024-03-30T15:15:27.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:27 smithi172 bash[23680]: audit 2024-03-30T15:15:26.152315+0000 mon.a (mon.0) 2115 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi072-64163-39"}]: dispatch 2024-03-30T15:15:27.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:27 smithi172 bash[23680]: audit 2024-03-30T15:15:26.153453+0000 mon.c (mon.2) 363 : audit 1 from='client.? 172.21.15.72:0/1172191487' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi072-64163-39"}]: dispatch 2024-03-30T15:15:27.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:27 smithi172 bash[23680]: audit 2024-03-30T15:15:26.153929+0000 mon.a (mon.0) 2116 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi072-64163-39"}]: dispatch 2024-03-30T15:15:27.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:27 smithi172 bash[23680]: audit 2024-03-30T15:15:26.154703+0000 mon.c (mon.2) 364 : audit 1 from='client.? 172.21.15.72:0/1172191487' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi072-64163-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:27.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:27 smithi172 bash[23680]: audit 2024-03-30T15:15:26.155439+0000 mon.a (mon.0) 2117 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi072-64163-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:28.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:28 smithi072 bash[21573]: audit 2024-03-30T15:15:27.116921+0000 mon.a (mon.0) 2118 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-33", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:15:28.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:28 smithi072 bash[21573]: audit 2024-03-30T15:15:27.117171+0000 mon.a (mon.0) 2119 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi072-64163-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:15:28.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:28 smithi072 bash[21573]: cluster 2024-03-30T15:15:27.124638+0000 mon.a (mon.0) 2120 : cluster 0 osdmap e269: 8 total, 8 up, 8 in 2024-03-30T15:15:28.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:28 smithi072 bash[21573]: audit 2024-03-30T15:15:27.127559+0000 mon.c (mon.2) 365 : audit 1 from='client.? 172.21.15.72:0/1172191487' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi072-64163-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi072-64163-39"}]: dispatch 2024-03-30T15:15:28.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:28 smithi072 bash[21573]: audit 2024-03-30T15:15:27.127831+0000 mon.a (mon.0) 2121 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-33"}]: dispatch 2024-03-30T15:15:28.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:28 smithi072 bash[21573]: audit 2024-03-30T15:15:27.129181+0000 mon.a (mon.0) 2122 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi072-64163-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi072-64163-39"}]: dispatch 2024-03-30T15:15:28.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:28 smithi072 bash[21573]: audit 2024-03-30T15:15:27.131578+0000 mon.c (mon.2) 366 : audit 1 from='client.? 172.21.15.72:0/2664613795' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi072-64171-49"}]: dispatch 2024-03-30T15:15:28.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:28 smithi072 bash[21573]: audit 2024-03-30T15:15:27.138830+0000 mon.a (mon.0) 2123 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi072-64171-49"}]: dispatch 2024-03-30T15:15:28.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:28 smithi072 bash[21573]: audit 2024-03-30T15:15:28.120356+0000 mon.a (mon.0) 2124 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-33"}]': finished 2024-03-30T15:15:28.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:28 smithi072 bash[28946]: audit 2024-03-30T15:15:27.116921+0000 mon.a (mon.0) 2118 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-33", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:15:28.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:28 smithi072 bash[28946]: audit 2024-03-30T15:15:27.117171+0000 mon.a (mon.0) 2119 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi072-64163-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:15:28.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:28 smithi072 bash[28946]: cluster 2024-03-30T15:15:27.124638+0000 mon.a (mon.0) 2120 : cluster 0 osdmap e269: 8 total, 8 up, 8 in 2024-03-30T15:15:28.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:28 smithi072 bash[28946]: audit 2024-03-30T15:15:27.127559+0000 mon.c (mon.2) 365 : audit 1 from='client.? 172.21.15.72:0/1172191487' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi072-64163-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi072-64163-39"}]: dispatch 2024-03-30T15:15:28.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:28 smithi072 bash[28946]: audit 2024-03-30T15:15:27.127831+0000 mon.a (mon.0) 2121 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-33"}]: dispatch 2024-03-30T15:15:28.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:28 smithi072 bash[28946]: audit 2024-03-30T15:15:27.129181+0000 mon.a (mon.0) 2122 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi072-64163-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi072-64163-39"}]: dispatch 2024-03-30T15:15:28.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:28 smithi072 bash[28946]: audit 2024-03-30T15:15:27.131578+0000 mon.c (mon.2) 366 : audit 1 from='client.? 172.21.15.72:0/2664613795' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi072-64171-49"}]: dispatch 2024-03-30T15:15:28.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:28 smithi072 bash[28946]: audit 2024-03-30T15:15:27.138830+0000 mon.a (mon.0) 2123 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi072-64171-49"}]: dispatch 2024-03-30T15:15:28.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:28 smithi072 bash[28946]: audit 2024-03-30T15:15:28.120356+0000 mon.a (mon.0) 2124 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-33"}]': finished 2024-03-30T15:15:28.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:28 smithi172 bash[23680]: audit 2024-03-30T15:15:27.116921+0000 mon.a (mon.0) 2118 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-33", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:15:28.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:28 smithi172 bash[23680]: audit 2024-03-30T15:15:27.117171+0000 mon.a (mon.0) 2119 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi072-64163-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:15:28.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:28 smithi172 bash[23680]: cluster 2024-03-30T15:15:27.124638+0000 mon.a (mon.0) 2120 : cluster 0 osdmap e269: 8 total, 8 up, 8 in 2024-03-30T15:15:28.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:28 smithi172 bash[23680]: audit 2024-03-30T15:15:27.127559+0000 mon.c (mon.2) 365 : audit 1 from='client.? 172.21.15.72:0/1172191487' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi072-64163-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi072-64163-39"}]: dispatch 2024-03-30T15:15:28.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:28 smithi172 bash[23680]: audit 2024-03-30T15:15:27.127831+0000 mon.a (mon.0) 2121 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-33"}]: dispatch 2024-03-30T15:15:28.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:28 smithi172 bash[23680]: audit 2024-03-30T15:15:27.129181+0000 mon.a (mon.0) 2122 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi072-64163-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi072-64163-39"}]: dispatch 2024-03-30T15:15:28.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:28 smithi172 bash[23680]: audit 2024-03-30T15:15:27.131578+0000 mon.c (mon.2) 366 : audit 1 from='client.? 172.21.15.72:0/2664613795' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi072-64171-49"}]: dispatch 2024-03-30T15:15:28.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:28 smithi172 bash[23680]: audit 2024-03-30T15:15:27.138830+0000 mon.a (mon.0) 2123 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi072-64171-49"}]: dispatch 2024-03-30T15:15:28.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:28 smithi172 bash[23680]: audit 2024-03-30T15:15:28.120356+0000 mon.a (mon.0) 2124 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-33"}]': finished 2024-03-30T15:15:29.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:29 smithi072 bash[21573]: cluster 2024-03-30T15:15:27.985185+0000 mgr.y (mgr.14526) 320 : cluster 0 pgmap v408: 228 pgs: 32 creating+peering, 196 active+clean; 4.6 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:15:29.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:29 smithi072 bash[21573]: audit 2024-03-30T15:15:28.120519+0000 mon.a (mon.0) 2125 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi072-64171-49"}]': finished 2024-03-30T15:15:29.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:29 smithi072 bash[21573]: audit 2024-03-30T15:15:28.130467+0000 mon.c (mon.2) 367 : audit 1 from='client.? 172.21.15.72:0/2664613795' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi072-64171-49"}]: dispatch 2024-03-30T15:15:29.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:29 smithi072 bash[21573]: cluster 2024-03-30T15:15:28.577710+0000 mon.a (mon.0) 2126 : cluster 0 osdmap e270: 8 total, 8 up, 8 in 2024-03-30T15:15:29.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:29 smithi072 bash[21573]: audit 2024-03-30T15:15:28.579573+0000 mon.a (mon.0) 2127 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-33", "mode": "writeback"}]: dispatch 2024-03-30T15:15:29.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:29 smithi072 bash[21573]: audit 2024-03-30T15:15:28.580275+0000 mon.a (mon.0) 2128 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi072-64171-49"}]: dispatch 2024-03-30T15:15:29.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:29 smithi072 bash[21573]: cluster 2024-03-30T15:15:29.121811+0000 mon.a (mon.0) 2129 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:15:29.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:29 smithi072 bash[21573]: audit 2024-03-30T15:15:29.124410+0000 mon.a (mon.0) 2130 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi072-64163-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi072-64163-39"}]': finished 2024-03-30T15:15:29.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:29 smithi072 bash[21573]: audit 2024-03-30T15:15:29.124681+0000 mon.a (mon.0) 2131 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-33", "mode": "writeback"}]': finished 2024-03-30T15:15:29.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:29 smithi072 bash[21573]: audit 2024-03-30T15:15:29.124862+0000 mon.a (mon.0) 2132 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi072-64171-49"}]': finished 2024-03-30T15:15:29.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:29 smithi072 bash[21573]: cluster 2024-03-30T15:15:29.135042+0000 mon.a (mon.0) 2133 : cluster 0 osdmap e271: 8 total, 8 up, 8 in 2024-03-30T15:15:29.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:29 smithi072 bash[21573]: audit 2024-03-30T15:15:29.171150+0000 mon.a (mon.0) 2134 : audit 1 from='client.? 172.21.15.72:0/772482678' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi072-64171-50"}]: dispatch 2024-03-30T15:15:29.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:29 smithi072 bash[21573]: audit 2024-03-30T15:15:29.172178+0000 mon.a (mon.0) 2135 : audit 1 from='client.? 172.21.15.72:0/772482678' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi072-64171-50"}]: dispatch 2024-03-30T15:15:29.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:29 smithi072 bash[21573]: audit 2024-03-30T15:15:29.172590+0000 mon.a (mon.0) 2136 : audit 1 from='client.? 172.21.15.72:0/772482678' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi072-64171-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:29.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:29 smithi072 bash[21573]: audit 2024-03-30T15:15:29.334917+0000 mon.a (mon.0) 2137 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:15:29.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:29 smithi072 bash[28946]: cluster 2024-03-30T15:15:27.985185+0000 mgr.y (mgr.14526) 320 : cluster 0 pgmap v408: 228 pgs: 32 creating+peering, 196 active+clean; 4.6 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:15:29.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:29 smithi072 bash[28946]: audit 2024-03-30T15:15:28.120519+0000 mon.a (mon.0) 2125 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi072-64171-49"}]': finished 2024-03-30T15:15:29.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:29 smithi072 bash[28946]: audit 2024-03-30T15:15:28.130467+0000 mon.c (mon.2) 367 : audit 1 from='client.? 172.21.15.72:0/2664613795' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi072-64171-49"}]: dispatch 2024-03-30T15:15:29.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:29 smithi072 bash[28946]: cluster 2024-03-30T15:15:28.577710+0000 mon.a (mon.0) 2126 : cluster 0 osdmap e270: 8 total, 8 up, 8 in 2024-03-30T15:15:29.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:29 smithi072 bash[28946]: audit 2024-03-30T15:15:28.579573+0000 mon.a (mon.0) 2127 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-33", "mode": "writeback"}]: dispatch 2024-03-30T15:15:29.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:29 smithi072 bash[28946]: audit 2024-03-30T15:15:28.580275+0000 mon.a (mon.0) 2128 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi072-64171-49"}]: dispatch 2024-03-30T15:15:29.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:29 smithi072 bash[28946]: cluster 2024-03-30T15:15:29.121811+0000 mon.a (mon.0) 2129 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:15:29.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:29 smithi072 bash[28946]: audit 2024-03-30T15:15:29.124410+0000 mon.a (mon.0) 2130 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi072-64163-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi072-64163-39"}]': finished 2024-03-30T15:15:29.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:29 smithi072 bash[28946]: audit 2024-03-30T15:15:29.124681+0000 mon.a (mon.0) 2131 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-33", "mode": "writeback"}]': finished 2024-03-30T15:15:29.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:29 smithi072 bash[28946]: audit 2024-03-30T15:15:29.124862+0000 mon.a (mon.0) 2132 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi072-64171-49"}]': finished 2024-03-30T15:15:29.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:29 smithi072 bash[28946]: cluster 2024-03-30T15:15:29.135042+0000 mon.a (mon.0) 2133 : cluster 0 osdmap e271: 8 total, 8 up, 8 in 2024-03-30T15:15:29.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:29 smithi072 bash[28946]: audit 2024-03-30T15:15:29.171150+0000 mon.a (mon.0) 2134 : audit 1 from='client.? 172.21.15.72:0/772482678' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi072-64171-50"}]: dispatch 2024-03-30T15:15:29.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:29 smithi072 bash[28946]: audit 2024-03-30T15:15:29.172178+0000 mon.a (mon.0) 2135 : audit 1 from='client.? 172.21.15.72:0/772482678' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi072-64171-50"}]: dispatch 2024-03-30T15:15:29.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:29 smithi072 bash[28946]: audit 2024-03-30T15:15:29.172590+0000 mon.a (mon.0) 2136 : audit 1 from='client.? 172.21.15.72:0/772482678' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi072-64171-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:29.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:29 smithi072 bash[28946]: audit 2024-03-30T15:15:29.334917+0000 mon.a (mon.0) 2137 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:15:29.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:29 smithi172 bash[23680]: cluster 2024-03-30T15:15:27.985185+0000 mgr.y (mgr.14526) 320 : cluster 0 pgmap v408: 228 pgs: 32 creating+peering, 196 active+clean; 4.6 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:15:29.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:29 smithi172 bash[23680]: audit 2024-03-30T15:15:28.120519+0000 mon.a (mon.0) 2125 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi072-64171-49"}]': finished 2024-03-30T15:15:29.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:29 smithi172 bash[23680]: audit 2024-03-30T15:15:28.130467+0000 mon.c (mon.2) 367 : audit 1 from='client.? 172.21.15.72:0/2664613795' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi072-64171-49"}]: dispatch 2024-03-30T15:15:29.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:29 smithi172 bash[23680]: cluster 2024-03-30T15:15:28.577710+0000 mon.a (mon.0) 2126 : cluster 0 osdmap e270: 8 total, 8 up, 8 in 2024-03-30T15:15:29.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:29 smithi172 bash[23680]: audit 2024-03-30T15:15:28.579573+0000 mon.a (mon.0) 2127 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-33", "mode": "writeback"}]: dispatch 2024-03-30T15:15:29.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:29 smithi172 bash[23680]: audit 2024-03-30T15:15:28.580275+0000 mon.a (mon.0) 2128 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi072-64171-49"}]: dispatch 2024-03-30T15:15:29.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:29 smithi172 bash[23680]: cluster 2024-03-30T15:15:29.121811+0000 mon.a (mon.0) 2129 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:15:29.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:29 smithi172 bash[23680]: audit 2024-03-30T15:15:29.124410+0000 mon.a (mon.0) 2130 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi072-64163-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi072-64163-39"}]': finished 2024-03-30T15:15:29.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:29 smithi172 bash[23680]: audit 2024-03-30T15:15:29.124681+0000 mon.a (mon.0) 2131 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-33", "mode": "writeback"}]': finished 2024-03-30T15:15:29.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:29 smithi172 bash[23680]: audit 2024-03-30T15:15:29.124862+0000 mon.a (mon.0) 2132 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi072-64171-49"}]': finished 2024-03-30T15:15:29.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:29 smithi172 bash[23680]: cluster 2024-03-30T15:15:29.135042+0000 mon.a (mon.0) 2133 : cluster 0 osdmap e271: 8 total, 8 up, 8 in 2024-03-30T15:15:29.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:29 smithi172 bash[23680]: audit 2024-03-30T15:15:29.171150+0000 mon.a (mon.0) 2134 : audit 1 from='client.? 172.21.15.72:0/772482678' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi072-64171-50"}]: dispatch 2024-03-30T15:15:29.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:29 smithi172 bash[23680]: audit 2024-03-30T15:15:29.172178+0000 mon.a (mon.0) 2135 : audit 1 from='client.? 172.21.15.72:0/772482678' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi072-64171-50"}]: dispatch 2024-03-30T15:15:29.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:29 smithi172 bash[23680]: audit 2024-03-30T15:15:29.172590+0000 mon.a (mon.0) 2136 : audit 1 from='client.? 172.21.15.72:0/772482678' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi072-64171-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:29.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:29 smithi172 bash[23680]: audit 2024-03-30T15:15:29.334917+0000 mon.a (mon.0) 2137 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:15:31.417 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:15:31 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:15:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:15:31.464 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:15:31 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:15:31.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:31 smithi072 bash[21573]: cluster 2024-03-30T15:15:29.985944+0000 mgr.y (mgr.14526) 321 : cluster 0 pgmap v411: 236 pgs: 8 unknown, 32 creating+peering, 196 active+clean; 4.6 MiB data, 607 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:15:31.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:31 smithi072 bash[21573]: audit 2024-03-30T15:15:30.127197+0000 mon.a (mon.0) 2138 : audit 1 from='client.? 172.21.15.72:0/772482678' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi072-64171-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:15:31.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:31 smithi072 bash[21573]: audit 2024-03-30T15:15:30.127455+0000 mon.a (mon.0) 2139 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:15:31.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:31 smithi072 bash[21573]: cluster 2024-03-30T15:15:30.136675+0000 mon.a (mon.0) 2140 : cluster 0 osdmap e272: 8 total, 8 up, 8 in 2024-03-30T15:15:31.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:31 smithi072 bash[21573]: audit 2024-03-30T15:15:30.143995+0000 mon.a (mon.0) 2141 : audit 1 from='client.? 172.21.15.72:0/772482678' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi072-64171-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi072-64171-50"}]: dispatch 2024-03-30T15:15:31.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:31 smithi072 bash[21573]: audit 2024-03-30T15:15:30.144871+0000 mon.a (mon.0) 2142 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-33"}]: dispatch 2024-03-30T15:15:31.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:31 smithi072 bash[28946]: cluster 2024-03-30T15:15:29.985944+0000 mgr.y (mgr.14526) 321 : cluster 0 pgmap v411: 236 pgs: 8 unknown, 32 creating+peering, 196 active+clean; 4.6 MiB data, 607 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:15:31.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:31 smithi072 bash[28946]: audit 2024-03-30T15:15:30.127197+0000 mon.a (mon.0) 2138 : audit 1 from='client.? 172.21.15.72:0/772482678' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi072-64171-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:15:31.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:31 smithi072 bash[28946]: audit 2024-03-30T15:15:30.127455+0000 mon.a (mon.0) 2139 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:15:31.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:31 smithi072 bash[28946]: cluster 2024-03-30T15:15:30.136675+0000 mon.a (mon.0) 2140 : cluster 0 osdmap e272: 8 total, 8 up, 8 in 2024-03-30T15:15:31.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:31 smithi072 bash[28946]: audit 2024-03-30T15:15:30.143995+0000 mon.a (mon.0) 2141 : audit 1 from='client.? 172.21.15.72:0/772482678' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi072-64171-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi072-64171-50"}]: dispatch 2024-03-30T15:15:31.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:31 smithi072 bash[28946]: audit 2024-03-30T15:15:30.144871+0000 mon.a (mon.0) 2142 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-33"}]: dispatch 2024-03-30T15:15:31.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:31 smithi172 bash[23680]: cluster 2024-03-30T15:15:29.985944+0000 mgr.y (mgr.14526) 321 : cluster 0 pgmap v411: 236 pgs: 8 unknown, 32 creating+peering, 196 active+clean; 4.6 MiB data, 607 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:15:31.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:31 smithi172 bash[23680]: audit 2024-03-30T15:15:30.127197+0000 mon.a (mon.0) 2138 : audit 1 from='client.? 172.21.15.72:0/772482678' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi072-64171-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:15:31.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:31 smithi172 bash[23680]: audit 2024-03-30T15:15:30.127455+0000 mon.a (mon.0) 2139 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:15:31.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:31 smithi172 bash[23680]: cluster 2024-03-30T15:15:30.136675+0000 mon.a (mon.0) 2140 : cluster 0 osdmap e272: 8 total, 8 up, 8 in 2024-03-30T15:15:31.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:31 smithi172 bash[23680]: audit 2024-03-30T15:15:30.143995+0000 mon.a (mon.0) 2141 : audit 1 from='client.? 172.21.15.72:0/772482678' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi072-64171-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi072-64171-50"}]: dispatch 2024-03-30T15:15:31.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:31 smithi172 bash[23680]: audit 2024-03-30T15:15:30.144871+0000 mon.a (mon.0) 2142 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-33"}]: dispatch 2024-03-30T15:15:32.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:32 smithi072 bash[21573]: cluster 2024-03-30T15:15:31.128258+0000 mon.a (mon.0) 2143 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:15:32.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:32 smithi072 bash[21573]: audit 2024-03-30T15:15:31.130681+0000 mon.a (mon.0) 2144 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-33"}]': finished 2024-03-30T15:15:32.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:32 smithi072 bash[21573]: audit 2024-03-30T15:15:31.131615+0000 mgr.y (mgr.14526) 322 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:15:32.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:32 smithi072 bash[21573]: cluster 2024-03-30T15:15:31.586242+0000 mon.a (mon.0) 2145 : cluster 0 osdmap e273: 8 total, 8 up, 8 in 2024-03-30T15:15:32.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:32 smithi072 bash[21573]: audit 2024-03-30T15:15:31.588012+0000 mon.c (mon.2) 368 : audit 1 from='client.? 172.21.15.72:0/1172191487' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi072-64163-39"}]: dispatch 2024-03-30T15:15:32.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:32 smithi072 bash[21573]: audit 2024-03-30T15:15:31.598854+0000 mon.a (mon.0) 2146 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi072-64163-39"}]: dispatch 2024-03-30T15:15:32.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:32 smithi072 bash[21573]: audit 2024-03-30T15:15:32.133905+0000 mon.a (mon.0) 2147 : audit 1 from='client.? 172.21.15.72:0/772482678' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi072-64171-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi072-64171-50"}]': finished 2024-03-30T15:15:32.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:32 smithi072 bash[21573]: audit 2024-03-30T15:15:32.134094+0000 mon.a (mon.0) 2148 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi072-64163-39"}]': finished 2024-03-30T15:15:32.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:32 smithi072 bash[21573]: cluster 2024-03-30T15:15:32.141866+0000 mon.a (mon.0) 2149 : cluster 0 osdmap e274: 8 total, 8 up, 8 in 2024-03-30T15:15:32.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:32 smithi072 bash[21573]: audit 2024-03-30T15:15:32.142380+0000 mon.c (mon.2) 369 : audit 1 from='client.? 172.21.15.72:0/1172191487' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi072-64163-39"}]: dispatch 2024-03-30T15:15:32.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:32 smithi072 bash[21573]: audit 2024-03-30T15:15:32.144524+0000 mon.a (mon.0) 2150 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi072-64163-39"}]: dispatch 2024-03-30T15:15:32.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:32 smithi072 bash[28946]: cluster 2024-03-30T15:15:31.128258+0000 mon.a (mon.0) 2143 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:15:32.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:32 smithi072 bash[28946]: audit 2024-03-30T15:15:31.130681+0000 mon.a (mon.0) 2144 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-33"}]': finished 2024-03-30T15:15:32.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:32 smithi072 bash[28946]: audit 2024-03-30T15:15:31.131615+0000 mgr.y (mgr.14526) 322 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:15:32.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:32 smithi072 bash[28946]: cluster 2024-03-30T15:15:31.586242+0000 mon.a (mon.0) 2145 : cluster 0 osdmap e273: 8 total, 8 up, 8 in 2024-03-30T15:15:32.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:32 smithi072 bash[28946]: audit 2024-03-30T15:15:31.588012+0000 mon.c (mon.2) 368 : audit 1 from='client.? 172.21.15.72:0/1172191487' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi072-64163-39"}]: dispatch 2024-03-30T15:15:32.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:32 smithi072 bash[28946]: audit 2024-03-30T15:15:31.598854+0000 mon.a (mon.0) 2146 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi072-64163-39"}]: dispatch 2024-03-30T15:15:32.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:32 smithi072 bash[28946]: audit 2024-03-30T15:15:32.133905+0000 mon.a (mon.0) 2147 : audit 1 from='client.? 172.21.15.72:0/772482678' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi072-64171-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi072-64171-50"}]': finished 2024-03-30T15:15:32.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:32 smithi072 bash[28946]: audit 2024-03-30T15:15:32.134094+0000 mon.a (mon.0) 2148 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi072-64163-39"}]': finished 2024-03-30T15:15:32.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:32 smithi072 bash[28946]: cluster 2024-03-30T15:15:32.141866+0000 mon.a (mon.0) 2149 : cluster 0 osdmap e274: 8 total, 8 up, 8 in 2024-03-30T15:15:32.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:32 smithi072 bash[28946]: audit 2024-03-30T15:15:32.142380+0000 mon.c (mon.2) 369 : audit 1 from='client.? 172.21.15.72:0/1172191487' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi072-64163-39"}]: dispatch 2024-03-30T15:15:32.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:32 smithi072 bash[28946]: audit 2024-03-30T15:15:32.144524+0000 mon.a (mon.0) 2150 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi072-64163-39"}]: dispatch 2024-03-30T15:15:32.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:32 smithi172 bash[23680]: cluster 2024-03-30T15:15:31.128258+0000 mon.a (mon.0) 2143 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:15:32.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:32 smithi172 bash[23680]: audit 2024-03-30T15:15:31.130681+0000 mon.a (mon.0) 2144 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-33"}]': finished 2024-03-30T15:15:32.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:32 smithi172 bash[23680]: audit 2024-03-30T15:15:31.131615+0000 mgr.y (mgr.14526) 322 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:15:32.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:32 smithi172 bash[23680]: cluster 2024-03-30T15:15:31.586242+0000 mon.a (mon.0) 2145 : cluster 0 osdmap e273: 8 total, 8 up, 8 in 2024-03-30T15:15:32.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:32 smithi172 bash[23680]: audit 2024-03-30T15:15:31.588012+0000 mon.c (mon.2) 368 : audit 1 from='client.? 172.21.15.72:0/1172191487' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi072-64163-39"}]: dispatch 2024-03-30T15:15:32.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:32 smithi172 bash[23680]: audit 2024-03-30T15:15:31.598854+0000 mon.a (mon.0) 2146 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi072-64163-39"}]: dispatch 2024-03-30T15:15:32.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:32 smithi172 bash[23680]: audit 2024-03-30T15:15:32.133905+0000 mon.a (mon.0) 2147 : audit 1 from='client.? 172.21.15.72:0/772482678' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi072-64171-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi072-64171-50"}]': finished 2024-03-30T15:15:32.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:32 smithi172 bash[23680]: audit 2024-03-30T15:15:32.134094+0000 mon.a (mon.0) 2148 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi072-64163-39"}]': finished 2024-03-30T15:15:32.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:32 smithi172 bash[23680]: cluster 2024-03-30T15:15:32.141866+0000 mon.a (mon.0) 2149 : cluster 0 osdmap e274: 8 total, 8 up, 8 in 2024-03-30T15:15:32.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:32 smithi172 bash[23680]: audit 2024-03-30T15:15:32.142380+0000 mon.c (mon.2) 369 : audit 1 from='client.? 172.21.15.72:0/1172191487' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi072-64163-39"}]: dispatch 2024-03-30T15:15:32.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:32 smithi172 bash[23680]: audit 2024-03-30T15:15:32.144524+0000 mon.a (mon.0) 2150 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi072-64163-39"}]: dispatch 2024-03-30T15:15:33.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:33 smithi072 bash[21573]: cluster 2024-03-30T15:15:31.986736+0000 mgr.y (mgr.14526) 323 : cluster 0 pgmap v414: 228 pgs: 228 active+clean; 4.6 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 4 op/s 2024-03-30T15:15:33.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:33 smithi072 bash[21573]: cluster 2024-03-30T15:15:32.588804+0000 mon.a (mon.0) 2151 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:15:33.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:33 smithi072 bash[21573]: audit 2024-03-30T15:15:33.138480+0000 mon.a (mon.0) 2152 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi072-64163-39"}]': finished 2024-03-30T15:15:33.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:33 smithi072 bash[21573]: cluster 2024-03-30T15:15:33.146578+0000 mon.a (mon.0) 2153 : cluster 0 osdmap e275: 8 total, 8 up, 8 in 2024-03-30T15:15:33.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:33 smithi072 bash[21573]: audit 2024-03-30T15:15:33.149910+0000 mon.a (mon.0) 2154 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:15:33.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:33 smithi072 bash[21573]: audit 2024-03-30T15:15:33.189961+0000 mon.c (mon.2) 370 : audit 1 from='client.? 172.21.15.72:0/1730191610' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi072-64163-40"}]: dispatch 2024-03-30T15:15:33.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:33 smithi072 bash[21573]: audit 2024-03-30T15:15:33.190647+0000 mon.a (mon.0) 2155 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi072-64163-40"}]: dispatch 2024-03-30T15:15:33.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:33 smithi072 bash[21573]: audit 2024-03-30T15:15:33.191742+0000 mon.c (mon.2) 371 : audit 1 from='client.? 172.21.15.72:0/1730191610' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi072-64163-40"}]: dispatch 2024-03-30T15:15:33.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:33 smithi072 bash[21573]: audit 2024-03-30T15:15:33.192011+0000 mon.a (mon.0) 2156 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi072-64163-40"}]: dispatch 2024-03-30T15:15:33.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:33 smithi072 bash[21573]: audit 2024-03-30T15:15:33.192433+0000 mon.c (mon.2) 372 : audit 1 from='client.? 172.21.15.72:0/1730191610' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi072-64163-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:33.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:33 smithi072 bash[21573]: audit 2024-03-30T15:15:33.192690+0000 mon.a (mon.0) 2157 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi072-64163-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:33.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:33 smithi072 bash[28946]: cluster 2024-03-30T15:15:31.986736+0000 mgr.y (mgr.14526) 323 : cluster 0 pgmap v414: 228 pgs: 228 active+clean; 4.6 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 4 op/s 2024-03-30T15:15:33.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:33 smithi072 bash[28946]: cluster 2024-03-30T15:15:32.588804+0000 mon.a (mon.0) 2151 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:15:33.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:33 smithi072 bash[28946]: audit 2024-03-30T15:15:33.138480+0000 mon.a (mon.0) 2152 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi072-64163-39"}]': finished 2024-03-30T15:15:33.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:33 smithi072 bash[28946]: cluster 2024-03-30T15:15:33.146578+0000 mon.a (mon.0) 2153 : cluster 0 osdmap e275: 8 total, 8 up, 8 in 2024-03-30T15:15:33.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:33 smithi072 bash[28946]: audit 2024-03-30T15:15:33.149910+0000 mon.a (mon.0) 2154 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:15:33.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:33 smithi072 bash[28946]: audit 2024-03-30T15:15:33.189961+0000 mon.c (mon.2) 370 : audit 1 from='client.? 172.21.15.72:0/1730191610' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi072-64163-40"}]: dispatch 2024-03-30T15:15:33.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:33 smithi072 bash[28946]: audit 2024-03-30T15:15:33.190647+0000 mon.a (mon.0) 2155 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi072-64163-40"}]: dispatch 2024-03-30T15:15:33.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:33 smithi072 bash[28946]: audit 2024-03-30T15:15:33.191742+0000 mon.c (mon.2) 371 : audit 1 from='client.? 172.21.15.72:0/1730191610' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi072-64163-40"}]: dispatch 2024-03-30T15:15:33.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:33 smithi072 bash[28946]: audit 2024-03-30T15:15:33.192011+0000 mon.a (mon.0) 2156 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi072-64163-40"}]: dispatch 2024-03-30T15:15:33.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:33 smithi072 bash[28946]: audit 2024-03-30T15:15:33.192433+0000 mon.c (mon.2) 372 : audit 1 from='client.? 172.21.15.72:0/1730191610' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi072-64163-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:33.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:33 smithi072 bash[28946]: audit 2024-03-30T15:15:33.192690+0000 mon.a (mon.0) 2157 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi072-64163-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:33.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:33 smithi172 bash[23680]: cluster 2024-03-30T15:15:31.986736+0000 mgr.y (mgr.14526) 323 : cluster 0 pgmap v414: 228 pgs: 228 active+clean; 4.6 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 4 op/s 2024-03-30T15:15:33.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:33 smithi172 bash[23680]: cluster 2024-03-30T15:15:32.588804+0000 mon.a (mon.0) 2151 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:15:33.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:33 smithi172 bash[23680]: audit 2024-03-30T15:15:33.138480+0000 mon.a (mon.0) 2152 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi072-64163-39"}]': finished 2024-03-30T15:15:33.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:33 smithi172 bash[23680]: cluster 2024-03-30T15:15:33.146578+0000 mon.a (mon.0) 2153 : cluster 0 osdmap e275: 8 total, 8 up, 8 in 2024-03-30T15:15:33.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:33 smithi172 bash[23680]: audit 2024-03-30T15:15:33.149910+0000 mon.a (mon.0) 2154 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:15:33.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:33 smithi172 bash[23680]: audit 2024-03-30T15:15:33.189961+0000 mon.c (mon.2) 370 : audit 1 from='client.? 172.21.15.72:0/1730191610' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi072-64163-40"}]: dispatch 2024-03-30T15:15:33.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:33 smithi172 bash[23680]: audit 2024-03-30T15:15:33.190647+0000 mon.a (mon.0) 2155 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi072-64163-40"}]: dispatch 2024-03-30T15:15:33.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:33 smithi172 bash[23680]: audit 2024-03-30T15:15:33.191742+0000 mon.c (mon.2) 371 : audit 1 from='client.? 172.21.15.72:0/1730191610' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi072-64163-40"}]: dispatch 2024-03-30T15:15:33.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:33 smithi172 bash[23680]: audit 2024-03-30T15:15:33.192011+0000 mon.a (mon.0) 2156 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi072-64163-40"}]: dispatch 2024-03-30T15:15:33.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:33 smithi172 bash[23680]: audit 2024-03-30T15:15:33.192433+0000 mon.c (mon.2) 372 : audit 1 from='client.? 172.21.15.72:0/1730191610' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi072-64163-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:33.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:33 smithi172 bash[23680]: audit 2024-03-30T15:15:33.192690+0000 mon.a (mon.0) 2157 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi072-64163-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:35.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:35 smithi072 bash[21573]: cluster 2024-03-30T15:15:33.987579+0000 mgr.y (mgr.14526) 324 : cluster 0 pgmap v417: 236 pgs: 40 unknown, 196 active+clean; 4.6 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:15:35.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:35 smithi072 bash[21573]: audit 2024-03-30T15:15:34.142676+0000 mon.a (mon.0) 2158 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:15:35.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:35 smithi072 bash[21573]: audit 2024-03-30T15:15:34.142835+0000 mon.a (mon.0) 2159 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi072-64163-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:15:35.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:35 smithi072 bash[21573]: cluster 2024-03-30T15:15:34.154903+0000 mon.a (mon.0) 2160 : cluster 0 osdmap e276: 8 total, 8 up, 8 in 2024-03-30T15:15:35.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:35 smithi072 bash[21573]: audit 2024-03-30T15:15:34.156693+0000 mon.c (mon.2) 373 : audit 1 from='client.? 172.21.15.72:0/1730191610' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi072-64163-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi072-64163-40"}]: dispatch 2024-03-30T15:15:35.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:35 smithi072 bash[21573]: audit 2024-03-30T15:15:34.159994+0000 mon.a (mon.0) 2161 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi072-64163-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi072-64163-40"}]: dispatch 2024-03-30T15:15:35.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:35 smithi072 bash[21573]: audit 2024-03-30T15:15:34.161399+0000 mon.a (mon.0) 2162 : audit 1 from='client.? 172.21.15.72:0/772482678' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi072-64171-50"}]: dispatch 2024-03-30T15:15:35.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:35 smithi072 bash[21573]: audit 2024-03-30T15:15:34.162582+0000 mon.a (mon.0) 2163 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:15:35.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:35 smithi072 bash[28946]: cluster 2024-03-30T15:15:33.987579+0000 mgr.y (mgr.14526) 324 : cluster 0 pgmap v417: 236 pgs: 40 unknown, 196 active+clean; 4.6 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:15:35.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:35 smithi072 bash[28946]: audit 2024-03-30T15:15:34.142676+0000 mon.a (mon.0) 2158 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:15:35.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:35 smithi072 bash[28946]: audit 2024-03-30T15:15:34.142835+0000 mon.a (mon.0) 2159 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi072-64163-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:15:35.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:35 smithi072 bash[28946]: cluster 2024-03-30T15:15:34.154903+0000 mon.a (mon.0) 2160 : cluster 0 osdmap e276: 8 total, 8 up, 8 in 2024-03-30T15:15:35.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:35 smithi072 bash[28946]: audit 2024-03-30T15:15:34.156693+0000 mon.c (mon.2) 373 : audit 1 from='client.? 172.21.15.72:0/1730191610' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi072-64163-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi072-64163-40"}]: dispatch 2024-03-30T15:15:35.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:35 smithi072 bash[28946]: audit 2024-03-30T15:15:34.159994+0000 mon.a (mon.0) 2161 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi072-64163-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi072-64163-40"}]: dispatch 2024-03-30T15:15:35.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:35 smithi072 bash[28946]: audit 2024-03-30T15:15:34.161399+0000 mon.a (mon.0) 2162 : audit 1 from='client.? 172.21.15.72:0/772482678' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi072-64171-50"}]: dispatch 2024-03-30T15:15:35.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:35 smithi072 bash[28946]: audit 2024-03-30T15:15:34.162582+0000 mon.a (mon.0) 2163 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:15:35.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:35 smithi172 bash[23680]: cluster 2024-03-30T15:15:33.987579+0000 mgr.y (mgr.14526) 324 : cluster 0 pgmap v417: 236 pgs: 40 unknown, 196 active+clean; 4.6 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:15:35.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:35 smithi172 bash[23680]: audit 2024-03-30T15:15:34.142676+0000 mon.a (mon.0) 2158 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:15:35.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:35 smithi172 bash[23680]: audit 2024-03-30T15:15:34.142835+0000 mon.a (mon.0) 2159 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi072-64163-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:15:35.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:35 smithi172 bash[23680]: cluster 2024-03-30T15:15:34.154903+0000 mon.a (mon.0) 2160 : cluster 0 osdmap e276: 8 total, 8 up, 8 in 2024-03-30T15:15:35.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:35 smithi172 bash[23680]: audit 2024-03-30T15:15:34.156693+0000 mon.c (mon.2) 373 : audit 1 from='client.? 172.21.15.72:0/1730191610' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi072-64163-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi072-64163-40"}]: dispatch 2024-03-30T15:15:35.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:35 smithi172 bash[23680]: audit 2024-03-30T15:15:34.159994+0000 mon.a (mon.0) 2161 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi072-64163-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi072-64163-40"}]: dispatch 2024-03-30T15:15:35.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:35 smithi172 bash[23680]: audit 2024-03-30T15:15:34.161399+0000 mon.a (mon.0) 2162 : audit 1 from='client.? 172.21.15.72:0/772482678' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi072-64171-50"}]: dispatch 2024-03-30T15:15:35.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:35 smithi172 bash[23680]: audit 2024-03-30T15:15:34.162582+0000 mon.a (mon.0) 2163 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:15:36.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:36 smithi072 bash[21573]: audit 2024-03-30T15:15:35.145982+0000 mon.a (mon.0) 2164 : audit 1 from='client.? 172.21.15.72:0/772482678' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi072-64171-50"}]': finished 2024-03-30T15:15:36.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:36 smithi072 bash[21573]: audit 2024-03-30T15:15:35.146208+0000 mon.a (mon.0) 2165 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-35", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:15:36.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:36 smithi072 bash[21573]: cluster 2024-03-30T15:15:35.596154+0000 mon.a (mon.0) 2166 : cluster 0 osdmap e277: 8 total, 8 up, 8 in 2024-03-30T15:15:36.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:36 smithi072 bash[21573]: audit 2024-03-30T15:15:35.597588+0000 mon.a (mon.0) 2167 : audit 1 from='client.? 172.21.15.72:0/772482678' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi072-64171-50"}]: dispatch 2024-03-30T15:15:36.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:36 smithi072 bash[21573]: audit 2024-03-30T15:15:35.597901+0000 mon.a (mon.0) 2168 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-35"}]: dispatch 2024-03-30T15:15:36.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:36 smithi072 bash[21573]: audit 2024-03-30T15:15:35.922787+0000 mon.c (mon.2) 374 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:15:36.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:36 smithi072 bash[21573]: audit 2024-03-30T15:15:36.149918+0000 mon.a (mon.0) 2169 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemove_smithi072-64163-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi072-64163-40"}]': finished 2024-03-30T15:15:36.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:36 smithi072 bash[21573]: audit 2024-03-30T15:15:36.150213+0000 mon.a (mon.0) 2170 : audit 1 from='client.? 172.21.15.72:0/772482678' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi072-64171-50"}]': finished 2024-03-30T15:15:36.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:36 smithi072 bash[21573]: audit 2024-03-30T15:15:36.150384+0000 mon.a (mon.0) 2171 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-35"}]': finished 2024-03-30T15:15:36.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:36 smithi072 bash[21573]: cluster 2024-03-30T15:15:36.157754+0000 mon.a (mon.0) 2172 : cluster 0 osdmap e278: 8 total, 8 up, 8 in 2024-03-30T15:15:36.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:36 smithi072 bash[21573]: audit 2024-03-30T15:15:36.159334+0000 mon.a (mon.0) 2173 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-35", "mode": "writeback"}]: dispatch 2024-03-30T15:15:36.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:36 smithi072 bash[28946]: audit 2024-03-30T15:15:35.145982+0000 mon.a (mon.0) 2164 : audit 1 from='client.? 172.21.15.72:0/772482678' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi072-64171-50"}]': finished 2024-03-30T15:15:36.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:36 smithi072 bash[28946]: audit 2024-03-30T15:15:35.146208+0000 mon.a (mon.0) 2165 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-35", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:15:36.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:36 smithi072 bash[28946]: cluster 2024-03-30T15:15:35.596154+0000 mon.a (mon.0) 2166 : cluster 0 osdmap e277: 8 total, 8 up, 8 in 2024-03-30T15:15:36.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:36 smithi072 bash[28946]: audit 2024-03-30T15:15:35.597588+0000 mon.a (mon.0) 2167 : audit 1 from='client.? 172.21.15.72:0/772482678' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi072-64171-50"}]: dispatch 2024-03-30T15:15:36.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:36 smithi072 bash[28946]: audit 2024-03-30T15:15:35.597901+0000 mon.a (mon.0) 2168 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-35"}]: dispatch 2024-03-30T15:15:36.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:36 smithi072 bash[28946]: audit 2024-03-30T15:15:35.922787+0000 mon.c (mon.2) 374 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:15:36.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:36 smithi072 bash[28946]: audit 2024-03-30T15:15:36.149918+0000 mon.a (mon.0) 2169 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemove_smithi072-64163-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi072-64163-40"}]': finished 2024-03-30T15:15:36.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:36 smithi072 bash[28946]: audit 2024-03-30T15:15:36.150213+0000 mon.a (mon.0) 2170 : audit 1 from='client.? 172.21.15.72:0/772482678' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi072-64171-50"}]': finished 2024-03-30T15:15:36.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:36 smithi072 bash[28946]: audit 2024-03-30T15:15:36.150384+0000 mon.a (mon.0) 2171 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-35"}]': finished 2024-03-30T15:15:36.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:36 smithi072 bash[28946]: cluster 2024-03-30T15:15:36.157754+0000 mon.a (mon.0) 2172 : cluster 0 osdmap e278: 8 total, 8 up, 8 in 2024-03-30T15:15:36.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:36 smithi072 bash[28946]: audit 2024-03-30T15:15:36.159334+0000 mon.a (mon.0) 2173 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-35", "mode": "writeback"}]: dispatch 2024-03-30T15:15:36.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:36 smithi172 bash[23680]: audit 2024-03-30T15:15:35.145982+0000 mon.a (mon.0) 2164 : audit 1 from='client.? 172.21.15.72:0/772482678' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi072-64171-50"}]': finished 2024-03-30T15:15:36.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:36 smithi172 bash[23680]: audit 2024-03-30T15:15:35.146208+0000 mon.a (mon.0) 2165 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-35", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:15:36.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:36 smithi172 bash[23680]: cluster 2024-03-30T15:15:35.596154+0000 mon.a (mon.0) 2166 : cluster 0 osdmap e277: 8 total, 8 up, 8 in 2024-03-30T15:15:36.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:36 smithi172 bash[23680]: audit 2024-03-30T15:15:35.597588+0000 mon.a (mon.0) 2167 : audit 1 from='client.? 172.21.15.72:0/772482678' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi072-64171-50"}]: dispatch 2024-03-30T15:15:36.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:36 smithi172 bash[23680]: audit 2024-03-30T15:15:35.597901+0000 mon.a (mon.0) 2168 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-35"}]: dispatch 2024-03-30T15:15:36.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:36 smithi172 bash[23680]: audit 2024-03-30T15:15:35.922787+0000 mon.c (mon.2) 374 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:15:36.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:36 smithi172 bash[23680]: audit 2024-03-30T15:15:36.149918+0000 mon.a (mon.0) 2169 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemove_smithi072-64163-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi072-64163-40"}]': finished 2024-03-30T15:15:36.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:36 smithi172 bash[23680]: audit 2024-03-30T15:15:36.150213+0000 mon.a (mon.0) 2170 : audit 1 from='client.? 172.21.15.72:0/772482678' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi072-64171-50"}]': finished 2024-03-30T15:15:36.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:36 smithi172 bash[23680]: audit 2024-03-30T15:15:36.150384+0000 mon.a (mon.0) 2171 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-35"}]': finished 2024-03-30T15:15:36.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:36 smithi172 bash[23680]: cluster 2024-03-30T15:15:36.157754+0000 mon.a (mon.0) 2172 : cluster 0 osdmap e278: 8 total, 8 up, 8 in 2024-03-30T15:15:36.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:36 smithi172 bash[23680]: audit 2024-03-30T15:15:36.159334+0000 mon.a (mon.0) 2173 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-35", "mode": "writeback"}]: dispatch 2024-03-30T15:15:37.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:37 smithi072 bash[21573]: cluster 2024-03-30T15:15:35.989632+0000 mgr.y (mgr.14526) 325 : cluster 0 pgmap v420: 228 pgs: 228 active+clean; 4.6 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T15:15:37.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:37 smithi072 bash[21573]: cluster 2024-03-30T15:15:37.150916+0000 mon.a (mon.0) 2174 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:15:37.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:37 smithi072 bash[21573]: audit 2024-03-30T15:15:37.153656+0000 mon.a (mon.0) 2175 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-35", "mode": "writeback"}]': finished 2024-03-30T15:15:37.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:37 smithi072 bash[21573]: cluster 2024-03-30T15:15:37.161532+0000 mon.a (mon.0) 2176 : cluster 0 osdmap e279: 8 total, 8 up, 8 in 2024-03-30T15:15:37.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:37 smithi072 bash[21573]: audit 2024-03-30T15:15:37.165040+0000 mon.a (mon.0) 2177 : audit 1 from='client.? 172.21.15.72:0/2187510415' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi072-64171-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:15:37.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:37 smithi072 bash[28946]: cluster 2024-03-30T15:15:35.989632+0000 mgr.y (mgr.14526) 325 : cluster 0 pgmap v420: 228 pgs: 228 active+clean; 4.6 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T15:15:37.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:37 smithi072 bash[28946]: cluster 2024-03-30T15:15:37.150916+0000 mon.a (mon.0) 2174 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:15:37.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:37 smithi072 bash[28946]: audit 2024-03-30T15:15:37.153656+0000 mon.a (mon.0) 2175 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-35", "mode": "writeback"}]': finished 2024-03-30T15:15:37.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:37 smithi072 bash[28946]: cluster 2024-03-30T15:15:37.161532+0000 mon.a (mon.0) 2176 : cluster 0 osdmap e279: 8 total, 8 up, 8 in 2024-03-30T15:15:37.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:37 smithi072 bash[28946]: audit 2024-03-30T15:15:37.165040+0000 mon.a (mon.0) 2177 : audit 1 from='client.? 172.21.15.72:0/2187510415' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi072-64171-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:15:37.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:37 smithi172 bash[23680]: cluster 2024-03-30T15:15:35.989632+0000 mgr.y (mgr.14526) 325 : cluster 0 pgmap v420: 228 pgs: 228 active+clean; 4.6 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T15:15:37.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:37 smithi172 bash[23680]: cluster 2024-03-30T15:15:37.150916+0000 mon.a (mon.0) 2174 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:15:37.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:37 smithi172 bash[23680]: audit 2024-03-30T15:15:37.153656+0000 mon.a (mon.0) 2175 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-35", "mode": "writeback"}]': finished 2024-03-30T15:15:37.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:37 smithi172 bash[23680]: cluster 2024-03-30T15:15:37.161532+0000 mon.a (mon.0) 2176 : cluster 0 osdmap e279: 8 total, 8 up, 8 in 2024-03-30T15:15:37.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:37 smithi172 bash[23680]: audit 2024-03-30T15:15:37.165040+0000 mon.a (mon.0) 2177 : audit 1 from='client.? 172.21.15.72:0/2187510415' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi072-64171-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:15:39.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:39 smithi172 bash[23680]: cluster 2024-03-30T15:15:37.990545+0000 mgr.y (mgr.14526) 326 : cluster 0 pgmap v423: 268 pgs: 40 unknown, 228 active+clean; 4.6 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:15:39.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:39 smithi172 bash[23680]: audit 2024-03-30T15:15:38.156698+0000 mon.a (mon.0) 2178 : audit 1 from='client.? 172.21.15.72:0/2187510415' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi072-64171-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:15:39.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:39 smithi172 bash[23680]: cluster 2024-03-30T15:15:38.169441+0000 mon.a (mon.0) 2179 : cluster 0 osdmap e280: 8 total, 8 up, 8 in 2024-03-30T15:15:39.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:39 smithi172 bash[23680]: audit 2024-03-30T15:15:38.175026+0000 mon.c (mon.2) 375 : audit 1 from='client.? 172.21.15.72:0/1730191610' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi072-64163-40"}]: dispatch 2024-03-30T15:15:39.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:39 smithi172 bash[23680]: audit 2024-03-30T15:15:38.178692+0000 mon.a (mon.0) 2180 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi072-64163-40"}]: dispatch 2024-03-30T15:15:39.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:39 smithi172 bash[23680]: cluster 2024-03-30T15:15:38.637038+0000 mon.a (mon.0) 2181 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:15:39.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:39 smithi072 bash[21573]: cluster 2024-03-30T15:15:37.990545+0000 mgr.y (mgr.14526) 326 : cluster 0 pgmap v423: 268 pgs: 40 unknown, 228 active+clean; 4.6 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:15:39.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:39 smithi072 bash[21573]: audit 2024-03-30T15:15:38.156698+0000 mon.a (mon.0) 2178 : audit 1 from='client.? 172.21.15.72:0/2187510415' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi072-64171-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:15:39.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:39 smithi072 bash[21573]: cluster 2024-03-30T15:15:38.169441+0000 mon.a (mon.0) 2179 : cluster 0 osdmap e280: 8 total, 8 up, 8 in 2024-03-30T15:15:39.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:39 smithi072 bash[21573]: audit 2024-03-30T15:15:38.175026+0000 mon.c (mon.2) 375 : audit 1 from='client.? 172.21.15.72:0/1730191610' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi072-64163-40"}]: dispatch 2024-03-30T15:15:39.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:39 smithi072 bash[21573]: audit 2024-03-30T15:15:38.178692+0000 mon.a (mon.0) 2180 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi072-64163-40"}]: dispatch 2024-03-30T15:15:39.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:39 smithi072 bash[21573]: cluster 2024-03-30T15:15:38.637038+0000 mon.a (mon.0) 2181 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:15:39.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:39 smithi072 bash[28946]: cluster 2024-03-30T15:15:37.990545+0000 mgr.y (mgr.14526) 326 : cluster 0 pgmap v423: 268 pgs: 40 unknown, 228 active+clean; 4.6 MiB data, 616 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:15:39.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:39 smithi072 bash[28946]: audit 2024-03-30T15:15:38.156698+0000 mon.a (mon.0) 2178 : audit 1 from='client.? 172.21.15.72:0/2187510415' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi072-64171-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:15:39.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:39 smithi072 bash[28946]: cluster 2024-03-30T15:15:38.169441+0000 mon.a (mon.0) 2179 : cluster 0 osdmap e280: 8 total, 8 up, 8 in 2024-03-30T15:15:39.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:39 smithi072 bash[28946]: audit 2024-03-30T15:15:38.175026+0000 mon.c (mon.2) 375 : audit 1 from='client.? 172.21.15.72:0/1730191610' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi072-64163-40"}]: dispatch 2024-03-30T15:15:39.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:39 smithi072 bash[28946]: audit 2024-03-30T15:15:38.178692+0000 mon.a (mon.0) 2180 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi072-64163-40"}]: dispatch 2024-03-30T15:15:39.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:39 smithi072 bash[28946]: cluster 2024-03-30T15:15:38.637038+0000 mon.a (mon.0) 2181 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:15:40.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:40 smithi172 bash[23680]: audit 2024-03-30T15:15:39.161195+0000 mon.a (mon.0) 2182 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi072-64163-40"}]': finished 2024-03-30T15:15:40.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:40 smithi172 bash[23680]: cluster 2024-03-30T15:15:39.173241+0000 mon.a (mon.0) 2183 : cluster 0 osdmap e281: 8 total, 8 up, 8 in 2024-03-30T15:15:40.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:40 smithi172 bash[23680]: audit 2024-03-30T15:15:39.174923+0000 mon.c (mon.2) 376 : audit 1 from='client.? 172.21.15.72:0/1730191610' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi072-64163-40"}]: dispatch 2024-03-30T15:15:40.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:40 smithi172 bash[23680]: audit 2024-03-30T15:15:39.175889+0000 mon.a (mon.0) 2184 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi072-64163-40"}]: dispatch 2024-03-30T15:15:40.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:40 smithi172 bash[23680]: audit 2024-03-30T15:15:39.226329+0000 mon.c (mon.2) 377 : audit 1 from='client.? 172.21.15.72:0/2271956108' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi072-64171-52"}]: dispatch 2024-03-30T15:15:40.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:40 smithi172 bash[23680]: audit 2024-03-30T15:15:39.226836+0000 mon.a (mon.0) 2185 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi072-64171-52"}]: dispatch 2024-03-30T15:15:40.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:40 smithi172 bash[23680]: audit 2024-03-30T15:15:39.227497+0000 mon.c (mon.2) 378 : audit 1 from='client.? 172.21.15.72:0/2271956108' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi072-64171-52"}]: dispatch 2024-03-30T15:15:40.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:40 smithi172 bash[23680]: audit 2024-03-30T15:15:39.227751+0000 mon.a (mon.0) 2186 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi072-64171-52"}]: dispatch 2024-03-30T15:15:40.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:40 smithi172 bash[23680]: audit 2024-03-30T15:15:39.228226+0000 mon.c (mon.2) 379 : audit 1 from='client.? 172.21.15.72:0/2271956108' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi072-64171-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:40.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:40 smithi172 bash[23680]: audit 2024-03-30T15:15:39.228484+0000 mon.a (mon.0) 2187 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi072-64171-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:40.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:40 smithi172 bash[23680]: audit 2024-03-30T15:15:39.318111+0000 mon.a (mon.0) 2188 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:15:40.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:40 smithi172 bash[23680]: audit 2024-03-30T15:15:40.164842+0000 mon.a (mon.0) 2189 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi072-64163-40"}]': finished 2024-03-30T15:15:40.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:40 smithi172 bash[23680]: audit 2024-03-30T15:15:40.165022+0000 mon.a (mon.0) 2190 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi072-64171-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:15:40.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:40 smithi172 bash[23680]: audit 2024-03-30T15:15:40.165309+0000 mon.a (mon.0) 2191 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:15:40.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:40 smithi172 bash[23680]: cluster 2024-03-30T15:15:40.173045+0000 mon.a (mon.0) 2192 : cluster 0 osdmap e282: 8 total, 8 up, 8 in 2024-03-30T15:15:40.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:40 smithi072 bash[21573]: audit 2024-03-30T15:15:39.161195+0000 mon.a (mon.0) 2182 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi072-64163-40"}]': finished 2024-03-30T15:15:40.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:40 smithi072 bash[21573]: cluster 2024-03-30T15:15:39.173241+0000 mon.a (mon.0) 2183 : cluster 0 osdmap e281: 8 total, 8 up, 8 in 2024-03-30T15:15:40.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:40 smithi072 bash[21573]: audit 2024-03-30T15:15:39.174923+0000 mon.c (mon.2) 376 : audit 1 from='client.? 172.21.15.72:0/1730191610' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi072-64163-40"}]: dispatch 2024-03-30T15:15:40.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:40 smithi072 bash[21573]: audit 2024-03-30T15:15:39.175889+0000 mon.a (mon.0) 2184 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi072-64163-40"}]: dispatch 2024-03-30T15:15:40.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:40 smithi072 bash[21573]: audit 2024-03-30T15:15:39.226329+0000 mon.c (mon.2) 377 : audit 1 from='client.? 172.21.15.72:0/2271956108' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi072-64171-52"}]: dispatch 2024-03-30T15:15:40.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:40 smithi072 bash[21573]: audit 2024-03-30T15:15:39.226836+0000 mon.a (mon.0) 2185 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi072-64171-52"}]: dispatch 2024-03-30T15:15:40.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:40 smithi072 bash[21573]: audit 2024-03-30T15:15:39.227497+0000 mon.c (mon.2) 378 : audit 1 from='client.? 172.21.15.72:0/2271956108' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi072-64171-52"}]: dispatch 2024-03-30T15:15:40.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:40 smithi072 bash[21573]: audit 2024-03-30T15:15:39.227751+0000 mon.a (mon.0) 2186 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi072-64171-52"}]: dispatch 2024-03-30T15:15:40.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:40 smithi072 bash[21573]: audit 2024-03-30T15:15:39.228226+0000 mon.c (mon.2) 379 : audit 1 from='client.? 172.21.15.72:0/2271956108' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi072-64171-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:40.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:40 smithi072 bash[21573]: audit 2024-03-30T15:15:39.228484+0000 mon.a (mon.0) 2187 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi072-64171-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:40.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:40 smithi072 bash[21573]: audit 2024-03-30T15:15:39.318111+0000 mon.a (mon.0) 2188 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:15:40.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:40 smithi072 bash[21573]: audit 2024-03-30T15:15:40.164842+0000 mon.a (mon.0) 2189 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi072-64163-40"}]': finished 2024-03-30T15:15:40.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:40 smithi072 bash[21573]: audit 2024-03-30T15:15:40.165022+0000 mon.a (mon.0) 2190 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi072-64171-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:15:40.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:40 smithi072 bash[21573]: audit 2024-03-30T15:15:40.165309+0000 mon.a (mon.0) 2191 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:15:40.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:40 smithi072 bash[21573]: cluster 2024-03-30T15:15:40.173045+0000 mon.a (mon.0) 2192 : cluster 0 osdmap e282: 8 total, 8 up, 8 in 2024-03-30T15:15:40.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:40 smithi072 bash[28946]: audit 2024-03-30T15:15:39.161195+0000 mon.a (mon.0) 2182 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi072-64163-40"}]': finished 2024-03-30T15:15:40.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:40 smithi072 bash[28946]: cluster 2024-03-30T15:15:39.173241+0000 mon.a (mon.0) 2183 : cluster 0 osdmap e281: 8 total, 8 up, 8 in 2024-03-30T15:15:40.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:40 smithi072 bash[28946]: audit 2024-03-30T15:15:39.174923+0000 mon.c (mon.2) 376 : audit 1 from='client.? 172.21.15.72:0/1730191610' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi072-64163-40"}]: dispatch 2024-03-30T15:15:40.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:40 smithi072 bash[28946]: audit 2024-03-30T15:15:39.175889+0000 mon.a (mon.0) 2184 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi072-64163-40"}]: dispatch 2024-03-30T15:15:40.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:40 smithi072 bash[28946]: audit 2024-03-30T15:15:39.226329+0000 mon.c (mon.2) 377 : audit 1 from='client.? 172.21.15.72:0/2271956108' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi072-64171-52"}]: dispatch 2024-03-30T15:15:40.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:40 smithi072 bash[28946]: audit 2024-03-30T15:15:39.226836+0000 mon.a (mon.0) 2185 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi072-64171-52"}]: dispatch 2024-03-30T15:15:40.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:40 smithi072 bash[28946]: audit 2024-03-30T15:15:39.227497+0000 mon.c (mon.2) 378 : audit 1 from='client.? 172.21.15.72:0/2271956108' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi072-64171-52"}]: dispatch 2024-03-30T15:15:40.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:40 smithi072 bash[28946]: audit 2024-03-30T15:15:39.227751+0000 mon.a (mon.0) 2186 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi072-64171-52"}]: dispatch 2024-03-30T15:15:40.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:40 smithi072 bash[28946]: audit 2024-03-30T15:15:39.228226+0000 mon.c (mon.2) 379 : audit 1 from='client.? 172.21.15.72:0/2271956108' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi072-64171-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:40.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:40 smithi072 bash[28946]: audit 2024-03-30T15:15:39.228484+0000 mon.a (mon.0) 2187 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi072-64171-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:40.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:40 smithi072 bash[28946]: audit 2024-03-30T15:15:39.318111+0000 mon.a (mon.0) 2188 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:15:40.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:40 smithi072 bash[28946]: audit 2024-03-30T15:15:40.164842+0000 mon.a (mon.0) 2189 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi072-64163-40"}]': finished 2024-03-30T15:15:40.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:40 smithi072 bash[28946]: audit 2024-03-30T15:15:40.165022+0000 mon.a (mon.0) 2190 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi072-64171-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:15:40.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:40 smithi072 bash[28946]: audit 2024-03-30T15:15:40.165309+0000 mon.a (mon.0) 2191 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:15:40.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:40 smithi072 bash[28946]: cluster 2024-03-30T15:15:40.173045+0000 mon.a (mon.0) 2192 : cluster 0 osdmap e282: 8 total, 8 up, 8 in 2024-03-30T15:15:41.417 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:15:41 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:15:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:15:41.464 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:15:41 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:15:41.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:41 smithi072 bash[21573]: cluster 2024-03-30T15:15:39.991463+0000 mgr.y (mgr.14526) 327 : cluster 0 pgmap v426: 228 pgs: 228 active+clean; 4.6 MiB data, 616 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:15:41.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:41 smithi072 bash[21573]: audit 2024-03-30T15:15:40.176484+0000 mon.c (mon.2) 380 : audit 1 from='client.? 172.21.15.72:0/2271956108' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi072-64171-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi072-64171-52"}]: dispatch 2024-03-30T15:15:41.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:41 smithi072 bash[21573]: audit 2024-03-30T15:15:40.178303+0000 mon.a (mon.0) 2193 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi072-64171-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi072-64171-52"}]: dispatch 2024-03-30T15:15:41.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:41 smithi072 bash[21573]: audit 2024-03-30T15:15:40.192447+0000 mon.a (mon.0) 2194 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-35"}]: dispatch 2024-03-30T15:15:41.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:41 smithi072 bash[21573]: audit 2024-03-30T15:15:40.229478+0000 mon.c (mon.2) 381 : audit 1 from='client.? 172.21.15.72:0/1788640921' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi072-64163-41"}]: dispatch 2024-03-30T15:15:41.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:41 smithi072 bash[21573]: audit 2024-03-30T15:15:40.229860+0000 mon.a (mon.0) 2195 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi072-64163-41"}]: dispatch 2024-03-30T15:15:41.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:41 smithi072 bash[21573]: audit 2024-03-30T15:15:40.230531+0000 mon.c (mon.2) 382 : audit 1 from='client.? 172.21.15.72:0/1788640921' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi072-64163-41"}]: dispatch 2024-03-30T15:15:41.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:41 smithi072 bash[21573]: audit 2024-03-30T15:15:40.230858+0000 mon.a (mon.0) 2196 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi072-64163-41"}]: dispatch 2024-03-30T15:15:41.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:41 smithi072 bash[21573]: audit 2024-03-30T15:15:40.231443+0000 mon.c (mon.2) 383 : audit 1 from='client.? 172.21.15.72:0/1788640921' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi072-64163-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:41.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:41 smithi072 bash[21573]: audit 2024-03-30T15:15:40.231742+0000 mon.a (mon.0) 2197 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi072-64163-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:41.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:41 smithi072 bash[21573]: audit 2024-03-30T15:15:41.168448+0000 mon.a (mon.0) 2198 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-35"}]': finished 2024-03-30T15:15:41.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:41 smithi072 bash[28946]: cluster 2024-03-30T15:15:39.991463+0000 mgr.y (mgr.14526) 327 : cluster 0 pgmap v426: 228 pgs: 228 active+clean; 4.6 MiB data, 616 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:15:41.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:41 smithi072 bash[28946]: audit 2024-03-30T15:15:40.176484+0000 mon.c (mon.2) 380 : audit 1 from='client.? 172.21.15.72:0/2271956108' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi072-64171-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi072-64171-52"}]: dispatch 2024-03-30T15:15:41.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:41 smithi072 bash[28946]: audit 2024-03-30T15:15:40.178303+0000 mon.a (mon.0) 2193 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi072-64171-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi072-64171-52"}]: dispatch 2024-03-30T15:15:41.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:41 smithi072 bash[28946]: audit 2024-03-30T15:15:40.192447+0000 mon.a (mon.0) 2194 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-35"}]: dispatch 2024-03-30T15:15:41.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:41 smithi072 bash[28946]: audit 2024-03-30T15:15:40.229478+0000 mon.c (mon.2) 381 : audit 1 from='client.? 172.21.15.72:0/1788640921' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi072-64163-41"}]: dispatch 2024-03-30T15:15:41.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:41 smithi072 bash[28946]: audit 2024-03-30T15:15:40.229860+0000 mon.a (mon.0) 2195 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi072-64163-41"}]: dispatch 2024-03-30T15:15:41.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:41 smithi072 bash[28946]: audit 2024-03-30T15:15:40.230531+0000 mon.c (mon.2) 382 : audit 1 from='client.? 172.21.15.72:0/1788640921' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi072-64163-41"}]: dispatch 2024-03-30T15:15:41.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:41 smithi072 bash[28946]: audit 2024-03-30T15:15:40.230858+0000 mon.a (mon.0) 2196 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi072-64163-41"}]: dispatch 2024-03-30T15:15:41.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:41 smithi072 bash[28946]: audit 2024-03-30T15:15:40.231443+0000 mon.c (mon.2) 383 : audit 1 from='client.? 172.21.15.72:0/1788640921' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi072-64163-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:41.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:41 smithi072 bash[28946]: audit 2024-03-30T15:15:40.231742+0000 mon.a (mon.0) 2197 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi072-64163-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:41.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:41 smithi072 bash[28946]: audit 2024-03-30T15:15:41.168448+0000 mon.a (mon.0) 2198 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-35"}]': finished 2024-03-30T15:15:41.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:41 smithi172 bash[23680]: cluster 2024-03-30T15:15:39.991463+0000 mgr.y (mgr.14526) 327 : cluster 0 pgmap v426: 228 pgs: 228 active+clean; 4.6 MiB data, 616 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:15:41.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:41 smithi172 bash[23680]: audit 2024-03-30T15:15:40.176484+0000 mon.c (mon.2) 380 : audit 1 from='client.? 172.21.15.72:0/2271956108' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi072-64171-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi072-64171-52"}]: dispatch 2024-03-30T15:15:41.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:41 smithi172 bash[23680]: audit 2024-03-30T15:15:40.178303+0000 mon.a (mon.0) 2193 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi072-64171-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi072-64171-52"}]: dispatch 2024-03-30T15:15:41.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:41 smithi172 bash[23680]: audit 2024-03-30T15:15:40.192447+0000 mon.a (mon.0) 2194 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-35"}]: dispatch 2024-03-30T15:15:41.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:41 smithi172 bash[23680]: audit 2024-03-30T15:15:40.229478+0000 mon.c (mon.2) 381 : audit 1 from='client.? 172.21.15.72:0/1788640921' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi072-64163-41"}]: dispatch 2024-03-30T15:15:41.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:41 smithi172 bash[23680]: audit 2024-03-30T15:15:40.229860+0000 mon.a (mon.0) 2195 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi072-64163-41"}]: dispatch 2024-03-30T15:15:41.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:41 smithi172 bash[23680]: audit 2024-03-30T15:15:40.230531+0000 mon.c (mon.2) 382 : audit 1 from='client.? 172.21.15.72:0/1788640921' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi072-64163-41"}]: dispatch 2024-03-30T15:15:41.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:41 smithi172 bash[23680]: audit 2024-03-30T15:15:40.230858+0000 mon.a (mon.0) 2196 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi072-64163-41"}]: dispatch 2024-03-30T15:15:41.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:41 smithi172 bash[23680]: audit 2024-03-30T15:15:40.231443+0000 mon.c (mon.2) 383 : audit 1 from='client.? 172.21.15.72:0/1788640921' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi072-64163-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:41.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:41 smithi172 bash[23680]: audit 2024-03-30T15:15:40.231742+0000 mon.a (mon.0) 2197 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi072-64163-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:41.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:41 smithi172 bash[23680]: audit 2024-03-30T15:15:41.168448+0000 mon.a (mon.0) 2198 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-35"}]': finished 2024-03-30T15:15:42.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:42 smithi072 bash[28946]: audit 2024-03-30T15:15:41.142890+0000 mgr.y (mgr.14526) 328 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:15:42.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:42 smithi072 bash[28946]: audit 2024-03-30T15:15:41.168672+0000 mon.a (mon.0) 2199 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi072-64163-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:15:42.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:42 smithi072 bash[28946]: audit 2024-03-30T15:15:41.178313+0000 mon.c (mon.2) 384 : audit 1 from='client.? 172.21.15.72:0/1788640921' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi072-64163-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi072-64163-41"}]: dispatch 2024-03-30T15:15:42.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:42 smithi072 bash[28946]: cluster 2024-03-30T15:15:41.614806+0000 mon.a (mon.0) 2200 : cluster 0 osdmap e283: 8 total, 8 up, 8 in 2024-03-30T15:15:42.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:42 smithi072 bash[28946]: audit 2024-03-30T15:15:41.616241+0000 mon.a (mon.0) 2201 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi072-64163-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi072-64163-41"}]: dispatch 2024-03-30T15:15:42.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:42 smithi072 bash[28946]: audit 2024-03-30T15:15:42.172649+0000 mon.a (mon.0) 2202 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi072-64171-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi072-64171-52"}]': finished 2024-03-30T15:15:42.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:42 smithi072 bash[28946]: cluster 2024-03-30T15:15:42.606363+0000 mon.a (mon.0) 2203 : cluster 0 osdmap e284: 8 total, 8 up, 8 in 2024-03-30T15:15:42.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:42 smithi072 bash[21573]: audit 2024-03-30T15:15:41.142890+0000 mgr.y (mgr.14526) 328 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:15:42.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:42 smithi072 bash[21573]: audit 2024-03-30T15:15:41.168672+0000 mon.a (mon.0) 2199 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi072-64163-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:15:42.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:42 smithi072 bash[21573]: audit 2024-03-30T15:15:41.178313+0000 mon.c (mon.2) 384 : audit 1 from='client.? 172.21.15.72:0/1788640921' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi072-64163-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi072-64163-41"}]: dispatch 2024-03-30T15:15:42.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:42 smithi072 bash[21573]: cluster 2024-03-30T15:15:41.614806+0000 mon.a (mon.0) 2200 : cluster 0 osdmap e283: 8 total, 8 up, 8 in 2024-03-30T15:15:42.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:42 smithi072 bash[21573]: audit 2024-03-30T15:15:41.616241+0000 mon.a (mon.0) 2201 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi072-64163-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi072-64163-41"}]: dispatch 2024-03-30T15:15:42.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:42 smithi072 bash[21573]: audit 2024-03-30T15:15:42.172649+0000 mon.a (mon.0) 2202 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi072-64171-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi072-64171-52"}]': finished 2024-03-30T15:15:42.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:42 smithi072 bash[21573]: cluster 2024-03-30T15:15:42.606363+0000 mon.a (mon.0) 2203 : cluster 0 osdmap e284: 8 total, 8 up, 8 in 2024-03-30T15:15:42.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:42 smithi172 bash[23680]: audit 2024-03-30T15:15:41.142890+0000 mgr.y (mgr.14526) 328 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:15:42.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:42 smithi172 bash[23680]: audit 2024-03-30T15:15:41.168672+0000 mon.a (mon.0) 2199 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi072-64163-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:15:42.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:42 smithi172 bash[23680]: audit 2024-03-30T15:15:41.178313+0000 mon.c (mon.2) 384 : audit 1 from='client.? 172.21.15.72:0/1788640921' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi072-64163-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi072-64163-41"}]: dispatch 2024-03-30T15:15:42.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:42 smithi172 bash[23680]: cluster 2024-03-30T15:15:41.614806+0000 mon.a (mon.0) 2200 : cluster 0 osdmap e283: 8 total, 8 up, 8 in 2024-03-30T15:15:42.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:42 smithi172 bash[23680]: audit 2024-03-30T15:15:41.616241+0000 mon.a (mon.0) 2201 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi072-64163-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi072-64163-41"}]: dispatch 2024-03-30T15:15:42.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:42 smithi172 bash[23680]: audit 2024-03-30T15:15:42.172649+0000 mon.a (mon.0) 2202 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi072-64171-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi072-64171-52"}]': finished 2024-03-30T15:15:42.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:42 smithi172 bash[23680]: cluster 2024-03-30T15:15:42.606363+0000 mon.a (mon.0) 2203 : cluster 0 osdmap e284: 8 total, 8 up, 8 in 2024-03-30T15:15:43.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:43 smithi072 bash[21573]: cluster 2024-03-30T15:15:41.992305+0000 mgr.y (mgr.14526) 329 : cluster 0 pgmap v429: 228 pgs: 228 active+clean; 4.6 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-03-30T15:15:43.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:43 smithi072 bash[21573]: audit 2024-03-30T15:15:42.640518+0000 mon.a (mon.0) 2204 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:15:43.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:43 smithi072 bash[21573]: audit 2024-03-30T15:15:43.175986+0000 mon.a (mon.0) 2205 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi072-64163-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi072-64163-41"}]': finished 2024-03-30T15:15:43.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:43 smithi072 bash[21573]: audit 2024-03-30T15:15:43.176265+0000 mon.a (mon.0) 2206 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:15:43.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:43 smithi072 bash[21573]: cluster 2024-03-30T15:15:43.186410+0000 mon.a (mon.0) 2207 : cluster 0 osdmap e285: 8 total, 8 up, 8 in 2024-03-30T15:15:43.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:43 smithi072 bash[21573]: audit 2024-03-30T15:15:43.187620+0000 mon.a (mon.0) 2208 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-35"}]: dispatch 2024-03-30T15:15:43.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:43 smithi072 bash[28946]: cluster 2024-03-30T15:15:41.992305+0000 mgr.y (mgr.14526) 329 : cluster 0 pgmap v429: 228 pgs: 228 active+clean; 4.6 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-03-30T15:15:43.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:43 smithi072 bash[28946]: audit 2024-03-30T15:15:42.640518+0000 mon.a (mon.0) 2204 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:15:43.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:43 smithi072 bash[28946]: audit 2024-03-30T15:15:43.175986+0000 mon.a (mon.0) 2205 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi072-64163-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi072-64163-41"}]': finished 2024-03-30T15:15:43.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:43 smithi072 bash[28946]: audit 2024-03-30T15:15:43.176265+0000 mon.a (mon.0) 2206 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:15:43.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:43 smithi072 bash[28946]: cluster 2024-03-30T15:15:43.186410+0000 mon.a (mon.0) 2207 : cluster 0 osdmap e285: 8 total, 8 up, 8 in 2024-03-30T15:15:43.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:43 smithi072 bash[28946]: audit 2024-03-30T15:15:43.187620+0000 mon.a (mon.0) 2208 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-35"}]: dispatch 2024-03-30T15:15:43.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:43 smithi172 bash[23680]: cluster 2024-03-30T15:15:41.992305+0000 mgr.y (mgr.14526) 329 : cluster 0 pgmap v429: 228 pgs: 228 active+clean; 4.6 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-03-30T15:15:43.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:43 smithi172 bash[23680]: audit 2024-03-30T15:15:42.640518+0000 mon.a (mon.0) 2204 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:15:43.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:43 smithi172 bash[23680]: audit 2024-03-30T15:15:43.175986+0000 mon.a (mon.0) 2205 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi072-64163-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi072-64163-41"}]': finished 2024-03-30T15:15:43.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:43 smithi172 bash[23680]: audit 2024-03-30T15:15:43.176265+0000 mon.a (mon.0) 2206 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:15:43.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:43 smithi172 bash[23680]: cluster 2024-03-30T15:15:43.186410+0000 mon.a (mon.0) 2207 : cluster 0 osdmap e285: 8 total, 8 up, 8 in 2024-03-30T15:15:43.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:43 smithi172 bash[23680]: audit 2024-03-30T15:15:43.187620+0000 mon.a (mon.0) 2208 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-35"}]: dispatch 2024-03-30T15:15:44.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:44 smithi072 bash[21573]: cluster 2024-03-30T15:15:44.176308+0000 mon.a (mon.0) 2209 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:15:44.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:44 smithi072 bash[21573]: audit 2024-03-30T15:15:44.178883+0000 mon.a (mon.0) 2210 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-35"}]': finished 2024-03-30T15:15:44.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:44 smithi072 bash[21573]: cluster 2024-03-30T15:15:44.186839+0000 mon.a (mon.0) 2211 : cluster 0 osdmap e286: 8 total, 8 up, 8 in 2024-03-30T15:15:44.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:44 smithi072 bash[21573]: audit 2024-03-30T15:15:44.196728+0000 mon.c (mon.2) 385 : audit 1 from='client.? 172.21.15.72:0/2271956108' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi072-64171-52"}]: dispatch 2024-03-30T15:15:44.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:44 smithi072 bash[21573]: audit 2024-03-30T15:15:44.198431+0000 mon.a (mon.0) 2212 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi072-64171-52"}]: dispatch 2024-03-30T15:15:44.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:44 smithi072 bash[28946]: cluster 2024-03-30T15:15:44.176308+0000 mon.a (mon.0) 2209 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:15:44.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:44 smithi072 bash[28946]: audit 2024-03-30T15:15:44.178883+0000 mon.a (mon.0) 2210 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-35"}]': finished 2024-03-30T15:15:44.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:44 smithi072 bash[28946]: cluster 2024-03-30T15:15:44.186839+0000 mon.a (mon.0) 2211 : cluster 0 osdmap e286: 8 total, 8 up, 8 in 2024-03-30T15:15:44.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:44 smithi072 bash[28946]: audit 2024-03-30T15:15:44.196728+0000 mon.c (mon.2) 385 : audit 1 from='client.? 172.21.15.72:0/2271956108' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi072-64171-52"}]: dispatch 2024-03-30T15:15:44.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:44 smithi072 bash[28946]: audit 2024-03-30T15:15:44.198431+0000 mon.a (mon.0) 2212 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi072-64171-52"}]: dispatch 2024-03-30T15:15:44.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:44 smithi172 bash[23680]: cluster 2024-03-30T15:15:44.176308+0000 mon.a (mon.0) 2209 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:15:44.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:44 smithi172 bash[23680]: audit 2024-03-30T15:15:44.178883+0000 mon.a (mon.0) 2210 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-35"}]': finished 2024-03-30T15:15:44.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:44 smithi172 bash[23680]: cluster 2024-03-30T15:15:44.186839+0000 mon.a (mon.0) 2211 : cluster 0 osdmap e286: 8 total, 8 up, 8 in 2024-03-30T15:15:44.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:44 smithi172 bash[23680]: audit 2024-03-30T15:15:44.196728+0000 mon.c (mon.2) 385 : audit 1 from='client.? 172.21.15.72:0/2271956108' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi072-64171-52"}]: dispatch 2024-03-30T15:15:44.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:44 smithi172 bash[23680]: audit 2024-03-30T15:15:44.198431+0000 mon.a (mon.0) 2212 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi072-64171-52"}]: dispatch 2024-03-30T15:15:45.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:45 smithi072 bash[21573]: cluster 2024-03-30T15:15:43.993186+0000 mgr.y (mgr.14526) 330 : cluster 0 pgmap v432: 244 pgs: 16 unknown, 228 active+clean; 4.6 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-03-30T15:15:45.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:45 smithi072 bash[21573]: cluster 2024-03-30T15:15:44.638518+0000 mon.a (mon.0) 2213 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:15:45.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:45 smithi072 bash[21573]: audit 2024-03-30T15:15:45.181529+0000 mon.a (mon.0) 2214 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi072-64171-52"}]': finished 2024-03-30T15:15:45.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:45 smithi072 bash[21573]: cluster 2024-03-30T15:15:45.190034+0000 mon.a (mon.0) 2215 : cluster 0 osdmap e287: 8 total, 8 up, 8 in 2024-03-30T15:15:45.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:45 smithi072 bash[21573]: audit 2024-03-30T15:15:45.201418+0000 mon.c (mon.2) 386 : audit 1 from='client.? 172.21.15.72:0/1788640921' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi072-64163-41"}]: dispatch 2024-03-30T15:15:45.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:45 smithi072 bash[21573]: audit 2024-03-30T15:15:45.203078+0000 mon.c (mon.2) 387 : audit 1 from='client.? 172.21.15.72:0/2271956108' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi072-64171-52"}]: dispatch 2024-03-30T15:15:45.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:45 smithi072 bash[21573]: audit 2024-03-30T15:15:45.639979+0000 mon.a (mon.0) 2216 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi072-64163-41"}]: dispatch 2024-03-30T15:15:45.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:45 smithi072 bash[21573]: audit 2024-03-30T15:15:45.640208+0000 mon.a (mon.0) 2217 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi072-64171-52"}]: dispatch 2024-03-30T15:15:45.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:45 smithi072 bash[28946]: cluster 2024-03-30T15:15:43.993186+0000 mgr.y (mgr.14526) 330 : cluster 0 pgmap v432: 244 pgs: 16 unknown, 228 active+clean; 4.6 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-03-30T15:15:45.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:45 smithi072 bash[28946]: cluster 2024-03-30T15:15:44.638518+0000 mon.a (mon.0) 2213 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:15:45.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:45 smithi072 bash[28946]: audit 2024-03-30T15:15:45.181529+0000 mon.a (mon.0) 2214 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi072-64171-52"}]': finished 2024-03-30T15:15:45.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:45 smithi072 bash[28946]: cluster 2024-03-30T15:15:45.190034+0000 mon.a (mon.0) 2215 : cluster 0 osdmap e287: 8 total, 8 up, 8 in 2024-03-30T15:15:45.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:45 smithi072 bash[28946]: audit 2024-03-30T15:15:45.201418+0000 mon.c (mon.2) 386 : audit 1 from='client.? 172.21.15.72:0/1788640921' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi072-64163-41"}]: dispatch 2024-03-30T15:15:45.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:45 smithi072 bash[28946]: audit 2024-03-30T15:15:45.203078+0000 mon.c (mon.2) 387 : audit 1 from='client.? 172.21.15.72:0/2271956108' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi072-64171-52"}]: dispatch 2024-03-30T15:15:45.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:45 smithi072 bash[28946]: audit 2024-03-30T15:15:45.639979+0000 mon.a (mon.0) 2216 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi072-64163-41"}]: dispatch 2024-03-30T15:15:45.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:45 smithi072 bash[28946]: audit 2024-03-30T15:15:45.640208+0000 mon.a (mon.0) 2217 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi072-64171-52"}]: dispatch 2024-03-30T15:15:45.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:45 smithi172 bash[23680]: cluster 2024-03-30T15:15:43.993186+0000 mgr.y (mgr.14526) 330 : cluster 0 pgmap v432: 244 pgs: 16 unknown, 228 active+clean; 4.6 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-03-30T15:15:45.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:45 smithi172 bash[23680]: cluster 2024-03-30T15:15:44.638518+0000 mon.a (mon.0) 2213 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:15:45.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:45 smithi172 bash[23680]: audit 2024-03-30T15:15:45.181529+0000 mon.a (mon.0) 2214 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi072-64171-52"}]': finished 2024-03-30T15:15:45.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:45 smithi172 bash[23680]: cluster 2024-03-30T15:15:45.190034+0000 mon.a (mon.0) 2215 : cluster 0 osdmap e287: 8 total, 8 up, 8 in 2024-03-30T15:15:45.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:45 smithi172 bash[23680]: audit 2024-03-30T15:15:45.201418+0000 mon.c (mon.2) 386 : audit 1 from='client.? 172.21.15.72:0/1788640921' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi072-64163-41"}]: dispatch 2024-03-30T15:15:45.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:45 smithi172 bash[23680]: audit 2024-03-30T15:15:45.203078+0000 mon.c (mon.2) 387 : audit 1 from='client.? 172.21.15.72:0/2271956108' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi072-64171-52"}]: dispatch 2024-03-30T15:15:45.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:45 smithi172 bash[23680]: audit 2024-03-30T15:15:45.639979+0000 mon.a (mon.0) 2216 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi072-64163-41"}]: dispatch 2024-03-30T15:15:45.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:45 smithi172 bash[23680]: audit 2024-03-30T15:15:45.640208+0000 mon.a (mon.0) 2217 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi072-64171-52"}]: dispatch 2024-03-30T15:15:47.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:47 smithi172 bash[23680]: cluster 2024-03-30T15:15:45.995038+0000 mgr.y (mgr.14526) 331 : cluster 0 pgmap v435: 196 pgs: 196 active+clean; 4.6 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-03-30T15:15:47.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:47 smithi172 bash[23680]: audit 2024-03-30T15:15:46.188615+0000 mon.a (mon.0) 2218 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi072-64163-41"}]': finished 2024-03-30T15:15:47.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:47 smithi172 bash[23680]: audit 2024-03-30T15:15:46.188824+0000 mon.a (mon.0) 2219 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi072-64171-52"}]': finished 2024-03-30T15:15:47.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:47 smithi172 bash[23680]: cluster 2024-03-30T15:15:46.199828+0000 mon.a (mon.0) 2220 : cluster 0 osdmap e288: 8 total, 8 up, 8 in 2024-03-30T15:15:47.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:47 smithi172 bash[23680]: audit 2024-03-30T15:15:46.200968+0000 mon.c (mon.2) 388 : audit 1 from='client.? 172.21.15.72:0/1788640921' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi072-64163-41"}]: dispatch 2024-03-30T15:15:47.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:47 smithi172 bash[23680]: audit 2024-03-30T15:15:46.207450+0000 mon.a (mon.0) 2221 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi072-64163-41"}]: dispatch 2024-03-30T15:15:47.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:47 smithi172 bash[23680]: audit 2024-03-30T15:15:46.211859+0000 mon.a (mon.0) 2222 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:15:47.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:47 smithi172 bash[23680]: audit 2024-03-30T15:15:46.243646+0000 mon.c (mon.2) 389 : audit 1 from='client.? 172.21.15.72:0/4126345961' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi072-64171-53"}]: dispatch 2024-03-30T15:15:47.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:47 smithi172 bash[23680]: audit 2024-03-30T15:15:46.244083+0000 mon.a (mon.0) 2223 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi072-64171-53"}]: dispatch 2024-03-30T15:15:47.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:47 smithi172 bash[23680]: audit 2024-03-30T15:15:46.245053+0000 mon.c (mon.2) 390 : audit 1 from='client.? 172.21.15.72:0/4126345961' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi072-64171-53"}]: dispatch 2024-03-30T15:15:47.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:47 smithi172 bash[23680]: audit 2024-03-30T15:15:46.245379+0000 mon.a (mon.0) 2224 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi072-64171-53"}]: dispatch 2024-03-30T15:15:47.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:47 smithi172 bash[23680]: audit 2024-03-30T15:15:46.245940+0000 mon.c (mon.2) 391 : audit 1 from='client.? 172.21.15.72:0/4126345961' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi072-64171-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:47.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:47 smithi172 bash[23680]: audit 2024-03-30T15:15:46.246237+0000 mon.a (mon.0) 2225 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi072-64171-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:47.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:47 smithi072 bash[21573]: cluster 2024-03-30T15:15:45.995038+0000 mgr.y (mgr.14526) 331 : cluster 0 pgmap v435: 196 pgs: 196 active+clean; 4.6 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-03-30T15:15:47.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:47 smithi072 bash[21573]: audit 2024-03-30T15:15:46.188615+0000 mon.a (mon.0) 2218 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi072-64163-41"}]': finished 2024-03-30T15:15:47.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:47 smithi072 bash[21573]: audit 2024-03-30T15:15:46.188824+0000 mon.a (mon.0) 2219 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi072-64171-52"}]': finished 2024-03-30T15:15:47.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:47 smithi072 bash[21573]: cluster 2024-03-30T15:15:46.199828+0000 mon.a (mon.0) 2220 : cluster 0 osdmap e288: 8 total, 8 up, 8 in 2024-03-30T15:15:47.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:47 smithi072 bash[21573]: audit 2024-03-30T15:15:46.200968+0000 mon.c (mon.2) 388 : audit 1 from='client.? 172.21.15.72:0/1788640921' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi072-64163-41"}]: dispatch 2024-03-30T15:15:47.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:47 smithi072 bash[21573]: audit 2024-03-30T15:15:46.207450+0000 mon.a (mon.0) 2221 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi072-64163-41"}]: dispatch 2024-03-30T15:15:47.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:47 smithi072 bash[21573]: audit 2024-03-30T15:15:46.211859+0000 mon.a (mon.0) 2222 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:15:47.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:47 smithi072 bash[21573]: audit 2024-03-30T15:15:46.243646+0000 mon.c (mon.2) 389 : audit 1 from='client.? 172.21.15.72:0/4126345961' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi072-64171-53"}]: dispatch 2024-03-30T15:15:47.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:47 smithi072 bash[21573]: audit 2024-03-30T15:15:46.244083+0000 mon.a (mon.0) 2223 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi072-64171-53"}]: dispatch 2024-03-30T15:15:47.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:47 smithi072 bash[21573]: audit 2024-03-30T15:15:46.245053+0000 mon.c (mon.2) 390 : audit 1 from='client.? 172.21.15.72:0/4126345961' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi072-64171-53"}]: dispatch 2024-03-30T15:15:47.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:47 smithi072 bash[21573]: audit 2024-03-30T15:15:46.245379+0000 mon.a (mon.0) 2224 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi072-64171-53"}]: dispatch 2024-03-30T15:15:47.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:47 smithi072 bash[21573]: audit 2024-03-30T15:15:46.245940+0000 mon.c (mon.2) 391 : audit 1 from='client.? 172.21.15.72:0/4126345961' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi072-64171-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:47.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:47 smithi072 bash[21573]: audit 2024-03-30T15:15:46.246237+0000 mon.a (mon.0) 2225 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi072-64171-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:47.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:47 smithi072 bash[28946]: cluster 2024-03-30T15:15:45.995038+0000 mgr.y (mgr.14526) 331 : cluster 0 pgmap v435: 196 pgs: 196 active+clean; 4.6 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-03-30T15:15:47.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:47 smithi072 bash[28946]: audit 2024-03-30T15:15:46.188615+0000 mon.a (mon.0) 2218 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi072-64163-41"}]': finished 2024-03-30T15:15:47.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:47 smithi072 bash[28946]: audit 2024-03-30T15:15:46.188824+0000 mon.a (mon.0) 2219 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi072-64171-52"}]': finished 2024-03-30T15:15:47.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:47 smithi072 bash[28946]: cluster 2024-03-30T15:15:46.199828+0000 mon.a (mon.0) 2220 : cluster 0 osdmap e288: 8 total, 8 up, 8 in 2024-03-30T15:15:47.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:47 smithi072 bash[28946]: audit 2024-03-30T15:15:46.200968+0000 mon.c (mon.2) 388 : audit 1 from='client.? 172.21.15.72:0/1788640921' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi072-64163-41"}]: dispatch 2024-03-30T15:15:47.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:47 smithi072 bash[28946]: audit 2024-03-30T15:15:46.207450+0000 mon.a (mon.0) 2221 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi072-64163-41"}]: dispatch 2024-03-30T15:15:47.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:47 smithi072 bash[28946]: audit 2024-03-30T15:15:46.211859+0000 mon.a (mon.0) 2222 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:15:47.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:47 smithi072 bash[28946]: audit 2024-03-30T15:15:46.243646+0000 mon.c (mon.2) 389 : audit 1 from='client.? 172.21.15.72:0/4126345961' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi072-64171-53"}]: dispatch 2024-03-30T15:15:47.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:47 smithi072 bash[28946]: audit 2024-03-30T15:15:46.244083+0000 mon.a (mon.0) 2223 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi072-64171-53"}]: dispatch 2024-03-30T15:15:47.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:47 smithi072 bash[28946]: audit 2024-03-30T15:15:46.245053+0000 mon.c (mon.2) 390 : audit 1 from='client.? 172.21.15.72:0/4126345961' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi072-64171-53"}]: dispatch 2024-03-30T15:15:47.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:47 smithi072 bash[28946]: audit 2024-03-30T15:15:46.245379+0000 mon.a (mon.0) 2224 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi072-64171-53"}]: dispatch 2024-03-30T15:15:47.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:47 smithi072 bash[28946]: audit 2024-03-30T15:15:46.245940+0000 mon.c (mon.2) 391 : audit 1 from='client.? 172.21.15.72:0/4126345961' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi072-64171-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:47.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:47 smithi072 bash[28946]: audit 2024-03-30T15:15:46.246237+0000 mon.a (mon.0) 2225 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi072-64171-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:48.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:48 smithi072 bash[21573]: audit 2024-03-30T15:15:47.192367+0000 mon.a (mon.0) 2226 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi072-64163-41"}]': finished 2024-03-30T15:15:48.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:48 smithi072 bash[21573]: audit 2024-03-30T15:15:47.192628+0000 mon.a (mon.0) 2227 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:15:48.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:48 smithi072 bash[21573]: audit 2024-03-30T15:15:47.192832+0000 mon.a (mon.0) 2228 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi072-64171-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:15:48.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:48 smithi072 bash[21573]: cluster 2024-03-30T15:15:47.200889+0000 mon.a (mon.0) 2229 : cluster 0 osdmap e289: 8 total, 8 up, 8 in 2024-03-30T15:15:48.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:48 smithi072 bash[21573]: audit 2024-03-30T15:15:47.201512+0000 mon.c (mon.2) 392 : audit 1 from='client.? 172.21.15.72:0/4126345961' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi072-64171-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi072-64171-53"}]: dispatch 2024-03-30T15:15:48.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:48 smithi072 bash[21573]: audit 2024-03-30T15:15:47.206745+0000 mon.a (mon.0) 2230 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi072-64171-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi072-64171-53"}]: dispatch 2024-03-30T15:15:48.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:48 smithi072 bash[21573]: audit 2024-03-30T15:15:47.231916+0000 mon.a (mon.0) 2231 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:15:48.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:48 smithi072 bash[21573]: audit 2024-03-30T15:15:47.247503+0000 mon.a (mon.0) 2232 : audit 1 from='client.? 172.21.15.72:0/2700176705' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi072-64163-42"}]: dispatch 2024-03-30T15:15:48.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:48 smithi072 bash[21573]: audit 2024-03-30T15:15:47.248458+0000 mon.a (mon.0) 2233 : audit 1 from='client.? 172.21.15.72:0/2700176705' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi072-64163-42"}]: dispatch 2024-03-30T15:15:48.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:48 smithi072 bash[21573]: audit 2024-03-30T15:15:47.248820+0000 mon.a (mon.0) 2234 : audit 1 from='client.? 172.21.15.72:0/2700176705' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi072-64163-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:48.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:48 smithi072 bash[21573]: audit 2024-03-30T15:15:48.196006+0000 mon.a (mon.0) 2235 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-37", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:15:48.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:48 smithi072 bash[28946]: audit 2024-03-30T15:15:47.192367+0000 mon.a (mon.0) 2226 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi072-64163-41"}]': finished 2024-03-30T15:15:48.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:48 smithi072 bash[28946]: audit 2024-03-30T15:15:47.192628+0000 mon.a (mon.0) 2227 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:15:48.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:48 smithi072 bash[28946]: audit 2024-03-30T15:15:47.192832+0000 mon.a (mon.0) 2228 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi072-64171-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:15:48.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:48 smithi072 bash[28946]: cluster 2024-03-30T15:15:47.200889+0000 mon.a (mon.0) 2229 : cluster 0 osdmap e289: 8 total, 8 up, 8 in 2024-03-30T15:15:48.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:48 smithi072 bash[28946]: audit 2024-03-30T15:15:47.201512+0000 mon.c (mon.2) 392 : audit 1 from='client.? 172.21.15.72:0/4126345961' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi072-64171-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi072-64171-53"}]: dispatch 2024-03-30T15:15:48.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:48 smithi072 bash[28946]: audit 2024-03-30T15:15:47.206745+0000 mon.a (mon.0) 2230 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi072-64171-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi072-64171-53"}]: dispatch 2024-03-30T15:15:48.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:48 smithi072 bash[28946]: audit 2024-03-30T15:15:47.231916+0000 mon.a (mon.0) 2231 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:15:48.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:48 smithi072 bash[28946]: audit 2024-03-30T15:15:47.247503+0000 mon.a (mon.0) 2232 : audit 1 from='client.? 172.21.15.72:0/2700176705' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi072-64163-42"}]: dispatch 2024-03-30T15:15:48.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:48 smithi072 bash[28946]: audit 2024-03-30T15:15:47.248458+0000 mon.a (mon.0) 2233 : audit 1 from='client.? 172.21.15.72:0/2700176705' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi072-64163-42"}]: dispatch 2024-03-30T15:15:48.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:48 smithi072 bash[28946]: audit 2024-03-30T15:15:47.248820+0000 mon.a (mon.0) 2234 : audit 1 from='client.? 172.21.15.72:0/2700176705' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi072-64163-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:48.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:48 smithi072 bash[28946]: audit 2024-03-30T15:15:48.196006+0000 mon.a (mon.0) 2235 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-37", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:15:48.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:48 smithi172 bash[23680]: audit 2024-03-30T15:15:47.192367+0000 mon.a (mon.0) 2226 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi072-64163-41"}]': finished 2024-03-30T15:15:48.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:48 smithi172 bash[23680]: audit 2024-03-30T15:15:47.192628+0000 mon.a (mon.0) 2227 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:15:48.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:48 smithi172 bash[23680]: audit 2024-03-30T15:15:47.192832+0000 mon.a (mon.0) 2228 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi072-64171-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:15:48.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:48 smithi172 bash[23680]: cluster 2024-03-30T15:15:47.200889+0000 mon.a (mon.0) 2229 : cluster 0 osdmap e289: 8 total, 8 up, 8 in 2024-03-30T15:15:48.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:48 smithi172 bash[23680]: audit 2024-03-30T15:15:47.201512+0000 mon.c (mon.2) 392 : audit 1 from='client.? 172.21.15.72:0/4126345961' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi072-64171-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi072-64171-53"}]: dispatch 2024-03-30T15:15:48.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:48 smithi172 bash[23680]: audit 2024-03-30T15:15:47.206745+0000 mon.a (mon.0) 2230 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi072-64171-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi072-64171-53"}]: dispatch 2024-03-30T15:15:48.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:48 smithi172 bash[23680]: audit 2024-03-30T15:15:47.231916+0000 mon.a (mon.0) 2231 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:15:48.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:48 smithi172 bash[23680]: audit 2024-03-30T15:15:47.247503+0000 mon.a (mon.0) 2232 : audit 1 from='client.? 172.21.15.72:0/2700176705' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi072-64163-42"}]: dispatch 2024-03-30T15:15:48.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:48 smithi172 bash[23680]: audit 2024-03-30T15:15:47.248458+0000 mon.a (mon.0) 2233 : audit 1 from='client.? 172.21.15.72:0/2700176705' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi072-64163-42"}]: dispatch 2024-03-30T15:15:48.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:48 smithi172 bash[23680]: audit 2024-03-30T15:15:47.248820+0000 mon.a (mon.0) 2234 : audit 1 from='client.? 172.21.15.72:0/2700176705' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi072-64163-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:48.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:48 smithi172 bash[23680]: audit 2024-03-30T15:15:48.196006+0000 mon.a (mon.0) 2235 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-37", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:15:49.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:49 smithi072 bash[21573]: cluster 2024-03-30T15:15:47.995837+0000 mgr.y (mgr.14526) 332 : cluster 0 pgmap v438: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-03-30T15:15:49.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:49 smithi072 bash[21573]: audit 2024-03-30T15:15:48.196213+0000 mon.a (mon.0) 2236 : audit 1 from='client.? 172.21.15.72:0/2700176705' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi072-64163-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:15:49.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:49 smithi072 bash[21573]: cluster 2024-03-30T15:15:48.651832+0000 mon.a (mon.0) 2237 : cluster 0 osdmap e290: 8 total, 8 up, 8 in 2024-03-30T15:15:49.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:49 smithi072 bash[21573]: audit 2024-03-30T15:15:48.653605+0000 mon.a (mon.0) 2238 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-37"}]: dispatch 2024-03-30T15:15:49.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:49 smithi072 bash[21573]: audit 2024-03-30T15:15:48.654271+0000 mon.a (mon.0) 2239 : audit 1 from='client.? 172.21.15.72:0/2700176705' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi072-64163-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi072-64163-42"}]: dispatch 2024-03-30T15:15:49.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:49 smithi072 bash[21573]: audit 2024-03-30T15:15:49.200766+0000 mon.a (mon.0) 2240 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi072-64171-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi072-64171-53"}]': finished 2024-03-30T15:15:49.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:49 smithi072 bash[21573]: audit 2024-03-30T15:15:49.201034+0000 mon.a (mon.0) 2241 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-37"}]': finished 2024-03-30T15:15:49.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:49 smithi072 bash[21573]: cluster 2024-03-30T15:15:49.633957+0000 mon.a (mon.0) 2242 : cluster 0 osdmap e291: 8 total, 8 up, 8 in 2024-03-30T15:15:49.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:49 smithi072 bash[21573]: audit 2024-03-30T15:15:49.634762+0000 mon.a (mon.0) 2243 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-37", "mode": "writeback"}]: dispatch 2024-03-30T15:15:49.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:49 smithi072 bash[28946]: cluster 2024-03-30T15:15:47.995837+0000 mgr.y (mgr.14526) 332 : cluster 0 pgmap v438: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-03-30T15:15:49.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:49 smithi072 bash[28946]: audit 2024-03-30T15:15:48.196213+0000 mon.a (mon.0) 2236 : audit 1 from='client.? 172.21.15.72:0/2700176705' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi072-64163-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:15:49.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:49 smithi072 bash[28946]: cluster 2024-03-30T15:15:48.651832+0000 mon.a (mon.0) 2237 : cluster 0 osdmap e290: 8 total, 8 up, 8 in 2024-03-30T15:15:49.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:49 smithi072 bash[28946]: audit 2024-03-30T15:15:48.653605+0000 mon.a (mon.0) 2238 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-37"}]: dispatch 2024-03-30T15:15:49.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:49 smithi072 bash[28946]: audit 2024-03-30T15:15:48.654271+0000 mon.a (mon.0) 2239 : audit 1 from='client.? 172.21.15.72:0/2700176705' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi072-64163-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi072-64163-42"}]: dispatch 2024-03-30T15:15:49.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:49 smithi072 bash[28946]: audit 2024-03-30T15:15:49.200766+0000 mon.a (mon.0) 2240 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi072-64171-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi072-64171-53"}]': finished 2024-03-30T15:15:49.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:49 smithi072 bash[28946]: audit 2024-03-30T15:15:49.201034+0000 mon.a (mon.0) 2241 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-37"}]': finished 2024-03-30T15:15:49.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:49 smithi072 bash[28946]: cluster 2024-03-30T15:15:49.633957+0000 mon.a (mon.0) 2242 : cluster 0 osdmap e291: 8 total, 8 up, 8 in 2024-03-30T15:15:49.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:49 smithi072 bash[28946]: audit 2024-03-30T15:15:49.634762+0000 mon.a (mon.0) 2243 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-37", "mode": "writeback"}]: dispatch 2024-03-30T15:15:49.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:49 smithi172 bash[23680]: cluster 2024-03-30T15:15:47.995837+0000 mgr.y (mgr.14526) 332 : cluster 0 pgmap v438: 228 pgs: 32 unknown, 196 active+clean; 4.6 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-03-30T15:15:49.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:49 smithi172 bash[23680]: audit 2024-03-30T15:15:48.196213+0000 mon.a (mon.0) 2236 : audit 1 from='client.? 172.21.15.72:0/2700176705' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi072-64163-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:15:49.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:49 smithi172 bash[23680]: cluster 2024-03-30T15:15:48.651832+0000 mon.a (mon.0) 2237 : cluster 0 osdmap e290: 8 total, 8 up, 8 in 2024-03-30T15:15:49.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:49 smithi172 bash[23680]: audit 2024-03-30T15:15:48.653605+0000 mon.a (mon.0) 2238 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-37"}]: dispatch 2024-03-30T15:15:49.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:49 smithi172 bash[23680]: audit 2024-03-30T15:15:48.654271+0000 mon.a (mon.0) 2239 : audit 1 from='client.? 172.21.15.72:0/2700176705' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi072-64163-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi072-64163-42"}]: dispatch 2024-03-30T15:15:49.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:49 smithi172 bash[23680]: audit 2024-03-30T15:15:49.200766+0000 mon.a (mon.0) 2240 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi072-64171-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi072-64171-53"}]': finished 2024-03-30T15:15:49.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:49 smithi172 bash[23680]: audit 2024-03-30T15:15:49.201034+0000 mon.a (mon.0) 2241 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-37"}]': finished 2024-03-30T15:15:49.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:49 smithi172 bash[23680]: cluster 2024-03-30T15:15:49.633957+0000 mon.a (mon.0) 2242 : cluster 0 osdmap e291: 8 total, 8 up, 8 in 2024-03-30T15:15:49.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:49 smithi172 bash[23680]: audit 2024-03-30T15:15:49.634762+0000 mon.a (mon.0) 2243 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-37", "mode": "writeback"}]: dispatch 2024-03-30T15:15:50.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:50 smithi172 bash[23680]: cluster 2024-03-30T15:15:50.201884+0000 mon.a (mon.0) 2244 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:15:50.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:50 smithi172 bash[23680]: audit 2024-03-30T15:15:50.204619+0000 mon.a (mon.0) 2245 : audit 1 from='client.? 172.21.15.72:0/2700176705' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWrite_smithi072-64163-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi072-64163-42"}]': finished 2024-03-30T15:15:50.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:50 smithi172 bash[23680]: audit 2024-03-30T15:15:50.204828+0000 mon.a (mon.0) 2246 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-37", "mode": "writeback"}]': finished 2024-03-30T15:15:50.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:50 smithi172 bash[23680]: cluster 2024-03-30T15:15:50.213289+0000 mon.a (mon.0) 2247 : cluster 0 osdmap e292: 8 total, 8 up, 8 in 2024-03-30T15:15:50.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:50 smithi172 bash[23680]: audit 2024-03-30T15:15:50.295246+0000 mon.a (mon.0) 2248 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:15:51.028 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:50 smithi072 bash[21573]: cluster 2024-03-30T15:15:50.201884+0000 mon.a (mon.0) 2244 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:15:51.029 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:50 smithi072 bash[21573]: audit 2024-03-30T15:15:50.204619+0000 mon.a (mon.0) 2245 : audit 1 from='client.? 172.21.15.72:0/2700176705' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWrite_smithi072-64163-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi072-64163-42"}]': finished 2024-03-30T15:15:51.029 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:50 smithi072 bash[21573]: audit 2024-03-30T15:15:50.204828+0000 mon.a (mon.0) 2246 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-37", "mode": "writeback"}]': finished 2024-03-30T15:15:51.029 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:50 smithi072 bash[21573]: cluster 2024-03-30T15:15:50.213289+0000 mon.a (mon.0) 2247 : cluster 0 osdmap e292: 8 total, 8 up, 8 in 2024-03-30T15:15:51.029 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:50 smithi072 bash[21573]: audit 2024-03-30T15:15:50.295246+0000 mon.a (mon.0) 2248 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:15:51.029 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:50 smithi072 bash[28946]: cluster 2024-03-30T15:15:50.201884+0000 mon.a (mon.0) 2244 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:15:51.029 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:50 smithi072 bash[28946]: audit 2024-03-30T15:15:50.204619+0000 mon.a (mon.0) 2245 : audit 1 from='client.? 172.21.15.72:0/2700176705' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWrite_smithi072-64163-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi072-64163-42"}]': finished 2024-03-30T15:15:51.029 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:50 smithi072 bash[28946]: audit 2024-03-30T15:15:50.204828+0000 mon.a (mon.0) 2246 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-37", "mode": "writeback"}]': finished 2024-03-30T15:15:51.029 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:50 smithi072 bash[28946]: cluster 2024-03-30T15:15:50.213289+0000 mon.a (mon.0) 2247 : cluster 0 osdmap e292: 8 total, 8 up, 8 in 2024-03-30T15:15:51.029 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:50 smithi072 bash[28946]: audit 2024-03-30T15:15:50.295246+0000 mon.a (mon.0) 2248 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:15:51.417 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:15:51 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:15:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:15:51.464 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:15:51 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:15:51.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:51 smithi172 bash[23680]: cluster 2024-03-30T15:15:49.996814+0000 mgr.y (mgr.14526) 333 : cluster 0 pgmap v441: 236 pgs: 40 unknown, 196 active+clean; 4.6 MiB data, 609 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:15:51.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:51 smithi172 bash[23680]: cluster 2024-03-30T15:15:50.669344+0000 mon.a (mon.0) 2249 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:15:51.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:51 smithi172 bash[23680]: audit 2024-03-30T15:15:50.964272+0000 mon.a (mon.0) 2250 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:15:51.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:51 smithi172 bash[23680]: audit 2024-03-30T15:15:50.967276+0000 mon.c (mon.2) 393 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:15:51.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:51 smithi172 bash[23680]: audit 2024-03-30T15:15:51.077573+0000 mon.a (mon.0) 2251 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:15:51.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:51 smithi172 bash[23680]: cluster 2024-03-30T15:15:51.093614+0000 mon.a (mon.0) 2252 : cluster 0 osdmap e293: 8 total, 8 up, 8 in 2024-03-30T15:15:51.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:51 smithi172 bash[23680]: audit 2024-03-30T15:15:51.096720+0000 mon.c (mon.2) 394 : audit 1 from='client.? 172.21.15.72:0/4126345961' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi072-64171-53"}]: dispatch 2024-03-30T15:15:51.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:51 smithi172 bash[23680]: audit 2024-03-30T15:15:51.099781+0000 mon.a (mon.0) 2253 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-37"}]: dispatch 2024-03-30T15:15:51.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:51 smithi172 bash[23680]: audit 2024-03-30T15:15:51.100831+0000 mon.a (mon.0) 2254 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi072-64171-53"}]: dispatch 2024-03-30T15:15:52.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:51 smithi072 bash[21573]: cluster 2024-03-30T15:15:49.996814+0000 mgr.y (mgr.14526) 333 : cluster 0 pgmap v441: 236 pgs: 40 unknown, 196 active+clean; 4.6 MiB data, 609 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:15:52.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:51 smithi072 bash[21573]: cluster 2024-03-30T15:15:50.669344+0000 mon.a (mon.0) 2249 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:15:52.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:51 smithi072 bash[21573]: audit 2024-03-30T15:15:50.964272+0000 mon.a (mon.0) 2250 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:15:52.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:51 smithi072 bash[21573]: audit 2024-03-30T15:15:50.967276+0000 mon.c (mon.2) 393 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:15:52.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:51 smithi072 bash[21573]: audit 2024-03-30T15:15:51.077573+0000 mon.a (mon.0) 2251 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:15:52.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:51 smithi072 bash[21573]: cluster 2024-03-30T15:15:51.093614+0000 mon.a (mon.0) 2252 : cluster 0 osdmap e293: 8 total, 8 up, 8 in 2024-03-30T15:15:52.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:51 smithi072 bash[21573]: audit 2024-03-30T15:15:51.096720+0000 mon.c (mon.2) 394 : audit 1 from='client.? 172.21.15.72:0/4126345961' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi072-64171-53"}]: dispatch 2024-03-30T15:15:52.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:51 smithi072 bash[21573]: audit 2024-03-30T15:15:51.099781+0000 mon.a (mon.0) 2253 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-37"}]: dispatch 2024-03-30T15:15:52.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:51 smithi072 bash[21573]: audit 2024-03-30T15:15:51.100831+0000 mon.a (mon.0) 2254 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi072-64171-53"}]: dispatch 2024-03-30T15:15:52.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:51 smithi072 bash[28946]: cluster 2024-03-30T15:15:49.996814+0000 mgr.y (mgr.14526) 333 : cluster 0 pgmap v441: 236 pgs: 40 unknown, 196 active+clean; 4.6 MiB data, 609 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:15:52.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:51 smithi072 bash[28946]: cluster 2024-03-30T15:15:50.669344+0000 mon.a (mon.0) 2249 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:15:52.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:51 smithi072 bash[28946]: audit 2024-03-30T15:15:50.964272+0000 mon.a (mon.0) 2250 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:15:52.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:51 smithi072 bash[28946]: audit 2024-03-30T15:15:50.967276+0000 mon.c (mon.2) 393 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:15:52.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:51 smithi072 bash[28946]: audit 2024-03-30T15:15:51.077573+0000 mon.a (mon.0) 2251 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:15:52.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:51 smithi072 bash[28946]: cluster 2024-03-30T15:15:51.093614+0000 mon.a (mon.0) 2252 : cluster 0 osdmap e293: 8 total, 8 up, 8 in 2024-03-30T15:15:52.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:51 smithi072 bash[28946]: audit 2024-03-30T15:15:51.096720+0000 mon.c (mon.2) 394 : audit 1 from='client.? 172.21.15.72:0/4126345961' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi072-64171-53"}]: dispatch 2024-03-30T15:15:52.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:51 smithi072 bash[28946]: audit 2024-03-30T15:15:51.099781+0000 mon.a (mon.0) 2253 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-37"}]: dispatch 2024-03-30T15:15:52.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:51 smithi072 bash[28946]: audit 2024-03-30T15:15:51.100831+0000 mon.a (mon.0) 2254 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi072-64171-53"}]: dispatch 2024-03-30T15:15:52.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:52 smithi172 bash[23680]: audit 2024-03-30T15:15:51.151567+0000 mgr.y (mgr.14526) 334 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:15:52.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:52 smithi172 bash[23680]: cluster 2024-03-30T15:15:52.077837+0000 mon.a (mon.0) 2255 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:15:52.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:52 smithi172 bash[23680]: audit 2024-03-30T15:15:52.080170+0000 mon.a (mon.0) 2256 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-37"}]': finished 2024-03-30T15:15:52.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:52 smithi172 bash[23680]: audit 2024-03-30T15:15:52.080397+0000 mon.a (mon.0) 2257 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi072-64171-53"}]': finished 2024-03-30T15:15:52.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:52 smithi172 bash[23680]: cluster 2024-03-30T15:15:52.086475+0000 mon.a (mon.0) 2258 : cluster 0 osdmap e294: 8 total, 8 up, 8 in 2024-03-30T15:15:52.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:52 smithi172 bash[23680]: audit 2024-03-30T15:15:52.089861+0000 mon.a (mon.0) 2259 : audit 1 from='client.? 172.21.15.72:0/2700176705' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi072-64163-42"}]: dispatch 2024-03-30T15:15:52.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:52 smithi172 bash[23680]: audit 2024-03-30T15:15:52.096195+0000 mon.c (mon.2) 395 : audit 1 from='client.? 172.21.15.72:0/4126345961' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi072-64171-53"}]: dispatch 2024-03-30T15:15:52.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:52 smithi172 bash[23680]: audit 2024-03-30T15:15:52.097042+0000 mon.a (mon.0) 2260 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi072-64171-53"}]: dispatch 2024-03-30T15:15:53.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:52 smithi072 bash[21573]: audit 2024-03-30T15:15:51.151567+0000 mgr.y (mgr.14526) 334 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:15:53.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:52 smithi072 bash[21573]: cluster 2024-03-30T15:15:52.077837+0000 mon.a (mon.0) 2255 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:15:53.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:52 smithi072 bash[21573]: audit 2024-03-30T15:15:52.080170+0000 mon.a (mon.0) 2256 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-37"}]': finished 2024-03-30T15:15:53.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:52 smithi072 bash[21573]: audit 2024-03-30T15:15:52.080397+0000 mon.a (mon.0) 2257 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi072-64171-53"}]': finished 2024-03-30T15:15:53.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:52 smithi072 bash[21573]: cluster 2024-03-30T15:15:52.086475+0000 mon.a (mon.0) 2258 : cluster 0 osdmap e294: 8 total, 8 up, 8 in 2024-03-30T15:15:53.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:52 smithi072 bash[21573]: audit 2024-03-30T15:15:52.089861+0000 mon.a (mon.0) 2259 : audit 1 from='client.? 172.21.15.72:0/2700176705' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi072-64163-42"}]: dispatch 2024-03-30T15:15:53.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:52 smithi072 bash[21573]: audit 2024-03-30T15:15:52.096195+0000 mon.c (mon.2) 395 : audit 1 from='client.? 172.21.15.72:0/4126345961' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi072-64171-53"}]: dispatch 2024-03-30T15:15:53.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:52 smithi072 bash[21573]: audit 2024-03-30T15:15:52.097042+0000 mon.a (mon.0) 2260 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi072-64171-53"}]: dispatch 2024-03-30T15:15:53.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:52 smithi072 bash[28946]: audit 2024-03-30T15:15:51.151567+0000 mgr.y (mgr.14526) 334 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:15:53.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:52 smithi072 bash[28946]: cluster 2024-03-30T15:15:52.077837+0000 mon.a (mon.0) 2255 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:15:53.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:52 smithi072 bash[28946]: audit 2024-03-30T15:15:52.080170+0000 mon.a (mon.0) 2256 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-37"}]': finished 2024-03-30T15:15:53.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:52 smithi072 bash[28946]: audit 2024-03-30T15:15:52.080397+0000 mon.a (mon.0) 2257 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi072-64171-53"}]': finished 2024-03-30T15:15:53.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:52 smithi072 bash[28946]: cluster 2024-03-30T15:15:52.086475+0000 mon.a (mon.0) 2258 : cluster 0 osdmap e294: 8 total, 8 up, 8 in 2024-03-30T15:15:53.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:52 smithi072 bash[28946]: audit 2024-03-30T15:15:52.089861+0000 mon.a (mon.0) 2259 : audit 1 from='client.? 172.21.15.72:0/2700176705' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi072-64163-42"}]: dispatch 2024-03-30T15:15:53.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:52 smithi072 bash[28946]: audit 2024-03-30T15:15:52.096195+0000 mon.c (mon.2) 395 : audit 1 from='client.? 172.21.15.72:0/4126345961' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi072-64171-53"}]: dispatch 2024-03-30T15:15:53.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:52 smithi072 bash[28946]: audit 2024-03-30T15:15:52.097042+0000 mon.a (mon.0) 2260 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi072-64171-53"}]: dispatch 2024-03-30T15:15:53.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:53 smithi172 bash[23680]: cluster 2024-03-30T15:15:51.997706+0000 mgr.y (mgr.14526) 335 : cluster 0 pgmap v444: 236 pgs: 8 creating+peering, 228 active+clean; 4.6 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-03-30T15:15:53.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:53 smithi172 bash[23680]: audit 2024-03-30T15:15:53.083494+0000 mon.a (mon.0) 2261 : audit 1 from='client.? 172.21.15.72:0/2700176705' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi072-64163-42"}]': finished 2024-03-30T15:15:53.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:53 smithi172 bash[23680]: audit 2024-03-30T15:15:53.083611+0000 mon.a (mon.0) 2262 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi072-64171-53"}]': finished 2024-03-30T15:15:53.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:53 smithi172 bash[23680]: cluster 2024-03-30T15:15:53.091360+0000 mon.a (mon.0) 2263 : cluster 0 osdmap e295: 8 total, 8 up, 8 in 2024-03-30T15:15:53.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:53 smithi172 bash[23680]: audit 2024-03-30T15:15:53.092645+0000 mon.a (mon.0) 2264 : audit 1 from='client.? 172.21.15.72:0/2700176705' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi072-64163-42"}]: dispatch 2024-03-30T15:15:53.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:53 smithi172 bash[23680]: audit 2024-03-30T15:15:53.126373+0000 mon.c (mon.2) 396 : audit 1 from='client.? 172.21.15.72:0/3160847843' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi072-64171-54"}]: dispatch 2024-03-30T15:15:53.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:53 smithi172 bash[23680]: audit 2024-03-30T15:15:53.539287+0000 mon.a (mon.0) 2265 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi072-64171-54"}]: dispatch 2024-03-30T15:15:53.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:53 smithi172 bash[23680]: audit 2024-03-30T15:15:53.540167+0000 mon.c (mon.2) 397 : audit 1 from='client.? 172.21.15.72:0/3160847843' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi072-64171-54"}]: dispatch 2024-03-30T15:15:53.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:53 smithi172 bash[23680]: audit 2024-03-30T15:15:53.540481+0000 mon.a (mon.0) 2266 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi072-64171-54"}]: dispatch 2024-03-30T15:15:53.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:53 smithi172 bash[23680]: audit 2024-03-30T15:15:53.541144+0000 mon.c (mon.2) 398 : audit 1 from='client.? 172.21.15.72:0/3160847843' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi072-64171-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:53.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:53 smithi172 bash[23680]: audit 2024-03-30T15:15:53.541491+0000 mon.a (mon.0) 2267 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi072-64171-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:54.121 INFO:tasks.workunit.client.0.smithi072.stdout:te 2024-03-30T15:15:54.122 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleWrite (7004 ms) 2024-03-30T15:15:54.122 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ RUN ] LibRadosAioEC.WaitForComplete 2024-03-30T15:15:54.122 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ OK ] LibRadosAioEC.WaitForComplete (6992 ms) 2024-03-30T15:15:54.122 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip 2024-03-30T15:15:54.122 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip (7373 ms) 2024-03-30T15:15:54.122 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip2 2024-03-30T15:15:54.122 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip2 (7052 ms) 2024-03-30T15:15:54.122 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripAppend 2024-03-30T15:15:54.122 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripAppend (7031 ms) 2024-03-30T15:15:54.122 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ RUN ] LibRadosAioEC.IsComplete 2024-03-30T15:15:54.122 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ OK ] LibRadosAioEC.IsComplete (7477 ms) 2024-03-30T15:15:54.123 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ RUN ] LibRadosAioEC.IsSafe 2024-03-30T15:15:54.123 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ OK ] LibRadosAioEC.IsSafe (6478 ms) 2024-03-30T15:15:54.123 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ RUN ] LibRadosAioEC.ReturnValue 2024-03-30T15:15:54.123 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ OK ] LibRadosAioEC.ReturnValue (7033 ms) 2024-03-30T15:15:54.123 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ RUN ] LibRadosAioEC.Flush 2024-03-30T15:15:54.123 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ OK ] LibRadosAioEC.Flush (7029 ms) 2024-03-30T15:15:54.123 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ RUN ] LibRadosAioEC.FlushAsync 2024-03-30T15:15:54.123 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ OK ] LibRadosAioEC.FlushAsync (6972 ms) 2024-03-30T15:15:54.123 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripWriteFull 2024-03-30T15:15:54.123 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripWriteFull (7021 ms) 2024-03-30T15:15:54.123 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStat 2024-03-30T15:15:54.123 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStat (6985 ms) 2024-03-30T15:15:54.123 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStatNS 2024-03-30T15:15:54.123 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStatNS (7053 ms) 2024-03-30T15:15:54.123 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ RUN ] LibRadosAioEC.StatRemove 2024-03-30T15:15:54.124 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ OK ] LibRadosAioEC.StatRemove (7021 ms) 2024-03-30T15:15:54.124 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ RUN ] LibRadosAioEC.ExecuteClass 2024-03-30T15:15:54.124 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ OK ] LibRadosAioEC.ExecuteClass (7028 ms) 2024-03-30T15:15:54.124 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ RUN ] LibRadosAioEC.MultiWrite 2024-03-30T15:15:54.124 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ OK ] LibRadosAioEC.MultiWrite (6907 ms) 2024-03-30T15:15:54.124 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [----------] 16 tests from LibRadosAioEC (112456 ms total) 2024-03-30T15:15:54.124 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: 2024-03-30T15:15:54.124 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [----------] Global test environment tear-down 2024-03-30T15:15:54.124 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [==========] 42 tests from 2 test suites ran. (242174 ms total) 2024-03-30T15:15:54.124 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio: [ PASSED ] 42 tests. 2024-03-30T15:15:54.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:53 smithi072 bash[21573]: cluster 2024-03-30T15:15:51.997706+0000 mgr.y (mgr.14526) 335 : cluster 0 pgmap v444: 236 pgs: 8 creating+peering, 228 active+clean; 4.6 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-03-30T15:15:54.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:53 smithi072 bash[21573]: audit 2024-03-30T15:15:53.083494+0000 mon.a (mon.0) 2261 : audit 1 from='client.? 172.21.15.72:0/2700176705' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi072-64163-42"}]': finished 2024-03-30T15:15:54.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:53 smithi072 bash[21573]: audit 2024-03-30T15:15:53.083611+0000 mon.a (mon.0) 2262 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi072-64171-53"}]': finished 2024-03-30T15:15:54.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:53 smithi072 bash[21573]: cluster 2024-03-30T15:15:53.091360+0000 mon.a (mon.0) 2263 : cluster 0 osdmap e295: 8 total, 8 up, 8 in 2024-03-30T15:15:54.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:53 smithi072 bash[21573]: audit 2024-03-30T15:15:53.092645+0000 mon.a (mon.0) 2264 : audit 1 from='client.? 172.21.15.72:0/2700176705' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi072-64163-42"}]: dispatch 2024-03-30T15:15:54.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:53 smithi072 bash[21573]: audit 2024-03-30T15:15:53.126373+0000 mon.c (mon.2) 396 : audit 1 from='client.? 172.21.15.72:0/3160847843' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi072-64171-54"}]: dispatch 2024-03-30T15:15:54.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:53 smithi072 bash[21573]: audit 2024-03-30T15:15:53.539287+0000 mon.a (mon.0) 2265 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi072-64171-54"}]: dispatch 2024-03-30T15:15:54.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:53 smithi072 bash[21573]: audit 2024-03-30T15:15:53.540167+0000 mon.c (mon.2) 397 : audit 1 from='client.? 172.21.15.72:0/3160847843' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi072-64171-54"}]: dispatch 2024-03-30T15:15:54.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:53 smithi072 bash[21573]: audit 2024-03-30T15:15:53.540481+0000 mon.a (mon.0) 2266 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi072-64171-54"}]: dispatch 2024-03-30T15:15:54.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:53 smithi072 bash[21573]: audit 2024-03-30T15:15:53.541144+0000 mon.c (mon.2) 398 : audit 1 from='client.? 172.21.15.72:0/3160847843' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi072-64171-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:54.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:53 smithi072 bash[21573]: audit 2024-03-30T15:15:53.541491+0000 mon.a (mon.0) 2267 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi072-64171-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:54.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:53 smithi072 bash[28946]: cluster 2024-03-30T15:15:51.997706+0000 mgr.y (mgr.14526) 335 : cluster 0 pgmap v444: 236 pgs: 8 creating+peering, 228 active+clean; 4.6 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-03-30T15:15:54.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:53 smithi072 bash[28946]: audit 2024-03-30T15:15:53.083494+0000 mon.a (mon.0) 2261 : audit 1 from='client.? 172.21.15.72:0/2700176705' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi072-64163-42"}]': finished 2024-03-30T15:15:54.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:53 smithi072 bash[28946]: audit 2024-03-30T15:15:53.083611+0000 mon.a (mon.0) 2262 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi072-64171-53"}]': finished 2024-03-30T15:15:54.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:53 smithi072 bash[28946]: cluster 2024-03-30T15:15:53.091360+0000 mon.a (mon.0) 2263 : cluster 0 osdmap e295: 8 total, 8 up, 8 in 2024-03-30T15:15:54.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:53 smithi072 bash[28946]: audit 2024-03-30T15:15:53.092645+0000 mon.a (mon.0) 2264 : audit 1 from='client.? 172.21.15.72:0/2700176705' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi072-64163-42"}]: dispatch 2024-03-30T15:15:54.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:53 smithi072 bash[28946]: audit 2024-03-30T15:15:53.126373+0000 mon.c (mon.2) 396 : audit 1 from='client.? 172.21.15.72:0/3160847843' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi072-64171-54"}]: dispatch 2024-03-30T15:15:54.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:53 smithi072 bash[28946]: audit 2024-03-30T15:15:53.539287+0000 mon.a (mon.0) 2265 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi072-64171-54"}]: dispatch 2024-03-30T15:15:54.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:53 smithi072 bash[28946]: audit 2024-03-30T15:15:53.540167+0000 mon.c (mon.2) 397 : audit 1 from='client.? 172.21.15.72:0/3160847843' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi072-64171-54"}]: dispatch 2024-03-30T15:15:54.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:53 smithi072 bash[28946]: audit 2024-03-30T15:15:53.540481+0000 mon.a (mon.0) 2266 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi072-64171-54"}]: dispatch 2024-03-30T15:15:54.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:53 smithi072 bash[28946]: audit 2024-03-30T15:15:53.541144+0000 mon.c (mon.2) 398 : audit 1 from='client.? 172.21.15.72:0/3160847843' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi072-64171-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:54.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:53 smithi072 bash[28946]: audit 2024-03-30T15:15:53.541491+0000 mon.a (mon.0) 2267 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi072-64171-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:15:55.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:55 smithi072 bash[28946]: cluster 2024-03-30T15:15:53.998572+0000 mgr.y (mgr.14526) 336 : cluster 0 pgmap v447: 196 pgs: 196 active+clean; 4.6 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-03-30T15:15:55.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:55 smithi072 bash[28946]: audit 2024-03-30T15:15:54.087752+0000 mon.a (mon.0) 2268 : audit 1 from='client.? 172.21.15.72:0/2700176705' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi072-64163-42"}]': finished 2024-03-30T15:15:55.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:55 smithi072 bash[28946]: audit 2024-03-30T15:15:54.087965+0000 mon.a (mon.0) 2269 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi072-64171-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:15:55.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:55 smithi072 bash[28946]: cluster 2024-03-30T15:15:54.098184+0000 mon.a (mon.0) 2270 : cluster 0 osdmap e296: 8 total, 8 up, 8 in 2024-03-30T15:15:55.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:55 smithi072 bash[28946]: audit 2024-03-30T15:15:54.100771+0000 mon.a (mon.0) 2271 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:15:55.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:55 smithi072 bash[28946]: audit 2024-03-30T15:15:54.103765+0000 mon.c (mon.2) 399 : audit 1 from='client.? 172.21.15.72:0/3160847843' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi072-64171-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi072-64171-54"}]: dispatch 2024-03-30T15:15:55.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:55 smithi072 bash[28946]: audit 2024-03-30T15:15:54.104776+0000 mon.a (mon.0) 2272 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi072-64171-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi072-64171-54"}]: dispatch 2024-03-30T15:15:55.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:55 smithi072 bash[21573]: cluster 2024-03-30T15:15:53.998572+0000 mgr.y (mgr.14526) 336 : cluster 0 pgmap v447: 196 pgs: 196 active+clean; 4.6 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-03-30T15:15:55.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:55 smithi072 bash[21573]: audit 2024-03-30T15:15:54.087752+0000 mon.a (mon.0) 2268 : audit 1 from='client.? 172.21.15.72:0/2700176705' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi072-64163-42"}]': finished 2024-03-30T15:15:55.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:55 smithi072 bash[21573]: audit 2024-03-30T15:15:54.087965+0000 mon.a (mon.0) 2269 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi072-64171-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:15:55.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:55 smithi072 bash[21573]: cluster 2024-03-30T15:15:54.098184+0000 mon.a (mon.0) 2270 : cluster 0 osdmap e296: 8 total, 8 up, 8 in 2024-03-30T15:15:55.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:55 smithi072 bash[21573]: audit 2024-03-30T15:15:54.100771+0000 mon.a (mon.0) 2271 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:15:55.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:55 smithi072 bash[21573]: audit 2024-03-30T15:15:54.103765+0000 mon.c (mon.2) 399 : audit 1 from='client.? 172.21.15.72:0/3160847843' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi072-64171-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi072-64171-54"}]: dispatch 2024-03-30T15:15:55.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:55 smithi072 bash[21573]: audit 2024-03-30T15:15:54.104776+0000 mon.a (mon.0) 2272 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi072-64171-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi072-64171-54"}]: dispatch 2024-03-30T15:15:55.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:55 smithi172 bash[23680]: cluster 2024-03-30T15:15:53.998572+0000 mgr.y (mgr.14526) 336 : cluster 0 pgmap v447: 196 pgs: 196 active+clean; 4.6 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-03-30T15:15:55.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:55 smithi172 bash[23680]: audit 2024-03-30T15:15:54.087752+0000 mon.a (mon.0) 2268 : audit 1 from='client.? 172.21.15.72:0/2700176705' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi072-64163-42"}]': finished 2024-03-30T15:15:55.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:55 smithi172 bash[23680]: audit 2024-03-30T15:15:54.087965+0000 mon.a (mon.0) 2269 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi072-64171-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:15:55.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:55 smithi172 bash[23680]: cluster 2024-03-30T15:15:54.098184+0000 mon.a (mon.0) 2270 : cluster 0 osdmap e296: 8 total, 8 up, 8 in 2024-03-30T15:15:55.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:55 smithi172 bash[23680]: audit 2024-03-30T15:15:54.100771+0000 mon.a (mon.0) 2271 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:15:55.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:55 smithi172 bash[23680]: audit 2024-03-30T15:15:54.103765+0000 mon.c (mon.2) 399 : audit 1 from='client.? 172.21.15.72:0/3160847843' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi072-64171-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi072-64171-54"}]: dispatch 2024-03-30T15:15:55.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:55 smithi172 bash[23680]: audit 2024-03-30T15:15:54.104776+0000 mon.a (mon.0) 2272 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi072-64171-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi072-64171-54"}]: dispatch 2024-03-30T15:15:56.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:56 smithi072 bash[21573]: audit 2024-03-30T15:15:55.092918+0000 mon.a (mon.0) 2273 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:15:56.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:56 smithi072 bash[21573]: cluster 2024-03-30T15:15:55.556370+0000 mon.a (mon.0) 2274 : cluster 0 osdmap e297: 8 total, 8 up, 8 in 2024-03-30T15:15:56.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:56 smithi072 bash[21573]: audit 2024-03-30T15:15:55.569770+0000 mon.a (mon.0) 2275 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:15:56.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:56 smithi072 bash[21573]: cluster 2024-03-30T15:15:56.076706+0000 mon.a (mon.0) 2276 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:15:56.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:56 smithi072 bash[21573]: audit 2024-03-30T15:15:56.096280+0000 mon.a (mon.0) 2277 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi072-64171-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi072-64171-54"}]': finished 2024-03-30T15:15:56.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:56 smithi072 bash[21573]: audit 2024-03-30T15:15:56.096626+0000 mon.a (mon.0) 2278 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-39", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:15:56.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:56 smithi072 bash[21573]: cluster 2024-03-30T15:15:56.104257+0000 mon.a (mon.0) 2279 : cluster 0 osdmap e298: 8 total, 8 up, 8 in 2024-03-30T15:15:56.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:56 smithi072 bash[21573]: audit 2024-03-30T15:15:56.116092+0000 mon.a (mon.0) 2280 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-39"}]: dispatch 2024-03-30T15:15:56.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:56 smithi072 bash[28946]: audit 2024-03-30T15:15:55.092918+0000 mon.a (mon.0) 2273 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:15:56.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:56 smithi072 bash[28946]: cluster 2024-03-30T15:15:55.556370+0000 mon.a (mon.0) 2274 : cluster 0 osdmap e297: 8 total, 8 up, 8 in 2024-03-30T15:15:56.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:56 smithi072 bash[28946]: audit 2024-03-30T15:15:55.569770+0000 mon.a (mon.0) 2275 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:15:56.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:56 smithi072 bash[28946]: cluster 2024-03-30T15:15:56.076706+0000 mon.a (mon.0) 2276 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:15:56.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:56 smithi072 bash[28946]: audit 2024-03-30T15:15:56.096280+0000 mon.a (mon.0) 2277 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi072-64171-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi072-64171-54"}]': finished 2024-03-30T15:15:56.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:56 smithi072 bash[28946]: audit 2024-03-30T15:15:56.096626+0000 mon.a (mon.0) 2278 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-39", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:15:56.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:56 smithi072 bash[28946]: cluster 2024-03-30T15:15:56.104257+0000 mon.a (mon.0) 2279 : cluster 0 osdmap e298: 8 total, 8 up, 8 in 2024-03-30T15:15:56.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:56 smithi072 bash[28946]: audit 2024-03-30T15:15:56.116092+0000 mon.a (mon.0) 2280 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-39"}]: dispatch 2024-03-30T15:15:56.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:56 smithi172 bash[23680]: audit 2024-03-30T15:15:55.092918+0000 mon.a (mon.0) 2273 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:15:56.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:56 smithi172 bash[23680]: cluster 2024-03-30T15:15:55.556370+0000 mon.a (mon.0) 2274 : cluster 0 osdmap e297: 8 total, 8 up, 8 in 2024-03-30T15:15:56.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:56 smithi172 bash[23680]: audit 2024-03-30T15:15:55.569770+0000 mon.a (mon.0) 2275 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:15:56.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:56 smithi172 bash[23680]: cluster 2024-03-30T15:15:56.076706+0000 mon.a (mon.0) 2276 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:15:56.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:56 smithi172 bash[23680]: audit 2024-03-30T15:15:56.096280+0000 mon.a (mon.0) 2277 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi072-64171-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi072-64171-54"}]': finished 2024-03-30T15:15:56.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:56 smithi172 bash[23680]: audit 2024-03-30T15:15:56.096626+0000 mon.a (mon.0) 2278 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-39", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:15:56.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:56 smithi172 bash[23680]: cluster 2024-03-30T15:15:56.104257+0000 mon.a (mon.0) 2279 : cluster 0 osdmap e298: 8 total, 8 up, 8 in 2024-03-30T15:15:56.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:56 smithi172 bash[23680]: audit 2024-03-30T15:15:56.116092+0000 mon.a (mon.0) 2280 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-39"}]: dispatch 2024-03-30T15:15:57.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:57 smithi072 bash[21573]: cluster 2024-03-30T15:15:56.000634+0000 mgr.y (mgr.14526) 337 : cluster 0 pgmap v450: 228 pgs: 228 active+clean; 4.6 MiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:15:57.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:57 smithi072 bash[21573]: audit 2024-03-30T15:15:57.099106+0000 mon.a (mon.0) 2281 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-39"}]': finished 2024-03-30T15:15:57.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:57 smithi072 bash[21573]: cluster 2024-03-30T15:15:57.110246+0000 mon.a (mon.0) 2282 : cluster 0 osdmap e299: 8 total, 8 up, 8 in 2024-03-30T15:15:57.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:57 smithi072 bash[21573]: audit 2024-03-30T15:15:57.121441+0000 mon.a (mon.0) 2283 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-39", "mode": "writeback"}]: dispatch 2024-03-30T15:15:57.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:57 smithi072 bash[28946]: cluster 2024-03-30T15:15:56.000634+0000 mgr.y (mgr.14526) 337 : cluster 0 pgmap v450: 228 pgs: 228 active+clean; 4.6 MiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:15:57.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:57 smithi072 bash[28946]: audit 2024-03-30T15:15:57.099106+0000 mon.a (mon.0) 2281 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-39"}]': finished 2024-03-30T15:15:57.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:57 smithi072 bash[28946]: cluster 2024-03-30T15:15:57.110246+0000 mon.a (mon.0) 2282 : cluster 0 osdmap e299: 8 total, 8 up, 8 in 2024-03-30T15:15:57.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:57 smithi072 bash[28946]: audit 2024-03-30T15:15:57.121441+0000 mon.a (mon.0) 2283 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-39", "mode": "writeback"}]: dispatch 2024-03-30T15:15:57.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:57 smithi172 bash[23680]: cluster 2024-03-30T15:15:56.000634+0000 mgr.y (mgr.14526) 337 : cluster 0 pgmap v450: 228 pgs: 228 active+clean; 4.6 MiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:15:57.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:57 smithi172 bash[23680]: audit 2024-03-30T15:15:57.099106+0000 mon.a (mon.0) 2281 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-39"}]': finished 2024-03-30T15:15:57.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:57 smithi172 bash[23680]: cluster 2024-03-30T15:15:57.110246+0000 mon.a (mon.0) 2282 : cluster 0 osdmap e299: 8 total, 8 up, 8 in 2024-03-30T15:15:57.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:57 smithi172 bash[23680]: audit 2024-03-30T15:15:57.121441+0000 mon.a (mon.0) 2283 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-39", "mode": "writeback"}]: dispatch 2024-03-30T15:15:58.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:58 smithi072 bash[21573]: cluster 2024-03-30T15:15:58.099475+0000 mon.a (mon.0) 2284 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:15:58.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:58 smithi072 bash[21573]: audit 2024-03-30T15:15:58.101895+0000 mon.a (mon.0) 2285 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-39", "mode": "writeback"}]': finished 2024-03-30T15:15:58.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:58 smithi072 bash[21573]: cluster 2024-03-30T15:15:58.111061+0000 mon.a (mon.0) 2286 : cluster 0 osdmap e300: 8 total, 8 up, 8 in 2024-03-30T15:15:58.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:58 smithi072 bash[21573]: audit 2024-03-30T15:15:58.119606+0000 mon.c (mon.2) 400 : audit 1 from='client.? 172.21.15.72:0/3160847843' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi072-64171-54"}]: dispatch 2024-03-30T15:15:58.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:58 smithi072 bash[21573]: audit 2024-03-30T15:15:58.121167+0000 mon.a (mon.0) 2287 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi072-64171-54"}]: dispatch 2024-03-30T15:15:58.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:58 smithi072 bash[21573]: audit 2024-03-30T15:15:58.306077+0000 mon.a (mon.0) 2288 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:15:58.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:58 smithi072 bash[28946]: cluster 2024-03-30T15:15:58.099475+0000 mon.a (mon.0) 2284 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:15:58.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:58 smithi072 bash[28946]: audit 2024-03-30T15:15:58.101895+0000 mon.a (mon.0) 2285 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-39", "mode": "writeback"}]': finished 2024-03-30T15:15:58.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:58 smithi072 bash[28946]: cluster 2024-03-30T15:15:58.111061+0000 mon.a (mon.0) 2286 : cluster 0 osdmap e300: 8 total, 8 up, 8 in 2024-03-30T15:15:58.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:58 smithi072 bash[28946]: audit 2024-03-30T15:15:58.119606+0000 mon.c (mon.2) 400 : audit 1 from='client.? 172.21.15.72:0/3160847843' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi072-64171-54"}]: dispatch 2024-03-30T15:15:58.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:58 smithi072 bash[28946]: audit 2024-03-30T15:15:58.121167+0000 mon.a (mon.0) 2287 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi072-64171-54"}]: dispatch 2024-03-30T15:15:58.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:58 smithi072 bash[28946]: audit 2024-03-30T15:15:58.306077+0000 mon.a (mon.0) 2288 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:15:58.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:58 smithi172 bash[23680]: cluster 2024-03-30T15:15:58.099475+0000 mon.a (mon.0) 2284 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:15:58.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:58 smithi172 bash[23680]: audit 2024-03-30T15:15:58.101895+0000 mon.a (mon.0) 2285 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-39", "mode": "writeback"}]': finished 2024-03-30T15:15:58.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:58 smithi172 bash[23680]: cluster 2024-03-30T15:15:58.111061+0000 mon.a (mon.0) 2286 : cluster 0 osdmap e300: 8 total, 8 up, 8 in 2024-03-30T15:15:58.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:58 smithi172 bash[23680]: audit 2024-03-30T15:15:58.119606+0000 mon.c (mon.2) 400 : audit 1 from='client.? 172.21.15.72:0/3160847843' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi072-64171-54"}]: dispatch 2024-03-30T15:15:58.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:58 smithi172 bash[23680]: audit 2024-03-30T15:15:58.121167+0000 mon.a (mon.0) 2287 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi072-64171-54"}]: dispatch 2024-03-30T15:15:58.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:58 smithi172 bash[23680]: audit 2024-03-30T15:15:58.306077+0000 mon.a (mon.0) 2288 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:15:59.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:59 smithi072 bash[21573]: cluster 2024-03-30T15:15:58.001540+0000 mgr.y (mgr.14526) 338 : cluster 0 pgmap v453: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:15:59.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:59 smithi072 bash[21573]: audit 2024-03-30T15:15:59.104725+0000 mon.a (mon.0) 2289 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi072-64171-54"}]': finished 2024-03-30T15:15:59.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:59 smithi072 bash[21573]: audit 2024-03-30T15:15:59.104966+0000 mon.a (mon.0) 2290 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:15:59.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:59 smithi072 bash[21573]: cluster 2024-03-30T15:15:59.113153+0000 mon.a (mon.0) 2291 : cluster 0 osdmap e301: 8 total, 8 up, 8 in 2024-03-30T15:15:59.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:59 smithi072 bash[21573]: audit 2024-03-30T15:15:59.114147+0000 mon.c (mon.2) 401 : audit 1 from='client.? 172.21.15.72:0/3160847843' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi072-64171-54"}]: dispatch 2024-03-30T15:15:59.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:59 smithi072 bash[21573]: audit 2024-03-30T15:15:59.114520+0000 mon.a (mon.0) 2292 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-39"}]: dispatch 2024-03-30T15:15:59.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:15:59 smithi072 bash[21573]: audit 2024-03-30T15:15:59.116180+0000 mon.a (mon.0) 2293 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi072-64171-54"}]: dispatch 2024-03-30T15:15:59.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:59 smithi072 bash[28946]: cluster 2024-03-30T15:15:58.001540+0000 mgr.y (mgr.14526) 338 : cluster 0 pgmap v453: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:15:59.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:59 smithi072 bash[28946]: audit 2024-03-30T15:15:59.104725+0000 mon.a (mon.0) 2289 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi072-64171-54"}]': finished 2024-03-30T15:15:59.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:59 smithi072 bash[28946]: audit 2024-03-30T15:15:59.104966+0000 mon.a (mon.0) 2290 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:15:59.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:59 smithi072 bash[28946]: cluster 2024-03-30T15:15:59.113153+0000 mon.a (mon.0) 2291 : cluster 0 osdmap e301: 8 total, 8 up, 8 in 2024-03-30T15:15:59.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:59 smithi072 bash[28946]: audit 2024-03-30T15:15:59.114147+0000 mon.c (mon.2) 401 : audit 1 from='client.? 172.21.15.72:0/3160847843' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi072-64171-54"}]: dispatch 2024-03-30T15:15:59.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:59 smithi072 bash[28946]: audit 2024-03-30T15:15:59.114520+0000 mon.a (mon.0) 2292 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-39"}]: dispatch 2024-03-30T15:15:59.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:15:59 smithi072 bash[28946]: audit 2024-03-30T15:15:59.116180+0000 mon.a (mon.0) 2293 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi072-64171-54"}]: dispatch 2024-03-30T15:15:59.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:59 smithi172 bash[23680]: cluster 2024-03-30T15:15:58.001540+0000 mgr.y (mgr.14526) 338 : cluster 0 pgmap v453: 236 pgs: 8 unknown, 228 active+clean; 4.6 MiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:15:59.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:59 smithi172 bash[23680]: audit 2024-03-30T15:15:59.104725+0000 mon.a (mon.0) 2289 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi072-64171-54"}]': finished 2024-03-30T15:15:59.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:59 smithi172 bash[23680]: audit 2024-03-30T15:15:59.104966+0000 mon.a (mon.0) 2290 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:15:59.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:59 smithi172 bash[23680]: cluster 2024-03-30T15:15:59.113153+0000 mon.a (mon.0) 2291 : cluster 0 osdmap e301: 8 total, 8 up, 8 in 2024-03-30T15:15:59.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:59 smithi172 bash[23680]: audit 2024-03-30T15:15:59.114147+0000 mon.c (mon.2) 401 : audit 1 from='client.? 172.21.15.72:0/3160847843' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi072-64171-54"}]: dispatch 2024-03-30T15:15:59.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:59 smithi172 bash[23680]: audit 2024-03-30T15:15:59.114520+0000 mon.a (mon.0) 2292 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-39"}]: dispatch 2024-03-30T15:15:59.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:15:59 smithi172 bash[23680]: audit 2024-03-30T15:15:59.116180+0000 mon.a (mon.0) 2293 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi072-64171-54"}]: dispatch 2024-03-30T15:16:00.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:00 smithi072 bash[28946]: cluster 2024-03-30T15:16:00.106213+0000 mon.a (mon.0) 2294 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:16:00.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:00 smithi072 bash[28946]: audit 2024-03-30T15:16:00.108372+0000 mon.a (mon.0) 2295 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-39"}]': finished 2024-03-30T15:16:00.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:00 smithi072 bash[28946]: audit 2024-03-30T15:16:00.108541+0000 mon.a (mon.0) 2296 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi072-64171-54"}]': finished 2024-03-30T15:16:00.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:00 smithi072 bash[28946]: cluster 2024-03-30T15:16:00.118004+0000 mon.a (mon.0) 2297 : cluster 0 osdmap e302: 8 total, 8 up, 8 in 2024-03-30T15:16:00.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:00 smithi072 bash[28946]: audit 2024-03-30T15:16:00.159006+0000 mon.c (mon.2) 402 : audit 1 from='client.? 172.21.15.72:0/862490468' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi072-64171-55"}]: dispatch 2024-03-30T15:16:00.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:00 smithi072 bash[28946]: audit 2024-03-30T15:16:00.159364+0000 mon.a (mon.0) 2298 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi072-64171-55"}]: dispatch 2024-03-30T15:16:00.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:00 smithi072 bash[28946]: audit 2024-03-30T15:16:00.160115+0000 mon.c (mon.2) 403 : audit 1 from='client.? 172.21.15.72:0/862490468' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi072-64171-55"}]: dispatch 2024-03-30T15:16:00.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:00 smithi072 bash[28946]: audit 2024-03-30T15:16:00.160390+0000 mon.a (mon.0) 2299 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi072-64171-55"}]: dispatch 2024-03-30T15:16:00.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:00 smithi072 bash[28946]: audit 2024-03-30T15:16:00.160887+0000 mon.c (mon.2) 404 : audit 1 from='client.? 172.21.15.72:0/862490468' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi072-64171-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:16:00.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:00 smithi072 bash[28946]: audit 2024-03-30T15:16:00.161231+0000 mon.a (mon.0) 2300 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi072-64171-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:16:00.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:00 smithi072 bash[21573]: cluster 2024-03-30T15:16:00.106213+0000 mon.a (mon.0) 2294 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:16:00.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:00 smithi072 bash[21573]: audit 2024-03-30T15:16:00.108372+0000 mon.a (mon.0) 2295 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-39"}]': finished 2024-03-30T15:16:00.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:00 smithi072 bash[21573]: audit 2024-03-30T15:16:00.108541+0000 mon.a (mon.0) 2296 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi072-64171-54"}]': finished 2024-03-30T15:16:00.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:00 smithi072 bash[21573]: cluster 2024-03-30T15:16:00.118004+0000 mon.a (mon.0) 2297 : cluster 0 osdmap e302: 8 total, 8 up, 8 in 2024-03-30T15:16:00.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:00 smithi072 bash[21573]: audit 2024-03-30T15:16:00.159006+0000 mon.c (mon.2) 402 : audit 1 from='client.? 172.21.15.72:0/862490468' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi072-64171-55"}]: dispatch 2024-03-30T15:16:00.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:00 smithi072 bash[21573]: audit 2024-03-30T15:16:00.159364+0000 mon.a (mon.0) 2298 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi072-64171-55"}]: dispatch 2024-03-30T15:16:00.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:00 smithi072 bash[21573]: audit 2024-03-30T15:16:00.160115+0000 mon.c (mon.2) 403 : audit 1 from='client.? 172.21.15.72:0/862490468' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi072-64171-55"}]: dispatch 2024-03-30T15:16:00.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:00 smithi072 bash[21573]: audit 2024-03-30T15:16:00.160390+0000 mon.a (mon.0) 2299 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi072-64171-55"}]: dispatch 2024-03-30T15:16:00.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:00 smithi072 bash[21573]: audit 2024-03-30T15:16:00.160887+0000 mon.c (mon.2) 404 : audit 1 from='client.? 172.21.15.72:0/862490468' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi072-64171-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:16:00.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:00 smithi072 bash[21573]: audit 2024-03-30T15:16:00.161231+0000 mon.a (mon.0) 2300 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi072-64171-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:16:00.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:00 smithi172 bash[23680]: cluster 2024-03-30T15:16:00.106213+0000 mon.a (mon.0) 2294 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:16:00.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:00 smithi172 bash[23680]: audit 2024-03-30T15:16:00.108372+0000 mon.a (mon.0) 2295 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-39"}]': finished 2024-03-30T15:16:00.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:00 smithi172 bash[23680]: audit 2024-03-30T15:16:00.108541+0000 mon.a (mon.0) 2296 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi072-64171-54"}]': finished 2024-03-30T15:16:00.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:00 smithi172 bash[23680]: cluster 2024-03-30T15:16:00.118004+0000 mon.a (mon.0) 2297 : cluster 0 osdmap e302: 8 total, 8 up, 8 in 2024-03-30T15:16:00.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:00 smithi172 bash[23680]: audit 2024-03-30T15:16:00.159006+0000 mon.c (mon.2) 402 : audit 1 from='client.? 172.21.15.72:0/862490468' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi072-64171-55"}]: dispatch 2024-03-30T15:16:00.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:00 smithi172 bash[23680]: audit 2024-03-30T15:16:00.159364+0000 mon.a (mon.0) 2298 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi072-64171-55"}]: dispatch 2024-03-30T15:16:00.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:00 smithi172 bash[23680]: audit 2024-03-30T15:16:00.160115+0000 mon.c (mon.2) 403 : audit 1 from='client.? 172.21.15.72:0/862490468' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi072-64171-55"}]: dispatch 2024-03-30T15:16:00.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:00 smithi172 bash[23680]: audit 2024-03-30T15:16:00.160390+0000 mon.a (mon.0) 2299 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi072-64171-55"}]: dispatch 2024-03-30T15:16:00.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:00 smithi172 bash[23680]: audit 2024-03-30T15:16:00.160887+0000 mon.c (mon.2) 404 : audit 1 from='client.? 172.21.15.72:0/862490468' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi072-64171-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:16:00.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:00 smithi172 bash[23680]: audit 2024-03-30T15:16:00.161231+0000 mon.a (mon.0) 2300 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi072-64171-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:16:01.118 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [==========] Running 77 tests from 4 test suites. 2024-03-30T15:16:01.118 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [----------] Global test environment set-up. 2024-03-30T15:16:01.118 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP 2024-03-30T15:16:01.118 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: seed 64344 2024-03-30T15:16:01.118 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.Dirty 2024-03-30T15:16:01.118 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTierPP.Dirty (331 ms) 2024-03-30T15:16:01.118 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.FlushWriteRaces 2024-03-30T15:16:01.119 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTierPP.FlushWriteRaces (21426 ms) 2024-03-30T15:16:01.119 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.HitSetNone 2024-03-30T15:16:01.119 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTierPP.HitSetNone (2 ms) 2024-03-30T15:16:01.119 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP (21759 ms total) 2024-03-30T15:16:01.119 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: 2024-03-30T15:16:01.119 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [----------] 48 tests from LibRadosTwoPoolsPP 2024-03-30T15:16:01.119 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Overlay 2024-03-30T15:16:01.119 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Overlay (13648 ms) 2024-03-30T15:16:01.119 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Promote 2024-03-30T15:16:01.119 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Promote (9905 ms) 2024-03-30T15:16:01.119 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnap 2024-03-30T15:16:01.119 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnap (11793 ms) 2024-03-30T15:16:01.119 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapScrub 2024-03-30T15:16:01.119 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: my_snaps [3] 2024-03-30T15:16:01.120 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: my_snaps [4,3] 2024-03-30T15:16:01.120 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: my_snaps [5,4,3] 2024-03-30T15:16:01.120 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: my_snaps [6,5,4,3] 2024-03-30T15:16:01.120 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: promoting some heads 2024-03-30T15:16:01.120 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: promoting from clones for snap 6 2024-03-30T15:16:01.120 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: promoting from clones for snap 5 2024-03-30T15:16:01.120 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: promoting from clones for snap 4 2024-03-30T15:16:01.120 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: promoting from clones for snap 3 2024-03-30T15:16:01.120 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: waiting for scrubs... 2024-03-30T15:16:01.120 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: done waiting 2024-03-30T15:16:01.120 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnapScrub (48387 ms) 2024-03-30T15:16:01.120 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2024-03-30T15:16:01.120 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnapTrimRace (9967 ms) 2024-03-30T15:16:01.120 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Whiteout 2024-03-30T15:16:01.120 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Whiteout (8439 ms) 2024-03-30T15:16:01.121 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2024-03-30T15:16:01.121 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate (7950 ms) 2024-03-30T15:16:01.121 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Evict 2024-03-30T15:16:01.121 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Evict (8031 ms) 2024-03-30T15:16:01.121 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap 2024-03-30T15:16:01.121 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnap (10041 ms) 2024-03-30T15:16:01.121 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap2 2024-03-30T15:16:01.121 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnap2 (9384 ms) 2024-03-30T15:16:01.121 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ListSnap 2024-03-30T15:16:01.121 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ListSnap (10039 ms) 2024-03-30T15:16:01.121 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2024-03-30T15:16:01.121 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace (12556 ms) 2024-03-30T15:16:01.121 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlush 2024-03-30T15:16:01.121 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TryFlush (8421 ms) 2024-03-30T15:16:01.121 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Flush 2024-03-30T15:16:01.122 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Flush (7607 ms) 2024-03-30T15:16:01.122 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushSnap 2024-03-30T15:16:01.122 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.FlushSnap (13050 ms) 2024-03-30T15:16:01.122 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2024-03-30T15:16:01.122 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.FlushTryFlushRaces (7899 ms) 2024-03-30T15:16:01.122 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlushReadRace 2024-03-30T15:16:01.122 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TryFlushReadRace (8030 ms) 2024-03-30T15:16:01.417 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:16:01 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:16:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:16:01.464 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:16:01 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:16:01.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:01 smithi072 bash[21573]: cluster 2024-03-30T15:16:00.002448+0000 mgr.y (mgr.14526) 339 : cluster 0 pgmap v456: 228 pgs: 228 active+clean; 4.6 MiB data, 611 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:16:01.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:01 smithi072 bash[21573]: audit 2024-03-30T15:16:01.111027+0000 mon.a (mon.0) 2301 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi072-64171-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:16:01.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:01 smithi072 bash[21573]: cluster 2024-03-30T15:16:01.119407+0000 mon.a (mon.0) 2302 : cluster 0 osdmap e303: 8 total, 8 up, 8 in 2024-03-30T15:16:01.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:01 smithi072 bash[21573]: audit 2024-03-30T15:16:01.121930+0000 mon.c (mon.2) 405 : audit 1 from='client.? 172.21.15.72:0/862490468' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafePP_smithi072-64171-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi072-64171-55"}]: dispatch 2024-03-30T15:16:01.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:01 smithi072 bash[21573]: audit 2024-03-30T15:16:01.123506+0000 mon.a (mon.0) 2303 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafePP_smithi072-64171-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi072-64171-55"}]: dispatch 2024-03-30T15:16:01.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:01 smithi072 bash[28946]: cluster 2024-03-30T15:16:00.002448+0000 mgr.y (mgr.14526) 339 : cluster 0 pgmap v456: 228 pgs: 228 active+clean; 4.6 MiB data, 611 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:16:01.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:01 smithi072 bash[28946]: audit 2024-03-30T15:16:01.111027+0000 mon.a (mon.0) 2301 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi072-64171-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:16:01.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:01 smithi072 bash[28946]: cluster 2024-03-30T15:16:01.119407+0000 mon.a (mon.0) 2302 : cluster 0 osdmap e303: 8 total, 8 up, 8 in 2024-03-30T15:16:01.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:01 smithi072 bash[28946]: audit 2024-03-30T15:16:01.121930+0000 mon.c (mon.2) 405 : audit 1 from='client.? 172.21.15.72:0/862490468' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafePP_smithi072-64171-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi072-64171-55"}]: dispatch 2024-03-30T15:16:01.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:01 smithi072 bash[28946]: audit 2024-03-30T15:16:01.123506+0000 mon.a (mon.0) 2303 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafePP_smithi072-64171-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi072-64171-55"}]: dispatch 2024-03-30T15:16:01.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:01 smithi172 bash[23680]: cluster 2024-03-30T15:16:00.002448+0000 mgr.y (mgr.14526) 339 : cluster 0 pgmap v456: 228 pgs: 228 active+clean; 4.6 MiB data, 611 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:16:01.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:01 smithi172 bash[23680]: audit 2024-03-30T15:16:01.111027+0000 mon.a (mon.0) 2301 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi072-64171-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:16:01.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:01 smithi172 bash[23680]: cluster 2024-03-30T15:16:01.119407+0000 mon.a (mon.0) 2302 : cluster 0 osdmap e303: 8 total, 8 up, 8 in 2024-03-30T15:16:01.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:01 smithi172 bash[23680]: audit 2024-03-30T15:16:01.121930+0000 mon.c (mon.2) 405 : audit 1 from='client.? 172.21.15.72:0/862490468' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafePP_smithi072-64171-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi072-64171-55"}]: dispatch 2024-03-30T15:16:01.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:01 smithi172 bash[23680]: audit 2024-03-30T15:16:01.123506+0000 mon.a (mon.0) 2303 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafePP_smithi072-64171-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi072-64171-55"}]: dispatch 2024-03-30T15:16:02.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:02 smithi072 bash[21573]: audit 2024-03-30T15:16:01.162751+0000 mgr.y (mgr.14526) 340 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:16:02.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:02 smithi072 bash[21573]: cluster 2024-03-30T15:16:02.570778+0000 mon.a (mon.0) 2304 : cluster 0 osdmap e304: 8 total, 8 up, 8 in 2024-03-30T15:16:02.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:02 smithi072 bash[21573]: audit 2024-03-30T15:16:02.573511+0000 mon.a (mon.0) 2305 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:16:02.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:02 smithi072 bash[28946]: audit 2024-03-30T15:16:01.162751+0000 mgr.y (mgr.14526) 340 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:16:02.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:02 smithi072 bash[28946]: cluster 2024-03-30T15:16:02.570778+0000 mon.a (mon.0) 2304 : cluster 0 osdmap e304: 8 total, 8 up, 8 in 2024-03-30T15:16:02.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:02 smithi072 bash[28946]: audit 2024-03-30T15:16:02.573511+0000 mon.a (mon.0) 2305 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:16:02.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:02 smithi172 bash[23680]: audit 2024-03-30T15:16:01.162751+0000 mgr.y (mgr.14526) 340 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:16:02.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:02 smithi172 bash[23680]: cluster 2024-03-30T15:16:02.570778+0000 mon.a (mon.0) 2304 : cluster 0 osdmap e304: 8 total, 8 up, 8 in 2024-03-30T15:16:02.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:02 smithi172 bash[23680]: audit 2024-03-30T15:16:02.573511+0000 mon.a (mon.0) 2305 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:16:03.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:03 smithi072 bash[21573]: cluster 2024-03-30T15:16:02.003282+0000 mgr.y (mgr.14526) 341 : cluster 0 pgmap v459: 196 pgs: 196 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-03-30T15:16:03.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:03 smithi072 bash[21573]: audit 2024-03-30T15:16:03.118972+0000 mon.a (mon.0) 2306 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafePP_smithi072-64171-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi072-64171-55"}]': finished 2024-03-30T15:16:03.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:03 smithi072 bash[21573]: audit 2024-03-30T15:16:03.119197+0000 mon.a (mon.0) 2307 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:16:03.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:03 smithi072 bash[21573]: cluster 2024-03-30T15:16:03.127606+0000 mon.a (mon.0) 2308 : cluster 0 osdmap e305: 8 total, 8 up, 8 in 2024-03-30T15:16:03.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:03 smithi072 bash[21573]: audit 2024-03-30T15:16:03.132657+0000 mon.a (mon.0) 2309 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:16:03.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:03 smithi072 bash[28946]: cluster 2024-03-30T15:16:02.003282+0000 mgr.y (mgr.14526) 341 : cluster 0 pgmap v459: 196 pgs: 196 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-03-30T15:16:03.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:03 smithi072 bash[28946]: audit 2024-03-30T15:16:03.118972+0000 mon.a (mon.0) 2306 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafePP_smithi072-64171-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi072-64171-55"}]': finished 2024-03-30T15:16:03.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:03 smithi072 bash[28946]: audit 2024-03-30T15:16:03.119197+0000 mon.a (mon.0) 2307 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:16:03.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:03 smithi072 bash[28946]: cluster 2024-03-30T15:16:03.127606+0000 mon.a (mon.0) 2308 : cluster 0 osdmap e305: 8 total, 8 up, 8 in 2024-03-30T15:16:03.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:03 smithi072 bash[28946]: audit 2024-03-30T15:16:03.132657+0000 mon.a (mon.0) 2309 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:16:03.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:03 smithi172 bash[23680]: cluster 2024-03-30T15:16:02.003282+0000 mgr.y (mgr.14526) 341 : cluster 0 pgmap v459: 196 pgs: 196 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-03-30T15:16:03.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:03 smithi172 bash[23680]: audit 2024-03-30T15:16:03.118972+0000 mon.a (mon.0) 2306 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafePP_smithi072-64171-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi072-64171-55"}]': finished 2024-03-30T15:16:03.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:03 smithi172 bash[23680]: audit 2024-03-30T15:16:03.119197+0000 mon.a (mon.0) 2307 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:16:03.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:03 smithi172 bash[23680]: cluster 2024-03-30T15:16:03.127606+0000 mon.a (mon.0) 2308 : cluster 0 osdmap e305: 8 total, 8 up, 8 in 2024-03-30T15:16:03.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:03 smithi172 bash[23680]: audit 2024-03-30T15:16:03.132657+0000 mon.a (mon.0) 2309 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:16:05.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:05 smithi072 bash[21573]: cluster 2024-03-30T15:16:04.004168+0000 mgr.y (mgr.14526) 342 : cluster 0 pgmap v462: 236 pgs: 40 unknown, 196 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-03-30T15:16:05.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:05 smithi072 bash[21573]: audit 2024-03-30T15:16:04.121590+0000 mon.a (mon.0) 2310 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-41", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:16:05.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:05 smithi072 bash[21573]: cluster 2024-03-30T15:16:04.135631+0000 mon.a (mon.0) 2311 : cluster 0 osdmap e306: 8 total, 8 up, 8 in 2024-03-30T15:16:05.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:05 smithi072 bash[21573]: audit 2024-03-30T15:16:04.139100+0000 mon.a (mon.0) 2312 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-41","var": "hit_set_count","val": "2"}]: dispatch 2024-03-30T15:16:05.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:05 smithi072 bash[21573]: cluster 2024-03-30T15:16:04.606836+0000 mon.a (mon.0) 2313 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:16:05.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:05 smithi072 bash[28946]: cluster 2024-03-30T15:16:04.004168+0000 mgr.y (mgr.14526) 342 : cluster 0 pgmap v462: 236 pgs: 40 unknown, 196 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-03-30T15:16:05.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:05 smithi072 bash[28946]: audit 2024-03-30T15:16:04.121590+0000 mon.a (mon.0) 2310 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-41", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:16:05.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:05 smithi072 bash[28946]: cluster 2024-03-30T15:16:04.135631+0000 mon.a (mon.0) 2311 : cluster 0 osdmap e306: 8 total, 8 up, 8 in 2024-03-30T15:16:05.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:05 smithi072 bash[28946]: audit 2024-03-30T15:16:04.139100+0000 mon.a (mon.0) 2312 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-41","var": "hit_set_count","val": "2"}]: dispatch 2024-03-30T15:16:05.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:05 smithi072 bash[28946]: cluster 2024-03-30T15:16:04.606836+0000 mon.a (mon.0) 2313 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:16:05.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:05 smithi172 bash[23680]: cluster 2024-03-30T15:16:04.004168+0000 mgr.y (mgr.14526) 342 : cluster 0 pgmap v462: 236 pgs: 40 unknown, 196 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-03-30T15:16:05.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:05 smithi172 bash[23680]: audit 2024-03-30T15:16:04.121590+0000 mon.a (mon.0) 2310 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-41", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:16:05.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:05 smithi172 bash[23680]: cluster 2024-03-30T15:16:04.135631+0000 mon.a (mon.0) 2311 : cluster 0 osdmap e306: 8 total, 8 up, 8 in 2024-03-30T15:16:05.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:05 smithi172 bash[23680]: audit 2024-03-30T15:16:04.139100+0000 mon.a (mon.0) 2312 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-41","var": "hit_set_count","val": "2"}]: dispatch 2024-03-30T15:16:05.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:05 smithi172 bash[23680]: cluster 2024-03-30T15:16:04.606836+0000 mon.a (mon.0) 2313 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:16:06.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:06 smithi072 bash[21573]: audit 2024-03-30T15:16:05.124210+0000 mon.a (mon.0) 2314 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-41","var": "hit_set_count","val": "2"}]': finished 2024-03-30T15:16:06.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:06 smithi072 bash[21573]: cluster 2024-03-30T15:16:05.132923+0000 mon.a (mon.0) 2315 : cluster 0 osdmap e307: 8 total, 8 up, 8 in 2024-03-30T15:16:06.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:06 smithi072 bash[21573]: audit 2024-03-30T15:16:05.135488+0000 mon.a (mon.0) 2316 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-41","var": "hit_set_period","val": "600"}]: dispatch 2024-03-30T15:16:06.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:06 smithi072 bash[21573]: audit 2024-03-30T15:16:05.139554+0000 mon.c (mon.2) 406 : audit 1 from='client.? 172.21.15.72:0/862490468' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi072-64171-55"}]: dispatch 2024-03-30T15:16:06.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:06 smithi072 bash[21573]: audit 2024-03-30T15:16:05.151000+0000 mon.a (mon.0) 2317 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi072-64171-55"}]: dispatch 2024-03-30T15:16:06.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:06 smithi072 bash[21573]: audit 2024-03-30T15:16:06.007803+0000 mon.a (mon.0) 2318 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:16:06.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:06 smithi072 bash[21573]: audit 2024-03-30T15:16:06.013085+0000 mon.c (mon.2) 407 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:16:06.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:06 smithi072 bash[28946]: audit 2024-03-30T15:16:05.124210+0000 mon.a (mon.0) 2314 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-41","var": "hit_set_count","val": "2"}]': finished 2024-03-30T15:16:06.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:06 smithi072 bash[28946]: cluster 2024-03-30T15:16:05.132923+0000 mon.a (mon.0) 2315 : cluster 0 osdmap e307: 8 total, 8 up, 8 in 2024-03-30T15:16:06.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:06 smithi072 bash[28946]: audit 2024-03-30T15:16:05.135488+0000 mon.a (mon.0) 2316 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-41","var": "hit_set_period","val": "600"}]: dispatch 2024-03-30T15:16:06.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:06 smithi072 bash[28946]: audit 2024-03-30T15:16:05.139554+0000 mon.c (mon.2) 406 : audit 1 from='client.? 172.21.15.72:0/862490468' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi072-64171-55"}]: dispatch 2024-03-30T15:16:06.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:06 smithi072 bash[28946]: audit 2024-03-30T15:16:05.151000+0000 mon.a (mon.0) 2317 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi072-64171-55"}]: dispatch 2024-03-30T15:16:06.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:06 smithi072 bash[28946]: audit 2024-03-30T15:16:06.007803+0000 mon.a (mon.0) 2318 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:16:06.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:06 smithi072 bash[28946]: audit 2024-03-30T15:16:06.013085+0000 mon.c (mon.2) 407 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:16:06.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:06 smithi172 bash[23680]: audit 2024-03-30T15:16:05.124210+0000 mon.a (mon.0) 2314 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-41","var": "hit_set_count","val": "2"}]': finished 2024-03-30T15:16:06.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:06 smithi172 bash[23680]: cluster 2024-03-30T15:16:05.132923+0000 mon.a (mon.0) 2315 : cluster 0 osdmap e307: 8 total, 8 up, 8 in 2024-03-30T15:16:06.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:06 smithi172 bash[23680]: audit 2024-03-30T15:16:05.135488+0000 mon.a (mon.0) 2316 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-41","var": "hit_set_period","val": "600"}]: dispatch 2024-03-30T15:16:06.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:06 smithi172 bash[23680]: audit 2024-03-30T15:16:05.139554+0000 mon.c (mon.2) 406 : audit 1 from='client.? 172.21.15.72:0/862490468' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi072-64171-55"}]: dispatch 2024-03-30T15:16:06.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:06 smithi172 bash[23680]: audit 2024-03-30T15:16:05.151000+0000 mon.a (mon.0) 2317 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi072-64171-55"}]: dispatch 2024-03-30T15:16:06.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:06 smithi172 bash[23680]: audit 2024-03-30T15:16:06.007803+0000 mon.a (mon.0) 2318 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:16:06.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:06 smithi172 bash[23680]: audit 2024-03-30T15:16:06.013085+0000 mon.c (mon.2) 407 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:16:07.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:07 smithi072 bash[21573]: cluster 2024-03-30T15:16:06.006449+0000 mgr.y (mgr.14526) 343 : cluster 0 pgmap v465: 228 pgs: 228 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:16:07.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:07 smithi072 bash[21573]: audit 2024-03-30T15:16:06.126720+0000 mon.a (mon.0) 2319 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-41","var": "hit_set_period","val": "600"}]': finished 2024-03-30T15:16:07.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:07 smithi072 bash[21573]: audit 2024-03-30T15:16:06.126922+0000 mon.a (mon.0) 2320 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi072-64171-55"}]': finished 2024-03-30T15:16:07.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:07 smithi072 bash[21573]: cluster 2024-03-30T15:16:06.133886+0000 mon.a (mon.0) 2321 : cluster 0 osdmap e308: 8 total, 8 up, 8 in 2024-03-30T15:16:07.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:07 smithi072 bash[21573]: audit 2024-03-30T15:16:06.141071+0000 mon.a (mon.0) 2322 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-03-30T15:16:07.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:07 smithi072 bash[21573]: audit 2024-03-30T15:16:06.141590+0000 mon.c (mon.2) 408 : audit 1 from='client.? 172.21.15.72:0/862490468' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi072-64171-55"}]: dispatch 2024-03-30T15:16:07.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:07 smithi072 bash[21573]: audit 2024-03-30T15:16:06.142273+0000 mon.a (mon.0) 2323 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi072-64171-55"}]: dispatch 2024-03-30T15:16:07.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:07 smithi072 bash[21573]: audit 2024-03-30T15:16:07.129875+0000 mon.a (mon.0) 2324 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-41","var": "hit_set_type","val": "explicit_object"}]': finished 2024-03-30T15:16:07.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:07 smithi072 bash[21573]: audit 2024-03-30T15:16:07.130045+0000 mon.a (mon.0) 2325 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi072-64171-55"}]': finished 2024-03-30T15:16:07.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:07 smithi072 bash[21573]: cluster 2024-03-30T15:16:07.137289+0000 mon.a (mon.0) 2326 : cluster 0 osdmap e309: 8 total, 8 up, 8 in 2024-03-30T15:16:07.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:07 smithi072 bash[28946]: cluster 2024-03-30T15:16:06.006449+0000 mgr.y (mgr.14526) 343 : cluster 0 pgmap v465: 228 pgs: 228 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:16:07.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:07 smithi072 bash[28946]: audit 2024-03-30T15:16:06.126720+0000 mon.a (mon.0) 2319 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-41","var": "hit_set_period","val": "600"}]': finished 2024-03-30T15:16:07.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:07 smithi072 bash[28946]: audit 2024-03-30T15:16:06.126922+0000 mon.a (mon.0) 2320 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi072-64171-55"}]': finished 2024-03-30T15:16:07.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:07 smithi072 bash[28946]: cluster 2024-03-30T15:16:06.133886+0000 mon.a (mon.0) 2321 : cluster 0 osdmap e308: 8 total, 8 up, 8 in 2024-03-30T15:16:07.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:07 smithi072 bash[28946]: audit 2024-03-30T15:16:06.141071+0000 mon.a (mon.0) 2322 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-03-30T15:16:07.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:07 smithi072 bash[28946]: audit 2024-03-30T15:16:06.141590+0000 mon.c (mon.2) 408 : audit 1 from='client.? 172.21.15.72:0/862490468' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi072-64171-55"}]: dispatch 2024-03-30T15:16:07.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:07 smithi072 bash[28946]: audit 2024-03-30T15:16:06.142273+0000 mon.a (mon.0) 2323 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi072-64171-55"}]: dispatch 2024-03-30T15:16:07.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:07 smithi072 bash[28946]: audit 2024-03-30T15:16:07.129875+0000 mon.a (mon.0) 2324 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-41","var": "hit_set_type","val": "explicit_object"}]': finished 2024-03-30T15:16:07.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:07 smithi072 bash[28946]: audit 2024-03-30T15:16:07.130045+0000 mon.a (mon.0) 2325 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi072-64171-55"}]': finished 2024-03-30T15:16:07.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:07 smithi072 bash[28946]: cluster 2024-03-30T15:16:07.137289+0000 mon.a (mon.0) 2326 : cluster 0 osdmap e309: 8 total, 8 up, 8 in 2024-03-30T15:16:07.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:07 smithi172 bash[23680]: cluster 2024-03-30T15:16:06.006449+0000 mgr.y (mgr.14526) 343 : cluster 0 pgmap v465: 228 pgs: 228 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:16:07.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:07 smithi172 bash[23680]: audit 2024-03-30T15:16:06.126720+0000 mon.a (mon.0) 2319 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-41","var": "hit_set_period","val": "600"}]': finished 2024-03-30T15:16:07.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:07 smithi172 bash[23680]: audit 2024-03-30T15:16:06.126922+0000 mon.a (mon.0) 2320 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi072-64171-55"}]': finished 2024-03-30T15:16:07.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:07 smithi172 bash[23680]: cluster 2024-03-30T15:16:06.133886+0000 mon.a (mon.0) 2321 : cluster 0 osdmap e308: 8 total, 8 up, 8 in 2024-03-30T15:16:07.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:07 smithi172 bash[23680]: audit 2024-03-30T15:16:06.141071+0000 mon.a (mon.0) 2322 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-03-30T15:16:07.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:07 smithi172 bash[23680]: audit 2024-03-30T15:16:06.141590+0000 mon.c (mon.2) 408 : audit 1 from='client.? 172.21.15.72:0/862490468' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi072-64171-55"}]: dispatch 2024-03-30T15:16:07.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:07 smithi172 bash[23680]: audit 2024-03-30T15:16:06.142273+0000 mon.a (mon.0) 2323 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi072-64171-55"}]: dispatch 2024-03-30T15:16:07.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:07 smithi172 bash[23680]: audit 2024-03-30T15:16:07.129875+0000 mon.a (mon.0) 2324 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-41","var": "hit_set_type","val": "explicit_object"}]': finished 2024-03-30T15:16:07.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:07 smithi172 bash[23680]: audit 2024-03-30T15:16:07.130045+0000 mon.a (mon.0) 2325 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi072-64171-55"}]': finished 2024-03-30T15:16:07.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:07 smithi172 bash[23680]: cluster 2024-03-30T15:16:07.137289+0000 mon.a (mon.0) 2326 : cluster 0 osdmap e309: 8 total, 8 up, 8 in 2024-03-30T15:16:08.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:08 smithi072 bash[21573]: audit 2024-03-30T15:16:07.163481+0000 mon.c (mon.2) 409 : audit 1 from='client.? 172.21.15.72:0/420558177' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi072-64171-56"}]: dispatch 2024-03-30T15:16:08.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:08 smithi072 bash[21573]: audit 2024-03-30T15:16:07.163794+0000 mon.a (mon.0) 2327 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi072-64171-56"}]: dispatch 2024-03-30T15:16:08.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:08 smithi072 bash[21573]: audit 2024-03-30T15:16:07.164602+0000 mon.c (mon.2) 410 : audit 1 from='client.? 172.21.15.72:0/420558177' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi072-64171-56"}]: dispatch 2024-03-30T15:16:08.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:08 smithi072 bash[21573]: audit 2024-03-30T15:16:07.164957+0000 mon.a (mon.0) 2328 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi072-64171-56"}]: dispatch 2024-03-30T15:16:08.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:08 smithi072 bash[21573]: audit 2024-03-30T15:16:07.165536+0000 mon.c (mon.2) 411 : audit 1 from='client.? 172.21.15.72:0/420558177' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi072-64171-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:16:08.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:08 smithi072 bash[21573]: audit 2024-03-30T15:16:07.165860+0000 mon.a (mon.0) 2329 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi072-64171-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:16:08.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:08 smithi072 bash[28946]: audit 2024-03-30T15:16:07.163481+0000 mon.c (mon.2) 409 : audit 1 from='client.? 172.21.15.72:0/420558177' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi072-64171-56"}]: dispatch 2024-03-30T15:16:08.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:08 smithi072 bash[28946]: audit 2024-03-30T15:16:07.163794+0000 mon.a (mon.0) 2327 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi072-64171-56"}]: dispatch 2024-03-30T15:16:08.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:08 smithi072 bash[28946]: audit 2024-03-30T15:16:07.164602+0000 mon.c (mon.2) 410 : audit 1 from='client.? 172.21.15.72:0/420558177' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi072-64171-56"}]: dispatch 2024-03-30T15:16:08.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:08 smithi072 bash[28946]: audit 2024-03-30T15:16:07.164957+0000 mon.a (mon.0) 2328 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi072-64171-56"}]: dispatch 2024-03-30T15:16:08.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:08 smithi072 bash[28946]: audit 2024-03-30T15:16:07.165536+0000 mon.c (mon.2) 411 : audit 1 from='client.? 172.21.15.72:0/420558177' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi072-64171-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:16:08.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:08 smithi072 bash[28946]: audit 2024-03-30T15:16:07.165860+0000 mon.a (mon.0) 2329 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi072-64171-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:16:08.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:08 smithi172 bash[23680]: audit 2024-03-30T15:16:07.163481+0000 mon.c (mon.2) 409 : audit 1 from='client.? 172.21.15.72:0/420558177' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi072-64171-56"}]: dispatch 2024-03-30T15:16:08.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:08 smithi172 bash[23680]: audit 2024-03-30T15:16:07.163794+0000 mon.a (mon.0) 2327 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi072-64171-56"}]: dispatch 2024-03-30T15:16:08.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:08 smithi172 bash[23680]: audit 2024-03-30T15:16:07.164602+0000 mon.c (mon.2) 410 : audit 1 from='client.? 172.21.15.72:0/420558177' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi072-64171-56"}]: dispatch 2024-03-30T15:16:08.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:08 smithi172 bash[23680]: audit 2024-03-30T15:16:07.164957+0000 mon.a (mon.0) 2328 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi072-64171-56"}]: dispatch 2024-03-30T15:16:08.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:08 smithi172 bash[23680]: audit 2024-03-30T15:16:07.165536+0000 mon.c (mon.2) 411 : audit 1 from='client.? 172.21.15.72:0/420558177' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi072-64171-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:16:08.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:08 smithi172 bash[23680]: audit 2024-03-30T15:16:07.165860+0000 mon.a (mon.0) 2329 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi072-64171-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:16:09.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:09 smithi072 bash[21573]: cluster 2024-03-30T15:16:08.007343+0000 mgr.y (mgr.14526) 344 : cluster 0 pgmap v468: 228 pgs: 228 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:16:09.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:09 smithi072 bash[21573]: audit 2024-03-30T15:16:08.147648+0000 mon.a (mon.0) 2330 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi072-64171-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:16:09.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:09 smithi072 bash[21573]: cluster 2024-03-30T15:16:08.155644+0000 mon.a (mon.0) 2331 : cluster 0 osdmap e310: 8 total, 8 up, 8 in 2024-03-30T15:16:09.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:09 smithi072 bash[21573]: audit 2024-03-30T15:16:08.157639+0000 mon.c (mon.2) 412 : audit 1 from='client.? 172.21.15.72:0/420558177' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi072-64171-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi072-64171-56"}]: dispatch 2024-03-30T15:16:09.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:09 smithi072 bash[21573]: audit 2024-03-30T15:16:08.172065+0000 mon.a (mon.0) 2332 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi072-64171-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi072-64171-56"}]: dispatch 2024-03-30T15:16:09.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:09 smithi072 bash[21573]: audit 2024-03-30T15:16:08.198715+0000 mon.a (mon.0) 2333 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:16:09.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:09 smithi072 bash[21573]: audit 2024-03-30T15:16:08.199452+0000 mon.a (mon.0) 2334 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-41"}]: dispatch 2024-03-30T15:16:09.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:09 smithi072 bash[28946]: cluster 2024-03-30T15:16:08.007343+0000 mgr.y (mgr.14526) 344 : cluster 0 pgmap v468: 228 pgs: 228 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:16:09.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:09 smithi072 bash[28946]: audit 2024-03-30T15:16:08.147648+0000 mon.a (mon.0) 2330 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi072-64171-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:16:09.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:09 smithi072 bash[28946]: cluster 2024-03-30T15:16:08.155644+0000 mon.a (mon.0) 2331 : cluster 0 osdmap e310: 8 total, 8 up, 8 in 2024-03-30T15:16:09.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:09 smithi072 bash[28946]: audit 2024-03-30T15:16:08.157639+0000 mon.c (mon.2) 412 : audit 1 from='client.? 172.21.15.72:0/420558177' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi072-64171-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi072-64171-56"}]: dispatch 2024-03-30T15:16:09.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:09 smithi072 bash[28946]: audit 2024-03-30T15:16:08.172065+0000 mon.a (mon.0) 2332 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi072-64171-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi072-64171-56"}]: dispatch 2024-03-30T15:16:09.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:09 smithi072 bash[28946]: audit 2024-03-30T15:16:08.198715+0000 mon.a (mon.0) 2333 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:16:09.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:09 smithi072 bash[28946]: audit 2024-03-30T15:16:08.199452+0000 mon.a (mon.0) 2334 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-41"}]: dispatch 2024-03-30T15:16:09.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:09 smithi172 bash[23680]: cluster 2024-03-30T15:16:08.007343+0000 mgr.y (mgr.14526) 344 : cluster 0 pgmap v468: 228 pgs: 228 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:16:09.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:09 smithi172 bash[23680]: audit 2024-03-30T15:16:08.147648+0000 mon.a (mon.0) 2330 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi072-64171-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:16:09.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:09 smithi172 bash[23680]: cluster 2024-03-30T15:16:08.155644+0000 mon.a (mon.0) 2331 : cluster 0 osdmap e310: 8 total, 8 up, 8 in 2024-03-30T15:16:09.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:09 smithi172 bash[23680]: audit 2024-03-30T15:16:08.157639+0000 mon.c (mon.2) 412 : audit 1 from='client.? 172.21.15.72:0/420558177' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi072-64171-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi072-64171-56"}]: dispatch 2024-03-30T15:16:09.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:09 smithi172 bash[23680]: audit 2024-03-30T15:16:08.172065+0000 mon.a (mon.0) 2332 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi072-64171-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi072-64171-56"}]: dispatch 2024-03-30T15:16:09.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:09 smithi172 bash[23680]: audit 2024-03-30T15:16:08.198715+0000 mon.a (mon.0) 2333 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:16:09.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:09 smithi172 bash[23680]: audit 2024-03-30T15:16:08.199452+0000 mon.a (mon.0) 2334 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-41"}]: dispatch 2024-03-30T15:16:10.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:10 smithi172 bash[23680]: audit 2024-03-30T15:16:09.173046+0000 mon.a (mon.0) 2335 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-41"}]': finished 2024-03-30T15:16:10.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:10 smithi172 bash[23680]: cluster 2024-03-30T15:16:09.619724+0000 mon.a (mon.0) 2336 : cluster 0 osdmap e311: 8 total, 8 up, 8 in 2024-03-30T15:16:10.666 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:10 smithi072 bash[28946]: audit 2024-03-30T15:16:09.173046+0000 mon.a (mon.0) 2335 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-41"}]': finished 2024-03-30T15:16:10.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:10 smithi072 bash[28946]: cluster 2024-03-30T15:16:09.619724+0000 mon.a (mon.0) 2336 : cluster 0 osdmap e311: 8 total, 8 up, 8 in 2024-03-30T15:16:10.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:10 smithi072 bash[21573]: audit 2024-03-30T15:16:09.173046+0000 mon.a (mon.0) 2335 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-41"}]': finished 2024-03-30T15:16:10.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:10 smithi072 bash[21573]: cluster 2024-03-30T15:16:09.619724+0000 mon.a (mon.0) 2336 : cluster 0 osdmap e311: 8 total, 8 up, 8 in 2024-03-30T15:16:11.418 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:16:11 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:16:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:16:11.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:11 smithi072 bash[21573]: cluster 2024-03-30T15:16:10.008131+0000 mgr.y (mgr.14526) 345 : cluster 0 pgmap v471: 228 pgs: 228 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:16:11.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:11 smithi072 bash[21573]: audit 2024-03-30T15:16:10.185604+0000 mon.a (mon.0) 2337 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi072-64171-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi072-64171-56"}]': finished 2024-03-30T15:16:11.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:11 smithi072 bash[21573]: cluster 2024-03-30T15:16:10.193459+0000 mon.a (mon.0) 2338 : cluster 0 osdmap e312: 8 total, 8 up, 8 in 2024-03-30T15:16:11.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:11 smithi072 bash[21573]: audit 2024-03-30T15:16:10.621865+0000 mon.c (mon.2) 413 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:16:11.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:11 smithi072 bash[21573]: cluster 2024-03-30T15:16:11.087562+0000 mon.a (mon.0) 2339 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:16:11.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:11 smithi072 bash[28946]: cluster 2024-03-30T15:16:10.008131+0000 mgr.y (mgr.14526) 345 : cluster 0 pgmap v471: 228 pgs: 228 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:16:11.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:11 smithi072 bash[28946]: audit 2024-03-30T15:16:10.185604+0000 mon.a (mon.0) 2337 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi072-64171-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi072-64171-56"}]': finished 2024-03-30T15:16:11.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:11 smithi072 bash[28946]: cluster 2024-03-30T15:16:10.193459+0000 mon.a (mon.0) 2338 : cluster 0 osdmap e312: 8 total, 8 up, 8 in 2024-03-30T15:16:11.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:11 smithi072 bash[28946]: audit 2024-03-30T15:16:10.621865+0000 mon.c (mon.2) 413 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:16:11.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:11 smithi072 bash[28946]: cluster 2024-03-30T15:16:11.087562+0000 mon.a (mon.0) 2339 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:16:11.464 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:16:11 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:16:11.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:11 smithi172 bash[23680]: cluster 2024-03-30T15:16:10.008131+0000 mgr.y (mgr.14526) 345 : cluster 0 pgmap v471: 228 pgs: 228 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:16:11.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:11 smithi172 bash[23680]: audit 2024-03-30T15:16:10.185604+0000 mon.a (mon.0) 2337 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi072-64171-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi072-64171-56"}]': finished 2024-03-30T15:16:11.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:11 smithi172 bash[23680]: cluster 2024-03-30T15:16:10.193459+0000 mon.a (mon.0) 2338 : cluster 0 osdmap e312: 8 total, 8 up, 8 in 2024-03-30T15:16:11.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:11 smithi172 bash[23680]: audit 2024-03-30T15:16:10.621865+0000 mon.c (mon.2) 413 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:16:11.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:11 smithi172 bash[23680]: cluster 2024-03-30T15:16:11.087562+0000 mon.a (mon.0) 2339 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:16:12.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:12 smithi072 bash[21573]: audit 2024-03-30T15:16:11.171389+0000 mgr.y (mgr.14526) 346 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:16:12.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:12 smithi072 bash[21573]: cluster 2024-03-30T15:16:11.211839+0000 mon.a (mon.0) 2340 : cluster 0 osdmap e313: 8 total, 8 up, 8 in 2024-03-30T15:16:12.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:12 smithi072 bash[21573]: audit 2024-03-30T15:16:11.218216+0000 mon.a (mon.0) 2341 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:16:12.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:12 smithi072 bash[21573]: audit 2024-03-30T15:16:11.309028+0000 mon.c (mon.2) 414 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:16:12.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:12 smithi072 bash[21573]: audit 2024-03-30T15:16:11.310493+0000 mon.c (mon.2) 415 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:16:12.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:12 smithi072 bash[21573]: audit 2024-03-30T15:16:11.319404+0000 mon.a (mon.0) 2342 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:16:12.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:12 smithi072 bash[28946]: audit 2024-03-30T15:16:11.171389+0000 mgr.y (mgr.14526) 346 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:16:12.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:12 smithi072 bash[28946]: cluster 2024-03-30T15:16:11.211839+0000 mon.a (mon.0) 2340 : cluster 0 osdmap e313: 8 total, 8 up, 8 in 2024-03-30T15:16:12.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:12 smithi072 bash[28946]: audit 2024-03-30T15:16:11.218216+0000 mon.a (mon.0) 2341 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:16:12.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:12 smithi072 bash[28946]: audit 2024-03-30T15:16:11.309028+0000 mon.c (mon.2) 414 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:16:12.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:12 smithi072 bash[28946]: audit 2024-03-30T15:16:11.310493+0000 mon.c (mon.2) 415 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:16:12.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:12 smithi072 bash[28946]: audit 2024-03-30T15:16:11.319404+0000 mon.a (mon.0) 2342 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:16:12.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:12 smithi172 bash[23680]: audit 2024-03-30T15:16:11.171389+0000 mgr.y (mgr.14526) 346 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:16:12.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:12 smithi172 bash[23680]: cluster 2024-03-30T15:16:11.211839+0000 mon.a (mon.0) 2340 : cluster 0 osdmap e313: 8 total, 8 up, 8 in 2024-03-30T15:16:12.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:12 smithi172 bash[23680]: audit 2024-03-30T15:16:11.218216+0000 mon.a (mon.0) 2341 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:16:12.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:12 smithi172 bash[23680]: audit 2024-03-30T15:16:11.309028+0000 mon.c (mon.2) 414 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:16:12.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:12 smithi172 bash[23680]: audit 2024-03-30T15:16:11.310493+0000 mon.c (mon.2) 415 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:16:12.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:12 smithi172 bash[23680]: audit 2024-03-30T15:16:11.319404+0000 mon.a (mon.0) 2342 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:16:13.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:13 smithi072 bash[21573]: cluster 2024-03-30T15:16:12.008958+0000 mgr.y (mgr.14526) 347 : cluster 0 pgmap v474: 236 pgs: 32 unknown, 8 creating+peering, 196 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:16:13.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:13 smithi072 bash[21573]: audit 2024-03-30T15:16:12.204586+0000 mon.a (mon.0) 2343 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:16:13.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:13 smithi072 bash[21573]: cluster 2024-03-30T15:16:12.212510+0000 mon.a (mon.0) 2344 : cluster 0 osdmap e314: 8 total, 8 up, 8 in 2024-03-30T15:16:13.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:13 smithi072 bash[21573]: audit 2024-03-30T15:16:12.216637+0000 mon.c (mon.2) 416 : audit 1 from='client.? 172.21.15.72:0/420558177' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi072-64171-56"}]: dispatch 2024-03-30T15:16:13.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:13 smithi072 bash[21573]: audit 2024-03-30T15:16:12.217293+0000 mon.a (mon.0) 2345 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi072-64344-6","var": "pg_num","format": "json"}]: dispatch 2024-03-30T15:16:13.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:13 smithi072 bash[21573]: audit 2024-03-30T15:16:12.223759+0000 mon.a (mon.0) 2346 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:16:13.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:13 smithi072 bash[21573]: audit 2024-03-30T15:16:12.243469+0000 mon.a (mon.0) 2347 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi072-64171-56"}]: dispatch 2024-03-30T15:16:13.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:13 smithi072 bash[21573]: audit 2024-03-30T15:16:13.207329+0000 mon.a (mon.0) 2348 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-43", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:16:13.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:13 smithi072 bash[21573]: audit 2024-03-30T15:16:13.207560+0000 mon.a (mon.0) 2349 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi072-64171-56"}]': finished 2024-03-30T15:16:13.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:13 smithi072 bash[21573]: cluster 2024-03-30T15:16:13.215184+0000 mon.a (mon.0) 2350 : cluster 0 osdmap e315: 8 total, 8 up, 8 in 2024-03-30T15:16:13.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:13 smithi072 bash[21573]: audit 2024-03-30T15:16:13.216399+0000 mon.a (mon.0) 2351 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-43","var": "hit_set_count","val": "8"}]: dispatch 2024-03-30T15:16:13.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:13 smithi072 bash[21573]: audit 2024-03-30T15:16:13.217270+0000 mon.c (mon.2) 417 : audit 1 from='client.? 172.21.15.72:0/420558177' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi072-64171-56"}]: dispatch 2024-03-30T15:16:13.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:13 smithi072 bash[21573]: audit 2024-03-30T15:16:13.219416+0000 mon.a (mon.0) 2352 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi072-64171-56"}]: dispatch 2024-03-30T15:16:13.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:13 smithi072 bash[28946]: cluster 2024-03-30T15:16:12.008958+0000 mgr.y (mgr.14526) 347 : cluster 0 pgmap v474: 236 pgs: 32 unknown, 8 creating+peering, 196 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:16:13.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:13 smithi072 bash[28946]: audit 2024-03-30T15:16:12.204586+0000 mon.a (mon.0) 2343 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:16:13.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:13 smithi072 bash[28946]: cluster 2024-03-30T15:16:12.212510+0000 mon.a (mon.0) 2344 : cluster 0 osdmap e314: 8 total, 8 up, 8 in 2024-03-30T15:16:13.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:13 smithi072 bash[28946]: audit 2024-03-30T15:16:12.216637+0000 mon.c (mon.2) 416 : audit 1 from='client.? 172.21.15.72:0/420558177' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi072-64171-56"}]: dispatch 2024-03-30T15:16:13.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:13 smithi072 bash[28946]: audit 2024-03-30T15:16:12.217293+0000 mon.a (mon.0) 2345 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi072-64344-6","var": "pg_num","format": "json"}]: dispatch 2024-03-30T15:16:13.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:13 smithi072 bash[28946]: audit 2024-03-30T15:16:12.223759+0000 mon.a (mon.0) 2346 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:16:13.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:13 smithi072 bash[28946]: audit 2024-03-30T15:16:12.243469+0000 mon.a (mon.0) 2347 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi072-64171-56"}]: dispatch 2024-03-30T15:16:13.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:13 smithi072 bash[28946]: audit 2024-03-30T15:16:13.207329+0000 mon.a (mon.0) 2348 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-43", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:16:13.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:13 smithi072 bash[28946]: audit 2024-03-30T15:16:13.207560+0000 mon.a (mon.0) 2349 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi072-64171-56"}]': finished 2024-03-30T15:16:13.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:13 smithi072 bash[28946]: cluster 2024-03-30T15:16:13.215184+0000 mon.a (mon.0) 2350 : cluster 0 osdmap e315: 8 total, 8 up, 8 in 2024-03-30T15:16:13.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:13 smithi072 bash[28946]: audit 2024-03-30T15:16:13.216399+0000 mon.a (mon.0) 2351 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-43","var": "hit_set_count","val": "8"}]: dispatch 2024-03-30T15:16:13.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:13 smithi072 bash[28946]: audit 2024-03-30T15:16:13.217270+0000 mon.c (mon.2) 417 : audit 1 from='client.? 172.21.15.72:0/420558177' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi072-64171-56"}]: dispatch 2024-03-30T15:16:13.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:13 smithi072 bash[28946]: audit 2024-03-30T15:16:13.219416+0000 mon.a (mon.0) 2352 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi072-64171-56"}]: dispatch 2024-03-30T15:16:13.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:13 smithi172 bash[23680]: cluster 2024-03-30T15:16:12.008958+0000 mgr.y (mgr.14526) 347 : cluster 0 pgmap v474: 236 pgs: 32 unknown, 8 creating+peering, 196 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:16:13.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:13 smithi172 bash[23680]: audit 2024-03-30T15:16:12.204586+0000 mon.a (mon.0) 2343 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:16:13.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:13 smithi172 bash[23680]: cluster 2024-03-30T15:16:12.212510+0000 mon.a (mon.0) 2344 : cluster 0 osdmap e314: 8 total, 8 up, 8 in 2024-03-30T15:16:13.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:13 smithi172 bash[23680]: audit 2024-03-30T15:16:12.216637+0000 mon.c (mon.2) 416 : audit 1 from='client.? 172.21.15.72:0/420558177' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi072-64171-56"}]: dispatch 2024-03-30T15:16:13.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:13 smithi172 bash[23680]: audit 2024-03-30T15:16:12.217293+0000 mon.a (mon.0) 2345 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi072-64344-6","var": "pg_num","format": "json"}]: dispatch 2024-03-30T15:16:13.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:13 smithi172 bash[23680]: audit 2024-03-30T15:16:12.223759+0000 mon.a (mon.0) 2346 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:16:13.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:13 smithi172 bash[23680]: audit 2024-03-30T15:16:12.243469+0000 mon.a (mon.0) 2347 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi072-64171-56"}]: dispatch 2024-03-30T15:16:13.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:13 smithi172 bash[23680]: audit 2024-03-30T15:16:13.207329+0000 mon.a (mon.0) 2348 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-43", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:16:13.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:13 smithi172 bash[23680]: audit 2024-03-30T15:16:13.207560+0000 mon.a (mon.0) 2349 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi072-64171-56"}]': finished 2024-03-30T15:16:13.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:13 smithi172 bash[23680]: cluster 2024-03-30T15:16:13.215184+0000 mon.a (mon.0) 2350 : cluster 0 osdmap e315: 8 total, 8 up, 8 in 2024-03-30T15:16:13.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:13 smithi172 bash[23680]: audit 2024-03-30T15:16:13.216399+0000 mon.a (mon.0) 2351 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-43","var": "hit_set_count","val": "8"}]: dispatch 2024-03-30T15:16:13.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:13 smithi172 bash[23680]: audit 2024-03-30T15:16:13.217270+0000 mon.c (mon.2) 417 : audit 1 from='client.? 172.21.15.72:0/420558177' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi072-64171-56"}]: dispatch 2024-03-30T15:16:13.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:13 smithi172 bash[23680]: audit 2024-03-30T15:16:13.219416+0000 mon.a (mon.0) 2352 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi072-64171-56"}]: dispatch 2024-03-30T15:16:15.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:15 smithi072 bash[21573]: cluster 2024-03-30T15:16:14.009853+0000 mgr.y (mgr.14526) 348 : cluster 0 pgmap v477: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:16:15.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:15 smithi072 bash[21573]: audit 2024-03-30T15:16:14.210527+0000 mon.a (mon.0) 2353 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-43","var": "hit_set_count","val": "8"}]': finished 2024-03-30T15:16:15.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:15 smithi072 bash[21573]: audit 2024-03-30T15:16:14.210702+0000 mon.a (mon.0) 2354 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi072-64171-56"}]': finished 2024-03-30T15:16:15.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:15 smithi072 bash[21573]: cluster 2024-03-30T15:16:14.218887+0000 mon.a (mon.0) 2355 : cluster 0 osdmap e316: 8 total, 8 up, 8 in 2024-03-30T15:16:15.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:15 smithi072 bash[21573]: audit 2024-03-30T15:16:14.224087+0000 mon.a (mon.0) 2356 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-43","var": "hit_set_period","val": "600"}]: dispatch 2024-03-30T15:16:15.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:15 smithi072 bash[21573]: audit 2024-03-30T15:16:14.257854+0000 mon.c (mon.2) 418 : audit 1 from='client.? 172.21.15.72:0/2521395763' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi072-64171-57"}]: dispatch 2024-03-30T15:16:15.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:15 smithi072 bash[21573]: audit 2024-03-30T15:16:14.258208+0000 mon.a (mon.0) 2357 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi072-64171-57"}]: dispatch 2024-03-30T15:16:15.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:15 smithi072 bash[21573]: audit 2024-03-30T15:16:14.258952+0000 mon.c (mon.2) 419 : audit 1 from='client.? 172.21.15.72:0/2521395763' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi072-64171-57"}]: dispatch 2024-03-30T15:16:15.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:15 smithi072 bash[21573]: audit 2024-03-30T15:16:14.259289+0000 mon.a (mon.0) 2358 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi072-64171-57"}]: dispatch 2024-03-30T15:16:15.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:15 smithi072 bash[21573]: audit 2024-03-30T15:16:14.259830+0000 mon.c (mon.2) 420 : audit 1 from='client.? 172.21.15.72:0/2521395763' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi072-64171-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:16:15.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:15 smithi072 bash[21573]: audit 2024-03-30T15:16:14.260105+0000 mon.a (mon.0) 2359 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi072-64171-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:16:15.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:15 smithi072 bash[28946]: cluster 2024-03-30T15:16:14.009853+0000 mgr.y (mgr.14526) 348 : cluster 0 pgmap v477: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:16:15.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:15 smithi072 bash[28946]: audit 2024-03-30T15:16:14.210527+0000 mon.a (mon.0) 2353 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-43","var": "hit_set_count","val": "8"}]': finished 2024-03-30T15:16:15.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:15 smithi072 bash[28946]: audit 2024-03-30T15:16:14.210702+0000 mon.a (mon.0) 2354 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi072-64171-56"}]': finished 2024-03-30T15:16:15.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:15 smithi072 bash[28946]: cluster 2024-03-30T15:16:14.218887+0000 mon.a (mon.0) 2355 : cluster 0 osdmap e316: 8 total, 8 up, 8 in 2024-03-30T15:16:15.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:15 smithi072 bash[28946]: audit 2024-03-30T15:16:14.224087+0000 mon.a (mon.0) 2356 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-43","var": "hit_set_period","val": "600"}]: dispatch 2024-03-30T15:16:15.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:15 smithi072 bash[28946]: audit 2024-03-30T15:16:14.257854+0000 mon.c (mon.2) 418 : audit 1 from='client.? 172.21.15.72:0/2521395763' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi072-64171-57"}]: dispatch 2024-03-30T15:16:15.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:15 smithi072 bash[28946]: audit 2024-03-30T15:16:14.258208+0000 mon.a (mon.0) 2357 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi072-64171-57"}]: dispatch 2024-03-30T15:16:15.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:15 smithi072 bash[28946]: audit 2024-03-30T15:16:14.258952+0000 mon.c (mon.2) 419 : audit 1 from='client.? 172.21.15.72:0/2521395763' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi072-64171-57"}]: dispatch 2024-03-30T15:16:15.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:15 smithi072 bash[28946]: audit 2024-03-30T15:16:14.259289+0000 mon.a (mon.0) 2358 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi072-64171-57"}]: dispatch 2024-03-30T15:16:15.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:15 smithi072 bash[28946]: audit 2024-03-30T15:16:14.259830+0000 mon.c (mon.2) 420 : audit 1 from='client.? 172.21.15.72:0/2521395763' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi072-64171-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:16:15.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:15 smithi072 bash[28946]: audit 2024-03-30T15:16:14.260105+0000 mon.a (mon.0) 2359 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi072-64171-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:16:15.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:15 smithi172 bash[23680]: cluster 2024-03-30T15:16:14.009853+0000 mgr.y (mgr.14526) 348 : cluster 0 pgmap v477: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:16:15.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:15 smithi172 bash[23680]: audit 2024-03-30T15:16:14.210527+0000 mon.a (mon.0) 2353 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-43","var": "hit_set_count","val": "8"}]': finished 2024-03-30T15:16:15.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:15 smithi172 bash[23680]: audit 2024-03-30T15:16:14.210702+0000 mon.a (mon.0) 2354 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi072-64171-56"}]': finished 2024-03-30T15:16:15.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:15 smithi172 bash[23680]: cluster 2024-03-30T15:16:14.218887+0000 mon.a (mon.0) 2355 : cluster 0 osdmap e316: 8 total, 8 up, 8 in 2024-03-30T15:16:15.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:15 smithi172 bash[23680]: audit 2024-03-30T15:16:14.224087+0000 mon.a (mon.0) 2356 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-43","var": "hit_set_period","val": "600"}]: dispatch 2024-03-30T15:16:15.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:15 smithi172 bash[23680]: audit 2024-03-30T15:16:14.257854+0000 mon.c (mon.2) 418 : audit 1 from='client.? 172.21.15.72:0/2521395763' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi072-64171-57"}]: dispatch 2024-03-30T15:16:15.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:15 smithi172 bash[23680]: audit 2024-03-30T15:16:14.258208+0000 mon.a (mon.0) 2357 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi072-64171-57"}]: dispatch 2024-03-30T15:16:15.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:15 smithi172 bash[23680]: audit 2024-03-30T15:16:14.258952+0000 mon.c (mon.2) 419 : audit 1 from='client.? 172.21.15.72:0/2521395763' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi072-64171-57"}]: dispatch 2024-03-30T15:16:15.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:15 smithi172 bash[23680]: audit 2024-03-30T15:16:14.259289+0000 mon.a (mon.0) 2358 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi072-64171-57"}]: dispatch 2024-03-30T15:16:15.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:15 smithi172 bash[23680]: audit 2024-03-30T15:16:14.259830+0000 mon.c (mon.2) 420 : audit 1 from='client.? 172.21.15.72:0/2521395763' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi072-64171-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:16:15.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:15 smithi172 bash[23680]: audit 2024-03-30T15:16:14.260105+0000 mon.a (mon.0) 2359 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi072-64171-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:16:16.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:16 smithi172 bash[23680]: audit 2024-03-30T15:16:15.213258+0000 mon.a (mon.0) 2360 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-43","var": "hit_set_period","val": "600"}]': finished 2024-03-30T15:16:16.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:16 smithi172 bash[23680]: audit 2024-03-30T15:16:15.213459+0000 mon.a (mon.0) 2361 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi072-64171-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:16:16.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:16 smithi172 bash[23680]: cluster 2024-03-30T15:16:15.220527+0000 mon.a (mon.0) 2362 : cluster 0 osdmap e317: 8 total, 8 up, 8 in 2024-03-30T15:16:16.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:16 smithi172 bash[23680]: audit 2024-03-30T15:16:15.221846+0000 mon.a (mon.0) 2363 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-03-30T15:16:16.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:16 smithi172 bash[23680]: audit 2024-03-30T15:16:15.225295+0000 mon.c (mon.2) 421 : audit 1 from='client.? 172.21.15.72:0/2521395763' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi072-64171-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi072-64171-57"}]: dispatch 2024-03-30T15:16:16.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:16 smithi172 bash[23680]: audit 2024-03-30T15:16:15.234647+0000 mon.a (mon.0) 2364 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi072-64171-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi072-64171-57"}]: dispatch 2024-03-30T15:16:16.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:16 smithi172 bash[23680]: audit 2024-03-30T15:16:16.216765+0000 mon.a (mon.0) 2365 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-43","var": "hit_set_type","val": "explicit_hash"}]': finished 2024-03-30T15:16:17.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:16 smithi072 bash[21573]: audit 2024-03-30T15:16:15.213258+0000 mon.a (mon.0) 2360 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-43","var": "hit_set_period","val": "600"}]': finished 2024-03-30T15:16:17.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:16 smithi072 bash[21573]: audit 2024-03-30T15:16:15.213459+0000 mon.a (mon.0) 2361 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi072-64171-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:16:17.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:16 smithi072 bash[21573]: cluster 2024-03-30T15:16:15.220527+0000 mon.a (mon.0) 2362 : cluster 0 osdmap e317: 8 total, 8 up, 8 in 2024-03-30T15:16:17.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:16 smithi072 bash[21573]: audit 2024-03-30T15:16:15.221846+0000 mon.a (mon.0) 2363 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-03-30T15:16:17.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:16 smithi072 bash[21573]: audit 2024-03-30T15:16:15.225295+0000 mon.c (mon.2) 421 : audit 1 from='client.? 172.21.15.72:0/2521395763' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi072-64171-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi072-64171-57"}]: dispatch 2024-03-30T15:16:17.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:16 smithi072 bash[21573]: audit 2024-03-30T15:16:15.234647+0000 mon.a (mon.0) 2364 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi072-64171-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi072-64171-57"}]: dispatch 2024-03-30T15:16:17.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:16 smithi072 bash[21573]: audit 2024-03-30T15:16:16.216765+0000 mon.a (mon.0) 2365 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-43","var": "hit_set_type","val": "explicit_hash"}]': finished 2024-03-30T15:16:17.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:16 smithi072 bash[28946]: audit 2024-03-30T15:16:15.213258+0000 mon.a (mon.0) 2360 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-43","var": "hit_set_period","val": "600"}]': finished 2024-03-30T15:16:17.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:16 smithi072 bash[28946]: audit 2024-03-30T15:16:15.213459+0000 mon.a (mon.0) 2361 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi072-64171-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:16:17.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:16 smithi072 bash[28946]: cluster 2024-03-30T15:16:15.220527+0000 mon.a (mon.0) 2362 : cluster 0 osdmap e317: 8 total, 8 up, 8 in 2024-03-30T15:16:17.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:16 smithi072 bash[28946]: audit 2024-03-30T15:16:15.221846+0000 mon.a (mon.0) 2363 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-03-30T15:16:17.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:16 smithi072 bash[28946]: audit 2024-03-30T15:16:15.225295+0000 mon.c (mon.2) 421 : audit 1 from='client.? 172.21.15.72:0/2521395763' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi072-64171-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi072-64171-57"}]: dispatch 2024-03-30T15:16:17.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:16 smithi072 bash[28946]: audit 2024-03-30T15:16:15.234647+0000 mon.a (mon.0) 2364 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi072-64171-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi072-64171-57"}]: dispatch 2024-03-30T15:16:17.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:16 smithi072 bash[28946]: audit 2024-03-30T15:16:16.216765+0000 mon.a (mon.0) 2365 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-43","var": "hit_set_type","val": "explicit_hash"}]': finished 2024-03-30T15:16:17.258 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetRead 2024-03-30T15:16:17.258 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: hmm, no HitSet yet 2024-03-30T15:16:17.258 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: ok, hit_set contains 274:602f83fe:::foo:head 2024-03-30T15:16:17.258 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetRead (9071 ms) 2024-03-30T15:16:17.258 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetWrite 2024-03-30T15:16:17.258 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: pg_num = 32 2024-03-30T15:16:17.259 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: pg 0 ls 1711811777,0 2024-03-30T15:16:17.259 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: pg 1 ls 1711811777,0 2024-03-30T15:16:17.259 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: pg 2 ls 1711811777,0 2024-03-30T15:16:17.259 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: pg 3 ls 1711811777,0 2024-03-30T15:16:17.259 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: pg 4 ls 1711811777,0 2024-03-30T15:16:17.259 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: pg 5 ls 1711811777,0 2024-03-30T15:16:17.259 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: pg 6 ls 1711811777,0 2024-03-30T15:16:17.259 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: pg 7 ls 1711811777,0 2024-03-30T15:16:17.259 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: pg 8 ls 1711811777,0 2024-03-30T15:16:17.259 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: pg 9 ls 1711811777,0 2024-03-30T15:16:17.259 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: pg 10 ls 1711811777,0 2024-03-30T15:16:17.259 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: pg 11 ls 1711811777,0 2024-03-30T15:16:17.259 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: pg 12 ls 1711811777,0 2024-03-30T15:16:17.259 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: pg 13 ls 1711811777,0 2024-03-30T15:16:17.260 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: pg 14 ls 1711811777,0 2024-03-30T15:16:17.260 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: pg 15 ls 1711811777,0 2024-03-30T15:16:17.260 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: pg 16 ls 1711811777,0 2024-03-30T15:16:17.260 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: pg 17 ls 1711811777,0 2024-03-30T15:16:17.260 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: pg 18 ls 1711811777,0 2024-03-30T15:16:17.260 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: pg 19 ls 1711811777,0 2024-03-30T15:16:17.260 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: pg 20 ls 1711811777,0 2024-03-30T15:16:17.260 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: pg 21 ls 1711811777,0 2024-03-30T15:16:17.260 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: pg 22 ls 1711811777,0 2024-03-30T15:16:17.260 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: pg 23 ls 1711811777,0 2024-03-30T15:16:17.260 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: pg 24 ls 1711811777,0 2024-03-30T15:16:17.260 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: pg 25 ls 1711811777,0 2024-03-30T15:16:17.260 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: pg 26 ls 1711811777,0 2024-03-30T15:16:17.260 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: pg 27 ls 1711811777,0 2024-03-30T15:16:17.261 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: pg 28 ls 1711811777,0 2024-03-30T15:16:17.261 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: pg 29 ls 1711811777,0 2024-03-30T15:16:17.261 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: pg 30 ls 1711811777,0 2024-03-30T15:16:17.261 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: pg 31 ls 1711811777,0 2024-03-30T15:16:17.261 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: pg_num = 32 2024-03-30T15:16:17.261 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:6cac518f:::0:head 2024-03-30T15:16:17.261 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:02547ec2:::1:head 2024-03-30T15:16:17.261 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:f905c69b:::2:head 2024-03-30T15:16:17.261 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:cfc208b3:::3:head 2024-03-30T15:16:17.261 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:d83876eb:::4:head 2024-03-30T15:16:17.261 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:b29083e3:::5:head 2024-03-30T15:16:17.261 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:c4fdafeb:::6:head 2024-03-30T15:16:17.261 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:5c6b0b28:::7:head 2024-03-30T15:16:17.261 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:bd63b0f1:::8:head 2024-03-30T15:16:17.262 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:e960b815:::9:head 2024-03-30T15:16:17.262 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:52ea6a34:::10:head 2024-03-30T15:16:17.262 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:89d3ae78:::11:head 2024-03-30T15:16:17.262 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:de5d7c5f:::12:head 2024-03-30T15:16:17.262 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:566253c9:::13:head 2024-03-30T15:16:17.262 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:62a1935d:::14:head 2024-03-30T15:16:17.264 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:863748b0:::15:head 2024-03-30T15:16:17.264 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:3958e169:::16:head 2024-03-30T15:16:17.264 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:4d4dabf9:::17:head 2024-03-30T15:16:17.264 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:8391935d:::18:head 2024-03-30T15:16:17.264 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:28883081:::19:head 2024-03-30T15:16:17.264 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:69259c59:::20:head 2024-03-30T15:16:17.264 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:4bdb80b7:::21:head 2024-03-30T15:16:17.264 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:a11c5d71:::22:head 2024-03-30T15:16:17.264 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:271af37b:::23:head 2024-03-30T15:16:17.264 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:95b121be:::24:head 2024-03-30T15:16:17.264 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:58d1031b:::25:head 2024-03-30T15:16:17.264 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:0a050783:::26:head 2024-03-30T15:16:17.265 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:c709704c:::27:head 2024-03-30T15:16:17.265 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:cbe56eaf:::28:head 2024-03-30T15:16:17.265 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:86b4b162:::29:head 2024-03-30T15:16:17.265 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:70d89383:::30:head 2024-03-30T15:16:17.265 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:dd450c7c:::31:head 2024-03-30T15:16:17.265 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:6d5729b1:::32:head 2024-03-30T15:16:17.265 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:c388f3fb:::33:head 2024-03-30T15:16:17.265 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:56cfea31:::34:head 2024-03-30T15:16:17.265 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:9dbc1bf7:::35:head 2024-03-30T15:16:17.265 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:40b74ccd:::36:head 2024-03-30T15:16:17.265 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:4d5aaf42:::37:head 2024-03-30T15:16:17.265 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:920f362c:::38:head 2024-03-30T15:16:17.266 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:6cc53222:::39:head 2024-03-30T15:16:17.266 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:9cad833f:::40:head 2024-03-30T15:16:17.266 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:1ea84d41:::41:head 2024-03-30T15:16:17.266 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:c4480ef6:::42:head 2024-03-30T15:16:17.266 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:a694361e:::43:head 2024-03-30T15:16:17.266 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:d1bd33e9:::44:head 2024-03-30T15:16:17.266 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:ddc2cd5d:::45:head 2024-03-30T15:16:17.266 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:2b782207:::46:head 2024-03-30T15:16:17.266 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:7b187fca:::47:head 2024-03-30T15:16:17.266 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:90ecdf6f:::48:head 2024-03-30T15:16:17.266 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:a5ed95fe:::49:head 2024-03-30T15:16:17.266 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:ea0eaa55:::50:head 2024-03-30T15:16:17.266 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:f33ef17b:::51:head 2024-03-30T15:16:17.267 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:a0d1b2f6:::52:head 2024-03-30T15:16:17.267 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:60c5229e:::53:head 2024-03-30T15:16:17.267 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:edcbc575:::54:head 2024-03-30T15:16:17.267 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:102cf253:::55:head 2024-03-30T15:16:17.267 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:efb7fb0b:::56:head 2024-03-30T15:16:17.267 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:50d0a326:::57:head 2024-03-30T15:16:17.267 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:d4dc5daf:::58:head 2024-03-30T15:16:17.267 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:3a130462:::59:head 2024-03-30T15:16:17.267 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:ec87ed71:::60:head 2024-03-30T15:16:17.267 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:d5bc9454:::61:head 2024-03-30T15:16:17.267 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:3ddfe313:::62:head 2024-03-30T15:16:17.267 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:7c2816b9:::63:head 2024-03-30T15:16:17.267 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:47e00e4d:::64:head 2024-03-30T15:16:17.267 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:c6410c18:::65:head 2024-03-30T15:16:17.267 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:b48ed237:::66:head 2024-03-30T15:16:17.268 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:cd63ad31:::67:head 2024-03-30T15:16:17.268 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:b179e92b:::68:head 2024-03-30T15:16:17.268 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:0d9f741a:::69:head 2024-03-30T15:16:17.268 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:6d3352ae:::70:head 2024-03-30T15:16:17.268 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:c6d5c19e:::71:head 2024-03-30T15:16:17.268 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:bc4729c3:::72:head 2024-03-30T15:16:17.268 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:77e930b9:::73:head 2024-03-30T15:16:17.268 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:0abeecfd:::74:head 2024-03-30T15:16:17.268 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:b7c37e15:::75:head 2024-03-30T15:16:17.268 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:b6378398:::76:head 2024-03-30T15:16:17.268 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:02bd68de:::77:head 2024-03-30T15:16:17.268 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:cc795d2d:::78:head 2024-03-30T15:16:17.268 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:630d4fea:::79:head 2024-03-30T15:16:17.268 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:e0d29ef5:::80:head 2024-03-30T15:16:17.268 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:fd6f13d2:::81:head 2024-03-30T15:16:17.269 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:606461d5:::82:head 2024-03-30T15:16:17.269 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:eadbdc43:::83:head 2024-03-30T15:16:17.269 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:8761d0bb:::84:head 2024-03-30T15:16:17.269 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:9ef0186f:::85:head 2024-03-30T15:16:17.269 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:e0d41294:::86:head 2024-03-30T15:16:17.269 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:961de695:::87:head 2024-03-30T15:16:17.269 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:1423148f:::88:head 2024-03-30T15:16:17.269 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:633a8fa2:::89:head 2024-03-30T15:16:17.269 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:a8653809:::90:head 2024-03-30T15:16:17.269 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:3dac8b33:::91:head 2024-03-30T15:16:17.269 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:35aad435:::92:head 2024-03-30T15:16:17.269 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:f6dcc343:::93:head 2024-03-30T15:16:17.269 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:dbbdad87:::94:head 2024-03-30T15:16:17.269 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:1cb48ce0:::95:head 2024-03-30T15:16:17.270 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:03cd461c:::96:head 2024-03-30T15:16:17.270 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:17a4ea99:::97:head 2024-03-30T15:16:17.270 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:9993c9a7:::98:head 2024-03-30T15:16:17.270 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:6394211c:::99:head 2024-03-30T15:16:17.270 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:94c7ae57:::100:head 2024-03-30T15:16:17.270 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:6fdee5bb:::101:head 2024-03-30T15:16:17.270 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:9a477fd1:::102:head 2024-03-30T15:16:17.270 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:eb850916:::103:head 2024-03-30T15:16:17.270 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:affc56b9:::104:head 2024-03-30T15:16:17.270 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:b42dc814:::105:head 2024-03-30T15:16:17.270 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:f319f8f0:::106:head 2024-03-30T15:16:17.270 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:9a40b9de:::107:head 2024-03-30T15:16:17.270 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:8b524f28:::108:head 2024-03-30T15:16:17.271 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:e3de589f:::109:head 2024-03-30T15:16:17.271 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:90f90a5b:::110:head 2024-03-30T15:16:17.271 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:a7b4f1d7:::111:head 2024-03-30T15:16:17.271 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:af51766e:::112:head 2024-03-30T15:16:17.271 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:b6f90bd1:::113:head 2024-03-30T15:16:17.271 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:e0261208:::114:head 2024-03-30T15:16:17.271 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:c9569ef7:::115:head 2024-03-30T15:16:17.271 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:61bebe50:::116:head 2024-03-30T15:16:17.271 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:fe93412b:::117:head 2024-03-30T15:16:17.271 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:d3d38bee:::118:head 2024-03-30T15:16:17.271 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:3100ba0c:::119:head 2024-03-30T15:16:17.271 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:d0560ada:::120:head 2024-03-30T15:16:17.271 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:f0ea8b35:::121:head 2024-03-30T15:16:17.271 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:766f231a:::122:head 2024-03-30T15:16:17.271 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:a07a2582:::123:head 2024-03-30T15:16:17.272 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:bd7c6b3a:::124:head 2024-03-30T15:16:17.272 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:fb2ddaff:::125:head 2024-03-30T15:16:17.272 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:4408e1fe:::126:head 2024-03-30T15:16:17.272 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:ee1df7a7:::127:head 2024-03-30T15:16:17.272 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:c3002909:::128:head 2024-03-30T15:16:17.272 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:4f48ffa9:::129:head 2024-03-30T15:16:17.272 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:edf38733:::130:head 2024-03-30T15:16:17.272 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:c08425c0:::131:head 2024-03-30T15:16:17.272 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:5f902d98:::132:head 2024-03-30T15:16:17.272 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:41ea2c93:::133:head 2024-03-30T15:16:17.272 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:813cee13:::134:head 2024-03-30T15:16:17.272 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:0131818d:::135:head 2024-03-30T15:16:17.272 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:26ba5a85:::136:head 2024-03-30T15:16:17.272 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:381b8a5a:::137:head 2024-03-30T15:16:17.272 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:28797e47:::138:head 2024-03-30T15:16:17.273 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:bfca7f22:::139:head 2024-03-30T15:16:17.273 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:36807075:::140:head 2024-03-30T15:16:17.273 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:80b03975:::141:head 2024-03-30T15:16:17.273 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:5c15709b:::142:head 2024-03-30T15:16:17.273 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:f39ea15e:::143:head 2024-03-30T15:16:17.273 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:ea992956:::144:head 2024-03-30T15:16:17.273 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:48887b1c:::145:head 2024-03-30T15:16:17.273 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:9f24a9dd:::146:head 2024-03-30T15:16:17.273 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:987f100b:::147:head 2024-03-30T15:16:17.273 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:d2dd3581:::148:head 2024-03-30T15:16:17.273 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:7fed1808:::149:head 2024-03-30T15:16:17.273 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:c80b70e9:::150:head 2024-03-30T15:16:17.273 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:85ed90f9:::151:head 2024-03-30T15:16:17.273 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:36428b24:::152:head 2024-03-30T15:16:17.273 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:d044c34a:::153:head 2024-03-30T15:16:17.274 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:7c18bf58:::154:head 2024-03-30T15:16:17.274 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:d1c21232:::155:head 2024-03-30T15:16:17.274 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:a7a3c575:::156:head 2024-03-30T15:16:17.274 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:87da0633:::157:head 2024-03-30T15:16:17.274 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:d5ac3822:::158:head 2024-03-30T15:16:17.274 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:3f20522d:::159:head 2024-03-30T15:16:17.274 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:6ca26563:::160:head 2024-03-30T15:16:17.274 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:532ce135:::161:head 2024-03-30T15:16:17.274 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:c78863e6:::162:head 2024-03-30T15:16:17.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:17 smithi172 bash[23680]: cluster 2024-03-30T15:16:16.011889+0000 mgr.y (mgr.14526) 349 : cluster 0 pgmap v480: 228 pgs: 228 active+clean; 8.4 MiB data, 641 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:16:17.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:17 smithi172 bash[23680]: cluster 2024-03-30T15:16:16.678658+0000 mon.a (mon.0) 2366 : cluster 0 osdmap e318: 8 total, 8 up, 8 in 2024-03-30T15:16:17.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:17 smithi172 bash[23680]: audit 2024-03-30T15:16:17.219886+0000 mon.a (mon.0) 2367 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushPP_smithi072-64171-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi072-64171-57"}]': finished 2024-03-30T15:16:17.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:17 smithi172 bash[23680]: cluster 2024-03-30T15:16:17.228521+0000 mon.a (mon.0) 2368 : cluster 0 osdmap e319: 8 total, 8 up, 8 in 2024-03-30T15:16:17.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:17 smithi172 bash[23680]: audit 2024-03-30T15:16:17.262536+0000 mon.a (mon.0) 2369 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi072-64344-43","var": "pg_num","format": "json"}]: dispatch 2024-03-30T15:16:17.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:17 smithi172 bash[23680]: audit 2024-03-30T15:16:17.559993+0000 mon.a (mon.0) 2370 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:16:17.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:17 smithi172 bash[23680]: audit 2024-03-30T15:16:17.560827+0000 mon.a (mon.0) 2371 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-43"}]: dispatch 2024-03-30T15:16:18.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:17 smithi072 bash[21573]: cluster 2024-03-30T15:16:16.011889+0000 mgr.y (mgr.14526) 349 : cluster 0 pgmap v480: 228 pgs: 228 active+clean; 8.4 MiB data, 641 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:16:18.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:17 smithi072 bash[21573]: cluster 2024-03-30T15:16:16.678658+0000 mon.a (mon.0) 2366 : cluster 0 osdmap e318: 8 total, 8 up, 8 in 2024-03-30T15:16:18.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:17 smithi072 bash[21573]: audit 2024-03-30T15:16:17.219886+0000 mon.a (mon.0) 2367 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushPP_smithi072-64171-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi072-64171-57"}]': finished 2024-03-30T15:16:18.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:17 smithi072 bash[21573]: cluster 2024-03-30T15:16:17.228521+0000 mon.a (mon.0) 2368 : cluster 0 osdmap e319: 8 total, 8 up, 8 in 2024-03-30T15:16:18.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:17 smithi072 bash[21573]: audit 2024-03-30T15:16:17.262536+0000 mon.a (mon.0) 2369 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi072-64344-43","var": "pg_num","format": "json"}]: dispatch 2024-03-30T15:16:18.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:17 smithi072 bash[21573]: audit 2024-03-30T15:16:17.559993+0000 mon.a (mon.0) 2370 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:16:18.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:17 smithi072 bash[21573]: audit 2024-03-30T15:16:17.560827+0000 mon.a (mon.0) 2371 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-43"}]: dispatch 2024-03-30T15:16:18.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:17 smithi072 bash[28946]: cluster 2024-03-30T15:16:16.011889+0000 mgr.y (mgr.14526) 349 : cluster 0 pgmap v480: 228 pgs: 228 active+clean; 8.4 MiB data, 641 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:16:18.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:17 smithi072 bash[28946]: cluster 2024-03-30T15:16:16.678658+0000 mon.a (mon.0) 2366 : cluster 0 osdmap e318: 8 total, 8 up, 8 in 2024-03-30T15:16:18.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:17 smithi072 bash[28946]: audit 2024-03-30T15:16:17.219886+0000 mon.a (mon.0) 2367 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushPP_smithi072-64171-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi072-64171-57"}]': finished 2024-03-30T15:16:18.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:17 smithi072 bash[28946]: cluster 2024-03-30T15:16:17.228521+0000 mon.a (mon.0) 2368 : cluster 0 osdmap e319: 8 total, 8 up, 8 in 2024-03-30T15:16:18.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:17 smithi072 bash[28946]: audit 2024-03-30T15:16:17.262536+0000 mon.a (mon.0) 2369 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi072-64344-43","var": "pg_num","format": "json"}]: dispatch 2024-03-30T15:16:18.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:17 smithi072 bash[28946]: audit 2024-03-30T15:16:17.559993+0000 mon.a (mon.0) 2370 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:16:18.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:17 smithi072 bash[28946]: audit 2024-03-30T15:16:17.560827+0000 mon.a (mon.0) 2371 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-43"}]: dispatch 2024-03-30T15:16:19.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:19 smithi172 bash[23680]: cluster 2024-03-30T15:16:18.012699+0000 mgr.y (mgr.14526) 350 : cluster 0 pgmap v483: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 641 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:16:19.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:19 smithi172 bash[23680]: audit 2024-03-30T15:16:18.222654+0000 mon.a (mon.0) 2372 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-43"}]': finished 2024-03-30T15:16:19.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:19 smithi172 bash[23680]: cluster 2024-03-30T15:16:18.230704+0000 mon.a (mon.0) 2373 : cluster 0 osdmap e320: 8 total, 8 up, 8 in 2024-03-30T15:16:19.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:19 smithi172 bash[23680]: cluster 2024-03-30T15:16:18.683554+0000 mon.a (mon.0) 2374 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:16:20.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:19 smithi072 bash[21573]: cluster 2024-03-30T15:16:18.012699+0000 mgr.y (mgr.14526) 350 : cluster 0 pgmap v483: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 641 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:16:20.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:19 smithi072 bash[21573]: audit 2024-03-30T15:16:18.222654+0000 mon.a (mon.0) 2372 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-43"}]': finished 2024-03-30T15:16:20.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:19 smithi072 bash[21573]: cluster 2024-03-30T15:16:18.230704+0000 mon.a (mon.0) 2373 : cluster 0 osdmap e320: 8 total, 8 up, 8 in 2024-03-30T15:16:20.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:19 smithi072 bash[21573]: cluster 2024-03-30T15:16:18.683554+0000 mon.a (mon.0) 2374 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:16:20.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:19 smithi072 bash[28946]: cluster 2024-03-30T15:16:18.012699+0000 mgr.y (mgr.14526) 350 : cluster 0 pgmap v483: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 641 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:16:20.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:19 smithi072 bash[28946]: audit 2024-03-30T15:16:18.222654+0000 mon.a (mon.0) 2372 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-43"}]': finished 2024-03-30T15:16:20.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:19 smithi072 bash[28946]: cluster 2024-03-30T15:16:18.230704+0000 mon.a (mon.0) 2373 : cluster 0 osdmap e320: 8 total, 8 up, 8 in 2024-03-30T15:16:20.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:19 smithi072 bash[28946]: cluster 2024-03-30T15:16:18.683554+0000 mon.a (mon.0) 2374 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:16:20.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:20 smithi172 bash[23680]: cluster 2024-03-30T15:16:19.233424+0000 mon.a (mon.0) 2375 : cluster 0 osdmap e321: 8 total, 8 up, 8 in 2024-03-30T15:16:20.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:20 smithi172 bash[23680]: audit 2024-03-30T15:16:19.242981+0000 mon.c (mon.2) 422 : audit 1 from='client.? 172.21.15.72:0/2521395763' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi072-64171-57"}]: dispatch 2024-03-30T15:16:20.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:20 smithi172 bash[23680]: audit 2024-03-30T15:16:19.693958+0000 mon.a (mon.0) 2376 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi072-64171-57"}]: dispatch 2024-03-30T15:16:20.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:20 smithi172 bash[23680]: audit 2024-03-30T15:16:20.228951+0000 mon.a (mon.0) 2377 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi072-64171-57"}]': finished 2024-03-30T15:16:20.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:20 smithi172 bash[23680]: cluster 2024-03-30T15:16:20.238183+0000 mon.a (mon.0) 2378 : cluster 0 osdmap e322: 8 total, 8 up, 8 in 2024-03-30T15:16:20.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:20 smithi172 bash[23680]: audit 2024-03-30T15:16:20.243438+0000 mon.a (mon.0) 2379 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:16:20.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:20 smithi172 bash[23680]: audit 2024-03-30T15:16:20.243443+0000 mon.c (mon.2) 423 : audit 1 from='client.? 172.21.15.72:0/2521395763' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi072-64171-57"}]: dispatch 2024-03-30T15:16:20.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:20 smithi172 bash[23680]: audit 2024-03-30T15:16:20.244673+0000 mon.a (mon.0) 2380 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi072-64171-57"}]: dispatch 2024-03-30T15:16:21.028 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:20 smithi072 bash[21573]: cluster 2024-03-30T15:16:19.233424+0000 mon.a (mon.0) 2375 : cluster 0 osdmap e321: 8 total, 8 up, 8 in 2024-03-30T15:16:21.028 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:20 smithi072 bash[21573]: audit 2024-03-30T15:16:19.242981+0000 mon.c (mon.2) 422 : audit 1 from='client.? 172.21.15.72:0/2521395763' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi072-64171-57"}]: dispatch 2024-03-30T15:16:21.028 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:20 smithi072 bash[21573]: audit 2024-03-30T15:16:19.693958+0000 mon.a (mon.0) 2376 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi072-64171-57"}]: dispatch 2024-03-30T15:16:21.028 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:20 smithi072 bash[21573]: audit 2024-03-30T15:16:20.228951+0000 mon.a (mon.0) 2377 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi072-64171-57"}]': finished 2024-03-30T15:16:21.028 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:20 smithi072 bash[21573]: cluster 2024-03-30T15:16:20.238183+0000 mon.a (mon.0) 2378 : cluster 0 osdmap e322: 8 total, 8 up, 8 in 2024-03-30T15:16:21.028 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:20 smithi072 bash[21573]: audit 2024-03-30T15:16:20.243438+0000 mon.a (mon.0) 2379 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:16:21.029 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:20 smithi072 bash[21573]: audit 2024-03-30T15:16:20.243443+0000 mon.c (mon.2) 423 : audit 1 from='client.? 172.21.15.72:0/2521395763' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi072-64171-57"}]: dispatch 2024-03-30T15:16:21.029 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:20 smithi072 bash[21573]: audit 2024-03-30T15:16:20.244673+0000 mon.a (mon.0) 2380 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi072-64171-57"}]: dispatch 2024-03-30T15:16:21.029 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:20 smithi072 bash[28946]: cluster 2024-03-30T15:16:19.233424+0000 mon.a (mon.0) 2375 : cluster 0 osdmap e321: 8 total, 8 up, 8 in 2024-03-30T15:16:21.029 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:20 smithi072 bash[28946]: audit 2024-03-30T15:16:19.242981+0000 mon.c (mon.2) 422 : audit 1 from='client.? 172.21.15.72:0/2521395763' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi072-64171-57"}]: dispatch 2024-03-30T15:16:21.029 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:20 smithi072 bash[28946]: audit 2024-03-30T15:16:19.693958+0000 mon.a (mon.0) 2376 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi072-64171-57"}]: dispatch 2024-03-30T15:16:21.029 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:20 smithi072 bash[28946]: audit 2024-03-30T15:16:20.228951+0000 mon.a (mon.0) 2377 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi072-64171-57"}]': finished 2024-03-30T15:16:21.029 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:20 smithi072 bash[28946]: cluster 2024-03-30T15:16:20.238183+0000 mon.a (mon.0) 2378 : cluster 0 osdmap e322: 8 total, 8 up, 8 in 2024-03-30T15:16:21.029 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:20 smithi072 bash[28946]: audit 2024-03-30T15:16:20.243438+0000 mon.a (mon.0) 2379 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:16:21.029 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:20 smithi072 bash[28946]: audit 2024-03-30T15:16:20.243443+0000 mon.c (mon.2) 423 : audit 1 from='client.? 172.21.15.72:0/2521395763' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi072-64171-57"}]: dispatch 2024-03-30T15:16:21.029 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:20 smithi072 bash[28946]: audit 2024-03-30T15:16:20.244673+0000 mon.a (mon.0) 2380 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi072-64171-57"}]: dispatch 2024-03-30T15:16:21.417 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:16:21 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:16:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:16:21.463 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:16:21 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:16:21.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:21 smithi172 bash[23680]: cluster 2024-03-30T15:16:20.013338+0000 mgr.y (mgr.14526) 351 : cluster 0 pgmap v486: 196 pgs: 196 active+clean; 8.4 MiB data, 641 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:16:21.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:21 smithi172 bash[23680]: audit 2024-03-30T15:16:21.046407+0000 mon.c (mon.2) 424 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:16:21.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:21 smithi172 bash[23680]: audit 2024-03-30T15:16:21.232621+0000 mon.a (mon.0) 2381 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:16:21.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:21 smithi172 bash[23680]: audit 2024-03-30T15:16:21.232848+0000 mon.a (mon.0) 2382 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi072-64171-57"}]': finished 2024-03-30T15:16:21.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:21 smithi172 bash[23680]: cluster 2024-03-30T15:16:21.239759+0000 mon.a (mon.0) 2383 : cluster 0 osdmap e323: 8 total, 8 up, 8 in 2024-03-30T15:16:21.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:21 smithi172 bash[23680]: audit 2024-03-30T15:16:21.256592+0000 mon.a (mon.0) 2384 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:16:21.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:21 smithi172 bash[23680]: audit 2024-03-30T15:16:21.284516+0000 mon.a (mon.0) 2385 : audit 1 from='client.? 172.21.15.72:0/2725207180' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi072-64171-58"}]: dispatch 2024-03-30T15:16:21.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:21 smithi172 bash[23680]: audit 2024-03-30T15:16:21.285940+0000 mon.a (mon.0) 2386 : audit 1 from='client.? 172.21.15.72:0/2725207180' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi072-64171-58"}]: dispatch 2024-03-30T15:16:21.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:21 smithi172 bash[23680]: audit 2024-03-30T15:16:21.286356+0000 mon.a (mon.0) 2387 : audit 1 from='client.? 172.21.15.72:0/2725207180' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi072-64171-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:16:22.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:21 smithi072 bash[21573]: cluster 2024-03-30T15:16:20.013338+0000 mgr.y (mgr.14526) 351 : cluster 0 pgmap v486: 196 pgs: 196 active+clean; 8.4 MiB data, 641 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:16:22.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:21 smithi072 bash[21573]: audit 2024-03-30T15:16:21.046407+0000 mon.c (mon.2) 424 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:16:22.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:21 smithi072 bash[21573]: audit 2024-03-30T15:16:21.232621+0000 mon.a (mon.0) 2381 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:16:22.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:21 smithi072 bash[21573]: audit 2024-03-30T15:16:21.232848+0000 mon.a (mon.0) 2382 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi072-64171-57"}]': finished 2024-03-30T15:16:22.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:21 smithi072 bash[21573]: cluster 2024-03-30T15:16:21.239759+0000 mon.a (mon.0) 2383 : cluster 0 osdmap e323: 8 total, 8 up, 8 in 2024-03-30T15:16:22.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:21 smithi072 bash[21573]: audit 2024-03-30T15:16:21.256592+0000 mon.a (mon.0) 2384 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:16:22.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:21 smithi072 bash[21573]: audit 2024-03-30T15:16:21.284516+0000 mon.a (mon.0) 2385 : audit 1 from='client.? 172.21.15.72:0/2725207180' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi072-64171-58"}]: dispatch 2024-03-30T15:16:22.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:21 smithi072 bash[21573]: audit 2024-03-30T15:16:21.285940+0000 mon.a (mon.0) 2386 : audit 1 from='client.? 172.21.15.72:0/2725207180' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi072-64171-58"}]: dispatch 2024-03-30T15:16:22.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:21 smithi072 bash[21573]: audit 2024-03-30T15:16:21.286356+0000 mon.a (mon.0) 2387 : audit 1 from='client.? 172.21.15.72:0/2725207180' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi072-64171-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:16:22.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:21 smithi072 bash[28946]: cluster 2024-03-30T15:16:20.013338+0000 mgr.y (mgr.14526) 351 : cluster 0 pgmap v486: 196 pgs: 196 active+clean; 8.4 MiB data, 641 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:16:22.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:21 smithi072 bash[28946]: audit 2024-03-30T15:16:21.046407+0000 mon.c (mon.2) 424 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:16:22.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:21 smithi072 bash[28946]: audit 2024-03-30T15:16:21.232621+0000 mon.a (mon.0) 2381 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:16:22.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:21 smithi072 bash[28946]: audit 2024-03-30T15:16:21.232848+0000 mon.a (mon.0) 2382 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi072-64171-57"}]': finished 2024-03-30T15:16:22.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:21 smithi072 bash[28946]: cluster 2024-03-30T15:16:21.239759+0000 mon.a (mon.0) 2383 : cluster 0 osdmap e323: 8 total, 8 up, 8 in 2024-03-30T15:16:22.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:21 smithi072 bash[28946]: audit 2024-03-30T15:16:21.256592+0000 mon.a (mon.0) 2384 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:16:22.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:21 smithi072 bash[28946]: audit 2024-03-30T15:16:21.284516+0000 mon.a (mon.0) 2385 : audit 1 from='client.? 172.21.15.72:0/2725207180' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi072-64171-58"}]: dispatch 2024-03-30T15:16:22.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:21 smithi072 bash[28946]: audit 2024-03-30T15:16:21.285940+0000 mon.a (mon.0) 2386 : audit 1 from='client.? 172.21.15.72:0/2725207180' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi072-64171-58"}]: dispatch 2024-03-30T15:16:22.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:21 smithi072 bash[28946]: audit 2024-03-30T15:16:21.286356+0000 mon.a (mon.0) 2387 : audit 1 from='client.? 172.21.15.72:0/2725207180' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi072-64171-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:16:22.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:22 smithi172 bash[23680]: audit 2024-03-30T15:16:21.179273+0000 mgr.y (mgr.14526) 352 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:16:22.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:22 smithi172 bash[23680]: audit 2024-03-30T15:16:22.235342+0000 mon.a (mon.0) 2388 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-45", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:16:22.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:22 smithi172 bash[23680]: audit 2024-03-30T15:16:22.235507+0000 mon.a (mon.0) 2389 : audit 1 from='client.? 172.21.15.72:0/2725207180' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi072-64171-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:16:22.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:22 smithi172 bash[23680]: cluster 2024-03-30T15:16:22.242566+0000 mon.a (mon.0) 2390 : cluster 0 osdmap e324: 8 total, 8 up, 8 in 2024-03-30T15:16:22.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:22 smithi172 bash[23680]: audit 2024-03-30T15:16:22.248208+0000 mon.a (mon.0) 2391 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-45","var": "hit_set_count","val": "3"}]: dispatch 2024-03-30T15:16:22.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:22 smithi172 bash[23680]: audit 2024-03-30T15:16:22.248674+0000 mon.a (mon.0) 2392 : audit 1 from='client.? 172.21.15.72:0/2725207180' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi072-64171-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi072-64171-58"}]: dispatch 2024-03-30T15:16:23.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:22 smithi072 bash[21573]: audit 2024-03-30T15:16:21.179273+0000 mgr.y (mgr.14526) 352 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:16:23.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:22 smithi072 bash[21573]: audit 2024-03-30T15:16:22.235342+0000 mon.a (mon.0) 2388 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-45", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:16:23.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:22 smithi072 bash[21573]: audit 2024-03-30T15:16:22.235507+0000 mon.a (mon.0) 2389 : audit 1 from='client.? 172.21.15.72:0/2725207180' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi072-64171-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:16:23.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:22 smithi072 bash[21573]: cluster 2024-03-30T15:16:22.242566+0000 mon.a (mon.0) 2390 : cluster 0 osdmap e324: 8 total, 8 up, 8 in 2024-03-30T15:16:23.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:22 smithi072 bash[21573]: audit 2024-03-30T15:16:22.248208+0000 mon.a (mon.0) 2391 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-45","var": "hit_set_count","val": "3"}]: dispatch 2024-03-30T15:16:23.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:22 smithi072 bash[21573]: audit 2024-03-30T15:16:22.248674+0000 mon.a (mon.0) 2392 : audit 1 from='client.? 172.21.15.72:0/2725207180' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi072-64171-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi072-64171-58"}]: dispatch 2024-03-30T15:16:23.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:22 smithi072 bash[28946]: audit 2024-03-30T15:16:21.179273+0000 mgr.y (mgr.14526) 352 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:16:23.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:22 smithi072 bash[28946]: audit 2024-03-30T15:16:22.235342+0000 mon.a (mon.0) 2388 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-45", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:16:23.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:22 smithi072 bash[28946]: audit 2024-03-30T15:16:22.235507+0000 mon.a (mon.0) 2389 : audit 1 from='client.? 172.21.15.72:0/2725207180' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi072-64171-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:16:23.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:22 smithi072 bash[28946]: cluster 2024-03-30T15:16:22.242566+0000 mon.a (mon.0) 2390 : cluster 0 osdmap e324: 8 total, 8 up, 8 in 2024-03-30T15:16:23.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:22 smithi072 bash[28946]: audit 2024-03-30T15:16:22.248208+0000 mon.a (mon.0) 2391 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-45","var": "hit_set_count","val": "3"}]: dispatch 2024-03-30T15:16:23.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:22 smithi072 bash[28946]: audit 2024-03-30T15:16:22.248674+0000 mon.a (mon.0) 2392 : audit 1 from='client.? 172.21.15.72:0/2725207180' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi072-64171-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi072-64171-58"}]: dispatch 2024-03-30T15:16:23.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:23 smithi172 bash[23680]: cluster 2024-03-30T15:16:22.014048+0000 mgr.y (mgr.14526) 353 : cluster 0 pgmap v489: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:16:23.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:23 smithi172 bash[23680]: audit 2024-03-30T15:16:23.238728+0000 mon.a (mon.0) 2393 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-45","var": "hit_set_count","val": "3"}]': finished 2024-03-30T15:16:23.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:23 smithi172 bash[23680]: cluster 2024-03-30T15:16:23.692592+0000 mon.a (mon.0) 2394 : cluster 0 osdmap e325: 8 total, 8 up, 8 in 2024-03-30T15:16:23.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:23 smithi172 bash[23680]: audit 2024-03-30T15:16:23.694173+0000 mon.a (mon.0) 2395 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-45","var": "hit_set_period","val": "3"}]: dispatch 2024-03-30T15:16:24.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:23 smithi072 bash[21573]: cluster 2024-03-30T15:16:22.014048+0000 mgr.y (mgr.14526) 353 : cluster 0 pgmap v489: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:16:24.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:23 smithi072 bash[21573]: audit 2024-03-30T15:16:23.238728+0000 mon.a (mon.0) 2393 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-45","var": "hit_set_count","val": "3"}]': finished 2024-03-30T15:16:24.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:23 smithi072 bash[21573]: cluster 2024-03-30T15:16:23.692592+0000 mon.a (mon.0) 2394 : cluster 0 osdmap e325: 8 total, 8 up, 8 in 2024-03-30T15:16:24.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:23 smithi072 bash[21573]: audit 2024-03-30T15:16:23.694173+0000 mon.a (mon.0) 2395 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-45","var": "hit_set_period","val": "3"}]: dispatch 2024-03-30T15:16:24.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:23 smithi072 bash[28946]: cluster 2024-03-30T15:16:22.014048+0000 mgr.y (mgr.14526) 353 : cluster 0 pgmap v489: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:16:24.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:23 smithi072 bash[28946]: audit 2024-03-30T15:16:23.238728+0000 mon.a (mon.0) 2393 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-45","var": "hit_set_count","val": "3"}]': finished 2024-03-30T15:16:24.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:23 smithi072 bash[28946]: cluster 2024-03-30T15:16:23.692592+0000 mon.a (mon.0) 2394 : cluster 0 osdmap e325: 8 total, 8 up, 8 in 2024-03-30T15:16:24.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:23 smithi072 bash[28946]: audit 2024-03-30T15:16:23.694173+0000 mon.a (mon.0) 2395 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-45","var": "hit_set_period","val": "3"}]: dispatch 2024-03-30T15:16:25.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:25 smithi072 bash[21573]: cluster 2024-03-30T15:16:24.014878+0000 mgr.y (mgr.14526) 354 : cluster 0 pgmap v492: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:16:25.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:25 smithi072 bash[21573]: audit 2024-03-30T15:16:24.241972+0000 mon.a (mon.0) 2396 : audit 1 from='client.? 172.21.15.72:0/2725207180' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi072-64171-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi072-64171-58"}]': finished 2024-03-30T15:16:25.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:25 smithi072 bash[21573]: audit 2024-03-30T15:16:24.242171+0000 mon.a (mon.0) 2397 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-45","var": "hit_set_period","val": "3"}]': finished 2024-03-30T15:16:25.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:25 smithi072 bash[21573]: cluster 2024-03-30T15:16:24.249536+0000 mon.a (mon.0) 2398 : cluster 0 osdmap e326: 8 total, 8 up, 8 in 2024-03-30T15:16:25.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:25 smithi072 bash[21573]: audit 2024-03-30T15:16:24.256377+0000 mon.a (mon.0) 2399 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-30T15:16:25.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:25 smithi072 bash[28946]: cluster 2024-03-30T15:16:24.014878+0000 mgr.y (mgr.14526) 354 : cluster 0 pgmap v492: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:16:25.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:25 smithi072 bash[28946]: audit 2024-03-30T15:16:24.241972+0000 mon.a (mon.0) 2396 : audit 1 from='client.? 172.21.15.72:0/2725207180' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi072-64171-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi072-64171-58"}]': finished 2024-03-30T15:16:25.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:25 smithi072 bash[28946]: audit 2024-03-30T15:16:24.242171+0000 mon.a (mon.0) 2397 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-45","var": "hit_set_period","val": "3"}]': finished 2024-03-30T15:16:25.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:25 smithi072 bash[28946]: cluster 2024-03-30T15:16:24.249536+0000 mon.a (mon.0) 2398 : cluster 0 osdmap e326: 8 total, 8 up, 8 in 2024-03-30T15:16:25.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:25 smithi072 bash[28946]: audit 2024-03-30T15:16:24.256377+0000 mon.a (mon.0) 2399 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-30T15:16:25.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:25 smithi172 bash[23680]: cluster 2024-03-30T15:16:24.014878+0000 mgr.y (mgr.14526) 354 : cluster 0 pgmap v492: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:16:25.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:25 smithi172 bash[23680]: audit 2024-03-30T15:16:24.241972+0000 mon.a (mon.0) 2396 : audit 1 from='client.? 172.21.15.72:0/2725207180' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi072-64171-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi072-64171-58"}]': finished 2024-03-30T15:16:25.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:25 smithi172 bash[23680]: audit 2024-03-30T15:16:24.242171+0000 mon.a (mon.0) 2397 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-45","var": "hit_set_period","val": "3"}]': finished 2024-03-30T15:16:25.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:25 smithi172 bash[23680]: cluster 2024-03-30T15:16:24.249536+0000 mon.a (mon.0) 2398 : cluster 0 osdmap e326: 8 total, 8 up, 8 in 2024-03-30T15:16:25.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:25 smithi172 bash[23680]: audit 2024-03-30T15:16:24.256377+0000 mon.a (mon.0) 2399 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-30T15:16:26.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:26 smithi072 bash[21573]: audit 2024-03-30T15:16:25.254663+0000 mon.a (mon.0) 2400 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-45","var": "hit_set_type","val": "bloom"}]': finished 2024-03-30T15:16:26.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:26 smithi072 bash[21573]: cluster 2024-03-30T15:16:25.264610+0000 mon.a (mon.0) 2401 : cluster 0 osdmap e327: 8 total, 8 up, 8 in 2024-03-30T15:16:26.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:26 smithi072 bash[21573]: audit 2024-03-30T15:16:25.265583+0000 mon.a (mon.0) 2402 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-03-30T15:16:26.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:26 smithi072 bash[21573]: cluster 2024-03-30T15:16:26.095731+0000 mon.a (mon.0) 2403 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:16:26.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:26 smithi072 bash[28946]: audit 2024-03-30T15:16:25.254663+0000 mon.a (mon.0) 2400 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-45","var": "hit_set_type","val": "bloom"}]': finished 2024-03-30T15:16:26.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:26 smithi072 bash[28946]: cluster 2024-03-30T15:16:25.264610+0000 mon.a (mon.0) 2401 : cluster 0 osdmap e327: 8 total, 8 up, 8 in 2024-03-30T15:16:26.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:26 smithi072 bash[28946]: audit 2024-03-30T15:16:25.265583+0000 mon.a (mon.0) 2402 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-03-30T15:16:26.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:26 smithi072 bash[28946]: cluster 2024-03-30T15:16:26.095731+0000 mon.a (mon.0) 2403 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:16:26.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:26 smithi172 bash[23680]: audit 2024-03-30T15:16:25.254663+0000 mon.a (mon.0) 2400 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-45","var": "hit_set_type","val": "bloom"}]': finished 2024-03-30T15:16:26.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:26 smithi172 bash[23680]: cluster 2024-03-30T15:16:25.264610+0000 mon.a (mon.0) 2401 : cluster 0 osdmap e327: 8 total, 8 up, 8 in 2024-03-30T15:16:26.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:26 smithi172 bash[23680]: audit 2024-03-30T15:16:25.265583+0000 mon.a (mon.0) 2402 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-03-30T15:16:26.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:26 smithi172 bash[23680]: cluster 2024-03-30T15:16:26.095731+0000 mon.a (mon.0) 2403 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:16:27.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:27 smithi072 bash[21573]: cluster 2024-03-30T15:16:26.017241+0000 mgr.y (mgr.14526) 355 : cluster 0 pgmap v495: 236 pgs: 3 creating+activating, 233 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:16:27.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:27 smithi072 bash[21573]: audit 2024-03-30T15:16:26.263573+0000 mon.a (mon.0) 2404 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-45","var": "hit_set_fpp","val": ".01"}]': finished 2024-03-30T15:16:27.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:27 smithi072 bash[21573]: cluster 2024-03-30T15:16:26.272193+0000 mon.a (mon.0) 2405 : cluster 0 osdmap e328: 8 total, 8 up, 8 in 2024-03-30T15:16:27.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:27 smithi072 bash[21573]: audit 2024-03-30T15:16:26.279587+0000 mon.a (mon.0) 2406 : audit 1 from='client.? 172.21.15.72:0/2725207180' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi072-64171-58"}]: dispatch 2024-03-30T15:16:27.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:27 smithi072 bash[28946]: cluster 2024-03-30T15:16:26.017241+0000 mgr.y (mgr.14526) 355 : cluster 0 pgmap v495: 236 pgs: 3 creating+activating, 233 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:16:27.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:27 smithi072 bash[28946]: audit 2024-03-30T15:16:26.263573+0000 mon.a (mon.0) 2404 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-45","var": "hit_set_fpp","val": ".01"}]': finished 2024-03-30T15:16:27.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:27 smithi072 bash[28946]: cluster 2024-03-30T15:16:26.272193+0000 mon.a (mon.0) 2405 : cluster 0 osdmap e328: 8 total, 8 up, 8 in 2024-03-30T15:16:27.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:27 smithi072 bash[28946]: audit 2024-03-30T15:16:26.279587+0000 mon.a (mon.0) 2406 : audit 1 from='client.? 172.21.15.72:0/2725207180' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi072-64171-58"}]: dispatch 2024-03-30T15:16:27.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:27 smithi172 bash[23680]: cluster 2024-03-30T15:16:26.017241+0000 mgr.y (mgr.14526) 355 : cluster 0 pgmap v495: 236 pgs: 3 creating+activating, 233 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:16:27.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:27 smithi172 bash[23680]: audit 2024-03-30T15:16:26.263573+0000 mon.a (mon.0) 2404 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-45","var": "hit_set_fpp","val": ".01"}]': finished 2024-03-30T15:16:27.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:27 smithi172 bash[23680]: cluster 2024-03-30T15:16:26.272193+0000 mon.a (mon.0) 2405 : cluster 0 osdmap e328: 8 total, 8 up, 8 in 2024-03-30T15:16:27.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:27 smithi172 bash[23680]: audit 2024-03-30T15:16:26.279587+0000 mon.a (mon.0) 2406 : audit 1 from='client.? 172.21.15.72:0/2725207180' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi072-64171-58"}]: dispatch 2024-03-30T15:16:28.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:28 smithi072 bash[21573]: audit 2024-03-30T15:16:27.266277+0000 mon.a (mon.0) 2407 : audit 1 from='client.? 172.21.15.72:0/2725207180' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi072-64171-58"}]': finished 2024-03-30T15:16:28.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:28 smithi072 bash[21573]: cluster 2024-03-30T15:16:27.273791+0000 mon.a (mon.0) 2408 : cluster 0 osdmap e329: 8 total, 8 up, 8 in 2024-03-30T15:16:28.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:28 smithi072 bash[21573]: audit 2024-03-30T15:16:27.276532+0000 mon.a (mon.0) 2409 : audit 1 from='client.? 172.21.15.72:0/2725207180' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi072-64171-58"}]: dispatch 2024-03-30T15:16:28.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:28 smithi072 bash[21573]: audit 2024-03-30T15:16:28.269825+0000 mon.a (mon.0) 2410 : audit 1 from='client.? 172.21.15.72:0/2725207180' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi072-64171-58"}]': finished 2024-03-30T15:16:28.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:28 smithi072 bash[28946]: audit 2024-03-30T15:16:27.266277+0000 mon.a (mon.0) 2407 : audit 1 from='client.? 172.21.15.72:0/2725207180' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi072-64171-58"}]': finished 2024-03-30T15:16:28.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:28 smithi072 bash[28946]: cluster 2024-03-30T15:16:27.273791+0000 mon.a (mon.0) 2408 : cluster 0 osdmap e329: 8 total, 8 up, 8 in 2024-03-30T15:16:28.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:28 smithi072 bash[28946]: audit 2024-03-30T15:16:27.276532+0000 mon.a (mon.0) 2409 : audit 1 from='client.? 172.21.15.72:0/2725207180' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi072-64171-58"}]: dispatch 2024-03-30T15:16:28.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:28 smithi072 bash[28946]: audit 2024-03-30T15:16:28.269825+0000 mon.a (mon.0) 2410 : audit 1 from='client.? 172.21.15.72:0/2725207180' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi072-64171-58"}]': finished 2024-03-30T15:16:28.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:28 smithi172 bash[23680]: audit 2024-03-30T15:16:27.266277+0000 mon.a (mon.0) 2407 : audit 1 from='client.? 172.21.15.72:0/2725207180' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi072-64171-58"}]': finished 2024-03-30T15:16:28.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:28 smithi172 bash[23680]: cluster 2024-03-30T15:16:27.273791+0000 mon.a (mon.0) 2408 : cluster 0 osdmap e329: 8 total, 8 up, 8 in 2024-03-30T15:16:28.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:28 smithi172 bash[23680]: audit 2024-03-30T15:16:27.276532+0000 mon.a (mon.0) 2409 : audit 1 from='client.? 172.21.15.72:0/2725207180' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi072-64171-58"}]: dispatch 2024-03-30T15:16:28.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:28 smithi172 bash[23680]: audit 2024-03-30T15:16:28.269825+0000 mon.a (mon.0) 2410 : audit 1 from='client.? 172.21.15.72:0/2725207180' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi072-64171-58"}]': finished 2024-03-30T15:16:29.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:29 smithi072 bash[21573]: cluster 2024-03-30T15:16:28.018053+0000 mgr.y (mgr.14526) 356 : cluster 0 pgmap v498: 228 pgs: 228 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:16:29.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:29 smithi072 bash[21573]: cluster 2024-03-30T15:16:28.277128+0000 mon.a (mon.0) 2411 : cluster 0 osdmap e330: 8 total, 8 up, 8 in 2024-03-30T15:16:29.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:29 smithi072 bash[21573]: audit 2024-03-30T15:16:28.309578+0000 mon.a (mon.0) 2412 : audit 1 from='client.? 172.21.15.72:0/2257847343' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi072-64171-59"}]: dispatch 2024-03-30T15:16:29.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:29 smithi072 bash[21573]: audit 2024-03-30T15:16:28.310856+0000 mon.a (mon.0) 2413 : audit 1 from='client.? 172.21.15.72:0/2257847343' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi072-64171-59"}]: dispatch 2024-03-30T15:16:29.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:29 smithi072 bash[21573]: audit 2024-03-30T15:16:28.311353+0000 mon.a (mon.0) 2414 : audit 1 from='client.? 172.21.15.72:0/2257847343' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi072-64171-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:16:29.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:29 smithi072 bash[28946]: cluster 2024-03-30T15:16:28.018053+0000 mgr.y (mgr.14526) 356 : cluster 0 pgmap v498: 228 pgs: 228 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:16:29.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:29 smithi072 bash[28946]: cluster 2024-03-30T15:16:28.277128+0000 mon.a (mon.0) 2411 : cluster 0 osdmap e330: 8 total, 8 up, 8 in 2024-03-30T15:16:29.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:29 smithi072 bash[28946]: audit 2024-03-30T15:16:28.309578+0000 mon.a (mon.0) 2412 : audit 1 from='client.? 172.21.15.72:0/2257847343' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi072-64171-59"}]: dispatch 2024-03-30T15:16:29.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:29 smithi072 bash[28946]: audit 2024-03-30T15:16:28.310856+0000 mon.a (mon.0) 2413 : audit 1 from='client.? 172.21.15.72:0/2257847343' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi072-64171-59"}]: dispatch 2024-03-30T15:16:29.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:29 smithi072 bash[28946]: audit 2024-03-30T15:16:28.311353+0000 mon.a (mon.0) 2414 : audit 1 from='client.? 172.21.15.72:0/2257847343' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi072-64171-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:16:29.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:29 smithi172 bash[23680]: cluster 2024-03-30T15:16:28.018053+0000 mgr.y (mgr.14526) 356 : cluster 0 pgmap v498: 228 pgs: 228 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:16:29.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:29 smithi172 bash[23680]: cluster 2024-03-30T15:16:28.277128+0000 mon.a (mon.0) 2411 : cluster 0 osdmap e330: 8 total, 8 up, 8 in 2024-03-30T15:16:29.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:29 smithi172 bash[23680]: audit 2024-03-30T15:16:28.309578+0000 mon.a (mon.0) 2412 : audit 1 from='client.? 172.21.15.72:0/2257847343' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi072-64171-59"}]: dispatch 2024-03-30T15:16:29.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:29 smithi172 bash[23680]: audit 2024-03-30T15:16:28.310856+0000 mon.a (mon.0) 2413 : audit 1 from='client.? 172.21.15.72:0/2257847343' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi072-64171-59"}]: dispatch 2024-03-30T15:16:29.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:29 smithi172 bash[23680]: audit 2024-03-30T15:16:28.311353+0000 mon.a (mon.0) 2414 : audit 1 from='client.? 172.21.15.72:0/2257847343' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi072-64171-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:16:31.028 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:30 smithi072 bash[28946]: audit 2024-03-30T15:16:29.294414+0000 mon.a (mon.0) 2415 : audit 1 from='client.? 172.21.15.72:0/2257847343' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi072-64171-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:16:31.028 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:30 smithi072 bash[28946]: cluster 2024-03-30T15:16:29.301824+0000 mon.a (mon.0) 2416 : cluster 0 osdmap e331: 8 total, 8 up, 8 in 2024-03-30T15:16:31.028 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:30 smithi072 bash[28946]: audit 2024-03-30T15:16:29.306121+0000 mon.a (mon.0) 2417 : audit 1 from='client.? 172.21.15.72:0/2257847343' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi072-64171-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi072-64171-59"}]: dispatch 2024-03-30T15:16:31.029 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:30 smithi072 bash[21573]: audit 2024-03-30T15:16:29.294414+0000 mon.a (mon.0) 2415 : audit 1 from='client.? 172.21.15.72:0/2257847343' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi072-64171-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:16:31.029 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:30 smithi072 bash[21573]: cluster 2024-03-30T15:16:29.301824+0000 mon.a (mon.0) 2416 : cluster 0 osdmap e331: 8 total, 8 up, 8 in 2024-03-30T15:16:31.029 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:30 smithi072 bash[21573]: audit 2024-03-30T15:16:29.306121+0000 mon.a (mon.0) 2417 : audit 1 from='client.? 172.21.15.72:0/2257847343' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi072-64171-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi072-64171-59"}]: dispatch 2024-03-30T15:16:31.183 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:30 smithi172 bash[23680]: audit 2024-03-30T15:16:29.294414+0000 mon.a (mon.0) 2415 : audit 1 from='client.? 172.21.15.72:0/2257847343' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi072-64171-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:16:31.183 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:30 smithi172 bash[23680]: cluster 2024-03-30T15:16:29.301824+0000 mon.a (mon.0) 2416 : cluster 0 osdmap e331: 8 total, 8 up, 8 in 2024-03-30T15:16:31.183 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:30 smithi172 bash[23680]: audit 2024-03-30T15:16:29.306121+0000 mon.a (mon.0) 2417 : audit 1 from='client.? 172.21.15.72:0/2257847343' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi072-64171-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi072-64171-59"}]: dispatch 2024-03-30T15:16:31.418 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:16:31 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:16:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:16:31.470 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:16:31 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:16:32.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:31 smithi072 bash[21573]: cluster 2024-03-30T15:16:30.018838+0000 mgr.y (mgr.14526) 357 : cluster 0 pgmap v501: 228 pgs: 228 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:16:32.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:31 smithi072 bash[21573]: cluster 2024-03-30T15:16:30.750651+0000 mon.a (mon.0) 2418 : cluster 0 osdmap e332: 8 total, 8 up, 8 in 2024-03-30T15:16:32.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:31 smithi072 bash[21573]: audit 2024-03-30T15:16:31.187321+0000 mgr.y (mgr.14526) 358 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:16:32.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:31 smithi072 bash[21573]: audit 2024-03-30T15:16:31.301130+0000 mon.a (mon.0) 2419 : audit 1 from='client.? 172.21.15.72:0/2257847343' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi072-64171-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi072-64171-59"}]': finished 2024-03-30T15:16:32.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:31 smithi072 bash[21573]: cluster 2024-03-30T15:16:31.312894+0000 mon.a (mon.0) 2420 : cluster 0 osdmap e333: 8 total, 8 up, 8 in 2024-03-30T15:16:32.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:31 smithi072 bash[28946]: cluster 2024-03-30T15:16:30.018838+0000 mgr.y (mgr.14526) 357 : cluster 0 pgmap v501: 228 pgs: 228 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:16:32.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:31 smithi072 bash[28946]: cluster 2024-03-30T15:16:30.750651+0000 mon.a (mon.0) 2418 : cluster 0 osdmap e332: 8 total, 8 up, 8 in 2024-03-30T15:16:32.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:31 smithi072 bash[28946]: audit 2024-03-30T15:16:31.187321+0000 mgr.y (mgr.14526) 358 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:16:32.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:31 smithi072 bash[28946]: audit 2024-03-30T15:16:31.301130+0000 mon.a (mon.0) 2419 : audit 1 from='client.? 172.21.15.72:0/2257847343' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi072-64171-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi072-64171-59"}]': finished 2024-03-30T15:16:32.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:31 smithi072 bash[28946]: cluster 2024-03-30T15:16:31.312894+0000 mon.a (mon.0) 2420 : cluster 0 osdmap e333: 8 total, 8 up, 8 in 2024-03-30T15:16:32.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:31 smithi172 bash[23680]: cluster 2024-03-30T15:16:30.018838+0000 mgr.y (mgr.14526) 357 : cluster 0 pgmap v501: 228 pgs: 228 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:16:32.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:31 smithi172 bash[23680]: cluster 2024-03-30T15:16:30.750651+0000 mon.a (mon.0) 2418 : cluster 0 osdmap e332: 8 total, 8 up, 8 in 2024-03-30T15:16:32.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:31 smithi172 bash[23680]: audit 2024-03-30T15:16:31.187321+0000 mgr.y (mgr.14526) 358 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:16:32.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:31 smithi172 bash[23680]: audit 2024-03-30T15:16:31.301130+0000 mon.a (mon.0) 2419 : audit 1 from='client.? 172.21.15.72:0/2257847343' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi072-64171-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi072-64171-59"}]': finished 2024-03-30T15:16:32.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:31 smithi172 bash[23680]: cluster 2024-03-30T15:16:31.312894+0000 mon.a (mon.0) 2420 : cluster 0 osdmap e333: 8 total, 8 up, 8 in 2024-03-30T15:16:33.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:33 smithi072 bash[21573]: cluster 2024-03-30T15:16:32.019625+0000 mgr.y (mgr.14526) 359 : cluster 0 pgmap v504: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-03-30T15:16:33.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:33 smithi072 bash[21573]: cluster 2024-03-30T15:16:32.312197+0000 mon.a (mon.0) 2421 : cluster 0 osdmap e334: 8 total, 8 up, 8 in 2024-03-30T15:16:33.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:33 smithi072 bash[21573]: cluster 2024-03-30T15:16:32.766353+0000 mon.a (mon.0) 2422 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:16:33.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:33 smithi072 bash[28946]: cluster 2024-03-30T15:16:32.019625+0000 mgr.y (mgr.14526) 359 : cluster 0 pgmap v504: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-03-30T15:16:33.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:33 smithi072 bash[28946]: cluster 2024-03-30T15:16:32.312197+0000 mon.a (mon.0) 2421 : cluster 0 osdmap e334: 8 total, 8 up, 8 in 2024-03-30T15:16:33.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:33 smithi072 bash[28946]: cluster 2024-03-30T15:16:32.766353+0000 mon.a (mon.0) 2422 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:16:33.713 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:33 smithi172 bash[23680]: cluster 2024-03-30T15:16:32.019625+0000 mgr.y (mgr.14526) 359 : cluster 0 pgmap v504: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-03-30T15:16:33.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:33 smithi172 bash[23680]: cluster 2024-03-30T15:16:32.312197+0000 mon.a (mon.0) 2421 : cluster 0 osdmap e334: 8 total, 8 up, 8 in 2024-03-30T15:16:33.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:33 smithi172 bash[23680]: cluster 2024-03-30T15:16:32.766353+0000 mon.a (mon.0) 2422 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:16:34.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:34 smithi072 bash[21573]: cluster 2024-03-30T15:16:33.321188+0000 mon.a (mon.0) 2423 : cluster 0 osdmap e335: 8 total, 8 up, 8 in 2024-03-30T15:16:34.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:34 smithi072 bash[21573]: audit 2024-03-30T15:16:33.323371+0000 mon.a (mon.0) 2424 : audit 1 from='client.? 172.21.15.72:0/2257847343' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi072-64171-59"}]: dispatch 2024-03-30T15:16:34.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:34 smithi072 bash[28946]: cluster 2024-03-30T15:16:33.321188+0000 mon.a (mon.0) 2423 : cluster 0 osdmap e335: 8 total, 8 up, 8 in 2024-03-30T15:16:34.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:34 smithi072 bash[28946]: audit 2024-03-30T15:16:33.323371+0000 mon.a (mon.0) 2424 : audit 1 from='client.? 172.21.15.72:0/2257847343' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi072-64171-59"}]: dispatch 2024-03-30T15:16:34.713 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:34 smithi172 bash[23680]: cluster 2024-03-30T15:16:33.321188+0000 mon.a (mon.0) 2423 : cluster 0 osdmap e335: 8 total, 8 up, 8 in 2024-03-30T15:16:34.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:34 smithi172 bash[23680]: audit 2024-03-30T15:16:33.323371+0000 mon.a (mon.0) 2424 : audit 1 from='client.? 172.21.15.72:0/2257847343' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi072-64171-59"}]: dispatch 2024-03-30T15:16:35.328 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:7462ddf6:::io.RoundTripAppendPP (3031 ms) 2024-03-30T15:16:35.328 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAio.RacingRemovePP 2024-03-30T15:16:35.328 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAio.RacingRemovePP (3022 ms) 2024-03-30T15:16:35.328 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP 2024-03-30T15:16:35.328 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP (3405 ms) 2024-03-30T15:16:35.328 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP2 2024-03-30T15:16:35.328 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP2 (2900 ms) 2024-03-30T15:16:35.328 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolEIOFlag 2024-03-30T15:16:35.328 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: setting pool EIO 2024-03-30T15:16:35.329 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: max_success 101, min_failed 102 2024-03-30T15:16:35.329 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolEIOFlag (4487 ms) 2024-03-30T15:16:35.329 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiReads 2024-03-30T15:16:35.329 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiReads (2579 ms) 2024-03-30T15:16:35.329 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio (156143 ms total) 2024-03-30T15:16:35.329 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: 2024-03-30T15:16:35.329 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP 2024-03-30T15:16:35.329 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.ReadIntoBufferlist 2024-03-30T15:16:35.329 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAioPP.ReadIntoBufferlist (3014 ms) 2024-03-30T15:16:35.329 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.XattrsRoundTripPP 2024-03-30T15:16:35.329 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAioPP.XattrsRoundTripPP (9028 ms) 2024-03-30T15:16:35.329 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RmXattrPP 2024-03-30T15:16:35.329 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RmXattrPP (14957 ms) 2024-03-30T15:16:35.329 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RemoveTestPP 2024-03-30T15:16:35.329 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RemoveTestPP (3011 ms) 2024-03-30T15:16:35.329 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP (30010 ms total) 2024-03-30T15:16:35.330 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: 2024-03-30T15:16:35.330 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP 2024-03-30T15:16:35.330 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosIoPP.XattrListPP 2024-03-30T15:16:35.330 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosIoPP.XattrListPP (3013 ms) 2024-03-30T15:16:35.330 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP (3013 ms total) 2024-03-30T15:16:35.330 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: 2024-03-30T15:16:35.330 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC 2024-03-30T15:16:35.330 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleWritePP 2024-03-30T15:16:35.330 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleWritePP (13999 ms) 2024-03-30T15:16:35.330 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.WaitForSafePP 2024-03-30T15:16:35.330 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAioEC.WaitForSafePP (6979 ms) 2024-03-30T15:16:35.330 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP 2024-03-30T15:16:35.330 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP (7054 ms) 2024-03-30T15:16:35.330 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP2 2024-03-30T15:16:35.330 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP2 (7023 ms) 2024-03-30T15:16:35.331 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP3 2024-03-30T15:16:35.331 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP3 (3016 ms) 2024-03-30T15:16:35.331 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripSparseReadPP 2024-03-30T15:16:35.331 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripSparseReadPP (7027 ms) 2024-03-30T15:16:35.331 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripAppendPP 2024-03-30T15:16:35.331 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripAppendPP (6899 ms) 2024-03-30T15:16:35.331 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsCompletePP 2024-03-30T15:16:35.331 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsCompletePP (7021 ms) 2024-03-30T15:16:35.331 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsSafePP 2024-03-30T15:16:35.331 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsSafePP (7017 ms) 2024-03-30T15:16:35.331 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ReturnValuePP 2024-03-30T15:16:35.331 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ReturnValuePP (7084 ms) 2024-03-30T15:16:35.331 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushPP 2024-03-30T15:16:35.331 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushPP (7027 ms) 2024-03-30T15:16:35.331 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushAsyncPP 2024-03-30T15:16:35.332 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushAsyncPP (7030 ms) 2024-03-30T15:16:35.332 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP 2024-03-30T15:16:35.332 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP (7049 ms) 2024-03-30T15:16:35.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:35 smithi072 bash[28946]: cluster 2024-03-30T15:16:34.020457+0000 mgr.y (mgr.14526) 360 : cluster 0 pgmap v507: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-03-30T15:16:35.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:35 smithi072 bash[28946]: audit 2024-03-30T15:16:34.317297+0000 mon.a (mon.0) 2425 : audit 1 from='client.? 172.21.15.72:0/2257847343' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi072-64171-59"}]': finished 2024-03-30T15:16:35.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:35 smithi072 bash[28946]: cluster 2024-03-30T15:16:34.327886+0000 mon.a (mon.0) 2426 : cluster 0 osdmap e336: 8 total, 8 up, 8 in 2024-03-30T15:16:35.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:35 smithi072 bash[28946]: audit 2024-03-30T15:16:34.329644+0000 mon.a (mon.0) 2427 : audit 1 from='client.? 172.21.15.72:0/2257847343' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi072-64171-59"}]: dispatch 2024-03-30T15:16:35.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:35 smithi072 bash[28946]: audit 2024-03-30T15:16:35.320589+0000 mon.a (mon.0) 2428 : audit 1 from='client.? 172.21.15.72:0/2257847343' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi072-64171-59"}]': finished 2024-03-30T15:16:35.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:35 smithi072 bash[28946]: cluster 2024-03-30T15:16:35.328099+0000 mon.a (mon.0) 2429 : cluster 0 osdmap e337: 8 total, 8 up, 8 in 2024-03-30T15:16:35.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:35 smithi072 bash[21573]: cluster 2024-03-30T15:16:34.020457+0000 mgr.y (mgr.14526) 360 : cluster 0 pgmap v507: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-03-30T15:16:35.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:35 smithi072 bash[21573]: audit 2024-03-30T15:16:34.317297+0000 mon.a (mon.0) 2425 : audit 1 from='client.? 172.21.15.72:0/2257847343' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi072-64171-59"}]': finished 2024-03-30T15:16:35.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:35 smithi072 bash[21573]: cluster 2024-03-30T15:16:34.327886+0000 mon.a (mon.0) 2426 : cluster 0 osdmap e336: 8 total, 8 up, 8 in 2024-03-30T15:16:35.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:35 smithi072 bash[21573]: audit 2024-03-30T15:16:34.329644+0000 mon.a (mon.0) 2427 : audit 1 from='client.? 172.21.15.72:0/2257847343' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi072-64171-59"}]: dispatch 2024-03-30T15:16:35.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:35 smithi072 bash[21573]: audit 2024-03-30T15:16:35.320589+0000 mon.a (mon.0) 2428 : audit 1 from='client.? 172.21.15.72:0/2257847343' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi072-64171-59"}]': finished 2024-03-30T15:16:35.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:35 smithi072 bash[21573]: cluster 2024-03-30T15:16:35.328099+0000 mon.a (mon.0) 2429 : cluster 0 osdmap e337: 8 total, 8 up, 8 in 2024-03-30T15:16:35.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:35 smithi172 bash[23680]: cluster 2024-03-30T15:16:34.020457+0000 mgr.y (mgr.14526) 360 : cluster 0 pgmap v507: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-03-30T15:16:35.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:35 smithi172 bash[23680]: audit 2024-03-30T15:16:34.317297+0000 mon.a (mon.0) 2425 : audit 1 from='client.? 172.21.15.72:0/2257847343' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi072-64171-59"}]': finished 2024-03-30T15:16:35.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:35 smithi172 bash[23680]: cluster 2024-03-30T15:16:34.327886+0000 mon.a (mon.0) 2426 : cluster 0 osdmap e336: 8 total, 8 up, 8 in 2024-03-30T15:16:35.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:35 smithi172 bash[23680]: audit 2024-03-30T15:16:34.329644+0000 mon.a (mon.0) 2427 : audit 1 from='client.? 172.21.15.72:0/2257847343' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi072-64171-59"}]: dispatch 2024-03-30T15:16:35.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:35 smithi172 bash[23680]: audit 2024-03-30T15:16:35.320589+0000 mon.a (mon.0) 2428 : audit 1 from='client.? 172.21.15.72:0/2257847343' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi072-64171-59"}]': finished 2024-03-30T15:16:35.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:35 smithi172 bash[23680]: cluster 2024-03-30T15:16:35.328099+0000 mon.a (mon.0) 2429 : cluster 0 osdmap e337: 8 total, 8 up, 8 in 2024-03-30T15:16:36.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:36 smithi072 bash[21573]: audit 2024-03-30T15:16:36.080186+0000 mon.c (mon.2) 425 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:16:36.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:36 smithi072 bash[28946]: audit 2024-03-30T15:16:36.080186+0000 mon.c (mon.2) 425 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:16:36.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:36 smithi172 bash[23680]: audit 2024-03-30T15:16:36.080186+0000 mon.c (mon.2) 425 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:16:37.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:37 smithi072 bash[21573]: cluster 2024-03-30T15:16:36.022728+0000 mgr.y (mgr.14526) 361 : cluster 0 pgmap v510: 228 pgs: 228 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-03-30T15:16:37.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:37 smithi072 bash[21573]: cluster 2024-03-30T15:16:36.367761+0000 mon.a (mon.0) 2430 : cluster 0 osdmap e338: 8 total, 8 up, 8 in 2024-03-30T15:16:37.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:37 smithi072 bash[21573]: audit 2024-03-30T15:16:36.384592+0000 mon.c (mon.2) 426 : audit 1 from='client.? 172.21.15.72:0/23390643' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi072-64171-60","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:16:37.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:37 smithi072 bash[21573]: audit 2024-03-30T15:16:36.386264+0000 mon.a (mon.0) 2431 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi072-64171-60","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:16:37.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:37 smithi072 bash[28946]: cluster 2024-03-30T15:16:36.022728+0000 mgr.y (mgr.14526) 361 : cluster 0 pgmap v510: 228 pgs: 228 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-03-30T15:16:37.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:37 smithi072 bash[28946]: cluster 2024-03-30T15:16:36.367761+0000 mon.a (mon.0) 2430 : cluster 0 osdmap e338: 8 total, 8 up, 8 in 2024-03-30T15:16:37.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:37 smithi072 bash[28946]: audit 2024-03-30T15:16:36.384592+0000 mon.c (mon.2) 426 : audit 1 from='client.? 172.21.15.72:0/23390643' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi072-64171-60","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:16:37.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:37 smithi072 bash[28946]: audit 2024-03-30T15:16:36.386264+0000 mon.a (mon.0) 2431 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi072-64171-60","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:16:37.713 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:37 smithi172 bash[23680]: cluster 2024-03-30T15:16:36.022728+0000 mgr.y (mgr.14526) 361 : cluster 0 pgmap v510: 228 pgs: 228 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-03-30T15:16:37.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:37 smithi172 bash[23680]: cluster 2024-03-30T15:16:36.367761+0000 mon.a (mon.0) 2430 : cluster 0 osdmap e338: 8 total, 8 up, 8 in 2024-03-30T15:16:37.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:37 smithi172 bash[23680]: audit 2024-03-30T15:16:36.384592+0000 mon.c (mon.2) 426 : audit 1 from='client.? 172.21.15.72:0/23390643' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi072-64171-60","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:16:37.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:37 smithi172 bash[23680]: audit 2024-03-30T15:16:36.386264+0000 mon.a (mon.0) 2431 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi072-64171-60","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:16:38.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:38 smithi072 bash[21573]: audit 2024-03-30T15:16:37.355486+0000 mon.a (mon.0) 2432 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi072-64171-60","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:16:38.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:38 smithi072 bash[21573]: cluster 2024-03-30T15:16:37.363904+0000 mon.a (mon.0) 2433 : cluster 0 osdmap e339: 8 total, 8 up, 8 in 2024-03-30T15:16:38.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:38 smithi072 bash[28946]: audit 2024-03-30T15:16:37.355486+0000 mon.a (mon.0) 2432 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi072-64171-60","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:16:38.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:38 smithi072 bash[28946]: cluster 2024-03-30T15:16:37.363904+0000 mon.a (mon.0) 2433 : cluster 0 osdmap e339: 8 total, 8 up, 8 in 2024-03-30T15:16:38.713 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:38 smithi172 bash[23680]: audit 2024-03-30T15:16:37.355486+0000 mon.a (mon.0) 2432 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi072-64171-60","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:16:38.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:38 smithi172 bash[23680]: cluster 2024-03-30T15:16:37.363904+0000 mon.a (mon.0) 2433 : cluster 0 osdmap e339: 8 total, 8 up, 8 in 2024-03-30T15:16:39.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:39 smithi072 bash[21573]: cluster 2024-03-30T15:16:38.023601+0000 mgr.y (mgr.14526) 362 : cluster 0 pgmap v513: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-03-30T15:16:39.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:39 smithi072 bash[21573]: cluster 2024-03-30T15:16:38.393844+0000 mon.a (mon.0) 2434 : cluster 0 osdmap e340: 8 total, 8 up, 8 in 2024-03-30T15:16:39.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:39 smithi072 bash[21573]: audit 2024-03-30T15:16:38.395886+0000 mon.a (mon.0) 2435 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:16:39.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:39 smithi072 bash[21573]: audit 2024-03-30T15:16:38.397299+0000 mon.a (mon.0) 2436 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-45"}]: dispatch 2024-03-30T15:16:39.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:39 smithi072 bash[21573]: audit 2024-03-30T15:16:38.428125+0000 mon.c (mon.2) 427 : audit 1 from='client.? 172.21.15.72:0/2818575339' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi072-64171-61"}]: dispatch 2024-03-30T15:16:39.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:39 smithi072 bash[21573]: audit 2024-03-30T15:16:38.428444+0000 mon.a (mon.0) 2437 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi072-64171-61"}]: dispatch 2024-03-30T15:16:39.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:39 smithi072 bash[21573]: audit 2024-03-30T15:16:38.429175+0000 mon.c (mon.2) 428 : audit 1 from='client.? 172.21.15.72:0/2818575339' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi072-64171-61"}]: dispatch 2024-03-30T15:16:39.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:39 smithi072 bash[21573]: audit 2024-03-30T15:16:38.429515+0000 mon.a (mon.0) 2438 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi072-64171-61"}]: dispatch 2024-03-30T15:16:39.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:39 smithi072 bash[21573]: audit 2024-03-30T15:16:38.430040+0000 mon.c (mon.2) 429 : audit 1 from='client.? 172.21.15.72:0/2818575339' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi072-64171-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:16:39.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:39 smithi072 bash[21573]: audit 2024-03-30T15:16:38.430372+0000 mon.a (mon.0) 2439 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi072-64171-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:16:39.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:39 smithi072 bash[28946]: cluster 2024-03-30T15:16:38.023601+0000 mgr.y (mgr.14526) 362 : cluster 0 pgmap v513: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-03-30T15:16:39.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:39 smithi072 bash[28946]: cluster 2024-03-30T15:16:38.393844+0000 mon.a (mon.0) 2434 : cluster 0 osdmap e340: 8 total, 8 up, 8 in 2024-03-30T15:16:39.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:39 smithi072 bash[28946]: audit 2024-03-30T15:16:38.395886+0000 mon.a (mon.0) 2435 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:16:39.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:39 smithi072 bash[28946]: audit 2024-03-30T15:16:38.397299+0000 mon.a (mon.0) 2436 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-45"}]: dispatch 2024-03-30T15:16:39.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:39 smithi072 bash[28946]: audit 2024-03-30T15:16:38.428125+0000 mon.c (mon.2) 427 : audit 1 from='client.? 172.21.15.72:0/2818575339' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi072-64171-61"}]: dispatch 2024-03-30T15:16:39.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:39 smithi072 bash[28946]: audit 2024-03-30T15:16:38.428444+0000 mon.a (mon.0) 2437 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi072-64171-61"}]: dispatch 2024-03-30T15:16:39.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:39 smithi072 bash[28946]: audit 2024-03-30T15:16:38.429175+0000 mon.c (mon.2) 428 : audit 1 from='client.? 172.21.15.72:0/2818575339' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi072-64171-61"}]: dispatch 2024-03-30T15:16:39.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:39 smithi072 bash[28946]: audit 2024-03-30T15:16:38.429515+0000 mon.a (mon.0) 2438 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi072-64171-61"}]: dispatch 2024-03-30T15:16:39.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:39 smithi072 bash[28946]: audit 2024-03-30T15:16:38.430040+0000 mon.c (mon.2) 429 : audit 1 from='client.? 172.21.15.72:0/2818575339' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi072-64171-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:16:39.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:39 smithi072 bash[28946]: audit 2024-03-30T15:16:38.430372+0000 mon.a (mon.0) 2439 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi072-64171-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:16:39.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:39 smithi172 bash[23680]: cluster 2024-03-30T15:16:38.023601+0000 mgr.y (mgr.14526) 362 : cluster 0 pgmap v513: 260 pgs: 32 unknown, 228 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-03-30T15:16:39.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:39 smithi172 bash[23680]: cluster 2024-03-30T15:16:38.393844+0000 mon.a (mon.0) 2434 : cluster 0 osdmap e340: 8 total, 8 up, 8 in 2024-03-30T15:16:39.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:39 smithi172 bash[23680]: audit 2024-03-30T15:16:38.395886+0000 mon.a (mon.0) 2435 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:16:39.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:39 smithi172 bash[23680]: audit 2024-03-30T15:16:38.397299+0000 mon.a (mon.0) 2436 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-45"}]: dispatch 2024-03-30T15:16:39.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:39 smithi172 bash[23680]: audit 2024-03-30T15:16:38.428125+0000 mon.c (mon.2) 427 : audit 1 from='client.? 172.21.15.72:0/2818575339' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi072-64171-61"}]: dispatch 2024-03-30T15:16:39.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:39 smithi172 bash[23680]: audit 2024-03-30T15:16:38.428444+0000 mon.a (mon.0) 2437 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi072-64171-61"}]: dispatch 2024-03-30T15:16:39.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:39 smithi172 bash[23680]: audit 2024-03-30T15:16:38.429175+0000 mon.c (mon.2) 428 : audit 1 from='client.? 172.21.15.72:0/2818575339' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi072-64171-61"}]: dispatch 2024-03-30T15:16:39.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:39 smithi172 bash[23680]: audit 2024-03-30T15:16:38.429515+0000 mon.a (mon.0) 2438 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi072-64171-61"}]: dispatch 2024-03-30T15:16:39.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:39 smithi172 bash[23680]: audit 2024-03-30T15:16:38.430040+0000 mon.c (mon.2) 429 : audit 1 from='client.? 172.21.15.72:0/2818575339' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi072-64171-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:16:39.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:39 smithi172 bash[23680]: audit 2024-03-30T15:16:38.430372+0000 mon.a (mon.0) 2439 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi072-64171-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:16:40.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:40 smithi072 bash[21573]: audit 2024-03-30T15:16:39.388947+0000 mon.a (mon.0) 2440 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-45"}]': finished 2024-03-30T15:16:40.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:40 smithi072 bash[21573]: audit 2024-03-30T15:16:39.389174+0000 mon.a (mon.0) 2441 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi072-64171-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:16:40.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:40 smithi072 bash[21573]: cluster 2024-03-30T15:16:39.396478+0000 mon.a (mon.0) 2442 : cluster 0 osdmap e341: 8 total, 8 up, 8 in 2024-03-30T15:16:40.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:40 smithi072 bash[21573]: audit 2024-03-30T15:16:39.399494+0000 mon.c (mon.2) 430 : audit 1 from='client.? 172.21.15.72:0/2818575339' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi072-64171-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi072-64171-61"}]: dispatch 2024-03-30T15:16:40.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:40 smithi072 bash[21573]: audit 2024-03-30T15:16:39.411766+0000 mon.a (mon.0) 2443 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi072-64171-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi072-64171-61"}]: dispatch 2024-03-30T15:16:40.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:40 smithi072 bash[28946]: audit 2024-03-30T15:16:39.388947+0000 mon.a (mon.0) 2440 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-45"}]': finished 2024-03-30T15:16:40.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:40 smithi072 bash[28946]: audit 2024-03-30T15:16:39.389174+0000 mon.a (mon.0) 2441 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi072-64171-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:16:40.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:40 smithi072 bash[28946]: cluster 2024-03-30T15:16:39.396478+0000 mon.a (mon.0) 2442 : cluster 0 osdmap e341: 8 total, 8 up, 8 in 2024-03-30T15:16:40.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:40 smithi072 bash[28946]: audit 2024-03-30T15:16:39.399494+0000 mon.c (mon.2) 430 : audit 1 from='client.? 172.21.15.72:0/2818575339' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi072-64171-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi072-64171-61"}]: dispatch 2024-03-30T15:16:40.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:40 smithi072 bash[28946]: audit 2024-03-30T15:16:39.411766+0000 mon.a (mon.0) 2443 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi072-64171-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi072-64171-61"}]: dispatch 2024-03-30T15:16:40.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:40 smithi172 bash[23680]: audit 2024-03-30T15:16:39.388947+0000 mon.a (mon.0) 2440 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-45"}]': finished 2024-03-30T15:16:40.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:40 smithi172 bash[23680]: audit 2024-03-30T15:16:39.389174+0000 mon.a (mon.0) 2441 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi072-64171-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:16:40.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:40 smithi172 bash[23680]: cluster 2024-03-30T15:16:39.396478+0000 mon.a (mon.0) 2442 : cluster 0 osdmap e341: 8 total, 8 up, 8 in 2024-03-30T15:16:40.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:40 smithi172 bash[23680]: audit 2024-03-30T15:16:39.399494+0000 mon.c (mon.2) 430 : audit 1 from='client.? 172.21.15.72:0/2818575339' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi072-64171-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi072-64171-61"}]: dispatch 2024-03-30T15:16:40.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:40 smithi172 bash[23680]: audit 2024-03-30T15:16:39.411766+0000 mon.a (mon.0) 2443 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi072-64171-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi072-64171-61"}]: dispatch 2024-03-30T15:16:41.413 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:16:41 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:16:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:16:41.463 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:16:41 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:16:41.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:41 smithi172 bash[23680]: cluster 2024-03-30T15:16:40.024371+0000 mgr.y (mgr.14526) 363 : cluster 0 pgmap v516: 228 pgs: 228 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:16:41.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:41 smithi172 bash[23680]: cluster 2024-03-30T15:16:40.868361+0000 mon.a (mon.0) 2444 : cluster 0 osdmap e342: 8 total, 8 up, 8 in 2024-03-30T15:16:41.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:41 smithi172 bash[23680]: cluster 2024-03-30T15:16:41.275604+0000 mon.a (mon.0) 2445 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:16:41.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:41 smithi072 bash[28946]: cluster 2024-03-30T15:16:40.024371+0000 mgr.y (mgr.14526) 363 : cluster 0 pgmap v516: 228 pgs: 228 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:16:41.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:41 smithi072 bash[28946]: cluster 2024-03-30T15:16:40.868361+0000 mon.a (mon.0) 2444 : cluster 0 osdmap e342: 8 total, 8 up, 8 in 2024-03-30T15:16:41.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:41 smithi072 bash[28946]: cluster 2024-03-30T15:16:41.275604+0000 mon.a (mon.0) 2445 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:16:41.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:41 smithi072 bash[21573]: cluster 2024-03-30T15:16:40.024371+0000 mgr.y (mgr.14526) 363 : cluster 0 pgmap v516: 228 pgs: 228 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:16:41.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:41 smithi072 bash[21573]: cluster 2024-03-30T15:16:40.868361+0000 mon.a (mon.0) 2444 : cluster 0 osdmap e342: 8 total, 8 up, 8 in 2024-03-30T15:16:41.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:41 smithi072 bash[21573]: cluster 2024-03-30T15:16:41.275604+0000 mon.a (mon.0) 2445 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:16:42.713 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:42 smithi172 bash[23680]: audit 2024-03-30T15:16:41.198625+0000 mgr.y (mgr.14526) 364 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:16:42.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:42 smithi172 bash[23680]: audit 2024-03-30T15:16:41.427865+0000 mon.a (mon.0) 2446 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi072-64171-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi072-64171-61"}]': finished 2024-03-30T15:16:42.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:42 smithi172 bash[23680]: cluster 2024-03-30T15:16:41.435738+0000 mon.a (mon.0) 2447 : cluster 0 osdmap e343: 8 total, 8 up, 8 in 2024-03-30T15:16:42.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:42 smithi172 bash[23680]: audit 2024-03-30T15:16:41.447766+0000 mon.a (mon.0) 2448 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:16:42.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:42 smithi072 bash[21573]: audit 2024-03-30T15:16:41.198625+0000 mgr.y (mgr.14526) 364 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:16:42.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:42 smithi072 bash[21573]: audit 2024-03-30T15:16:41.427865+0000 mon.a (mon.0) 2446 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi072-64171-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi072-64171-61"}]': finished 2024-03-30T15:16:42.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:42 smithi072 bash[21573]: cluster 2024-03-30T15:16:41.435738+0000 mon.a (mon.0) 2447 : cluster 0 osdmap e343: 8 total, 8 up, 8 in 2024-03-30T15:16:42.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:42 smithi072 bash[21573]: audit 2024-03-30T15:16:41.447766+0000 mon.a (mon.0) 2448 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:16:42.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:42 smithi072 bash[28946]: audit 2024-03-30T15:16:41.198625+0000 mgr.y (mgr.14526) 364 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:16:42.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:42 smithi072 bash[28946]: audit 2024-03-30T15:16:41.427865+0000 mon.a (mon.0) 2446 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi072-64171-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi072-64171-61"}]': finished 2024-03-30T15:16:42.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:42 smithi072 bash[28946]: cluster 2024-03-30T15:16:41.435738+0000 mon.a (mon.0) 2447 : cluster 0 osdmap e343: 8 total, 8 up, 8 in 2024-03-30T15:16:42.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:42 smithi072 bash[28946]: audit 2024-03-30T15:16:41.447766+0000 mon.a (mon.0) 2448 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:16:43.713 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:43 smithi172 bash[23680]: cluster 2024-03-30T15:16:42.025209+0000 mgr.y (mgr.14526) 365 : cluster 0 pgmap v519: 236 pgs: 40 unknown, 196 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:16:43.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:43 smithi172 bash[23680]: audit 2024-03-30T15:16:42.437612+0000 mon.a (mon.0) 2449 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-47","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:16:43.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:43 smithi172 bash[23680]: cluster 2024-03-30T15:16:42.449394+0000 mon.a (mon.0) 2450 : cluster 0 osdmap e344: 8 total, 8 up, 8 in 2024-03-30T15:16:43.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:43 smithi172 bash[23680]: audit 2024-03-30T15:16:42.545879+0000 mon.a (mon.0) 2451 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:16:43.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:43 smithi072 bash[21573]: cluster 2024-03-30T15:16:42.025209+0000 mgr.y (mgr.14526) 365 : cluster 0 pgmap v519: 236 pgs: 40 unknown, 196 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:16:43.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:43 smithi072 bash[21573]: audit 2024-03-30T15:16:42.437612+0000 mon.a (mon.0) 2449 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-47","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:16:43.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:43 smithi072 bash[21573]: cluster 2024-03-30T15:16:42.449394+0000 mon.a (mon.0) 2450 : cluster 0 osdmap e344: 8 total, 8 up, 8 in 2024-03-30T15:16:43.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:43 smithi072 bash[21573]: audit 2024-03-30T15:16:42.545879+0000 mon.a (mon.0) 2451 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:16:43.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:43 smithi072 bash[28946]: cluster 2024-03-30T15:16:42.025209+0000 mgr.y (mgr.14526) 365 : cluster 0 pgmap v519: 236 pgs: 40 unknown, 196 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:16:43.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:43 smithi072 bash[28946]: audit 2024-03-30T15:16:42.437612+0000 mon.a (mon.0) 2449 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-47","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:16:43.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:43 smithi072 bash[28946]: cluster 2024-03-30T15:16:42.449394+0000 mon.a (mon.0) 2450 : cluster 0 osdmap e344: 8 total, 8 up, 8 in 2024-03-30T15:16:43.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:43 smithi072 bash[28946]: audit 2024-03-30T15:16:42.545879+0000 mon.a (mon.0) 2451 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:16:44.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:44 smithi072 bash[21573]: audit 2024-03-30T15:16:43.440220+0000 mon.a (mon.0) 2452 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-47", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:16:44.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:44 smithi072 bash[21573]: cluster 2024-03-30T15:16:43.447539+0000 mon.a (mon.0) 2453 : cluster 0 osdmap e345: 8 total, 8 up, 8 in 2024-03-30T15:16:44.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:44 smithi072 bash[21573]: audit 2024-03-30T15:16:43.450904+0000 mon.c (mon.2) 431 : audit 1 from='client.? 172.21.15.72:0/2818575339' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi072-64171-61"}]: dispatch 2024-03-30T15:16:44.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:44 smithi072 bash[21573]: audit 2024-03-30T15:16:43.452315+0000 mon.a (mon.0) 2454 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-47"}]: dispatch 2024-03-30T15:16:44.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:44 smithi072 bash[21573]: audit 2024-03-30T15:16:43.453956+0000 mon.a (mon.0) 2455 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi072-64171-61"}]: dispatch 2024-03-30T15:16:44.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:44 smithi072 bash[21573]: audit 2024-03-30T15:16:44.443148+0000 mon.a (mon.0) 2456 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-47"}]': finished 2024-03-30T15:16:44.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:44 smithi072 bash[28946]: audit 2024-03-30T15:16:43.440220+0000 mon.a (mon.0) 2452 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-47", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:16:44.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:44 smithi072 bash[28946]: cluster 2024-03-30T15:16:43.447539+0000 mon.a (mon.0) 2453 : cluster 0 osdmap e345: 8 total, 8 up, 8 in 2024-03-30T15:16:44.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:44 smithi072 bash[28946]: audit 2024-03-30T15:16:43.450904+0000 mon.c (mon.2) 431 : audit 1 from='client.? 172.21.15.72:0/2818575339' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi072-64171-61"}]: dispatch 2024-03-30T15:16:44.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:44 smithi072 bash[28946]: audit 2024-03-30T15:16:43.452315+0000 mon.a (mon.0) 2454 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-47"}]: dispatch 2024-03-30T15:16:44.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:44 smithi072 bash[28946]: audit 2024-03-30T15:16:43.453956+0000 mon.a (mon.0) 2455 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi072-64171-61"}]: dispatch 2024-03-30T15:16:44.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:44 smithi072 bash[28946]: audit 2024-03-30T15:16:44.443148+0000 mon.a (mon.0) 2456 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-47"}]': finished 2024-03-30T15:16:44.963 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:44 smithi172 bash[23680]: audit 2024-03-30T15:16:43.440220+0000 mon.a (mon.0) 2452 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-47", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:16:44.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:44 smithi172 bash[23680]: cluster 2024-03-30T15:16:43.447539+0000 mon.a (mon.0) 2453 : cluster 0 osdmap e345: 8 total, 8 up, 8 in 2024-03-30T15:16:44.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:44 smithi172 bash[23680]: audit 2024-03-30T15:16:43.450904+0000 mon.c (mon.2) 431 : audit 1 from='client.? 172.21.15.72:0/2818575339' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi072-64171-61"}]: dispatch 2024-03-30T15:16:44.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:44 smithi172 bash[23680]: audit 2024-03-30T15:16:43.452315+0000 mon.a (mon.0) 2454 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-47"}]: dispatch 2024-03-30T15:16:44.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:44 smithi172 bash[23680]: audit 2024-03-30T15:16:43.453956+0000 mon.a (mon.0) 2455 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi072-64171-61"}]: dispatch 2024-03-30T15:16:44.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:44 smithi172 bash[23680]: audit 2024-03-30T15:16:44.443148+0000 mon.a (mon.0) 2456 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-47"}]': finished 2024-03-30T15:16:45.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:45 smithi072 bash[21573]: cluster 2024-03-30T15:16:44.025960+0000 mgr.y (mgr.14526) 366 : cluster 0 pgmap v522: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:16:45.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:45 smithi072 bash[21573]: audit 2024-03-30T15:16:44.443314+0000 mon.a (mon.0) 2457 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi072-64171-61"}]': finished 2024-03-30T15:16:45.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:45 smithi072 bash[21573]: audit 2024-03-30T15:16:44.453090+0000 mon.c (mon.2) 432 : audit 1 from='client.? 172.21.15.72:0/2818575339' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi072-64171-61"}]: dispatch 2024-03-30T15:16:45.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:45 smithi072 bash[21573]: cluster 2024-03-30T15:16:44.455807+0000 mon.a (mon.0) 2458 : cluster 0 osdmap e346: 8 total, 8 up, 8 in 2024-03-30T15:16:45.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:45 smithi072 bash[21573]: audit 2024-03-30T15:16:44.459349+0000 mon.a (mon.0) 2459 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-47", "mode": "writeback"}]: dispatch 2024-03-30T15:16:45.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:45 smithi072 bash[21573]: audit 2024-03-30T15:16:44.466284+0000 mon.a (mon.0) 2460 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi072-64171-61"}]: dispatch 2024-03-30T15:16:45.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:45 smithi072 bash[21573]: cluster 2024-03-30T15:16:45.444314+0000 mon.a (mon.0) 2461 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:16:45.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:45 smithi072 bash[21573]: audit 2024-03-30T15:16:45.448666+0000 mon.a (mon.0) 2462 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-47", "mode": "writeback"}]': finished 2024-03-30T15:16:45.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:45 smithi072 bash[21573]: audit 2024-03-30T15:16:45.448820+0000 mon.a (mon.0) 2463 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi072-64171-61"}]': finished 2024-03-30T15:16:45.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:45 smithi072 bash[21573]: cluster 2024-03-30T15:16:45.458473+0000 mon.a (mon.0) 2464 : cluster 0 osdmap e347: 8 total, 8 up, 8 in 2024-03-30T15:16:45.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:45 smithi072 bash[21573]: audit 2024-03-30T15:16:45.460934+0000 mon.a (mon.0) 2465 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-47","var": "hit_set_count","val": "2"}]: dispatch 2024-03-30T15:16:45.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:45 smithi072 bash[28946]: cluster 2024-03-30T15:16:44.025960+0000 mgr.y (mgr.14526) 366 : cluster 0 pgmap v522: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:16:45.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:45 smithi072 bash[28946]: audit 2024-03-30T15:16:44.443314+0000 mon.a (mon.0) 2457 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi072-64171-61"}]': finished 2024-03-30T15:16:45.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:45 smithi072 bash[28946]: audit 2024-03-30T15:16:44.453090+0000 mon.c (mon.2) 432 : audit 1 from='client.? 172.21.15.72:0/2818575339' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi072-64171-61"}]: dispatch 2024-03-30T15:16:45.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:45 smithi072 bash[28946]: cluster 2024-03-30T15:16:44.455807+0000 mon.a (mon.0) 2458 : cluster 0 osdmap e346: 8 total, 8 up, 8 in 2024-03-30T15:16:45.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:45 smithi072 bash[28946]: audit 2024-03-30T15:16:44.459349+0000 mon.a (mon.0) 2459 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-47", "mode": "writeback"}]: dispatch 2024-03-30T15:16:45.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:45 smithi072 bash[28946]: audit 2024-03-30T15:16:44.466284+0000 mon.a (mon.0) 2460 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi072-64171-61"}]: dispatch 2024-03-30T15:16:45.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:45 smithi072 bash[28946]: cluster 2024-03-30T15:16:45.444314+0000 mon.a (mon.0) 2461 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:16:45.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:45 smithi072 bash[28946]: audit 2024-03-30T15:16:45.448666+0000 mon.a (mon.0) 2462 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-47", "mode": "writeback"}]': finished 2024-03-30T15:16:45.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:45 smithi072 bash[28946]: audit 2024-03-30T15:16:45.448820+0000 mon.a (mon.0) 2463 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi072-64171-61"}]': finished 2024-03-30T15:16:45.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:45 smithi072 bash[28946]: cluster 2024-03-30T15:16:45.458473+0000 mon.a (mon.0) 2464 : cluster 0 osdmap e347: 8 total, 8 up, 8 in 2024-03-30T15:16:45.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:45 smithi072 bash[28946]: audit 2024-03-30T15:16:45.460934+0000 mon.a (mon.0) 2465 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-47","var": "hit_set_count","val": "2"}]: dispatch 2024-03-30T15:16:45.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:45 smithi172 bash[23680]: cluster 2024-03-30T15:16:44.025960+0000 mgr.y (mgr.14526) 366 : cluster 0 pgmap v522: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:16:45.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:45 smithi172 bash[23680]: audit 2024-03-30T15:16:44.443314+0000 mon.a (mon.0) 2457 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi072-64171-61"}]': finished 2024-03-30T15:16:45.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:45 smithi172 bash[23680]: audit 2024-03-30T15:16:44.453090+0000 mon.c (mon.2) 432 : audit 1 from='client.? 172.21.15.72:0/2818575339' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi072-64171-61"}]: dispatch 2024-03-30T15:16:45.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:45 smithi172 bash[23680]: cluster 2024-03-30T15:16:44.455807+0000 mon.a (mon.0) 2458 : cluster 0 osdmap e346: 8 total, 8 up, 8 in 2024-03-30T15:16:45.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:45 smithi172 bash[23680]: audit 2024-03-30T15:16:44.459349+0000 mon.a (mon.0) 2459 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-47", "mode": "writeback"}]: dispatch 2024-03-30T15:16:45.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:45 smithi172 bash[23680]: audit 2024-03-30T15:16:44.466284+0000 mon.a (mon.0) 2460 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi072-64171-61"}]: dispatch 2024-03-30T15:16:45.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:45 smithi172 bash[23680]: cluster 2024-03-30T15:16:45.444314+0000 mon.a (mon.0) 2461 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:16:45.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:45 smithi172 bash[23680]: audit 2024-03-30T15:16:45.448666+0000 mon.a (mon.0) 2462 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-47", "mode": "writeback"}]': finished 2024-03-30T15:16:45.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:45 smithi172 bash[23680]: audit 2024-03-30T15:16:45.448820+0000 mon.a (mon.0) 2463 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi072-64171-61"}]': finished 2024-03-30T15:16:45.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:45 smithi172 bash[23680]: cluster 2024-03-30T15:16:45.458473+0000 mon.a (mon.0) 2464 : cluster 0 osdmap e347: 8 total, 8 up, 8 in 2024-03-30T15:16:45.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:45 smithi172 bash[23680]: audit 2024-03-30T15:16:45.460934+0000 mon.a (mon.0) 2465 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-47","var": "hit_set_count","val": "2"}]: dispatch 2024-03-30T15:16:46.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:46 smithi072 bash[21573]: audit 2024-03-30T15:16:45.498667+0000 mon.a (mon.0) 2466 : audit 1 from='client.? 172.21.15.72:0/2523258635' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi072-64171-62"}]: dispatch 2024-03-30T15:16:46.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:46 smithi072 bash[21573]: audit 2024-03-30T15:16:45.499709+0000 mon.a (mon.0) 2467 : audit 1 from='client.? 172.21.15.72:0/2523258635' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi072-64171-62"}]: dispatch 2024-03-30T15:16:46.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:46 smithi072 bash[21573]: audit 2024-03-30T15:16:45.500142+0000 mon.a (mon.0) 2468 : audit 1 from='client.? 172.21.15.72:0/2523258635' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi072-64171-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:16:46.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:46 smithi072 bash[21573]: audit 2024-03-30T15:16:46.451283+0000 mon.a (mon.0) 2469 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-47","var": "hit_set_count","val": "2"}]': finished 2024-03-30T15:16:46.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:46 smithi072 bash[21573]: audit 2024-03-30T15:16:46.451527+0000 mon.a (mon.0) 2470 : audit 1 from='client.? 172.21.15.72:0/2523258635' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi072-64171-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:16:46.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:46 smithi072 bash[21573]: cluster 2024-03-30T15:16:46.460186+0000 mon.a (mon.0) 2471 : cluster 0 osdmap e348: 8 total, 8 up, 8 in 2024-03-30T15:16:46.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:46 smithi072 bash[21573]: audit 2024-03-30T15:16:46.461055+0000 mon.a (mon.0) 2472 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-47","var": "hit_set_period","val": "600"}]: dispatch 2024-03-30T15:16:46.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:46 smithi072 bash[21573]: audit 2024-03-30T15:16:46.461330+0000 mon.a (mon.0) 2473 : audit 1 from='client.? 172.21.15.72:0/2523258635' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi072-64171-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi072-64171-62"}]: dispatch 2024-03-30T15:16:46.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:46 smithi072 bash[28946]: audit 2024-03-30T15:16:45.498667+0000 mon.a (mon.0) 2466 : audit 1 from='client.? 172.21.15.72:0/2523258635' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi072-64171-62"}]: dispatch 2024-03-30T15:16:46.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:46 smithi072 bash[28946]: audit 2024-03-30T15:16:45.499709+0000 mon.a (mon.0) 2467 : audit 1 from='client.? 172.21.15.72:0/2523258635' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi072-64171-62"}]: dispatch 2024-03-30T15:16:46.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:46 smithi072 bash[28946]: audit 2024-03-30T15:16:45.500142+0000 mon.a (mon.0) 2468 : audit 1 from='client.? 172.21.15.72:0/2523258635' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi072-64171-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:16:46.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:46 smithi072 bash[28946]: audit 2024-03-30T15:16:46.451283+0000 mon.a (mon.0) 2469 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-47","var": "hit_set_count","val": "2"}]': finished 2024-03-30T15:16:46.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:46 smithi072 bash[28946]: audit 2024-03-30T15:16:46.451527+0000 mon.a (mon.0) 2470 : audit 1 from='client.? 172.21.15.72:0/2523258635' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi072-64171-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:16:46.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:46 smithi072 bash[28946]: cluster 2024-03-30T15:16:46.460186+0000 mon.a (mon.0) 2471 : cluster 0 osdmap e348: 8 total, 8 up, 8 in 2024-03-30T15:16:46.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:46 smithi072 bash[28946]: audit 2024-03-30T15:16:46.461055+0000 mon.a (mon.0) 2472 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-47","var": "hit_set_period","val": "600"}]: dispatch 2024-03-30T15:16:46.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:46 smithi072 bash[28946]: audit 2024-03-30T15:16:46.461330+0000 mon.a (mon.0) 2473 : audit 1 from='client.? 172.21.15.72:0/2523258635' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi072-64171-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi072-64171-62"}]: dispatch 2024-03-30T15:16:46.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:46 smithi172 bash[23680]: audit 2024-03-30T15:16:45.498667+0000 mon.a (mon.0) 2466 : audit 1 from='client.? 172.21.15.72:0/2523258635' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi072-64171-62"}]: dispatch 2024-03-30T15:16:46.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:46 smithi172 bash[23680]: audit 2024-03-30T15:16:45.499709+0000 mon.a (mon.0) 2467 : audit 1 from='client.? 172.21.15.72:0/2523258635' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi072-64171-62"}]: dispatch 2024-03-30T15:16:46.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:46 smithi172 bash[23680]: audit 2024-03-30T15:16:45.500142+0000 mon.a (mon.0) 2468 : audit 1 from='client.? 172.21.15.72:0/2523258635' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi072-64171-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:16:46.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:46 smithi172 bash[23680]: audit 2024-03-30T15:16:46.451283+0000 mon.a (mon.0) 2469 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-47","var": "hit_set_count","val": "2"}]': finished 2024-03-30T15:16:46.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:46 smithi172 bash[23680]: audit 2024-03-30T15:16:46.451527+0000 mon.a (mon.0) 2470 : audit 1 from='client.? 172.21.15.72:0/2523258635' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi072-64171-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:16:46.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:46 smithi172 bash[23680]: cluster 2024-03-30T15:16:46.460186+0000 mon.a (mon.0) 2471 : cluster 0 osdmap e348: 8 total, 8 up, 8 in 2024-03-30T15:16:46.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:46 smithi172 bash[23680]: audit 2024-03-30T15:16:46.461055+0000 mon.a (mon.0) 2472 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-47","var": "hit_set_period","val": "600"}]: dispatch 2024-03-30T15:16:46.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:46 smithi172 bash[23680]: audit 2024-03-30T15:16:46.461330+0000 mon.a (mon.0) 2473 : audit 1 from='client.? 172.21.15.72:0/2523258635' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi072-64171-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi072-64171-62"}]: dispatch 2024-03-30T15:16:48.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:47 smithi072 bash[28946]: cluster 2024-03-30T15:16:46.028109+0000 mgr.y (mgr.14526) 367 : cluster 0 pgmap v525: 228 pgs: 228 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-03-30T15:16:48.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:47 smithi072 bash[28946]: audit 2024-03-30T15:16:47.454642+0000 mon.a (mon.0) 2474 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-47","var": "hit_set_period","val": "600"}]': finished 2024-03-30T15:16:48.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:47 smithi072 bash[21573]: cluster 2024-03-30T15:16:46.028109+0000 mgr.y (mgr.14526) 367 : cluster 0 pgmap v525: 228 pgs: 228 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-03-30T15:16:48.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:47 smithi072 bash[21573]: audit 2024-03-30T15:16:47.454642+0000 mon.a (mon.0) 2474 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-47","var": "hit_set_period","val": "600"}]': finished 2024-03-30T15:16:48.213 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:47 smithi172 bash[23680]: cluster 2024-03-30T15:16:46.028109+0000 mgr.y (mgr.14526) 367 : cluster 0 pgmap v525: 228 pgs: 228 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-03-30T15:16:48.213 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:47 smithi172 bash[23680]: audit 2024-03-30T15:16:47.454642+0000 mon.a (mon.0) 2474 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-47","var": "hit_set_period","val": "600"}]': finished 2024-03-30T15:16:49.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:48 smithi072 bash[21573]: cluster 2024-03-30T15:16:47.911984+0000 mon.a (mon.0) 2475 : cluster 0 osdmap e349: 8 total, 8 up, 8 in 2024-03-30T15:16:49.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:48 smithi072 bash[21573]: audit 2024-03-30T15:16:47.913491+0000 mon.a (mon.0) 2476 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-47","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-30T15:16:49.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:48 smithi072 bash[21573]: cluster 2024-03-30T15:16:48.028887+0000 mgr.y (mgr.14526) 368 : cluster 0 pgmap v528: 228 pgs: 228 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-03-30T15:16:49.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:48 smithi072 bash[21573]: cluster 2024-03-30T15:16:48.455494+0000 mon.a (mon.0) 2477 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:16:49.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:48 smithi072 bash[21573]: audit 2024-03-30T15:16:48.458203+0000 mon.a (mon.0) 2478 : audit 1 from='client.? 172.21.15.72:0/2523258635' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi072-64171-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi072-64171-62"}]': finished 2024-03-30T15:16:49.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:48 smithi072 bash[21573]: audit 2024-03-30T15:16:48.458442+0000 mon.a (mon.0) 2479 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-47","var": "hit_set_type","val": "bloom"}]': finished 2024-03-30T15:16:49.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:48 smithi072 bash[21573]: cluster 2024-03-30T15:16:48.469875+0000 mon.a (mon.0) 2480 : cluster 0 osdmap e350: 8 total, 8 up, 8 in 2024-03-30T15:16:49.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:48 smithi072 bash[21573]: audit 2024-03-30T15:16:48.476710+0000 mon.a (mon.0) 2481 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-03-30T15:16:49.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:48 smithi072 bash[28946]: cluster 2024-03-30T15:16:47.911984+0000 mon.a (mon.0) 2475 : cluster 0 osdmap e349: 8 total, 8 up, 8 in 2024-03-30T15:16:49.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:48 smithi072 bash[28946]: audit 2024-03-30T15:16:47.913491+0000 mon.a (mon.0) 2476 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-47","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-30T15:16:49.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:48 smithi072 bash[28946]: cluster 2024-03-30T15:16:48.028887+0000 mgr.y (mgr.14526) 368 : cluster 0 pgmap v528: 228 pgs: 228 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-03-30T15:16:49.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:48 smithi072 bash[28946]: cluster 2024-03-30T15:16:48.455494+0000 mon.a (mon.0) 2477 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:16:49.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:48 smithi072 bash[28946]: audit 2024-03-30T15:16:48.458203+0000 mon.a (mon.0) 2478 : audit 1 from='client.? 172.21.15.72:0/2523258635' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi072-64171-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi072-64171-62"}]': finished 2024-03-30T15:16:49.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:48 smithi072 bash[28946]: audit 2024-03-30T15:16:48.458442+0000 mon.a (mon.0) 2479 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-47","var": "hit_set_type","val": "bloom"}]': finished 2024-03-30T15:16:49.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:48 smithi072 bash[28946]: cluster 2024-03-30T15:16:48.469875+0000 mon.a (mon.0) 2480 : cluster 0 osdmap e350: 8 total, 8 up, 8 in 2024-03-30T15:16:49.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:48 smithi072 bash[28946]: audit 2024-03-30T15:16:48.476710+0000 mon.a (mon.0) 2481 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-03-30T15:16:49.213 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:48 smithi172 bash[23680]: cluster 2024-03-30T15:16:47.911984+0000 mon.a (mon.0) 2475 : cluster 0 osdmap e349: 8 total, 8 up, 8 in 2024-03-30T15:16:49.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:48 smithi172 bash[23680]: audit 2024-03-30T15:16:47.913491+0000 mon.a (mon.0) 2476 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-47","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-30T15:16:49.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:48 smithi172 bash[23680]: cluster 2024-03-30T15:16:48.028887+0000 mgr.y (mgr.14526) 368 : cluster 0 pgmap v528: 228 pgs: 228 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-03-30T15:16:49.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:48 smithi172 bash[23680]: cluster 2024-03-30T15:16:48.455494+0000 mon.a (mon.0) 2477 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:16:49.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:48 smithi172 bash[23680]: audit 2024-03-30T15:16:48.458203+0000 mon.a (mon.0) 2478 : audit 1 from='client.? 172.21.15.72:0/2523258635' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi072-64171-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi072-64171-62"}]': finished 2024-03-30T15:16:49.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:48 smithi172 bash[23680]: audit 2024-03-30T15:16:48.458442+0000 mon.a (mon.0) 2479 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-47","var": "hit_set_type","val": "bloom"}]': finished 2024-03-30T15:16:49.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:48 smithi172 bash[23680]: cluster 2024-03-30T15:16:48.469875+0000 mon.a (mon.0) 2480 : cluster 0 osdmap e350: 8 total, 8 up, 8 in 2024-03-30T15:16:49.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:48 smithi172 bash[23680]: audit 2024-03-30T15:16:48.476710+0000 mon.a (mon.0) 2481 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-03-30T15:16:50.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:50 smithi072 bash[21573]: audit 2024-03-30T15:16:49.460828+0000 mon.a (mon.0) 2482 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-47","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-03-30T15:16:50.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:50 smithi072 bash[21573]: cluster 2024-03-30T15:16:49.469095+0000 mon.a (mon.0) 2483 : cluster 0 osdmap e351: 8 total, 8 up, 8 in 2024-03-30T15:16:50.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:50 smithi072 bash[21573]: audit 2024-03-30T15:16:49.472149+0000 mon.a (mon.0) 2484 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-03-30T15:16:50.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:50 smithi072 bash[28946]: audit 2024-03-30T15:16:49.460828+0000 mon.a (mon.0) 2482 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-47","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-03-30T15:16:50.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:50 smithi072 bash[28946]: cluster 2024-03-30T15:16:49.469095+0000 mon.a (mon.0) 2483 : cluster 0 osdmap e351: 8 total, 8 up, 8 in 2024-03-30T15:16:50.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:50 smithi072 bash[28946]: audit 2024-03-30T15:16:49.472149+0000 mon.a (mon.0) 2484 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-03-30T15:16:50.963 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:50 smithi172 bash[23680]: audit 2024-03-30T15:16:49.460828+0000 mon.a (mon.0) 2482 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-47","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-03-30T15:16:50.963 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:50 smithi172 bash[23680]: cluster 2024-03-30T15:16:49.469095+0000 mon.a (mon.0) 2483 : cluster 0 osdmap e351: 8 total, 8 up, 8 in 2024-03-30T15:16:50.963 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:50 smithi172 bash[23680]: audit 2024-03-30T15:16:49.472149+0000 mon.a (mon.0) 2484 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-03-30T15:16:51.417 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:16:51 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:16:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:16:51.463 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:16:51 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:16:51.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:51 smithi072 bash[21573]: cluster 2024-03-30T15:16:50.029689+0000 mgr.y (mgr.14526) 369 : cluster 0 pgmap v531: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:16:51.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:51 smithi072 bash[21573]: cluster 2024-03-30T15:16:50.460820+0000 mon.a (mon.0) 2485 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:16:51.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:51 smithi072 bash[21573]: audit 2024-03-30T15:16:50.470615+0000 mon.a (mon.0) 2486 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-47","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-03-30T15:16:51.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:51 smithi072 bash[21573]: cluster 2024-03-30T15:16:50.484628+0000 mon.a (mon.0) 2487 : cluster 0 osdmap e352: 8 total, 8 up, 8 in 2024-03-30T15:16:51.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:51 smithi072 bash[21573]: audit 2024-03-30T15:16:50.486419+0000 mon.a (mon.0) 2488 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-03-30T15:16:51.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:51 smithi072 bash[21573]: audit 2024-03-30T15:16:50.488025+0000 mon.a (mon.0) 2489 : audit 1 from='client.? 172.21.15.72:0/2523258635' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi072-64171-62"}]: dispatch 2024-03-30T15:16:51.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:51 smithi072 bash[21573]: audit 2024-03-30T15:16:51.114835+0000 mon.c (mon.2) 433 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:16:51.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:51 smithi072 bash[28946]: cluster 2024-03-30T15:16:50.029689+0000 mgr.y (mgr.14526) 369 : cluster 0 pgmap v531: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:16:51.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:51 smithi072 bash[28946]: cluster 2024-03-30T15:16:50.460820+0000 mon.a (mon.0) 2485 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:16:51.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:51 smithi072 bash[28946]: audit 2024-03-30T15:16:50.470615+0000 mon.a (mon.0) 2486 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-47","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-03-30T15:16:51.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:51 smithi072 bash[28946]: cluster 2024-03-30T15:16:50.484628+0000 mon.a (mon.0) 2487 : cluster 0 osdmap e352: 8 total, 8 up, 8 in 2024-03-30T15:16:51.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:51 smithi072 bash[28946]: audit 2024-03-30T15:16:50.486419+0000 mon.a (mon.0) 2488 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-03-30T15:16:51.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:51 smithi072 bash[28946]: audit 2024-03-30T15:16:50.488025+0000 mon.a (mon.0) 2489 : audit 1 from='client.? 172.21.15.72:0/2523258635' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi072-64171-62"}]: dispatch 2024-03-30T15:16:51.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:51 smithi072 bash[28946]: audit 2024-03-30T15:16:51.114835+0000 mon.c (mon.2) 433 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:16:51.963 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:51 smithi172 bash[23680]: cluster 2024-03-30T15:16:50.029689+0000 mgr.y (mgr.14526) 369 : cluster 0 pgmap v531: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:16:51.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:51 smithi172 bash[23680]: cluster 2024-03-30T15:16:50.460820+0000 mon.a (mon.0) 2485 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:16:51.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:51 smithi172 bash[23680]: audit 2024-03-30T15:16:50.470615+0000 mon.a (mon.0) 2486 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-47","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-03-30T15:16:51.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:51 smithi172 bash[23680]: cluster 2024-03-30T15:16:50.484628+0000 mon.a (mon.0) 2487 : cluster 0 osdmap e352: 8 total, 8 up, 8 in 2024-03-30T15:16:51.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:51 smithi172 bash[23680]: audit 2024-03-30T15:16:50.486419+0000 mon.a (mon.0) 2488 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-03-30T15:16:51.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:51 smithi172 bash[23680]: audit 2024-03-30T15:16:50.488025+0000 mon.a (mon.0) 2489 : audit 1 from='client.? 172.21.15.72:0/2523258635' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi072-64171-62"}]: dispatch 2024-03-30T15:16:51.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:51 smithi172 bash[23680]: audit 2024-03-30T15:16:51.114835+0000 mon.c (mon.2) 433 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:16:52.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:52 smithi072 bash[21573]: audit 2024-03-30T15:16:51.207136+0000 mgr.y (mgr.14526) 370 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:16:52.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:52 smithi072 bash[21573]: audit 2024-03-30T15:16:51.473089+0000 mon.a (mon.0) 2490 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-47","var": "hit_set_search_last_n","val": "1"}]': finished 2024-03-30T15:16:52.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:52 smithi072 bash[21573]: audit 2024-03-30T15:16:51.473460+0000 mon.a (mon.0) 2491 : audit 1 from='client.? 172.21.15.72:0/2523258635' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi072-64171-62"}]': finished 2024-03-30T15:16:52.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:52 smithi072 bash[21573]: cluster 2024-03-30T15:16:51.481517+0000 mon.a (mon.0) 2492 : cluster 0 osdmap e353: 8 total, 8 up, 8 in 2024-03-30T15:16:52.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:52 smithi072 bash[21573]: audit 2024-03-30T15:16:51.483578+0000 mon.a (mon.0) 2493 : audit 1 from='client.? 172.21.15.72:0/2523258635' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi072-64171-62"}]: dispatch 2024-03-30T15:16:52.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:52 smithi072 bash[21573]: audit 2024-03-30T15:16:51.577932+0000 mon.a (mon.0) 2494 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:16:52.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:52 smithi072 bash[21573]: audit 2024-03-30T15:16:52.476479+0000 mon.a (mon.0) 2495 : audit 1 from='client.? 172.21.15.72:0/2523258635' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi072-64171-62"}]': finished 2024-03-30T15:16:52.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:52 smithi072 bash[21573]: audit 2024-03-30T15:16:52.476614+0000 mon.a (mon.0) 2496 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:16:52.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:52 smithi072 bash[21573]: cluster 2024-03-30T15:16:52.484139+0000 mon.a (mon.0) 2497 : cluster 0 osdmap e354: 8 total, 8 up, 8 in 2024-03-30T15:16:52.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:52 smithi072 bash[28946]: audit 2024-03-30T15:16:51.207136+0000 mgr.y (mgr.14526) 370 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:16:52.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:52 smithi072 bash[28946]: audit 2024-03-30T15:16:51.473089+0000 mon.a (mon.0) 2490 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-47","var": "hit_set_search_last_n","val": "1"}]': finished 2024-03-30T15:16:52.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:52 smithi072 bash[28946]: audit 2024-03-30T15:16:51.473460+0000 mon.a (mon.0) 2491 : audit 1 from='client.? 172.21.15.72:0/2523258635' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi072-64171-62"}]': finished 2024-03-30T15:16:52.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:52 smithi072 bash[28946]: cluster 2024-03-30T15:16:51.481517+0000 mon.a (mon.0) 2492 : cluster 0 osdmap e353: 8 total, 8 up, 8 in 2024-03-30T15:16:52.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:52 smithi072 bash[28946]: audit 2024-03-30T15:16:51.483578+0000 mon.a (mon.0) 2493 : audit 1 from='client.? 172.21.15.72:0/2523258635' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi072-64171-62"}]: dispatch 2024-03-30T15:16:52.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:52 smithi072 bash[28946]: audit 2024-03-30T15:16:51.577932+0000 mon.a (mon.0) 2494 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:16:52.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:52 smithi072 bash[28946]: audit 2024-03-30T15:16:52.476479+0000 mon.a (mon.0) 2495 : audit 1 from='client.? 172.21.15.72:0/2523258635' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi072-64171-62"}]': finished 2024-03-30T15:16:52.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:52 smithi072 bash[28946]: audit 2024-03-30T15:16:52.476614+0000 mon.a (mon.0) 2496 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:16:52.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:52 smithi072 bash[28946]: cluster 2024-03-30T15:16:52.484139+0000 mon.a (mon.0) 2497 : cluster 0 osdmap e354: 8 total, 8 up, 8 in 2024-03-30T15:16:52.963 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:52 smithi172 bash[23680]: audit 2024-03-30T15:16:51.207136+0000 mgr.y (mgr.14526) 370 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:16:52.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:52 smithi172 bash[23680]: audit 2024-03-30T15:16:51.473089+0000 mon.a (mon.0) 2490 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-47","var": "hit_set_search_last_n","val": "1"}]': finished 2024-03-30T15:16:52.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:52 smithi172 bash[23680]: audit 2024-03-30T15:16:51.473460+0000 mon.a (mon.0) 2491 : audit 1 from='client.? 172.21.15.72:0/2523258635' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi072-64171-62"}]': finished 2024-03-30T15:16:52.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:52 smithi172 bash[23680]: cluster 2024-03-30T15:16:51.481517+0000 mon.a (mon.0) 2492 : cluster 0 osdmap e353: 8 total, 8 up, 8 in 2024-03-30T15:16:52.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:52 smithi172 bash[23680]: audit 2024-03-30T15:16:51.483578+0000 mon.a (mon.0) 2493 : audit 1 from='client.? 172.21.15.72:0/2523258635' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi072-64171-62"}]: dispatch 2024-03-30T15:16:52.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:52 smithi172 bash[23680]: audit 2024-03-30T15:16:51.577932+0000 mon.a (mon.0) 2494 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:16:52.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:52 smithi172 bash[23680]: audit 2024-03-30T15:16:52.476479+0000 mon.a (mon.0) 2495 : audit 1 from='client.? 172.21.15.72:0/2523258635' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi072-64171-62"}]': finished 2024-03-30T15:16:52.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:52 smithi172 bash[23680]: audit 2024-03-30T15:16:52.476614+0000 mon.a (mon.0) 2496 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:16:52.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:52 smithi172 bash[23680]: cluster 2024-03-30T15:16:52.484139+0000 mon.a (mon.0) 2497 : cluster 0 osdmap e354: 8 total, 8 up, 8 in 2024-03-30T15:16:53.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:53 smithi072 bash[21573]: cluster 2024-03-30T15:16:52.030478+0000 mgr.y (mgr.14526) 371 : cluster 0 pgmap v534: 228 pgs: 228 active+clean; 8.4 MiB data, 654 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:16:53.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:53 smithi072 bash[21573]: audit 2024-03-30T15:16:52.489451+0000 mon.a (mon.0) 2498 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-47"}]: dispatch 2024-03-30T15:16:53.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:53 smithi072 bash[21573]: audit 2024-03-30T15:16:52.535587+0000 mon.a (mon.0) 2499 : audit 1 from='client.? 172.21.15.72:0/913402216' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi072-64171-63"}]: dispatch 2024-03-30T15:16:53.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:53 smithi072 bash[21573]: audit 2024-03-30T15:16:52.536699+0000 mon.a (mon.0) 2500 : audit 1 from='client.? 172.21.15.72:0/913402216' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi072-64171-63"}]: dispatch 2024-03-30T15:16:53.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:53 smithi072 bash[21573]: audit 2024-03-30T15:16:52.537143+0000 mon.a (mon.0) 2501 : audit 1 from='client.? 172.21.15.72:0/913402216' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi072-64171-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:16:53.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:53 smithi072 bash[21573]: audit 2024-03-30T15:16:53.479219+0000 mon.a (mon.0) 2502 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-47"}]': finished 2024-03-30T15:16:53.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:53 smithi072 bash[21573]: audit 2024-03-30T15:16:53.479443+0000 mon.a (mon.0) 2503 : audit 1 from='client.? 172.21.15.72:0/913402216' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi072-64171-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:16:53.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:53 smithi072 bash[21573]: cluster 2024-03-30T15:16:53.489378+0000 mon.a (mon.0) 2504 : cluster 0 osdmap e355: 8 total, 8 up, 8 in 2024-03-30T15:16:53.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:53 smithi072 bash[21573]: audit 2024-03-30T15:16:53.491866+0000 mon.a (mon.0) 2505 : audit 1 from='client.? 172.21.15.72:0/913402216' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi072-64171-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi072-64171-63"}]: dispatch 2024-03-30T15:16:53.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:53 smithi072 bash[28946]: cluster 2024-03-30T15:16:52.030478+0000 mgr.y (mgr.14526) 371 : cluster 0 pgmap v534: 228 pgs: 228 active+clean; 8.4 MiB data, 654 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:16:53.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:53 smithi072 bash[28946]: audit 2024-03-30T15:16:52.489451+0000 mon.a (mon.0) 2498 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-47"}]: dispatch 2024-03-30T15:16:53.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:53 smithi072 bash[28946]: audit 2024-03-30T15:16:52.535587+0000 mon.a (mon.0) 2499 : audit 1 from='client.? 172.21.15.72:0/913402216' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi072-64171-63"}]: dispatch 2024-03-30T15:16:53.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:53 smithi072 bash[28946]: audit 2024-03-30T15:16:52.536699+0000 mon.a (mon.0) 2500 : audit 1 from='client.? 172.21.15.72:0/913402216' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi072-64171-63"}]: dispatch 2024-03-30T15:16:53.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:53 smithi072 bash[28946]: audit 2024-03-30T15:16:52.537143+0000 mon.a (mon.0) 2501 : audit 1 from='client.? 172.21.15.72:0/913402216' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi072-64171-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:16:53.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:53 smithi072 bash[28946]: audit 2024-03-30T15:16:53.479219+0000 mon.a (mon.0) 2502 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-47"}]': finished 2024-03-30T15:16:53.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:53 smithi072 bash[28946]: audit 2024-03-30T15:16:53.479443+0000 mon.a (mon.0) 2503 : audit 1 from='client.? 172.21.15.72:0/913402216' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi072-64171-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:16:53.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:53 smithi072 bash[28946]: cluster 2024-03-30T15:16:53.489378+0000 mon.a (mon.0) 2504 : cluster 0 osdmap e355: 8 total, 8 up, 8 in 2024-03-30T15:16:53.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:53 smithi072 bash[28946]: audit 2024-03-30T15:16:53.491866+0000 mon.a (mon.0) 2505 : audit 1 from='client.? 172.21.15.72:0/913402216' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi072-64171-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi072-64171-63"}]: dispatch 2024-03-30T15:16:53.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:53 smithi172 bash[23680]: cluster 2024-03-30T15:16:52.030478+0000 mgr.y (mgr.14526) 371 : cluster 0 pgmap v534: 228 pgs: 228 active+clean; 8.4 MiB data, 654 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:16:53.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:53 smithi172 bash[23680]: audit 2024-03-30T15:16:52.489451+0000 mon.a (mon.0) 2498 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-47"}]: dispatch 2024-03-30T15:16:53.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:53 smithi172 bash[23680]: audit 2024-03-30T15:16:52.535587+0000 mon.a (mon.0) 2499 : audit 1 from='client.? 172.21.15.72:0/913402216' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi072-64171-63"}]: dispatch 2024-03-30T15:16:53.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:53 smithi172 bash[23680]: audit 2024-03-30T15:16:52.536699+0000 mon.a (mon.0) 2500 : audit 1 from='client.? 172.21.15.72:0/913402216' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi072-64171-63"}]: dispatch 2024-03-30T15:16:53.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:53 smithi172 bash[23680]: audit 2024-03-30T15:16:52.537143+0000 mon.a (mon.0) 2501 : audit 1 from='client.? 172.21.15.72:0/913402216' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi072-64171-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:16:53.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:53 smithi172 bash[23680]: audit 2024-03-30T15:16:53.479219+0000 mon.a (mon.0) 2502 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-47"}]': finished 2024-03-30T15:16:53.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:53 smithi172 bash[23680]: audit 2024-03-30T15:16:53.479443+0000 mon.a (mon.0) 2503 : audit 1 from='client.? 172.21.15.72:0/913402216' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi072-64171-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:16:53.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:53 smithi172 bash[23680]: cluster 2024-03-30T15:16:53.489378+0000 mon.a (mon.0) 2504 : cluster 0 osdmap e355: 8 total, 8 up, 8 in 2024-03-30T15:16:53.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:53 smithi172 bash[23680]: audit 2024-03-30T15:16:53.491866+0000 mon.a (mon.0) 2505 : audit 1 from='client.? 172.21.15.72:0/913402216' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi072-64171-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi072-64171-63"}]: dispatch 2024-03-30T15:16:55.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:55 smithi072 bash[21573]: audit 2024-03-30T15:16:53.563092+0000 mon.a (mon.0) 2506 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:16:55.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:55 smithi072 bash[21573]: audit 2024-03-30T15:16:53.563888+0000 mon.a (mon.0) 2507 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-47"}]: dispatch 2024-03-30T15:16:55.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:55 smithi072 bash[28946]: audit 2024-03-30T15:16:53.563092+0000 mon.a (mon.0) 2506 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:16:55.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:55 smithi072 bash[28946]: audit 2024-03-30T15:16:53.563888+0000 mon.a (mon.0) 2507 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-47"}]: dispatch 2024-03-30T15:16:55.713 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:55 smithi172 bash[23680]: audit 2024-03-30T15:16:53.563092+0000 mon.a (mon.0) 2506 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:16:55.713 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:55 smithi172 bash[23680]: audit 2024-03-30T15:16:53.563888+0000 mon.a (mon.0) 2507 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-47"}]: dispatch 2024-03-30T15:16:56.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:56 smithi072 bash[28946]: cluster 2024-03-30T15:16:54.031232+0000 mgr.y (mgr.14526) 372 : cluster 0 pgmap v537: 228 pgs: 228 active+clean; 8.4 MiB data, 654 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:16:56.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:56 smithi072 bash[28946]: cluster 2024-03-30T15:16:54.947296+0000 mon.a (mon.0) 2508 : cluster 0 osdmap e356: 8 total, 8 up, 8 in 2024-03-30T15:16:56.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:56 smithi072 bash[28946]: audit 2024-03-30T15:16:55.488320+0000 mon.a (mon.0) 2509 : audit 1 from='client.? 172.21.15.72:0/913402216' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi072-64171-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi072-64171-63"}]': finished 2024-03-30T15:16:56.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:56 smithi072 bash[28946]: cluster 2024-03-30T15:16:55.500343+0000 mon.a (mon.0) 2510 : cluster 0 osdmap e357: 8 total, 8 up, 8 in 2024-03-30T15:16:56.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:56 smithi072 bash[28946]: audit 2024-03-30T15:16:55.516197+0000 mon.a (mon.0) 2511 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:16:56.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:56 smithi072 bash[28946]: cluster 2024-03-30T15:16:56.279880+0000 mon.a (mon.0) 2512 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:16:56.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:56 smithi072 bash[21573]: cluster 2024-03-30T15:16:54.031232+0000 mgr.y (mgr.14526) 372 : cluster 0 pgmap v537: 228 pgs: 228 active+clean; 8.4 MiB data, 654 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:16:56.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:56 smithi072 bash[21573]: cluster 2024-03-30T15:16:54.947296+0000 mon.a (mon.0) 2508 : cluster 0 osdmap e356: 8 total, 8 up, 8 in 2024-03-30T15:16:56.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:56 smithi072 bash[21573]: audit 2024-03-30T15:16:55.488320+0000 mon.a (mon.0) 2509 : audit 1 from='client.? 172.21.15.72:0/913402216' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi072-64171-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi072-64171-63"}]': finished 2024-03-30T15:16:56.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:56 smithi072 bash[21573]: cluster 2024-03-30T15:16:55.500343+0000 mon.a (mon.0) 2510 : cluster 0 osdmap e357: 8 total, 8 up, 8 in 2024-03-30T15:16:56.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:56 smithi072 bash[21573]: audit 2024-03-30T15:16:55.516197+0000 mon.a (mon.0) 2511 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:16:56.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:56 smithi072 bash[21573]: cluster 2024-03-30T15:16:56.279880+0000 mon.a (mon.0) 2512 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:16:56.713 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:56 smithi172 bash[23680]: cluster 2024-03-30T15:16:54.031232+0000 mgr.y (mgr.14526) 372 : cluster 0 pgmap v537: 228 pgs: 228 active+clean; 8.4 MiB data, 654 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:16:56.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:56 smithi172 bash[23680]: cluster 2024-03-30T15:16:54.947296+0000 mon.a (mon.0) 2508 : cluster 0 osdmap e356: 8 total, 8 up, 8 in 2024-03-30T15:16:56.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:56 smithi172 bash[23680]: audit 2024-03-30T15:16:55.488320+0000 mon.a (mon.0) 2509 : audit 1 from='client.? 172.21.15.72:0/913402216' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi072-64171-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi072-64171-63"}]': finished 2024-03-30T15:16:56.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:56 smithi172 bash[23680]: cluster 2024-03-30T15:16:55.500343+0000 mon.a (mon.0) 2510 : cluster 0 osdmap e357: 8 total, 8 up, 8 in 2024-03-30T15:16:56.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:56 smithi172 bash[23680]: audit 2024-03-30T15:16:55.516197+0000 mon.a (mon.0) 2511 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:16:56.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:56 smithi172 bash[23680]: cluster 2024-03-30T15:16:56.279880+0000 mon.a (mon.0) 2512 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:16:57.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:57 smithi072 bash[21573]: cluster 2024-03-30T15:16:56.033477+0000 mgr.y (mgr.14526) 373 : cluster 0 pgmap v540: 236 pgs: 40 creating+peering, 196 active+clean; 8.4 MiB data, 655 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-03-30T15:16:57.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:57 smithi072 bash[21573]: audit 2024-03-30T15:16:56.500475+0000 mon.a (mon.0) 2513 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-49","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:16:57.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:57 smithi072 bash[21573]: cluster 2024-03-30T15:16:56.510692+0000 mon.a (mon.0) 2514 : cluster 0 osdmap e358: 8 total, 8 up, 8 in 2024-03-30T15:16:57.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:57 smithi072 bash[21573]: audit 2024-03-30T15:16:56.575422+0000 mon.a (mon.0) 2515 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:16:57.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:57 smithi072 bash[28946]: cluster 2024-03-30T15:16:56.033477+0000 mgr.y (mgr.14526) 373 : cluster 0 pgmap v540: 236 pgs: 40 creating+peering, 196 active+clean; 8.4 MiB data, 655 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-03-30T15:16:57.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:57 smithi072 bash[28946]: audit 2024-03-30T15:16:56.500475+0000 mon.a (mon.0) 2513 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-49","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:16:57.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:57 smithi072 bash[28946]: cluster 2024-03-30T15:16:56.510692+0000 mon.a (mon.0) 2514 : cluster 0 osdmap e358: 8 total, 8 up, 8 in 2024-03-30T15:16:57.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:57 smithi072 bash[28946]: audit 2024-03-30T15:16:56.575422+0000 mon.a (mon.0) 2515 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:16:57.963 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:57 smithi172 bash[23680]: cluster 2024-03-30T15:16:56.033477+0000 mgr.y (mgr.14526) 373 : cluster 0 pgmap v540: 236 pgs: 40 creating+peering, 196 active+clean; 8.4 MiB data, 655 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-03-30T15:16:57.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:57 smithi172 bash[23680]: audit 2024-03-30T15:16:56.500475+0000 mon.a (mon.0) 2513 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-49","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:16:57.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:57 smithi172 bash[23680]: cluster 2024-03-30T15:16:56.510692+0000 mon.a (mon.0) 2514 : cluster 0 osdmap e358: 8 total, 8 up, 8 in 2024-03-30T15:16:57.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:57 smithi172 bash[23680]: audit 2024-03-30T15:16:56.575422+0000 mon.a (mon.0) 2515 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:16:58.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:58 smithi072 bash[21573]: audit 2024-03-30T15:16:57.511132+0000 mon.a (mon.0) 2516 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-49", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:16:58.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:58 smithi072 bash[21573]: cluster 2024-03-30T15:16:57.517643+0000 mon.a (mon.0) 2517 : cluster 0 osdmap e359: 8 total, 8 up, 8 in 2024-03-30T15:16:58.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:58 smithi072 bash[21573]: audit 2024-03-30T15:16:57.519135+0000 mon.a (mon.0) 2518 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-49"}]: dispatch 2024-03-30T15:16:58.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:58 smithi072 bash[21573]: audit 2024-03-30T15:16:57.523269+0000 mon.a (mon.0) 2519 : audit 1 from='client.? 172.21.15.72:0/913402216' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi072-64171-63"}]: dispatch 2024-03-30T15:16:58.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:58 smithi072 bash[28946]: audit 2024-03-30T15:16:57.511132+0000 mon.a (mon.0) 2516 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-49", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:16:58.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:58 smithi072 bash[28946]: cluster 2024-03-30T15:16:57.517643+0000 mon.a (mon.0) 2517 : cluster 0 osdmap e359: 8 total, 8 up, 8 in 2024-03-30T15:16:58.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:58 smithi072 bash[28946]: audit 2024-03-30T15:16:57.519135+0000 mon.a (mon.0) 2518 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-49"}]: dispatch 2024-03-30T15:16:58.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:58 smithi072 bash[28946]: audit 2024-03-30T15:16:57.523269+0000 mon.a (mon.0) 2519 : audit 1 from='client.? 172.21.15.72:0/913402216' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi072-64171-63"}]: dispatch 2024-03-30T15:16:58.963 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:58 smithi172 bash[23680]: audit 2024-03-30T15:16:57.511132+0000 mon.a (mon.0) 2516 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-49", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:16:58.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:58 smithi172 bash[23680]: cluster 2024-03-30T15:16:57.517643+0000 mon.a (mon.0) 2517 : cluster 0 osdmap e359: 8 total, 8 up, 8 in 2024-03-30T15:16:58.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:58 smithi172 bash[23680]: audit 2024-03-30T15:16:57.519135+0000 mon.a (mon.0) 2518 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-49"}]: dispatch 2024-03-30T15:16:58.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:58 smithi172 bash[23680]: audit 2024-03-30T15:16:57.523269+0000 mon.a (mon.0) 2519 : audit 1 from='client.? 172.21.15.72:0/913402216' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi072-64171-63"}]: dispatch 2024-03-30T15:16:59.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:59 smithi072 bash[21573]: cluster 2024-03-30T15:16:58.034337+0000 mgr.y (mgr.14526) 374 : cluster 0 pgmap v543: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 655 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-03-30T15:16:59.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:59 smithi072 bash[21573]: audit 2024-03-30T15:16:58.524487+0000 mon.a (mon.0) 2520 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-49"}]': finished 2024-03-30T15:16:59.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:59 smithi072 bash[21573]: audit 2024-03-30T15:16:58.524732+0000 mon.a (mon.0) 2521 : audit 1 from='client.? 172.21.15.72:0/913402216' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi072-64171-63"}]': finished 2024-03-30T15:16:59.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:59 smithi072 bash[21573]: cluster 2024-03-30T15:16:58.535962+0000 mon.a (mon.0) 2522 : cluster 0 osdmap e360: 8 total, 8 up, 8 in 2024-03-30T15:16:59.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:59 smithi072 bash[21573]: audit 2024-03-30T15:16:58.538577+0000 mon.a (mon.0) 2523 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-49", "mode": "readproxy"}]: dispatch 2024-03-30T15:16:59.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:16:59 smithi072 bash[21573]: audit 2024-03-30T15:16:58.539194+0000 mon.a (mon.0) 2524 : audit 1 from='client.? 172.21.15.72:0/913402216' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi072-64171-63"}]: dispatch 2024-03-30T15:16:59.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:59 smithi072 bash[28946]: cluster 2024-03-30T15:16:58.034337+0000 mgr.y (mgr.14526) 374 : cluster 0 pgmap v543: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 655 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-03-30T15:16:59.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:59 smithi072 bash[28946]: audit 2024-03-30T15:16:58.524487+0000 mon.a (mon.0) 2520 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-49"}]': finished 2024-03-30T15:16:59.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:59 smithi072 bash[28946]: audit 2024-03-30T15:16:58.524732+0000 mon.a (mon.0) 2521 : audit 1 from='client.? 172.21.15.72:0/913402216' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi072-64171-63"}]': finished 2024-03-30T15:16:59.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:59 smithi072 bash[28946]: cluster 2024-03-30T15:16:58.535962+0000 mon.a (mon.0) 2522 : cluster 0 osdmap e360: 8 total, 8 up, 8 in 2024-03-30T15:16:59.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:59 smithi072 bash[28946]: audit 2024-03-30T15:16:58.538577+0000 mon.a (mon.0) 2523 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-49", "mode": "readproxy"}]: dispatch 2024-03-30T15:16:59.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:16:59 smithi072 bash[28946]: audit 2024-03-30T15:16:58.539194+0000 mon.a (mon.0) 2524 : audit 1 from='client.? 172.21.15.72:0/913402216' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi072-64171-63"}]: dispatch 2024-03-30T15:16:59.963 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:59 smithi172 bash[23680]: cluster 2024-03-30T15:16:58.034337+0000 mgr.y (mgr.14526) 374 : cluster 0 pgmap v543: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 655 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-03-30T15:16:59.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:59 smithi172 bash[23680]: audit 2024-03-30T15:16:58.524487+0000 mon.a (mon.0) 2520 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-49"}]': finished 2024-03-30T15:16:59.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:59 smithi172 bash[23680]: audit 2024-03-30T15:16:58.524732+0000 mon.a (mon.0) 2521 : audit 1 from='client.? 172.21.15.72:0/913402216' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi072-64171-63"}]': finished 2024-03-30T15:16:59.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:59 smithi172 bash[23680]: cluster 2024-03-30T15:16:58.535962+0000 mon.a (mon.0) 2522 : cluster 0 osdmap e360: 8 total, 8 up, 8 in 2024-03-30T15:16:59.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:59 smithi172 bash[23680]: audit 2024-03-30T15:16:58.538577+0000 mon.a (mon.0) 2523 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-49", "mode": "readproxy"}]: dispatch 2024-03-30T15:16:59.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:16:59 smithi172 bash[23680]: audit 2024-03-30T15:16:58.539194+0000 mon.a (mon.0) 2524 : audit 1 from='client.? 172.21.15.72:0/913402216' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi072-64171-63"}]: dispatch 2024-03-30T15:17:00.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:00 smithi072 bash[21573]: cluster 2024-03-30T15:16:59.525386+0000 mon.a (mon.0) 2525 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:17:00.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:00 smithi072 bash[21573]: audit 2024-03-30T15:16:59.527790+0000 mon.a (mon.0) 2526 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-49", "mode": "readproxy"}]': finished 2024-03-30T15:17:00.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:00 smithi072 bash[21573]: audit 2024-03-30T15:16:59.527990+0000 mon.a (mon.0) 2527 : audit 1 from='client.? 172.21.15.72:0/913402216' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi072-64171-63"}]': finished 2024-03-30T15:17:00.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:00 smithi072 bash[21573]: cluster 2024-03-30T15:16:59.535306+0000 mon.a (mon.0) 2528 : cluster 0 osdmap e361: 8 total, 8 up, 8 in 2024-03-30T15:17:00.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:00 smithi072 bash[21573]: audit 2024-03-30T15:16:59.580727+0000 mon.a (mon.0) 2529 : audit 1 from='client.? 172.21.15.72:0/2303971640' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi072-64171-64"}]: dispatch 2024-03-30T15:17:00.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:00 smithi072 bash[21573]: audit 2024-03-30T15:16:59.581713+0000 mon.a (mon.0) 2530 : audit 1 from='client.? 172.21.15.72:0/2303971640' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi072-64171-64"}]: dispatch 2024-03-30T15:17:00.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:00 smithi072 bash[21573]: audit 2024-03-30T15:16:59.582187+0000 mon.a (mon.0) 2531 : audit 1 from='client.? 172.21.15.72:0/2303971640' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi072-64171-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:17:00.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:00 smithi072 bash[28946]: cluster 2024-03-30T15:16:59.525386+0000 mon.a (mon.0) 2525 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:17:00.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:00 smithi072 bash[28946]: audit 2024-03-30T15:16:59.527790+0000 mon.a (mon.0) 2526 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-49", "mode": "readproxy"}]': finished 2024-03-30T15:17:00.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:00 smithi072 bash[28946]: audit 2024-03-30T15:16:59.527990+0000 mon.a (mon.0) 2527 : audit 1 from='client.? 172.21.15.72:0/913402216' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi072-64171-63"}]': finished 2024-03-30T15:17:00.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:00 smithi072 bash[28946]: cluster 2024-03-30T15:16:59.535306+0000 mon.a (mon.0) 2528 : cluster 0 osdmap e361: 8 total, 8 up, 8 in 2024-03-30T15:17:00.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:00 smithi072 bash[28946]: audit 2024-03-30T15:16:59.580727+0000 mon.a (mon.0) 2529 : audit 1 from='client.? 172.21.15.72:0/2303971640' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi072-64171-64"}]: dispatch 2024-03-30T15:17:00.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:00 smithi072 bash[28946]: audit 2024-03-30T15:16:59.581713+0000 mon.a (mon.0) 2530 : audit 1 from='client.? 172.21.15.72:0/2303971640' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi072-64171-64"}]: dispatch 2024-03-30T15:17:00.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:00 smithi072 bash[28946]: audit 2024-03-30T15:16:59.582187+0000 mon.a (mon.0) 2531 : audit 1 from='client.? 172.21.15.72:0/2303971640' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi072-64171-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:17:00.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:00 smithi172 bash[23680]: cluster 2024-03-30T15:16:59.525386+0000 mon.a (mon.0) 2525 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:17:00.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:00 smithi172 bash[23680]: audit 2024-03-30T15:16:59.527790+0000 mon.a (mon.0) 2526 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-49", "mode": "readproxy"}]': finished 2024-03-30T15:17:00.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:00 smithi172 bash[23680]: audit 2024-03-30T15:16:59.527990+0000 mon.a (mon.0) 2527 : audit 1 from='client.? 172.21.15.72:0/913402216' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi072-64171-63"}]': finished 2024-03-30T15:17:00.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:00 smithi172 bash[23680]: cluster 2024-03-30T15:16:59.535306+0000 mon.a (mon.0) 2528 : cluster 0 osdmap e361: 8 total, 8 up, 8 in 2024-03-30T15:17:00.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:00 smithi172 bash[23680]: audit 2024-03-30T15:16:59.580727+0000 mon.a (mon.0) 2529 : audit 1 from='client.? 172.21.15.72:0/2303971640' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi072-64171-64"}]: dispatch 2024-03-30T15:17:00.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:00 smithi172 bash[23680]: audit 2024-03-30T15:16:59.581713+0000 mon.a (mon.0) 2530 : audit 1 from='client.? 172.21.15.72:0/2303971640' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi072-64171-64"}]: dispatch 2024-03-30T15:17:00.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:00 smithi172 bash[23680]: audit 2024-03-30T15:16:59.582187+0000 mon.a (mon.0) 2531 : audit 1 from='client.? 172.21.15.72:0/2303971640' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi072-64171-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:17:01.417 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:17:01 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:17:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:17:01.463 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:17:01 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:17:02.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:02 smithi072 bash[21573]: cluster 2024-03-30T15:17:00.035386+0000 mgr.y (mgr.14526) 375 : cluster 0 pgmap v546: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 655 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:17:02.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:02 smithi072 bash[21573]: audit 2024-03-30T15:17:00.555187+0000 mon.a (mon.0) 2532 : audit 1 from='client.? 172.21.15.72:0/2303971640' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi072-64171-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:17:02.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:02 smithi072 bash[21573]: cluster 2024-03-30T15:17:00.562358+0000 mon.a (mon.0) 2533 : cluster 0 osdmap e362: 8 total, 8 up, 8 in 2024-03-30T15:17:02.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:02 smithi072 bash[21573]: audit 2024-03-30T15:17:00.563140+0000 mon.a (mon.0) 2534 : audit 1 from='client.? 172.21.15.72:0/2303971640' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi072-64171-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi072-64171-64"}]: dispatch 2024-03-30T15:17:02.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:02 smithi072 bash[28946]: cluster 2024-03-30T15:17:00.035386+0000 mgr.y (mgr.14526) 375 : cluster 0 pgmap v546: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 655 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:17:02.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:02 smithi072 bash[28946]: audit 2024-03-30T15:17:00.555187+0000 mon.a (mon.0) 2532 : audit 1 from='client.? 172.21.15.72:0/2303971640' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi072-64171-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:17:02.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:02 smithi072 bash[28946]: cluster 2024-03-30T15:17:00.562358+0000 mon.a (mon.0) 2533 : cluster 0 osdmap e362: 8 total, 8 up, 8 in 2024-03-30T15:17:02.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:02 smithi072 bash[28946]: audit 2024-03-30T15:17:00.563140+0000 mon.a (mon.0) 2534 : audit 1 from='client.? 172.21.15.72:0/2303971640' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi072-64171-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi072-64171-64"}]: dispatch 2024-03-30T15:17:02.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:02 smithi172 bash[23680]: cluster 2024-03-30T15:17:00.035386+0000 mgr.y (mgr.14526) 375 : cluster 0 pgmap v546: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 655 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:17:02.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:02 smithi172 bash[23680]: audit 2024-03-30T15:17:00.555187+0000 mon.a (mon.0) 2532 : audit 1 from='client.? 172.21.15.72:0/2303971640' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi072-64171-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:17:02.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:02 smithi172 bash[23680]: cluster 2024-03-30T15:17:00.562358+0000 mon.a (mon.0) 2533 : cluster 0 osdmap e362: 8 total, 8 up, 8 in 2024-03-30T15:17:02.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:02 smithi172 bash[23680]: audit 2024-03-30T15:17:00.563140+0000 mon.a (mon.0) 2534 : audit 1 from='client.? 172.21.15.72:0/2303971640' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi072-64171-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi072-64171-64"}]: dispatch 2024-03-30T15:17:03.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:03 smithi072 bash[21573]: audit 2024-03-30T15:17:01.215079+0000 mgr.y (mgr.14526) 376 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:17:03.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:03 smithi072 bash[21573]: cluster 2024-03-30T15:17:02.012142+0000 mon.a (mon.0) 2535 : cluster 0 osdmap e363: 8 total, 8 up, 8 in 2024-03-30T15:17:03.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:03 smithi072 bash[21573]: cluster 2024-03-30T15:17:02.036148+0000 mgr.y (mgr.14526) 377 : cluster 0 pgmap v549: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:17:03.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:03 smithi072 bash[21573]: audit 2024-03-30T15:17:02.562214+0000 mon.a (mon.0) 2536 : audit 1 from='client.? 172.21.15.72:0/2303971640' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi072-64171-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi072-64171-64"}]': finished 2024-03-30T15:17:03.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:03 smithi072 bash[21573]: cluster 2024-03-30T15:17:02.572456+0000 mon.a (mon.0) 2537 : cluster 0 osdmap e364: 8 total, 8 up, 8 in 2024-03-30T15:17:03.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:03 smithi072 bash[28946]: audit 2024-03-30T15:17:01.215079+0000 mgr.y (mgr.14526) 376 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:17:03.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:03 smithi072 bash[28946]: cluster 2024-03-30T15:17:02.012142+0000 mon.a (mon.0) 2535 : cluster 0 osdmap e363: 8 total, 8 up, 8 in 2024-03-30T15:17:03.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:03 smithi072 bash[28946]: cluster 2024-03-30T15:17:02.036148+0000 mgr.y (mgr.14526) 377 : cluster 0 pgmap v549: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:17:03.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:03 smithi072 bash[28946]: audit 2024-03-30T15:17:02.562214+0000 mon.a (mon.0) 2536 : audit 1 from='client.? 172.21.15.72:0/2303971640' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi072-64171-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi072-64171-64"}]': finished 2024-03-30T15:17:03.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:03 smithi072 bash[28946]: cluster 2024-03-30T15:17:02.572456+0000 mon.a (mon.0) 2537 : cluster 0 osdmap e364: 8 total, 8 up, 8 in 2024-03-30T15:17:03.463 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:03 smithi172 bash[23680]: audit 2024-03-30T15:17:01.215079+0000 mgr.y (mgr.14526) 376 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:17:03.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:03 smithi172 bash[23680]: cluster 2024-03-30T15:17:02.012142+0000 mon.a (mon.0) 2535 : cluster 0 osdmap e363: 8 total, 8 up, 8 in 2024-03-30T15:17:03.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:03 smithi172 bash[23680]: cluster 2024-03-30T15:17:02.036148+0000 mgr.y (mgr.14526) 377 : cluster 0 pgmap v549: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:17:03.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:03 smithi172 bash[23680]: audit 2024-03-30T15:17:02.562214+0000 mon.a (mon.0) 2536 : audit 1 from='client.? 172.21.15.72:0/2303971640' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi072-64171-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi072-64171-64"}]': finished 2024-03-30T15:17:03.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:03 smithi172 bash[23680]: cluster 2024-03-30T15:17:02.572456+0000 mon.a (mon.0) 2537 : cluster 0 osdmap e364: 8 total, 8 up, 8 in 2024-03-30T15:17:04.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:04 smithi072 bash[28946]: cluster 2024-03-30T15:17:03.576743+0000 mon.a (mon.0) 2538 : cluster 0 osdmap e365: 8 total, 8 up, 8 in 2024-03-30T15:17:04.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:04 smithi072 bash[21573]: cluster 2024-03-30T15:17:03.576743+0000 mon.a (mon.0) 2538 : cluster 0 osdmap e365: 8 total, 8 up, 8 in 2024-03-30T15:17:04.963 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:04 smithi172 bash[23680]: cluster 2024-03-30T15:17:03.576743+0000 mon.a (mon.0) 2538 : cluster 0 osdmap e365: 8 total, 8 up, 8 in 2024-03-30T15:17:05.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:05 smithi072 bash[21573]: cluster 2024-03-30T15:17:04.036937+0000 mgr.y (mgr.14526) 378 : cluster 0 pgmap v552: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:17:05.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:05 smithi072 bash[21573]: cluster 2024-03-30T15:17:04.564881+0000 mon.a (mon.0) 2539 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:17:05.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:05 smithi072 bash[21573]: cluster 2024-03-30T15:17:04.602652+0000 mon.a (mon.0) 2540 : cluster 0 osdmap e366: 8 total, 8 up, 8 in 2024-03-30T15:17:05.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:05 smithi072 bash[21573]: audit 2024-03-30T15:17:04.605258+0000 mon.a (mon.0) 2541 : audit 1 from='client.? 172.21.15.72:0/2303971640' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi072-64171-64"}]: dispatch 2024-03-30T15:17:05.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:05 smithi072 bash[28946]: cluster 2024-03-30T15:17:04.036937+0000 mgr.y (mgr.14526) 378 : cluster 0 pgmap v552: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:17:05.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:05 smithi072 bash[28946]: cluster 2024-03-30T15:17:04.564881+0000 mon.a (mon.0) 2539 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:17:05.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:05 smithi072 bash[28946]: cluster 2024-03-30T15:17:04.602652+0000 mon.a (mon.0) 2540 : cluster 0 osdmap e366: 8 total, 8 up, 8 in 2024-03-30T15:17:05.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:05 smithi072 bash[28946]: audit 2024-03-30T15:17:04.605258+0000 mon.a (mon.0) 2541 : audit 1 from='client.? 172.21.15.72:0/2303971640' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi072-64171-64"}]: dispatch 2024-03-30T15:17:05.963 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:05 smithi172 bash[23680]: cluster 2024-03-30T15:17:04.036937+0000 mgr.y (mgr.14526) 378 : cluster 0 pgmap v552: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:17:05.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:05 smithi172 bash[23680]: cluster 2024-03-30T15:17:04.564881+0000 mon.a (mon.0) 2539 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:17:05.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:05 smithi172 bash[23680]: cluster 2024-03-30T15:17:04.602652+0000 mon.a (mon.0) 2540 : cluster 0 osdmap e366: 8 total, 8 up, 8 in 2024-03-30T15:17:05.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:05 smithi172 bash[23680]: audit 2024-03-30T15:17:04.605258+0000 mon.a (mon.0) 2541 : audit 1 from='client.? 172.21.15.72:0/2303971640' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi072-64171-64"}]: dispatch 2024-03-30T15:17:06.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:06 smithi072 bash[21573]: audit 2024-03-30T15:17:05.580883+0000 mon.a (mon.0) 2542 : audit 1 from='client.? 172.21.15.72:0/2303971640' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi072-64171-64"}]': finished 2024-03-30T15:17:06.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:06 smithi072 bash[21573]: cluster 2024-03-30T15:17:05.587579+0000 mon.a (mon.0) 2543 : cluster 0 osdmap e367: 8 total, 8 up, 8 in 2024-03-30T15:17:06.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:06 smithi072 bash[21573]: audit 2024-03-30T15:17:05.588824+0000 mon.a (mon.0) 2544 : audit 1 from='client.? 172.21.15.72:0/2303971640' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi072-64171-64"}]: dispatch 2024-03-30T15:17:06.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:06 smithi072 bash[21573]: audit 2024-03-30T15:17:06.155344+0000 mon.a (mon.0) 2545 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:17:06.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:06 smithi072 bash[21573]: audit 2024-03-30T15:17:06.167947+0000 mon.c (mon.2) 434 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:17:06.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:06 smithi072 bash[21573]: audit 2024-03-30T15:17:06.584264+0000 mon.a (mon.0) 2546 : audit 1 from='client.? 172.21.15.72:0/2303971640' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi072-64171-64"}]': finished 2024-03-30T15:17:06.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:06 smithi072 bash[21573]: cluster 2024-03-30T15:17:06.591874+0000 mon.a (mon.0) 2547 : cluster 0 osdmap e368: 8 total, 8 up, 8 in 2024-03-30T15:17:06.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:06 smithi072 bash[28946]: audit 2024-03-30T15:17:05.580883+0000 mon.a (mon.0) 2542 : audit 1 from='client.? 172.21.15.72:0/2303971640' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi072-64171-64"}]': finished 2024-03-30T15:17:06.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:06 smithi072 bash[28946]: cluster 2024-03-30T15:17:05.587579+0000 mon.a (mon.0) 2543 : cluster 0 osdmap e367: 8 total, 8 up, 8 in 2024-03-30T15:17:06.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:06 smithi072 bash[28946]: audit 2024-03-30T15:17:05.588824+0000 mon.a (mon.0) 2544 : audit 1 from='client.? 172.21.15.72:0/2303971640' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi072-64171-64"}]: dispatch 2024-03-30T15:17:06.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:06 smithi072 bash[28946]: audit 2024-03-30T15:17:06.155344+0000 mon.a (mon.0) 2545 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:17:06.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:06 smithi072 bash[28946]: audit 2024-03-30T15:17:06.167947+0000 mon.c (mon.2) 434 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:17:06.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:06 smithi072 bash[28946]: audit 2024-03-30T15:17:06.584264+0000 mon.a (mon.0) 2546 : audit 1 from='client.? 172.21.15.72:0/2303971640' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi072-64171-64"}]': finished 2024-03-30T15:17:06.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:06 smithi072 bash[28946]: cluster 2024-03-30T15:17:06.591874+0000 mon.a (mon.0) 2547 : cluster 0 osdmap e368: 8 total, 8 up, 8 in 2024-03-30T15:17:06.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:06 smithi172 bash[23680]: audit 2024-03-30T15:17:05.580883+0000 mon.a (mon.0) 2542 : audit 1 from='client.? 172.21.15.72:0/2303971640' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi072-64171-64"}]': finished 2024-03-30T15:17:06.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:06 smithi172 bash[23680]: cluster 2024-03-30T15:17:05.587579+0000 mon.a (mon.0) 2543 : cluster 0 osdmap e367: 8 total, 8 up, 8 in 2024-03-30T15:17:06.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:06 smithi172 bash[23680]: audit 2024-03-30T15:17:05.588824+0000 mon.a (mon.0) 2544 : audit 1 from='client.? 172.21.15.72:0/2303971640' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi072-64171-64"}]: dispatch 2024-03-30T15:17:06.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:06 smithi172 bash[23680]: audit 2024-03-30T15:17:06.155344+0000 mon.a (mon.0) 2545 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:17:06.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:06 smithi172 bash[23680]: audit 2024-03-30T15:17:06.167947+0000 mon.c (mon.2) 434 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:17:06.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:06 smithi172 bash[23680]: audit 2024-03-30T15:17:06.584264+0000 mon.a (mon.0) 2546 : audit 1 from='client.? 172.21.15.72:0/2303971640' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi072-64171-64"}]': finished 2024-03-30T15:17:06.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:06 smithi172 bash[23680]: cluster 2024-03-30T15:17:06.591874+0000 mon.a (mon.0) 2547 : cluster 0 osdmap e368: 8 total, 8 up, 8 in 2024-03-30T15:17:07.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:07 smithi072 bash[28946]: cluster 2024-03-30T15:17:06.039048+0000 mgr.y (mgr.14526) 379 : cluster 0 pgmap v555: 228 pgs: 228 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:17:07.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:07 smithi072 bash[28946]: audit 2024-03-30T15:17:06.626537+0000 mon.c (mon.2) 435 : audit 1 from='client.? 172.21.15.72:0/715129469' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi072-64171-65"}]: dispatch 2024-03-30T15:17:07.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:07 smithi072 bash[28946]: audit 2024-03-30T15:17:06.626856+0000 mon.a (mon.0) 2548 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi072-64171-65"}]: dispatch 2024-03-30T15:17:07.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:07 smithi072 bash[28946]: audit 2024-03-30T15:17:06.627645+0000 mon.c (mon.2) 436 : audit 1 from='client.? 172.21.15.72:0/715129469' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi072-64171-65"}]: dispatch 2024-03-30T15:17:07.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:07 smithi072 bash[28946]: audit 2024-03-30T15:17:06.627910+0000 mon.a (mon.0) 2549 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi072-64171-65"}]: dispatch 2024-03-30T15:17:07.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:07 smithi072 bash[28946]: audit 2024-03-30T15:17:06.628400+0000 mon.c (mon.2) 437 : audit 1 from='client.? 172.21.15.72:0/715129469' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi072-64171-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:17:07.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:07 smithi072 bash[28946]: audit 2024-03-30T15:17:06.628708+0000 mon.a (mon.0) 2550 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi072-64171-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:17:07.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:07 smithi072 bash[21573]: cluster 2024-03-30T15:17:06.039048+0000 mgr.y (mgr.14526) 379 : cluster 0 pgmap v555: 228 pgs: 228 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:17:07.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:07 smithi072 bash[21573]: audit 2024-03-30T15:17:06.626537+0000 mon.c (mon.2) 435 : audit 1 from='client.? 172.21.15.72:0/715129469' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi072-64171-65"}]: dispatch 2024-03-30T15:17:07.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:07 smithi072 bash[21573]: audit 2024-03-30T15:17:06.626856+0000 mon.a (mon.0) 2548 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi072-64171-65"}]: dispatch 2024-03-30T15:17:07.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:07 smithi072 bash[21573]: audit 2024-03-30T15:17:06.627645+0000 mon.c (mon.2) 436 : audit 1 from='client.? 172.21.15.72:0/715129469' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi072-64171-65"}]: dispatch 2024-03-30T15:17:07.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:07 smithi072 bash[21573]: audit 2024-03-30T15:17:06.627910+0000 mon.a (mon.0) 2549 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi072-64171-65"}]: dispatch 2024-03-30T15:17:07.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:07 smithi072 bash[21573]: audit 2024-03-30T15:17:06.628400+0000 mon.c (mon.2) 437 : audit 1 from='client.? 172.21.15.72:0/715129469' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi072-64171-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:17:07.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:07 smithi072 bash[21573]: audit 2024-03-30T15:17:06.628708+0000 mon.a (mon.0) 2550 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi072-64171-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:17:07.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:07 smithi172 bash[23680]: cluster 2024-03-30T15:17:06.039048+0000 mgr.y (mgr.14526) 379 : cluster 0 pgmap v555: 228 pgs: 228 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:17:07.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:07 smithi172 bash[23680]: audit 2024-03-30T15:17:06.626537+0000 mon.c (mon.2) 435 : audit 1 from='client.? 172.21.15.72:0/715129469' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi072-64171-65"}]: dispatch 2024-03-30T15:17:07.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:07 smithi172 bash[23680]: audit 2024-03-30T15:17:06.626856+0000 mon.a (mon.0) 2548 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi072-64171-65"}]: dispatch 2024-03-30T15:17:07.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:07 smithi172 bash[23680]: audit 2024-03-30T15:17:06.627645+0000 mon.c (mon.2) 436 : audit 1 from='client.? 172.21.15.72:0/715129469' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi072-64171-65"}]: dispatch 2024-03-30T15:17:07.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:07 smithi172 bash[23680]: audit 2024-03-30T15:17:06.627910+0000 mon.a (mon.0) 2549 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi072-64171-65"}]: dispatch 2024-03-30T15:17:07.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:07 smithi172 bash[23680]: audit 2024-03-30T15:17:06.628400+0000 mon.c (mon.2) 437 : audit 1 from='client.? 172.21.15.72:0/715129469' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi072-64171-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:17:07.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:07 smithi172 bash[23680]: audit 2024-03-30T15:17:06.628708+0000 mon.a (mon.0) 2550 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi072-64171-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:17:08.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:08 smithi072 bash[21573]: audit 2024-03-30T15:17:07.608118+0000 mon.a (mon.0) 2551 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi072-64171-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:17:08.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:08 smithi072 bash[21573]: cluster 2024-03-30T15:17:07.616173+0000 mon.a (mon.0) 2552 : cluster 0 osdmap e369: 8 total, 8 up, 8 in 2024-03-30T15:17:08.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:08 smithi072 bash[21573]: audit 2024-03-30T15:17:07.621831+0000 mon.c (mon.2) 438 : audit 1 from='client.? 172.21.15.72:0/715129469' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "OmapPP_smithi072-64171-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi072-64171-65"}]: dispatch 2024-03-30T15:17:08.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:08 smithi072 bash[21573]: audit 2024-03-30T15:17:07.631572+0000 mon.a (mon.0) 2553 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "OmapPP_smithi072-64171-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi072-64171-65"}]: dispatch 2024-03-30T15:17:08.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:08 smithi072 bash[28946]: audit 2024-03-30T15:17:07.608118+0000 mon.a (mon.0) 2551 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi072-64171-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:17:08.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:08 smithi072 bash[28946]: cluster 2024-03-30T15:17:07.616173+0000 mon.a (mon.0) 2552 : cluster 0 osdmap e369: 8 total, 8 up, 8 in 2024-03-30T15:17:08.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:08 smithi072 bash[28946]: audit 2024-03-30T15:17:07.621831+0000 mon.c (mon.2) 438 : audit 1 from='client.? 172.21.15.72:0/715129469' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "OmapPP_smithi072-64171-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi072-64171-65"}]: dispatch 2024-03-30T15:17:08.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:08 smithi072 bash[28946]: audit 2024-03-30T15:17:07.631572+0000 mon.a (mon.0) 2553 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "OmapPP_smithi072-64171-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi072-64171-65"}]: dispatch 2024-03-30T15:17:08.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:08 smithi172 bash[23680]: audit 2024-03-30T15:17:07.608118+0000 mon.a (mon.0) 2551 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi072-64171-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:17:08.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:08 smithi172 bash[23680]: cluster 2024-03-30T15:17:07.616173+0000 mon.a (mon.0) 2552 : cluster 0 osdmap e369: 8 total, 8 up, 8 in 2024-03-30T15:17:08.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:08 smithi172 bash[23680]: audit 2024-03-30T15:17:07.621831+0000 mon.c (mon.2) 438 : audit 1 from='client.? 172.21.15.72:0/715129469' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "OmapPP_smithi072-64171-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi072-64171-65"}]: dispatch 2024-03-30T15:17:08.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:08 smithi172 bash[23680]: audit 2024-03-30T15:17:07.631572+0000 mon.a (mon.0) 2553 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "OmapPP_smithi072-64171-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi072-64171-65"}]: dispatch 2024-03-30T15:17:09.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:09 smithi072 bash[21573]: cluster 2024-03-30T15:17:08.039889+0000 mgr.y (mgr.14526) 380 : cluster 0 pgmap v558: 228 pgs: 228 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:17:09.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:09 smithi072 bash[21573]: cluster 2024-03-30T15:17:09.089916+0000 mon.a (mon.0) 2554 : cluster 0 osdmap e370: 8 total, 8 up, 8 in 2024-03-30T15:17:09.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:09 smithi072 bash[28946]: cluster 2024-03-30T15:17:08.039889+0000 mgr.y (mgr.14526) 380 : cluster 0 pgmap v558: 228 pgs: 228 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:17:09.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:09 smithi072 bash[28946]: cluster 2024-03-30T15:17:09.089916+0000 mon.a (mon.0) 2554 : cluster 0 osdmap e370: 8 total, 8 up, 8 in 2024-03-30T15:17:09.963 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:09 smithi172 bash[23680]: cluster 2024-03-30T15:17:08.039889+0000 mgr.y (mgr.14526) 380 : cluster 0 pgmap v558: 228 pgs: 228 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:17:09.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:09 smithi172 bash[23680]: cluster 2024-03-30T15:17:09.089916+0000 mon.a (mon.0) 2554 : cluster 0 osdmap e370: 8 total, 8 up, 8 in 2024-03-30T15:17:10.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:10 smithi072 bash[21573]: audit 2024-03-30T15:17:09.648842+0000 mon.a (mon.0) 2555 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "OmapPP_smithi072-64171-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi072-64171-65"}]': finished 2024-03-30T15:17:10.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:10 smithi072 bash[21573]: cluster 2024-03-30T15:17:09.655700+0000 mon.a (mon.0) 2556 : cluster 0 osdmap e371: 8 total, 8 up, 8 in 2024-03-30T15:17:10.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:10 smithi072 bash[21573]: audit 2024-03-30T15:17:09.996300+0000 mon.a (mon.0) 2557 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:17:10.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:10 smithi072 bash[28946]: audit 2024-03-30T15:17:09.648842+0000 mon.a (mon.0) 2555 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "OmapPP_smithi072-64171-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi072-64171-65"}]': finished 2024-03-30T15:17:10.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:10 smithi072 bash[28946]: cluster 2024-03-30T15:17:09.655700+0000 mon.a (mon.0) 2556 : cluster 0 osdmap e371: 8 total, 8 up, 8 in 2024-03-30T15:17:10.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:10 smithi072 bash[28946]: audit 2024-03-30T15:17:09.996300+0000 mon.a (mon.0) 2557 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:17:10.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:10 smithi172 bash[23680]: audit 2024-03-30T15:17:09.648842+0000 mon.a (mon.0) 2555 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "OmapPP_smithi072-64171-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi072-64171-65"}]': finished 2024-03-30T15:17:10.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:10 smithi172 bash[23680]: cluster 2024-03-30T15:17:09.655700+0000 mon.a (mon.0) 2556 : cluster 0 osdmap e371: 8 total, 8 up, 8 in 2024-03-30T15:17:10.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:10 smithi172 bash[23680]: audit 2024-03-30T15:17:09.996300+0000 mon.a (mon.0) 2557 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:17:11.417 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:17:11 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:17:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:17:11.669 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:17:11 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:17:11.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:11 smithi172 bash[23680]: cluster 2024-03-30T15:17:10.040709+0000 mgr.y (mgr.14526) 381 : cluster 0 pgmap v561: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:17:11.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:11 smithi172 bash[23680]: cluster 2024-03-30T15:17:10.648864+0000 mon.a (mon.0) 2558 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:17:11.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:11 smithi172 bash[23680]: audit 2024-03-30T15:17:10.658052+0000 mon.a (mon.0) 2559 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:17:11.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:11 smithi172 bash[23680]: cluster 2024-03-30T15:17:10.667918+0000 mon.a (mon.0) 2560 : cluster 0 osdmap e372: 8 total, 8 up, 8 in 2024-03-30T15:17:11.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:11 smithi172 bash[23680]: audit 2024-03-30T15:17:10.669757+0000 mon.a (mon.0) 2561 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-49"}]: dispatch 2024-03-30T15:17:11.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:11 smithi172 bash[23680]: audit 2024-03-30T15:17:11.381882+0000 mon.c (mon.2) 439 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:17:12.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:11 smithi072 bash[21573]: cluster 2024-03-30T15:17:10.040709+0000 mgr.y (mgr.14526) 381 : cluster 0 pgmap v561: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:17:12.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:11 smithi072 bash[21573]: cluster 2024-03-30T15:17:10.648864+0000 mon.a (mon.0) 2558 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:17:12.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:11 smithi072 bash[21573]: audit 2024-03-30T15:17:10.658052+0000 mon.a (mon.0) 2559 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:17:12.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:11 smithi072 bash[21573]: cluster 2024-03-30T15:17:10.667918+0000 mon.a (mon.0) 2560 : cluster 0 osdmap e372: 8 total, 8 up, 8 in 2024-03-30T15:17:12.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:11 smithi072 bash[21573]: audit 2024-03-30T15:17:10.669757+0000 mon.a (mon.0) 2561 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-49"}]: dispatch 2024-03-30T15:17:12.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:11 smithi072 bash[21573]: audit 2024-03-30T15:17:11.381882+0000 mon.c (mon.2) 439 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:17:12.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:11 smithi072 bash[28946]: cluster 2024-03-30T15:17:10.040709+0000 mgr.y (mgr.14526) 381 : cluster 0 pgmap v561: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:17:12.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:11 smithi072 bash[28946]: cluster 2024-03-30T15:17:10.648864+0000 mon.a (mon.0) 2558 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:17:12.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:11 smithi072 bash[28946]: audit 2024-03-30T15:17:10.658052+0000 mon.a (mon.0) 2559 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:17:12.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:11 smithi072 bash[28946]: cluster 2024-03-30T15:17:10.667918+0000 mon.a (mon.0) 2560 : cluster 0 osdmap e372: 8 total, 8 up, 8 in 2024-03-30T15:17:12.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:11 smithi072 bash[28946]: audit 2024-03-30T15:17:10.669757+0000 mon.a (mon.0) 2561 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-49"}]: dispatch 2024-03-30T15:17:12.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:11 smithi072 bash[28946]: audit 2024-03-30T15:17:11.381882+0000 mon.c (mon.2) 439 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:17:12.679 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullP163:head 2024-03-30T15:17:12.679 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:5d165639:::164:head 2024-03-30T15:17:12.680 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:f43765fc:::165:head 2024-03-30T15:17:12.680 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:b4c720e9:::166:head 2024-03-30T15:17:12.680 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:e694b040:::167:head 2024-03-30T15:17:12.680 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:afa38db2:::168:head 2024-03-30T15:17:12.680 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:77ba9f53:::169:head 2024-03-30T15:17:12.680 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:87495034:::170:head 2024-03-30T15:17:12.680 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:7c96bf0e:::171:head 2024-03-30T15:17:12.680 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:dbe346cc:::172:head 2024-03-30T15:17:12.680 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:e943ec24:::173:head 2024-03-30T15:17:12.680 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:f97a9c0c:::174:head 2024-03-30T15:17:12.680 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:6f26e74d:::175:head 2024-03-30T15:17:12.680 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:4f95e106:::176:head 2024-03-30T15:17:12.680 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:0e6f2f8f:::177:head 2024-03-30T15:17:12.680 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:05db05f1:::178:head 2024-03-30T15:17:12.680 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:38a78d66:::179:head 2024-03-30T15:17:12.681 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:d095610b:::180:head 2024-03-30T15:17:12.681 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:a1a9d709:::181:head 2024-03-30T15:17:12.681 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:1e5d39db:::182:head 2024-03-30T15:17:12.681 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:f7df4fb9:::183:head 2024-03-30T15:17:12.681 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:03a7f161:::184:head 2024-03-30T15:17:12.681 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:ba70721e:::185:head 2024-03-30T15:17:12.681 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:28e5662d:::186:head 2024-03-30T15:17:12.681 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:973d52de:::187:head 2024-03-30T15:17:12.681 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:4303eb1c:::188:head 2024-03-30T15:17:12.681 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:b990b48e:::189:head 2024-03-30T15:17:12.681 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:29b8165b:::190:head 2024-03-30T15:17:12.681 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:3547f197:::191:head 2024-03-30T15:17:12.681 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:7e260936:::192:head 2024-03-30T15:17:12.681 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:1abec7b1:::193:head 2024-03-30T15:17:12.681 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:10fdda93:::194:head 2024-03-30T15:17:12.682 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:15817eea:::195:head 2024-03-30T15:17:12.682 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:770bab57:::196:head 2024-03-30T15:17:12.682 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:ed9e13e7:::197:head 2024-03-30T15:17:12.682 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:71471a8f:::198:head 2024-03-30T15:17:12.682 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: checking for 277:10fb1d02:::199:head 2024-03-30T15:17:12.682 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetWrite (9041 ms) 2024-03-30T15:17:12.682 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetTrim 2024-03-30T15:17:12.682 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: got ls 1711811787,0 2024-03-30T15:17:12.682 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: first is 1711811787 2024-03-30T15:17:12.682 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: got ls 1711811787,0 2024-03-30T15:17:12.682 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: got ls 1711811787,0 2024-03-30T15:17:12.682 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: got ls 1711811787,1711811789,1711811790,0 2024-03-30T15:17:12.682 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: got ls 1711811787,1711811789,1711811790,0 2024-03-30T15:17:12.682 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: got ls 1711811787,1711811789,1711811790,0 2024-03-30T15:17:12.682 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: got ls 1711811787,1711811789,1711811790,1711811792,1711811793,0 2024-03-30T15:17:12.683 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: got ls 1711811787,1711811789,1711811790,1711811792,1711811793,0 2024-03-30T15:17:12.683 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: got ls 1711811787,1711811789,1711811790,1711811792,1711811793,0 2024-03-30T15:17:12.683 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: got ls 1711811787,1711811789,1711811790,1711811792,1711811793,1711811795,1711811796,0 2024-03-30T15:17:12.683 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: got ls 1711811787,1711811789,1711811790,1711811792,1711811793,1711811795,1711811796,0 2024-03-30T15:17:12.683 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: got ls 1711811787,1711811789,1711811790,1711811792,1711811793,1711811795,1711811796,0 2024-03-30T15:17:12.683 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: got ls 1711811790,1711811792,1711811793,1711811795,1711811796,1711811798,1711811799,0 2024-03-30T15:17:12.683 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: first now 1711811790, trimmed 2024-03-30T15:17:12.683 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetTrim (21634 ms) 2024-03-30T15:17:12.683 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2024-03-30T15:17:12.683 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: foo0 2024-03-30T15:17:12.684 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: verifying foo0 is eventually promoted 2024-03-30T15:17:12.684 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteOn2ndRead (14080 ms) 2024-03-30T15:17:12.684 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ProxyRead 2024-03-30T15:17:13.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:13 smithi072 bash[21573]: audit 2024-03-30T15:17:11.226400+0000 mgr.y (mgr.14526) 382 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:17:13.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:13 smithi072 bash[21573]: cluster 2024-03-30T15:17:11.658476+0000 mon.a (mon.0) 2562 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:17:13.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:13 smithi072 bash[21573]: audit 2024-03-30T15:17:11.660730+0000 mon.a (mon.0) 2563 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-49"}]': finished 2024-03-30T15:17:13.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:13 smithi072 bash[21573]: cluster 2024-03-30T15:17:11.668183+0000 mon.a (mon.0) 2564 : cluster 0 osdmap e373: 8 total, 8 up, 8 in 2024-03-30T15:17:13.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:13 smithi072 bash[21573]: audit 2024-03-30T15:17:11.673087+0000 mon.c (mon.2) 440 : audit 1 from='client.? 172.21.15.72:0/715129469' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi072-64171-65"}]: dispatch 2024-03-30T15:17:13.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:13 smithi072 bash[21573]: audit 2024-03-30T15:17:11.682690+0000 mon.a (mon.0) 2565 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi072-64171-65"}]: dispatch 2024-03-30T15:17:13.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:13 smithi072 bash[21573]: audit 2024-03-30T15:17:11.731961+0000 mon.a (mon.0) 2566 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:17:13.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:13 smithi072 bash[21573]: audit 2024-03-30T15:17:11.732622+0000 mon.a (mon.0) 2567 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-49"}]: dispatch 2024-03-30T15:17:13.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:13 smithi072 bash[21573]: audit 2024-03-30T15:17:12.217346+0000 mon.c (mon.2) 441 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:17:13.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:13 smithi072 bash[21573]: audit 2024-03-30T15:17:12.219100+0000 mon.c (mon.2) 442 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:17:13.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:13 smithi072 bash[21573]: audit 2024-03-30T15:17:12.228543+0000 mon.a (mon.0) 2568 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:17:13.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:13 smithi072 bash[28946]: audit 2024-03-30T15:17:11.226400+0000 mgr.y (mgr.14526) 382 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:17:13.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:13 smithi072 bash[28946]: cluster 2024-03-30T15:17:11.658476+0000 mon.a (mon.0) 2562 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:17:13.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:13 smithi072 bash[28946]: audit 2024-03-30T15:17:11.660730+0000 mon.a (mon.0) 2563 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-49"}]': finished 2024-03-30T15:17:13.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:13 smithi072 bash[28946]: cluster 2024-03-30T15:17:11.668183+0000 mon.a (mon.0) 2564 : cluster 0 osdmap e373: 8 total, 8 up, 8 in 2024-03-30T15:17:13.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:13 smithi072 bash[28946]: audit 2024-03-30T15:17:11.673087+0000 mon.c (mon.2) 440 : audit 1 from='client.? 172.21.15.72:0/715129469' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi072-64171-65"}]: dispatch 2024-03-30T15:17:13.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:13 smithi072 bash[28946]: audit 2024-03-30T15:17:11.682690+0000 mon.a (mon.0) 2565 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi072-64171-65"}]: dispatch 2024-03-30T15:17:13.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:13 smithi072 bash[28946]: audit 2024-03-30T15:17:11.731961+0000 mon.a (mon.0) 2566 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:17:13.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:13 smithi072 bash[28946]: audit 2024-03-30T15:17:11.732622+0000 mon.a (mon.0) 2567 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-49"}]: dispatch 2024-03-30T15:17:13.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:13 smithi072 bash[28946]: audit 2024-03-30T15:17:12.217346+0000 mon.c (mon.2) 441 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:17:13.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:13 smithi072 bash[28946]: audit 2024-03-30T15:17:12.219100+0000 mon.c (mon.2) 442 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:17:13.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:13 smithi072 bash[28946]: audit 2024-03-30T15:17:12.228543+0000 mon.a (mon.0) 2568 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:17:13.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:13 smithi172 bash[23680]: audit 2024-03-30T15:17:11.226400+0000 mgr.y (mgr.14526) 382 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:17:13.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:13 smithi172 bash[23680]: cluster 2024-03-30T15:17:11.658476+0000 mon.a (mon.0) 2562 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:17:13.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:13 smithi172 bash[23680]: audit 2024-03-30T15:17:11.660730+0000 mon.a (mon.0) 2563 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-49"}]': finished 2024-03-30T15:17:13.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:13 smithi172 bash[23680]: cluster 2024-03-30T15:17:11.668183+0000 mon.a (mon.0) 2564 : cluster 0 osdmap e373: 8 total, 8 up, 8 in 2024-03-30T15:17:13.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:13 smithi172 bash[23680]: audit 2024-03-30T15:17:11.673087+0000 mon.c (mon.2) 440 : audit 1 from='client.? 172.21.15.72:0/715129469' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi072-64171-65"}]: dispatch 2024-03-30T15:17:13.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:13 smithi172 bash[23680]: audit 2024-03-30T15:17:11.682690+0000 mon.a (mon.0) 2565 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi072-64171-65"}]: dispatch 2024-03-30T15:17:13.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:13 smithi172 bash[23680]: audit 2024-03-30T15:17:11.731961+0000 mon.a (mon.0) 2566 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:17:13.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:13 smithi172 bash[23680]: audit 2024-03-30T15:17:11.732622+0000 mon.a (mon.0) 2567 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-49"}]: dispatch 2024-03-30T15:17:13.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:13 smithi172 bash[23680]: audit 2024-03-30T15:17:12.217346+0000 mon.c (mon.2) 441 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:17:13.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:13 smithi172 bash[23680]: audit 2024-03-30T15:17:12.219100+0000 mon.c (mon.2) 442 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:17:13.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:13 smithi172 bash[23680]: audit 2024-03-30T15:17:12.228543+0000 mon.a (mon.0) 2568 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:17:14.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:14 smithi072 bash[21573]: cluster 2024-03-30T15:17:12.041579+0000 mgr.y (mgr.14526) 383 : cluster 0 pgmap v564: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:17:14.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:14 smithi072 bash[21573]: audit 2024-03-30T15:17:12.676062+0000 mon.a (mon.0) 2569 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi072-64171-65"}]': finished 2024-03-30T15:17:14.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:14 smithi072 bash[21573]: cluster 2024-03-30T15:17:12.682728+0000 mon.a (mon.0) 2570 : cluster 0 osdmap e374: 8 total, 8 up, 8 in 2024-03-30T15:17:14.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:14 smithi072 bash[21573]: audit 2024-03-30T15:17:12.686584+0000 mon.c (mon.2) 443 : audit 1 from='client.? 172.21.15.72:0/715129469' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi072-64171-65"}]: dispatch 2024-03-30T15:17:14.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:14 smithi072 bash[21573]: audit 2024-03-30T15:17:13.149931+0000 mon.a (mon.0) 2571 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi072-64171-65"}]: dispatch 2024-03-30T15:17:14.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:14 smithi072 bash[21573]: audit 2024-03-30T15:17:13.680587+0000 mon.a (mon.0) 2572 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi072-64171-65"}]': finished 2024-03-30T15:17:14.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:14 smithi072 bash[21573]: cluster 2024-03-30T15:17:13.699199+0000 mon.a (mon.0) 2573 : cluster 0 osdmap e375: 8 total, 8 up, 8 in 2024-03-30T15:17:14.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:14 smithi072 bash[21573]: audit 2024-03-30T15:17:13.721366+0000 mon.a (mon.0) 2574 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:17:14.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:14 smithi072 bash[21573]: audit 2024-03-30T15:17:13.736670+0000 mon.c (mon.2) 444 : audit 1 from='client.? 172.21.15.72:0/3589808744' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi072-64171-66"}]: dispatch 2024-03-30T15:17:14.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:14 smithi072 bash[21573]: audit 2024-03-30T15:17:13.737082+0000 mon.a (mon.0) 2575 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi072-64171-66"}]: dispatch 2024-03-30T15:17:14.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:14 smithi072 bash[21573]: audit 2024-03-30T15:17:13.737740+0000 mon.c (mon.2) 445 : audit 1 from='client.? 172.21.15.72:0/3589808744' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi072-64171-66"}]: dispatch 2024-03-30T15:17:14.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:14 smithi072 bash[21573]: audit 2024-03-30T15:17:13.738142+0000 mon.a (mon.0) 2576 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi072-64171-66"}]: dispatch 2024-03-30T15:17:14.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:14 smithi072 bash[21573]: audit 2024-03-30T15:17:13.738623+0000 mon.c (mon.2) 446 : audit 1 from='client.? 172.21.15.72:0/3589808744' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi072-64171-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:17:14.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:14 smithi072 bash[21573]: audit 2024-03-30T15:17:13.738908+0000 mon.a (mon.0) 2577 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi072-64171-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:17:14.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:14 smithi072 bash[28946]: cluster 2024-03-30T15:17:12.041579+0000 mgr.y (mgr.14526) 383 : cluster 0 pgmap v564: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:17:14.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:14 smithi072 bash[28946]: audit 2024-03-30T15:17:12.676062+0000 mon.a (mon.0) 2569 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi072-64171-65"}]': finished 2024-03-30T15:17:14.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:14 smithi072 bash[28946]: cluster 2024-03-30T15:17:12.682728+0000 mon.a (mon.0) 2570 : cluster 0 osdmap e374: 8 total, 8 up, 8 in 2024-03-30T15:17:14.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:14 smithi072 bash[28946]: audit 2024-03-30T15:17:12.686584+0000 mon.c (mon.2) 443 : audit 1 from='client.? 172.21.15.72:0/715129469' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi072-64171-65"}]: dispatch 2024-03-30T15:17:14.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:14 smithi072 bash[28946]: audit 2024-03-30T15:17:13.149931+0000 mon.a (mon.0) 2571 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi072-64171-65"}]: dispatch 2024-03-30T15:17:14.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:14 smithi072 bash[28946]: audit 2024-03-30T15:17:13.680587+0000 mon.a (mon.0) 2572 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi072-64171-65"}]': finished 2024-03-30T15:17:14.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:14 smithi072 bash[28946]: cluster 2024-03-30T15:17:13.699199+0000 mon.a (mon.0) 2573 : cluster 0 osdmap e375: 8 total, 8 up, 8 in 2024-03-30T15:17:14.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:14 smithi072 bash[28946]: audit 2024-03-30T15:17:13.721366+0000 mon.a (mon.0) 2574 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:17:14.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:14 smithi072 bash[28946]: audit 2024-03-30T15:17:13.736670+0000 mon.c (mon.2) 444 : audit 1 from='client.? 172.21.15.72:0/3589808744' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi072-64171-66"}]: dispatch 2024-03-30T15:17:14.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:14 smithi072 bash[28946]: audit 2024-03-30T15:17:13.737082+0000 mon.a (mon.0) 2575 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi072-64171-66"}]: dispatch 2024-03-30T15:17:14.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:14 smithi072 bash[28946]: audit 2024-03-30T15:17:13.737740+0000 mon.c (mon.2) 445 : audit 1 from='client.? 172.21.15.72:0/3589808744' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi072-64171-66"}]: dispatch 2024-03-30T15:17:14.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:14 smithi072 bash[28946]: audit 2024-03-30T15:17:13.738142+0000 mon.a (mon.0) 2576 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi072-64171-66"}]: dispatch 2024-03-30T15:17:14.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:14 smithi072 bash[28946]: audit 2024-03-30T15:17:13.738623+0000 mon.c (mon.2) 446 : audit 1 from='client.? 172.21.15.72:0/3589808744' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi072-64171-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:17:14.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:14 smithi072 bash[28946]: audit 2024-03-30T15:17:13.738908+0000 mon.a (mon.0) 2577 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi072-64171-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:17:14.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:14 smithi172 bash[23680]: cluster 2024-03-30T15:17:12.041579+0000 mgr.y (mgr.14526) 383 : cluster 0 pgmap v564: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:17:14.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:14 smithi172 bash[23680]: audit 2024-03-30T15:17:12.676062+0000 mon.a (mon.0) 2569 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi072-64171-65"}]': finished 2024-03-30T15:17:14.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:14 smithi172 bash[23680]: cluster 2024-03-30T15:17:12.682728+0000 mon.a (mon.0) 2570 : cluster 0 osdmap e374: 8 total, 8 up, 8 in 2024-03-30T15:17:14.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:14 smithi172 bash[23680]: audit 2024-03-30T15:17:12.686584+0000 mon.c (mon.2) 443 : audit 1 from='client.? 172.21.15.72:0/715129469' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi072-64171-65"}]: dispatch 2024-03-30T15:17:14.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:14 smithi172 bash[23680]: audit 2024-03-30T15:17:13.149931+0000 mon.a (mon.0) 2571 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi072-64171-65"}]: dispatch 2024-03-30T15:17:14.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:14 smithi172 bash[23680]: audit 2024-03-30T15:17:13.680587+0000 mon.a (mon.0) 2572 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi072-64171-65"}]': finished 2024-03-30T15:17:14.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:14 smithi172 bash[23680]: cluster 2024-03-30T15:17:13.699199+0000 mon.a (mon.0) 2573 : cluster 0 osdmap e375: 8 total, 8 up, 8 in 2024-03-30T15:17:14.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:14 smithi172 bash[23680]: audit 2024-03-30T15:17:13.721366+0000 mon.a (mon.0) 2574 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:17:14.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:14 smithi172 bash[23680]: audit 2024-03-30T15:17:13.736670+0000 mon.c (mon.2) 444 : audit 1 from='client.? 172.21.15.72:0/3589808744' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi072-64171-66"}]: dispatch 2024-03-30T15:17:14.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:14 smithi172 bash[23680]: audit 2024-03-30T15:17:13.737082+0000 mon.a (mon.0) 2575 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi072-64171-66"}]: dispatch 2024-03-30T15:17:14.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:14 smithi172 bash[23680]: audit 2024-03-30T15:17:13.737740+0000 mon.c (mon.2) 445 : audit 1 from='client.? 172.21.15.72:0/3589808744' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi072-64171-66"}]: dispatch 2024-03-30T15:17:14.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:14 smithi172 bash[23680]: audit 2024-03-30T15:17:13.738142+0000 mon.a (mon.0) 2576 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi072-64171-66"}]: dispatch 2024-03-30T15:17:14.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:14 smithi172 bash[23680]: audit 2024-03-30T15:17:13.738623+0000 mon.c (mon.2) 446 : audit 1 from='client.? 172.21.15.72:0/3589808744' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi072-64171-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:17:14.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:14 smithi172 bash[23680]: audit 2024-03-30T15:17:13.738908+0000 mon.a (mon.0) 2577 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi072-64171-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:17:16.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:16 smithi072 bash[21573]: cluster 2024-03-30T15:17:14.042523+0000 mgr.y (mgr.14526) 384 : cluster 0 pgmap v567: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:17:16.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:16 smithi072 bash[21573]: audit 2024-03-30T15:17:14.691874+0000 mon.a (mon.0) 2578 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:17:16.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:16 smithi072 bash[21573]: audit 2024-03-30T15:17:14.692090+0000 mon.a (mon.0) 2579 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi072-64171-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:17:16.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:16 smithi072 bash[21573]: cluster 2024-03-30T15:17:14.700204+0000 mon.a (mon.0) 2580 : cluster 0 osdmap e376: 8 total, 8 up, 8 in 2024-03-30T15:17:16.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:16 smithi072 bash[21573]: audit 2024-03-30T15:17:14.702502+0000 mon.c (mon.2) 447 : audit 1 from='client.? 172.21.15.72:0/3589808744' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi072-64171-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi072-64171-66"}]: dispatch 2024-03-30T15:17:16.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:16 smithi072 bash[21573]: audit 2024-03-30T15:17:14.703841+0000 mon.a (mon.0) 2581 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi072-64171-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi072-64171-66"}]: dispatch 2024-03-30T15:17:16.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:16 smithi072 bash[21573]: audit 2024-03-30T15:17:14.750399+0000 mon.a (mon.0) 2582 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-51", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:17:16.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:16 smithi072 bash[28946]: cluster 2024-03-30T15:17:14.042523+0000 mgr.y (mgr.14526) 384 : cluster 0 pgmap v567: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:17:16.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:16 smithi072 bash[28946]: audit 2024-03-30T15:17:14.691874+0000 mon.a (mon.0) 2578 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:17:16.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:16 smithi072 bash[28946]: audit 2024-03-30T15:17:14.692090+0000 mon.a (mon.0) 2579 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi072-64171-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:17:16.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:16 smithi072 bash[28946]: cluster 2024-03-30T15:17:14.700204+0000 mon.a (mon.0) 2580 : cluster 0 osdmap e376: 8 total, 8 up, 8 in 2024-03-30T15:17:16.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:16 smithi072 bash[28946]: audit 2024-03-30T15:17:14.702502+0000 mon.c (mon.2) 447 : audit 1 from='client.? 172.21.15.72:0/3589808744' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi072-64171-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi072-64171-66"}]: dispatch 2024-03-30T15:17:16.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:16 smithi072 bash[28946]: audit 2024-03-30T15:17:14.703841+0000 mon.a (mon.0) 2581 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi072-64171-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi072-64171-66"}]: dispatch 2024-03-30T15:17:16.422 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:16 smithi072 bash[28946]: audit 2024-03-30T15:17:14.750399+0000 mon.a (mon.0) 2582 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-51", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:17:16.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:16 smithi172 bash[23680]: cluster 2024-03-30T15:17:14.042523+0000 mgr.y (mgr.14526) 384 : cluster 0 pgmap v567: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:17:16.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:16 smithi172 bash[23680]: audit 2024-03-30T15:17:14.691874+0000 mon.a (mon.0) 2578 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:17:16.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:16 smithi172 bash[23680]: audit 2024-03-30T15:17:14.692090+0000 mon.a (mon.0) 2579 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi072-64171-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:17:16.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:16 smithi172 bash[23680]: cluster 2024-03-30T15:17:14.700204+0000 mon.a (mon.0) 2580 : cluster 0 osdmap e376: 8 total, 8 up, 8 in 2024-03-30T15:17:16.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:16 smithi172 bash[23680]: audit 2024-03-30T15:17:14.702502+0000 mon.c (mon.2) 447 : audit 1 from='client.? 172.21.15.72:0/3589808744' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi072-64171-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi072-64171-66"}]: dispatch 2024-03-30T15:17:16.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:16 smithi172 bash[23680]: audit 2024-03-30T15:17:14.703841+0000 mon.a (mon.0) 2581 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi072-64171-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi072-64171-66"}]: dispatch 2024-03-30T15:17:16.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:16 smithi172 bash[23680]: audit 2024-03-30T15:17:14.750399+0000 mon.a (mon.0) 2582 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-51", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:17:17.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:17 smithi072 bash[21573]: audit 2024-03-30T15:17:15.695679+0000 mon.a (mon.0) 2583 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-51", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:17:17.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:17 smithi072 bash[21573]: cluster 2024-03-30T15:17:16.044499+0000 mgr.y (mgr.14526) 385 : cluster 0 pgmap v570: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-03-30T15:17:17.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:17 smithi072 bash[21573]: cluster 2024-03-30T15:17:16.148050+0000 mon.a (mon.0) 2584 : cluster 0 osdmap e377: 8 total, 8 up, 8 in 2024-03-30T15:17:17.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:17 smithi072 bash[21573]: audit 2024-03-30T15:17:16.149772+0000 mon.a (mon.0) 2585 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-51"}]: dispatch 2024-03-30T15:17:17.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:17 smithi072 bash[21573]: cluster 2024-03-30T15:17:16.695583+0000 mon.a (mon.0) 2586 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:17:17.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:17 smithi072 bash[21573]: audit 2024-03-30T15:17:16.706740+0000 mon.a (mon.0) 2587 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi072-64171-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi072-64171-66"}]': finished 2024-03-30T15:17:17.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:17 smithi072 bash[21573]: audit 2024-03-30T15:17:16.706974+0000 mon.a (mon.0) 2588 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-51"}]': finished 2024-03-30T15:17:17.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:17 smithi072 bash[21573]: cluster 2024-03-30T15:17:16.713114+0000 mon.a (mon.0) 2589 : cluster 0 osdmap e378: 8 total, 8 up, 8 in 2024-03-30T15:17:17.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:17 smithi072 bash[21573]: audit 2024-03-30T15:17:16.714035+0000 mon.a (mon.0) 2590 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-51", "mode": "writeback"}]: dispatch 2024-03-30T15:17:17.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:17 smithi072 bash[28946]: audit 2024-03-30T15:17:15.695679+0000 mon.a (mon.0) 2583 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-51", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:17:17.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:17 smithi072 bash[28946]: cluster 2024-03-30T15:17:16.044499+0000 mgr.y (mgr.14526) 385 : cluster 0 pgmap v570: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-03-30T15:17:17.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:17 smithi072 bash[28946]: cluster 2024-03-30T15:17:16.148050+0000 mon.a (mon.0) 2584 : cluster 0 osdmap e377: 8 total, 8 up, 8 in 2024-03-30T15:17:17.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:17 smithi072 bash[28946]: audit 2024-03-30T15:17:16.149772+0000 mon.a (mon.0) 2585 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-51"}]: dispatch 2024-03-30T15:17:17.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:17 smithi072 bash[28946]: cluster 2024-03-30T15:17:16.695583+0000 mon.a (mon.0) 2586 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:17:17.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:17 smithi072 bash[28946]: audit 2024-03-30T15:17:16.706740+0000 mon.a (mon.0) 2587 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi072-64171-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi072-64171-66"}]': finished 2024-03-30T15:17:17.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:17 smithi072 bash[28946]: audit 2024-03-30T15:17:16.706974+0000 mon.a (mon.0) 2588 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-51"}]': finished 2024-03-30T15:17:17.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:17 smithi072 bash[28946]: cluster 2024-03-30T15:17:16.713114+0000 mon.a (mon.0) 2589 : cluster 0 osdmap e378: 8 total, 8 up, 8 in 2024-03-30T15:17:17.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:17 smithi072 bash[28946]: audit 2024-03-30T15:17:16.714035+0000 mon.a (mon.0) 2590 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-51", "mode": "writeback"}]: dispatch 2024-03-30T15:17:17.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:17 smithi172 bash[23680]: audit 2024-03-30T15:17:15.695679+0000 mon.a (mon.0) 2583 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-51", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:17:17.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:17 smithi172 bash[23680]: cluster 2024-03-30T15:17:16.044499+0000 mgr.y (mgr.14526) 385 : cluster 0 pgmap v570: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-03-30T15:17:17.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:17 smithi172 bash[23680]: cluster 2024-03-30T15:17:16.148050+0000 mon.a (mon.0) 2584 : cluster 0 osdmap e377: 8 total, 8 up, 8 in 2024-03-30T15:17:17.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:17 smithi172 bash[23680]: audit 2024-03-30T15:17:16.149772+0000 mon.a (mon.0) 2585 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-51"}]: dispatch 2024-03-30T15:17:17.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:17 smithi172 bash[23680]: cluster 2024-03-30T15:17:16.695583+0000 mon.a (mon.0) 2586 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:17:17.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:17 smithi172 bash[23680]: audit 2024-03-30T15:17:16.706740+0000 mon.a (mon.0) 2587 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi072-64171-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi072-64171-66"}]': finished 2024-03-30T15:17:17.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:17 smithi172 bash[23680]: audit 2024-03-30T15:17:16.706974+0000 mon.a (mon.0) 2588 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-51"}]': finished 2024-03-30T15:17:17.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:17 smithi172 bash[23680]: cluster 2024-03-30T15:17:16.713114+0000 mon.a (mon.0) 2589 : cluster 0 osdmap e378: 8 total, 8 up, 8 in 2024-03-30T15:17:17.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:17 smithi172 bash[23680]: audit 2024-03-30T15:17:16.714035+0000 mon.a (mon.0) 2590 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-51", "mode": "writeback"}]: dispatch 2024-03-30T15:17:18.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:18 smithi072 bash[21573]: cluster 2024-03-30T15:17:17.707211+0000 mon.a (mon.0) 2591 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:17:18.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:18 smithi072 bash[21573]: audit 2024-03-30T15:17:17.711350+0000 mon.a (mon.0) 2592 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-51", "mode": "writeback"}]': finished 2024-03-30T15:17:18.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:18 smithi072 bash[21573]: cluster 2024-03-30T15:17:17.719042+0000 mon.a (mon.0) 2593 : cluster 0 osdmap e379: 8 total, 8 up, 8 in 2024-03-30T15:17:18.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:18 smithi072 bash[21573]: audit 2024-03-30T15:17:17.814913+0000 mon.a (mon.0) 2594 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-51","var": "hit_set_count","val": "2"}]: dispatch 2024-03-30T15:17:18.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:18 smithi072 bash[28946]: cluster 2024-03-30T15:17:17.707211+0000 mon.a (mon.0) 2591 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:17:18.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:18 smithi072 bash[28946]: audit 2024-03-30T15:17:17.711350+0000 mon.a (mon.0) 2592 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-51", "mode": "writeback"}]': finished 2024-03-30T15:17:18.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:18 smithi072 bash[28946]: cluster 2024-03-30T15:17:17.719042+0000 mon.a (mon.0) 2593 : cluster 0 osdmap e379: 8 total, 8 up, 8 in 2024-03-30T15:17:18.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:18 smithi072 bash[28946]: audit 2024-03-30T15:17:17.814913+0000 mon.a (mon.0) 2594 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-51","var": "hit_set_count","val": "2"}]: dispatch 2024-03-30T15:17:18.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:18 smithi172 bash[23680]: cluster 2024-03-30T15:17:17.707211+0000 mon.a (mon.0) 2591 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:17:18.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:18 smithi172 bash[23680]: audit 2024-03-30T15:17:17.711350+0000 mon.a (mon.0) 2592 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-51", "mode": "writeback"}]': finished 2024-03-30T15:17:18.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:18 smithi172 bash[23680]: cluster 2024-03-30T15:17:17.719042+0000 mon.a (mon.0) 2593 : cluster 0 osdmap e379: 8 total, 8 up, 8 in 2024-03-30T15:17:18.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:18 smithi172 bash[23680]: audit 2024-03-30T15:17:17.814913+0000 mon.a (mon.0) 2594 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-51","var": "hit_set_count","val": "2"}]: dispatch 2024-03-30T15:17:20.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:19 smithi072 bash[21573]: cluster 2024-03-30T15:17:18.045455+0000 mgr.y (mgr.14526) 386 : cluster 0 pgmap v573: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-03-30T15:17:20.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:19 smithi072 bash[21573]: audit 2024-03-30T15:17:18.720800+0000 mon.a (mon.0) 2595 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-51","var": "hit_set_count","val": "2"}]': finished 2024-03-30T15:17:20.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:19 smithi072 bash[21573]: cluster 2024-03-30T15:17:18.729305+0000 mon.a (mon.0) 2596 : cluster 0 osdmap e380: 8 total, 8 up, 8 in 2024-03-30T15:17:20.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:19 smithi072 bash[21573]: audit 2024-03-30T15:17:18.731279+0000 mon.a (mon.0) 2597 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-51","var": "hit_set_period","val": "600"}]: dispatch 2024-03-30T15:17:20.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:19 smithi072 bash[21573]: audit 2024-03-30T15:17:18.736142+0000 mon.c (mon.2) 448 : audit 1 from='client.? 172.21.15.72:0/3589808744' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi072-64171-66"}]: dispatch 2024-03-30T15:17:20.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:19 smithi072 bash[21573]: audit 2024-03-30T15:17:18.737257+0000 mon.a (mon.0) 2598 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi072-64171-66"}]: dispatch 2024-03-30T15:17:20.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:19 smithi072 bash[28946]: cluster 2024-03-30T15:17:18.045455+0000 mgr.y (mgr.14526) 386 : cluster 0 pgmap v573: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-03-30T15:17:20.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:19 smithi072 bash[28946]: audit 2024-03-30T15:17:18.720800+0000 mon.a (mon.0) 2595 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-51","var": "hit_set_count","val": "2"}]': finished 2024-03-30T15:17:20.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:19 smithi072 bash[28946]: cluster 2024-03-30T15:17:18.729305+0000 mon.a (mon.0) 2596 : cluster 0 osdmap e380: 8 total, 8 up, 8 in 2024-03-30T15:17:20.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:19 smithi072 bash[28946]: audit 2024-03-30T15:17:18.731279+0000 mon.a (mon.0) 2597 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-51","var": "hit_set_period","val": "600"}]: dispatch 2024-03-30T15:17:20.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:19 smithi072 bash[28946]: audit 2024-03-30T15:17:18.736142+0000 mon.c (mon.2) 448 : audit 1 from='client.? 172.21.15.72:0/3589808744' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi072-64171-66"}]: dispatch 2024-03-30T15:17:20.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:19 smithi072 bash[28946]: audit 2024-03-30T15:17:18.737257+0000 mon.a (mon.0) 2598 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi072-64171-66"}]: dispatch 2024-03-30T15:17:20.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:19 smithi172 bash[23680]: cluster 2024-03-30T15:17:18.045455+0000 mgr.y (mgr.14526) 386 : cluster 0 pgmap v573: 236 pgs: 8 unknown, 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-03-30T15:17:20.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:19 smithi172 bash[23680]: audit 2024-03-30T15:17:18.720800+0000 mon.a (mon.0) 2595 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-51","var": "hit_set_count","val": "2"}]': finished 2024-03-30T15:17:20.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:19 smithi172 bash[23680]: cluster 2024-03-30T15:17:18.729305+0000 mon.a (mon.0) 2596 : cluster 0 osdmap e380: 8 total, 8 up, 8 in 2024-03-30T15:17:20.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:19 smithi172 bash[23680]: audit 2024-03-30T15:17:18.731279+0000 mon.a (mon.0) 2597 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-51","var": "hit_set_period","val": "600"}]: dispatch 2024-03-30T15:17:20.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:19 smithi172 bash[23680]: audit 2024-03-30T15:17:18.736142+0000 mon.c (mon.2) 448 : audit 1 from='client.? 172.21.15.72:0/3589808744' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi072-64171-66"}]: dispatch 2024-03-30T15:17:20.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:19 smithi172 bash[23680]: audit 2024-03-30T15:17:18.737257+0000 mon.a (mon.0) 2598 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi072-64171-66"}]: dispatch 2024-03-30T15:17:20.742 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ P2 2024-03-30T15:17:20.743 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP2 (3067 ms) 2024-03-30T15:17:20.743 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPP 2024-03-30T15:17:20.743 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPP (7066 ms) 2024-03-30T15:17:20.743 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPPNS 2024-03-30T15:17:20.743 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPPNS (7030 ms) 2024-03-30T15:17:20.743 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.StatRemovePP 2024-03-30T15:17:20.743 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAioEC.StatRemovePP (7047 ms) 2024-03-30T15:17:20.743 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ExecuteClassPP 2024-03-30T15:17:20.743 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ExecuteClassPP (7058 ms) 2024-03-30T15:17:20.743 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.OmapPP 2024-03-30T15:17:20.743 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAioEC.OmapPP (7107 ms) 2024-03-30T15:17:20.743 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.MultiWritePP 2024-03-30T15:17:20.743 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ OK ] LibRadosAioEC.MultiWritePP (7032 ms) 2024-03-30T15:17:20.743 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC (139633 ms total) 2024-03-30T15:17:20.744 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: 2024-03-30T15:17:20.744 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [----------] Global test environment tear-down 2024-03-30T15:17:20.744 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [==========] 57 tests from 4 test suites ran. (328799 ms total) 2024-03-30T15:17:20.744 INFO:tasks.workunit.client.0.smithi072.stdout: api_aio_pp: [ PASSED ] 57 tests. 2024-03-30T15:17:21.030 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:20 smithi072 bash[28946]: audit 2024-03-30T15:17:19.723688+0000 mon.a (mon.0) 2599 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-51","var": "hit_set_period","val": "600"}]': finished 2024-03-30T15:17:21.030 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:20 smithi072 bash[28946]: audit 2024-03-30T15:17:19.723825+0000 mon.a (mon.0) 2600 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi072-64171-66"}]': finished 2024-03-30T15:17:21.030 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:20 smithi072 bash[28946]: cluster 2024-03-30T15:17:19.732557+0000 mon.a (mon.0) 2601 : cluster 0 osdmap e381: 8 total, 8 up, 8 in 2024-03-30T15:17:21.030 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:20 smithi072 bash[28946]: audit 2024-03-30T15:17:19.733729+0000 mon.c (mon.2) 449 : audit 1 from='client.? 172.21.15.72:0/3589808744' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi072-64171-66"}]: dispatch 2024-03-30T15:17:21.030 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:20 smithi072 bash[28946]: audit 2024-03-30T15:17:19.736009+0000 mon.a (mon.0) 2602 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-51","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-30T15:17:21.031 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:20 smithi072 bash[28946]: audit 2024-03-30T15:17:19.737355+0000 mon.a (mon.0) 2603 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi072-64171-66"}]: dispatch 2024-03-30T15:17:21.031 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:20 smithi072 bash[28946]: cluster 2024-03-30T15:17:20.724655+0000 mon.a (mon.0) 2604 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:17:21.031 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:20 smithi072 bash[28946]: audit 2024-03-30T15:17:20.727119+0000 mon.a (mon.0) 2605 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-51","var": "hit_set_type","val": "bloom"}]': finished 2024-03-30T15:17:21.031 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:20 smithi072 bash[28946]: audit 2024-03-30T15:17:20.727319+0000 mon.a (mon.0) 2606 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi072-64171-66"}]': finished 2024-03-30T15:17:21.031 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:20 smithi072 bash[28946]: cluster 2024-03-30T15:17:20.734387+0000 mon.a (mon.0) 2607 : cluster 0 osdmap e382: 8 total, 8 up, 8 in 2024-03-30T15:17:21.031 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:20 smithi072 bash[28946]: audit 2024-03-30T15:17:20.737760+0000 mon.a (mon.0) 2608 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-03-30T15:17:21.032 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:20 smithi072 bash[21573]: audit 2024-03-30T15:17:19.723688+0000 mon.a (mon.0) 2599 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-51","var": "hit_set_period","val": "600"}]': finished 2024-03-30T15:17:21.032 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:20 smithi072 bash[21573]: audit 2024-03-30T15:17:19.723825+0000 mon.a (mon.0) 2600 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi072-64171-66"}]': finished 2024-03-30T15:17:21.032 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:20 smithi072 bash[21573]: cluster 2024-03-30T15:17:19.732557+0000 mon.a (mon.0) 2601 : cluster 0 osdmap e381: 8 total, 8 up, 8 in 2024-03-30T15:17:21.032 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:20 smithi072 bash[21573]: audit 2024-03-30T15:17:19.733729+0000 mon.c (mon.2) 449 : audit 1 from='client.? 172.21.15.72:0/3589808744' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi072-64171-66"}]: dispatch 2024-03-30T15:17:21.032 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:20 smithi072 bash[21573]: audit 2024-03-30T15:17:19.736009+0000 mon.a (mon.0) 2602 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-51","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-30T15:17:21.033 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:20 smithi072 bash[21573]: audit 2024-03-30T15:17:19.737355+0000 mon.a (mon.0) 2603 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi072-64171-66"}]: dispatch 2024-03-30T15:17:21.033 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:20 smithi072 bash[21573]: cluster 2024-03-30T15:17:20.724655+0000 mon.a (mon.0) 2604 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:17:21.033 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:20 smithi072 bash[21573]: audit 2024-03-30T15:17:20.727119+0000 mon.a (mon.0) 2605 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-51","var": "hit_set_type","val": "bloom"}]': finished 2024-03-30T15:17:21.033 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:20 smithi072 bash[21573]: audit 2024-03-30T15:17:20.727319+0000 mon.a (mon.0) 2606 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi072-64171-66"}]': finished 2024-03-30T15:17:21.033 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:20 smithi072 bash[21573]: cluster 2024-03-30T15:17:20.734387+0000 mon.a (mon.0) 2607 : cluster 0 osdmap e382: 8 total, 8 up, 8 in 2024-03-30T15:17:21.033 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:20 smithi072 bash[21573]: audit 2024-03-30T15:17:20.737760+0000 mon.a (mon.0) 2608 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-03-30T15:17:21.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:20 smithi172 bash[23680]: audit 2024-03-30T15:17:19.723688+0000 mon.a (mon.0) 2599 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-51","var": "hit_set_period","val": "600"}]': finished 2024-03-30T15:17:21.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:20 smithi172 bash[23680]: audit 2024-03-30T15:17:19.723825+0000 mon.a (mon.0) 2600 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi072-64171-66"}]': finished 2024-03-30T15:17:21.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:20 smithi172 bash[23680]: cluster 2024-03-30T15:17:19.732557+0000 mon.a (mon.0) 2601 : cluster 0 osdmap e381: 8 total, 8 up, 8 in 2024-03-30T15:17:21.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:20 smithi172 bash[23680]: audit 2024-03-30T15:17:19.733729+0000 mon.c (mon.2) 449 : audit 1 from='client.? 172.21.15.72:0/3589808744' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi072-64171-66"}]: dispatch 2024-03-30T15:17:21.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:20 smithi172 bash[23680]: audit 2024-03-30T15:17:19.736009+0000 mon.a (mon.0) 2602 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-51","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-30T15:17:21.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:20 smithi172 bash[23680]: audit 2024-03-30T15:17:19.737355+0000 mon.a (mon.0) 2603 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi072-64171-66"}]: dispatch 2024-03-30T15:17:21.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:20 smithi172 bash[23680]: cluster 2024-03-30T15:17:20.724655+0000 mon.a (mon.0) 2604 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:17:21.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:20 smithi172 bash[23680]: audit 2024-03-30T15:17:20.727119+0000 mon.a (mon.0) 2605 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-51","var": "hit_set_type","val": "bloom"}]': finished 2024-03-30T15:17:21.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:20 smithi172 bash[23680]: audit 2024-03-30T15:17:20.727319+0000 mon.a (mon.0) 2606 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi072-64171-66"}]': finished 2024-03-30T15:17:21.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:20 smithi172 bash[23680]: cluster 2024-03-30T15:17:20.734387+0000 mon.a (mon.0) 2607 : cluster 0 osdmap e382: 8 total, 8 up, 8 in 2024-03-30T15:17:21.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:20 smithi172 bash[23680]: audit 2024-03-30T15:17:20.737760+0000 mon.a (mon.0) 2608 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-03-30T15:17:21.416 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:17:21 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:17:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:17:21.714 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:17:21 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:17:22.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:21 smithi072 bash[21573]: cluster 2024-03-30T15:17:20.046239+0000 mgr.y (mgr.14526) 387 : cluster 0 pgmap v576: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:17:22.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:21 smithi072 bash[21573]: audit 2024-03-30T15:17:21.210457+0000 mon.a (mon.0) 2609 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:17:22.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:21 smithi072 bash[21573]: audit 2024-03-30T15:17:21.213564+0000 mon.c (mon.2) 450 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:17:22.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:21 smithi072 bash[21573]: audit 2024-03-30T15:17:21.235525+0000 mgr.y (mgr.14526) 388 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:17:22.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:21 smithi072 bash[21573]: audit 2024-03-30T15:17:21.729629+0000 mon.a (mon.0) 2610 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-51","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-03-30T15:17:22.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:21 smithi072 bash[21573]: cluster 2024-03-30T15:17:21.737513+0000 mon.a (mon.0) 2611 : cluster 0 osdmap e383: 8 total, 8 up, 8 in 2024-03-30T15:17:22.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:21 smithi072 bash[21573]: audit 2024-03-30T15:17:21.738976+0000 mon.a (mon.0) 2612 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-51","var": "target_max_objects","val": "1"}]: dispatch 2024-03-30T15:17:22.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:21 smithi072 bash[28946]: cluster 2024-03-30T15:17:20.046239+0000 mgr.y (mgr.14526) 387 : cluster 0 pgmap v576: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:17:22.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:21 smithi072 bash[28946]: audit 2024-03-30T15:17:21.210457+0000 mon.a (mon.0) 2609 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:17:22.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:21 smithi072 bash[28946]: audit 2024-03-30T15:17:21.213564+0000 mon.c (mon.2) 450 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:17:22.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:21 smithi072 bash[28946]: audit 2024-03-30T15:17:21.235525+0000 mgr.y (mgr.14526) 388 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:17:22.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:21 smithi072 bash[28946]: audit 2024-03-30T15:17:21.729629+0000 mon.a (mon.0) 2610 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-51","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-03-30T15:17:22.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:21 smithi072 bash[28946]: cluster 2024-03-30T15:17:21.737513+0000 mon.a (mon.0) 2611 : cluster 0 osdmap e383: 8 total, 8 up, 8 in 2024-03-30T15:17:22.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:21 smithi072 bash[28946]: audit 2024-03-30T15:17:21.738976+0000 mon.a (mon.0) 2612 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-51","var": "target_max_objects","val": "1"}]: dispatch 2024-03-30T15:17:22.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:21 smithi172 bash[23680]: cluster 2024-03-30T15:17:20.046239+0000 mgr.y (mgr.14526) 387 : cluster 0 pgmap v576: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:17:22.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:21 smithi172 bash[23680]: audit 2024-03-30T15:17:21.210457+0000 mon.a (mon.0) 2609 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:17:22.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:21 smithi172 bash[23680]: audit 2024-03-30T15:17:21.213564+0000 mon.c (mon.2) 450 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:17:22.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:21 smithi172 bash[23680]: audit 2024-03-30T15:17:21.235525+0000 mgr.y (mgr.14526) 388 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:17:22.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:21 smithi172 bash[23680]: audit 2024-03-30T15:17:21.729629+0000 mon.a (mon.0) 2610 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-51","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-03-30T15:17:22.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:21 smithi172 bash[23680]: cluster 2024-03-30T15:17:21.737513+0000 mon.a (mon.0) 2611 : cluster 0 osdmap e383: 8 total, 8 up, 8 in 2024-03-30T15:17:22.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:21 smithi172 bash[23680]: audit 2024-03-30T15:17:21.738976+0000 mon.a (mon.0) 2612 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-51","var": "target_max_objects","val": "1"}]: dispatch 2024-03-30T15:17:24.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:23 smithi072 bash[21573]: cluster 2024-03-30T15:17:22.047155+0000 mgr.y (mgr.14526) 389 : cluster 0 pgmap v579: 228 pgs: 228 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-30T15:17:24.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:23 smithi072 bash[21573]: audit 2024-03-30T15:17:22.732537+0000 mon.a (mon.0) 2613 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-51","var": "target_max_objects","val": "1"}]': finished 2024-03-30T15:17:24.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:23 smithi072 bash[21573]: cluster 2024-03-30T15:17:22.740130+0000 mon.a (mon.0) 2614 : cluster 0 osdmap e384: 8 total, 8 up, 8 in 2024-03-30T15:17:24.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:23 smithi072 bash[28946]: cluster 2024-03-30T15:17:22.047155+0000 mgr.y (mgr.14526) 389 : cluster 0 pgmap v579: 228 pgs: 228 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-30T15:17:24.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:23 smithi072 bash[28946]: audit 2024-03-30T15:17:22.732537+0000 mon.a (mon.0) 2613 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-51","var": "target_max_objects","val": "1"}]': finished 2024-03-30T15:17:24.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:23 smithi072 bash[28946]: cluster 2024-03-30T15:17:22.740130+0000 mon.a (mon.0) 2614 : cluster 0 osdmap e384: 8 total, 8 up, 8 in 2024-03-30T15:17:24.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:23 smithi172 bash[23680]: cluster 2024-03-30T15:17:22.047155+0000 mgr.y (mgr.14526) 389 : cluster 0 pgmap v579: 228 pgs: 228 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-30T15:17:24.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:23 smithi172 bash[23680]: audit 2024-03-30T15:17:22.732537+0000 mon.a (mon.0) 2613 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-51","var": "target_max_objects","val": "1"}]': finished 2024-03-30T15:17:24.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:23 smithi172 bash[23680]: cluster 2024-03-30T15:17:22.740130+0000 mon.a (mon.0) 2614 : cluster 0 osdmap e384: 8 total, 8 up, 8 in 2024-03-30T15:17:25.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:24 smithi072 bash[21573]: cluster 2024-03-30T15:17:24.048082+0000 mgr.y (mgr.14526) 390 : cluster 0 pgmap v581: 228 pgs: 228 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-30T15:17:25.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:24 smithi072 bash[21573]: cluster 2024-03-30T15:17:24.734514+0000 mon.a (mon.0) 2615 : cluster 3 Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-03-30T15:17:25.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:24 smithi072 bash[28946]: cluster 2024-03-30T15:17:24.048082+0000 mgr.y (mgr.14526) 390 : cluster 0 pgmap v581: 228 pgs: 228 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-30T15:17:25.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:24 smithi072 bash[28946]: cluster 2024-03-30T15:17:24.734514+0000 mon.a (mon.0) 2615 : cluster 3 Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-03-30T15:17:25.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:24 smithi172 bash[23680]: cluster 2024-03-30T15:17:24.048082+0000 mgr.y (mgr.14526) 390 : cluster 0 pgmap v581: 228 pgs: 228 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-30T15:17:25.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:24 smithi172 bash[23680]: cluster 2024-03-30T15:17:24.734514+0000 mon.a (mon.0) 2615 : cluster 3 Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-03-30T15:17:27.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:27 smithi072 bash[21573]: cluster 2024-03-30T15:17:26.050201+0000 mgr.y (mgr.14526) 391 : cluster 0 pgmap v582: 228 pgs: 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-30T15:17:27.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:27 smithi072 bash[28946]: cluster 2024-03-30T15:17:26.050201+0000 mgr.y (mgr.14526) 391 : cluster 0 pgmap v582: 228 pgs: 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-30T15:17:27.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:27 smithi172 bash[23680]: cluster 2024-03-30T15:17:26.050201+0000 mgr.y (mgr.14526) 391 : cluster 0 pgmap v582: 228 pgs: 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-30T15:17:29.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:29 smithi072 bash[21573]: cluster 2024-03-30T15:17:28.051056+0000 mgr.y (mgr.14526) 392 : cluster 0 pgmap v583: 228 pgs: 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-30T15:17:29.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:29 smithi072 bash[28946]: cluster 2024-03-30T15:17:28.051056+0000 mgr.y (mgr.14526) 392 : cluster 0 pgmap v583: 228 pgs: 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-30T15:17:29.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:29 smithi172 bash[23680]: cluster 2024-03-30T15:17:28.051056+0000 mgr.y (mgr.14526) 392 : cluster 0 pgmap v583: 228 pgs: 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-30T15:17:31.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:31 smithi072 bash[21573]: cluster 2024-03-30T15:17:30.051900+0000 mgr.y (mgr.14526) 393 : cluster 0 pgmap v584: 228 pgs: 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 615 B/s rd, 0 B/s wr, 0 op/s 2024-03-30T15:17:31.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:31 smithi072 bash[28946]: cluster 2024-03-30T15:17:30.051900+0000 mgr.y (mgr.14526) 393 : cluster 0 pgmap v584: 228 pgs: 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 615 B/s rd, 0 B/s wr, 0 op/s 2024-03-30T15:17:31.417 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:17:31 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:17:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:17:31.464 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:17:31 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:17:31.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:31 smithi172 bash[23680]: cluster 2024-03-30T15:17:30.051900+0000 mgr.y (mgr.14526) 393 : cluster 0 pgmap v584: 228 pgs: 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 615 B/s rd, 0 B/s wr, 0 op/s 2024-03-30T15:17:32.416 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:32 smithi072 bash[28946]: audit 2024-03-30T15:17:31.243374+0000 mgr.y (mgr.14526) 394 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:17:32.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:32 smithi072 bash[21573]: audit 2024-03-30T15:17:31.243374+0000 mgr.y (mgr.14526) 394 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:17:32.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:32 smithi172 bash[23680]: audit 2024-03-30T15:17:31.243374+0000 mgr.y (mgr.14526) 394 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:17:33.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:33 smithi072 bash[21573]: cluster 2024-03-30T15:17:32.054155+0000 mgr.y (mgr.14526) 395 : cluster 0 pgmap v585: 228 pgs: 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:17:33.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:33 smithi072 bash[21573]: audit 2024-03-30T15:17:32.765810+0000 mon.a (mon.0) 2616 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:17:33.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:33 smithi072 bash[28946]: cluster 2024-03-30T15:17:32.054155+0000 mgr.y (mgr.14526) 395 : cluster 0 pgmap v585: 228 pgs: 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:17:33.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:33 smithi072 bash[28946]: audit 2024-03-30T15:17:32.765810+0000 mon.a (mon.0) 2616 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:17:33.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:33 smithi172 bash[23680]: cluster 2024-03-30T15:17:32.054155+0000 mgr.y (mgr.14526) 395 : cluster 0 pgmap v585: 228 pgs: 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:17:33.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:33 smithi172 bash[23680]: audit 2024-03-30T15:17:32.765810+0000 mon.a (mon.0) 2616 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:17:34.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:34 smithi072 bash[21573]: audit 2024-03-30T15:17:33.130767+0000 mon.a (mon.0) 2617 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:17:34.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:34 smithi072 bash[21573]: cluster 2024-03-30T15:17:33.139759+0000 mon.a (mon.0) 2618 : cluster 0 osdmap e385: 8 total, 8 up, 8 in 2024-03-30T15:17:34.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:34 smithi072 bash[21573]: audit 2024-03-30T15:17:33.143753+0000 mon.a (mon.0) 2619 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-51"}]: dispatch 2024-03-30T15:17:34.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:34 smithi072 bash[21573]: audit 2024-03-30T15:17:34.133517+0000 mon.a (mon.0) 2620 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-51"}]': finished 2024-03-30T15:17:34.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:34 smithi072 bash[21573]: cluster 2024-03-30T15:17:34.143093+0000 mon.a (mon.0) 2621 : cluster 0 osdmap e386: 8 total, 8 up, 8 in 2024-03-30T15:17:34.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:34 smithi072 bash[28946]: audit 2024-03-30T15:17:33.130767+0000 mon.a (mon.0) 2617 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:17:34.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:34 smithi072 bash[28946]: cluster 2024-03-30T15:17:33.139759+0000 mon.a (mon.0) 2618 : cluster 0 osdmap e385: 8 total, 8 up, 8 in 2024-03-30T15:17:34.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:34 smithi072 bash[28946]: audit 2024-03-30T15:17:33.143753+0000 mon.a (mon.0) 2619 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-51"}]: dispatch 2024-03-30T15:17:34.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:34 smithi072 bash[28946]: audit 2024-03-30T15:17:34.133517+0000 mon.a (mon.0) 2620 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-51"}]': finished 2024-03-30T15:17:34.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:34 smithi072 bash[28946]: cluster 2024-03-30T15:17:34.143093+0000 mon.a (mon.0) 2621 : cluster 0 osdmap e386: 8 total, 8 up, 8 in 2024-03-30T15:17:34.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:34 smithi172 bash[23680]: audit 2024-03-30T15:17:33.130767+0000 mon.a (mon.0) 2617 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:17:34.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:34 smithi172 bash[23680]: cluster 2024-03-30T15:17:33.139759+0000 mon.a (mon.0) 2618 : cluster 0 osdmap e385: 8 total, 8 up, 8 in 2024-03-30T15:17:34.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:34 smithi172 bash[23680]: audit 2024-03-30T15:17:33.143753+0000 mon.a (mon.0) 2619 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-51"}]: dispatch 2024-03-30T15:17:34.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:34 smithi172 bash[23680]: audit 2024-03-30T15:17:34.133517+0000 mon.a (mon.0) 2620 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-51"}]': finished 2024-03-30T15:17:34.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:34 smithi172 bash[23680]: cluster 2024-03-30T15:17:34.143093+0000 mon.a (mon.0) 2621 : cluster 0 osdmap e386: 8 total, 8 up, 8 in 2024-03-30T15:17:35.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:35 smithi072 bash[21573]: cluster 2024-03-30T15:17:34.055030+0000 mgr.y (mgr.14526) 396 : cluster 0 pgmap v587: 228 pgs: 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:17:35.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:35 smithi072 bash[21573]: audit 2024-03-30T15:17:34.222939+0000 mon.a (mon.0) 2622 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:17:35.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:35 smithi072 bash[21573]: audit 2024-03-30T15:17:34.224124+0000 mon.a (mon.0) 2623 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-51"}]: dispatch 2024-03-30T15:17:35.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:35 smithi072 bash[28946]: cluster 2024-03-30T15:17:34.055030+0000 mgr.y (mgr.14526) 396 : cluster 0 pgmap v587: 228 pgs: 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:17:35.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:35 smithi072 bash[28946]: audit 2024-03-30T15:17:34.222939+0000 mon.a (mon.0) 2622 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:17:35.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:35 smithi072 bash[28946]: audit 2024-03-30T15:17:34.224124+0000 mon.a (mon.0) 2623 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-51"}]: dispatch 2024-03-30T15:17:35.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:35 smithi172 bash[23680]: cluster 2024-03-30T15:17:34.055030+0000 mgr.y (mgr.14526) 396 : cluster 0 pgmap v587: 228 pgs: 228 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:17:35.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:35 smithi172 bash[23680]: audit 2024-03-30T15:17:34.222939+0000 mon.a (mon.0) 2622 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:17:35.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:35 smithi172 bash[23680]: audit 2024-03-30T15:17:34.224124+0000 mon.a (mon.0) 2623 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-51"}]: dispatch 2024-03-30T15:17:36.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:36 smithi172 bash[23680]: cluster 2024-03-30T15:17:35.178708+0000 mon.a (mon.0) 2624 : cluster 0 osdmap e387: 8 total, 8 up, 8 in 2024-03-30T15:17:36.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:36 smithi072 bash[21573]: cluster 2024-03-30T15:17:35.178708+0000 mon.a (mon.0) 2624 : cluster 0 osdmap e387: 8 total, 8 up, 8 in 2024-03-30T15:17:36.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:36 smithi072 bash[28946]: cluster 2024-03-30T15:17:35.178708+0000 mon.a (mon.0) 2624 : cluster 0 osdmap e387: 8 total, 8 up, 8 in 2024-03-30T15:17:37.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:37 smithi172 bash[23680]: cluster 2024-03-30T15:17:36.056932+0000 mgr.y (mgr.14526) 397 : cluster 0 pgmap v590: 196 pgs: 196 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T15:17:37.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:37 smithi172 bash[23680]: cluster 2024-03-30T15:17:36.170993+0000 mon.a (mon.0) 2625 : cluster 1 Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-03-30T15:17:37.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:37 smithi172 bash[23680]: cluster 2024-03-30T15:17:36.194891+0000 mon.a (mon.0) 2626 : cluster 0 osdmap e388: 8 total, 8 up, 8 in 2024-03-30T15:17:37.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:37 smithi172 bash[23680]: audit 2024-03-30T15:17:36.201583+0000 mon.a (mon.0) 2627 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:17:37.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:37 smithi172 bash[23680]: audit 2024-03-30T15:17:36.247001+0000 mon.c (mon.2) 451 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:17:37.666 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:37 smithi072 bash[28946]: cluster 2024-03-30T15:17:36.056932+0000 mgr.y (mgr.14526) 397 : cluster 0 pgmap v590: 196 pgs: 196 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T15:17:37.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:37 smithi072 bash[28946]: cluster 2024-03-30T15:17:36.170993+0000 mon.a (mon.0) 2625 : cluster 1 Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-03-30T15:17:37.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:37 smithi072 bash[28946]: cluster 2024-03-30T15:17:36.194891+0000 mon.a (mon.0) 2626 : cluster 0 osdmap e388: 8 total, 8 up, 8 in 2024-03-30T15:17:37.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:37 smithi072 bash[28946]: audit 2024-03-30T15:17:36.201583+0000 mon.a (mon.0) 2627 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:17:37.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:37 smithi072 bash[28946]: audit 2024-03-30T15:17:36.247001+0000 mon.c (mon.2) 451 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:17:37.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:37 smithi072 bash[21573]: cluster 2024-03-30T15:17:36.056932+0000 mgr.y (mgr.14526) 397 : cluster 0 pgmap v590: 196 pgs: 196 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T15:17:37.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:37 smithi072 bash[21573]: cluster 2024-03-30T15:17:36.170993+0000 mon.a (mon.0) 2625 : cluster 1 Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-03-30T15:17:37.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:37 smithi072 bash[21573]: cluster 2024-03-30T15:17:36.194891+0000 mon.a (mon.0) 2626 : cluster 0 osdmap e388: 8 total, 8 up, 8 in 2024-03-30T15:17:37.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:37 smithi072 bash[21573]: audit 2024-03-30T15:17:36.201583+0000 mon.a (mon.0) 2627 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:17:37.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:37 smithi072 bash[21573]: audit 2024-03-30T15:17:36.247001+0000 mon.c (mon.2) 451 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:17:38.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:38 smithi172 bash[23680]: audit 2024-03-30T15:17:37.197573+0000 mon.a (mon.0) 2628 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-53","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:17:38.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:38 smithi172 bash[23680]: cluster 2024-03-30T15:17:37.205477+0000 mon.a (mon.0) 2629 : cluster 0 osdmap e389: 8 total, 8 up, 8 in 2024-03-30T15:17:38.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:38 smithi172 bash[23680]: audit 2024-03-30T15:17:37.289076+0000 mon.a (mon.0) 2630 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:17:38.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:38 smithi172 bash[23680]: audit 2024-03-30T15:17:37.289743+0000 mon.a (mon.0) 2631 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-53"}]: dispatch 2024-03-30T15:17:38.666 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:38 smithi072 bash[28946]: audit 2024-03-30T15:17:37.197573+0000 mon.a (mon.0) 2628 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-53","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:17:38.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:38 smithi072 bash[28946]: cluster 2024-03-30T15:17:37.205477+0000 mon.a (mon.0) 2629 : cluster 0 osdmap e389: 8 total, 8 up, 8 in 2024-03-30T15:17:38.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:38 smithi072 bash[28946]: audit 2024-03-30T15:17:37.289076+0000 mon.a (mon.0) 2630 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:17:38.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:38 smithi072 bash[28946]: audit 2024-03-30T15:17:37.289743+0000 mon.a (mon.0) 2631 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-53"}]: dispatch 2024-03-30T15:17:38.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:38 smithi072 bash[21573]: audit 2024-03-30T15:17:37.197573+0000 mon.a (mon.0) 2628 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-53","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:17:38.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:38 smithi072 bash[21573]: cluster 2024-03-30T15:17:37.205477+0000 mon.a (mon.0) 2629 : cluster 0 osdmap e389: 8 total, 8 up, 8 in 2024-03-30T15:17:38.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:38 smithi072 bash[21573]: audit 2024-03-30T15:17:37.289076+0000 mon.a (mon.0) 2630 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:17:38.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:38 smithi072 bash[21573]: audit 2024-03-30T15:17:37.289743+0000 mon.a (mon.0) 2631 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-53"}]: dispatch 2024-03-30T15:17:39.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:39 smithi172 bash[23680]: cluster 2024-03-30T15:17:38.057719+0000 mgr.y (mgr.14526) 398 : cluster 0 pgmap v593: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-03-30T15:17:39.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:39 smithi172 bash[23680]: cluster 2024-03-30T15:17:38.223385+0000 mon.a (mon.0) 2632 : cluster 0 osdmap e390: 8 total, 8 up, 8 in 2024-03-30T15:17:39.666 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:39 smithi072 bash[28946]: cluster 2024-03-30T15:17:38.057719+0000 mgr.y (mgr.14526) 398 : cluster 0 pgmap v593: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-03-30T15:17:39.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:39 smithi072 bash[28946]: cluster 2024-03-30T15:17:38.223385+0000 mon.a (mon.0) 2632 : cluster 0 osdmap e390: 8 total, 8 up, 8 in 2024-03-30T15:17:39.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:39 smithi072 bash[21573]: cluster 2024-03-30T15:17:38.057719+0000 mgr.y (mgr.14526) 398 : cluster 0 pgmap v593: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-03-30T15:17:39.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:39 smithi072 bash[21573]: cluster 2024-03-30T15:17:38.223385+0000 mon.a (mon.0) 2632 : cluster 0 osdmap e390: 8 total, 8 up, 8 in 2024-03-30T15:17:40.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:40 smithi072 bash[21573]: cluster 2024-03-30T15:17:39.228268+0000 mon.a (mon.0) 2633 : cluster 0 osdmap e391: 8 total, 8 up, 8 in 2024-03-30T15:17:40.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:40 smithi072 bash[21573]: audit 2024-03-30T15:17:39.241777+0000 mon.a (mon.0) 2634 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:17:40.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:40 smithi072 bash[28946]: cluster 2024-03-30T15:17:39.228268+0000 mon.a (mon.0) 2633 : cluster 0 osdmap e391: 8 total, 8 up, 8 in 2024-03-30T15:17:40.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:40 smithi072 bash[28946]: audit 2024-03-30T15:17:39.241777+0000 mon.a (mon.0) 2634 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:17:40.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:40 smithi172 bash[23680]: cluster 2024-03-30T15:17:39.228268+0000 mon.a (mon.0) 2633 : cluster 0 osdmap e391: 8 total, 8 up, 8 in 2024-03-30T15:17:40.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:40 smithi172 bash[23680]: audit 2024-03-30T15:17:39.241777+0000 mon.a (mon.0) 2634 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:17:41.416 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:17:41 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:17:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:17:41.714 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:17:41 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:17:42.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:41 smithi072 bash[21573]: cluster 2024-03-30T15:17:40.058513+0000 mgr.y (mgr.14526) 399 : cluster 0 pgmap v596: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:17:42.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:41 smithi072 bash[21573]: cluster 2024-03-30T15:17:40.222260+0000 mon.a (mon.0) 2635 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:17:42.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:41 smithi072 bash[21573]: audit 2024-03-30T15:17:40.223948+0000 mon.a (mon.0) 2636 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-55","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:17:42.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:41 smithi072 bash[21573]: cluster 2024-03-30T15:17:40.234499+0000 mon.a (mon.0) 2637 : cluster 0 osdmap e392: 8 total, 8 up, 8 in 2024-03-30T15:17:42.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:41 smithi072 bash[21573]: audit 2024-03-30T15:17:40.244091+0000 mon.a (mon.0) 2638 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:17:42.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:41 smithi072 bash[21573]: audit 2024-03-30T15:17:40.325480+0000 mon.a (mon.0) 2639 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:17:42.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:41 smithi072 bash[21573]: audit 2024-03-30T15:17:40.326157+0000 mon.a (mon.0) 2640 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-55"}]: dispatch 2024-03-30T15:17:42.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:41 smithi072 bash[28946]: cluster 2024-03-30T15:17:40.058513+0000 mgr.y (mgr.14526) 399 : cluster 0 pgmap v596: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:17:42.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:41 smithi072 bash[28946]: cluster 2024-03-30T15:17:40.222260+0000 mon.a (mon.0) 2635 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:17:42.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:41 smithi072 bash[28946]: audit 2024-03-30T15:17:40.223948+0000 mon.a (mon.0) 2636 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-55","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:17:42.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:41 smithi072 bash[28946]: cluster 2024-03-30T15:17:40.234499+0000 mon.a (mon.0) 2637 : cluster 0 osdmap e392: 8 total, 8 up, 8 in 2024-03-30T15:17:42.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:41 smithi072 bash[28946]: audit 2024-03-30T15:17:40.244091+0000 mon.a (mon.0) 2638 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:17:42.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:41 smithi072 bash[28946]: audit 2024-03-30T15:17:40.325480+0000 mon.a (mon.0) 2639 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:17:42.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:41 smithi072 bash[28946]: audit 2024-03-30T15:17:40.326157+0000 mon.a (mon.0) 2640 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-55"}]: dispatch 2024-03-30T15:17:42.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:41 smithi172 bash[23680]: cluster 2024-03-30T15:17:40.058513+0000 mgr.y (mgr.14526) 399 : cluster 0 pgmap v596: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:17:42.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:41 smithi172 bash[23680]: cluster 2024-03-30T15:17:40.222260+0000 mon.a (mon.0) 2635 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:17:42.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:41 smithi172 bash[23680]: audit 2024-03-30T15:17:40.223948+0000 mon.a (mon.0) 2636 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-55","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:17:42.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:41 smithi172 bash[23680]: cluster 2024-03-30T15:17:40.234499+0000 mon.a (mon.0) 2637 : cluster 0 osdmap e392: 8 total, 8 up, 8 in 2024-03-30T15:17:42.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:41 smithi172 bash[23680]: audit 2024-03-30T15:17:40.244091+0000 mon.a (mon.0) 2638 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:17:42.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:41 smithi172 bash[23680]: audit 2024-03-30T15:17:40.325480+0000 mon.a (mon.0) 2639 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:17:42.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:41 smithi172 bash[23680]: audit 2024-03-30T15:17:40.326157+0000 mon.a (mon.0) 2640 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-55"}]: dispatch 2024-03-30T15:17:43.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:42 smithi072 bash[21573]: audit 2024-03-30T15:17:41.254938+0000 mgr.y (mgr.14526) 400 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:17:43.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:42 smithi072 bash[21573]: cluster 2024-03-30T15:17:41.270589+0000 mon.a (mon.0) 2641 : cluster 0 osdmap e393: 8 total, 8 up, 8 in 2024-03-30T15:17:43.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:42 smithi072 bash[21573]: cluster 2024-03-30T15:17:42.277257+0000 mon.a (mon.0) 2642 : cluster 0 osdmap e394: 8 total, 8 up, 8 in 2024-03-30T15:17:43.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:42 smithi072 bash[21573]: audit 2024-03-30T15:17:42.282313+0000 mon.a (mon.0) 2643 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:17:43.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:42 smithi072 bash[28946]: audit 2024-03-30T15:17:41.254938+0000 mgr.y (mgr.14526) 400 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:17:43.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:42 smithi072 bash[28946]: cluster 2024-03-30T15:17:41.270589+0000 mon.a (mon.0) 2641 : cluster 0 osdmap e393: 8 total, 8 up, 8 in 2024-03-30T15:17:43.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:42 smithi072 bash[28946]: cluster 2024-03-30T15:17:42.277257+0000 mon.a (mon.0) 2642 : cluster 0 osdmap e394: 8 total, 8 up, 8 in 2024-03-30T15:17:43.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:42 smithi072 bash[28946]: audit 2024-03-30T15:17:42.282313+0000 mon.a (mon.0) 2643 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:17:43.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:42 smithi172 bash[23680]: audit 2024-03-30T15:17:41.254938+0000 mgr.y (mgr.14526) 400 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:17:43.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:42 smithi172 bash[23680]: cluster 2024-03-30T15:17:41.270589+0000 mon.a (mon.0) 2641 : cluster 0 osdmap e393: 8 total, 8 up, 8 in 2024-03-30T15:17:43.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:42 smithi172 bash[23680]: cluster 2024-03-30T15:17:42.277257+0000 mon.a (mon.0) 2642 : cluster 0 osdmap e394: 8 total, 8 up, 8 in 2024-03-30T15:17:43.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:42 smithi172 bash[23680]: audit 2024-03-30T15:17:42.282313+0000 mon.a (mon.0) 2643 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:17:44.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:43 smithi072 bash[21573]: cluster 2024-03-30T15:17:42.059251+0000 mgr.y (mgr.14526) 401 : cluster 0 pgmap v599: 196 pgs: 196 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 109 KiB/s rd, 1.5 KiB/s wr, 181 op/s 2024-03-30T15:17:44.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:43 smithi072 bash[21573]: audit 2024-03-30T15:17:43.270111+0000 mon.a (mon.0) 2644 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-57","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:17:44.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:43 smithi072 bash[21573]: cluster 2024-03-30T15:17:43.278293+0000 mon.a (mon.0) 2645 : cluster 0 osdmap e395: 8 total, 8 up, 8 in 2024-03-30T15:17:44.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:43 smithi072 bash[21573]: audit 2024-03-30T15:17:43.370178+0000 mon.a (mon.0) 2646 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:17:44.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:43 smithi072 bash[21573]: audit 2024-03-30T15:17:43.370819+0000 mon.a (mon.0) 2647 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-57"}]: dispatch 2024-03-30T15:17:44.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:43 smithi072 bash[28946]: cluster 2024-03-30T15:17:42.059251+0000 mgr.y (mgr.14526) 401 : cluster 0 pgmap v599: 196 pgs: 196 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 109 KiB/s rd, 1.5 KiB/s wr, 181 op/s 2024-03-30T15:17:44.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:43 smithi072 bash[28946]: audit 2024-03-30T15:17:43.270111+0000 mon.a (mon.0) 2644 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-57","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:17:44.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:43 smithi072 bash[28946]: cluster 2024-03-30T15:17:43.278293+0000 mon.a (mon.0) 2645 : cluster 0 osdmap e395: 8 total, 8 up, 8 in 2024-03-30T15:17:44.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:43 smithi072 bash[28946]: audit 2024-03-30T15:17:43.370178+0000 mon.a (mon.0) 2646 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:17:44.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:43 smithi072 bash[28946]: audit 2024-03-30T15:17:43.370819+0000 mon.a (mon.0) 2647 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-57"}]: dispatch 2024-03-30T15:17:44.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:43 smithi172 bash[23680]: cluster 2024-03-30T15:17:42.059251+0000 mgr.y (mgr.14526) 401 : cluster 0 pgmap v599: 196 pgs: 196 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 109 KiB/s rd, 1.5 KiB/s wr, 181 op/s 2024-03-30T15:17:44.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:43 smithi172 bash[23680]: audit 2024-03-30T15:17:43.270111+0000 mon.a (mon.0) 2644 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-57","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:17:44.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:43 smithi172 bash[23680]: cluster 2024-03-30T15:17:43.278293+0000 mon.a (mon.0) 2645 : cluster 0 osdmap e395: 8 total, 8 up, 8 in 2024-03-30T15:17:44.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:43 smithi172 bash[23680]: audit 2024-03-30T15:17:43.370178+0000 mon.a (mon.0) 2646 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:17:44.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:43 smithi172 bash[23680]: audit 2024-03-30T15:17:43.370819+0000 mon.a (mon.0) 2647 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-57"}]: dispatch 2024-03-30T15:17:45.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:45 smithi072 bash[21573]: cluster 2024-03-30T15:17:44.060068+0000 mgr.y (mgr.14526) 402 : cluster 0 pgmap v602: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 109 KiB/s rd, 1.5 KiB/s wr, 181 op/s 2024-03-30T15:17:45.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:45 smithi072 bash[21573]: cluster 2024-03-30T15:17:44.285697+0000 mon.a (mon.0) 2648 : cluster 0 osdmap e396: 8 total, 8 up, 8 in 2024-03-30T15:17:45.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:45 smithi072 bash[28946]: cluster 2024-03-30T15:17:44.060068+0000 mgr.y (mgr.14526) 402 : cluster 0 pgmap v602: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 109 KiB/s rd, 1.5 KiB/s wr, 181 op/s 2024-03-30T15:17:45.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:45 smithi072 bash[28946]: cluster 2024-03-30T15:17:44.285697+0000 mon.a (mon.0) 2648 : cluster 0 osdmap e396: 8 total, 8 up, 8 in 2024-03-30T15:17:45.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:45 smithi172 bash[23680]: cluster 2024-03-30T15:17:44.060068+0000 mgr.y (mgr.14526) 402 : cluster 0 pgmap v602: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 109 KiB/s rd, 1.5 KiB/s wr, 181 op/s 2024-03-30T15:17:45.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:45 smithi172 bash[23680]: cluster 2024-03-30T15:17:44.285697+0000 mon.a (mon.0) 2648 : cluster 0 osdmap e396: 8 total, 8 up, 8 in 2024-03-30T15:17:46.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:46 smithi072 bash[28946]: cluster 2024-03-30T15:17:45.288886+0000 mon.a (mon.0) 2649 : cluster 0 osdmap e397: 8 total, 8 up, 8 in 2024-03-30T15:17:46.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:46 smithi072 bash[28946]: audit 2024-03-30T15:17:45.292355+0000 mon.a (mon.0) 2650 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:17:46.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:46 smithi072 bash[28946]: audit 2024-03-30T15:17:46.279824+0000 mon.a (mon.0) 2651 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-59","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:17:46.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:46 smithi072 bash[28946]: cluster 2024-03-30T15:17:46.289755+0000 mon.a (mon.0) 2652 : cluster 0 osdmap e398: 8 total, 8 up, 8 in 2024-03-30T15:17:46.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:46 smithi072 bash[21573]: cluster 2024-03-30T15:17:45.288886+0000 mon.a (mon.0) 2649 : cluster 0 osdmap e397: 8 total, 8 up, 8 in 2024-03-30T15:17:46.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:46 smithi072 bash[21573]: audit 2024-03-30T15:17:45.292355+0000 mon.a (mon.0) 2650 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:17:46.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:46 smithi072 bash[21573]: audit 2024-03-30T15:17:46.279824+0000 mon.a (mon.0) 2651 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-59","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:17:46.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:46 smithi072 bash[21573]: cluster 2024-03-30T15:17:46.289755+0000 mon.a (mon.0) 2652 : cluster 0 osdmap e398: 8 total, 8 up, 8 in 2024-03-30T15:17:46.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:46 smithi172 bash[23680]: cluster 2024-03-30T15:17:45.288886+0000 mon.a (mon.0) 2649 : cluster 0 osdmap e397: 8 total, 8 up, 8 in 2024-03-30T15:17:46.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:46 smithi172 bash[23680]: audit 2024-03-30T15:17:45.292355+0000 mon.a (mon.0) 2650 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:17:46.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:46 smithi172 bash[23680]: audit 2024-03-30T15:17:46.279824+0000 mon.a (mon.0) 2651 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-59","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:17:46.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:46 smithi172 bash[23680]: cluster 2024-03-30T15:17:46.289755+0000 mon.a (mon.0) 2652 : cluster 0 osdmap e398: 8 total, 8 up, 8 in 2024-03-30T15:17:48.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:47 smithi072 bash[21573]: cluster 2024-03-30T15:17:46.062251+0000 mgr.y (mgr.14526) 403 : cluster 0 pgmap v605: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 767 B/s wr, 1 op/s 2024-03-30T15:17:48.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:47 smithi072 bash[21573]: audit 2024-03-30T15:17:46.294253+0000 mon.a (mon.0) 2653 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:17:48.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:47 smithi072 bash[21573]: cluster 2024-03-30T15:17:46.307568+0000 mon.a (mon.0) 2654 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:17:48.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:47 smithi072 bash[21573]: audit 2024-03-30T15:17:46.389233+0000 mon.a (mon.0) 2655 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:17:48.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:47 smithi072 bash[21573]: audit 2024-03-30T15:17:46.389847+0000 mon.a (mon.0) 2656 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-59"}]: dispatch 2024-03-30T15:17:48.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:47 smithi072 bash[21573]: cluster 2024-03-30T15:17:47.325326+0000 mon.a (mon.0) 2657 : cluster 0 osdmap e399: 8 total, 8 up, 8 in 2024-03-30T15:17:48.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:47 smithi072 bash[28946]: cluster 2024-03-30T15:17:46.062251+0000 mgr.y (mgr.14526) 403 : cluster 0 pgmap v605: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 767 B/s wr, 1 op/s 2024-03-30T15:17:48.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:47 smithi072 bash[28946]: audit 2024-03-30T15:17:46.294253+0000 mon.a (mon.0) 2653 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:17:48.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:47 smithi072 bash[28946]: cluster 2024-03-30T15:17:46.307568+0000 mon.a (mon.0) 2654 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:17:48.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:47 smithi072 bash[28946]: audit 2024-03-30T15:17:46.389233+0000 mon.a (mon.0) 2655 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:17:48.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:47 smithi072 bash[28946]: audit 2024-03-30T15:17:46.389847+0000 mon.a (mon.0) 2656 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-59"}]: dispatch 2024-03-30T15:17:48.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:47 smithi072 bash[28946]: cluster 2024-03-30T15:17:47.325326+0000 mon.a (mon.0) 2657 : cluster 0 osdmap e399: 8 total, 8 up, 8 in 2024-03-30T15:17:48.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:47 smithi172 bash[23680]: cluster 2024-03-30T15:17:46.062251+0000 mgr.y (mgr.14526) 403 : cluster 0 pgmap v605: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 767 B/s wr, 1 op/s 2024-03-30T15:17:48.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:47 smithi172 bash[23680]: audit 2024-03-30T15:17:46.294253+0000 mon.a (mon.0) 2653 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:17:48.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:47 smithi172 bash[23680]: cluster 2024-03-30T15:17:46.307568+0000 mon.a (mon.0) 2654 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:17:48.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:47 smithi172 bash[23680]: audit 2024-03-30T15:17:46.389233+0000 mon.a (mon.0) 2655 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:17:48.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:47 smithi172 bash[23680]: audit 2024-03-30T15:17:46.389847+0000 mon.a (mon.0) 2656 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-59"}]: dispatch 2024-03-30T15:17:48.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:47 smithi172 bash[23680]: cluster 2024-03-30T15:17:47.325326+0000 mon.a (mon.0) 2657 : cluster 0 osdmap e399: 8 total, 8 up, 8 in 2024-03-30T15:17:49.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:49 smithi072 bash[21573]: cluster 2024-03-30T15:17:48.063083+0000 mgr.y (mgr.14526) 404 : cluster 0 pgmap v608: 196 pgs: 196 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 767 B/s wr, 1 op/s 2024-03-30T15:17:49.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:49 smithi072 bash[21573]: cluster 2024-03-30T15:17:48.328398+0000 mon.a (mon.0) 2658 : cluster 0 osdmap e400: 8 total, 8 up, 8 in 2024-03-30T15:17:49.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:49 smithi072 bash[21573]: audit 2024-03-30T15:17:48.331671+0000 mon.a (mon.0) 2659 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:17:49.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:49 smithi072 bash[28946]: cluster 2024-03-30T15:17:48.063083+0000 mgr.y (mgr.14526) 404 : cluster 0 pgmap v608: 196 pgs: 196 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 767 B/s wr, 1 op/s 2024-03-30T15:17:49.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:49 smithi072 bash[28946]: cluster 2024-03-30T15:17:48.328398+0000 mon.a (mon.0) 2658 : cluster 0 osdmap e400: 8 total, 8 up, 8 in 2024-03-30T15:17:49.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:49 smithi072 bash[28946]: audit 2024-03-30T15:17:48.331671+0000 mon.a (mon.0) 2659 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:17:49.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:49 smithi172 bash[23680]: cluster 2024-03-30T15:17:48.063083+0000 mgr.y (mgr.14526) 404 : cluster 0 pgmap v608: 196 pgs: 196 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 767 B/s wr, 1 op/s 2024-03-30T15:17:49.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:49 smithi172 bash[23680]: cluster 2024-03-30T15:17:48.328398+0000 mon.a (mon.0) 2658 : cluster 0 osdmap e400: 8 total, 8 up, 8 in 2024-03-30T15:17:49.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:49 smithi172 bash[23680]: audit 2024-03-30T15:17:48.331671+0000 mon.a (mon.0) 2659 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:17:50.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:50 smithi072 bash[21573]: audit 2024-03-30T15:17:49.324434+0000 mon.a (mon.0) 2660 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-61","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:17:50.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:50 smithi072 bash[21573]: cluster 2024-03-30T15:17:49.333999+0000 mon.a (mon.0) 2661 : cluster 0 osdmap e401: 8 total, 8 up, 8 in 2024-03-30T15:17:50.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:50 smithi072 bash[21573]: audit 2024-03-30T15:17:49.350869+0000 mon.a (mon.0) 2662 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:17:50.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:50 smithi072 bash[21573]: audit 2024-03-30T15:17:49.370374+0000 mon.a (mon.0) 2663 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-30T15:17:50.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:50 smithi072 bash[28946]: audit 2024-03-30T15:17:49.324434+0000 mon.a (mon.0) 2660 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-61","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:17:50.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:50 smithi072 bash[28946]: cluster 2024-03-30T15:17:49.333999+0000 mon.a (mon.0) 2661 : cluster 0 osdmap e401: 8 total, 8 up, 8 in 2024-03-30T15:17:50.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:50 smithi072 bash[28946]: audit 2024-03-30T15:17:49.350869+0000 mon.a (mon.0) 2662 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:17:50.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:50 smithi072 bash[28946]: audit 2024-03-30T15:17:49.370374+0000 mon.a (mon.0) 2663 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-30T15:17:50.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:50 smithi172 bash[23680]: audit 2024-03-30T15:17:49.324434+0000 mon.a (mon.0) 2660 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-61","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:17:50.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:50 smithi172 bash[23680]: cluster 2024-03-30T15:17:49.333999+0000 mon.a (mon.0) 2661 : cluster 0 osdmap e401: 8 total, 8 up, 8 in 2024-03-30T15:17:50.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:50 smithi172 bash[23680]: audit 2024-03-30T15:17:49.350869+0000 mon.a (mon.0) 2662 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:17:50.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:50 smithi172 bash[23680]: audit 2024-03-30T15:17:49.370374+0000 mon.a (mon.0) 2663 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-30T15:17:51.351 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:17:51 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:17:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:17:51.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:51 smithi072 bash[21573]: cluster 2024-03-30T15:17:50.063919+0000 mgr.y (mgr.14526) 405 : cluster 0 pgmap v611: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:17:51.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:51 smithi072 bash[21573]: audit 2024-03-30T15:17:50.353420+0000 mon.a (mon.0) 2664 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-30T15:17:51.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:51 smithi072 bash[21573]: cluster 2024-03-30T15:17:50.363374+0000 mon.a (mon.0) 2665 : cluster 0 osdmap e402: 8 total, 8 up, 8 in 2024-03-30T15:17:51.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:51 smithi072 bash[21573]: audit 2024-03-30T15:17:50.444440+0000 mon.a (mon.0) 2666 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:17:51.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:51 smithi072 bash[21573]: audit 2024-03-30T15:17:50.445505+0000 mon.a (mon.0) 2667 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-61"}]: dispatch 2024-03-30T15:17:51.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:51 smithi072 bash[21573]: audit 2024-03-30T15:17:51.281078+0000 mon.c (mon.2) 452 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:17:51.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:51 smithi072 bash[28946]: cluster 2024-03-30T15:17:50.063919+0000 mgr.y (mgr.14526) 405 : cluster 0 pgmap v611: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:17:51.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:51 smithi072 bash[28946]: audit 2024-03-30T15:17:50.353420+0000 mon.a (mon.0) 2664 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-30T15:17:51.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:51 smithi072 bash[28946]: cluster 2024-03-30T15:17:50.363374+0000 mon.a (mon.0) 2665 : cluster 0 osdmap e402: 8 total, 8 up, 8 in 2024-03-30T15:17:51.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:51 smithi072 bash[28946]: audit 2024-03-30T15:17:50.444440+0000 mon.a (mon.0) 2666 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:17:51.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:51 smithi072 bash[28946]: audit 2024-03-30T15:17:50.445505+0000 mon.a (mon.0) 2667 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-61"}]: dispatch 2024-03-30T15:17:51.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:51 smithi072 bash[28946]: audit 2024-03-30T15:17:51.281078+0000 mon.c (mon.2) 452 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:17:51.714 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:17:51 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:17:51.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:51 smithi172 bash[23680]: cluster 2024-03-30T15:17:50.063919+0000 mgr.y (mgr.14526) 405 : cluster 0 pgmap v611: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:17:51.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:51 smithi172 bash[23680]: audit 2024-03-30T15:17:50.353420+0000 mon.a (mon.0) 2664 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-30T15:17:51.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:51 smithi172 bash[23680]: cluster 2024-03-30T15:17:50.363374+0000 mon.a (mon.0) 2665 : cluster 0 osdmap e402: 8 total, 8 up, 8 in 2024-03-30T15:17:51.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:51 smithi172 bash[23680]: audit 2024-03-30T15:17:50.444440+0000 mon.a (mon.0) 2666 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:17:51.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:51 smithi172 bash[23680]: audit 2024-03-30T15:17:50.445505+0000 mon.a (mon.0) 2667 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-61"}]: dispatch 2024-03-30T15:17:51.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:51 smithi172 bash[23680]: audit 2024-03-30T15:17:51.281078+0000 mon.c (mon.2) 452 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:17:52.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:52 smithi072 bash[21573]: audit 2024-03-30T15:17:51.264073+0000 mgr.y (mgr.14526) 406 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:17:52.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:52 smithi072 bash[21573]: cluster 2024-03-30T15:17:51.372464+0000 mon.a (mon.0) 2668 : cluster 0 osdmap e403: 8 total, 8 up, 8 in 2024-03-30T15:17:52.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:52 smithi072 bash[21573]: cluster 2024-03-30T15:17:51.820211+0000 mon.a (mon.0) 2669 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:17:52.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:52 smithi072 bash[28946]: audit 2024-03-30T15:17:51.264073+0000 mgr.y (mgr.14526) 406 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:17:52.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:52 smithi072 bash[28946]: cluster 2024-03-30T15:17:51.372464+0000 mon.a (mon.0) 2668 : cluster 0 osdmap e403: 8 total, 8 up, 8 in 2024-03-30T15:17:52.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:52 smithi072 bash[28946]: cluster 2024-03-30T15:17:51.820211+0000 mon.a (mon.0) 2669 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:17:52.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:52 smithi172 bash[23680]: audit 2024-03-30T15:17:51.264073+0000 mgr.y (mgr.14526) 406 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:17:52.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:52 smithi172 bash[23680]: cluster 2024-03-30T15:17:51.372464+0000 mon.a (mon.0) 2668 : cluster 0 osdmap e403: 8 total, 8 up, 8 in 2024-03-30T15:17:52.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:52 smithi172 bash[23680]: cluster 2024-03-30T15:17:51.820211+0000 mon.a (mon.0) 2669 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:17:53.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:53 smithi072 bash[21573]: cluster 2024-03-30T15:17:52.064736+0000 mgr.y (mgr.14526) 407 : cluster 0 pgmap v614: 196 pgs: 196 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-03-30T15:17:53.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:53 smithi072 bash[21573]: cluster 2024-03-30T15:17:52.380191+0000 mon.a (mon.0) 2670 : cluster 0 osdmap e404: 8 total, 8 up, 8 in 2024-03-30T15:17:53.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:53 smithi072 bash[21573]: audit 2024-03-30T15:17:52.383858+0000 mon.a (mon.0) 2671 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:17:53.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:53 smithi072 bash[21573]: audit 2024-03-30T15:17:53.371985+0000 mon.a (mon.0) 2672 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-63","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:17:53.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:53 smithi072 bash[21573]: cluster 2024-03-30T15:17:53.383073+0000 mon.a (mon.0) 2673 : cluster 0 osdmap e405: 8 total, 8 up, 8 in 2024-03-30T15:17:53.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:53 smithi072 bash[28946]: cluster 2024-03-30T15:17:52.064736+0000 mgr.y (mgr.14526) 407 : cluster 0 pgmap v614: 196 pgs: 196 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-03-30T15:17:53.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:53 smithi072 bash[28946]: cluster 2024-03-30T15:17:52.380191+0000 mon.a (mon.0) 2670 : cluster 0 osdmap e404: 8 total, 8 up, 8 in 2024-03-30T15:17:53.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:53 smithi072 bash[28946]: audit 2024-03-30T15:17:52.383858+0000 mon.a (mon.0) 2671 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:17:53.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:53 smithi072 bash[28946]: audit 2024-03-30T15:17:53.371985+0000 mon.a (mon.0) 2672 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-63","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:17:53.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:53 smithi072 bash[28946]: cluster 2024-03-30T15:17:53.383073+0000 mon.a (mon.0) 2673 : cluster 0 osdmap e405: 8 total, 8 up, 8 in 2024-03-30T15:17:53.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:53 smithi172 bash[23680]: cluster 2024-03-30T15:17:52.064736+0000 mgr.y (mgr.14526) 407 : cluster 0 pgmap v614: 196 pgs: 196 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-03-30T15:17:53.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:53 smithi172 bash[23680]: cluster 2024-03-30T15:17:52.380191+0000 mon.a (mon.0) 2670 : cluster 0 osdmap e404: 8 total, 8 up, 8 in 2024-03-30T15:17:53.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:53 smithi172 bash[23680]: audit 2024-03-30T15:17:52.383858+0000 mon.a (mon.0) 2671 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:17:53.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:53 smithi172 bash[23680]: audit 2024-03-30T15:17:53.371985+0000 mon.a (mon.0) 2672 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-63","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:17:53.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:53 smithi172 bash[23680]: cluster 2024-03-30T15:17:53.383073+0000 mon.a (mon.0) 2673 : cluster 0 osdmap e405: 8 total, 8 up, 8 in 2024-03-30T15:17:54.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:54 smithi072 bash[21573]: audit 2024-03-30T15:17:53.386850+0000 mon.a (mon.0) 2674 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:17:54.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:54 smithi072 bash[21573]: audit 2024-03-30T15:17:53.403136+0000 mon.a (mon.0) 2675 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-30T15:17:54.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:54 smithi072 bash[21573]: audit 2024-03-30T15:17:54.375040+0000 mon.a (mon.0) 2676 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-30T15:17:54.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:54 smithi072 bash[21573]: cluster 2024-03-30T15:17:54.382002+0000 mon.a (mon.0) 2677 : cluster 0 osdmap e406: 8 total, 8 up, 8 in 2024-03-30T15:17:54.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:54 smithi072 bash[28946]: audit 2024-03-30T15:17:53.386850+0000 mon.a (mon.0) 2674 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:17:54.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:54 smithi072 bash[28946]: audit 2024-03-30T15:17:53.403136+0000 mon.a (mon.0) 2675 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-30T15:17:54.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:54 smithi072 bash[28946]: audit 2024-03-30T15:17:54.375040+0000 mon.a (mon.0) 2676 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-30T15:17:54.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:54 smithi072 bash[28946]: cluster 2024-03-30T15:17:54.382002+0000 mon.a (mon.0) 2677 : cluster 0 osdmap e406: 8 total, 8 up, 8 in 2024-03-30T15:17:54.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:54 smithi172 bash[23680]: audit 2024-03-30T15:17:53.386850+0000 mon.a (mon.0) 2674 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:17:54.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:54 smithi172 bash[23680]: audit 2024-03-30T15:17:53.403136+0000 mon.a (mon.0) 2675 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-30T15:17:54.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:54 smithi172 bash[23680]: audit 2024-03-30T15:17:54.375040+0000 mon.a (mon.0) 2676 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-30T15:17:54.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:54 smithi172 bash[23680]: cluster 2024-03-30T15:17:54.382002+0000 mon.a (mon.0) 2677 : cluster 0 osdmap e406: 8 total, 8 up, 8 in 2024-03-30T15:17:55.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:55 smithi172 bash[23680]: cluster 2024-03-30T15:17:54.065710+0000 mgr.y (mgr.14526) 408 : cluster 0 pgmap v617: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-03-30T15:17:55.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:55 smithi072 bash[21573]: cluster 2024-03-30T15:17:54.065710+0000 mgr.y (mgr.14526) 408 : cluster 0 pgmap v617: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-03-30T15:17:55.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:55 smithi072 bash[28946]: cluster 2024-03-30T15:17:54.065710+0000 mgr.y (mgr.14526) 408 : cluster 0 pgmap v617: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-03-30T15:17:56.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:56 smithi172 bash[23680]: cluster 2024-03-30T15:17:55.436294+0000 mon.a (mon.0) 2678 : cluster 0 osdmap e407: 8 total, 8 up, 8 in 2024-03-30T15:17:56.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:56 smithi072 bash[21573]: cluster 2024-03-30T15:17:55.436294+0000 mon.a (mon.0) 2678 : cluster 0 osdmap e407: 8 total, 8 up, 8 in 2024-03-30T15:17:56.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:56 smithi072 bash[28946]: cluster 2024-03-30T15:17:55.436294+0000 mon.a (mon.0) 2678 : cluster 0 osdmap e407: 8 total, 8 up, 8 in 2024-03-30T15:17:57.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:57 smithi172 bash[23680]: cluster 2024-03-30T15:17:56.067785+0000 mgr.y (mgr.14526) 409 : cluster 0 pgmap v620: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-03-30T15:17:57.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:57 smithi172 bash[23680]: cluster 2024-03-30T15:17:56.447483+0000 mon.a (mon.0) 2679 : cluster 0 osdmap e408: 8 total, 8 up, 8 in 2024-03-30T15:17:57.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:57 smithi072 bash[21573]: cluster 2024-03-30T15:17:56.067785+0000 mgr.y (mgr.14526) 409 : cluster 0 pgmap v620: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-03-30T15:17:57.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:57 smithi072 bash[21573]: cluster 2024-03-30T15:17:56.447483+0000 mon.a (mon.0) 2679 : cluster 0 osdmap e408: 8 total, 8 up, 8 in 2024-03-30T15:17:57.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:57 smithi072 bash[28946]: cluster 2024-03-30T15:17:56.067785+0000 mgr.y (mgr.14526) 409 : cluster 0 pgmap v620: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-03-30T15:17:57.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:57 smithi072 bash[28946]: cluster 2024-03-30T15:17:56.447483+0000 mon.a (mon.0) 2679 : cluster 0 osdmap e408: 8 total, 8 up, 8 in 2024-03-30T15:17:58.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:58 smithi172 bash[23680]: cluster 2024-03-30T15:17:57.461323+0000 mon.a (mon.0) 2680 : cluster 0 osdmap e409: 8 total, 8 up, 8 in 2024-03-30T15:17:58.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:58 smithi072 bash[21573]: cluster 2024-03-30T15:17:57.461323+0000 mon.a (mon.0) 2680 : cluster 0 osdmap e409: 8 total, 8 up, 8 in 2024-03-30T15:17:58.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:58 smithi072 bash[28946]: cluster 2024-03-30T15:17:57.461323+0000 mon.a (mon.0) 2680 : cluster 0 osdmap e409: 8 total, 8 up, 8 in 2024-03-30T15:17:59.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:59 smithi172 bash[23680]: cluster 2024-03-30T15:17:58.068642+0000 mgr.y (mgr.14526) 410 : cluster 0 pgmap v623: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-03-30T15:17:59.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:17:59 smithi172 bash[23680]: cluster 2024-03-30T15:17:58.468331+0000 mon.a (mon.0) 2681 : cluster 0 osdmap e410: 8 total, 8 up, 8 in 2024-03-30T15:17:59.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:59 smithi072 bash[21573]: cluster 2024-03-30T15:17:58.068642+0000 mgr.y (mgr.14526) 410 : cluster 0 pgmap v623: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-03-30T15:17:59.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:17:59 smithi072 bash[21573]: cluster 2024-03-30T15:17:58.468331+0000 mon.a (mon.0) 2681 : cluster 0 osdmap e410: 8 total, 8 up, 8 in 2024-03-30T15:17:59.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:59 smithi072 bash[28946]: cluster 2024-03-30T15:17:58.068642+0000 mgr.y (mgr.14526) 410 : cluster 0 pgmap v623: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-03-30T15:17:59.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:17:59 smithi072 bash[28946]: cluster 2024-03-30T15:17:58.468331+0000 mon.a (mon.0) 2681 : cluster 0 osdmap e410: 8 total, 8 up, 8 in 2024-03-30T15:18:01.416 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:18:01 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:18:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:18:01.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:01 smithi172 bash[23680]: cluster 2024-03-30T15:18:00.069502+0000 mgr.y (mgr.14526) 411 : cluster 0 pgmap v625: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-03-30T15:18:01.714 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:18:01 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:18:01.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:01 smithi072 bash[21573]: cluster 2024-03-30T15:18:00.069502+0000 mgr.y (mgr.14526) 411 : cluster 0 pgmap v625: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-03-30T15:18:01.916 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:01 smithi072 bash[28946]: cluster 2024-03-30T15:18:00.069502+0000 mgr.y (mgr.14526) 411 : cluster 0 pgmap v625: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-03-30T15:18:02.916 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:02 smithi072 bash[28946]: audit 2024-03-30T15:18:01.267072+0000 mgr.y (mgr.14526) 412 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:18:02.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:02 smithi072 bash[21573]: audit 2024-03-30T15:18:01.267072+0000 mgr.y (mgr.14526) 412 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:18:02.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:02 smithi172 bash[23680]: audit 2024-03-30T15:18:01.267072+0000 mgr.y (mgr.14526) 412 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:18:03.916 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:03 smithi072 bash[28946]: cluster 2024-03-30T15:18:02.071721+0000 mgr.y (mgr.14526) 413 : cluster 0 pgmap v626: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 682 B/s wr, 2 op/s 2024-03-30T15:18:03.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:03 smithi072 bash[21573]: cluster 2024-03-30T15:18:02.071721+0000 mgr.y (mgr.14526) 413 : cluster 0 pgmap v626: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 682 B/s wr, 2 op/s 2024-03-30T15:18:03.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:03 smithi172 bash[23680]: cluster 2024-03-30T15:18:02.071721+0000 mgr.y (mgr.14526) 413 : cluster 0 pgmap v626: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 682 B/s wr, 2 op/s 2024-03-30T15:18:05.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:05 smithi072 bash[21573]: cluster 2024-03-30T15:18:04.072551+0000 mgr.y (mgr.14526) 414 : cluster 0 pgmap v627: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 536 B/s wr, 2 op/s 2024-03-30T15:18:05.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:05 smithi072 bash[28946]: cluster 2024-03-30T15:18:04.072551+0000 mgr.y (mgr.14526) 414 : cluster 0 pgmap v627: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 536 B/s wr, 2 op/s 2024-03-30T15:18:05.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:05 smithi172 bash[23680]: cluster 2024-03-30T15:18:04.072551+0000 mgr.y (mgr.14526) 414 : cluster 0 pgmap v627: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 536 B/s wr, 2 op/s 2024-03-30T15:18:06.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:06 smithi072 bash[21573]: audit 2024-03-30T15:18:06.314143+0000 mon.c (mon.2) 453 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:18:06.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:06 smithi072 bash[28946]: audit 2024-03-30T15:18:06.314143+0000 mon.c (mon.2) 453 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:18:06.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:06 smithi172 bash[23680]: audit 2024-03-30T15:18:06.314143+0000 mon.c (mon.2) 453 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:18:07.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:07 smithi072 bash[21573]: cluster 2024-03-30T15:18:06.074706+0000 mgr.y (mgr.14526) 415 : cluster 0 pgmap v628: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 475 B/s wr, 2 op/s 2024-03-30T15:18:07.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:07 smithi072 bash[21573]: cluster 2024-03-30T15:18:06.834999+0000 mon.a (mon.0) 2682 : cluster 0 osdmap e411: 8 total, 8 up, 8 in 2024-03-30T15:18:07.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:07 smithi072 bash[28946]: cluster 2024-03-30T15:18:06.074706+0000 mgr.y (mgr.14526) 415 : cluster 0 pgmap v628: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 475 B/s wr, 2 op/s 2024-03-30T15:18:07.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:07 smithi072 bash[28946]: cluster 2024-03-30T15:18:06.834999+0000 mon.a (mon.0) 2682 : cluster 0 osdmap e411: 8 total, 8 up, 8 in 2024-03-30T15:18:07.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:07 smithi172 bash[23680]: cluster 2024-03-30T15:18:06.074706+0000 mgr.y (mgr.14526) 415 : cluster 0 pgmap v628: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 475 B/s wr, 2 op/s 2024-03-30T15:18:07.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:07 smithi172 bash[23680]: cluster 2024-03-30T15:18:06.834999+0000 mon.a (mon.0) 2682 : cluster 0 osdmap e411: 8 total, 8 up, 8 in 2024-03-30T15:18:09.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:09 smithi072 bash[21573]: cluster 2024-03-30T15:18:08.075527+0000 mgr.y (mgr.14526) 416 : cluster 0 pgmap v630: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 426 B/s wr, 2 op/s 2024-03-30T15:18:09.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:09 smithi072 bash[21573]: cluster 2024-03-30T15:18:08.507107+0000 mon.a (mon.0) 2683 : cluster 0 osdmap e412: 8 total, 8 up, 8 in 2024-03-30T15:18:09.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:09 smithi072 bash[28946]: cluster 2024-03-30T15:18:08.075527+0000 mgr.y (mgr.14526) 416 : cluster 0 pgmap v630: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 426 B/s wr, 2 op/s 2024-03-30T15:18:09.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:09 smithi072 bash[28946]: cluster 2024-03-30T15:18:08.507107+0000 mon.a (mon.0) 2683 : cluster 0 osdmap e412: 8 total, 8 up, 8 in 2024-03-30T15:18:09.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:09 smithi172 bash[23680]: cluster 2024-03-30T15:18:08.075527+0000 mgr.y (mgr.14526) 416 : cluster 0 pgmap v630: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 426 B/s wr, 2 op/s 2024-03-30T15:18:09.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:09 smithi172 bash[23680]: cluster 2024-03-30T15:18:08.507107+0000 mon.a (mon.0) 2683 : cluster 0 osdmap e412: 8 total, 8 up, 8 in 2024-03-30T15:18:11.416 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:18:11 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:18:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:18:11.714 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:11 smithi172 bash[23680]: cluster 2024-03-30T15:18:10.076384+0000 mgr.y (mgr.14526) 417 : cluster 0 pgmap v632: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-30T15:18:11.714 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:18:11 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:18:11.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:11 smithi072 bash[21573]: cluster 2024-03-30T15:18:10.076384+0000 mgr.y (mgr.14526) 417 : cluster 0 pgmap v632: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-30T15:18:11.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:11 smithi072 bash[28946]: cluster 2024-03-30T15:18:10.076384+0000 mgr.y (mgr.14526) 417 : cluster 0 pgmap v632: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-30T15:18:12.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:12 smithi072 bash[21573]: audit 2024-03-30T15:18:11.276432+0000 mgr.y (mgr.14526) 418 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:18:12.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:12 smithi072 bash[21573]: audit 2024-03-30T15:18:12.311594+0000 mon.c (mon.2) 454 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:18:12.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:12 smithi072 bash[28946]: audit 2024-03-30T15:18:11.276432+0000 mgr.y (mgr.14526) 418 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:18:12.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:12 smithi072 bash[28946]: audit 2024-03-30T15:18:12.311594+0000 mon.c (mon.2) 454 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:18:12.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:12 smithi172 bash[23680]: audit 2024-03-30T15:18:11.276432+0000 mgr.y (mgr.14526) 418 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:18:12.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:12 smithi172 bash[23680]: audit 2024-03-30T15:18:12.311594+0000 mon.c (mon.2) 454 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:18:13.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:13 smithi072 bash[21573]: cluster 2024-03-30T15:18:12.078603+0000 mgr.y (mgr.14526) 419 : cluster 0 pgmap v633: 228 pgs: 228 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:18:13.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:13 smithi072 bash[21573]: audit 2024-03-30T15:18:12.896077+0000 mon.a (mon.0) 2684 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:18:13.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:13 smithi072 bash[21573]: audit 2024-03-30T15:18:12.913982+0000 mon.a (mon.0) 2685 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:18:13.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:13 smithi072 bash[28946]: cluster 2024-03-30T15:18:12.078603+0000 mgr.y (mgr.14526) 419 : cluster 0 pgmap v633: 228 pgs: 228 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:18:13.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:13 smithi072 bash[28946]: audit 2024-03-30T15:18:12.896077+0000 mon.a (mon.0) 2684 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:18:13.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:13 smithi072 bash[28946]: audit 2024-03-30T15:18:12.913982+0000 mon.a (mon.0) 2685 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:18:13.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:13 smithi172 bash[23680]: cluster 2024-03-30T15:18:12.078603+0000 mgr.y (mgr.14526) 419 : cluster 0 pgmap v633: 228 pgs: 228 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:18:13.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:13 smithi172 bash[23680]: audit 2024-03-30T15:18:12.896077+0000 mon.a (mon.0) 2684 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:18:13.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:13 smithi172 bash[23680]: audit 2024-03-30T15:18:12.913982+0000 mon.a (mon.0) 2685 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:18:14.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:14 smithi072 bash[21573]: audit 2024-03-30T15:18:13.564831+0000 mon.c (mon.2) 455 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:18:14.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:14 smithi072 bash[21573]: audit 2024-03-30T15:18:13.566594+0000 mon.c (mon.2) 456 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:18:14.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:14 smithi072 bash[21573]: audit 2024-03-30T15:18:13.578548+0000 mon.a (mon.0) 2686 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:18:14.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:14 smithi072 bash[28946]: audit 2024-03-30T15:18:13.564831+0000 mon.c (mon.2) 455 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:18:14.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:14 smithi072 bash[28946]: audit 2024-03-30T15:18:13.566594+0000 mon.c (mon.2) 456 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:18:14.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:14 smithi072 bash[28946]: audit 2024-03-30T15:18:13.578548+0000 mon.a (mon.0) 2686 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:18:14.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:14 smithi172 bash[23680]: audit 2024-03-30T15:18:13.564831+0000 mon.c (mon.2) 455 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:18:14.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:14 smithi172 bash[23680]: audit 2024-03-30T15:18:13.566594+0000 mon.c (mon.2) 456 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:18:14.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:14 smithi172 bash[23680]: audit 2024-03-30T15:18:13.578548+0000 mon.a (mon.0) 2686 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:18:15.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:15 smithi072 bash[21573]: cluster 2024-03-30T15:18:14.079471+0000 mgr.y (mgr.14526) 420 : cluster 0 pgmap v634: 228 pgs: 228 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:18:15.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:15 smithi072 bash[28946]: cluster 2024-03-30T15:18:14.079471+0000 mgr.y (mgr.14526) 420 : cluster 0 pgmap v634: 228 pgs: 228 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:18:15.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:15 smithi172 bash[23680]: cluster 2024-03-30T15:18:14.079471+0000 mgr.y (mgr.14526) 420 : cluster 0 pgmap v634: 228 pgs: 228 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:18:17.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:17 smithi072 bash[21573]: cluster 2024-03-30T15:18:16.081560+0000 mgr.y (mgr.14526) 421 : cluster 0 pgmap v635: 228 pgs: 228 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:18:17.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:17 smithi072 bash[21573]: cluster 2024-03-30T15:18:16.837288+0000 mon.a (mon.0) 2687 : cluster 0 osdmap e413: 8 total, 8 up, 8 in 2024-03-30T15:18:17.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:17 smithi072 bash[28946]: cluster 2024-03-30T15:18:16.081560+0000 mgr.y (mgr.14526) 421 : cluster 0 pgmap v635: 228 pgs: 228 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:18:17.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:17 smithi072 bash[28946]: cluster 2024-03-30T15:18:16.837288+0000 mon.a (mon.0) 2687 : cluster 0 osdmap e413: 8 total, 8 up, 8 in 2024-03-30T15:18:17.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:17 smithi172 bash[23680]: cluster 2024-03-30T15:18:16.081560+0000 mgr.y (mgr.14526) 421 : cluster 0 pgmap v635: 228 pgs: 228 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:18:17.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:17 smithi172 bash[23680]: cluster 2024-03-30T15:18:16.837288+0000 mon.a (mon.0) 2687 : cluster 0 osdmap e413: 8 total, 8 up, 8 in 2024-03-30T15:18:19.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:19 smithi072 bash[21573]: cluster 2024-03-30T15:18:18.082350+0000 mgr.y (mgr.14526) 422 : cluster 0 pgmap v637: 228 pgs: 228 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:18:19.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:19 smithi072 bash[21573]: cluster 2024-03-30T15:18:18.606960+0000 mon.a (mon.0) 2688 : cluster 0 osdmap e414: 8 total, 8 up, 8 in 2024-03-30T15:18:19.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:19 smithi072 bash[28946]: cluster 2024-03-30T15:18:18.082350+0000 mgr.y (mgr.14526) 422 : cluster 0 pgmap v637: 228 pgs: 228 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:18:19.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:19 smithi072 bash[28946]: cluster 2024-03-30T15:18:18.606960+0000 mon.a (mon.0) 2688 : cluster 0 osdmap e414: 8 total, 8 up, 8 in 2024-03-30T15:18:19.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:19 smithi172 bash[23680]: cluster 2024-03-30T15:18:18.082350+0000 mgr.y (mgr.14526) 422 : cluster 0 pgmap v637: 228 pgs: 228 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:18:19.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:19 smithi172 bash[23680]: cluster 2024-03-30T15:18:18.606960+0000 mon.a (mon.0) 2688 : cluster 0 osdmap e414: 8 total, 8 up, 8 in 2024-03-30T15:18:21.416 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:18:21 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:18:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:18:21.597 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:18:21 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:18:21.916 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:21 smithi072 bash[28946]: cluster 2024-03-30T15:18:20.083139+0000 mgr.y (mgr.14526) 423 : cluster 0 pgmap v639: 228 pgs: 228 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-30T15:18:21.916 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:21 smithi072 bash[28946]: audit 2024-03-30T15:18:21.348054+0000 mon.c (mon.2) 457 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:18:21.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:21 smithi072 bash[21573]: cluster 2024-03-30T15:18:20.083139+0000 mgr.y (mgr.14526) 423 : cluster 0 pgmap v639: 228 pgs: 228 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-30T15:18:21.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:21 smithi072 bash[21573]: audit 2024-03-30T15:18:21.348054+0000 mon.c (mon.2) 457 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:18:21.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:21 smithi172 bash[23680]: cluster 2024-03-30T15:18:20.083139+0000 mgr.y (mgr.14526) 423 : cluster 0 pgmap v639: 228 pgs: 228 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-30T15:18:21.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:21 smithi172 bash[23680]: audit 2024-03-30T15:18:21.348054+0000 mon.c (mon.2) 457 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:18:22.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:22 smithi072 bash[21573]: audit 2024-03-30T15:18:21.287694+0000 mgr.y (mgr.14526) 424 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:18:22.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:22 smithi072 bash[28946]: audit 2024-03-30T15:18:21.287694+0000 mgr.y (mgr.14526) 424 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:18:22.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:22 smithi172 bash[23680]: audit 2024-03-30T15:18:21.287694+0000 mgr.y (mgr.14526) 424 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:18:23.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:23 smithi072 bash[21573]: cluster 2024-03-30T15:18:22.085419+0000 mgr.y (mgr.14526) 425 : cluster 0 pgmap v640: 228 pgs: 228 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-03-30T15:18:23.916 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:23 smithi072 bash[28946]: cluster 2024-03-30T15:18:22.085419+0000 mgr.y (mgr.14526) 425 : cluster 0 pgmap v640: 228 pgs: 228 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-03-30T15:18:23.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:23 smithi172 bash[23680]: cluster 2024-03-30T15:18:22.085419+0000 mgr.y (mgr.14526) 425 : cluster 0 pgmap v640: 228 pgs: 228 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-03-30T15:18:25.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:25 smithi072 bash[21573]: cluster 2024-03-30T15:18:24.086246+0000 mgr.y (mgr.14526) 426 : cluster 0 pgmap v641: 228 pgs: 228 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T15:18:25.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:25 smithi072 bash[28946]: cluster 2024-03-30T15:18:24.086246+0000 mgr.y (mgr.14526) 426 : cluster 0 pgmap v641: 228 pgs: 228 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T15:18:25.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:25 smithi172 bash[23680]: cluster 2024-03-30T15:18:24.086246+0000 mgr.y (mgr.14526) 426 : cluster 0 pgmap v641: 228 pgs: 228 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T15:18:27.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:27 smithi072 bash[21573]: cluster 2024-03-30T15:18:26.088364+0000 mgr.y (mgr.14526) 427 : cluster 0 pgmap v642: 228 pgs: 228 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:18:27.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:27 smithi072 bash[21573]: cluster 2024-03-30T15:18:26.844024+0000 mon.a (mon.0) 2689 : cluster 0 osdmap e415: 8 total, 8 up, 8 in 2024-03-30T15:18:27.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:27 smithi072 bash[28946]: cluster 2024-03-30T15:18:26.088364+0000 mgr.y (mgr.14526) 427 : cluster 0 pgmap v642: 228 pgs: 228 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:18:27.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:27 smithi072 bash[28946]: cluster 2024-03-30T15:18:26.844024+0000 mon.a (mon.0) 2689 : cluster 0 osdmap e415: 8 total, 8 up, 8 in 2024-03-30T15:18:27.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:27 smithi172 bash[23680]: cluster 2024-03-30T15:18:26.088364+0000 mgr.y (mgr.14526) 427 : cluster 0 pgmap v642: 228 pgs: 228 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:18:27.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:27 smithi172 bash[23680]: cluster 2024-03-30T15:18:26.844024+0000 mon.a (mon.0) 2689 : cluster 0 osdmap e415: 8 total, 8 up, 8 in 2024-03-30T15:18:30.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:30 smithi072 bash[21573]: cluster 2024-03-30T15:18:28.089335+0000 mgr.y (mgr.14526) 428 : cluster 0 pgmap v644: 228 pgs: 228 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:18:30.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:30 smithi072 bash[21573]: audit 2024-03-30T15:18:28.650065+0000 mon.a (mon.0) 2690 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:18:30.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:30 smithi072 bash[21573]: audit 2024-03-30T15:18:28.651100+0000 mon.a (mon.0) 2691 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-63"}]: dispatch 2024-03-30T15:18:30.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:30 smithi072 bash[28946]: cluster 2024-03-30T15:18:28.089335+0000 mgr.y (mgr.14526) 428 : cluster 0 pgmap v644: 228 pgs: 228 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:18:30.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:30 smithi072 bash[28946]: audit 2024-03-30T15:18:28.650065+0000 mon.a (mon.0) 2690 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:18:30.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:30 smithi072 bash[28946]: audit 2024-03-30T15:18:28.651100+0000 mon.a (mon.0) 2691 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-63"}]: dispatch 2024-03-30T15:18:30.464 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:30 smithi172 bash[23680]: cluster 2024-03-30T15:18:28.089335+0000 mgr.y (mgr.14526) 428 : cluster 0 pgmap v644: 228 pgs: 228 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:18:30.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:30 smithi172 bash[23680]: audit 2024-03-30T15:18:28.650065+0000 mon.a (mon.0) 2690 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:18:30.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:30 smithi172 bash[23680]: audit 2024-03-30T15:18:28.651100+0000 mon.a (mon.0) 2691 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-63"}]: dispatch 2024-03-30T15:18:31.416 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:18:31 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:18:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:18:31.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:31 smithi072 bash[21573]: cluster 2024-03-30T15:18:29.635779+0000 mon.a (mon.0) 2692 : cluster 0 osdmap e416: 8 total, 8 up, 8 in 2024-03-30T15:18:31.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:31 smithi072 bash[21573]: cluster 2024-03-30T15:18:30.090295+0000 mgr.y (mgr.14526) 429 : cluster 0 pgmap v646: 196 pgs: 196 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:18:31.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:31 smithi072 bash[21573]: cluster 2024-03-30T15:18:30.642320+0000 mon.a (mon.0) 2693 : cluster 0 osdmap e417: 8 total, 8 up, 8 in 2024-03-30T15:18:31.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:31 smithi072 bash[21573]: audit 2024-03-30T15:18:30.665269+0000 mon.a (mon.0) 2694 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:18:31.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:31 smithi072 bash[28946]: cluster 2024-03-30T15:18:29.635779+0000 mon.a (mon.0) 2692 : cluster 0 osdmap e416: 8 total, 8 up, 8 in 2024-03-30T15:18:31.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:31 smithi072 bash[28946]: cluster 2024-03-30T15:18:30.090295+0000 mgr.y (mgr.14526) 429 : cluster 0 pgmap v646: 196 pgs: 196 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:18:31.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:31 smithi072 bash[28946]: cluster 2024-03-30T15:18:30.642320+0000 mon.a (mon.0) 2693 : cluster 0 osdmap e417: 8 total, 8 up, 8 in 2024-03-30T15:18:31.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:31 smithi072 bash[28946]: audit 2024-03-30T15:18:30.665269+0000 mon.a (mon.0) 2694 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:18:31.466 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:18:31 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:18:31.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:31 smithi172 bash[23680]: cluster 2024-03-30T15:18:29.635779+0000 mon.a (mon.0) 2692 : cluster 0 osdmap e416: 8 total, 8 up, 8 in 2024-03-30T15:18:31.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:31 smithi172 bash[23680]: cluster 2024-03-30T15:18:30.090295+0000 mgr.y (mgr.14526) 429 : cluster 0 pgmap v646: 196 pgs: 196 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:18:31.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:31 smithi172 bash[23680]: cluster 2024-03-30T15:18:30.642320+0000 mon.a (mon.0) 2693 : cluster 0 osdmap e417: 8 total, 8 up, 8 in 2024-03-30T15:18:31.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:31 smithi172 bash[23680]: audit 2024-03-30T15:18:30.665269+0000 mon.a (mon.0) 2694 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:18:32.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:32 smithi072 bash[21573]: audit 2024-03-30T15:18:31.299423+0000 mgr.y (mgr.14526) 430 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:18:32.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:32 smithi072 bash[21573]: audit 2024-03-30T15:18:31.635372+0000 mon.a (mon.0) 2695 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-65","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:18:32.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:32 smithi072 bash[21573]: cluster 2024-03-30T15:18:31.643931+0000 mon.a (mon.0) 2696 : cluster 0 osdmap e418: 8 total, 8 up, 8 in 2024-03-30T15:18:32.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:32 smithi072 bash[21573]: audit 2024-03-30T15:18:31.664235+0000 mon.a (mon.0) 2697 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:18:32.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:32 smithi072 bash[21573]: audit 2024-03-30T15:18:31.685498+0000 mon.a (mon.0) 2698 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-30T15:18:32.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:32 smithi072 bash[28946]: audit 2024-03-30T15:18:31.299423+0000 mgr.y (mgr.14526) 430 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:18:32.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:32 smithi072 bash[28946]: audit 2024-03-30T15:18:31.635372+0000 mon.a (mon.0) 2695 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-65","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:18:32.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:32 smithi072 bash[28946]: cluster 2024-03-30T15:18:31.643931+0000 mon.a (mon.0) 2696 : cluster 0 osdmap e418: 8 total, 8 up, 8 in 2024-03-30T15:18:32.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:32 smithi072 bash[28946]: audit 2024-03-30T15:18:31.664235+0000 mon.a (mon.0) 2697 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:18:32.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:32 smithi072 bash[28946]: audit 2024-03-30T15:18:31.685498+0000 mon.a (mon.0) 2698 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-30T15:18:32.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:32 smithi172 bash[23680]: audit 2024-03-30T15:18:31.299423+0000 mgr.y (mgr.14526) 430 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:18:32.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:32 smithi172 bash[23680]: audit 2024-03-30T15:18:31.635372+0000 mon.a (mon.0) 2695 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-65","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:18:32.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:32 smithi172 bash[23680]: cluster 2024-03-30T15:18:31.643931+0000 mon.a (mon.0) 2696 : cluster 0 osdmap e418: 8 total, 8 up, 8 in 2024-03-30T15:18:32.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:32 smithi172 bash[23680]: audit 2024-03-30T15:18:31.664235+0000 mon.a (mon.0) 2697 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:18:32.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:32 smithi172 bash[23680]: audit 2024-03-30T15:18:31.685498+0000 mon.a (mon.0) 2698 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-30T15:18:33.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:33 smithi072 bash[21573]: cluster 2024-03-30T15:18:32.091124+0000 mgr.y (mgr.14526) 431 : cluster 0 pgmap v649: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:18:33.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:33 smithi072 bash[21573]: audit 2024-03-30T15:18:32.645669+0000 mon.a (mon.0) 2699 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-30T15:18:33.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:33 smithi072 bash[21573]: cluster 2024-03-30T15:18:32.656491+0000 mon.a (mon.0) 2700 : cluster 0 osdmap e419: 8 total, 8 up, 8 in 2024-03-30T15:18:33.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:33 smithi072 bash[28946]: cluster 2024-03-30T15:18:32.091124+0000 mgr.y (mgr.14526) 431 : cluster 0 pgmap v649: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:18:33.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:33 smithi072 bash[28946]: audit 2024-03-30T15:18:32.645669+0000 mon.a (mon.0) 2699 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-30T15:18:33.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:33 smithi072 bash[28946]: cluster 2024-03-30T15:18:32.656491+0000 mon.a (mon.0) 2700 : cluster 0 osdmap e419: 8 total, 8 up, 8 in 2024-03-30T15:18:33.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:33 smithi172 bash[23680]: cluster 2024-03-30T15:18:32.091124+0000 mgr.y (mgr.14526) 431 : cluster 0 pgmap v649: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:18:33.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:33 smithi172 bash[23680]: audit 2024-03-30T15:18:32.645669+0000 mon.a (mon.0) 2699 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-30T15:18:33.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:33 smithi172 bash[23680]: cluster 2024-03-30T15:18:32.656491+0000 mon.a (mon.0) 2700 : cluster 0 osdmap e419: 8 total, 8 up, 8 in 2024-03-30T15:18:34.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:34 smithi072 bash[21573]: cluster 2024-03-30T15:18:33.656012+0000 mon.a (mon.0) 2701 : cluster 0 osdmap e420: 8 total, 8 up, 8 in 2024-03-30T15:18:34.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:34 smithi072 bash[28946]: cluster 2024-03-30T15:18:33.656012+0000 mon.a (mon.0) 2701 : cluster 0 osdmap e420: 8 total, 8 up, 8 in 2024-03-30T15:18:34.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:34 smithi172 bash[23680]: cluster 2024-03-30T15:18:33.656012+0000 mon.a (mon.0) 2701 : cluster 0 osdmap e420: 8 total, 8 up, 8 in 2024-03-30T15:18:35.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:35 smithi072 bash[21573]: cluster 2024-03-30T15:18:34.091993+0000 mgr.y (mgr.14526) 432 : cluster 0 pgmap v652: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:18:35.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:35 smithi072 bash[21573]: cluster 2024-03-30T15:18:34.676668+0000 mon.a (mon.0) 2702 : cluster 0 osdmap e421: 8 total, 8 up, 8 in 2024-03-30T15:18:35.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:35 smithi072 bash[28946]: cluster 2024-03-30T15:18:34.091993+0000 mgr.y (mgr.14526) 432 : cluster 0 pgmap v652: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:18:35.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:35 smithi072 bash[28946]: cluster 2024-03-30T15:18:34.676668+0000 mon.a (mon.0) 2702 : cluster 0 osdmap e421: 8 total, 8 up, 8 in 2024-03-30T15:18:35.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:35 smithi172 bash[23680]: cluster 2024-03-30T15:18:34.091993+0000 mgr.y (mgr.14526) 432 : cluster 0 pgmap v652: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:18:35.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:35 smithi172 bash[23680]: cluster 2024-03-30T15:18:34.676668+0000 mon.a (mon.0) 2702 : cluster 0 osdmap e421: 8 total, 8 up, 8 in 2024-03-30T15:18:36.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:36 smithi172 bash[23680]: cluster 2024-03-30T15:18:35.684866+0000 mon.a (mon.0) 2703 : cluster 0 osdmap e422: 8 total, 8 up, 8 in 2024-03-30T15:18:36.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:36 smithi172 bash[23680]: audit 2024-03-30T15:18:36.382255+0000 mon.c (mon.2) 458 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:18:37.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:36 smithi072 bash[21573]: cluster 2024-03-30T15:18:35.684866+0000 mon.a (mon.0) 2703 : cluster 0 osdmap e422: 8 total, 8 up, 8 in 2024-03-30T15:18:37.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:36 smithi072 bash[21573]: audit 2024-03-30T15:18:36.382255+0000 mon.c (mon.2) 458 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:18:37.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:36 smithi072 bash[28946]: cluster 2024-03-30T15:18:35.684866+0000 mon.a (mon.0) 2703 : cluster 0 osdmap e422: 8 total, 8 up, 8 in 2024-03-30T15:18:37.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:36 smithi072 bash[28946]: audit 2024-03-30T15:18:36.382255+0000 mon.c (mon.2) 458 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:18:37.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:37 smithi172 bash[23680]: cluster 2024-03-30T15:18:36.094184+0000 mgr.y (mgr.14526) 433 : cluster 0 pgmap v655: 228 pgs: 228 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-03-30T15:18:37.979 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:37 smithi172 bash[23680]: cluster 2024-03-30T15:18:36.845362+0000 mon.a (mon.0) 2704 : cluster 0 osdmap e423: 8 total, 8 up, 8 in 2024-03-30T15:18:38.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:37 smithi072 bash[21573]: cluster 2024-03-30T15:18:36.094184+0000 mgr.y (mgr.14526) 433 : cluster 0 pgmap v655: 228 pgs: 228 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-03-30T15:18:38.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:37 smithi072 bash[21573]: cluster 2024-03-30T15:18:36.845362+0000 mon.a (mon.0) 2704 : cluster 0 osdmap e423: 8 total, 8 up, 8 in 2024-03-30T15:18:38.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:37 smithi072 bash[28946]: cluster 2024-03-30T15:18:36.094184+0000 mgr.y (mgr.14526) 433 : cluster 0 pgmap v655: 228 pgs: 228 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-03-30T15:18:38.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:37 smithi072 bash[28946]: cluster 2024-03-30T15:18:36.845362+0000 mon.a (mon.0) 2704 : cluster 0 osdmap e423: 8 total, 8 up, 8 in 2024-03-30T15:18:39.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:39 smithi172 bash[23680]: cluster 2024-03-30T15:18:38.094961+0000 mgr.y (mgr.14526) 434 : cluster 0 pgmap v657: 228 pgs: 228 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 3.4 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-03-30T15:18:40.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:39 smithi072 bash[21573]: cluster 2024-03-30T15:18:38.094961+0000 mgr.y (mgr.14526) 434 : cluster 0 pgmap v657: 228 pgs: 228 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 3.4 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-03-30T15:18:40.166 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:39 smithi072 bash[28946]: cluster 2024-03-30T15:18:38.094961+0000 mgr.y (mgr.14526) 434 : cluster 0 pgmap v657: 228 pgs: 228 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 3.4 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-03-30T15:18:41.416 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:18:41 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:18:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:18:41.693 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:18:41 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:18:41.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:41 smithi172 bash[23680]: cluster 2024-03-30T15:18:40.095781+0000 mgr.y (mgr.14526) 435 : cluster 0 pgmap v658: 228 pgs: 228 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-03-30T15:18:42.166 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:41 smithi072 bash[28946]: cluster 2024-03-30T15:18:40.095781+0000 mgr.y (mgr.14526) 435 : cluster 0 pgmap v658: 228 pgs: 228 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-03-30T15:18:42.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:41 smithi072 bash[21573]: cluster 2024-03-30T15:18:40.095781+0000 mgr.y (mgr.14526) 435 : cluster 0 pgmap v658: 228 pgs: 228 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-03-30T15:18:42.964 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:42 smithi172 bash[23680]: audit 2024-03-30T15:18:41.308801+0000 mgr.y (mgr.14526) 436 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:18:43.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:42 smithi072 bash[28946]: audit 2024-03-30T15:18:41.308801+0000 mgr.y (mgr.14526) 436 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:18:43.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:42 smithi072 bash[21573]: audit 2024-03-30T15:18:41.308801+0000 mgr.y (mgr.14526) 436 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:18:43.970 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:43 smithi172 bash[23680]: cluster 2024-03-30T15:18:42.098020+0000 mgr.y (mgr.14526) 437 : cluster 0 pgmap v659: 228 pgs: 228 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-03-30T15:18:44.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:43 smithi072 bash[21573]: cluster 2024-03-30T15:18:42.098020+0000 mgr.y (mgr.14526) 437 : cluster 0 pgmap v659: 228 pgs: 228 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-03-30T15:18:44.166 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:43 smithi072 bash[28946]: cluster 2024-03-30T15:18:42.098020+0000 mgr.y (mgr.14526) 437 : cluster 0 pgmap v659: 228 pgs: 228 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-03-30T15:18:45.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:45 smithi172 bash[23680]: cluster 2024-03-30T15:18:44.098818+0000 mgr.y (mgr.14526) 438 : cluster 0 pgmap v660: 228 pgs: 228 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-03-30T15:18:46.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:45 smithi072 bash[21573]: cluster 2024-03-30T15:18:44.098818+0000 mgr.y (mgr.14526) 438 : cluster 0 pgmap v660: 228 pgs: 228 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-03-30T15:18:46.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:45 smithi072 bash[28946]: cluster 2024-03-30T15:18:44.098818+0000 mgr.y (mgr.14526) 438 : cluster 0 pgmap v660: 228 pgs: 228 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-03-30T15:18:47.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:46 smithi072 bash[21573]: audit 2024-03-30T15:18:45.726933+0000 mon.a (mon.0) 2705 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:18:47.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:46 smithi072 bash[21573]: audit 2024-03-30T15:18:45.727739+0000 mon.a (mon.0) 2706 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-65"}]: dispatch 2024-03-30T15:18:47.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:46 smithi072 bash[28946]: audit 2024-03-30T15:18:45.726933+0000 mon.a (mon.0) 2705 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:18:47.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:46 smithi072 bash[28946]: audit 2024-03-30T15:18:45.727739+0000 mon.a (mon.0) 2706 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-65"}]: dispatch 2024-03-30T15:18:47.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:46 smithi172 bash[23680]: audit 2024-03-30T15:18:45.726933+0000 mon.a (mon.0) 2705 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:18:47.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:46 smithi172 bash[23680]: audit 2024-03-30T15:18:45.727739+0000 mon.a (mon.0) 2706 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-65"}]: dispatch 2024-03-30T15:18:48.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:47 smithi072 bash[21573]: cluster 2024-03-30T15:18:46.100920+0000 mgr.y (mgr.14526) 439 : cluster 0 pgmap v661: 228 pgs: 228 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:18:48.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:47 smithi072 bash[21573]: cluster 2024-03-30T15:18:46.731913+0000 mon.a (mon.0) 2707 : cluster 0 osdmap e424: 8 total, 8 up, 8 in 2024-03-30T15:18:48.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:47 smithi072 bash[28946]: cluster 2024-03-30T15:18:46.100920+0000 mgr.y (mgr.14526) 439 : cluster 0 pgmap v661: 228 pgs: 228 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:18:48.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:47 smithi072 bash[28946]: cluster 2024-03-30T15:18:46.731913+0000 mon.a (mon.0) 2707 : cluster 0 osdmap e424: 8 total, 8 up, 8 in 2024-03-30T15:18:48.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:47 smithi172 bash[23680]: cluster 2024-03-30T15:18:46.100920+0000 mgr.y (mgr.14526) 439 : cluster 0 pgmap v661: 228 pgs: 228 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:18:48.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:47 smithi172 bash[23680]: cluster 2024-03-30T15:18:46.731913+0000 mon.a (mon.0) 2707 : cluster 0 osdmap e424: 8 total, 8 up, 8 in 2024-03-30T15:18:49.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:48 smithi072 bash[21573]: cluster 2024-03-30T15:18:47.747457+0000 mon.a (mon.0) 2708 : cluster 0 osdmap e425: 8 total, 8 up, 8 in 2024-03-30T15:18:49.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:48 smithi072 bash[21573]: audit 2024-03-30T15:18:47.751957+0000 mon.a (mon.0) 2709 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:18:49.166 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:48 smithi072 bash[28946]: cluster 2024-03-30T15:18:47.747457+0000 mon.a (mon.0) 2708 : cluster 0 osdmap e425: 8 total, 8 up, 8 in 2024-03-30T15:18:49.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:48 smithi072 bash[28946]: audit 2024-03-30T15:18:47.751957+0000 mon.a (mon.0) 2709 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:18:49.214 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:48 smithi172 bash[23680]: cluster 2024-03-30T15:18:47.747457+0000 mon.a (mon.0) 2708 : cluster 0 osdmap e425: 8 total, 8 up, 8 in 2024-03-30T15:18:49.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:48 smithi172 bash[23680]: audit 2024-03-30T15:18:47.751957+0000 mon.a (mon.0) 2709 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:18:50.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:49 smithi072 bash[21573]: cluster 2024-03-30T15:18:48.101738+0000 mgr.y (mgr.14526) 440 : cluster 0 pgmap v664: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:18:50.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:49 smithi072 bash[21573]: cluster 2024-03-30T15:18:48.739594+0000 mon.a (mon.0) 2710 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:18:50.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:49 smithi072 bash[21573]: audit 2024-03-30T15:18:48.749447+0000 mon.a (mon.0) 2711 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-67","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:18:50.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:49 smithi072 bash[21573]: cluster 2024-03-30T15:18:48.761684+0000 mon.a (mon.0) 2712 : cluster 0 osdmap e426: 8 total, 8 up, 8 in 2024-03-30T15:18:50.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:49 smithi072 bash[21573]: audit 2024-03-30T15:18:48.766176+0000 mon.a (mon.0) 2713 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:18:50.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:49 smithi072 bash[28946]: cluster 2024-03-30T15:18:48.101738+0000 mgr.y (mgr.14526) 440 : cluster 0 pgmap v664: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:18:50.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:49 smithi072 bash[28946]: cluster 2024-03-30T15:18:48.739594+0000 mon.a (mon.0) 2710 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:18:50.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:49 smithi072 bash[28946]: audit 2024-03-30T15:18:48.749447+0000 mon.a (mon.0) 2711 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-67","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:18:50.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:49 smithi072 bash[28946]: cluster 2024-03-30T15:18:48.761684+0000 mon.a (mon.0) 2712 : cluster 0 osdmap e426: 8 total, 8 up, 8 in 2024-03-30T15:18:50.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:49 smithi072 bash[28946]: audit 2024-03-30T15:18:48.766176+0000 mon.a (mon.0) 2713 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:18:50.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:49 smithi172 bash[23680]: cluster 2024-03-30T15:18:48.101738+0000 mgr.y (mgr.14526) 440 : cluster 0 pgmap v664: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:18:50.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:49 smithi172 bash[23680]: cluster 2024-03-30T15:18:48.739594+0000 mon.a (mon.0) 2710 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:18:50.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:49 smithi172 bash[23680]: audit 2024-03-30T15:18:48.749447+0000 mon.a (mon.0) 2711 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-67","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:18:50.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:49 smithi172 bash[23680]: cluster 2024-03-30T15:18:48.761684+0000 mon.a (mon.0) 2712 : cluster 0 osdmap e426: 8 total, 8 up, 8 in 2024-03-30T15:18:50.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:49 smithi172 bash[23680]: audit 2024-03-30T15:18:48.766176+0000 mon.a (mon.0) 2713 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:18:51.029 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:50 smithi072 bash[28946]: cluster 2024-03-30T15:18:49.768925+0000 mon.a (mon.0) 2714 : cluster 0 osdmap e427: 8 total, 8 up, 8 in 2024-03-30T15:18:51.029 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:50 smithi072 bash[28946]: audit 2024-03-30T15:18:49.852498+0000 mon.a (mon.0) 2715 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:18:51.029 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:50 smithi072 bash[28946]: audit 2024-03-30T15:18:49.853369+0000 mon.a (mon.0) 2716 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-67"}]: dispatch 2024-03-30T15:18:51.030 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:50 smithi072 bash[21573]: cluster 2024-03-30T15:18:49.768925+0000 mon.a (mon.0) 2714 : cluster 0 osdmap e427: 8 total, 8 up, 8 in 2024-03-30T15:18:51.030 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:50 smithi072 bash[21573]: audit 2024-03-30T15:18:49.852498+0000 mon.a (mon.0) 2715 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:18:51.030 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:50 smithi072 bash[21573]: audit 2024-03-30T15:18:49.853369+0000 mon.a (mon.0) 2716 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-67"}]: dispatch 2024-03-30T15:18:51.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:50 smithi172 bash[23680]: cluster 2024-03-30T15:18:49.768925+0000 mon.a (mon.0) 2714 : cluster 0 osdmap e427: 8 total, 8 up, 8 in 2024-03-30T15:18:51.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:50 smithi172 bash[23680]: audit 2024-03-30T15:18:49.852498+0000 mon.a (mon.0) 2715 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:18:51.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:50 smithi172 bash[23680]: audit 2024-03-30T15:18:49.853369+0000 mon.a (mon.0) 2716 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-67"}]: dispatch 2024-03-30T15:18:51.416 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:18:51 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:18:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:18:51.714 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:18:51 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:18:52.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:51 smithi072 bash[21573]: cluster 2024-03-30T15:18:50.102535+0000 mgr.y (mgr.14526) 441 : cluster 0 pgmap v667: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:18:52.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:51 smithi072 bash[21573]: cluster 2024-03-30T15:18:50.782281+0000 mon.a (mon.0) 2717 : cluster 0 osdmap e428: 8 total, 8 up, 8 in 2024-03-30T15:18:52.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:51 smithi072 bash[21573]: audit 2024-03-30T15:18:51.314859+0000 mgr.y (mgr.14526) 442 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:18:52.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:51 smithi072 bash[21573]: audit 2024-03-30T15:18:51.416772+0000 mon.c (mon.2) 459 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:18:52.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:51 smithi072 bash[28946]: cluster 2024-03-30T15:18:50.102535+0000 mgr.y (mgr.14526) 441 : cluster 0 pgmap v667: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:18:52.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:51 smithi072 bash[28946]: cluster 2024-03-30T15:18:50.782281+0000 mon.a (mon.0) 2717 : cluster 0 osdmap e428: 8 total, 8 up, 8 in 2024-03-30T15:18:52.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:51 smithi072 bash[28946]: audit 2024-03-30T15:18:51.314859+0000 mgr.y (mgr.14526) 442 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:18:52.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:51 smithi072 bash[28946]: audit 2024-03-30T15:18:51.416772+0000 mon.c (mon.2) 459 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:18:52.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:51 smithi172 bash[23680]: cluster 2024-03-30T15:18:50.102535+0000 mgr.y (mgr.14526) 441 : cluster 0 pgmap v667: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:18:52.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:51 smithi172 bash[23680]: cluster 2024-03-30T15:18:50.782281+0000 mon.a (mon.0) 2717 : cluster 0 osdmap e428: 8 total, 8 up, 8 in 2024-03-30T15:18:52.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:51 smithi172 bash[23680]: audit 2024-03-30T15:18:51.314859+0000 mgr.y (mgr.14526) 442 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:18:52.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:51 smithi172 bash[23680]: audit 2024-03-30T15:18:51.416772+0000 mon.c (mon.2) 459 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:18:53.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:52 smithi072 bash[21573]: cluster 2024-03-30T15:18:51.793390+0000 mon.a (mon.0) 2718 : cluster 0 osdmap e429: 8 total, 8 up, 8 in 2024-03-30T15:18:53.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:52 smithi072 bash[21573]: audit 2024-03-30T15:18:51.796960+0000 mon.a (mon.0) 2719 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:18:53.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:52 smithi072 bash[21573]: cluster 2024-03-30T15:18:52.103467+0000 mgr.y (mgr.14526) 443 : cluster 0 pgmap v670: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-03-30T15:18:53.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:52 smithi072 bash[28946]: cluster 2024-03-30T15:18:51.793390+0000 mon.a (mon.0) 2718 : cluster 0 osdmap e429: 8 total, 8 up, 8 in 2024-03-30T15:18:53.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:52 smithi072 bash[28946]: audit 2024-03-30T15:18:51.796960+0000 mon.a (mon.0) 2719 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:18:53.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:52 smithi072 bash[28946]: cluster 2024-03-30T15:18:52.103467+0000 mgr.y (mgr.14526) 443 : cluster 0 pgmap v670: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-03-30T15:18:53.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:52 smithi172 bash[23680]: cluster 2024-03-30T15:18:51.793390+0000 mon.a (mon.0) 2718 : cluster 0 osdmap e429: 8 total, 8 up, 8 in 2024-03-30T15:18:53.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:52 smithi172 bash[23680]: audit 2024-03-30T15:18:51.796960+0000 mon.a (mon.0) 2719 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:18:53.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:52 smithi172 bash[23680]: cluster 2024-03-30T15:18:52.103467+0000 mgr.y (mgr.14526) 443 : cluster 0 pgmap v670: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-03-30T15:18:54.166 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:53 smithi072 bash[28946]: audit 2024-03-30T15:18:52.794752+0000 mon.a (mon.0) 2720 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-69","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:18:54.166 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:53 smithi072 bash[28946]: cluster 2024-03-30T15:18:52.806370+0000 mon.a (mon.0) 2721 : cluster 0 osdmap e430: 8 total, 8 up, 8 in 2024-03-30T15:18:54.166 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:53 smithi072 bash[28946]: audit 2024-03-30T15:18:52.813981+0000 mon.a (mon.0) 2722 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:18:54.166 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:53 smithi072 bash[28946]: audit 2024-03-30T15:18:52.887991+0000 mon.a (mon.0) 2723 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:18:54.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:53 smithi072 bash[28946]: audit 2024-03-30T15:18:52.888585+0000 mon.a (mon.0) 2724 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-69"}]: dispatch 2024-03-30T15:18:54.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:53 smithi072 bash[21573]: audit 2024-03-30T15:18:52.794752+0000 mon.a (mon.0) 2720 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-69","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:18:54.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:53 smithi072 bash[21573]: cluster 2024-03-30T15:18:52.806370+0000 mon.a (mon.0) 2721 : cluster 0 osdmap e430: 8 total, 8 up, 8 in 2024-03-30T15:18:54.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:53 smithi072 bash[21573]: audit 2024-03-30T15:18:52.813981+0000 mon.a (mon.0) 2722 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:18:54.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:53 smithi072 bash[21573]: audit 2024-03-30T15:18:52.887991+0000 mon.a (mon.0) 2723 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:18:54.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:53 smithi072 bash[21573]: audit 2024-03-30T15:18:52.888585+0000 mon.a (mon.0) 2724 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-69"}]: dispatch 2024-03-30T15:18:54.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:53 smithi172 bash[23680]: audit 2024-03-30T15:18:52.794752+0000 mon.a (mon.0) 2720 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-69","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:18:54.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:53 smithi172 bash[23680]: cluster 2024-03-30T15:18:52.806370+0000 mon.a (mon.0) 2721 : cluster 0 osdmap e430: 8 total, 8 up, 8 in 2024-03-30T15:18:54.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:53 smithi172 bash[23680]: audit 2024-03-30T15:18:52.813981+0000 mon.a (mon.0) 2722 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:18:54.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:53 smithi172 bash[23680]: audit 2024-03-30T15:18:52.887991+0000 mon.a (mon.0) 2723 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:18:54.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:53 smithi172 bash[23680]: audit 2024-03-30T15:18:52.888585+0000 mon.a (mon.0) 2724 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-69"}]: dispatch 2024-03-30T15:18:55.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:54 smithi072 bash[21573]: cluster 2024-03-30T15:18:53.815087+0000 mon.a (mon.0) 2725 : cluster 0 osdmap e431: 8 total, 8 up, 8 in 2024-03-30T15:18:55.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:54 smithi072 bash[21573]: cluster 2024-03-30T15:18:54.104241+0000 mgr.y (mgr.14526) 444 : cluster 0 pgmap v673: 196 pgs: 196 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-03-30T15:18:55.166 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:54 smithi072 bash[28946]: cluster 2024-03-30T15:18:53.815087+0000 mon.a (mon.0) 2725 : cluster 0 osdmap e431: 8 total, 8 up, 8 in 2024-03-30T15:18:55.166 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:54 smithi072 bash[28946]: cluster 2024-03-30T15:18:54.104241+0000 mgr.y (mgr.14526) 444 : cluster 0 pgmap v673: 196 pgs: 196 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-03-30T15:18:55.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:54 smithi172 bash[23680]: cluster 2024-03-30T15:18:53.815087+0000 mon.a (mon.0) 2725 : cluster 0 osdmap e431: 8 total, 8 up, 8 in 2024-03-30T15:18:55.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:54 smithi172 bash[23680]: cluster 2024-03-30T15:18:54.104241+0000 mgr.y (mgr.14526) 444 : cluster 0 pgmap v673: 196 pgs: 196 active+clean; 8.4 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-03-30T15:18:56.166 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:55 smithi072 bash[28946]: cluster 2024-03-30T15:18:54.809546+0000 mon.a (mon.0) 2726 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:18:56.166 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:55 smithi072 bash[28946]: cluster 2024-03-30T15:18:54.836704+0000 mon.a (mon.0) 2727 : cluster 0 osdmap e432: 8 total, 8 up, 8 in 2024-03-30T15:18:56.166 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:55 smithi072 bash[28946]: audit 2024-03-30T15:18:54.841298+0000 mon.a (mon.0) 2728 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:18:56.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:55 smithi072 bash[21573]: cluster 2024-03-30T15:18:54.809546+0000 mon.a (mon.0) 2726 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:18:56.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:55 smithi072 bash[21573]: cluster 2024-03-30T15:18:54.836704+0000 mon.a (mon.0) 2727 : cluster 0 osdmap e432: 8 total, 8 up, 8 in 2024-03-30T15:18:56.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:55 smithi072 bash[21573]: audit 2024-03-30T15:18:54.841298+0000 mon.a (mon.0) 2728 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:18:56.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:55 smithi172 bash[23680]: cluster 2024-03-30T15:18:54.809546+0000 mon.a (mon.0) 2726 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:18:56.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:55 smithi172 bash[23680]: cluster 2024-03-30T15:18:54.836704+0000 mon.a (mon.0) 2727 : cluster 0 osdmap e432: 8 total, 8 up, 8 in 2024-03-30T15:18:56.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:55 smithi172 bash[23680]: audit 2024-03-30T15:18:54.841298+0000 mon.a (mon.0) 2728 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:18:57.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:56 smithi072 bash[21573]: audit 2024-03-30T15:18:55.835321+0000 mon.a (mon.0) 2729 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-71","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:18:57.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:56 smithi072 bash[21573]: cluster 2024-03-30T15:18:55.843525+0000 mon.a (mon.0) 2730 : cluster 0 osdmap e433: 8 total, 8 up, 8 in 2024-03-30T15:18:57.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:56 smithi072 bash[21573]: audit 2024-03-30T15:18:55.847254+0000 mon.a (mon.0) 2731 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:18:57.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:56 smithi072 bash[21573]: audit 2024-03-30T15:18:55.868044+0000 mon.a (mon.0) 2732 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-30T15:18:57.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:56 smithi072 bash[21573]: cluster 2024-03-30T15:18:56.106325+0000 mgr.y (mgr.14526) 445 : cluster 0 pgmap v676: 228 pgs: 2 creating+activating, 226 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-30T15:18:57.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:56 smithi072 bash[28946]: audit 2024-03-30T15:18:55.835321+0000 mon.a (mon.0) 2729 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-71","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:18:57.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:56 smithi072 bash[28946]: cluster 2024-03-30T15:18:55.843525+0000 mon.a (mon.0) 2730 : cluster 0 osdmap e433: 8 total, 8 up, 8 in 2024-03-30T15:18:57.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:56 smithi072 bash[28946]: audit 2024-03-30T15:18:55.847254+0000 mon.a (mon.0) 2731 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:18:57.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:56 smithi072 bash[28946]: audit 2024-03-30T15:18:55.868044+0000 mon.a (mon.0) 2732 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-30T15:18:57.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:56 smithi072 bash[28946]: cluster 2024-03-30T15:18:56.106325+0000 mgr.y (mgr.14526) 445 : cluster 0 pgmap v676: 228 pgs: 2 creating+activating, 226 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-30T15:18:57.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:56 smithi172 bash[23680]: audit 2024-03-30T15:18:55.835321+0000 mon.a (mon.0) 2729 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-71","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:18:57.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:56 smithi172 bash[23680]: cluster 2024-03-30T15:18:55.843525+0000 mon.a (mon.0) 2730 : cluster 0 osdmap e433: 8 total, 8 up, 8 in 2024-03-30T15:18:57.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:56 smithi172 bash[23680]: audit 2024-03-30T15:18:55.847254+0000 mon.a (mon.0) 2731 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:18:57.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:56 smithi172 bash[23680]: audit 2024-03-30T15:18:55.868044+0000 mon.a (mon.0) 2732 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-30T15:18:57.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:56 smithi172 bash[23680]: cluster 2024-03-30T15:18:56.106325+0000 mgr.y (mgr.14526) 445 : cluster 0 pgmap v676: 228 pgs: 2 creating+activating, 226 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-30T15:18:58.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:57 smithi072 bash[21573]: audit 2024-03-30T15:18:56.846178+0000 mon.a (mon.0) 2733 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-30T15:18:58.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:57 smithi072 bash[21573]: cluster 2024-03-30T15:18:56.855997+0000 mon.a (mon.0) 2734 : cluster 0 osdmap e434: 8 total, 8 up, 8 in 2024-03-30T15:18:58.166 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:57 smithi072 bash[28946]: audit 2024-03-30T15:18:56.846178+0000 mon.a (mon.0) 2733 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-30T15:18:58.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:57 smithi072 bash[28946]: cluster 2024-03-30T15:18:56.855997+0000 mon.a (mon.0) 2734 : cluster 0 osdmap e434: 8 total, 8 up, 8 in 2024-03-30T15:18:58.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:57 smithi172 bash[23680]: audit 2024-03-30T15:18:56.846178+0000 mon.a (mon.0) 2733 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-30T15:18:58.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:57 smithi172 bash[23680]: cluster 2024-03-30T15:18:56.855997+0000 mon.a (mon.0) 2734 : cluster 0 osdmap e434: 8 total, 8 up, 8 in 2024-03-30T15:18:59.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:58 smithi072 bash[21573]: cluster 2024-03-30T15:18:57.859749+0000 mon.a (mon.0) 2735 : cluster 0 osdmap e435: 8 total, 8 up, 8 in 2024-03-30T15:18:59.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:18:58 smithi072 bash[21573]: cluster 2024-03-30T15:18:58.107092+0000 mgr.y (mgr.14526) 446 : cluster 0 pgmap v679: 228 pgs: 2 creating+activating, 226 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-30T15:18:59.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:58 smithi072 bash[28946]: cluster 2024-03-30T15:18:57.859749+0000 mon.a (mon.0) 2735 : cluster 0 osdmap e435: 8 total, 8 up, 8 in 2024-03-30T15:18:59.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:18:58 smithi072 bash[28946]: cluster 2024-03-30T15:18:58.107092+0000 mgr.y (mgr.14526) 446 : cluster 0 pgmap v679: 228 pgs: 2 creating+activating, 226 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-30T15:18:59.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:58 smithi172 bash[23680]: cluster 2024-03-30T15:18:57.859749+0000 mon.a (mon.0) 2735 : cluster 0 osdmap e435: 8 total, 8 up, 8 in 2024-03-30T15:18:59.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:18:58 smithi172 bash[23680]: cluster 2024-03-30T15:18:58.107092+0000 mgr.y (mgr.14526) 446 : cluster 0 pgmap v679: 228 pgs: 2 creating+activating, 226 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-30T15:19:01.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:01 smithi072 bash[21573]: cluster 2024-03-30T15:19:00.107894+0000 mgr.y (mgr.14526) 447 : cluster 0 pgmap v680: 228 pgs: 2 creating+activating, 226 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 582 B/s wr, 1 op/s 2024-03-30T15:19:01.416 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:19:01 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:19:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:19:01.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:01 smithi072 bash[28946]: cluster 2024-03-30T15:19:00.107894+0000 mgr.y (mgr.14526) 447 : cluster 0 pgmap v680: 228 pgs: 2 creating+activating, 226 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 582 B/s wr, 1 op/s 2024-03-30T15:19:01.465 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:19:01 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:19:01.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:01 smithi172 bash[23680]: cluster 2024-03-30T15:19:00.107894+0000 mgr.y (mgr.14526) 447 : cluster 0 pgmap v680: 228 pgs: 2 creating+activating, 226 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 582 B/s wr, 1 op/s 2024-03-30T15:19:02.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:02 smithi172 bash[23680]: audit 2024-03-30T15:19:01.326391+0000 mgr.y (mgr.14526) 448 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:19:02.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:02 smithi072 bash[21573]: audit 2024-03-30T15:19:01.326391+0000 mgr.y (mgr.14526) 448 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:19:02.666 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:02 smithi072 bash[28946]: audit 2024-03-30T15:19:01.326391+0000 mgr.y (mgr.14526) 448 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:19:03.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:03 smithi172 bash[23680]: cluster 2024-03-30T15:19:02.110119+0000 mgr.y (mgr.14526) 449 : cluster 0 pgmap v681: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 2.6 KiB/s wr, 6 op/s 2024-03-30T15:19:03.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:03 smithi072 bash[21573]: cluster 2024-03-30T15:19:02.110119+0000 mgr.y (mgr.14526) 449 : cluster 0 pgmap v681: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 2.6 KiB/s wr, 6 op/s 2024-03-30T15:19:03.666 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:03 smithi072 bash[28946]: cluster 2024-03-30T15:19:02.110119+0000 mgr.y (mgr.14526) 449 : cluster 0 pgmap v681: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 2.6 KiB/s wr, 6 op/s 2024-03-30T15:19:05.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:05 smithi172 bash[23680]: cluster 2024-03-30T15:19:04.110926+0000 mgr.y (mgr.14526) 450 : cluster 0 pgmap v682: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1.6 KiB/s wr, 3 op/s 2024-03-30T15:19:05.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:05 smithi072 bash[21573]: cluster 2024-03-30T15:19:04.110926+0000 mgr.y (mgr.14526) 450 : cluster 0 pgmap v682: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1.6 KiB/s wr, 3 op/s 2024-03-30T15:19:05.666 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:05 smithi072 bash[28946]: cluster 2024-03-30T15:19:04.110926+0000 mgr.y (mgr.14526) 450 : cluster 0 pgmap v682: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1.6 KiB/s wr, 3 op/s 2024-03-30T15:19:07.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:07 smithi172 bash[23680]: cluster 2024-03-30T15:19:06.113081+0000 mgr.y (mgr.14526) 451 : cluster 0 pgmap v683: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.4 KiB/s wr, 3 op/s 2024-03-30T15:19:07.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:07 smithi172 bash[23680]: audit 2024-03-30T15:19:06.450057+0000 mon.c (mon.2) 460 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:19:07.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:07 smithi072 bash[21573]: cluster 2024-03-30T15:19:06.113081+0000 mgr.y (mgr.14526) 451 : cluster 0 pgmap v683: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.4 KiB/s wr, 3 op/s 2024-03-30T15:19:07.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:07 smithi072 bash[21573]: audit 2024-03-30T15:19:06.450057+0000 mon.c (mon.2) 460 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:19:07.666 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:07 smithi072 bash[28946]: cluster 2024-03-30T15:19:06.113081+0000 mgr.y (mgr.14526) 451 : cluster 0 pgmap v683: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.4 KiB/s wr, 3 op/s 2024-03-30T15:19:07.666 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:07 smithi072 bash[28946]: audit 2024-03-30T15:19:06.450057+0000 mon.c (mon.2) 460 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:19:09.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:09 smithi172 bash[23680]: cluster 2024-03-30T15:19:08.113851+0000 mgr.y (mgr.14526) 452 : cluster 0 pgmap v684: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-03-30T15:19:09.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:09 smithi072 bash[21573]: cluster 2024-03-30T15:19:08.113851+0000 mgr.y (mgr.14526) 452 : cluster 0 pgmap v684: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-03-30T15:19:09.666 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:09 smithi072 bash[28946]: cluster 2024-03-30T15:19:08.113851+0000 mgr.y (mgr.14526) 452 : cluster 0 pgmap v684: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-03-30T15:19:11.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:11 smithi072 bash[21573]: cluster 2024-03-30T15:19:10.114679+0000 mgr.y (mgr.14526) 453 : cluster 0 pgmap v685: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 938 B/s rd, 1.1 KiB/s wr, 2 op/s 2024-03-30T15:19:11.416 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:19:11 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:19:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:19:11.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:11 smithi072 bash[28946]: cluster 2024-03-30T15:19:10.114679+0000 mgr.y (mgr.14526) 453 : cluster 0 pgmap v685: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 938 B/s rd, 1.1 KiB/s wr, 2 op/s 2024-03-30T15:19:11.465 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:19:11 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:19:11.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:11 smithi172 bash[23680]: cluster 2024-03-30T15:19:10.114679+0000 mgr.y (mgr.14526) 453 : cluster 0 pgmap v685: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 938 B/s rd, 1.1 KiB/s wr, 2 op/s 2024-03-30T15:19:12.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:12 smithi172 bash[23680]: audit 2024-03-30T15:19:11.333206+0000 mgr.y (mgr.14526) 454 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:19:12.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:12 smithi072 bash[21573]: audit 2024-03-30T15:19:11.333206+0000 mgr.y (mgr.14526) 454 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:19:12.666 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:12 smithi072 bash[28946]: audit 2024-03-30T15:19:11.333206+0000 mgr.y (mgr.14526) 454 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:19:13.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:13 smithi172 bash[23680]: cluster 2024-03-30T15:19:12.116904+0000 mgr.y (mgr.14526) 455 : cluster 0 pgmap v686: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.3 KiB/s wr, 4 op/s 2024-03-30T15:19:13.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:13 smithi072 bash[21573]: cluster 2024-03-30T15:19:12.116904+0000 mgr.y (mgr.14526) 455 : cluster 0 pgmap v686: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.3 KiB/s wr, 4 op/s 2024-03-30T15:19:13.666 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:13 smithi072 bash[28946]: cluster 2024-03-30T15:19:12.116904+0000 mgr.y (mgr.14526) 455 : cluster 0 pgmap v686: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.3 KiB/s wr, 4 op/s 2024-03-30T15:19:14.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:14 smithi072 bash[21573]: audit 2024-03-30T15:19:13.673459+0000 mon.c (mon.2) 461 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:19:14.666 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:14 smithi072 bash[28946]: audit 2024-03-30T15:19:13.673459+0000 mon.c (mon.2) 461 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:19:14.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:14 smithi172 bash[23680]: audit 2024-03-30T15:19:13.673459+0000 mon.c (mon.2) 461 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:19:15.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[21573]: cluster 2024-03-30T15:19:14.117676+0000 mgr.y (mgr.14526) 456 : cluster 0 pgmap v687: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-30T15:19:15.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[21573]: audit 2024-03-30T15:19:14.410490+0000 mon.c (mon.2) 462 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[21573]: audit 2024-03-30T15:19:14.411157+0000 mon.c (mon.2) 463 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[21573]: audit 2024-03-30T15:19:14.411370+0000 mon.a (mon.0) 2736 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[21573]: audit 2024-03-30T15:19:14.412817+0000 mon.a (mon.0) 2737 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[21573]: audit 2024-03-30T15:19:14.414210+0000 mon.c (mon.2) 464 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[21573]: audit 2024-03-30T15:19:14.414799+0000 mon.a (mon.0) 2738 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[21573]: audit 2024-03-30T15:19:14.415858+0000 mon.c (mon.2) 465 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[21573]: audit 2024-03-30T15:19:14.416393+0000 mon.a (mon.0) 2739 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[21573]: audit 2024-03-30T15:19:14.417311+0000 mon.c (mon.2) 466 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[21573]: audit 2024-03-30T15:19:14.417783+0000 mon.a (mon.0) 2740 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[21573]: audit 2024-03-30T15:19:14.418612+0000 mon.c (mon.2) 467 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[21573]: audit 2024-03-30T15:19:14.419324+0000 mon.a (mon.0) 2741 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[21573]: audit 2024-03-30T15:19:14.420169+0000 mon.c (mon.2) 468 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[21573]: audit 2024-03-30T15:19:14.420857+0000 mon.a (mon.0) 2742 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[21573]: audit 2024-03-30T15:19:14.421845+0000 mon.c (mon.2) 469 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[21573]: audit 2024-03-30T15:19:14.422431+0000 mon.a (mon.0) 2743 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[28946]: cluster 2024-03-30T15:19:14.117676+0000 mgr.y (mgr.14526) 456 : cluster 0 pgmap v687: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-30T15:19:15.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[28946]: audit 2024-03-30T15:19:14.410490+0000 mon.c (mon.2) 462 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[28946]: audit 2024-03-30T15:19:14.411157+0000 mon.c (mon.2) 463 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[28946]: audit 2024-03-30T15:19:14.411370+0000 mon.a (mon.0) 2736 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[28946]: audit 2024-03-30T15:19:14.412817+0000 mon.a (mon.0) 2737 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[28946]: audit 2024-03-30T15:19:14.414210+0000 mon.c (mon.2) 464 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[28946]: audit 2024-03-30T15:19:14.414799+0000 mon.a (mon.0) 2738 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[28946]: audit 2024-03-30T15:19:14.415858+0000 mon.c (mon.2) 465 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[28946]: audit 2024-03-30T15:19:14.416393+0000 mon.a (mon.0) 2739 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[28946]: audit 2024-03-30T15:19:14.417311+0000 mon.c (mon.2) 466 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[28946]: audit 2024-03-30T15:19:14.417783+0000 mon.a (mon.0) 2740 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[28946]: audit 2024-03-30T15:19:14.418612+0000 mon.c (mon.2) 467 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[28946]: audit 2024-03-30T15:19:14.419324+0000 mon.a (mon.0) 2741 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[28946]: audit 2024-03-30T15:19:14.420169+0000 mon.c (mon.2) 468 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[28946]: audit 2024-03-30T15:19:14.420857+0000 mon.a (mon.0) 2742 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[28946]: audit 2024-03-30T15:19:14.421845+0000 mon.c (mon.2) 469 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[28946]: audit 2024-03-30T15:19:14.422431+0000 mon.a (mon.0) 2743 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[28946]: cephadm 2024-03-30T15:19:14.422976+0000 mgr.y (mgr.14526) 457 : cephadm 1 Adjusting osd_memory_target on smithi072 to 3292M 2024-03-30T15:19:15.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[28946]: cephadm 2024-03-30T15:19:14.424014+0000 mgr.y (mgr.14526) 458 : cephadm 1 Adjusting osd_memory_target on smithi172 to 3292M 2024-03-30T15:19:15.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[28946]: audit 2024-03-30T15:19:14.429096+0000 mon.a (mon.0) 2744 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:19:15.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[28946]: audit 2024-03-30T15:19:14.441135+0000 mon.a (mon.0) 2745 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:19:15.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[28946]: audit 2024-03-30T15:19:14.445162+0000 mon.c (mon.2) 470 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:19:15.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[28946]: audit 2024-03-30T15:19:14.446721+0000 mon.c (mon.2) 471 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:19:15.671 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[28946]: audit 2024-03-30T15:19:14.457183+0000 mon.a (mon.0) 2746 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:19:15.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[21573]: cephadm 2024-03-30T15:19:14.422976+0000 mgr.y (mgr.14526) 457 : cephadm 1 Adjusting osd_memory_target on smithi072 to 3292M 2024-03-30T15:19:15.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[21573]: cephadm 2024-03-30T15:19:14.424014+0000 mgr.y (mgr.14526) 458 : cephadm 1 Adjusting osd_memory_target on smithi172 to 3292M 2024-03-30T15:19:15.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[21573]: audit 2024-03-30T15:19:14.429096+0000 mon.a (mon.0) 2744 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:19:15.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[21573]: audit 2024-03-30T15:19:14.441135+0000 mon.a (mon.0) 2745 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:19:15.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[21573]: audit 2024-03-30T15:19:14.445162+0000 mon.c (mon.2) 470 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:19:15.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[21573]: audit 2024-03-30T15:19:14.446721+0000 mon.c (mon.2) 471 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:19:15.671 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:15 smithi072 bash[21573]: audit 2024-03-30T15:19:14.457183+0000 mon.a (mon.0) 2746 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:19:15.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:15 smithi172 bash[23680]: cluster 2024-03-30T15:19:14.117676+0000 mgr.y (mgr.14526) 456 : cluster 0 pgmap v687: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-30T15:19:15.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:15 smithi172 bash[23680]: audit 2024-03-30T15:19:14.410490+0000 mon.c (mon.2) 462 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:15 smithi172 bash[23680]: audit 2024-03-30T15:19:14.411157+0000 mon.c (mon.2) 463 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:15 smithi172 bash[23680]: audit 2024-03-30T15:19:14.411370+0000 mon.a (mon.0) 2736 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:15 smithi172 bash[23680]: audit 2024-03-30T15:19:14.412817+0000 mon.a (mon.0) 2737 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:15 smithi172 bash[23680]: audit 2024-03-30T15:19:14.414210+0000 mon.c (mon.2) 464 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:15 smithi172 bash[23680]: audit 2024-03-30T15:19:14.414799+0000 mon.a (mon.0) 2738 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:15 smithi172 bash[23680]: audit 2024-03-30T15:19:14.415858+0000 mon.c (mon.2) 465 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:15 smithi172 bash[23680]: audit 2024-03-30T15:19:14.416393+0000 mon.a (mon.0) 2739 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:15 smithi172 bash[23680]: audit 2024-03-30T15:19:14.417311+0000 mon.c (mon.2) 466 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:15 smithi172 bash[23680]: audit 2024-03-30T15:19:14.417783+0000 mon.a (mon.0) 2740 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:15 smithi172 bash[23680]: audit 2024-03-30T15:19:14.418612+0000 mon.c (mon.2) 467 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:15 smithi172 bash[23680]: audit 2024-03-30T15:19:14.419324+0000 mon.a (mon.0) 2741 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:15 smithi172 bash[23680]: audit 2024-03-30T15:19:14.420169+0000 mon.c (mon.2) 468 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:15 smithi172 bash[23680]: audit 2024-03-30T15:19:14.420857+0000 mon.a (mon.0) 2742 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:15 smithi172 bash[23680]: audit 2024-03-30T15:19:14.421845+0000 mon.c (mon.2) 469 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:15 smithi172 bash[23680]: audit 2024-03-30T15:19:14.422431+0000 mon.a (mon.0) 2743 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-30T15:19:15.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:15 smithi172 bash[23680]: cephadm 2024-03-30T15:19:14.422976+0000 mgr.y (mgr.14526) 457 : cephadm 1 Adjusting osd_memory_target on smithi072 to 3292M 2024-03-30T15:19:15.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:15 smithi172 bash[23680]: cephadm 2024-03-30T15:19:14.424014+0000 mgr.y (mgr.14526) 458 : cephadm 1 Adjusting osd_memory_target on smithi172 to 3292M 2024-03-30T15:19:15.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:15 smithi172 bash[23680]: audit 2024-03-30T15:19:14.429096+0000 mon.a (mon.0) 2744 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:19:15.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:15 smithi172 bash[23680]: audit 2024-03-30T15:19:14.441135+0000 mon.a (mon.0) 2745 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:19:15.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:15 smithi172 bash[23680]: audit 2024-03-30T15:19:14.445162+0000 mon.c (mon.2) 470 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:19:15.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:15 smithi172 bash[23680]: audit 2024-03-30T15:19:14.446721+0000 mon.c (mon.2) 471 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:19:15.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:15 smithi172 bash[23680]: audit 2024-03-30T15:19:14.457183+0000 mon.a (mon.0) 2746 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:19:17.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:17 smithi072 bash[21573]: cluster 2024-03-30T15:19:16.119832+0000 mgr.y (mgr.14526) 459 : cluster 0 pgmap v688: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-30T15:19:17.666 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:17 smithi072 bash[28946]: cluster 2024-03-30T15:19:16.119832+0000 mgr.y (mgr.14526) 459 : cluster 0 pgmap v688: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-30T15:19:17.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:17 smithi172 bash[23680]: cluster 2024-03-30T15:19:16.119832+0000 mgr.y (mgr.14526) 459 : cluster 0 pgmap v688: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-30T15:19:18.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:18 smithi072 bash[21573]: audit 2024-03-30T15:19:17.969711+0000 mon.a (mon.0) 2747 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:19:18.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:18 smithi072 bash[21573]: audit 2024-03-30T15:19:17.970760+0000 mon.a (mon.0) 2748 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-71"}]: dispatch 2024-03-30T15:19:18.666 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:18 smithi072 bash[28946]: audit 2024-03-30T15:19:17.969711+0000 mon.a (mon.0) 2747 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:19:18.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:18 smithi072 bash[28946]: audit 2024-03-30T15:19:17.970760+0000 mon.a (mon.0) 2748 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-71"}]: dispatch 2024-03-30T15:19:18.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:18 smithi172 bash[23680]: audit 2024-03-30T15:19:17.969711+0000 mon.a (mon.0) 2747 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:19:18.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:18 smithi172 bash[23680]: audit 2024-03-30T15:19:17.970760+0000 mon.a (mon.0) 2748 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-71"}]: dispatch 2024-03-30T15:19:19.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:19 smithi072 bash[21573]: cluster 2024-03-30T15:19:18.120618+0000 mgr.y (mgr.14526) 460 : cluster 0 pgmap v689: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-30T15:19:19.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:19 smithi072 bash[21573]: cluster 2024-03-30T15:19:18.251133+0000 mon.a (mon.0) 2749 : cluster 0 osdmap e436: 8 total, 8 up, 8 in 2024-03-30T15:19:19.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:19 smithi072 bash[28946]: cluster 2024-03-30T15:19:18.120618+0000 mgr.y (mgr.14526) 460 : cluster 0 pgmap v689: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-30T15:19:19.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:19 smithi072 bash[28946]: cluster 2024-03-30T15:19:18.251133+0000 mon.a (mon.0) 2749 : cluster 0 osdmap e436: 8 total, 8 up, 8 in 2024-03-30T15:19:19.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:19 smithi172 bash[23680]: cluster 2024-03-30T15:19:18.120618+0000 mgr.y (mgr.14526) 460 : cluster 0 pgmap v689: 228 pgs: 228 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-30T15:19:19.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:19 smithi172 bash[23680]: cluster 2024-03-30T15:19:18.251133+0000 mon.a (mon.0) 2749 : cluster 0 osdmap e436: 8 total, 8 up, 8 in 2024-03-30T15:19:20.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:20 smithi072 bash[21573]: cluster 2024-03-30T15:19:19.261821+0000 mon.a (mon.0) 2750 : cluster 0 osdmap e437: 8 total, 8 up, 8 in 2024-03-30T15:19:20.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:20 smithi072 bash[21573]: audit 2024-03-30T15:19:19.268120+0000 mon.a (mon.0) 2751 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:19:20.666 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:20 smithi072 bash[28946]: cluster 2024-03-30T15:19:19.261821+0000 mon.a (mon.0) 2750 : cluster 0 osdmap e437: 8 total, 8 up, 8 in 2024-03-30T15:19:20.666 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:20 smithi072 bash[28946]: audit 2024-03-30T15:19:19.268120+0000 mon.a (mon.0) 2751 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:19:20.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:20 smithi172 bash[23680]: cluster 2024-03-30T15:19:19.261821+0000 mon.a (mon.0) 2750 : cluster 0 osdmap e437: 8 total, 8 up, 8 in 2024-03-30T15:19:20.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:20 smithi172 bash[23680]: audit 2024-03-30T15:19:19.268120+0000 mon.a (mon.0) 2751 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:19:21.416 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:19:21 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:19:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:19:21.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:21 smithi072 bash[21573]: cluster 2024-03-30T15:19:20.121468+0000 mgr.y (mgr.14526) 461 : cluster 0 pgmap v692: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:19:21.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:21 smithi072 bash[21573]: cluster 2024-03-30T15:19:20.253768+0000 mon.a (mon.0) 2752 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:19:21.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:21 smithi072 bash[21573]: audit 2024-03-30T15:19:20.263586+0000 mon.a (mon.0) 2753 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-73","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:19:21.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:21 smithi072 bash[21573]: cluster 2024-03-30T15:19:20.273984+0000 mon.a (mon.0) 2754 : cluster 0 osdmap e438: 8 total, 8 up, 8 in 2024-03-30T15:19:21.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:21 smithi072 bash[21573]: audit 2024-03-30T15:19:20.290317+0000 mon.a (mon.0) 2755 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:19:21.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:21 smithi072 bash[28946]: cluster 2024-03-30T15:19:20.121468+0000 mgr.y (mgr.14526) 461 : cluster 0 pgmap v692: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:19:21.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:21 smithi072 bash[28946]: cluster 2024-03-30T15:19:20.253768+0000 mon.a (mon.0) 2752 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:19:21.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:21 smithi072 bash[28946]: audit 2024-03-30T15:19:20.263586+0000 mon.a (mon.0) 2753 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-73","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:19:21.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:21 smithi072 bash[28946]: cluster 2024-03-30T15:19:20.273984+0000 mon.a (mon.0) 2754 : cluster 0 osdmap e438: 8 total, 8 up, 8 in 2024-03-30T15:19:21.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:21 smithi072 bash[28946]: audit 2024-03-30T15:19:20.290317+0000 mon.a (mon.0) 2755 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:19:21.715 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:19:21 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:19:21.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:21 smithi172 bash[23680]: cluster 2024-03-30T15:19:20.121468+0000 mgr.y (mgr.14526) 461 : cluster 0 pgmap v692: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:19:21.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:21 smithi172 bash[23680]: cluster 2024-03-30T15:19:20.253768+0000 mon.a (mon.0) 2752 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:19:21.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:21 smithi172 bash[23680]: audit 2024-03-30T15:19:20.263586+0000 mon.a (mon.0) 2753 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-73","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:19:21.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:21 smithi172 bash[23680]: cluster 2024-03-30T15:19:20.273984+0000 mon.a (mon.0) 2754 : cluster 0 osdmap e438: 8 total, 8 up, 8 in 2024-03-30T15:19:21.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:21 smithi172 bash[23680]: audit 2024-03-30T15:19:20.290317+0000 mon.a (mon.0) 2755 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:19:22.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:22 smithi072 bash[21573]: cluster 2024-03-30T15:19:21.284017+0000 mon.a (mon.0) 2756 : cluster 0 osdmap e439: 8 total, 8 up, 8 in 2024-03-30T15:19:22.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:22 smithi072 bash[21573]: audit 2024-03-30T15:19:21.344812+0000 mgr.y (mgr.14526) 462 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:19:22.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:22 smithi072 bash[21573]: audit 2024-03-30T15:19:21.484047+0000 mon.c (mon.2) 472 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:19:22.666 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:22 smithi072 bash[28946]: cluster 2024-03-30T15:19:21.284017+0000 mon.a (mon.0) 2756 : cluster 0 osdmap e439: 8 total, 8 up, 8 in 2024-03-30T15:19:22.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:22 smithi072 bash[28946]: audit 2024-03-30T15:19:21.344812+0000 mgr.y (mgr.14526) 462 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:19:22.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:22 smithi072 bash[28946]: audit 2024-03-30T15:19:21.484047+0000 mon.c (mon.2) 472 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:19:22.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:22 smithi172 bash[23680]: cluster 2024-03-30T15:19:21.284017+0000 mon.a (mon.0) 2756 : cluster 0 osdmap e439: 8 total, 8 up, 8 in 2024-03-30T15:19:22.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:22 smithi172 bash[23680]: audit 2024-03-30T15:19:21.344812+0000 mgr.y (mgr.14526) 462 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:19:22.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:22 smithi172 bash[23680]: audit 2024-03-30T15:19:21.484047+0000 mon.c (mon.2) 472 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:19:23.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:23 smithi072 bash[21573]: cluster 2024-03-30T15:19:22.122208+0000 mgr.y (mgr.14526) 463 : cluster 0 pgmap v695: 228 pgs: 228 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:19:23.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:23 smithi072 bash[21573]: cluster 2024-03-30T15:19:22.296282+0000 mon.a (mon.0) 2757 : cluster 0 osdmap e440: 8 total, 8 up, 8 in 2024-03-30T15:19:23.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:23 smithi072 bash[28946]: cluster 2024-03-30T15:19:22.122208+0000 mgr.y (mgr.14526) 463 : cluster 0 pgmap v695: 228 pgs: 228 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:19:23.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:23 smithi072 bash[28946]: cluster 2024-03-30T15:19:22.296282+0000 mon.a (mon.0) 2757 : cluster 0 osdmap e440: 8 total, 8 up, 8 in 2024-03-30T15:19:23.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:23 smithi172 bash[23680]: cluster 2024-03-30T15:19:22.122208+0000 mgr.y (mgr.14526) 463 : cluster 0 pgmap v695: 228 pgs: 228 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:19:23.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:23 smithi172 bash[23680]: cluster 2024-03-30T15:19:22.296282+0000 mon.a (mon.0) 2757 : cluster 0 osdmap e440: 8 total, 8 up, 8 in 2024-03-30T15:19:25.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:25 smithi072 bash[21573]: cluster 2024-03-30T15:19:24.123017+0000 mgr.y (mgr.14526) 464 : cluster 0 pgmap v697: 228 pgs: 228 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.0 KiB/s wr, 2 op/s 2024-03-30T15:19:25.666 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:25 smithi072 bash[28946]: cluster 2024-03-30T15:19:24.123017+0000 mgr.y (mgr.14526) 464 : cluster 0 pgmap v697: 228 pgs: 228 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.0 KiB/s wr, 2 op/s 2024-03-30T15:19:25.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:25 smithi172 bash[23680]: cluster 2024-03-30T15:19:24.123017+0000 mgr.y (mgr.14526) 464 : cluster 0 pgmap v697: 228 pgs: 228 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.0 KiB/s wr, 2 op/s 2024-03-30T15:19:27.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:27 smithi072 bash[21573]: cluster 2024-03-30T15:19:26.125105+0000 mgr.y (mgr.14526) 465 : cluster 0 pgmap v698: 228 pgs: 228 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-03-30T15:19:27.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:27 smithi072 bash[21573]: cluster 2024-03-30T15:19:27.197228+0000 mon.a (mon.0) 2758 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:19:27.666 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:27 smithi072 bash[28946]: cluster 2024-03-30T15:19:26.125105+0000 mgr.y (mgr.14526) 465 : cluster 0 pgmap v698: 228 pgs: 228 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-03-30T15:19:27.666 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:27 smithi072 bash[28946]: cluster 2024-03-30T15:19:27.197228+0000 mon.a (mon.0) 2758 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:19:27.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:27 smithi172 bash[23680]: cluster 2024-03-30T15:19:26.125105+0000 mgr.y (mgr.14526) 465 : cluster 0 pgmap v698: 228 pgs: 228 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-03-30T15:19:27.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:27 smithi172 bash[23680]: cluster 2024-03-30T15:19:27.197228+0000 mon.a (mon.0) 2758 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:19:29.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:29 smithi072 bash[21573]: cluster 2024-03-30T15:19:28.125861+0000 mgr.y (mgr.14526) 466 : cluster 0 pgmap v699: 228 pgs: 228 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 912 B/s wr, 4 op/s 2024-03-30T15:19:29.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:29 smithi072 bash[28946]: cluster 2024-03-30T15:19:28.125861+0000 mgr.y (mgr.14526) 466 : cluster 0 pgmap v699: 228 pgs: 228 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 912 B/s wr, 4 op/s 2024-03-30T15:19:29.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:29 smithi172 bash[23680]: cluster 2024-03-30T15:19:28.125861+0000 mgr.y (mgr.14526) 466 : cluster 0 pgmap v699: 228 pgs: 228 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 912 B/s wr, 4 op/s 2024-03-30T15:19:31.301 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:19:31 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:19:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:19:31.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:31 smithi072 bash[21573]: cluster 2024-03-30T15:19:30.126602+0000 mgr.y (mgr.14526) 467 : cluster 0 pgmap v700: 228 pgs: 228 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 231 B/s wr, 2 op/s 2024-03-30T15:19:31.666 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:31 smithi072 bash[28946]: cluster 2024-03-30T15:19:30.126602+0000 mgr.y (mgr.14526) 467 : cluster 0 pgmap v700: 228 pgs: 228 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 231 B/s wr, 2 op/s 2024-03-30T15:19:31.715 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:19:31 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:19:31.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:31 smithi172 bash[23680]: cluster 2024-03-30T15:19:30.126602+0000 mgr.y (mgr.14526) 467 : cluster 0 pgmap v700: 228 pgs: 228 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 231 B/s wr, 2 op/s 2024-03-30T15:19:32.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:32 smithi072 bash[21573]: audit 2024-03-30T15:19:31.353385+0000 mgr.y (mgr.14526) 468 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:19:32.666 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:32 smithi072 bash[28946]: audit 2024-03-30T15:19:31.353385+0000 mgr.y (mgr.14526) 468 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:19:32.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:32 smithi172 bash[23680]: audit 2024-03-30T15:19:31.353385+0000 mgr.y (mgr.14526) 468 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:19:33.666 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:33 smithi072 bash[28946]: cluster 2024-03-30T15:19:32.128845+0000 mgr.y (mgr.14526) 469 : cluster 0 pgmap v701: 228 pgs: 228 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 204 B/s wr, 2 op/s 2024-03-30T15:19:33.666 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:33 smithi072 bash[28946]: audit 2024-03-30T15:19:32.399184+0000 mon.a (mon.0) 2759 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:19:33.666 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:33 smithi072 bash[28946]: audit 2024-03-30T15:19:32.400176+0000 mon.a (mon.0) 2760 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-73"}]: dispatch 2024-03-30T15:19:33.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:33 smithi072 bash[21573]: cluster 2024-03-30T15:19:32.128845+0000 mgr.y (mgr.14526) 469 : cluster 0 pgmap v701: 228 pgs: 228 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 204 B/s wr, 2 op/s 2024-03-30T15:19:33.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:33 smithi072 bash[21573]: audit 2024-03-30T15:19:32.399184+0000 mon.a (mon.0) 2759 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:19:33.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:33 smithi072 bash[21573]: audit 2024-03-30T15:19:32.400176+0000 mon.a (mon.0) 2760 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-73"}]: dispatch 2024-03-30T15:19:33.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:33 smithi172 bash[23680]: cluster 2024-03-30T15:19:32.128845+0000 mgr.y (mgr.14526) 469 : cluster 0 pgmap v701: 228 pgs: 228 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 204 B/s wr, 2 op/s 2024-03-30T15:19:33.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:33 smithi172 bash[23680]: audit 2024-03-30T15:19:32.399184+0000 mon.a (mon.0) 2759 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:19:33.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:33 smithi172 bash[23680]: audit 2024-03-30T15:19:32.400176+0000 mon.a (mon.0) 2760 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-73"}]: dispatch 2024-03-30T15:19:34.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:34 smithi072 bash[21573]: cluster 2024-03-30T15:19:33.347978+0000 mon.a (mon.0) 2761 : cluster 0 osdmap e441: 8 total, 8 up, 8 in 2024-03-30T15:19:34.666 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:34 smithi072 bash[28946]: cluster 2024-03-30T15:19:33.347978+0000 mon.a (mon.0) 2761 : cluster 0 osdmap e441: 8 total, 8 up, 8 in 2024-03-30T15:19:34.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:34 smithi172 bash[23680]: cluster 2024-03-30T15:19:33.347978+0000 mon.a (mon.0) 2761 : cluster 0 osdmap e441: 8 total, 8 up, 8 in 2024-03-30T15:19:35.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:35 smithi072 bash[21573]: cluster 2024-03-30T15:19:34.129716+0000 mgr.y (mgr.14526) 470 : cluster 0 pgmap v703: 196 pgs: 196 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T15:19:35.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:35 smithi072 bash[21573]: cluster 2024-03-30T15:19:34.364874+0000 mon.a (mon.0) 2762 : cluster 0 osdmap e442: 8 total, 8 up, 8 in 2024-03-30T15:19:35.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:35 smithi072 bash[21573]: audit 2024-03-30T15:19:34.371682+0000 mon.a (mon.0) 2763 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:19:35.666 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:35 smithi072 bash[28946]: cluster 2024-03-30T15:19:34.129716+0000 mgr.y (mgr.14526) 470 : cluster 0 pgmap v703: 196 pgs: 196 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T15:19:35.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:35 smithi072 bash[28946]: cluster 2024-03-30T15:19:34.364874+0000 mon.a (mon.0) 2762 : cluster 0 osdmap e442: 8 total, 8 up, 8 in 2024-03-30T15:19:35.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:35 smithi072 bash[28946]: audit 2024-03-30T15:19:34.371682+0000 mon.a (mon.0) 2763 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:19:35.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:35 smithi172 bash[23680]: cluster 2024-03-30T15:19:34.129716+0000 mgr.y (mgr.14526) 470 : cluster 0 pgmap v703: 196 pgs: 196 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T15:19:35.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:35 smithi172 bash[23680]: cluster 2024-03-30T15:19:34.364874+0000 mon.a (mon.0) 2762 : cluster 0 osdmap e442: 8 total, 8 up, 8 in 2024-03-30T15:19:35.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:35 smithi172 bash[23680]: audit 2024-03-30T15:19:34.371682+0000 mon.a (mon.0) 2763 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:19:36.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:36 smithi072 bash[21573]: audit 2024-03-30T15:19:35.356544+0000 mon.a (mon.0) 2764 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-75","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:19:36.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:36 smithi072 bash[21573]: cluster 2024-03-30T15:19:35.364393+0000 mon.a (mon.0) 2765 : cluster 0 osdmap e443: 8 total, 8 up, 8 in 2024-03-30T15:19:36.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:36 smithi072 bash[21573]: audit 2024-03-30T15:19:35.369817+0000 mon.a (mon.0) 2766 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:19:36.666 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:36 smithi072 bash[28946]: audit 2024-03-30T15:19:35.356544+0000 mon.a (mon.0) 2764 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-75","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:19:36.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:36 smithi072 bash[28946]: cluster 2024-03-30T15:19:35.364393+0000 mon.a (mon.0) 2765 : cluster 0 osdmap e443: 8 total, 8 up, 8 in 2024-03-30T15:19:36.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:36 smithi072 bash[28946]: audit 2024-03-30T15:19:35.369817+0000 mon.a (mon.0) 2766 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:19:36.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:36 smithi172 bash[23680]: audit 2024-03-30T15:19:35.356544+0000 mon.a (mon.0) 2764 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-75","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:19:36.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:36 smithi172 bash[23680]: cluster 2024-03-30T15:19:35.364393+0000 mon.a (mon.0) 2765 : cluster 0 osdmap e443: 8 total, 8 up, 8 in 2024-03-30T15:19:36.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:36 smithi172 bash[23680]: audit 2024-03-30T15:19:35.369817+0000 mon.a (mon.0) 2766 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:19:37.666 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:37 smithi072 bash[28946]: cluster 2024-03-30T15:19:36.131721+0000 mgr.y (mgr.14526) 471 : cluster 0 pgmap v706: 228 pgs: 228 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:19:37.666 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:37 smithi072 bash[28946]: cluster 2024-03-30T15:19:36.405816+0000 mon.a (mon.0) 2767 : cluster 0 osdmap e444: 8 total, 8 up, 8 in 2024-03-30T15:19:37.666 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:37 smithi072 bash[28946]: audit 2024-03-30T15:19:36.520863+0000 mon.c (mon.2) 473 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:19:37.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:37 smithi072 bash[21573]: cluster 2024-03-30T15:19:36.131721+0000 mgr.y (mgr.14526) 471 : cluster 0 pgmap v706: 228 pgs: 228 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:19:37.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:37 smithi072 bash[21573]: cluster 2024-03-30T15:19:36.405816+0000 mon.a (mon.0) 2767 : cluster 0 osdmap e444: 8 total, 8 up, 8 in 2024-03-30T15:19:37.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:37 smithi072 bash[21573]: audit 2024-03-30T15:19:36.520863+0000 mon.c (mon.2) 473 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:19:37.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:37 smithi172 bash[23680]: cluster 2024-03-30T15:19:36.131721+0000 mgr.y (mgr.14526) 471 : cluster 0 pgmap v706: 228 pgs: 228 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:19:37.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:37 smithi172 bash[23680]: cluster 2024-03-30T15:19:36.405816+0000 mon.a (mon.0) 2767 : cluster 0 osdmap e444: 8 total, 8 up, 8 in 2024-03-30T15:19:37.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:37 smithi172 bash[23680]: audit 2024-03-30T15:19:36.520863+0000 mon.c (mon.2) 473 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:19:38.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:38 smithi172 bash[23680]: cluster 2024-03-30T15:19:37.416375+0000 mon.a (mon.0) 2768 : cluster 0 osdmap e445: 8 total, 8 up, 8 in 2024-03-30T15:19:38.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:38 smithi172 bash[23680]: audit 2024-03-30T15:19:37.523290+0000 mon.a (mon.0) 2769 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:19:38.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:38 smithi172 bash[23680]: audit 2024-03-30T15:19:37.524203+0000 mon.a (mon.0) 2770 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-75"}]: dispatch 2024-03-30T15:19:38.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:38 smithi072 bash[21573]: cluster 2024-03-30T15:19:37.416375+0000 mon.a (mon.0) 2768 : cluster 0 osdmap e445: 8 total, 8 up, 8 in 2024-03-30T15:19:38.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:38 smithi072 bash[21573]: audit 2024-03-30T15:19:37.523290+0000 mon.a (mon.0) 2769 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:19:38.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:38 smithi072 bash[21573]: audit 2024-03-30T15:19:37.524203+0000 mon.a (mon.0) 2770 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-75"}]: dispatch 2024-03-30T15:19:38.916 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:38 smithi072 bash[28946]: cluster 2024-03-30T15:19:37.416375+0000 mon.a (mon.0) 2768 : cluster 0 osdmap e445: 8 total, 8 up, 8 in 2024-03-30T15:19:38.916 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:38 smithi072 bash[28946]: audit 2024-03-30T15:19:37.523290+0000 mon.a (mon.0) 2769 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:19:38.916 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:38 smithi072 bash[28946]: audit 2024-03-30T15:19:37.524203+0000 mon.a (mon.0) 2770 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-75"}]: dispatch 2024-03-30T15:19:39.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:39 smithi172 bash[23680]: cluster 2024-03-30T15:19:38.132544+0000 mgr.y (mgr.14526) 472 : cluster 0 pgmap v709: 228 pgs: 228 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-03-30T15:19:39.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:39 smithi172 bash[23680]: cluster 2024-03-30T15:19:38.430485+0000 mon.a (mon.0) 2771 : cluster 0 osdmap e446: 8 total, 8 up, 8 in 2024-03-30T15:19:39.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:39 smithi072 bash[21573]: cluster 2024-03-30T15:19:38.132544+0000 mgr.y (mgr.14526) 472 : cluster 0 pgmap v709: 228 pgs: 228 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-03-30T15:19:39.967 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:39 smithi072 bash[21573]: cluster 2024-03-30T15:19:38.430485+0000 mon.a (mon.0) 2771 : cluster 0 osdmap e446: 8 total, 8 up, 8 in 2024-03-30T15:19:39.968 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:39 smithi072 bash[28946]: cluster 2024-03-30T15:19:38.132544+0000 mgr.y (mgr.14526) 472 : cluster 0 pgmap v709: 228 pgs: 228 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-03-30T15:19:39.968 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:39 smithi072 bash[28946]: cluster 2024-03-30T15:19:38.430485+0000 mon.a (mon.0) 2771 : cluster 0 osdmap e446: 8 total, 8 up, 8 in 2024-03-30T15:19:40.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:40 smithi172 bash[23680]: cluster 2024-03-30T15:19:39.447919+0000 mon.a (mon.0) 2772 : cluster 0 osdmap e447: 8 total, 8 up, 8 in 2024-03-30T15:19:40.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:40 smithi172 bash[23680]: audit 2024-03-30T15:19:39.450525+0000 mon.a (mon.0) 2773 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:19:40.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:40 smithi072 bash[21573]: cluster 2024-03-30T15:19:39.447919+0000 mon.a (mon.0) 2772 : cluster 0 osdmap e447: 8 total, 8 up, 8 in 2024-03-30T15:19:40.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:40 smithi072 bash[21573]: audit 2024-03-30T15:19:39.450525+0000 mon.a (mon.0) 2773 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:19:40.916 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:40 smithi072 bash[28946]: cluster 2024-03-30T15:19:39.447919+0000 mon.a (mon.0) 2772 : cluster 0 osdmap e447: 8 total, 8 up, 8 in 2024-03-30T15:19:40.916 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:40 smithi072 bash[28946]: audit 2024-03-30T15:19:39.450525+0000 mon.a (mon.0) 2773 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:19:41.416 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:19:41 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:19:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:19:41.446 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:19:41 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:19:41.446 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:19:41 smithi172 bash[50795]: logger=cleanup t=2024-03-30T15:19:41.183585914Z level=info msg="Completed cleanup jobs" duration=81.757228ms 2024-03-30T15:19:41.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:41 smithi172 bash[23680]: cluster 2024-03-30T15:19:40.133429+0000 mgr.y (mgr.14526) 473 : cluster 0 pgmap v712: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:19:41.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:41 smithi172 bash[23680]: cluster 2024-03-30T15:19:40.436954+0000 mon.a (mon.0) 2774 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:19:41.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:41 smithi172 bash[23680]: audit 2024-03-30T15:19:40.448823+0000 mon.a (mon.0) 2775 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-77","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:19:41.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:41 smithi172 bash[23680]: cluster 2024-03-30T15:19:40.460291+0000 mon.a (mon.0) 2776 : cluster 0 osdmap e448: 8 total, 8 up, 8 in 2024-03-30T15:19:41.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:41 smithi172 bash[23680]: audit 2024-03-30T15:19:40.471010+0000 mon.a (mon.0) 2777 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:19:41.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:41 smithi072 bash[21573]: cluster 2024-03-30T15:19:40.133429+0000 mgr.y (mgr.14526) 473 : cluster 0 pgmap v712: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:19:41.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:41 smithi072 bash[21573]: cluster 2024-03-30T15:19:40.436954+0000 mon.a (mon.0) 2774 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:19:41.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:41 smithi072 bash[21573]: audit 2024-03-30T15:19:40.448823+0000 mon.a (mon.0) 2775 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-77","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:19:41.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:41 smithi072 bash[21573]: cluster 2024-03-30T15:19:40.460291+0000 mon.a (mon.0) 2776 : cluster 0 osdmap e448: 8 total, 8 up, 8 in 2024-03-30T15:19:41.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:41 smithi072 bash[21573]: audit 2024-03-30T15:19:40.471010+0000 mon.a (mon.0) 2777 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:19:41.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:41 smithi072 bash[28946]: cluster 2024-03-30T15:19:40.133429+0000 mgr.y (mgr.14526) 473 : cluster 0 pgmap v712: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:19:41.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:41 smithi072 bash[28946]: cluster 2024-03-30T15:19:40.436954+0000 mon.a (mon.0) 2774 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:19:41.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:41 smithi072 bash[28946]: audit 2024-03-30T15:19:40.448823+0000 mon.a (mon.0) 2775 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-77","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:19:41.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:41 smithi072 bash[28946]: cluster 2024-03-30T15:19:40.460291+0000 mon.a (mon.0) 2776 : cluster 0 osdmap e448: 8 total, 8 up, 8 in 2024-03-30T15:19:41.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:41 smithi072 bash[28946]: audit 2024-03-30T15:19:40.471010+0000 mon.a (mon.0) 2777 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:19:42.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:42 smithi072 bash[21573]: audit 2024-03-30T15:19:41.364862+0000 mgr.y (mgr.14526) 474 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:19:42.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:42 smithi072 bash[21573]: cluster 2024-03-30T15:19:41.466533+0000 mon.a (mon.0) 2778 : cluster 0 osdmap e449: 8 total, 8 up, 8 in 2024-03-30T15:19:42.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:42 smithi072 bash[21573]: audit 2024-03-30T15:19:41.562764+0000 mon.a (mon.0) 2779 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:19:42.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:42 smithi072 bash[21573]: audit 2024-03-30T15:19:41.563687+0000 mon.a (mon.0) 2780 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-77"}]: dispatch 2024-03-30T15:19:42.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:42 smithi072 bash[28946]: audit 2024-03-30T15:19:41.364862+0000 mgr.y (mgr.14526) 474 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:19:42.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:42 smithi072 bash[28946]: cluster 2024-03-30T15:19:41.466533+0000 mon.a (mon.0) 2778 : cluster 0 osdmap e449: 8 total, 8 up, 8 in 2024-03-30T15:19:42.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:42 smithi072 bash[28946]: audit 2024-03-30T15:19:41.562764+0000 mon.a (mon.0) 2779 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:19:42.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:42 smithi072 bash[28946]: audit 2024-03-30T15:19:41.563687+0000 mon.a (mon.0) 2780 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-77"}]: dispatch 2024-03-30T15:19:42.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:42 smithi172 bash[23680]: audit 2024-03-30T15:19:41.364862+0000 mgr.y (mgr.14526) 474 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:19:42.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:42 smithi172 bash[23680]: cluster 2024-03-30T15:19:41.466533+0000 mon.a (mon.0) 2778 : cluster 0 osdmap e449: 8 total, 8 up, 8 in 2024-03-30T15:19:42.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:42 smithi172 bash[23680]: audit 2024-03-30T15:19:41.562764+0000 mon.a (mon.0) 2779 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:19:42.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:42 smithi172 bash[23680]: audit 2024-03-30T15:19:41.563687+0000 mon.a (mon.0) 2780 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-77"}]: dispatch 2024-03-30T15:19:43.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:43 smithi072 bash[21573]: cluster 2024-03-30T15:19:42.134220+0000 mgr.y (mgr.14526) 475 : cluster 0 pgmap v715: 228 pgs: 228 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-03-30T15:19:43.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:43 smithi072 bash[21573]: cluster 2024-03-30T15:19:42.481596+0000 mon.a (mon.0) 2781 : cluster 0 osdmap e450: 8 total, 8 up, 8 in 2024-03-30T15:19:43.916 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:43 smithi072 bash[28946]: cluster 2024-03-30T15:19:42.134220+0000 mgr.y (mgr.14526) 475 : cluster 0 pgmap v715: 228 pgs: 228 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-03-30T15:19:43.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:43 smithi072 bash[28946]: cluster 2024-03-30T15:19:42.481596+0000 mon.a (mon.0) 2781 : cluster 0 osdmap e450: 8 total, 8 up, 8 in 2024-03-30T15:19:43.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:43 smithi172 bash[23680]: cluster 2024-03-30T15:19:42.134220+0000 mgr.y (mgr.14526) 475 : cluster 0 pgmap v715: 228 pgs: 228 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-03-30T15:19:43.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:43 smithi172 bash[23680]: cluster 2024-03-30T15:19:42.481596+0000 mon.a (mon.0) 2781 : cluster 0 osdmap e450: 8 total, 8 up, 8 in 2024-03-30T15:19:44.916 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:44 smithi072 bash[28946]: cluster 2024-03-30T15:19:43.489702+0000 mon.a (mon.0) 2782 : cluster 0 osdmap e451: 8 total, 8 up, 8 in 2024-03-30T15:19:44.916 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:44 smithi072 bash[28946]: audit 2024-03-30T15:19:43.508980+0000 mon.a (mon.0) 2783 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:19:44.916 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:44 smithi072 bash[28946]: audit 2024-03-30T15:19:44.477452+0000 mon.a (mon.0) 2784 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-79","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:19:44.916 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:44 smithi072 bash[28946]: cluster 2024-03-30T15:19:44.494507+0000 mon.a (mon.0) 2785 : cluster 0 osdmap e452: 8 total, 8 up, 8 in 2024-03-30T15:19:44.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:44 smithi072 bash[21573]: cluster 2024-03-30T15:19:43.489702+0000 mon.a (mon.0) 2782 : cluster 0 osdmap e451: 8 total, 8 up, 8 in 2024-03-30T15:19:44.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:44 smithi072 bash[21573]: audit 2024-03-30T15:19:43.508980+0000 mon.a (mon.0) 2783 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:19:44.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:44 smithi072 bash[21573]: audit 2024-03-30T15:19:44.477452+0000 mon.a (mon.0) 2784 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-79","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:19:44.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:44 smithi072 bash[21573]: cluster 2024-03-30T15:19:44.494507+0000 mon.a (mon.0) 2785 : cluster 0 osdmap e452: 8 total, 8 up, 8 in 2024-03-30T15:19:44.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:44 smithi172 bash[23680]: cluster 2024-03-30T15:19:43.489702+0000 mon.a (mon.0) 2782 : cluster 0 osdmap e451: 8 total, 8 up, 8 in 2024-03-30T15:19:44.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:44 smithi172 bash[23680]: audit 2024-03-30T15:19:43.508980+0000 mon.a (mon.0) 2783 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:19:44.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:44 smithi172 bash[23680]: audit 2024-03-30T15:19:44.477452+0000 mon.a (mon.0) 2784 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-79","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:19:44.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:44 smithi172 bash[23680]: cluster 2024-03-30T15:19:44.494507+0000 mon.a (mon.0) 2785 : cluster 0 osdmap e452: 8 total, 8 up, 8 in 2024-03-30T15:19:45.916 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:45 smithi072 bash[28946]: cluster 2024-03-30T15:19:44.135044+0000 mgr.y (mgr.14526) 476 : cluster 0 pgmap v718: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-30T15:19:45.916 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:45 smithi072 bash[28946]: audit 2024-03-30T15:19:44.499745+0000 mon.a (mon.0) 2786 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:19:45.916 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:45 smithi072 bash[28946]: cluster 2024-03-30T15:19:45.487552+0000 mon.a (mon.0) 2787 : cluster 0 osdmap e453: 8 total, 8 up, 8 in 2024-03-30T15:19:45.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:45 smithi072 bash[21573]: cluster 2024-03-30T15:19:44.135044+0000 mgr.y (mgr.14526) 476 : cluster 0 pgmap v718: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-30T15:19:45.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:45 smithi072 bash[21573]: audit 2024-03-30T15:19:44.499745+0000 mon.a (mon.0) 2786 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:19:45.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:45 smithi072 bash[21573]: cluster 2024-03-30T15:19:45.487552+0000 mon.a (mon.0) 2787 : cluster 0 osdmap e453: 8 total, 8 up, 8 in 2024-03-30T15:19:45.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:45 smithi172 bash[23680]: cluster 2024-03-30T15:19:44.135044+0000 mgr.y (mgr.14526) 476 : cluster 0 pgmap v718: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-30T15:19:45.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:45 smithi172 bash[23680]: audit 2024-03-30T15:19:44.499745+0000 mon.a (mon.0) 2786 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:19:45.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:45 smithi172 bash[23680]: cluster 2024-03-30T15:19:45.487552+0000 mon.a (mon.0) 2787 : cluster 0 osdmap e453: 8 total, 8 up, 8 in 2024-03-30T15:19:47.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:47 smithi072 bash[21573]: cluster 2024-03-30T15:19:46.137187+0000 mgr.y (mgr.14526) 477 : cluster 0 pgmap v721: 228 pgs: 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-03-30T15:19:47.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:47 smithi072 bash[21573]: cluster 2024-03-30T15:19:46.489723+0000 mon.a (mon.0) 2788 : cluster 0 osdmap e454: 8 total, 8 up, 8 in 2024-03-30T15:19:47.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:47 smithi072 bash[21573]: audit 2024-03-30T15:19:46.528465+0000 mon.a (mon.0) 2789 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "305.1"}]: dispatch 2024-03-30T15:19:47.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:47 smithi072 bash[21573]: audit 2024-03-30T15:19:46.528905+0000 mgr.y (mgr.14526) 478 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "305.1"}]: dispatch 2024-03-30T15:19:47.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:47 smithi072 bash[21573]: cluster 2024-03-30T15:19:46.539862+0000 mon.a (mon.0) 2790 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:19:47.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:47 smithi072 bash[21573]: cluster 2024-03-30T15:19:47.234605+0000 osd.4 (osd.4) 9 : cluster 0 305.1 deep-scrub starts 2024-03-30T15:19:47.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:47 smithi072 bash[21573]: cluster 2024-03-30T15:19:47.239396+0000 osd.4 (osd.4) 10 : cluster 0 305.1 deep-scrub ok 2024-03-30T15:19:47.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:47 smithi072 bash[28946]: cluster 2024-03-30T15:19:46.137187+0000 mgr.y (mgr.14526) 477 : cluster 0 pgmap v721: 228 pgs: 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-03-30T15:19:47.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:47 smithi072 bash[28946]: cluster 2024-03-30T15:19:46.489723+0000 mon.a (mon.0) 2788 : cluster 0 osdmap e454: 8 total, 8 up, 8 in 2024-03-30T15:19:47.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:47 smithi072 bash[28946]: audit 2024-03-30T15:19:46.528465+0000 mon.a (mon.0) 2789 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "305.1"}]: dispatch 2024-03-30T15:19:47.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:47 smithi072 bash[28946]: audit 2024-03-30T15:19:46.528905+0000 mgr.y (mgr.14526) 478 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "305.1"}]: dispatch 2024-03-30T15:19:47.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:47 smithi072 bash[28946]: cluster 2024-03-30T15:19:46.539862+0000 mon.a (mon.0) 2790 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:19:47.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:47 smithi072 bash[28946]: cluster 2024-03-30T15:19:47.234605+0000 osd.4 (osd.4) 9 : cluster 0 305.1 deep-scrub starts 2024-03-30T15:19:47.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:47 smithi072 bash[28946]: cluster 2024-03-30T15:19:47.239396+0000 osd.4 (osd.4) 10 : cluster 0 305.1 deep-scrub ok 2024-03-30T15:19:47.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:47 smithi172 bash[23680]: cluster 2024-03-30T15:19:46.137187+0000 mgr.y (mgr.14526) 477 : cluster 0 pgmap v721: 228 pgs: 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-03-30T15:19:47.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:47 smithi172 bash[23680]: cluster 2024-03-30T15:19:46.489723+0000 mon.a (mon.0) 2788 : cluster 0 osdmap e454: 8 total, 8 up, 8 in 2024-03-30T15:19:47.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:47 smithi172 bash[23680]: audit 2024-03-30T15:19:46.528465+0000 mon.a (mon.0) 2789 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "305.1"}]: dispatch 2024-03-30T15:19:47.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:47 smithi172 bash[23680]: audit 2024-03-30T15:19:46.528905+0000 mgr.y (mgr.14526) 478 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "305.1"}]: dispatch 2024-03-30T15:19:47.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:47 smithi172 bash[23680]: cluster 2024-03-30T15:19:46.539862+0000 mon.a (mon.0) 2790 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:19:47.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:47 smithi172 bash[23680]: cluster 2024-03-30T15:19:47.234605+0000 osd.4 (osd.4) 9 : cluster 0 305.1 deep-scrub starts 2024-03-30T15:19:47.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:47 smithi172 bash[23680]: cluster 2024-03-30T15:19:47.239396+0000 osd.4 (osd.4) 10 : cluster 0 305.1 deep-scrub ok 2024-03-30T15:19:49.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:49 smithi072 bash[21573]: cluster 2024-03-30T15:19:48.137944+0000 mgr.y (mgr.14526) 479 : cluster 0 pgmap v723: 228 pgs: 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-03-30T15:19:49.916 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:49 smithi072 bash[28946]: cluster 2024-03-30T15:19:48.137944+0000 mgr.y (mgr.14526) 479 : cluster 0 pgmap v723: 228 pgs: 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-03-30T15:19:49.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:49 smithi172 bash[23680]: cluster 2024-03-30T15:19:48.137944+0000 mgr.y (mgr.14526) 479 : cluster 0 pgmap v723: 228 pgs: 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-03-30T15:19:51.416 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:19:51 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:19:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:19:51.715 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:19:51 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:19:51.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:51 smithi172 bash[23680]: cluster 2024-03-30T15:19:50.138740+0000 mgr.y (mgr.14526) 480 : cluster 0 pgmap v724: 228 pgs: 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 852 B/s wr, 2 op/s 2024-03-30T15:19:51.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:51 smithi072 bash[21573]: cluster 2024-03-30T15:19:50.138740+0000 mgr.y (mgr.14526) 480 : cluster 0 pgmap v724: 228 pgs: 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 852 B/s wr, 2 op/s 2024-03-30T15:19:51.916 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:51 smithi072 bash[28946]: cluster 2024-03-30T15:19:50.138740+0000 mgr.y (mgr.14526) 480 : cluster 0 pgmap v724: 228 pgs: 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 852 B/s wr, 2 op/s 2024-03-30T15:19:52.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:52 smithi072 bash[21573]: audit 2024-03-30T15:19:51.369479+0000 mgr.y (mgr.14526) 481 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:19:52.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:52 smithi072 bash[21573]: audit 2024-03-30T15:19:51.555453+0000 mon.c (mon.2) 474 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:19:52.916 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:52 smithi072 bash[28946]: audit 2024-03-30T15:19:51.369479+0000 mgr.y (mgr.14526) 481 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:19:52.916 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:52 smithi072 bash[28946]: audit 2024-03-30T15:19:51.555453+0000 mon.c (mon.2) 474 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:19:52.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:52 smithi172 bash[23680]: audit 2024-03-30T15:19:51.369479+0000 mgr.y (mgr.14526) 481 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:19:52.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:52 smithi172 bash[23680]: audit 2024-03-30T15:19:51.555453+0000 mon.c (mon.2) 474 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:19:53.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:53 smithi072 bash[21573]: cluster 2024-03-30T15:19:52.140954+0000 mgr.y (mgr.14526) 482 : cluster 0 pgmap v725: 228 pgs: 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 802 B/s wr, 3 op/s 2024-03-30T15:19:53.916 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:53 smithi072 bash[28946]: cluster 2024-03-30T15:19:52.140954+0000 mgr.y (mgr.14526) 482 : cluster 0 pgmap v725: 228 pgs: 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 802 B/s wr, 3 op/s 2024-03-30T15:19:53.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:53 smithi172 bash[23680]: cluster 2024-03-30T15:19:52.140954+0000 mgr.y (mgr.14526) 482 : cluster 0 pgmap v725: 228 pgs: 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 802 B/s wr, 3 op/s 2024-03-30T15:19:55.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:55 smithi072 bash[21573]: cluster 2024-03-30T15:19:54.141752+0000 mgr.y (mgr.14526) 483 : cluster 0 pgmap v726: 228 pgs: 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 709 B/s wr, 2 op/s 2024-03-30T15:19:55.916 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:55 smithi072 bash[28946]: cluster 2024-03-30T15:19:54.141752+0000 mgr.y (mgr.14526) 483 : cluster 0 pgmap v726: 228 pgs: 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 709 B/s wr, 2 op/s 2024-03-30T15:19:55.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:55 smithi172 bash[23680]: cluster 2024-03-30T15:19:54.141752+0000 mgr.y (mgr.14526) 483 : cluster 0 pgmap v726: 228 pgs: 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 709 B/s wr, 2 op/s 2024-03-30T15:19:57.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:57 smithi072 bash[21573]: cluster 2024-03-30T15:19:56.143917+0000 mgr.y (mgr.14526) 484 : cluster 0 pgmap v727: 228 pgs: 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 102 B/s wr, 1 op/s 2024-03-30T15:19:57.916 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:57 smithi072 bash[28946]: cluster 2024-03-30T15:19:56.143917+0000 mgr.y (mgr.14526) 484 : cluster 0 pgmap v727: 228 pgs: 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 102 B/s wr, 1 op/s 2024-03-30T15:19:57.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:57 smithi172 bash[23680]: cluster 2024-03-30T15:19:56.143917+0000 mgr.y (mgr.14526) 484 : cluster 0 pgmap v727: 228 pgs: 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 102 B/s wr, 1 op/s 2024-03-30T15:19:59.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:19:59 smithi072 bash[21573]: cluster 2024-03-30T15:19:58.144726+0000 mgr.y (mgr.14526) 485 : cluster 0 pgmap v728: 228 pgs: 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 878 B/s rd, 87 B/s wr, 1 op/s 2024-03-30T15:19:59.916 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:19:59 smithi072 bash[28946]: cluster 2024-03-30T15:19:58.144726+0000 mgr.y (mgr.14526) 485 : cluster 0 pgmap v728: 228 pgs: 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 878 B/s rd, 87 B/s wr, 1 op/s 2024-03-30T15:19:59.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:19:59 smithi172 bash[23680]: cluster 2024-03-30T15:19:58.144726+0000 mgr.y (mgr.14526) 485 : cluster 0 pgmap v728: 228 pgs: 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 878 B/s rd, 87 B/s wr, 1 op/s 2024-03-30T15:20:00.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:00 smithi072 bash[21573]: cluster 2024-03-30T15:20:00.000169+0000 mon.a (mon.0) 2791 : cluster 3 Health detail: HEALTH_WARN 1 pool(s) do not have an application enabled 2024-03-30T15:20:00.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:00 smithi072 bash[21573]: cluster 2024-03-30T15:20:00.000213+0000 mon.a (mon.0) 2792 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled 2024-03-30T15:20:00.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:00 smithi072 bash[21573]: cluster 2024-03-30T15:20:00.000233+0000 mon.a (mon.0) 2793 : cluster 3 application not enabled on pool 'ceph_test_rados_api_asio' 2024-03-30T15:20:00.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:00 smithi072 bash[21573]: cluster 2024-03-30T15:20:00.000255+0000 mon.a (mon.0) 2794 : cluster 3 use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-03-30T15:20:00.916 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:00 smithi072 bash[28946]: cluster 2024-03-30T15:20:00.000169+0000 mon.a (mon.0) 2791 : cluster 3 Health detail: HEALTH_WARN 1 pool(s) do not have an application enabled 2024-03-30T15:20:00.916 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:00 smithi072 bash[28946]: cluster 2024-03-30T15:20:00.000213+0000 mon.a (mon.0) 2792 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled 2024-03-30T15:20:00.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:00 smithi072 bash[28946]: cluster 2024-03-30T15:20:00.000233+0000 mon.a (mon.0) 2793 : cluster 3 application not enabled on pool 'ceph_test_rados_api_asio' 2024-03-30T15:20:00.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:00 smithi072 bash[28946]: cluster 2024-03-30T15:20:00.000255+0000 mon.a (mon.0) 2794 : cluster 3 use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-03-30T15:20:00.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:00 smithi172 bash[23680]: cluster 2024-03-30T15:20:00.000169+0000 mon.a (mon.0) 2791 : cluster 3 Health detail: HEALTH_WARN 1 pool(s) do not have an application enabled 2024-03-30T15:20:00.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:00 smithi172 bash[23680]: cluster 2024-03-30T15:20:00.000213+0000 mon.a (mon.0) 2792 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled 2024-03-30T15:20:00.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:00 smithi172 bash[23680]: cluster 2024-03-30T15:20:00.000233+0000 mon.a (mon.0) 2793 : cluster 3 application not enabled on pool 'ceph_test_rados_api_asio' 2024-03-30T15:20:00.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:00 smithi172 bash[23680]: cluster 2024-03-30T15:20:00.000255+0000 mon.a (mon.0) 2794 : cluster 3 use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-03-30T15:20:01.416 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:20:01 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:20:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:20:01.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:01 smithi172 bash[23680]: cluster 2024-03-30T15:20:00.145332+0000 mgr.y (mgr.14526) 486 : cluster 0 pgmap v729: 228 pgs: 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-03-30T15:20:01.715 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:20:01 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:20:01.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:01 smithi072 bash[21573]: cluster 2024-03-30T15:20:00.145332+0000 mgr.y (mgr.14526) 486 : cluster 0 pgmap v729: 228 pgs: 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-03-30T15:20:01.916 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:01 smithi072 bash[28946]: cluster 2024-03-30T15:20:00.145332+0000 mgr.y (mgr.14526) 486 : cluster 0 pgmap v729: 228 pgs: 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-03-30T15:20:02.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:02 smithi072 bash[21573]: audit 2024-03-30T15:20:01.375089+0000 mgr.y (mgr.14526) 487 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:20:02.916 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:02 smithi072 bash[28946]: audit 2024-03-30T15:20:01.375089+0000 mgr.y (mgr.14526) 487 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:20:02.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:02 smithi172 bash[23680]: audit 2024-03-30T15:20:01.375089+0000 mgr.y (mgr.14526) 487 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:20:03.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:03 smithi072 bash[21573]: cluster 2024-03-30T15:20:02.147492+0000 mgr.y (mgr.14526) 488 : cluster 0 pgmap v730: 228 pgs: 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 1 op/s 2024-03-30T15:20:03.916 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:03 smithi072 bash[28946]: cluster 2024-03-30T15:20:02.147492+0000 mgr.y (mgr.14526) 488 : cluster 0 pgmap v730: 228 pgs: 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 1 op/s 2024-03-30T15:20:03.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:03 smithi172 bash[23680]: cluster 2024-03-30T15:20:02.147492+0000 mgr.y (mgr.14526) 488 : cluster 0 pgmap v730: 228 pgs: 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 1 op/s 2024-03-30T15:20:05.915 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:05 smithi072 bash[21573]: cluster 2024-03-30T15:20:04.148268+0000 mgr.y (mgr.14526) 489 : cluster 0 pgmap v731: 228 pgs: 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:20:05.916 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:05 smithi072 bash[28946]: cluster 2024-03-30T15:20:04.148268+0000 mgr.y (mgr.14526) 489 : cluster 0 pgmap v731: 228 pgs: 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:20:05.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:05 smithi172 bash[23680]: cluster 2024-03-30T15:20:04.148268+0000 mgr.y (mgr.14526) 489 : cluster 0 pgmap v731: 228 pgs: 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:20:06.916 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 30 15:20:06 smithi072 bash[31967]: debug 2024-03-30T15:20:06.564+0000 7f159304f700 -1 snap_mapper.add_oid found existing snaps mapped on 305:8740da06:test-rados-api-smithi072-64344-80::foo:2, removing 2024-03-30T15:20:06.965 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 30 15:20:06 smithi172 bash[27186]: debug 2024-03-30T15:20:06.561+0000 7f3e3b427700 -1 snap_mapper.add_oid found existing snaps mapped on 305:8740da06:test-rados-api-smithi072-64344-80::foo:2, removing 2024-03-30T15:20:06.965 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:20:06 smithi172 bash[32737]: debug 2024-03-30T15:20:06.561+0000 7f6fb63d6700 -1 snap_mapper.add_oid found existing snaps mapped on 305:8740da06:test-rados-api-smithi072-64344-80::foo:2, removing 2024-03-30T15:20:07.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:07 smithi072 bash[21573]: cluster 2024-03-30T15:20:06.150440+0000 mgr.y (mgr.14526) 490 : cluster 0 pgmap v732: 228 pgs: 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:20:07.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:07 smithi072 bash[21573]: audit 2024-03-30T15:20:06.568502+0000 mon.a (mon.0) 2795 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:20:07.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:07 smithi072 bash[21573]: audit 2024-03-30T15:20:06.569368+0000 mon.a (mon.0) 2796 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-79"}]: dispatch 2024-03-30T15:20:07.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:07 smithi072 bash[21573]: audit 2024-03-30T15:20:06.590009+0000 mon.c (mon.2) 475 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:20:07.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:07 smithi072 bash[28946]: cluster 2024-03-30T15:20:06.150440+0000 mgr.y (mgr.14526) 490 : cluster 0 pgmap v732: 228 pgs: 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:20:07.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:07 smithi072 bash[28946]: audit 2024-03-30T15:20:06.568502+0000 mon.a (mon.0) 2795 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:20:07.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:07 smithi072 bash[28946]: audit 2024-03-30T15:20:06.569368+0000 mon.a (mon.0) 2796 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-79"}]: dispatch 2024-03-30T15:20:07.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:07 smithi072 bash[28946]: audit 2024-03-30T15:20:06.590009+0000 mon.c (mon.2) 475 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:20:07.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:07 smithi172 bash[23680]: cluster 2024-03-30T15:20:06.150440+0000 mgr.y (mgr.14526) 490 : cluster 0 pgmap v732: 228 pgs: 228 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:20:07.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:07 smithi172 bash[23680]: audit 2024-03-30T15:20:06.568502+0000 mon.a (mon.0) 2795 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:20:07.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:07 smithi172 bash[23680]: audit 2024-03-30T15:20:06.569368+0000 mon.a (mon.0) 2796 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-79"}]: dispatch 2024-03-30T15:20:07.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:07 smithi172 bash[23680]: audit 2024-03-30T15:20:06.590009+0000 mon.c (mon.2) 475 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:20:08.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:08 smithi072 bash[21573]: cluster 2024-03-30T15:20:07.555745+0000 mon.a (mon.0) 2797 : cluster 0 osdmap e455: 8 total, 8 up, 8 in 2024-03-30T15:20:08.916 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:08 smithi072 bash[28946]: cluster 2024-03-30T15:20:07.555745+0000 mon.a (mon.0) 2797 : cluster 0 osdmap e455: 8 total, 8 up, 8 in 2024-03-30T15:20:08.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:08 smithi172 bash[23680]: cluster 2024-03-30T15:20:07.555745+0000 mon.a (mon.0) 2797 : cluster 0 osdmap e455: 8 total, 8 up, 8 in 2024-03-30T15:20:09.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:09 smithi072 bash[21573]: cluster 2024-03-30T15:20:08.151198+0000 mgr.y (mgr.14526) 491 : cluster 0 pgmap v734: 196 pgs: 196 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T15:20:09.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:09 smithi072 bash[21573]: cluster 2024-03-30T15:20:08.590932+0000 mon.a (mon.0) 2798 : cluster 0 osdmap e456: 8 total, 8 up, 8 in 2024-03-30T15:20:09.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:09 smithi072 bash[21573]: audit 2024-03-30T15:20:08.598035+0000 mon.a (mon.0) 2799 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:20:09.916 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:09 smithi072 bash[28946]: cluster 2024-03-30T15:20:08.151198+0000 mgr.y (mgr.14526) 491 : cluster 0 pgmap v734: 196 pgs: 196 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T15:20:09.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:09 smithi072 bash[28946]: cluster 2024-03-30T15:20:08.590932+0000 mon.a (mon.0) 2798 : cluster 0 osdmap e456: 8 total, 8 up, 8 in 2024-03-30T15:20:09.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:09 smithi072 bash[28946]: audit 2024-03-30T15:20:08.598035+0000 mon.a (mon.0) 2799 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:20:09.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:09 smithi172 bash[23680]: cluster 2024-03-30T15:20:08.151198+0000 mgr.y (mgr.14526) 491 : cluster 0 pgmap v734: 196 pgs: 196 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T15:20:09.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:09 smithi172 bash[23680]: cluster 2024-03-30T15:20:08.590932+0000 mon.a (mon.0) 2798 : cluster 0 osdmap e456: 8 total, 8 up, 8 in 2024-03-30T15:20:09.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:09 smithi172 bash[23680]: audit 2024-03-30T15:20:08.598035+0000 mon.a (mon.0) 2799 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:20:10.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:10 smithi072 bash[21573]: audit 2024-03-30T15:20:09.581505+0000 mon.a (mon.0) 2800 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-81","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:20:10.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:10 smithi072 bash[21573]: cluster 2024-03-30T15:20:09.589925+0000 mon.a (mon.0) 2801 : cluster 0 osdmap e457: 8 total, 8 up, 8 in 2024-03-30T15:20:10.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:10 smithi072 bash[21573]: audit 2024-03-30T15:20:09.592968+0000 mon.a (mon.0) 2802 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:20:10.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:10 smithi072 bash[21573]: audit 2024-03-30T15:20:09.614583+0000 mon.a (mon.0) 2803 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-30T15:20:10.916 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:10 smithi072 bash[28946]: audit 2024-03-30T15:20:09.581505+0000 mon.a (mon.0) 2800 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-81","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:20:10.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:10 smithi072 bash[28946]: cluster 2024-03-30T15:20:09.589925+0000 mon.a (mon.0) 2801 : cluster 0 osdmap e457: 8 total, 8 up, 8 in 2024-03-30T15:20:10.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:10 smithi072 bash[28946]: audit 2024-03-30T15:20:09.592968+0000 mon.a (mon.0) 2802 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:20:10.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:10 smithi072 bash[28946]: audit 2024-03-30T15:20:09.614583+0000 mon.a (mon.0) 2803 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-30T15:20:10.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:10 smithi172 bash[23680]: audit 2024-03-30T15:20:09.581505+0000 mon.a (mon.0) 2800 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-81","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:20:10.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:10 smithi172 bash[23680]: cluster 2024-03-30T15:20:09.589925+0000 mon.a (mon.0) 2801 : cluster 0 osdmap e457: 8 total, 8 up, 8 in 2024-03-30T15:20:10.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:10 smithi172 bash[23680]: audit 2024-03-30T15:20:09.592968+0000 mon.a (mon.0) 2802 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:20:10.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:10 smithi172 bash[23680]: audit 2024-03-30T15:20:09.614583+0000 mon.a (mon.0) 2803 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-30T15:20:11.416 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:20:11 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:20:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:20:11.715 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:20:11 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:20:11.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:11 smithi172 bash[23680]: cluster 2024-03-30T15:20:10.152030+0000 mgr.y (mgr.14526) 492 : cluster 0 pgmap v737: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:20:11.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:11 smithi172 bash[23680]: audit 2024-03-30T15:20:10.613339+0000 mon.a (mon.0) 2804 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-81","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-30T15:20:11.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:11 smithi172 bash[23680]: cluster 2024-03-30T15:20:10.622489+0000 mon.a (mon.0) 2805 : cluster 0 osdmap e458: 8 total, 8 up, 8 in 2024-03-30T15:20:11.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:11 smithi172 bash[23680]: audit 2024-03-30T15:20:10.624905+0000 mon.a (mon.0) 2806 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-81","var": "dedup_tier","val": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:20:11.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:11 smithi072 bash[21573]: cluster 2024-03-30T15:20:10.152030+0000 mgr.y (mgr.14526) 492 : cluster 0 pgmap v737: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:20:11.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:11 smithi072 bash[21573]: audit 2024-03-30T15:20:10.613339+0000 mon.a (mon.0) 2804 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-81","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-30T15:20:11.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:11 smithi072 bash[21573]: cluster 2024-03-30T15:20:10.622489+0000 mon.a (mon.0) 2805 : cluster 0 osdmap e458: 8 total, 8 up, 8 in 2024-03-30T15:20:11.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:11 smithi072 bash[21573]: audit 2024-03-30T15:20:10.624905+0000 mon.a (mon.0) 2806 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-81","var": "dedup_tier","val": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:20:11.916 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:11 smithi072 bash[28946]: cluster 2024-03-30T15:20:10.152030+0000 mgr.y (mgr.14526) 492 : cluster 0 pgmap v737: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:20:11.916 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:11 smithi072 bash[28946]: audit 2024-03-30T15:20:10.613339+0000 mon.a (mon.0) 2804 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-81","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-30T15:20:11.916 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:11 smithi072 bash[28946]: cluster 2024-03-30T15:20:10.622489+0000 mon.a (mon.0) 2805 : cluster 0 osdmap e458: 8 total, 8 up, 8 in 2024-03-30T15:20:11.916 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:11 smithi072 bash[28946]: audit 2024-03-30T15:20:10.624905+0000 mon.a (mon.0) 2806 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-81","var": "dedup_tier","val": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:20:12.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:12 smithi072 bash[21573]: audit 2024-03-30T15:20:11.386207+0000 mgr.y (mgr.14526) 493 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:20:12.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:12 smithi072 bash[21573]: audit 2024-03-30T15:20:11.616324+0000 mon.a (mon.0) 2807 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-81","var": "dedup_tier","val": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:20:12.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:12 smithi072 bash[21573]: cluster 2024-03-30T15:20:11.623322+0000 mon.a (mon.0) 2808 : cluster 0 osdmap e459: 8 total, 8 up, 8 in 2024-03-30T15:20:12.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:12 smithi072 bash[21573]: audit 2024-03-30T15:20:11.625150+0000 mon.a (mon.0) 2809 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-03-30T15:20:12.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:12 smithi072 bash[21573]: audit 2024-03-30T15:20:12.619044+0000 mon.a (mon.0) 2810 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-03-30T15:20:12.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:12 smithi072 bash[28946]: audit 2024-03-30T15:20:11.386207+0000 mgr.y (mgr.14526) 493 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:20:12.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:12 smithi072 bash[28946]: audit 2024-03-30T15:20:11.616324+0000 mon.a (mon.0) 2807 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-81","var": "dedup_tier","val": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:20:12.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:12 smithi072 bash[28946]: cluster 2024-03-30T15:20:11.623322+0000 mon.a (mon.0) 2808 : cluster 0 osdmap e459: 8 total, 8 up, 8 in 2024-03-30T15:20:12.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:12 smithi072 bash[28946]: audit 2024-03-30T15:20:11.625150+0000 mon.a (mon.0) 2809 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-03-30T15:20:12.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:12 smithi072 bash[28946]: audit 2024-03-30T15:20:12.619044+0000 mon.a (mon.0) 2810 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-03-30T15:20:12.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:12 smithi172 bash[23680]: audit 2024-03-30T15:20:11.386207+0000 mgr.y (mgr.14526) 493 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:20:12.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:12 smithi172 bash[23680]: audit 2024-03-30T15:20:11.616324+0000 mon.a (mon.0) 2807 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-81","var": "dedup_tier","val": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:20:12.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:12 smithi172 bash[23680]: cluster 2024-03-30T15:20:11.623322+0000 mon.a (mon.0) 2808 : cluster 0 osdmap e459: 8 total, 8 up, 8 in 2024-03-30T15:20:12.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:12 smithi172 bash[23680]: audit 2024-03-30T15:20:11.625150+0000 mon.a (mon.0) 2809 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-03-30T15:20:12.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:12 smithi172 bash[23680]: audit 2024-03-30T15:20:12.619044+0000 mon.a (mon.0) 2810 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-03-30T15:20:13.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:13 smithi072 bash[21573]: cluster 2024-03-30T15:20:12.152853+0000 mgr.y (mgr.14526) 494 : cluster 0 pgmap v740: 228 pgs: 228 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-03-30T15:20:13.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:13 smithi072 bash[21573]: cluster 2024-03-30T15:20:12.625808+0000 mon.a (mon.0) 2811 : cluster 0 osdmap e460: 8 total, 8 up, 8 in 2024-03-30T15:20:13.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:13 smithi072 bash[21573]: audit 2024-03-30T15:20:12.630987+0000 mon.a (mon.0) 2812 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-30T15:20:13.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:13 smithi072 bash[21573]: audit 2024-03-30T15:20:13.621714+0000 mon.a (mon.0) 2813 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-03-30T15:20:13.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:13 smithi072 bash[21573]: cluster 2024-03-30T15:20:13.628880+0000 mon.a (mon.0) 2814 : cluster 0 osdmap e461: 8 total, 8 up, 8 in 2024-03-30T15:20:13.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:13 smithi072 bash[28946]: cluster 2024-03-30T15:20:12.152853+0000 mgr.y (mgr.14526) 494 : cluster 0 pgmap v740: 228 pgs: 228 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-03-30T15:20:13.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:13 smithi072 bash[28946]: cluster 2024-03-30T15:20:12.625808+0000 mon.a (mon.0) 2811 : cluster 0 osdmap e460: 8 total, 8 up, 8 in 2024-03-30T15:20:13.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:13 smithi072 bash[28946]: audit 2024-03-30T15:20:12.630987+0000 mon.a (mon.0) 2812 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-30T15:20:13.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:13 smithi072 bash[28946]: audit 2024-03-30T15:20:13.621714+0000 mon.a (mon.0) 2813 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-03-30T15:20:13.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:13 smithi072 bash[28946]: cluster 2024-03-30T15:20:13.628880+0000 mon.a (mon.0) 2814 : cluster 0 osdmap e461: 8 total, 8 up, 8 in 2024-03-30T15:20:13.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:13 smithi172 bash[23680]: cluster 2024-03-30T15:20:12.152853+0000 mgr.y (mgr.14526) 494 : cluster 0 pgmap v740: 228 pgs: 228 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-03-30T15:20:13.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:13 smithi172 bash[23680]: cluster 2024-03-30T15:20:12.625808+0000 mon.a (mon.0) 2811 : cluster 0 osdmap e460: 8 total, 8 up, 8 in 2024-03-30T15:20:13.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:13 smithi172 bash[23680]: audit 2024-03-30T15:20:12.630987+0000 mon.a (mon.0) 2812 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-30T15:20:13.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:13 smithi172 bash[23680]: audit 2024-03-30T15:20:13.621714+0000 mon.a (mon.0) 2813 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-03-30T15:20:13.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:13 smithi172 bash[23680]: cluster 2024-03-30T15:20:13.628880+0000 mon.a (mon.0) 2814 : cluster 0 osdmap e461: 8 total, 8 up, 8 in 2024-03-30T15:20:14.915 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:14 smithi072 bash[21573]: audit 2024-03-30T15:20:13.684158+0000 mon.a (mon.0) 2815 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-03-30T15:20:14.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:14 smithi072 bash[21573]: audit 2024-03-30T15:20:14.553223+0000 mon.c (mon.2) 476 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:20:14.916 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:14 smithi072 bash[28946]: audit 2024-03-30T15:20:13.684158+0000 mon.a (mon.0) 2815 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-03-30T15:20:14.916 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:14 smithi072 bash[28946]: audit 2024-03-30T15:20:14.553223+0000 mon.c (mon.2) 476 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:20:14.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:14 smithi172 bash[23680]: audit 2024-03-30T15:20:13.684158+0000 mon.a (mon.0) 2815 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-03-30T15:20:14.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:14 smithi172 bash[23680]: audit 2024-03-30T15:20:14.553223+0000 mon.c (mon.2) 476 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:20:15.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:15 smithi072 bash[21573]: cluster 2024-03-30T15:20:14.153807+0000 mgr.y (mgr.14526) 495 : cluster 0 pgmap v743: 228 pgs: 228 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-03-30T15:20:15.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:15 smithi072 bash[21573]: audit 2024-03-30T15:20:14.653972+0000 mon.a (mon.0) 2816 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-81","var": "dedup_cdc_chunk_size","val": "512"}]': finished 2024-03-30T15:20:15.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:15 smithi072 bash[21573]: cluster 2024-03-30T15:20:14.662957+0000 mon.a (mon.0) 2817 : cluster 0 osdmap e462: 8 total, 8 up, 8 in 2024-03-30T15:20:15.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:15 smithi072 bash[21573]: audit 2024-03-30T15:20:14.698958+0000 mon.a (mon.0) 2818 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-03-30T15:20:15.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:15 smithi072 bash[21573]: audit 2024-03-30T15:20:15.134554+0000 mon.a (mon.0) 2819 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:20:15.916 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:15 smithi072 bash[21573]: audit 2024-03-30T15:20:15.153913+0000 mon.a (mon.0) 2820 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:20:15.916 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:15 smithi072 bash[28946]: cluster 2024-03-30T15:20:14.153807+0000 mgr.y (mgr.14526) 495 : cluster 0 pgmap v743: 228 pgs: 228 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-03-30T15:20:15.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:15 smithi072 bash[28946]: audit 2024-03-30T15:20:14.653972+0000 mon.a (mon.0) 2816 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-81","var": "dedup_cdc_chunk_size","val": "512"}]': finished 2024-03-30T15:20:15.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:15 smithi072 bash[28946]: cluster 2024-03-30T15:20:14.662957+0000 mon.a (mon.0) 2817 : cluster 0 osdmap e462: 8 total, 8 up, 8 in 2024-03-30T15:20:15.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:15 smithi072 bash[28946]: audit 2024-03-30T15:20:14.698958+0000 mon.a (mon.0) 2818 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-03-30T15:20:15.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:15 smithi072 bash[28946]: audit 2024-03-30T15:20:15.134554+0000 mon.a (mon.0) 2819 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:20:15.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:15 smithi072 bash[28946]: audit 2024-03-30T15:20:15.153913+0000 mon.a (mon.0) 2820 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:20:15.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:15 smithi172 bash[23680]: cluster 2024-03-30T15:20:14.153807+0000 mgr.y (mgr.14526) 495 : cluster 0 pgmap v743: 228 pgs: 228 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-03-30T15:20:15.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:15 smithi172 bash[23680]: audit 2024-03-30T15:20:14.653972+0000 mon.a (mon.0) 2816 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-81","var": "dedup_cdc_chunk_size","val": "512"}]': finished 2024-03-30T15:20:15.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:15 smithi172 bash[23680]: cluster 2024-03-30T15:20:14.662957+0000 mon.a (mon.0) 2817 : cluster 0 osdmap e462: 8 total, 8 up, 8 in 2024-03-30T15:20:15.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:15 smithi172 bash[23680]: audit 2024-03-30T15:20:14.698958+0000 mon.a (mon.0) 2818 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-03-30T15:20:15.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:15 smithi172 bash[23680]: audit 2024-03-30T15:20:15.134554+0000 mon.a (mon.0) 2819 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:20:15.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:15 smithi172 bash[23680]: audit 2024-03-30T15:20:15.153913+0000 mon.a (mon.0) 2820 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:20:16.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:16 smithi172 bash[23680]: audit 2024-03-30T15:20:15.665936+0000 mon.a (mon.0) 2821 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-81","var": "dedup_cdc_chunk_size","val": "16384"}]': finished 2024-03-30T15:20:16.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:16 smithi172 bash[23680]: cluster 2024-03-30T15:20:15.672569+0000 mon.a (mon.0) 2822 : cluster 0 osdmap e463: 8 total, 8 up, 8 in 2024-03-30T15:20:16.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:16 smithi172 bash[23680]: audit 2024-03-30T15:20:15.704505+0000 mon.a (mon.0) 2823 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-30T15:20:17.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:16 smithi072 bash[21573]: audit 2024-03-30T15:20:15.665936+0000 mon.a (mon.0) 2821 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-81","var": "dedup_cdc_chunk_size","val": "16384"}]': finished 2024-03-30T15:20:17.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:16 smithi072 bash[21573]: cluster 2024-03-30T15:20:15.672569+0000 mon.a (mon.0) 2822 : cluster 0 osdmap e463: 8 total, 8 up, 8 in 2024-03-30T15:20:17.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:16 smithi072 bash[21573]: audit 2024-03-30T15:20:15.704505+0000 mon.a (mon.0) 2823 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-30T15:20:17.166 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:16 smithi072 bash[28946]: audit 2024-03-30T15:20:15.665936+0000 mon.a (mon.0) 2821 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-81","var": "dedup_cdc_chunk_size","val": "16384"}]': finished 2024-03-30T15:20:17.166 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:16 smithi072 bash[28946]: cluster 2024-03-30T15:20:15.672569+0000 mon.a (mon.0) 2822 : cluster 0 osdmap e463: 8 total, 8 up, 8 in 2024-03-30T15:20:17.166 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:16 smithi072 bash[28946]: audit 2024-03-30T15:20:15.704505+0000 mon.a (mon.0) 2823 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-30T15:20:17.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:17 smithi172 bash[23680]: cluster 2024-03-30T15:20:16.156213+0000 mgr.y (mgr.14526) 496 : cluster 0 pgmap v746: 228 pgs: 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 7.5 KiB/s rd, 11 KiB/s wr, 29 op/s 2024-03-30T15:20:17.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:17 smithi172 bash[23680]: audit 2024-03-30T15:20:16.674724+0000 mon.a (mon.0) 2824 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-03-30T15:20:17.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:17 smithi172 bash[23680]: cluster 2024-03-30T15:20:16.685931+0000 mon.a (mon.0) 2825 : cluster 0 osdmap e464: 8 total, 8 up, 8 in 2024-03-30T15:20:17.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:17 smithi172 bash[23680]: audit 2024-03-30T15:20:16.761397+0000 mon.a (mon.0) 2826 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:20:17.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:17 smithi172 bash[23680]: audit 2024-03-30T15:20:16.762287+0000 mon.a (mon.0) 2827 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-81"}]: dispatch 2024-03-30T15:20:18.165 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:17 smithi072 bash[28946]: cluster 2024-03-30T15:20:16.156213+0000 mgr.y (mgr.14526) 496 : cluster 0 pgmap v746: 228 pgs: 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 7.5 KiB/s rd, 11 KiB/s wr, 29 op/s 2024-03-30T15:20:18.166 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:17 smithi072 bash[28946]: audit 2024-03-30T15:20:16.674724+0000 mon.a (mon.0) 2824 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-03-30T15:20:18.166 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:17 smithi072 bash[28946]: cluster 2024-03-30T15:20:16.685931+0000 mon.a (mon.0) 2825 : cluster 0 osdmap e464: 8 total, 8 up, 8 in 2024-03-30T15:20:18.166 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:17 smithi072 bash[28946]: audit 2024-03-30T15:20:16.761397+0000 mon.a (mon.0) 2826 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:20:18.166 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:17 smithi072 bash[28946]: audit 2024-03-30T15:20:16.762287+0000 mon.a (mon.0) 2827 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-81"}]: dispatch 2024-03-30T15:20:18.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:17 smithi072 bash[21573]: cluster 2024-03-30T15:20:16.156213+0000 mgr.y (mgr.14526) 496 : cluster 0 pgmap v746: 228 pgs: 228 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 7.5 KiB/s rd, 11 KiB/s wr, 29 op/s 2024-03-30T15:20:18.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:17 smithi072 bash[21573]: audit 2024-03-30T15:20:16.674724+0000 mon.a (mon.0) 2824 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-03-30T15:20:18.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:17 smithi072 bash[21573]: cluster 2024-03-30T15:20:16.685931+0000 mon.a (mon.0) 2825 : cluster 0 osdmap e464: 8 total, 8 up, 8 in 2024-03-30T15:20:18.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:17 smithi072 bash[21573]: audit 2024-03-30T15:20:16.761397+0000 mon.a (mon.0) 2826 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:20:18.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:17 smithi072 bash[21573]: audit 2024-03-30T15:20:16.762287+0000 mon.a (mon.0) 2827 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-81"}]: dispatch 2024-03-30T15:20:18.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:18 smithi172 bash[23680]: cluster 2024-03-30T15:20:17.687061+0000 mon.a (mon.0) 2828 : cluster 0 osdmap e465: 8 total, 8 up, 8 in 2024-03-30T15:20:19.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:18 smithi072 bash[21573]: cluster 2024-03-30T15:20:17.687061+0000 mon.a (mon.0) 2828 : cluster 0 osdmap e465: 8 total, 8 up, 8 in 2024-03-30T15:20:19.166 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:18 smithi072 bash[28946]: cluster 2024-03-30T15:20:17.687061+0000 mon.a (mon.0) 2828 : cluster 0 osdmap e465: 8 total, 8 up, 8 in 2024-03-30T15:20:19.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:19 smithi172 bash[23680]: cluster 2024-03-30T15:20:18.157213+0000 mgr.y (mgr.14526) 497 : cluster 0 pgmap v749: 196 pgs: 196 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 7.5 KiB/s rd, 9.0 KiB/s wr, 28 op/s 2024-03-30T15:20:19.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:19 smithi172 bash[23680]: cluster 2024-03-30T15:20:18.708660+0000 mon.a (mon.0) 2829 : cluster 0 osdmap e466: 8 total, 8 up, 8 in 2024-03-30T15:20:19.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:19 smithi172 bash[23680]: audit 2024-03-30T15:20:18.711279+0000 mon.a (mon.0) 2830 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:20:20.165 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:19 smithi072 bash[21573]: cluster 2024-03-30T15:20:18.157213+0000 mgr.y (mgr.14526) 497 : cluster 0 pgmap v749: 196 pgs: 196 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 7.5 KiB/s rd, 9.0 KiB/s wr, 28 op/s 2024-03-30T15:20:20.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:19 smithi072 bash[21573]: cluster 2024-03-30T15:20:18.708660+0000 mon.a (mon.0) 2829 : cluster 0 osdmap e466: 8 total, 8 up, 8 in 2024-03-30T15:20:20.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:19 smithi072 bash[21573]: audit 2024-03-30T15:20:18.711279+0000 mon.a (mon.0) 2830 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:20:20.166 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:19 smithi072 bash[28946]: cluster 2024-03-30T15:20:18.157213+0000 mgr.y (mgr.14526) 497 : cluster 0 pgmap v749: 196 pgs: 196 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 7.5 KiB/s rd, 9.0 KiB/s wr, 28 op/s 2024-03-30T15:20:20.166 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:19 smithi072 bash[28946]: cluster 2024-03-30T15:20:18.708660+0000 mon.a (mon.0) 2829 : cluster 0 osdmap e466: 8 total, 8 up, 8 in 2024-03-30T15:20:20.166 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:19 smithi072 bash[28946]: audit 2024-03-30T15:20:18.711279+0000 mon.a (mon.0) 2830 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:20:20.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:20 smithi172 bash[23680]: audit 2024-03-30T15:20:19.704546+0000 mon.a (mon.0) 2831 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-83","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:20:20.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:20 smithi172 bash[23680]: cluster 2024-03-30T15:20:19.708995+0000 mon.a (mon.0) 2832 : cluster 0 osdmap e467: 8 total, 8 up, 8 in 2024-03-30T15:20:20.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:20 smithi172 bash[23680]: audit 2024-03-30T15:20:19.714014+0000 mon.a (mon.0) 2833 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:20:20.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:20 smithi172 bash[23680]: audit 2024-03-30T15:20:19.719369+0000 mon.a (mon.0) 2834 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-30T15:20:20.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:20 smithi172 bash[23680]: audit 2024-03-30T15:20:20.249477+0000 mon.a (mon.0) 2835 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:20:20.965 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:20 smithi172 bash[23680]: audit 2024-03-30T15:20:20.265712+0000 mon.a (mon.0) 2836 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:20:21.029 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:20 smithi072 bash[21573]: audit 2024-03-30T15:20:19.704546+0000 mon.a (mon.0) 2831 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-83","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:20:21.029 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:20 smithi072 bash[21573]: cluster 2024-03-30T15:20:19.708995+0000 mon.a (mon.0) 2832 : cluster 0 osdmap e467: 8 total, 8 up, 8 in 2024-03-30T15:20:21.029 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:20 smithi072 bash[21573]: audit 2024-03-30T15:20:19.714014+0000 mon.a (mon.0) 2833 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:20:21.030 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:20 smithi072 bash[21573]: audit 2024-03-30T15:20:19.719369+0000 mon.a (mon.0) 2834 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-30T15:20:21.030 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:20 smithi072 bash[21573]: audit 2024-03-30T15:20:20.249477+0000 mon.a (mon.0) 2835 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:20:21.030 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:20 smithi072 bash[21573]: audit 2024-03-30T15:20:20.265712+0000 mon.a (mon.0) 2836 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:20:21.030 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:20 smithi072 bash[28946]: audit 2024-03-30T15:20:19.704546+0000 mon.a (mon.0) 2831 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-83","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:20:21.030 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:20 smithi072 bash[28946]: cluster 2024-03-30T15:20:19.708995+0000 mon.a (mon.0) 2832 : cluster 0 osdmap e467: 8 total, 8 up, 8 in 2024-03-30T15:20:21.030 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:20 smithi072 bash[28946]: audit 2024-03-30T15:20:19.714014+0000 mon.a (mon.0) 2833 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:20:21.030 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:20 smithi072 bash[28946]: audit 2024-03-30T15:20:19.719369+0000 mon.a (mon.0) 2834 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-30T15:20:21.030 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:20 smithi072 bash[28946]: audit 2024-03-30T15:20:20.249477+0000 mon.a (mon.0) 2835 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:20:21.030 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:20 smithi072 bash[28946]: audit 2024-03-30T15:20:20.265712+0000 mon.a (mon.0) 2836 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:20:21.416 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:20:21 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:20:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:20:21.715 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:20:21 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:20:22.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:21 smithi072 bash[21573]: cluster 2024-03-30T15:20:20.157810+0000 mgr.y (mgr.14526) 498 : cluster 0 pgmap v752: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:20:22.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:21 smithi072 bash[21573]: audit 2024-03-30T15:20:20.712834+0000 mon.a (mon.0) 2837 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-83","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-30T15:20:22.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:21 smithi072 bash[21573]: cluster 2024-03-30T15:20:20.720307+0000 mon.a (mon.0) 2838 : cluster 0 osdmap e468: 8 total, 8 up, 8 in 2024-03-30T15:20:22.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:21 smithi072 bash[21573]: audit 2024-03-30T15:20:20.720970+0000 mon.a (mon.0) 2839 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-83","var": "dedup_tier","val": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:20:22.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:21 smithi072 bash[21573]: audit 2024-03-30T15:20:21.206673+0000 mon.a (mon.0) 2840 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:20:22.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:21 smithi072 bash[21573]: audit 2024-03-30T15:20:21.223022+0000 mon.a (mon.0) 2841 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:20:22.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:21 smithi072 bash[21573]: audit 2024-03-30T15:20:21.625034+0000 mon.c (mon.2) 477 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:20:22.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:21 smithi072 bash[28946]: cluster 2024-03-30T15:20:20.157810+0000 mgr.y (mgr.14526) 498 : cluster 0 pgmap v752: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:20:22.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:21 smithi072 bash[28946]: audit 2024-03-30T15:20:20.712834+0000 mon.a (mon.0) 2837 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-83","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-30T15:20:22.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:21 smithi072 bash[28946]: cluster 2024-03-30T15:20:20.720307+0000 mon.a (mon.0) 2838 : cluster 0 osdmap e468: 8 total, 8 up, 8 in 2024-03-30T15:20:22.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:21 smithi072 bash[28946]: audit 2024-03-30T15:20:20.720970+0000 mon.a (mon.0) 2839 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-83","var": "dedup_tier","val": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:20:22.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:21 smithi072 bash[28946]: audit 2024-03-30T15:20:21.206673+0000 mon.a (mon.0) 2840 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:20:22.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:21 smithi072 bash[28946]: audit 2024-03-30T15:20:21.223022+0000 mon.a (mon.0) 2841 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:20:22.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:21 smithi072 bash[28946]: audit 2024-03-30T15:20:21.625034+0000 mon.c (mon.2) 477 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:20:22.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:21 smithi172 bash[23680]: cluster 2024-03-30T15:20:20.157810+0000 mgr.y (mgr.14526) 498 : cluster 0 pgmap v752: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:20:22.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:21 smithi172 bash[23680]: audit 2024-03-30T15:20:20.712834+0000 mon.a (mon.0) 2837 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-83","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-30T15:20:22.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:21 smithi172 bash[23680]: cluster 2024-03-30T15:20:20.720307+0000 mon.a (mon.0) 2838 : cluster 0 osdmap e468: 8 total, 8 up, 8 in 2024-03-30T15:20:22.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:21 smithi172 bash[23680]: audit 2024-03-30T15:20:20.720970+0000 mon.a (mon.0) 2839 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-83","var": "dedup_tier","val": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:20:22.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:21 smithi172 bash[23680]: audit 2024-03-30T15:20:21.206673+0000 mon.a (mon.0) 2840 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:20:22.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:21 smithi172 bash[23680]: audit 2024-03-30T15:20:21.223022+0000 mon.a (mon.0) 2841 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:20:22.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:21 smithi172 bash[23680]: audit 2024-03-30T15:20:21.625034+0000 mon.c (mon.2) 477 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:20:23.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:22 smithi072 bash[21573]: audit 2024-03-30T15:20:21.396844+0000 mgr.y (mgr.14526) 499 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:20:23.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:22 smithi072 bash[21573]: audit 2024-03-30T15:20:21.715447+0000 mon.a (mon.0) 2842 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-83","var": "dedup_tier","val": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:20:23.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:22 smithi072 bash[21573]: cluster 2024-03-30T15:20:21.725491+0000 mon.a (mon.0) 2843 : cluster 0 osdmap e469: 8 total, 8 up, 8 in 2024-03-30T15:20:23.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:22 smithi072 bash[21573]: audit 2024-03-30T15:20:21.727779+0000 mon.a (mon.0) 2844 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-03-30T15:20:23.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:22 smithi072 bash[21573]: audit 2024-03-30T15:20:21.950511+0000 mon.c (mon.2) 478 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:20:23.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:22 smithi072 bash[21573]: audit 2024-03-30T15:20:21.952773+0000 mon.c (mon.2) 479 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:20:23.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:22 smithi072 bash[21573]: audit 2024-03-30T15:20:21.964631+0000 mon.a (mon.0) 2845 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:20:23.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:22 smithi072 bash[21573]: audit 2024-03-30T15:20:22.717948+0000 mon.a (mon.0) 2846 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-03-30T15:20:23.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:22 smithi072 bash[28946]: audit 2024-03-30T15:20:21.396844+0000 mgr.y (mgr.14526) 499 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:20:23.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:22 smithi072 bash[28946]: audit 2024-03-30T15:20:21.715447+0000 mon.a (mon.0) 2842 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-83","var": "dedup_tier","val": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:20:23.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:22 smithi072 bash[28946]: cluster 2024-03-30T15:20:21.725491+0000 mon.a (mon.0) 2843 : cluster 0 osdmap e469: 8 total, 8 up, 8 in 2024-03-30T15:20:23.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:22 smithi072 bash[28946]: audit 2024-03-30T15:20:21.727779+0000 mon.a (mon.0) 2844 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-03-30T15:20:23.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:22 smithi072 bash[28946]: audit 2024-03-30T15:20:21.950511+0000 mon.c (mon.2) 478 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:20:23.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:22 smithi072 bash[28946]: audit 2024-03-30T15:20:21.952773+0000 mon.c (mon.2) 479 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:20:23.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:22 smithi072 bash[28946]: audit 2024-03-30T15:20:21.964631+0000 mon.a (mon.0) 2845 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:20:23.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:22 smithi072 bash[28946]: audit 2024-03-30T15:20:22.717948+0000 mon.a (mon.0) 2846 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-03-30T15:20:23.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:22 smithi172 bash[23680]: audit 2024-03-30T15:20:21.396844+0000 mgr.y (mgr.14526) 499 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:20:23.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:22 smithi172 bash[23680]: audit 2024-03-30T15:20:21.715447+0000 mon.a (mon.0) 2842 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-83","var": "dedup_tier","val": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:20:23.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:22 smithi172 bash[23680]: cluster 2024-03-30T15:20:21.725491+0000 mon.a (mon.0) 2843 : cluster 0 osdmap e469: 8 total, 8 up, 8 in 2024-03-30T15:20:23.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:22 smithi172 bash[23680]: audit 2024-03-30T15:20:21.727779+0000 mon.a (mon.0) 2844 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-03-30T15:20:23.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:22 smithi172 bash[23680]: audit 2024-03-30T15:20:21.950511+0000 mon.c (mon.2) 478 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:20:23.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:22 smithi172 bash[23680]: audit 2024-03-30T15:20:21.952773+0000 mon.c (mon.2) 479 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:20:23.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:22 smithi172 bash[23680]: audit 2024-03-30T15:20:21.964631+0000 mon.a (mon.0) 2845 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:20:23.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:22 smithi172 bash[23680]: audit 2024-03-30T15:20:22.717948+0000 mon.a (mon.0) 2846 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-03-30T15:20:24.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:23 smithi072 bash[21573]: cluster 2024-03-30T15:20:22.158604+0000 mgr.y (mgr.14526) 500 : cluster 0 pgmap v755: 228 pgs: 228 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-03-30T15:20:24.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:23 smithi072 bash[21573]: cluster 2024-03-30T15:20:22.725555+0000 mon.a (mon.0) 2847 : cluster 0 osdmap e470: 8 total, 8 up, 8 in 2024-03-30T15:20:24.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:23 smithi072 bash[21573]: audit 2024-03-30T15:20:22.732819+0000 mon.a (mon.0) 2848 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-30T15:20:24.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:23 smithi072 bash[21573]: audit 2024-03-30T15:20:23.720647+0000 mon.a (mon.0) 2849 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-83","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-03-30T15:20:24.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:23 smithi072 bash[21573]: cluster 2024-03-30T15:20:23.729526+0000 mon.a (mon.0) 2850 : cluster 0 osdmap e471: 8 total, 8 up, 8 in 2024-03-30T15:20:24.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:23 smithi072 bash[28946]: cluster 2024-03-30T15:20:22.158604+0000 mgr.y (mgr.14526) 500 : cluster 0 pgmap v755: 228 pgs: 228 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-03-30T15:20:24.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:23 smithi072 bash[28946]: cluster 2024-03-30T15:20:22.725555+0000 mon.a (mon.0) 2847 : cluster 0 osdmap e470: 8 total, 8 up, 8 in 2024-03-30T15:20:24.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:23 smithi072 bash[28946]: audit 2024-03-30T15:20:22.732819+0000 mon.a (mon.0) 2848 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-30T15:20:24.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:23 smithi072 bash[28946]: audit 2024-03-30T15:20:23.720647+0000 mon.a (mon.0) 2849 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-83","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-03-30T15:20:24.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:23 smithi072 bash[28946]: cluster 2024-03-30T15:20:23.729526+0000 mon.a (mon.0) 2850 : cluster 0 osdmap e471: 8 total, 8 up, 8 in 2024-03-30T15:20:24.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:23 smithi172 bash[23680]: cluster 2024-03-30T15:20:22.158604+0000 mgr.y (mgr.14526) 500 : cluster 0 pgmap v755: 228 pgs: 228 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-03-30T15:20:24.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:23 smithi172 bash[23680]: cluster 2024-03-30T15:20:22.725555+0000 mon.a (mon.0) 2847 : cluster 0 osdmap e470: 8 total, 8 up, 8 in 2024-03-30T15:20:24.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:23 smithi172 bash[23680]: audit 2024-03-30T15:20:22.732819+0000 mon.a (mon.0) 2848 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-30T15:20:24.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:23 smithi172 bash[23680]: audit 2024-03-30T15:20:23.720647+0000 mon.a (mon.0) 2849 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-83","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-03-30T15:20:24.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:23 smithi172 bash[23680]: cluster 2024-03-30T15:20:23.729526+0000 mon.a (mon.0) 2850 : cluster 0 osdmap e471: 8 total, 8 up, 8 in 2024-03-30T15:20:26.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:25 smithi072 bash[21573]: cluster 2024-03-30T15:20:24.159431+0000 mgr.y (mgr.14526) 501 : cluster 0 pgmap v758: 228 pgs: 228 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-03-30T15:20:26.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:25 smithi072 bash[21573]: cluster 2024-03-30T15:20:24.751789+0000 mon.a (mon.0) 2851 : cluster 0 osdmap e472: 8 total, 8 up, 8 in 2024-03-30T15:20:26.166 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:25 smithi072 bash[28946]: cluster 2024-03-30T15:20:24.159431+0000 mgr.y (mgr.14526) 501 : cluster 0 pgmap v758: 228 pgs: 228 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-03-30T15:20:26.166 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:25 smithi072 bash[28946]: cluster 2024-03-30T15:20:24.751789+0000 mon.a (mon.0) 2851 : cluster 0 osdmap e472: 8 total, 8 up, 8 in 2024-03-30T15:20:26.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:25 smithi172 bash[23680]: cluster 2024-03-30T15:20:24.159431+0000 mgr.y (mgr.14526) 501 : cluster 0 pgmap v758: 228 pgs: 228 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-03-30T15:20:26.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:25 smithi172 bash[23680]: cluster 2024-03-30T15:20:24.751789+0000 mon.a (mon.0) 2851 : cluster 0 osdmap e472: 8 total, 8 up, 8 in 2024-03-30T15:20:27.166 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:26 smithi072 bash[28946]: cluster 2024-03-30T15:20:25.755168+0000 mon.a (mon.0) 2852 : cluster 0 osdmap e473: 8 total, 8 up, 8 in 2024-03-30T15:20:27.166 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:26 smithi072 bash[28946]: audit 2024-03-30T15:20:25.831326+0000 mon.a (mon.0) 2853 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:20:27.166 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:26 smithi072 bash[28946]: audit 2024-03-30T15:20:25.832202+0000 mon.a (mon.0) 2854 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-83"}]: dispatch 2024-03-30T15:20:27.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:26 smithi072 bash[21573]: cluster 2024-03-30T15:20:25.755168+0000 mon.a (mon.0) 2852 : cluster 0 osdmap e473: 8 total, 8 up, 8 in 2024-03-30T15:20:27.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:26 smithi072 bash[21573]: audit 2024-03-30T15:20:25.831326+0000 mon.a (mon.0) 2853 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:20:27.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:26 smithi072 bash[21573]: audit 2024-03-30T15:20:25.832202+0000 mon.a (mon.0) 2854 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-83"}]: dispatch 2024-03-30T15:20:27.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:26 smithi172 bash[23680]: cluster 2024-03-30T15:20:25.755168+0000 mon.a (mon.0) 2852 : cluster 0 osdmap e473: 8 total, 8 up, 8 in 2024-03-30T15:20:27.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:26 smithi172 bash[23680]: audit 2024-03-30T15:20:25.831326+0000 mon.a (mon.0) 2853 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:20:27.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:26 smithi172 bash[23680]: audit 2024-03-30T15:20:25.832202+0000 mon.a (mon.0) 2854 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-83"}]: dispatch 2024-03-30T15:20:28.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:27 smithi072 bash[21573]: cluster 2024-03-30T15:20:26.161647+0000 mgr.y (mgr.14526) 502 : cluster 0 pgmap v761: 228 pgs: 228 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 6.7 KiB/s wr, 12 op/s 2024-03-30T15:20:28.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:27 smithi072 bash[21573]: cluster 2024-03-30T15:20:26.782601+0000 mon.a (mon.0) 2855 : cluster 0 osdmap e474: 8 total, 8 up, 8 in 2024-03-30T15:20:28.166 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:27 smithi072 bash[28946]: cluster 2024-03-30T15:20:26.161647+0000 mgr.y (mgr.14526) 502 : cluster 0 pgmap v761: 228 pgs: 228 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 6.7 KiB/s wr, 12 op/s 2024-03-30T15:20:28.166 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:27 smithi072 bash[28946]: cluster 2024-03-30T15:20:26.782601+0000 mon.a (mon.0) 2855 : cluster 0 osdmap e474: 8 total, 8 up, 8 in 2024-03-30T15:20:28.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:27 smithi172 bash[23680]: cluster 2024-03-30T15:20:26.161647+0000 mgr.y (mgr.14526) 502 : cluster 0 pgmap v761: 228 pgs: 228 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 6.7 KiB/s wr, 12 op/s 2024-03-30T15:20:28.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:27 smithi172 bash[23680]: cluster 2024-03-30T15:20:26.782601+0000 mon.a (mon.0) 2855 : cluster 0 osdmap e474: 8 total, 8 up, 8 in 2024-03-30T15:20:29.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:28 smithi072 bash[21573]: cluster 2024-03-30T15:20:27.792258+0000 mon.a (mon.0) 2856 : cluster 0 osdmap e475: 8 total, 8 up, 8 in 2024-03-30T15:20:29.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:28 smithi072 bash[21573]: audit 2024-03-30T15:20:27.797896+0000 mon.a (mon.0) 2857 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:20:29.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:28 smithi072 bash[21573]: cluster 2024-03-30T15:20:28.162399+0000 mgr.y (mgr.14526) 503 : cluster 0 pgmap v764: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-03-30T15:20:29.166 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:28 smithi072 bash[28946]: cluster 2024-03-30T15:20:27.792258+0000 mon.a (mon.0) 2856 : cluster 0 osdmap e475: 8 total, 8 up, 8 in 2024-03-30T15:20:29.166 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:28 smithi072 bash[28946]: audit 2024-03-30T15:20:27.797896+0000 mon.a (mon.0) 2857 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:20:29.166 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:28 smithi072 bash[28946]: cluster 2024-03-30T15:20:28.162399+0000 mgr.y (mgr.14526) 503 : cluster 0 pgmap v764: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-03-30T15:20:29.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:28 smithi172 bash[23680]: cluster 2024-03-30T15:20:27.792258+0000 mon.a (mon.0) 2856 : cluster 0 osdmap e475: 8 total, 8 up, 8 in 2024-03-30T15:20:29.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:28 smithi172 bash[23680]: audit 2024-03-30T15:20:27.797896+0000 mon.a (mon.0) 2857 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:20:29.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:28 smithi172 bash[23680]: cluster 2024-03-30T15:20:28.162399+0000 mgr.y (mgr.14526) 503 : cluster 0 pgmap v764: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-03-30T15:20:30.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:29 smithi072 bash[21573]: cluster 2024-03-30T15:20:28.785278+0000 mon.a (mon.0) 2858 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:20:30.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:29 smithi072 bash[21573]: audit 2024-03-30T15:20:28.796928+0000 mon.a (mon.0) 2859 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-85","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:20:30.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:29 smithi072 bash[21573]: cluster 2024-03-30T15:20:28.807119+0000 mon.a (mon.0) 2860 : cluster 0 osdmap e476: 8 total, 8 up, 8 in 2024-03-30T15:20:30.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:29 smithi072 bash[21573]: audit 2024-03-30T15:20:28.810771+0000 mon.a (mon.0) 2861 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:20:30.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:29 smithi072 bash[21573]: audit 2024-03-30T15:20:28.824904+0000 mon.a (mon.0) 2862 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-30T15:20:30.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:29 smithi072 bash[28946]: cluster 2024-03-30T15:20:28.785278+0000 mon.a (mon.0) 2858 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:20:30.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:29 smithi072 bash[28946]: audit 2024-03-30T15:20:28.796928+0000 mon.a (mon.0) 2859 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-85","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:20:30.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:29 smithi072 bash[28946]: cluster 2024-03-30T15:20:28.807119+0000 mon.a (mon.0) 2860 : cluster 0 osdmap e476: 8 total, 8 up, 8 in 2024-03-30T15:20:30.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:29 smithi072 bash[28946]: audit 2024-03-30T15:20:28.810771+0000 mon.a (mon.0) 2861 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:20:30.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:29 smithi072 bash[28946]: audit 2024-03-30T15:20:28.824904+0000 mon.a (mon.0) 2862 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-30T15:20:30.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:29 smithi172 bash[23680]: cluster 2024-03-30T15:20:28.785278+0000 mon.a (mon.0) 2858 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:20:30.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:29 smithi172 bash[23680]: audit 2024-03-30T15:20:28.796928+0000 mon.a (mon.0) 2859 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-85","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:20:30.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:29 smithi172 bash[23680]: cluster 2024-03-30T15:20:28.807119+0000 mon.a (mon.0) 2860 : cluster 0 osdmap e476: 8 total, 8 up, 8 in 2024-03-30T15:20:30.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:29 smithi172 bash[23680]: audit 2024-03-30T15:20:28.810771+0000 mon.a (mon.0) 2861 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:20:30.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:29 smithi172 bash[23680]: audit 2024-03-30T15:20:28.824904+0000 mon.a (mon.0) 2862 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-30T15:20:31.166 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:20:31 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:20:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:20:31.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:30 smithi072 bash[21573]: audit 2024-03-30T15:20:29.809298+0000 mon.a (mon.0) 2863 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-85","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-30T15:20:31.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:30 smithi072 bash[21573]: cluster 2024-03-30T15:20:29.816605+0000 mon.a (mon.0) 2864 : cluster 0 osdmap e477: 8 total, 8 up, 8 in 2024-03-30T15:20:31.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:30 smithi072 bash[21573]: audit 2024-03-30T15:20:29.818045+0000 mon.a (mon.0) 2865 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-85","var": "dedup_tier","val": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:20:31.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:30 smithi072 bash[21573]: cluster 2024-03-30T15:20:30.163184+0000 mgr.y (mgr.14526) 504 : cluster 0 pgmap v767: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:20:31.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:30 smithi072 bash[28946]: audit 2024-03-30T15:20:29.809298+0000 mon.a (mon.0) 2863 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-85","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-30T15:20:31.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:30 smithi072 bash[28946]: cluster 2024-03-30T15:20:29.816605+0000 mon.a (mon.0) 2864 : cluster 0 osdmap e477: 8 total, 8 up, 8 in 2024-03-30T15:20:31.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:30 smithi072 bash[28946]: audit 2024-03-30T15:20:29.818045+0000 mon.a (mon.0) 2865 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-85","var": "dedup_tier","val": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:20:31.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:30 smithi072 bash[28946]: cluster 2024-03-30T15:20:30.163184+0000 mgr.y (mgr.14526) 504 : cluster 0 pgmap v767: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:20:31.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:30 smithi172 bash[23680]: audit 2024-03-30T15:20:29.809298+0000 mon.a (mon.0) 2863 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-85","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-30T15:20:31.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:30 smithi172 bash[23680]: cluster 2024-03-30T15:20:29.816605+0000 mon.a (mon.0) 2864 : cluster 0 osdmap e477: 8 total, 8 up, 8 in 2024-03-30T15:20:31.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:30 smithi172 bash[23680]: audit 2024-03-30T15:20:29.818045+0000 mon.a (mon.0) 2865 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-85","var": "dedup_tier","val": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:20:31.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:30 smithi172 bash[23680]: cluster 2024-03-30T15:20:30.163184+0000 mgr.y (mgr.14526) 504 : cluster 0 pgmap v767: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 638 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:20:31.715 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:20:31 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:20:32.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:31 smithi072 bash[21573]: audit 2024-03-30T15:20:30.819142+0000 mon.a (mon.0) 2866 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-85","var": "dedup_tier","val": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:20:32.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:31 smithi072 bash[21573]: cluster 2024-03-30T15:20:30.829392+0000 mon.a (mon.0) 2867 : cluster 0 osdmap e478: 8 total, 8 up, 8 in 2024-03-30T15:20:32.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:31 smithi072 bash[21573]: audit 2024-03-30T15:20:30.830971+0000 mon.a (mon.0) 2868 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-03-30T15:20:32.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:31 smithi072 bash[21573]: audit 2024-03-30T15:20:31.407993+0000 mgr.y (mgr.14526) 505 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:20:32.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:31 smithi072 bash[28946]: audit 2024-03-30T15:20:30.819142+0000 mon.a (mon.0) 2866 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-85","var": "dedup_tier","val": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:20:32.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:31 smithi072 bash[28946]: cluster 2024-03-30T15:20:30.829392+0000 mon.a (mon.0) 2867 : cluster 0 osdmap e478: 8 total, 8 up, 8 in 2024-03-30T15:20:32.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:31 smithi072 bash[28946]: audit 2024-03-30T15:20:30.830971+0000 mon.a (mon.0) 2868 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-03-30T15:20:32.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:31 smithi072 bash[28946]: audit 2024-03-30T15:20:31.407993+0000 mgr.y (mgr.14526) 505 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:20:32.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:31 smithi172 bash[23680]: audit 2024-03-30T15:20:30.819142+0000 mon.a (mon.0) 2866 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-85","var": "dedup_tier","val": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:20:32.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:31 smithi172 bash[23680]: cluster 2024-03-30T15:20:30.829392+0000 mon.a (mon.0) 2867 : cluster 0 osdmap e478: 8 total, 8 up, 8 in 2024-03-30T15:20:32.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:31 smithi172 bash[23680]: audit 2024-03-30T15:20:30.830971+0000 mon.a (mon.0) 2868 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-03-30T15:20:32.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:31 smithi172 bash[23680]: audit 2024-03-30T15:20:31.407993+0000 mgr.y (mgr.14526) 505 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:20:33.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:32 smithi072 bash[21573]: audit 2024-03-30T15:20:31.821887+0000 mon.a (mon.0) 2869 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-03-30T15:20:33.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:32 smithi072 bash[21573]: cluster 2024-03-30T15:20:31.829962+0000 mon.a (mon.0) 2870 : cluster 0 osdmap e479: 8 total, 8 up, 8 in 2024-03-30T15:20:33.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:32 smithi072 bash[21573]: audit 2024-03-30T15:20:31.831941+0000 mon.a (mon.0) 2871 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-30T15:20:33.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:32 smithi072 bash[21573]: cluster 2024-03-30T15:20:32.163986+0000 mgr.y (mgr.14526) 506 : cluster 0 pgmap v770: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:20:33.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:32 smithi072 bash[21573]: audit 2024-03-30T15:20:32.825158+0000 mon.a (mon.0) 2872 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-85","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-03-30T15:20:33.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:32 smithi072 bash[21573]: cluster 2024-03-30T15:20:32.833495+0000 mon.a (mon.0) 2873 : cluster 0 osdmap e480: 8 total, 8 up, 8 in 2024-03-30T15:20:33.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:32 smithi072 bash[28946]: audit 2024-03-30T15:20:31.821887+0000 mon.a (mon.0) 2869 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-03-30T15:20:33.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:32 smithi072 bash[28946]: cluster 2024-03-30T15:20:31.829962+0000 mon.a (mon.0) 2870 : cluster 0 osdmap e479: 8 total, 8 up, 8 in 2024-03-30T15:20:33.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:32 smithi072 bash[28946]: audit 2024-03-30T15:20:31.831941+0000 mon.a (mon.0) 2871 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-30T15:20:33.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:32 smithi072 bash[28946]: cluster 2024-03-30T15:20:32.163986+0000 mgr.y (mgr.14526) 506 : cluster 0 pgmap v770: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:20:33.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:32 smithi072 bash[28946]: audit 2024-03-30T15:20:32.825158+0000 mon.a (mon.0) 2872 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-85","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-03-30T15:20:33.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:32 smithi072 bash[28946]: cluster 2024-03-30T15:20:32.833495+0000 mon.a (mon.0) 2873 : cluster 0 osdmap e480: 8 total, 8 up, 8 in 2024-03-30T15:20:33.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:32 smithi172 bash[23680]: audit 2024-03-30T15:20:31.821887+0000 mon.a (mon.0) 2869 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-03-30T15:20:33.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:32 smithi172 bash[23680]: cluster 2024-03-30T15:20:31.829962+0000 mon.a (mon.0) 2870 : cluster 0 osdmap e479: 8 total, 8 up, 8 in 2024-03-30T15:20:33.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:32 smithi172 bash[23680]: audit 2024-03-30T15:20:31.831941+0000 mon.a (mon.0) 2871 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-30T15:20:33.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:32 smithi172 bash[23680]: cluster 2024-03-30T15:20:32.163986+0000 mgr.y (mgr.14526) 506 : cluster 0 pgmap v770: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:20:33.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:32 smithi172 bash[23680]: audit 2024-03-30T15:20:32.825158+0000 mon.a (mon.0) 2872 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-85","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-03-30T15:20:33.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:32 smithi172 bash[23680]: cluster 2024-03-30T15:20:32.833495+0000 mon.a (mon.0) 2873 : cluster 0 osdmap e480: 8 total, 8 up, 8 in 2024-03-30T15:20:35.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:34 smithi072 bash[21573]: cluster 2024-03-30T15:20:33.860961+0000 mon.a (mon.0) 2874 : cluster 0 osdmap e481: 8 total, 8 up, 8 in 2024-03-30T15:20:35.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:34 smithi072 bash[21573]: cluster 2024-03-30T15:20:34.164814+0000 mgr.y (mgr.14526) 507 : cluster 0 pgmap v773: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:20:35.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:34 smithi072 bash[28946]: cluster 2024-03-30T15:20:33.860961+0000 mon.a (mon.0) 2874 : cluster 0 osdmap e481: 8 total, 8 up, 8 in 2024-03-30T15:20:35.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:34 smithi072 bash[28946]: cluster 2024-03-30T15:20:34.164814+0000 mgr.y (mgr.14526) 507 : cluster 0 pgmap v773: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:20:35.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:34 smithi172 bash[23680]: cluster 2024-03-30T15:20:33.860961+0000 mon.a (mon.0) 2874 : cluster 0 osdmap e481: 8 total, 8 up, 8 in 2024-03-30T15:20:35.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:34 smithi172 bash[23680]: cluster 2024-03-30T15:20:34.164814+0000 mgr.y (mgr.14526) 507 : cluster 0 pgmap v773: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:20:36.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:35 smithi072 bash[21573]: cluster 2024-03-30T15:20:34.873448+0000 mon.a (mon.0) 2875 : cluster 0 osdmap e482: 8 total, 8 up, 8 in 2024-03-30T15:20:36.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:35 smithi072 bash[21573]: audit 2024-03-30T15:20:34.957845+0000 mon.a (mon.0) 2876 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:20:36.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:35 smithi072 bash[21573]: audit 2024-03-30T15:20:34.958827+0000 mon.a (mon.0) 2877 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-85"}]: dispatch 2024-03-30T15:20:36.166 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:35 smithi072 bash[28946]: cluster 2024-03-30T15:20:34.873448+0000 mon.a (mon.0) 2875 : cluster 0 osdmap e482: 8 total, 8 up, 8 in 2024-03-30T15:20:36.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:35 smithi072 bash[28946]: audit 2024-03-30T15:20:34.957845+0000 mon.a (mon.0) 2876 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:20:36.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:35 smithi072 bash[28946]: audit 2024-03-30T15:20:34.958827+0000 mon.a (mon.0) 2877 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-85"}]: dispatch 2024-03-30T15:20:36.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:35 smithi172 bash[23680]: cluster 2024-03-30T15:20:34.873448+0000 mon.a (mon.0) 2875 : cluster 0 osdmap e482: 8 total, 8 up, 8 in 2024-03-30T15:20:36.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:35 smithi172 bash[23680]: audit 2024-03-30T15:20:34.957845+0000 mon.a (mon.0) 2876 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:20:36.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:35 smithi172 bash[23680]: audit 2024-03-30T15:20:34.958827+0000 mon.a (mon.0) 2877 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-85"}]: dispatch 2024-03-30T15:20:37.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:36 smithi072 bash[21573]: cluster 2024-03-30T15:20:35.872238+0000 mon.a (mon.0) 2878 : cluster 0 osdmap e483: 8 total, 8 up, 8 in 2024-03-30T15:20:37.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:36 smithi072 bash[21573]: cluster 2024-03-30T15:20:36.166556+0000 mgr.y (mgr.14526) 508 : cluster 0 pgmap v776: 196 pgs: 196 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.7 KiB/s wr, 11 op/s 2024-03-30T15:20:37.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:36 smithi072 bash[21573]: audit 2024-03-30T15:20:36.657963+0000 mon.c (mon.2) 480 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:20:37.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:36 smithi072 bash[28946]: cluster 2024-03-30T15:20:35.872238+0000 mon.a (mon.0) 2878 : cluster 0 osdmap e483: 8 total, 8 up, 8 in 2024-03-30T15:20:37.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:36 smithi072 bash[28946]: cluster 2024-03-30T15:20:36.166556+0000 mgr.y (mgr.14526) 508 : cluster 0 pgmap v776: 196 pgs: 196 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.7 KiB/s wr, 11 op/s 2024-03-30T15:20:37.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:36 smithi072 bash[28946]: audit 2024-03-30T15:20:36.657963+0000 mon.c (mon.2) 480 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:20:37.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:36 smithi172 bash[23680]: cluster 2024-03-30T15:20:35.872238+0000 mon.a (mon.0) 2878 : cluster 0 osdmap e483: 8 total, 8 up, 8 in 2024-03-30T15:20:37.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:36 smithi172 bash[23680]: cluster 2024-03-30T15:20:36.166556+0000 mgr.y (mgr.14526) 508 : cluster 0 pgmap v776: 196 pgs: 196 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.7 KiB/s wr, 11 op/s 2024-03-30T15:20:37.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:36 smithi172 bash[23680]: audit 2024-03-30T15:20:36.657963+0000 mon.c (mon.2) 480 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:20:37.940 INFO:tasks.workunit.client.0.smithi072.stdout: OK ] LibRadosTwoPoolsPP.ProxyRead (17735 ms) 2024-03-30T15:20:37.940 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.CachePin 2024-03-30T15:20:37.940 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.CachePin (22495 ms) 2024-03-30T15:20:37.940 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.SetRedirectRead 2024-03-30T15:20:37.940 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.SetRedirectRead (3045 ms) 2024-03-30T15:20:37.940 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestPromoteRead 2024-03-30T15:20:37.940 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: require_osd_release = squid 2024-03-30T15:20:37.941 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestPromoteRead (3046 ms) 2024-03-30T15:20:37.941 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRefRead 2024-03-30T15:20:37.941 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRefRead (3026 ms) 2024-03-30T15:20:37.941 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestUnset 2024-03-30T15:20:37.941 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: require_osd_release = squid 2024-03-30T15:20:37.941 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestUnset (3030 ms) 2024-03-30T15:20:37.941 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2024-03-30T15:20:37.941 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: require_osd_release = squid 2024-03-30T15:20:37.941 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestDedupRefRead (4046 ms) 2024-03-30T15:20:37.941 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2024-03-30T15:20:37.941 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: require_osd_release = squid 2024-03-30T15:20:37.941 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapRefcount (38266 ms) 2024-03-30T15:20:37.941 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2024-03-30T15:20:37.941 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: require_osd_release = squid 2024-03-30T15:20:37.942 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 (17096 ms) 2024-03-30T15:20:37.942 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2024-03-30T15:20:37.942 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: require_osd_release = squid 2024-03-30T15:20:37.942 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestTestSnapCreate (4048 ms) 2024-03-30T15:20:37.942 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2024-03-30T15:20:37.942 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: require_osd_release = squid 2024-03-30T15:20:37.942 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote (3032 ms) 2024-03-30T15:20:37.942 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2024-03-30T15:20:37.942 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: require_osd_release = squid 2024-03-30T15:20:37.942 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification (24437 ms) 2024-03-30T15:20:37.942 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2024-03-30T15:20:37.942 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: require_osd_release = squid 2024-03-30T15:20:37.942 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapIncCount (15099 ms) 2024-03-30T15:20:37.943 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvict 2024-03-30T15:20:37.943 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: require_osd_release = squid 2024-03-30T15:20:37.943 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvict (5081 ms) 2024-03-30T15:20:37.943 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictPromote 2024-03-30T15:20:37.943 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: require_osd_release = squid 2024-03-30T15:20:37.943 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvictPromote (4052 ms) 2024-03-30T15:20:37.943 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2024-03-30T15:20:37.943 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: require_osd_release = squid 2024-03-30T15:20:37.943 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: waiting for scrubs... 2024-03-30T15:20:37.943 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: done waiting 2024-03-30T15:20:37.943 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch (25078 ms) 2024-03-30T15:20:37.943 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.DedupFlushRead 2024-03-30T15:20:37.943 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: require_osd_release = squid 2024-03-30T15:20:37.943 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.DedupFlushRead (10123 ms) 2024-03-30T15:20:37.944 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushSnap 2024-03-30T15:20:37.944 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: require_osd_release = squid 2024-03-30T15:20:37.944 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestFlushSnap (9100 ms) 2024-03-30T15:20:37.944 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2024-03-30T15:20:37.944 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: require_osd_release = squid 2024-03-30T15:20:37.944 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestFlushDupCount (9088 ms) 2024-03-30T15:20:37.944 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2024-03-30T15:20:38.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:37 smithi072 bash[21573]: cluster 2024-03-30T15:20:36.899545+0000 mon.a (mon.0) 2879 : cluster 0 osdmap e484: 8 total, 8 up, 8 in 2024-03-30T15:20:38.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:37 smithi072 bash[21573]: audit 2024-03-30T15:20:36.902123+0000 mon.a (mon.0) 2880 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:20:38.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:37 smithi072 bash[21573]: cluster 2024-03-30T15:20:37.237818+0000 mon.a (mon.0) 2881 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:20:38.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:37 smithi072 bash[28946]: cluster 2024-03-30T15:20:36.899545+0000 mon.a (mon.0) 2879 : cluster 0 osdmap e484: 8 total, 8 up, 8 in 2024-03-30T15:20:38.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:37 smithi072 bash[28946]: audit 2024-03-30T15:20:36.902123+0000 mon.a (mon.0) 2880 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:20:38.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:37 smithi072 bash[28946]: cluster 2024-03-30T15:20:37.237818+0000 mon.a (mon.0) 2881 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:20:38.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:37 smithi172 bash[23680]: cluster 2024-03-30T15:20:36.899545+0000 mon.a (mon.0) 2879 : cluster 0 osdmap e484: 8 total, 8 up, 8 in 2024-03-30T15:20:38.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:37 smithi172 bash[23680]: audit 2024-03-30T15:20:36.902123+0000 mon.a (mon.0) 2880 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:20:38.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:37 smithi172 bash[23680]: cluster 2024-03-30T15:20:37.237818+0000 mon.a (mon.0) 2881 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:20:39.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:38 smithi072 bash[21573]: audit 2024-03-30T15:20:37.900774+0000 mon.a (mon.0) 2882 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-87","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:20:39.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:38 smithi072 bash[21573]: cluster 2024-03-30T15:20:37.908263+0000 mon.a (mon.0) 2883 : cluster 0 osdmap e485: 8 total, 8 up, 8 in 2024-03-30T15:20:39.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:38 smithi072 bash[21573]: audit 2024-03-30T15:20:37.929957+0000 mon.a (mon.0) 2884 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:20:39.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:38 smithi072 bash[21573]: cluster 2024-03-30T15:20:38.167307+0000 mgr.y (mgr.14526) 509 : cluster 0 pgmap v779: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.7 KiB/s wr, 11 op/s 2024-03-30T15:20:39.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:38 smithi072 bash[28946]: audit 2024-03-30T15:20:37.900774+0000 mon.a (mon.0) 2882 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-87","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:20:39.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:38 smithi072 bash[28946]: cluster 2024-03-30T15:20:37.908263+0000 mon.a (mon.0) 2883 : cluster 0 osdmap e485: 8 total, 8 up, 8 in 2024-03-30T15:20:39.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:38 smithi072 bash[28946]: audit 2024-03-30T15:20:37.929957+0000 mon.a (mon.0) 2884 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:20:39.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:38 smithi072 bash[28946]: cluster 2024-03-30T15:20:38.167307+0000 mgr.y (mgr.14526) 509 : cluster 0 pgmap v779: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.7 KiB/s wr, 11 op/s 2024-03-30T15:20:39.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:38 smithi172 bash[23680]: audit 2024-03-30T15:20:37.900774+0000 mon.a (mon.0) 2882 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-87","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:20:39.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:38 smithi172 bash[23680]: cluster 2024-03-30T15:20:37.908263+0000 mon.a (mon.0) 2883 : cluster 0 osdmap e485: 8 total, 8 up, 8 in 2024-03-30T15:20:39.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:38 smithi172 bash[23680]: audit 2024-03-30T15:20:37.929957+0000 mon.a (mon.0) 2884 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:20:39.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:38 smithi172 bash[23680]: cluster 2024-03-30T15:20:38.167307+0000 mgr.y (mgr.14526) 509 : cluster 0 pgmap v779: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.7 KiB/s wr, 11 op/s 2024-03-30T15:20:40.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:39 smithi072 bash[21573]: cluster 2024-03-30T15:20:38.928353+0000 mon.a (mon.0) 2885 : cluster 0 osdmap e486: 8 total, 8 up, 8 in 2024-03-30T15:20:40.166 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:39 smithi072 bash[21573]: audit 2024-03-30T15:20:38.935560+0000 mon.a (mon.0) 2886 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-30T15:20:40.166 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:39 smithi072 bash[28946]: cluster 2024-03-30T15:20:38.928353+0000 mon.a (mon.0) 2885 : cluster 0 osdmap e486: 8 total, 8 up, 8 in 2024-03-30T15:20:40.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:39 smithi072 bash[28946]: audit 2024-03-30T15:20:38.935560+0000 mon.a (mon.0) 2886 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-30T15:20:40.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:39 smithi172 bash[23680]: cluster 2024-03-30T15:20:38.928353+0000 mon.a (mon.0) 2885 : cluster 0 osdmap e486: 8 total, 8 up, 8 in 2024-03-30T15:20:40.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:39 smithi172 bash[23680]: audit 2024-03-30T15:20:38.935560+0000 mon.a (mon.0) 2886 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-30T15:20:41.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:40 smithi172 bash[23680]: audit 2024-03-30T15:20:39.924966+0000 mon.a (mon.0) 2887 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-87","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-30T15:20:41.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:40 smithi172 bash[23680]: cluster 2024-03-30T15:20:39.932790+0000 mon.a (mon.0) 2888 : cluster 0 osdmap e487: 8 total, 8 up, 8 in 2024-03-30T15:20:41.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:40 smithi172 bash[23680]: audit 2024-03-30T15:20:39.937340+0000 mon.a (mon.0) 2889 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-87","var": "dedup_tier","val": "test-rados-api-smithi072-64344-89-test-flush"}]: dispatch 2024-03-30T15:20:41.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:40 smithi172 bash[23680]: cluster 2024-03-30T15:20:40.168065+0000 mgr.y (mgr.14526) 510 : cluster 0 pgmap v782: 260 pgs: 64 unknown, 196 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:20:41.416 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:20:41 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:20:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:20:41.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:40 smithi072 bash[21573]: audit 2024-03-30T15:20:39.924966+0000 mon.a (mon.0) 2887 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-87","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-30T15:20:41.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:40 smithi072 bash[21573]: cluster 2024-03-30T15:20:39.932790+0000 mon.a (mon.0) 2888 : cluster 0 osdmap e487: 8 total, 8 up, 8 in 2024-03-30T15:20:41.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:40 smithi072 bash[21573]: audit 2024-03-30T15:20:39.937340+0000 mon.a (mon.0) 2889 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-87","var": "dedup_tier","val": "test-rados-api-smithi072-64344-89-test-flush"}]: dispatch 2024-03-30T15:20:41.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:40 smithi072 bash[21573]: cluster 2024-03-30T15:20:40.168065+0000 mgr.y (mgr.14526) 510 : cluster 0 pgmap v782: 260 pgs: 64 unknown, 196 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:20:41.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:40 smithi072 bash[28946]: audit 2024-03-30T15:20:39.924966+0000 mon.a (mon.0) 2887 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-87","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-30T15:20:41.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:40 smithi072 bash[28946]: cluster 2024-03-30T15:20:39.932790+0000 mon.a (mon.0) 2888 : cluster 0 osdmap e487: 8 total, 8 up, 8 in 2024-03-30T15:20:41.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:40 smithi072 bash[28946]: audit 2024-03-30T15:20:39.937340+0000 mon.a (mon.0) 2889 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-87","var": "dedup_tier","val": "test-rados-api-smithi072-64344-89-test-flush"}]: dispatch 2024-03-30T15:20:41.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:40 smithi072 bash[28946]: cluster 2024-03-30T15:20:40.168065+0000 mgr.y (mgr.14526) 510 : cluster 0 pgmap v782: 260 pgs: 64 unknown, 196 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:20:41.715 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:20:41 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:20:42.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:41 smithi172 bash[23680]: audit 2024-03-30T15:20:40.936477+0000 mon.a (mon.0) 2890 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-87","var": "dedup_tier","val": "test-rados-api-smithi072-64344-89-test-flush"}]': finished 2024-03-30T15:20:42.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:41 smithi172 bash[23680]: cluster 2024-03-30T15:20:40.947126+0000 mon.a (mon.0) 2891 : cluster 0 osdmap e488: 8 total, 8 up, 8 in 2024-03-30T15:20:42.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:41 smithi172 bash[23680]: audit 2024-03-30T15:20:40.948909+0000 mon.a (mon.0) 2892 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-03-30T15:20:42.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:41 smithi172 bash[23680]: audit 2024-03-30T15:20:41.413397+0000 mgr.y (mgr.14526) 511 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:20:42.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:41 smithi072 bash[21573]: audit 2024-03-30T15:20:40.936477+0000 mon.a (mon.0) 2890 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-87","var": "dedup_tier","val": "test-rados-api-smithi072-64344-89-test-flush"}]': finished 2024-03-30T15:20:42.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:41 smithi072 bash[21573]: cluster 2024-03-30T15:20:40.947126+0000 mon.a (mon.0) 2891 : cluster 0 osdmap e488: 8 total, 8 up, 8 in 2024-03-30T15:20:42.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:41 smithi072 bash[21573]: audit 2024-03-30T15:20:40.948909+0000 mon.a (mon.0) 2892 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-03-30T15:20:42.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:41 smithi072 bash[21573]: audit 2024-03-30T15:20:41.413397+0000 mgr.y (mgr.14526) 511 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:20:42.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:41 smithi072 bash[28946]: audit 2024-03-30T15:20:40.936477+0000 mon.a (mon.0) 2890 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-87","var": "dedup_tier","val": "test-rados-api-smithi072-64344-89-test-flush"}]': finished 2024-03-30T15:20:42.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:41 smithi072 bash[28946]: cluster 2024-03-30T15:20:40.947126+0000 mon.a (mon.0) 2891 : cluster 0 osdmap e488: 8 total, 8 up, 8 in 2024-03-30T15:20:42.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:41 smithi072 bash[28946]: audit 2024-03-30T15:20:40.948909+0000 mon.a (mon.0) 2892 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-03-30T15:20:42.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:41 smithi072 bash[28946]: audit 2024-03-30T15:20:41.413397+0000 mgr.y (mgr.14526) 511 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:20:43.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:42 smithi072 bash[21573]: audit 2024-03-30T15:20:41.939468+0000 mon.a (mon.0) 2893 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-03-30T15:20:43.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:42 smithi072 bash[21573]: cluster 2024-03-30T15:20:41.952065+0000 mon.a (mon.0) 2894 : cluster 0 osdmap e489: 8 total, 8 up, 8 in 2024-03-30T15:20:43.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:42 smithi072 bash[21573]: audit 2024-03-30T15:20:41.954574+0000 mon.a (mon.0) 2895 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-30T15:20:43.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:42 smithi072 bash[21573]: cluster 2024-03-30T15:20:42.168902+0000 mgr.y (mgr.14526) 512 : cluster 0 pgmap v785: 260 pgs: 260 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:20:43.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:42 smithi072 bash[21573]: cluster 2024-03-30T15:20:42.239148+0000 mon.a (mon.0) 2896 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:20:43.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:42 smithi072 bash[21573]: audit 2024-03-30T15:20:42.942229+0000 mon.a (mon.0) 2897 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-87","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-03-30T15:20:43.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:42 smithi072 bash[21573]: cluster 2024-03-30T15:20:42.953019+0000 mon.a (mon.0) 2898 : cluster 0 osdmap e490: 8 total, 8 up, 8 in 2024-03-30T15:20:43.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:42 smithi072 bash[28946]: audit 2024-03-30T15:20:41.939468+0000 mon.a (mon.0) 2893 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-03-30T15:20:43.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:42 smithi072 bash[28946]: cluster 2024-03-30T15:20:41.952065+0000 mon.a (mon.0) 2894 : cluster 0 osdmap e489: 8 total, 8 up, 8 in 2024-03-30T15:20:43.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:42 smithi072 bash[28946]: audit 2024-03-30T15:20:41.954574+0000 mon.a (mon.0) 2895 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-30T15:20:43.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:42 smithi072 bash[28946]: cluster 2024-03-30T15:20:42.168902+0000 mgr.y (mgr.14526) 512 : cluster 0 pgmap v785: 260 pgs: 260 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:20:43.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:42 smithi072 bash[28946]: cluster 2024-03-30T15:20:42.239148+0000 mon.a (mon.0) 2896 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:20:43.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:42 smithi072 bash[28946]: audit 2024-03-30T15:20:42.942229+0000 mon.a (mon.0) 2897 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-87","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-03-30T15:20:43.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:42 smithi072 bash[28946]: cluster 2024-03-30T15:20:42.953019+0000 mon.a (mon.0) 2898 : cluster 0 osdmap e490: 8 total, 8 up, 8 in 2024-03-30T15:20:43.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:42 smithi172 bash[23680]: audit 2024-03-30T15:20:41.939468+0000 mon.a (mon.0) 2893 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-03-30T15:20:43.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:42 smithi172 bash[23680]: cluster 2024-03-30T15:20:41.952065+0000 mon.a (mon.0) 2894 : cluster 0 osdmap e489: 8 total, 8 up, 8 in 2024-03-30T15:20:43.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:42 smithi172 bash[23680]: audit 2024-03-30T15:20:41.954574+0000 mon.a (mon.0) 2895 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-30T15:20:43.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:42 smithi172 bash[23680]: cluster 2024-03-30T15:20:42.168902+0000 mgr.y (mgr.14526) 512 : cluster 0 pgmap v785: 260 pgs: 260 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:20:43.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:42 smithi172 bash[23680]: cluster 2024-03-30T15:20:42.239148+0000 mon.a (mon.0) 2896 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:20:43.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:42 smithi172 bash[23680]: audit 2024-03-30T15:20:42.942229+0000 mon.a (mon.0) 2897 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-87","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-03-30T15:20:43.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:42 smithi172 bash[23680]: cluster 2024-03-30T15:20:42.953019+0000 mon.a (mon.0) 2898 : cluster 0 osdmap e490: 8 total, 8 up, 8 in 2024-03-30T15:20:45.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:44 smithi072 bash[21573]: cluster 2024-03-30T15:20:43.987284+0000 mon.a (mon.0) 2899 : cluster 0 osdmap e491: 8 total, 8 up, 8 in 2024-03-30T15:20:45.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:44 smithi072 bash[21573]: audit 2024-03-30T15:20:44.074411+0000 mon.a (mon.0) 2900 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:20:45.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:44 smithi072 bash[21573]: audit 2024-03-30T15:20:44.075073+0000 mon.a (mon.0) 2901 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-87"}]: dispatch 2024-03-30T15:20:45.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:44 smithi072 bash[21573]: cluster 2024-03-30T15:20:44.169672+0000 mgr.y (mgr.14526) 513 : cluster 0 pgmap v788: 228 pgs: 228 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:20:45.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:44 smithi072 bash[28946]: cluster 2024-03-30T15:20:43.987284+0000 mon.a (mon.0) 2899 : cluster 0 osdmap e491: 8 total, 8 up, 8 in 2024-03-30T15:20:45.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:44 smithi072 bash[28946]: audit 2024-03-30T15:20:44.074411+0000 mon.a (mon.0) 2900 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:20:45.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:44 smithi072 bash[28946]: audit 2024-03-30T15:20:44.075073+0000 mon.a (mon.0) 2901 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-87"}]: dispatch 2024-03-30T15:20:45.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:44 smithi072 bash[28946]: cluster 2024-03-30T15:20:44.169672+0000 mgr.y (mgr.14526) 513 : cluster 0 pgmap v788: 228 pgs: 228 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:20:45.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:44 smithi172 bash[23680]: cluster 2024-03-30T15:20:43.987284+0000 mon.a (mon.0) 2899 : cluster 0 osdmap e491: 8 total, 8 up, 8 in 2024-03-30T15:20:45.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:44 smithi172 bash[23680]: audit 2024-03-30T15:20:44.074411+0000 mon.a (mon.0) 2900 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:20:45.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:44 smithi172 bash[23680]: audit 2024-03-30T15:20:44.075073+0000 mon.a (mon.0) 2901 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-87"}]: dispatch 2024-03-30T15:20:45.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:44 smithi172 bash[23680]: cluster 2024-03-30T15:20:44.169672+0000 mgr.y (mgr.14526) 513 : cluster 0 pgmap v788: 228 pgs: 228 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:20:46.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:45 smithi072 bash[21573]: cluster 2024-03-30T15:20:44.998157+0000 mon.a (mon.0) 2902 : cluster 0 osdmap e492: 8 total, 8 up, 8 in 2024-03-30T15:20:46.416 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:45 smithi072 bash[28946]: cluster 2024-03-30T15:20:44.998157+0000 mon.a (mon.0) 2902 : cluster 0 osdmap e492: 8 total, 8 up, 8 in 2024-03-30T15:20:46.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:45 smithi172 bash[23680]: cluster 2024-03-30T15:20:44.998157+0000 mon.a (mon.0) 2902 : cluster 0 osdmap e492: 8 total, 8 up, 8 in 2024-03-30T15:20:47.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:47 smithi072 bash[21573]: cluster 2024-03-30T15:20:46.011537+0000 mon.a (mon.0) 2903 : cluster 0 osdmap e493: 8 total, 8 up, 8 in 2024-03-30T15:20:47.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:47 smithi072 bash[21573]: audit 2024-03-30T15:20:46.014053+0000 mon.a (mon.0) 2904 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:20:47.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:47 smithi072 bash[21573]: cluster 2024-03-30T15:20:46.170465+0000 mgr.y (mgr.14526) 514 : cluster 0 pgmap v791: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-30T15:20:47.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:47 smithi072 bash[28946]: cluster 2024-03-30T15:20:46.011537+0000 mon.a (mon.0) 2903 : cluster 0 osdmap e493: 8 total, 8 up, 8 in 2024-03-30T15:20:47.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:47 smithi072 bash[28946]: audit 2024-03-30T15:20:46.014053+0000 mon.a (mon.0) 2904 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:20:47.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:47 smithi072 bash[28946]: cluster 2024-03-30T15:20:46.170465+0000 mgr.y (mgr.14526) 514 : cluster 0 pgmap v791: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-30T15:20:47.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:47 smithi172 bash[23680]: cluster 2024-03-30T15:20:46.011537+0000 mon.a (mon.0) 2903 : cluster 0 osdmap e493: 8 total, 8 up, 8 in 2024-03-30T15:20:47.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:47 smithi172 bash[23680]: audit 2024-03-30T15:20:46.014053+0000 mon.a (mon.0) 2904 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:20:47.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:47 smithi172 bash[23680]: cluster 2024-03-30T15:20:46.170465+0000 mgr.y (mgr.14526) 514 : cluster 0 pgmap v791: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-30T15:20:48.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:48 smithi072 bash[21573]: audit 2024-03-30T15:20:47.012599+0000 mon.a (mon.0) 2905 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-90","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:20:48.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:48 smithi072 bash[21573]: cluster 2024-03-30T15:20:47.023159+0000 mon.a (mon.0) 2906 : cluster 0 osdmap e494: 8 total, 8 up, 8 in 2024-03-30T15:20:48.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:48 smithi072 bash[21573]: audit 2024-03-30T15:20:47.026317+0000 mon.a (mon.0) 2907 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:20:48.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:48 smithi072 bash[21573]: audit 2024-03-30T15:20:47.048482+0000 mon.a (mon.0) 2908 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-30T15:20:48.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:48 smithi072 bash[28946]: audit 2024-03-30T15:20:47.012599+0000 mon.a (mon.0) 2905 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-90","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:20:48.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:48 smithi072 bash[28946]: cluster 2024-03-30T15:20:47.023159+0000 mon.a (mon.0) 2906 : cluster 0 osdmap e494: 8 total, 8 up, 8 in 2024-03-30T15:20:48.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:48 smithi072 bash[28946]: audit 2024-03-30T15:20:47.026317+0000 mon.a (mon.0) 2907 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:20:48.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:48 smithi072 bash[28946]: audit 2024-03-30T15:20:47.048482+0000 mon.a (mon.0) 2908 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-30T15:20:48.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:48 smithi172 bash[23680]: audit 2024-03-30T15:20:47.012599+0000 mon.a (mon.0) 2905 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-90","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:20:48.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:48 smithi172 bash[23680]: cluster 2024-03-30T15:20:47.023159+0000 mon.a (mon.0) 2906 : cluster 0 osdmap e494: 8 total, 8 up, 8 in 2024-03-30T15:20:48.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:48 smithi172 bash[23680]: audit 2024-03-30T15:20:47.026317+0000 mon.a (mon.0) 2907 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:20:48.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:48 smithi172 bash[23680]: audit 2024-03-30T15:20:47.048482+0000 mon.a (mon.0) 2908 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-30T15:20:49.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:49 smithi072 bash[21573]: audit 2024-03-30T15:20:48.022834+0000 mon.a (mon.0) 2909 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-30T15:20:49.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:49 smithi072 bash[21573]: cluster 2024-03-30T15:20:48.031356+0000 mon.a (mon.0) 2910 : cluster 0 osdmap e495: 8 total, 8 up, 8 in 2024-03-30T15:20:49.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:49 smithi072 bash[21573]: cluster 2024-03-30T15:20:48.171250+0000 mgr.y (mgr.14526) 515 : cluster 0 pgmap v794: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-30T15:20:49.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:49 smithi072 bash[28946]: audit 2024-03-30T15:20:48.022834+0000 mon.a (mon.0) 2909 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-30T15:20:49.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:49 smithi072 bash[28946]: cluster 2024-03-30T15:20:48.031356+0000 mon.a (mon.0) 2910 : cluster 0 osdmap e495: 8 total, 8 up, 8 in 2024-03-30T15:20:49.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:49 smithi072 bash[28946]: cluster 2024-03-30T15:20:48.171250+0000 mgr.y (mgr.14526) 515 : cluster 0 pgmap v794: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-30T15:20:49.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:49 smithi172 bash[23680]: audit 2024-03-30T15:20:48.022834+0000 mon.a (mon.0) 2909 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-30T15:20:49.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:49 smithi172 bash[23680]: cluster 2024-03-30T15:20:48.031356+0000 mon.a (mon.0) 2910 : cluster 0 osdmap e495: 8 total, 8 up, 8 in 2024-03-30T15:20:49.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:49 smithi172 bash[23680]: cluster 2024-03-30T15:20:48.171250+0000 mgr.y (mgr.14526) 515 : cluster 0 pgmap v794: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-30T15:20:50.416 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:50 smithi072 bash[28946]: cluster 2024-03-30T15:20:49.022817+0000 mon.a (mon.0) 2911 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:20:50.416 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:50 smithi072 bash[28946]: cluster 2024-03-30T15:20:49.040715+0000 mon.a (mon.0) 2912 : cluster 0 osdmap e496: 8 total, 8 up, 8 in 2024-03-30T15:20:50.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:50 smithi072 bash[21573]: cluster 2024-03-30T15:20:49.022817+0000 mon.a (mon.0) 2911 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:20:50.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:50 smithi072 bash[21573]: cluster 2024-03-30T15:20:49.040715+0000 mon.a (mon.0) 2912 : cluster 0 osdmap e496: 8 total, 8 up, 8 in 2024-03-30T15:20:50.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:50 smithi172 bash[23680]: cluster 2024-03-30T15:20:49.022817+0000 mon.a (mon.0) 2911 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:20:50.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:50 smithi172 bash[23680]: cluster 2024-03-30T15:20:49.040715+0000 mon.a (mon.0) 2912 : cluster 0 osdmap e496: 8 total, 8 up, 8 in 2024-03-30T15:20:51.416 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:20:51 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:20:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:20:51.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:51 smithi072 bash[21573]: cluster 2024-03-30T15:20:50.049550+0000 mon.a (mon.0) 2913 : cluster 0 osdmap e497: 8 total, 8 up, 8 in 2024-03-30T15:20:51.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:51 smithi072 bash[21573]: audit 2024-03-30T15:20:50.130758+0000 mon.a (mon.0) 2914 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:20:51.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:51 smithi072 bash[21573]: audit 2024-03-30T15:20:50.132015+0000 mon.a (mon.0) 2915 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-90"}]: dispatch 2024-03-30T15:20:51.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:51 smithi072 bash[21573]: cluster 2024-03-30T15:20:50.172203+0000 mgr.y (mgr.14526) 516 : cluster 0 pgmap v797: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:20:51.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:51 smithi072 bash[28946]: cluster 2024-03-30T15:20:50.049550+0000 mon.a (mon.0) 2913 : cluster 0 osdmap e497: 8 total, 8 up, 8 in 2024-03-30T15:20:51.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:51 smithi072 bash[28946]: audit 2024-03-30T15:20:50.130758+0000 mon.a (mon.0) 2914 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:20:51.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:51 smithi072 bash[28946]: audit 2024-03-30T15:20:50.132015+0000 mon.a (mon.0) 2915 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-90"}]: dispatch 2024-03-30T15:20:51.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:51 smithi072 bash[28946]: cluster 2024-03-30T15:20:50.172203+0000 mgr.y (mgr.14526) 516 : cluster 0 pgmap v797: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:20:51.420 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:51 smithi172 bash[23680]: cluster 2024-03-30T15:20:50.049550+0000 mon.a (mon.0) 2913 : cluster 0 osdmap e497: 8 total, 8 up, 8 in 2024-03-30T15:20:51.420 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:51 smithi172 bash[23680]: audit 2024-03-30T15:20:50.130758+0000 mon.a (mon.0) 2914 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:20:51.420 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:51 smithi172 bash[23680]: audit 2024-03-30T15:20:50.132015+0000 mon.a (mon.0) 2915 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-90"}]: dispatch 2024-03-30T15:20:51.420 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:51 smithi172 bash[23680]: cluster 2024-03-30T15:20:50.172203+0000 mgr.y (mgr.14526) 516 : cluster 0 pgmap v797: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:20:51.715 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:20:51 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:20:52.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:52 smithi072 bash[28946]: cluster 2024-03-30T15:20:51.070163+0000 mon.a (mon.0) 2916 : cluster 0 osdmap e498: 8 total, 8 up, 8 in 2024-03-30T15:20:52.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:52 smithi072 bash[28946]: audit 2024-03-30T15:20:51.424744+0000 mgr.y (mgr.14526) 517 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:20:52.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:52 smithi072 bash[28946]: audit 2024-03-30T15:20:51.674882+0000 mon.c (mon.2) 481 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:20:52.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:52 smithi072 bash[21573]: cluster 2024-03-30T15:20:51.070163+0000 mon.a (mon.0) 2916 : cluster 0 osdmap e498: 8 total, 8 up, 8 in 2024-03-30T15:20:52.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:52 smithi072 bash[21573]: audit 2024-03-30T15:20:51.424744+0000 mgr.y (mgr.14526) 517 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:20:52.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:52 smithi072 bash[21573]: audit 2024-03-30T15:20:51.674882+0000 mon.c (mon.2) 481 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:20:52.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:52 smithi172 bash[23680]: cluster 2024-03-30T15:20:51.070163+0000 mon.a (mon.0) 2916 : cluster 0 osdmap e498: 8 total, 8 up, 8 in 2024-03-30T15:20:52.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:52 smithi172 bash[23680]: audit 2024-03-30T15:20:51.424744+0000 mgr.y (mgr.14526) 517 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:20:52.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:52 smithi172 bash[23680]: audit 2024-03-30T15:20:51.674882+0000 mon.c (mon.2) 481 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:20:53.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:53 smithi072 bash[21573]: cluster 2024-03-30T15:20:52.076258+0000 mon.a (mon.0) 2917 : cluster 0 osdmap e499: 8 total, 8 up, 8 in 2024-03-30T15:20:53.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:53 smithi072 bash[21573]: audit 2024-03-30T15:20:52.091888+0000 mon.a (mon.0) 2918 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:20:53.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:53 smithi072 bash[21573]: cluster 2024-03-30T15:20:52.173096+0000 mgr.y (mgr.14526) 518 : cluster 0 pgmap v800: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-03-30T15:20:53.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:53 smithi072 bash[28946]: cluster 2024-03-30T15:20:52.076258+0000 mon.a (mon.0) 2917 : cluster 0 osdmap e499: 8 total, 8 up, 8 in 2024-03-30T15:20:53.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:53 smithi072 bash[28946]: audit 2024-03-30T15:20:52.091888+0000 mon.a (mon.0) 2918 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:20:53.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:53 smithi072 bash[28946]: cluster 2024-03-30T15:20:52.173096+0000 mgr.y (mgr.14526) 518 : cluster 0 pgmap v800: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-03-30T15:20:53.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:53 smithi172 bash[23680]: cluster 2024-03-30T15:20:52.076258+0000 mon.a (mon.0) 2917 : cluster 0 osdmap e499: 8 total, 8 up, 8 in 2024-03-30T15:20:53.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:53 smithi172 bash[23680]: audit 2024-03-30T15:20:52.091888+0000 mon.a (mon.0) 2918 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:20:53.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:53 smithi172 bash[23680]: cluster 2024-03-30T15:20:52.173096+0000 mgr.y (mgr.14526) 518 : cluster 0 pgmap v800: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-03-30T15:20:54.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:54 smithi072 bash[21573]: audit 2024-03-30T15:20:53.077781+0000 mon.a (mon.0) 2919 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-92","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:20:54.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:54 smithi072 bash[21573]: cluster 2024-03-30T15:20:53.094922+0000 mon.a (mon.0) 2920 : cluster 0 osdmap e500: 8 total, 8 up, 8 in 2024-03-30T15:20:54.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:54 smithi072 bash[21573]: audit 2024-03-30T15:20:53.102526+0000 mon.a (mon.0) 2921 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:20:54.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:54 smithi072 bash[28946]: audit 2024-03-30T15:20:53.077781+0000 mon.a (mon.0) 2919 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-92","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:20:54.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:54 smithi072 bash[28946]: cluster 2024-03-30T15:20:53.094922+0000 mon.a (mon.0) 2920 : cluster 0 osdmap e500: 8 total, 8 up, 8 in 2024-03-30T15:20:54.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:54 smithi072 bash[28946]: audit 2024-03-30T15:20:53.102526+0000 mon.a (mon.0) 2921 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:20:54.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:54 smithi172 bash[23680]: audit 2024-03-30T15:20:53.077781+0000 mon.a (mon.0) 2919 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-92","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:20:54.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:54 smithi172 bash[23680]: cluster 2024-03-30T15:20:53.094922+0000 mon.a (mon.0) 2920 : cluster 0 osdmap e500: 8 total, 8 up, 8 in 2024-03-30T15:20:54.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:54 smithi172 bash[23680]: audit 2024-03-30T15:20:53.102526+0000 mon.a (mon.0) 2921 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:20:55.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:55 smithi072 bash[21573]: cluster 2024-03-30T15:20:54.086227+0000 mon.a (mon.0) 2922 : cluster 0 osdmap e501: 8 total, 8 up, 8 in 2024-03-30T15:20:55.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:55 smithi072 bash[21573]: cluster 2024-03-30T15:20:54.173870+0000 mgr.y (mgr.14526) 519 : cluster 0 pgmap v803: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-03-30T15:20:55.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:55 smithi072 bash[21573]: cluster 2024-03-30T15:20:55.093444+0000 mon.a (mon.0) 2923 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:20:55.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:55 smithi072 bash[28946]: cluster 2024-03-30T15:20:54.086227+0000 mon.a (mon.0) 2922 : cluster 0 osdmap e501: 8 total, 8 up, 8 in 2024-03-30T15:20:55.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:55 smithi072 bash[28946]: cluster 2024-03-30T15:20:54.173870+0000 mgr.y (mgr.14526) 519 : cluster 0 pgmap v803: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-03-30T15:20:55.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:55 smithi072 bash[28946]: cluster 2024-03-30T15:20:55.093444+0000 mon.a (mon.0) 2923 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:20:55.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:55 smithi172 bash[23680]: cluster 2024-03-30T15:20:54.086227+0000 mon.a (mon.0) 2922 : cluster 0 osdmap e501: 8 total, 8 up, 8 in 2024-03-30T15:20:55.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:55 smithi172 bash[23680]: cluster 2024-03-30T15:20:54.173870+0000 mgr.y (mgr.14526) 519 : cluster 0 pgmap v803: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-03-30T15:20:55.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:55 smithi172 bash[23680]: cluster 2024-03-30T15:20:55.093444+0000 mon.a (mon.0) 2923 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:20:56.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:56 smithi072 bash[21573]: cluster 2024-03-30T15:20:55.117612+0000 mon.a (mon.0) 2924 : cluster 0 osdmap e502: 8 total, 8 up, 8 in 2024-03-30T15:20:56.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:56 smithi072 bash[21573]: audit 2024-03-30T15:20:55.208307+0000 mon.a (mon.0) 2925 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:20:56.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:56 smithi072 bash[21573]: audit 2024-03-30T15:20:55.209428+0000 mon.a (mon.0) 2926 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-92"}]: dispatch 2024-03-30T15:20:56.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:56 smithi072 bash[28946]: cluster 2024-03-30T15:20:55.117612+0000 mon.a (mon.0) 2924 : cluster 0 osdmap e502: 8 total, 8 up, 8 in 2024-03-30T15:20:56.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:56 smithi072 bash[28946]: audit 2024-03-30T15:20:55.208307+0000 mon.a (mon.0) 2925 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:20:56.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:56 smithi072 bash[28946]: audit 2024-03-30T15:20:55.209428+0000 mon.a (mon.0) 2926 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-92"}]: dispatch 2024-03-30T15:20:56.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:56 smithi172 bash[23680]: cluster 2024-03-30T15:20:55.117612+0000 mon.a (mon.0) 2924 : cluster 0 osdmap e502: 8 total, 8 up, 8 in 2024-03-30T15:20:56.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:56 smithi172 bash[23680]: audit 2024-03-30T15:20:55.208307+0000 mon.a (mon.0) 2925 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:20:56.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:56 smithi172 bash[23680]: audit 2024-03-30T15:20:55.209428+0000 mon.a (mon.0) 2926 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-92"}]: dispatch 2024-03-30T15:20:57.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:57 smithi072 bash[21573]: cluster 2024-03-30T15:20:56.128161+0000 mon.a (mon.0) 2927 : cluster 0 osdmap e503: 8 total, 8 up, 8 in 2024-03-30T15:20:57.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:57 smithi072 bash[21573]: cluster 2024-03-30T15:20:56.174646+0000 mgr.y (mgr.14526) 520 : cluster 0 pgmap v806: 196 pgs: 196 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-30T15:20:57.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:57 smithi072 bash[28946]: cluster 2024-03-30T15:20:56.128161+0000 mon.a (mon.0) 2927 : cluster 0 osdmap e503: 8 total, 8 up, 8 in 2024-03-30T15:20:57.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:57 smithi072 bash[28946]: cluster 2024-03-30T15:20:56.174646+0000 mgr.y (mgr.14526) 520 : cluster 0 pgmap v806: 196 pgs: 196 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-30T15:20:57.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:57 smithi172 bash[23680]: cluster 2024-03-30T15:20:56.128161+0000 mon.a (mon.0) 2927 : cluster 0 osdmap e503: 8 total, 8 up, 8 in 2024-03-30T15:20:57.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:57 smithi172 bash[23680]: cluster 2024-03-30T15:20:56.174646+0000 mgr.y (mgr.14526) 520 : cluster 0 pgmap v806: 196 pgs: 196 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-30T15:20:58.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:58 smithi172 bash[23680]: cluster 2024-03-30T15:20:57.144438+0000 mon.a (mon.0) 2928 : cluster 0 osdmap e504: 8 total, 8 up, 8 in 2024-03-30T15:20:58.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:58 smithi172 bash[23680]: audit 2024-03-30T15:20:57.152517+0000 mon.a (mon.0) 2929 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:20:58.666 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:58 smithi072 bash[28946]: cluster 2024-03-30T15:20:57.144438+0000 mon.a (mon.0) 2928 : cluster 0 osdmap e504: 8 total, 8 up, 8 in 2024-03-30T15:20:58.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:58 smithi072 bash[28946]: audit 2024-03-30T15:20:57.152517+0000 mon.a (mon.0) 2929 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:20:58.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:58 smithi072 bash[21573]: cluster 2024-03-30T15:20:57.144438+0000 mon.a (mon.0) 2928 : cluster 0 osdmap e504: 8 total, 8 up, 8 in 2024-03-30T15:20:58.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:58 smithi072 bash[21573]: audit 2024-03-30T15:20:57.152517+0000 mon.a (mon.0) 2929 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:20:59.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:59 smithi172 bash[23680]: audit 2024-03-30T15:20:58.136187+0000 mon.a (mon.0) 2930 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-94","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:20:59.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:59 smithi172 bash[23680]: cluster 2024-03-30T15:20:58.146671+0000 mon.a (mon.0) 2931 : cluster 0 osdmap e505: 8 total, 8 up, 8 in 2024-03-30T15:20:59.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:59 smithi172 bash[23680]: audit 2024-03-30T15:20:58.154951+0000 mon.a (mon.0) 2932 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:20:59.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:59 smithi172 bash[23680]: cluster 2024-03-30T15:20:58.176374+0000 mgr.y (mgr.14526) 521 : cluster 0 pgmap v809: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-30T15:20:59.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:20:59 smithi172 bash[23680]: cluster 2024-03-30T15:20:59.146119+0000 mon.a (mon.0) 2933 : cluster 0 osdmap e506: 8 total, 8 up, 8 in 2024-03-30T15:20:59.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:59 smithi072 bash[21573]: audit 2024-03-30T15:20:58.136187+0000 mon.a (mon.0) 2930 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-94","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:20:59.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:59 smithi072 bash[21573]: cluster 2024-03-30T15:20:58.146671+0000 mon.a (mon.0) 2931 : cluster 0 osdmap e505: 8 total, 8 up, 8 in 2024-03-30T15:20:59.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:59 smithi072 bash[21573]: audit 2024-03-30T15:20:58.154951+0000 mon.a (mon.0) 2932 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:20:59.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:59 smithi072 bash[21573]: cluster 2024-03-30T15:20:58.176374+0000 mgr.y (mgr.14526) 521 : cluster 0 pgmap v809: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-30T15:20:59.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:20:59 smithi072 bash[21573]: cluster 2024-03-30T15:20:59.146119+0000 mon.a (mon.0) 2933 : cluster 0 osdmap e506: 8 total, 8 up, 8 in 2024-03-30T15:20:59.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:59 smithi072 bash[28946]: audit 2024-03-30T15:20:58.136187+0000 mon.a (mon.0) 2930 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-94","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:20:59.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:59 smithi072 bash[28946]: cluster 2024-03-30T15:20:58.146671+0000 mon.a (mon.0) 2931 : cluster 0 osdmap e505: 8 total, 8 up, 8 in 2024-03-30T15:20:59.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:59 smithi072 bash[28946]: audit 2024-03-30T15:20:58.154951+0000 mon.a (mon.0) 2932 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:20:59.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:59 smithi072 bash[28946]: cluster 2024-03-30T15:20:58.176374+0000 mgr.y (mgr.14526) 521 : cluster 0 pgmap v809: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 2 op/s 2024-03-30T15:20:59.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:20:59 smithi072 bash[28946]: cluster 2024-03-30T15:20:59.146119+0000 mon.a (mon.0) 2933 : cluster 0 osdmap e506: 8 total, 8 up, 8 in 2024-03-30T15:21:01.416 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:21:01 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:21:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:21:01.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:01 smithi072 bash[21573]: cluster 2024-03-30T15:21:00.149602+0000 mon.a (mon.0) 2934 : cluster 0 osdmap e507: 8 total, 8 up, 8 in 2024-03-30T15:21:01.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:01 smithi072 bash[21573]: cluster 2024-03-30T15:21:00.177196+0000 mgr.y (mgr.14526) 522 : cluster 0 pgmap v812: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:21:01.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:01 smithi072 bash[28946]: cluster 2024-03-30T15:21:00.149602+0000 mon.a (mon.0) 2934 : cluster 0 osdmap e507: 8 total, 8 up, 8 in 2024-03-30T15:21:01.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:01 smithi072 bash[28946]: cluster 2024-03-30T15:21:00.177196+0000 mgr.y (mgr.14526) 522 : cluster 0 pgmap v812: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:21:01.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:01 smithi172 bash[23680]: cluster 2024-03-30T15:21:00.149602+0000 mon.a (mon.0) 2934 : cluster 0 osdmap e507: 8 total, 8 up, 8 in 2024-03-30T15:21:01.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:01 smithi172 bash[23680]: cluster 2024-03-30T15:21:00.177196+0000 mgr.y (mgr.14526) 522 : cluster 0 pgmap v812: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:21:01.715 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:21:01 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:21:02.416 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:02 smithi072 bash[21573]: audit 2024-03-30T15:21:01.436086+0000 mgr.y (mgr.14526) 523 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:21:02.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:02 smithi072 bash[28946]: audit 2024-03-30T15:21:01.436086+0000 mgr.y (mgr.14526) 523 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:21:02.465 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:02 smithi172 bash[23680]: audit 2024-03-30T15:21:01.436086+0000 mgr.y (mgr.14526) 523 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:21:03.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:03 smithi072 bash[21573]: cluster 2024-03-30T15:21:02.179336+0000 mgr.y (mgr.14526) 524 : cluster 0 pgmap v813: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-03-30T15:21:03.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:03 smithi072 bash[28946]: cluster 2024-03-30T15:21:02.179336+0000 mgr.y (mgr.14526) 524 : cluster 0 pgmap v813: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-03-30T15:21:03.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:03 smithi172 bash[23680]: cluster 2024-03-30T15:21:02.179336+0000 mgr.y (mgr.14526) 524 : cluster 0 pgmap v813: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-03-30T15:21:05.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:05 smithi072 bash[21573]: cluster 2024-03-30T15:21:04.180184+0000 mgr.y (mgr.14526) 525 : cluster 0 pgmap v814: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-03-30T15:21:05.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:05 smithi072 bash[28946]: cluster 2024-03-30T15:21:04.180184+0000 mgr.y (mgr.14526) 525 : cluster 0 pgmap v814: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-03-30T15:21:05.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:05 smithi172 bash[23680]: cluster 2024-03-30T15:21:04.180184+0000 mgr.y (mgr.14526) 525 : cluster 0 pgmap v814: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-03-30T15:21:07.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:07 smithi072 bash[21573]: cluster 2024-03-30T15:21:06.182487+0000 mgr.y (mgr.14526) 526 : cluster 0 pgmap v815: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1023 B/s wr, 4 op/s 2024-03-30T15:21:07.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:07 smithi072 bash[21573]: audit 2024-03-30T15:21:06.708209+0000 mon.c (mon.2) 482 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:21:07.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:07 smithi072 bash[28946]: cluster 2024-03-30T15:21:06.182487+0000 mgr.y (mgr.14526) 526 : cluster 0 pgmap v815: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1023 B/s wr, 4 op/s 2024-03-30T15:21:07.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:07 smithi072 bash[28946]: audit 2024-03-30T15:21:06.708209+0000 mon.c (mon.2) 482 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:21:07.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:07 smithi172 bash[23680]: cluster 2024-03-30T15:21:06.182487+0000 mgr.y (mgr.14526) 526 : cluster 0 pgmap v815: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1023 B/s wr, 4 op/s 2024-03-30T15:21:07.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:07 smithi172 bash[23680]: audit 2024-03-30T15:21:06.708209+0000 mon.c (mon.2) 482 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:21:09.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:09 smithi072 bash[21573]: cluster 2024-03-30T15:21:08.183329+0000 mgr.y (mgr.14526) 527 : cluster 0 pgmap v816: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 906 B/s wr, 3 op/s 2024-03-30T15:21:09.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:09 smithi072 bash[28946]: cluster 2024-03-30T15:21:08.183329+0000 mgr.y (mgr.14526) 527 : cluster 0 pgmap v816: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 906 B/s wr, 3 op/s 2024-03-30T15:21:09.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:09 smithi172 bash[23680]: cluster 2024-03-30T15:21:08.183329+0000 mgr.y (mgr.14526) 527 : cluster 0 pgmap v816: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 906 B/s wr, 3 op/s 2024-03-30T15:21:11.416 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:21:11 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:21:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:21:11.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:11 smithi072 bash[21573]: cluster 2024-03-30T15:21:10.184153+0000 mgr.y (mgr.14526) 528 : cluster 0 pgmap v817: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 815 B/s wr, 3 op/s 2024-03-30T15:21:11.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:11 smithi072 bash[21573]: cluster 2024-03-30T15:21:10.284682+0000 mon.a (mon.0) 2935 : cluster 0 osdmap e508: 8 total, 8 up, 8 in 2024-03-30T15:21:11.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:11 smithi072 bash[28946]: cluster 2024-03-30T15:21:10.184153+0000 mgr.y (mgr.14526) 528 : cluster 0 pgmap v817: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 815 B/s wr, 3 op/s 2024-03-30T15:21:11.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:11 smithi072 bash[28946]: cluster 2024-03-30T15:21:10.284682+0000 mon.a (mon.0) 2935 : cluster 0 osdmap e508: 8 total, 8 up, 8 in 2024-03-30T15:21:11.715 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:21:11 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:21:11.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:11 smithi172 bash[23680]: cluster 2024-03-30T15:21:10.184153+0000 mgr.y (mgr.14526) 528 : cluster 0 pgmap v817: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 815 B/s wr, 3 op/s 2024-03-30T15:21:11.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:11 smithi172 bash[23680]: cluster 2024-03-30T15:21:10.284682+0000 mon.a (mon.0) 2935 : cluster 0 osdmap e508: 8 total, 8 up, 8 in 2024-03-30T15:21:12.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:12 smithi072 bash[21573]: audit 2024-03-30T15:21:11.441142+0000 mgr.y (mgr.14526) 529 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:21:12.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:12 smithi072 bash[28946]: audit 2024-03-30T15:21:11.441142+0000 mgr.y (mgr.14526) 529 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:21:12.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:12 smithi172 bash[23680]: audit 2024-03-30T15:21:11.441142+0000 mgr.y (mgr.14526) 529 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:21:13.666 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:13 smithi072 bash[21573]: cluster 2024-03-30T15:21:12.186399+0000 mgr.y (mgr.14526) 530 : cluster 0 pgmap v819: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:21:13.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:13 smithi072 bash[28946]: cluster 2024-03-30T15:21:12.186399+0000 mgr.y (mgr.14526) 530 : cluster 0 pgmap v819: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:21:13.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:13 smithi172 bash[23680]: cluster 2024-03-30T15:21:12.186399+0000 mgr.y (mgr.14526) 530 : cluster 0 pgmap v819: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:21:15.666 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:15 smithi072 bash[28946]: cluster 2024-03-30T15:21:14.187344+0000 mgr.y (mgr.14526) 531 : cluster 0 pgmap v820: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:21:15.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:15 smithi072 bash[21573]: cluster 2024-03-30T15:21:14.187344+0000 mgr.y (mgr.14526) 531 : cluster 0 pgmap v820: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:21:15.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:15 smithi172 bash[23680]: cluster 2024-03-30T15:21:14.187344+0000 mgr.y (mgr.14526) 531 : cluster 0 pgmap v820: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:21:17.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:17 smithi072 bash[21573]: cluster 2024-03-30T15:21:16.189461+0000 mgr.y (mgr.14526) 532 : cluster 0 pgmap v821: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:21:17.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:17 smithi072 bash[21573]: cluster 2024-03-30T15:21:17.265568+0000 mon.a (mon.0) 2936 : cluster 0 osdmap e509: 8 total, 8 up, 8 in 2024-03-30T15:21:17.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:17 smithi072 bash[28946]: cluster 2024-03-30T15:21:16.189461+0000 mgr.y (mgr.14526) 532 : cluster 0 pgmap v821: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:21:17.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:17 smithi072 bash[28946]: cluster 2024-03-30T15:21:17.265568+0000 mon.a (mon.0) 2936 : cluster 0 osdmap e509: 8 total, 8 up, 8 in 2024-03-30T15:21:17.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:17 smithi172 bash[23680]: cluster 2024-03-30T15:21:16.189461+0000 mgr.y (mgr.14526) 532 : cluster 0 pgmap v821: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:21:17.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:17 smithi172 bash[23680]: cluster 2024-03-30T15:21:17.265568+0000 mon.a (mon.0) 2936 : cluster 0 osdmap e509: 8 total, 8 up, 8 in 2024-03-30T15:21:19.666 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:19 smithi072 bash[28946]: cluster 2024-03-30T15:21:18.190351+0000 mgr.y (mgr.14526) 533 : cluster 0 pgmap v823: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:21:19.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:19 smithi072 bash[21573]: cluster 2024-03-30T15:21:18.190351+0000 mgr.y (mgr.14526) 533 : cluster 0 pgmap v823: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:21:19.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:19 smithi172 bash[23680]: cluster 2024-03-30T15:21:18.190351+0000 mgr.y (mgr.14526) 533 : cluster 0 pgmap v823: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:21:21.416 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:21:21 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:21:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:21:21.715 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:21:21 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:21:22.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:21 smithi072 bash[28946]: cluster 2024-03-30T15:21:20.191340+0000 mgr.y (mgr.14526) 534 : cluster 0 pgmap v824: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:21:22.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:21 smithi072 bash[28946]: audit 2024-03-30T15:21:20.333822+0000 mon.a (mon.0) 2937 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:21:22.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:21 smithi072 bash[28946]: audit 2024-03-30T15:21:20.335049+0000 mon.a (mon.0) 2938 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-94"}]: dispatch 2024-03-30T15:21:22.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:21 smithi072 bash[21573]: cluster 2024-03-30T15:21:20.191340+0000 mgr.y (mgr.14526) 534 : cluster 0 pgmap v824: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:21:22.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:21 smithi072 bash[21573]: audit 2024-03-30T15:21:20.333822+0000 mon.a (mon.0) 2937 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:21:22.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:21 smithi072 bash[21573]: audit 2024-03-30T15:21:20.335049+0000 mon.a (mon.0) 2938 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-94"}]: dispatch 2024-03-30T15:21:22.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:21 smithi172 bash[23680]: cluster 2024-03-30T15:21:20.191340+0000 mgr.y (mgr.14526) 534 : cluster 0 pgmap v824: 228 pgs: 228 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:21:22.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:21 smithi172 bash[23680]: audit 2024-03-30T15:21:20.333822+0000 mon.a (mon.0) 2937 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:21:22.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:21 smithi172 bash[23680]: audit 2024-03-30T15:21:20.335049+0000 mon.a (mon.0) 2938 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-94"}]: dispatch 2024-03-30T15:21:23.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:22 smithi072 bash[21573]: cluster 2024-03-30T15:21:21.318218+0000 mon.a (mon.0) 2939 : cluster 0 osdmap e510: 8 total, 8 up, 8 in 2024-03-30T15:21:23.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:22 smithi072 bash[21573]: audit 2024-03-30T15:21:21.452603+0000 mgr.y (mgr.14526) 535 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:21:23.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:22 smithi072 bash[21573]: audit 2024-03-30T15:21:21.741700+0000 mon.c (mon.2) 483 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:21:23.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:22 smithi072 bash[21573]: audit 2024-03-30T15:21:22.051103+0000 mon.c (mon.2) 484 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:21:23.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:22 smithi072 bash[21573]: cluster 2024-03-30T15:21:22.325383+0000 mon.a (mon.0) 2940 : cluster 0 osdmap e511: 8 total, 8 up, 8 in 2024-03-30T15:21:23.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:22 smithi072 bash[21573]: audit 2024-03-30T15:21:22.330028+0000 mon.a (mon.0) 2941 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:21:23.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:22 smithi072 bash[28946]: cluster 2024-03-30T15:21:21.318218+0000 mon.a (mon.0) 2939 : cluster 0 osdmap e510: 8 total, 8 up, 8 in 2024-03-30T15:21:23.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:22 smithi072 bash[28946]: audit 2024-03-30T15:21:21.452603+0000 mgr.y (mgr.14526) 535 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:21:23.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:22 smithi072 bash[28946]: audit 2024-03-30T15:21:21.741700+0000 mon.c (mon.2) 483 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:21:23.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:22 smithi072 bash[28946]: audit 2024-03-30T15:21:22.051103+0000 mon.c (mon.2) 484 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:21:23.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:22 smithi072 bash[28946]: cluster 2024-03-30T15:21:22.325383+0000 mon.a (mon.0) 2940 : cluster 0 osdmap e511: 8 total, 8 up, 8 in 2024-03-30T15:21:23.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:22 smithi072 bash[28946]: audit 2024-03-30T15:21:22.330028+0000 mon.a (mon.0) 2941 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:21:23.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:22 smithi172 bash[23680]: cluster 2024-03-30T15:21:21.318218+0000 mon.a (mon.0) 2939 : cluster 0 osdmap e510: 8 total, 8 up, 8 in 2024-03-30T15:21:23.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:22 smithi172 bash[23680]: audit 2024-03-30T15:21:21.452603+0000 mgr.y (mgr.14526) 535 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:21:23.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:22 smithi172 bash[23680]: audit 2024-03-30T15:21:21.741700+0000 mon.c (mon.2) 483 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:21:23.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:22 smithi172 bash[23680]: audit 2024-03-30T15:21:22.051103+0000 mon.c (mon.2) 484 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:21:23.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:22 smithi172 bash[23680]: cluster 2024-03-30T15:21:22.325383+0000 mon.a (mon.0) 2940 : cluster 0 osdmap e511: 8 total, 8 up, 8 in 2024-03-30T15:21:23.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:22 smithi172 bash[23680]: audit 2024-03-30T15:21:22.330028+0000 mon.a (mon.0) 2941 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:21:24.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:23 smithi072 bash[21573]: cluster 2024-03-30T15:21:22.192329+0000 mgr.y (mgr.14526) 536 : cluster 0 pgmap v826: 196 pgs: 196 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:21:24.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:23 smithi072 bash[21573]: audit 2024-03-30T15:21:22.834951+0000 mon.c (mon.2) 485 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:21:24.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:23 smithi072 bash[21573]: audit 2024-03-30T15:21:22.836748+0000 mon.c (mon.2) 486 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:21:24.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:23 smithi072 bash[21573]: audit 2024-03-30T15:21:22.847578+0000 mon.a (mon.0) 2942 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:21:24.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:23 smithi072 bash[21573]: audit 2024-03-30T15:21:23.317705+0000 mon.a (mon.0) 2943 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-96","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:21:24.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:23 smithi072 bash[21573]: cluster 2024-03-30T15:21:23.326144+0000 mon.a (mon.0) 2944 : cluster 0 osdmap e512: 8 total, 8 up, 8 in 2024-03-30T15:21:24.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:23 smithi072 bash[21573]: audit 2024-03-30T15:21:23.342705+0000 mon.a (mon.0) 2945 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:21:24.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:23 smithi072 bash[28946]: cluster 2024-03-30T15:21:22.192329+0000 mgr.y (mgr.14526) 536 : cluster 0 pgmap v826: 196 pgs: 196 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:21:24.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:23 smithi072 bash[28946]: audit 2024-03-30T15:21:22.834951+0000 mon.c (mon.2) 485 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:21:24.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:23 smithi072 bash[28946]: audit 2024-03-30T15:21:22.836748+0000 mon.c (mon.2) 486 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:21:24.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:23 smithi072 bash[28946]: audit 2024-03-30T15:21:22.847578+0000 mon.a (mon.0) 2942 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:21:24.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:23 smithi072 bash[28946]: audit 2024-03-30T15:21:23.317705+0000 mon.a (mon.0) 2943 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-96","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:21:24.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:23 smithi072 bash[28946]: cluster 2024-03-30T15:21:23.326144+0000 mon.a (mon.0) 2944 : cluster 0 osdmap e512: 8 total, 8 up, 8 in 2024-03-30T15:21:24.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:23 smithi072 bash[28946]: audit 2024-03-30T15:21:23.342705+0000 mon.a (mon.0) 2945 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:21:24.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:23 smithi172 bash[23680]: cluster 2024-03-30T15:21:22.192329+0000 mgr.y (mgr.14526) 536 : cluster 0 pgmap v826: 196 pgs: 196 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:21:24.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:23 smithi172 bash[23680]: audit 2024-03-30T15:21:22.834951+0000 mon.c (mon.2) 485 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:21:24.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:23 smithi172 bash[23680]: audit 2024-03-30T15:21:22.836748+0000 mon.c (mon.2) 486 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:21:24.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:23 smithi172 bash[23680]: audit 2024-03-30T15:21:22.847578+0000 mon.a (mon.0) 2942 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:21:24.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:23 smithi172 bash[23680]: audit 2024-03-30T15:21:23.317705+0000 mon.a (mon.0) 2943 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-96","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:21:24.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:23 smithi172 bash[23680]: cluster 2024-03-30T15:21:23.326144+0000 mon.a (mon.0) 2944 : cluster 0 osdmap e512: 8 total, 8 up, 8 in 2024-03-30T15:21:24.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:23 smithi172 bash[23680]: audit 2024-03-30T15:21:23.342705+0000 mon.a (mon.0) 2945 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:21:25.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:25 smithi072 bash[21573]: cluster 2024-03-30T15:21:24.193243+0000 mgr.y (mgr.14526) 537 : cluster 0 pgmap v829: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:21:25.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:25 smithi072 bash[21573]: cluster 2024-03-30T15:21:24.327908+0000 mon.a (mon.0) 2946 : cluster 0 osdmap e513: 8 total, 8 up, 8 in 2024-03-30T15:21:25.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:25 smithi072 bash[28946]: cluster 2024-03-30T15:21:24.193243+0000 mgr.y (mgr.14526) 537 : cluster 0 pgmap v829: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:21:25.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:25 smithi072 bash[28946]: cluster 2024-03-30T15:21:24.327908+0000 mon.a (mon.0) 2946 : cluster 0 osdmap e513: 8 total, 8 up, 8 in 2024-03-30T15:21:25.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:25 smithi172 bash[23680]: cluster 2024-03-30T15:21:24.193243+0000 mgr.y (mgr.14526) 537 : cluster 0 pgmap v829: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:21:25.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:25 smithi172 bash[23680]: cluster 2024-03-30T15:21:24.327908+0000 mon.a (mon.0) 2946 : cluster 0 osdmap e513: 8 total, 8 up, 8 in 2024-03-30T15:21:27.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:27 smithi072 bash[28946]: cluster 2024-03-30T15:21:26.195393+0000 mgr.y (mgr.14526) 538 : cluster 0 pgmap v831: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.0 KiB/s wr, 3 op/s 2024-03-30T15:21:27.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:27 smithi072 bash[21573]: cluster 2024-03-30T15:21:26.195393+0000 mgr.y (mgr.14526) 538 : cluster 0 pgmap v831: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.0 KiB/s wr, 3 op/s 2024-03-30T15:21:27.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:27 smithi172 bash[23680]: cluster 2024-03-30T15:21:26.195393+0000 mgr.y (mgr.14526) 538 : cluster 0 pgmap v831: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.0 KiB/s wr, 3 op/s 2024-03-30T15:21:29.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:29 smithi072 bash[21573]: cluster 2024-03-30T15:21:28.196219+0000 mgr.y (mgr.14526) 539 : cluster 0 pgmap v832: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 852 B/s wr, 2 op/s 2024-03-30T15:21:29.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:29 smithi072 bash[28946]: cluster 2024-03-30T15:21:28.196219+0000 mgr.y (mgr.14526) 539 : cluster 0 pgmap v832: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 852 B/s wr, 2 op/s 2024-03-30T15:21:29.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:29 smithi172 bash[23680]: cluster 2024-03-30T15:21:28.196219+0000 mgr.y (mgr.14526) 539 : cluster 0 pgmap v832: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 852 B/s wr, 2 op/s 2024-03-30T15:21:31.331 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:21:31 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:21:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:21:31.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:31 smithi072 bash[21573]: cluster 2024-03-30T15:21:30.197193+0000 mgr.y (mgr.14526) 540 : cluster 0 pgmap v833: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 649 B/s rd, 649 B/s wr, 2 op/s 2024-03-30T15:21:31.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:31 smithi072 bash[21573]: audit 2024-03-30T15:21:30.436433+0000 mon.c (mon.2) 487 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "314.1e", "id": [6, 0]}]: dispatch 2024-03-30T15:21:31.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:31 smithi072 bash[21573]: audit 2024-03-30T15:21:30.437377+0000 mon.a (mon.0) 2947 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "314.1e", "id": [6, 0]}]: dispatch 2024-03-30T15:21:31.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:31 smithi072 bash[28946]: cluster 2024-03-30T15:21:30.197193+0000 mgr.y (mgr.14526) 540 : cluster 0 pgmap v833: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 649 B/s rd, 649 B/s wr, 2 op/s 2024-03-30T15:21:31.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:31 smithi072 bash[28946]: audit 2024-03-30T15:21:30.436433+0000 mon.c (mon.2) 487 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "314.1e", "id": [6, 0]}]: dispatch 2024-03-30T15:21:31.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:31 smithi072 bash[28946]: audit 2024-03-30T15:21:30.437377+0000 mon.a (mon.0) 2947 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "314.1e", "id": [6, 0]}]: dispatch 2024-03-30T15:21:31.715 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:21:31 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:21:31.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:31 smithi172 bash[23680]: cluster 2024-03-30T15:21:30.197193+0000 mgr.y (mgr.14526) 540 : cluster 0 pgmap v833: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 649 B/s rd, 649 B/s wr, 2 op/s 2024-03-30T15:21:31.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:31 smithi172 bash[23680]: audit 2024-03-30T15:21:30.436433+0000 mon.c (mon.2) 487 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "314.1e", "id": [6, 0]}]: dispatch 2024-03-30T15:21:31.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:31 smithi172 bash[23680]: audit 2024-03-30T15:21:30.437377+0000 mon.a (mon.0) 2947 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "314.1e", "id": [6, 0]}]: dispatch 2024-03-30T15:21:32.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:32 smithi072 bash[21573]: audit 2024-03-30T15:21:31.344138+0000 mon.a (mon.0) 2948 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "314.1e", "id": [6, 0]}]': finished 2024-03-30T15:21:32.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:32 smithi072 bash[21573]: cluster 2024-03-30T15:21:31.355972+0000 mon.a (mon.0) 2949 : cluster 0 osdmap e514: 8 total, 8 up, 8 in 2024-03-30T15:21:32.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:32 smithi072 bash[21573]: audit 2024-03-30T15:21:31.464205+0000 mgr.y (mgr.14526) 541 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:21:32.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:32 smithi072 bash[28946]: audit 2024-03-30T15:21:31.344138+0000 mon.a (mon.0) 2948 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "314.1e", "id": [6, 0]}]': finished 2024-03-30T15:21:32.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:32 smithi072 bash[28946]: cluster 2024-03-30T15:21:31.355972+0000 mon.a (mon.0) 2949 : cluster 0 osdmap e514: 8 total, 8 up, 8 in 2024-03-30T15:21:32.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:32 smithi072 bash[28946]: audit 2024-03-30T15:21:31.464205+0000 mgr.y (mgr.14526) 541 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:21:32.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:32 smithi172 bash[23680]: audit 2024-03-30T15:21:31.344138+0000 mon.a (mon.0) 2948 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "314.1e", "id": [6, 0]}]': finished 2024-03-30T15:21:32.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:32 smithi172 bash[23680]: cluster 2024-03-30T15:21:31.355972+0000 mon.a (mon.0) 2949 : cluster 0 osdmap e514: 8 total, 8 up, 8 in 2024-03-30T15:21:32.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:32 smithi172 bash[23680]: audit 2024-03-30T15:21:31.464205+0000 mgr.y (mgr.14526) 541 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:21:33.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:33 smithi072 bash[21573]: cluster 2024-03-30T15:21:32.198040+0000 mgr.y (mgr.14526) 542 : cluster 0 pgmap v835: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 639 B/s wr, 2 op/s 2024-03-30T15:21:33.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:33 smithi072 bash[21573]: cluster 2024-03-30T15:21:32.352711+0000 mon.a (mon.0) 2950 : cluster 0 osdmap e515: 8 total, 8 up, 8 in 2024-03-30T15:21:33.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:33 smithi072 bash[28946]: cluster 2024-03-30T15:21:32.198040+0000 mgr.y (mgr.14526) 542 : cluster 0 pgmap v835: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 639 B/s wr, 2 op/s 2024-03-30T15:21:33.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:33 smithi072 bash[28946]: cluster 2024-03-30T15:21:32.352711+0000 mon.a (mon.0) 2950 : cluster 0 osdmap e515: 8 total, 8 up, 8 in 2024-03-30T15:21:33.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:33 smithi172 bash[23680]: cluster 2024-03-30T15:21:32.198040+0000 mgr.y (mgr.14526) 542 : cluster 0 pgmap v835: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 639 B/s wr, 2 op/s 2024-03-30T15:21:33.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:33 smithi172 bash[23680]: cluster 2024-03-30T15:21:32.352711+0000 mon.a (mon.0) 2950 : cluster 0 osdmap e515: 8 total, 8 up, 8 in 2024-03-30T15:21:34.667 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 30 15:21:34 smithi072 bash[37707]: debug 2024-03-30T15:21:34.369+0000 7f6d3fca1700 -1 snap_mapper.add_oid found existing snaps mapped on 100:2313bc4a:test-rados-api-smithi072-64344-97::foo:21, removing 2024-03-30T15:21:34.667 INFO:journalctl@ceph.osd.3.smithi072.stdout:Mar 30 15:21:34 smithi072 bash[48729]: debug 2024-03-30T15:21:34.369+0000 7f0e6f827700 -1 snap_mapper.add_oid found existing snaps mapped on 100:2313bc4a:test-rados-api-smithi072-64344-97::foo:21, removing 2024-03-30T15:21:34.668 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 30 15:21:34 smithi072 bash[43232]: debug 2024-03-30T15:21:34.369+0000 7efe38d23700 -1 snap_mapper.add_oid found existing snaps mapped on 100:2313bc4a:test-rados-api-smithi072-64344-97::foo:21, removing 2024-03-30T15:21:35.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:35 smithi072 bash[21573]: cluster 2024-03-30T15:21:34.198900+0000 mgr.y (mgr.14526) 543 : cluster 0 pgmap v837: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-30T15:21:35.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:35 smithi072 bash[21573]: audit 2024-03-30T15:21:34.414442+0000 mon.a (mon.0) 2951 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:21:35.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:35 smithi072 bash[21573]: audit 2024-03-30T15:21:34.415420+0000 mon.a (mon.0) 2952 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-96"}]: dispatch 2024-03-30T15:21:35.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:35 smithi072 bash[28946]: cluster 2024-03-30T15:21:34.198900+0000 mgr.y (mgr.14526) 543 : cluster 0 pgmap v837: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-30T15:21:35.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:35 smithi072 bash[28946]: audit 2024-03-30T15:21:34.414442+0000 mon.a (mon.0) 2951 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:21:35.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:35 smithi072 bash[28946]: audit 2024-03-30T15:21:34.415420+0000 mon.a (mon.0) 2952 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-96"}]: dispatch 2024-03-30T15:21:35.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:35 smithi172 bash[23680]: cluster 2024-03-30T15:21:34.198900+0000 mgr.y (mgr.14526) 543 : cluster 0 pgmap v837: 228 pgs: 228 active+clean; 8.4 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-30T15:21:35.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:35 smithi172 bash[23680]: audit 2024-03-30T15:21:34.414442+0000 mon.a (mon.0) 2951 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:21:35.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:35 smithi172 bash[23680]: audit 2024-03-30T15:21:34.415420+0000 mon.a (mon.0) 2952 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-96"}]: dispatch 2024-03-30T15:21:36.667 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:36 smithi072 bash[21573]: cluster 2024-03-30T15:21:35.384711+0000 mon.a (mon.0) 2953 : cluster 0 osdmap e516: 8 total, 8 up, 8 in 2024-03-30T15:21:36.667 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:36 smithi072 bash[28946]: cluster 2024-03-30T15:21:35.384711+0000 mon.a (mon.0) 2953 : cluster 0 osdmap e516: 8 total, 8 up, 8 in 2024-03-30T15:21:36.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:36 smithi172 bash[23680]: cluster 2024-03-30T15:21:35.384711+0000 mon.a (mon.0) 2953 : cluster 0 osdmap e516: 8 total, 8 up, 8 in 2024-03-30T15:21:37.715 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:37 smithi172 bash[23680]: cluster 2024-03-30T15:21:36.200745+0000 mgr.y (mgr.14526) 544 : cluster 0 pgmap v839: 196 pgs: 196 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-03-30T15:21:37.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:37 smithi172 bash[23680]: cluster 2024-03-30T15:21:36.409317+0000 mon.a (mon.0) 2954 : cluster 0 osdmap e517: 8 total, 8 up, 8 in 2024-03-30T15:21:37.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:37 smithi172 bash[23680]: audit 2024-03-30T15:21:36.423033+0000 mon.a (mon.0) 2955 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:21:37.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:37 smithi172 bash[23680]: audit 2024-03-30T15:21:36.807061+0000 mon.c (mon.2) 488 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:21:37.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:37 smithi072 bash[21573]: cluster 2024-03-30T15:21:36.200745+0000 mgr.y (mgr.14526) 544 : cluster 0 pgmap v839: 196 pgs: 196 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-03-30T15:21:37.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:37 smithi072 bash[21573]: cluster 2024-03-30T15:21:36.409317+0000 mon.a (mon.0) 2954 : cluster 0 osdmap e517: 8 total, 8 up, 8 in 2024-03-30T15:21:37.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:37 smithi072 bash[21573]: audit 2024-03-30T15:21:36.423033+0000 mon.a (mon.0) 2955 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:21:37.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:37 smithi072 bash[21573]: audit 2024-03-30T15:21:36.807061+0000 mon.c (mon.2) 488 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:21:37.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:37 smithi072 bash[28946]: cluster 2024-03-30T15:21:36.200745+0000 mgr.y (mgr.14526) 544 : cluster 0 pgmap v839: 196 pgs: 196 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-03-30T15:21:37.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:37 smithi072 bash[28946]: cluster 2024-03-30T15:21:36.409317+0000 mon.a (mon.0) 2954 : cluster 0 osdmap e517: 8 total, 8 up, 8 in 2024-03-30T15:21:37.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:37 smithi072 bash[28946]: audit 2024-03-30T15:21:36.423033+0000 mon.a (mon.0) 2955 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:21:37.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:37 smithi072 bash[28946]: audit 2024-03-30T15:21:36.807061+0000 mon.c (mon.2) 488 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:21:38.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:38 smithi172 bash[23680]: audit 2024-03-30T15:21:37.396209+0000 mon.a (mon.0) 2956 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-98","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:21:38.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:38 smithi172 bash[23680]: cluster 2024-03-30T15:21:37.408174+0000 mon.a (mon.0) 2957 : cluster 0 osdmap e518: 8 total, 8 up, 8 in 2024-03-30T15:21:38.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:38 smithi172 bash[23680]: audit 2024-03-30T15:21:37.457319+0000 mon.a (mon.0) 2958 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-98", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:21:38.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:38 smithi072 bash[21573]: audit 2024-03-30T15:21:37.396209+0000 mon.a (mon.0) 2956 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-98","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:21:38.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:38 smithi072 bash[21573]: cluster 2024-03-30T15:21:37.408174+0000 mon.a (mon.0) 2957 : cluster 0 osdmap e518: 8 total, 8 up, 8 in 2024-03-30T15:21:38.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:38 smithi072 bash[21573]: audit 2024-03-30T15:21:37.457319+0000 mon.a (mon.0) 2958 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-98", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:21:38.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:38 smithi072 bash[28946]: audit 2024-03-30T15:21:37.396209+0000 mon.a (mon.0) 2956 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-98","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:21:38.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:38 smithi072 bash[28946]: cluster 2024-03-30T15:21:37.408174+0000 mon.a (mon.0) 2957 : cluster 0 osdmap e518: 8 total, 8 up, 8 in 2024-03-30T15:21:38.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:38 smithi072 bash[28946]: audit 2024-03-30T15:21:37.457319+0000 mon.a (mon.0) 2958 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-98", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:21:39.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:39 smithi172 bash[23680]: cluster 2024-03-30T15:21:38.201597+0000 mgr.y (mgr.14526) 545 : cluster 0 pgmap v842: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 op/s 2024-03-30T15:21:39.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:39 smithi172 bash[23680]: audit 2024-03-30T15:21:38.440109+0000 mon.a (mon.0) 2959 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-98", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:21:39.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:39 smithi172 bash[23680]: cluster 2024-03-30T15:21:38.453464+0000 mon.a (mon.0) 2960 : cluster 0 osdmap e519: 8 total, 8 up, 8 in 2024-03-30T15:21:39.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:39 smithi172 bash[23680]: audit 2024-03-30T15:21:38.454888+0000 mon.a (mon.0) 2961 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-98", "mode": "writeback"}]: dispatch 2024-03-30T15:21:39.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:39 smithi072 bash[21573]: cluster 2024-03-30T15:21:38.201597+0000 mgr.y (mgr.14526) 545 : cluster 0 pgmap v842: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 op/s 2024-03-30T15:21:39.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:39 smithi072 bash[21573]: audit 2024-03-30T15:21:38.440109+0000 mon.a (mon.0) 2959 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-98", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:21:39.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:39 smithi072 bash[21573]: cluster 2024-03-30T15:21:38.453464+0000 mon.a (mon.0) 2960 : cluster 0 osdmap e519: 8 total, 8 up, 8 in 2024-03-30T15:21:39.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:39 smithi072 bash[21573]: audit 2024-03-30T15:21:38.454888+0000 mon.a (mon.0) 2961 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-98", "mode": "writeback"}]: dispatch 2024-03-30T15:21:39.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:39 smithi072 bash[28946]: cluster 2024-03-30T15:21:38.201597+0000 mgr.y (mgr.14526) 545 : cluster 0 pgmap v842: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 op/s 2024-03-30T15:21:39.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:39 smithi072 bash[28946]: audit 2024-03-30T15:21:38.440109+0000 mon.a (mon.0) 2959 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-98", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:21:39.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:39 smithi072 bash[28946]: cluster 2024-03-30T15:21:38.453464+0000 mon.a (mon.0) 2960 : cluster 0 osdmap e519: 8 total, 8 up, 8 in 2024-03-30T15:21:39.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:39 smithi072 bash[28946]: audit 2024-03-30T15:21:38.454888+0000 mon.a (mon.0) 2961 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-98", "mode": "writeback"}]: dispatch 2024-03-30T15:21:40.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:40 smithi172 bash[23680]: cluster 2024-03-30T15:21:39.440481+0000 mon.a (mon.0) 2962 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:21:40.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:40 smithi172 bash[23680]: audit 2024-03-30T15:21:39.442989+0000 mon.a (mon.0) 2963 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-98", "mode": "writeback"}]': finished 2024-03-30T15:21:40.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:40 smithi172 bash[23680]: cluster 2024-03-30T15:21:39.450354+0000 mon.a (mon.0) 2964 : cluster 0 osdmap e520: 8 total, 8 up, 8 in 2024-03-30T15:21:40.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:40 smithi172 bash[23680]: audit 2024-03-30T15:21:39.453641+0000 mon.a (mon.0) 2965 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-98"}]: dispatch 2024-03-30T15:21:40.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:40 smithi172 bash[23680]: audit 2024-03-30T15:21:40.445706+0000 mon.a (mon.0) 2966 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-98"}]': finished 2024-03-30T15:21:40.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:40 smithi172 bash[23680]: cluster 2024-03-30T15:21:40.453616+0000 mon.a (mon.0) 2967 : cluster 0 osdmap e521: 8 total, 8 up, 8 in 2024-03-30T15:21:40.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:40 smithi072 bash[21573]: cluster 2024-03-30T15:21:39.440481+0000 mon.a (mon.0) 2962 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:21:40.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:40 smithi072 bash[21573]: audit 2024-03-30T15:21:39.442989+0000 mon.a (mon.0) 2963 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-98", "mode": "writeback"}]': finished 2024-03-30T15:21:40.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:40 smithi072 bash[21573]: cluster 2024-03-30T15:21:39.450354+0000 mon.a (mon.0) 2964 : cluster 0 osdmap e520: 8 total, 8 up, 8 in 2024-03-30T15:21:40.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:40 smithi072 bash[21573]: audit 2024-03-30T15:21:39.453641+0000 mon.a (mon.0) 2965 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-98"}]: dispatch 2024-03-30T15:21:40.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:40 smithi072 bash[21573]: audit 2024-03-30T15:21:40.445706+0000 mon.a (mon.0) 2966 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-98"}]': finished 2024-03-30T15:21:40.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:40 smithi072 bash[21573]: cluster 2024-03-30T15:21:40.453616+0000 mon.a (mon.0) 2967 : cluster 0 osdmap e521: 8 total, 8 up, 8 in 2024-03-30T15:21:40.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:40 smithi072 bash[28946]: cluster 2024-03-30T15:21:39.440481+0000 mon.a (mon.0) 2962 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:21:40.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:40 smithi072 bash[28946]: audit 2024-03-30T15:21:39.442989+0000 mon.a (mon.0) 2963 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-98", "mode": "writeback"}]': finished 2024-03-30T15:21:40.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:40 smithi072 bash[28946]: cluster 2024-03-30T15:21:39.450354+0000 mon.a (mon.0) 2964 : cluster 0 osdmap e520: 8 total, 8 up, 8 in 2024-03-30T15:21:40.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:40 smithi072 bash[28946]: audit 2024-03-30T15:21:39.453641+0000 mon.a (mon.0) 2965 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-98"}]: dispatch 2024-03-30T15:21:40.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:40 smithi072 bash[28946]: audit 2024-03-30T15:21:40.445706+0000 mon.a (mon.0) 2966 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-98"}]': finished 2024-03-30T15:21:40.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:40 smithi072 bash[28946]: cluster 2024-03-30T15:21:40.453616+0000 mon.a (mon.0) 2967 : cluster 0 osdmap e521: 8 total, 8 up, 8 in 2024-03-30T15:21:41.417 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:21:41 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:21:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:21:41.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:41 smithi072 bash[21573]: cluster 2024-03-30T15:21:40.202531+0000 mgr.y (mgr.14526) 546 : cluster 0 pgmap v845: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:21:41.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:41 smithi072 bash[21573]: audit 2024-03-30T15:21:40.454420+0000 mon.a (mon.0) 2968 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-98","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-30T15:21:41.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:41 smithi072 bash[21573]: cluster 2024-03-30T15:21:41.446002+0000 mon.a (mon.0) 2969 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:21:41.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:41 smithi072 bash[21573]: audit 2024-03-30T15:21:41.448455+0000 mon.a (mon.0) 2970 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-98","var": "hit_set_type","val": "bloom"}]': finished 2024-03-30T15:21:41.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:41 smithi072 bash[21573]: cluster 2024-03-30T15:21:41.456185+0000 mon.a (mon.0) 2971 : cluster 0 osdmap e522: 8 total, 8 up, 8 in 2024-03-30T15:21:41.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:41 smithi072 bash[21573]: audit 2024-03-30T15:21:41.457643+0000 mon.a (mon.0) 2972 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-98","var": "hit_set_count","val": "1"}]: dispatch 2024-03-30T15:21:41.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:41 smithi072 bash[28946]: cluster 2024-03-30T15:21:40.202531+0000 mgr.y (mgr.14526) 546 : cluster 0 pgmap v845: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:21:41.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:41 smithi072 bash[28946]: audit 2024-03-30T15:21:40.454420+0000 mon.a (mon.0) 2968 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-98","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-30T15:21:41.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:41 smithi072 bash[28946]: cluster 2024-03-30T15:21:41.446002+0000 mon.a (mon.0) 2969 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:21:41.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:41 smithi072 bash[28946]: audit 2024-03-30T15:21:41.448455+0000 mon.a (mon.0) 2970 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-98","var": "hit_set_type","val": "bloom"}]': finished 2024-03-30T15:21:41.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:41 smithi072 bash[28946]: cluster 2024-03-30T15:21:41.456185+0000 mon.a (mon.0) 2971 : cluster 0 osdmap e522: 8 total, 8 up, 8 in 2024-03-30T15:21:41.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:41 smithi072 bash[28946]: audit 2024-03-30T15:21:41.457643+0000 mon.a (mon.0) 2972 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-98","var": "hit_set_count","val": "1"}]: dispatch 2024-03-30T15:21:41.966 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:21:41 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:21:41.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:41 smithi172 bash[23680]: cluster 2024-03-30T15:21:40.202531+0000 mgr.y (mgr.14526) 546 : cluster 0 pgmap v845: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:21:41.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:41 smithi172 bash[23680]: audit 2024-03-30T15:21:40.454420+0000 mon.a (mon.0) 2968 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-98","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-30T15:21:41.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:41 smithi172 bash[23680]: cluster 2024-03-30T15:21:41.446002+0000 mon.a (mon.0) 2969 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:21:41.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:41 smithi172 bash[23680]: audit 2024-03-30T15:21:41.448455+0000 mon.a (mon.0) 2970 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-98","var": "hit_set_type","val": "bloom"}]': finished 2024-03-30T15:21:41.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:41 smithi172 bash[23680]: cluster 2024-03-30T15:21:41.456185+0000 mon.a (mon.0) 2971 : cluster 0 osdmap e522: 8 total, 8 up, 8 in 2024-03-30T15:21:41.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:41 smithi172 bash[23680]: audit 2024-03-30T15:21:41.457643+0000 mon.a (mon.0) 2972 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-98","var": "hit_set_count","val": "1"}]: dispatch 2024-03-30T15:21:42.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:42 smithi072 bash[21573]: audit 2024-03-30T15:21:41.473076+0000 mgr.y (mgr.14526) 547 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:21:42.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:42 smithi072 bash[21573]: audit 2024-03-30T15:21:42.451527+0000 mon.a (mon.0) 2973 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-98","var": "hit_set_count","val": "1"}]': finished 2024-03-30T15:21:42.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:42 smithi072 bash[21573]: cluster 2024-03-30T15:21:42.458909+0000 mon.a (mon.0) 2974 : cluster 0 osdmap e523: 8 total, 8 up, 8 in 2024-03-30T15:21:42.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:42 smithi072 bash[21573]: audit 2024-03-30T15:21:42.460003+0000 mon.a (mon.0) 2975 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-98","var": "hit_set_period","val": "600"}]: dispatch 2024-03-30T15:21:42.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:42 smithi072 bash[28946]: audit 2024-03-30T15:21:41.473076+0000 mgr.y (mgr.14526) 547 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:21:42.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:42 smithi072 bash[28946]: audit 2024-03-30T15:21:42.451527+0000 mon.a (mon.0) 2973 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-98","var": "hit_set_count","val": "1"}]': finished 2024-03-30T15:21:42.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:42 smithi072 bash[28946]: cluster 2024-03-30T15:21:42.458909+0000 mon.a (mon.0) 2974 : cluster 0 osdmap e523: 8 total, 8 up, 8 in 2024-03-30T15:21:42.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:42 smithi072 bash[28946]: audit 2024-03-30T15:21:42.460003+0000 mon.a (mon.0) 2975 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-98","var": "hit_set_period","val": "600"}]: dispatch 2024-03-30T15:21:42.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:42 smithi172 bash[23680]: audit 2024-03-30T15:21:41.473076+0000 mgr.y (mgr.14526) 547 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:21:42.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:42 smithi172 bash[23680]: audit 2024-03-30T15:21:42.451527+0000 mon.a (mon.0) 2973 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-98","var": "hit_set_count","val": "1"}]': finished 2024-03-30T15:21:42.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:42 smithi172 bash[23680]: cluster 2024-03-30T15:21:42.458909+0000 mon.a (mon.0) 2974 : cluster 0 osdmap e523: 8 total, 8 up, 8 in 2024-03-30T15:21:42.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:42 smithi172 bash[23680]: audit 2024-03-30T15:21:42.460003+0000 mon.a (mon.0) 2975 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-98","var": "hit_set_period","val": "600"}]: dispatch 2024-03-30T15:21:43.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:43 smithi072 bash[21573]: cluster 2024-03-30T15:21:42.203420+0000 mgr.y (mgr.14526) 548 : cluster 0 pgmap v848: 228 pgs: 228 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:21:43.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:43 smithi072 bash[21573]: audit 2024-03-30T15:21:43.454117+0000 mon.a (mon.0) 2976 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-98","var": "hit_set_period","val": "600"}]': finished 2024-03-30T15:21:43.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:43 smithi072 bash[21573]: cluster 2024-03-30T15:21:43.463909+0000 mon.a (mon.0) 2977 : cluster 0 osdmap e524: 8 total, 8 up, 8 in 2024-03-30T15:21:43.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:43 smithi072 bash[21573]: audit 2024-03-30T15:21:43.465357+0000 mon.a (mon.0) 2978 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-98","var": "target_max_objects","val": "250"}]: dispatch 2024-03-30T15:21:43.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:43 smithi072 bash[28946]: cluster 2024-03-30T15:21:42.203420+0000 mgr.y (mgr.14526) 548 : cluster 0 pgmap v848: 228 pgs: 228 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:21:43.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:43 smithi072 bash[28946]: audit 2024-03-30T15:21:43.454117+0000 mon.a (mon.0) 2976 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-98","var": "hit_set_period","val": "600"}]': finished 2024-03-30T15:21:43.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:43 smithi072 bash[28946]: cluster 2024-03-30T15:21:43.463909+0000 mon.a (mon.0) 2977 : cluster 0 osdmap e524: 8 total, 8 up, 8 in 2024-03-30T15:21:43.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:43 smithi072 bash[28946]: audit 2024-03-30T15:21:43.465357+0000 mon.a (mon.0) 2978 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-98","var": "target_max_objects","val": "250"}]: dispatch 2024-03-30T15:21:43.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:43 smithi172 bash[23680]: cluster 2024-03-30T15:21:42.203420+0000 mgr.y (mgr.14526) 548 : cluster 0 pgmap v848: 228 pgs: 228 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:21:43.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:43 smithi172 bash[23680]: audit 2024-03-30T15:21:43.454117+0000 mon.a (mon.0) 2976 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-98","var": "hit_set_period","val": "600"}]': finished 2024-03-30T15:21:43.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:43 smithi172 bash[23680]: cluster 2024-03-30T15:21:43.463909+0000 mon.a (mon.0) 2977 : cluster 0 osdmap e524: 8 total, 8 up, 8 in 2024-03-30T15:21:43.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:43 smithi172 bash[23680]: audit 2024-03-30T15:21:43.465357+0000 mon.a (mon.0) 2978 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-98","var": "target_max_objects","val": "250"}]: dispatch 2024-03-30T15:21:45.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:45 smithi172 bash[23680]: cluster 2024-03-30T15:21:44.204271+0000 mgr.y (mgr.14526) 549 : cluster 0 pgmap v851: 228 pgs: 228 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:21:45.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:45 smithi172 bash[23680]: audit 2024-03-30T15:21:44.457081+0000 mon.a (mon.0) 2979 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-98","var": "target_max_objects","val": "250"}]': finished 2024-03-30T15:21:45.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:45 smithi172 bash[23680]: cluster 2024-03-30T15:21:44.463363+0000 mon.a (mon.0) 2980 : cluster 0 osdmap e525: 8 total, 8 up, 8 in 2024-03-30T15:21:45.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:45 smithi172 bash[23680]: audit 2024-03-30T15:21:44.535943+0000 mon.a (mon.0) 2981 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:21:45.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:45 smithi072 bash[21573]: cluster 2024-03-30T15:21:44.204271+0000 mgr.y (mgr.14526) 549 : cluster 0 pgmap v851: 228 pgs: 228 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:21:45.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:45 smithi072 bash[21573]: audit 2024-03-30T15:21:44.457081+0000 mon.a (mon.0) 2979 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-98","var": "target_max_objects","val": "250"}]': finished 2024-03-30T15:21:45.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:45 smithi072 bash[21573]: cluster 2024-03-30T15:21:44.463363+0000 mon.a (mon.0) 2980 : cluster 0 osdmap e525: 8 total, 8 up, 8 in 2024-03-30T15:21:45.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:45 smithi072 bash[21573]: audit 2024-03-30T15:21:44.535943+0000 mon.a (mon.0) 2981 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:21:45.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:45 smithi072 bash[28946]: cluster 2024-03-30T15:21:44.204271+0000 mgr.y (mgr.14526) 549 : cluster 0 pgmap v851: 228 pgs: 228 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:21:45.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:45 smithi072 bash[28946]: audit 2024-03-30T15:21:44.457081+0000 mon.a (mon.0) 2979 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-98","var": "target_max_objects","val": "250"}]': finished 2024-03-30T15:21:45.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:45 smithi072 bash[28946]: cluster 2024-03-30T15:21:44.463363+0000 mon.a (mon.0) 2980 : cluster 0 osdmap e525: 8 total, 8 up, 8 in 2024-03-30T15:21:45.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:45 smithi072 bash[28946]: audit 2024-03-30T15:21:44.535943+0000 mon.a (mon.0) 2981 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:21:46.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:46 smithi072 bash[28946]: audit 2024-03-30T15:21:45.489925+0000 mon.a (mon.0) 2982 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:21:46.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:46 smithi072 bash[28946]: cluster 2024-03-30T15:21:45.497664+0000 mon.a (mon.0) 2983 : cluster 0 osdmap e526: 8 total, 8 up, 8 in 2024-03-30T15:21:46.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:46 smithi072 bash[28946]: audit 2024-03-30T15:21:45.498712+0000 mon.a (mon.0) 2984 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-98"}]: dispatch 2024-03-30T15:21:46.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:46 smithi072 bash[21573]: audit 2024-03-30T15:21:45.489925+0000 mon.a (mon.0) 2982 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:21:46.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:46 smithi072 bash[21573]: cluster 2024-03-30T15:21:45.497664+0000 mon.a (mon.0) 2983 : cluster 0 osdmap e526: 8 total, 8 up, 8 in 2024-03-30T15:21:46.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:46 smithi072 bash[21573]: audit 2024-03-30T15:21:45.498712+0000 mon.a (mon.0) 2984 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-98"}]: dispatch 2024-03-30T15:21:46.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:46 smithi172 bash[23680]: audit 2024-03-30T15:21:45.489925+0000 mon.a (mon.0) 2982 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:21:46.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:46 smithi172 bash[23680]: cluster 2024-03-30T15:21:45.497664+0000 mon.a (mon.0) 2983 : cluster 0 osdmap e526: 8 total, 8 up, 8 in 2024-03-30T15:21:46.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:46 smithi172 bash[23680]: audit 2024-03-30T15:21:45.498712+0000 mon.a (mon.0) 2984 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-98"}]: dispatch 2024-03-30T15:21:48.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:47 smithi172 bash[23680]: cluster 2024-03-30T15:21:46.206507+0000 mgr.y (mgr.14526) 550 : cluster 0 pgmap v854: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:21:48.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:47 smithi172 bash[23680]: audit 2024-03-30T15:21:46.500957+0000 mon.a (mon.0) 2985 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-98"}]': finished 2024-03-30T15:21:48.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:47 smithi172 bash[23680]: cluster 2024-03-30T15:21:46.510524+0000 mon.a (mon.0) 2986 : cluster 0 osdmap e527: 8 total, 8 up, 8 in 2024-03-30T15:21:48.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:47 smithi072 bash[21573]: cluster 2024-03-30T15:21:46.206507+0000 mgr.y (mgr.14526) 550 : cluster 0 pgmap v854: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:21:48.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:47 smithi072 bash[21573]: audit 2024-03-30T15:21:46.500957+0000 mon.a (mon.0) 2985 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-98"}]': finished 2024-03-30T15:21:48.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:47 smithi072 bash[21573]: cluster 2024-03-30T15:21:46.510524+0000 mon.a (mon.0) 2986 : cluster 0 osdmap e527: 8 total, 8 up, 8 in 2024-03-30T15:21:48.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:47 smithi072 bash[28946]: cluster 2024-03-30T15:21:46.206507+0000 mgr.y (mgr.14526) 550 : cluster 0 pgmap v854: 228 pgs: 228 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:21:48.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:47 smithi072 bash[28946]: audit 2024-03-30T15:21:46.500957+0000 mon.a (mon.0) 2985 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-98"}]': finished 2024-03-30T15:21:48.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:47 smithi072 bash[28946]: cluster 2024-03-30T15:21:46.510524+0000 mon.a (mon.0) 2986 : cluster 0 osdmap e527: 8 total, 8 up, 8 in 2024-03-30T15:21:49.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:48 smithi172 bash[23680]: cluster 2024-03-30T15:21:47.510675+0000 mon.a (mon.0) 2987 : cluster 0 osdmap e528: 8 total, 8 up, 8 in 2024-03-30T15:21:49.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:48 smithi172 bash[23680]: cluster 2024-03-30T15:21:48.207300+0000 mgr.y (mgr.14526) 551 : cluster 0 pgmap v857: 196 pgs: 196 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:21:49.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:48 smithi172 bash[23680]: cluster 2024-03-30T15:21:48.517189+0000 mon.a (mon.0) 2988 : cluster 0 osdmap e529: 8 total, 8 up, 8 in 2024-03-30T15:21:49.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:48 smithi172 bash[23680]: audit 2024-03-30T15:21:48.531068+0000 mon.a (mon.0) 2989 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:21:49.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:48 smithi072 bash[21573]: cluster 2024-03-30T15:21:47.510675+0000 mon.a (mon.0) 2987 : cluster 0 osdmap e528: 8 total, 8 up, 8 in 2024-03-30T15:21:49.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:48 smithi072 bash[21573]: cluster 2024-03-30T15:21:48.207300+0000 mgr.y (mgr.14526) 551 : cluster 0 pgmap v857: 196 pgs: 196 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:21:49.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:48 smithi072 bash[21573]: cluster 2024-03-30T15:21:48.517189+0000 mon.a (mon.0) 2988 : cluster 0 osdmap e529: 8 total, 8 up, 8 in 2024-03-30T15:21:49.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:48 smithi072 bash[21573]: audit 2024-03-30T15:21:48.531068+0000 mon.a (mon.0) 2989 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:21:49.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:48 smithi072 bash[28946]: cluster 2024-03-30T15:21:47.510675+0000 mon.a (mon.0) 2987 : cluster 0 osdmap e528: 8 total, 8 up, 8 in 2024-03-30T15:21:49.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:48 smithi072 bash[28946]: cluster 2024-03-30T15:21:48.207300+0000 mgr.y (mgr.14526) 551 : cluster 0 pgmap v857: 196 pgs: 196 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:21:49.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:48 smithi072 bash[28946]: cluster 2024-03-30T15:21:48.517189+0000 mon.a (mon.0) 2988 : cluster 0 osdmap e529: 8 total, 8 up, 8 in 2024-03-30T15:21:49.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:48 smithi072 bash[28946]: audit 2024-03-30T15:21:48.531068+0000 mon.a (mon.0) 2989 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:21:50.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:50 smithi072 bash[21573]: audit 2024-03-30T15:21:49.510476+0000 mon.a (mon.0) 2990 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-100","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:21:50.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:50 smithi072 bash[21573]: cluster 2024-03-30T15:21:49.518516+0000 mon.a (mon.0) 2991 : cluster 0 osdmap e530: 8 total, 8 up, 8 in 2024-03-30T15:21:50.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:50 smithi072 bash[21573]: audit 2024-03-30T15:21:49.524673+0000 mon.a (mon.0) 2992 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-100", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:21:50.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:50 smithi072 bash[28946]: audit 2024-03-30T15:21:49.510476+0000 mon.a (mon.0) 2990 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-100","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:21:50.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:50 smithi072 bash[28946]: cluster 2024-03-30T15:21:49.518516+0000 mon.a (mon.0) 2991 : cluster 0 osdmap e530: 8 total, 8 up, 8 in 2024-03-30T15:21:50.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:50 smithi072 bash[28946]: audit 2024-03-30T15:21:49.524673+0000 mon.a (mon.0) 2992 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-100", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:21:50.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:50 smithi172 bash[23680]: audit 2024-03-30T15:21:49.510476+0000 mon.a (mon.0) 2990 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-100","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:21:50.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:50 smithi172 bash[23680]: cluster 2024-03-30T15:21:49.518516+0000 mon.a (mon.0) 2991 : cluster 0 osdmap e530: 8 total, 8 up, 8 in 2024-03-30T15:21:50.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:50 smithi172 bash[23680]: audit 2024-03-30T15:21:49.524673+0000 mon.a (mon.0) 2992 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-100", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:21:51.417 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:21:51 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:21:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:21:51.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:51 smithi072 bash[21573]: cluster 2024-03-30T15:21:50.208085+0000 mgr.y (mgr.14526) 552 : cluster 0 pgmap v860: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:21:51.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:51 smithi072 bash[21573]: audit 2024-03-30T15:21:50.513858+0000 mon.a (mon.0) 2993 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-100", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:21:51.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:51 smithi072 bash[21573]: cluster 2024-03-30T15:21:50.523854+0000 mon.a (mon.0) 2994 : cluster 0 osdmap e531: 8 total, 8 up, 8 in 2024-03-30T15:21:51.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:51 smithi072 bash[21573]: audit 2024-03-30T15:21:50.529015+0000 mon.a (mon.0) 2995 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-100"}]: dispatch 2024-03-30T15:21:51.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:51 smithi072 bash[21573]: audit 2024-03-30T15:21:51.516581+0000 mon.a (mon.0) 2996 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-100"}]': finished 2024-03-30T15:21:51.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:51 smithi072 bash[21573]: cluster 2024-03-30T15:21:51.524583+0000 mon.a (mon.0) 2997 : cluster 0 osdmap e532: 8 total, 8 up, 8 in 2024-03-30T15:21:51.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:51 smithi072 bash[21573]: audit 2024-03-30T15:21:51.525443+0000 mon.a (mon.0) 2998 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-100", "mode": "writeback"}]: dispatch 2024-03-30T15:21:51.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:51 smithi072 bash[28946]: cluster 2024-03-30T15:21:50.208085+0000 mgr.y (mgr.14526) 552 : cluster 0 pgmap v860: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:21:51.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:51 smithi072 bash[28946]: audit 2024-03-30T15:21:50.513858+0000 mon.a (mon.0) 2993 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-100", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:21:51.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:51 smithi072 bash[28946]: cluster 2024-03-30T15:21:50.523854+0000 mon.a (mon.0) 2994 : cluster 0 osdmap e531: 8 total, 8 up, 8 in 2024-03-30T15:21:51.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:51 smithi072 bash[28946]: audit 2024-03-30T15:21:50.529015+0000 mon.a (mon.0) 2995 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-100"}]: dispatch 2024-03-30T15:21:51.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:51 smithi072 bash[28946]: audit 2024-03-30T15:21:51.516581+0000 mon.a (mon.0) 2996 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-100"}]': finished 2024-03-30T15:21:51.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:51 smithi072 bash[28946]: cluster 2024-03-30T15:21:51.524583+0000 mon.a (mon.0) 2997 : cluster 0 osdmap e532: 8 total, 8 up, 8 in 2024-03-30T15:21:51.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:51 smithi072 bash[28946]: audit 2024-03-30T15:21:51.525443+0000 mon.a (mon.0) 2998 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-100", "mode": "writeback"}]: dispatch 2024-03-30T15:21:51.966 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:21:51 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:21:51.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:51 smithi172 bash[23680]: cluster 2024-03-30T15:21:50.208085+0000 mgr.y (mgr.14526) 552 : cluster 0 pgmap v860: 228 pgs: 32 unknown, 196 active+clean; 8.4 MiB data, 649 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:21:51.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:51 smithi172 bash[23680]: audit 2024-03-30T15:21:50.513858+0000 mon.a (mon.0) 2993 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-100", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:21:51.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:51 smithi172 bash[23680]: cluster 2024-03-30T15:21:50.523854+0000 mon.a (mon.0) 2994 : cluster 0 osdmap e531: 8 total, 8 up, 8 in 2024-03-30T15:21:51.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:51 smithi172 bash[23680]: audit 2024-03-30T15:21:50.529015+0000 mon.a (mon.0) 2995 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-100"}]: dispatch 2024-03-30T15:21:51.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:51 smithi172 bash[23680]: audit 2024-03-30T15:21:51.516581+0000 mon.a (mon.0) 2996 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-6", "overlaypool": "test-rados-api-smithi072-64344-100"}]': finished 2024-03-30T15:21:51.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:51 smithi172 bash[23680]: cluster 2024-03-30T15:21:51.524583+0000 mon.a (mon.0) 2997 : cluster 0 osdmap e532: 8 total, 8 up, 8 in 2024-03-30T15:21:51.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:51 smithi172 bash[23680]: audit 2024-03-30T15:21:51.525443+0000 mon.a (mon.0) 2998 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-100", "mode": "writeback"}]: dispatch 2024-03-30T15:21:52.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:52 smithi072 bash[21573]: audit 2024-03-30T15:21:51.484505+0000 mgr.y (mgr.14526) 553 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:21:52.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:52 smithi072 bash[21573]: audit 2024-03-30T15:21:51.840701+0000 mon.c (mon.2) 489 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:21:52.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:52 smithi072 bash[21573]: cluster 2024-03-30T15:21:52.517033+0000 mon.a (mon.0) 2999 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:21:52.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:52 smithi072 bash[21573]: audit 2024-03-30T15:21:52.519427+0000 mon.a (mon.0) 3000 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-100", "mode": "writeback"}]': finished 2024-03-30T15:21:52.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:52 smithi072 bash[21573]: cluster 2024-03-30T15:21:52.526436+0000 mon.a (mon.0) 3001 : cluster 0 osdmap e533: 8 total, 8 up, 8 in 2024-03-30T15:21:52.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:52 smithi072 bash[21573]: audit 2024-03-30T15:21:52.528536+0000 mon.a (mon.0) 3002 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-100","var": "hit_set_count","val": "2"}]: dispatch 2024-03-30T15:21:52.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:52 smithi072 bash[28946]: audit 2024-03-30T15:21:51.484505+0000 mgr.y (mgr.14526) 553 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:21:52.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:52 smithi072 bash[28946]: audit 2024-03-30T15:21:51.840701+0000 mon.c (mon.2) 489 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:21:52.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:52 smithi072 bash[28946]: cluster 2024-03-30T15:21:52.517033+0000 mon.a (mon.0) 2999 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:21:52.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:52 smithi072 bash[28946]: audit 2024-03-30T15:21:52.519427+0000 mon.a (mon.0) 3000 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-100", "mode": "writeback"}]': finished 2024-03-30T15:21:52.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:52 smithi072 bash[28946]: cluster 2024-03-30T15:21:52.526436+0000 mon.a (mon.0) 3001 : cluster 0 osdmap e533: 8 total, 8 up, 8 in 2024-03-30T15:21:52.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:52 smithi072 bash[28946]: audit 2024-03-30T15:21:52.528536+0000 mon.a (mon.0) 3002 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-100","var": "hit_set_count","val": "2"}]: dispatch 2024-03-30T15:21:52.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:52 smithi172 bash[23680]: audit 2024-03-30T15:21:51.484505+0000 mgr.y (mgr.14526) 553 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:21:52.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:52 smithi172 bash[23680]: audit 2024-03-30T15:21:51.840701+0000 mon.c (mon.2) 489 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:21:52.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:52 smithi172 bash[23680]: cluster 2024-03-30T15:21:52.517033+0000 mon.a (mon.0) 2999 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:21:52.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:52 smithi172 bash[23680]: audit 2024-03-30T15:21:52.519427+0000 mon.a (mon.0) 3000 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-100", "mode": "writeback"}]': finished 2024-03-30T15:21:52.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:52 smithi172 bash[23680]: cluster 2024-03-30T15:21:52.526436+0000 mon.a (mon.0) 3001 : cluster 0 osdmap e533: 8 total, 8 up, 8 in 2024-03-30T15:21:52.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:52 smithi172 bash[23680]: audit 2024-03-30T15:21:52.528536+0000 mon.a (mon.0) 3002 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-100","var": "hit_set_count","val": "2"}]: dispatch 2024-03-30T15:21:53.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:53 smithi072 bash[21573]: cluster 2024-03-30T15:21:52.208879+0000 mgr.y (mgr.14526) 554 : cluster 0 pgmap v863: 228 pgs: 228 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:21:53.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:53 smithi072 bash[21573]: audit 2024-03-30T15:21:53.522061+0000 mon.a (mon.0) 3003 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-100","var": "hit_set_count","val": "2"}]': finished 2024-03-30T15:21:53.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:53 smithi072 bash[21573]: cluster 2024-03-30T15:21:53.529144+0000 mon.a (mon.0) 3004 : cluster 0 osdmap e534: 8 total, 8 up, 8 in 2024-03-30T15:21:53.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:53 smithi072 bash[21573]: audit 2024-03-30T15:21:53.531215+0000 mon.a (mon.0) 3005 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-100","var": "hit_set_period","val": "600"}]: dispatch 2024-03-30T15:21:53.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:53 smithi072 bash[28946]: cluster 2024-03-30T15:21:52.208879+0000 mgr.y (mgr.14526) 554 : cluster 0 pgmap v863: 228 pgs: 228 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:21:53.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:53 smithi072 bash[28946]: audit 2024-03-30T15:21:53.522061+0000 mon.a (mon.0) 3003 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-100","var": "hit_set_count","val": "2"}]': finished 2024-03-30T15:21:53.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:53 smithi072 bash[28946]: cluster 2024-03-30T15:21:53.529144+0000 mon.a (mon.0) 3004 : cluster 0 osdmap e534: 8 total, 8 up, 8 in 2024-03-30T15:21:53.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:53 smithi072 bash[28946]: audit 2024-03-30T15:21:53.531215+0000 mon.a (mon.0) 3005 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-100","var": "hit_set_period","val": "600"}]: dispatch 2024-03-30T15:21:53.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:53 smithi172 bash[23680]: cluster 2024-03-30T15:21:52.208879+0000 mgr.y (mgr.14526) 554 : cluster 0 pgmap v863: 228 pgs: 228 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:21:53.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:53 smithi172 bash[23680]: audit 2024-03-30T15:21:53.522061+0000 mon.a (mon.0) 3003 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-100","var": "hit_set_count","val": "2"}]': finished 2024-03-30T15:21:53.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:53 smithi172 bash[23680]: cluster 2024-03-30T15:21:53.529144+0000 mon.a (mon.0) 3004 : cluster 0 osdmap e534: 8 total, 8 up, 8 in 2024-03-30T15:21:53.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:53 smithi172 bash[23680]: audit 2024-03-30T15:21:53.531215+0000 mon.a (mon.0) 3005 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-100","var": "hit_set_period","val": "600"}]: dispatch 2024-03-30T15:21:55.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:55 smithi072 bash[21573]: cluster 2024-03-30T15:21:54.209677+0000 mgr.y (mgr.14526) 555 : cluster 0 pgmap v866: 228 pgs: 228 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:21:55.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:55 smithi072 bash[21573]: audit 2024-03-30T15:21:54.524995+0000 mon.a (mon.0) 3006 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-100","var": "hit_set_period","val": "600"}]': finished 2024-03-30T15:21:55.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:55 smithi072 bash[21573]: cluster 2024-03-30T15:21:54.532740+0000 mon.a (mon.0) 3007 : cluster 0 osdmap e535: 8 total, 8 up, 8 in 2024-03-30T15:21:55.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:55 smithi072 bash[21573]: audit 2024-03-30T15:21:54.534349+0000 mon.a (mon.0) 3008 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-03-30T15:21:55.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:55 smithi072 bash[28946]: cluster 2024-03-30T15:21:54.209677+0000 mgr.y (mgr.14526) 555 : cluster 0 pgmap v866: 228 pgs: 228 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:21:55.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:55 smithi072 bash[28946]: audit 2024-03-30T15:21:54.524995+0000 mon.a (mon.0) 3006 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-100","var": "hit_set_period","val": "600"}]': finished 2024-03-30T15:21:55.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:55 smithi072 bash[28946]: cluster 2024-03-30T15:21:54.532740+0000 mon.a (mon.0) 3007 : cluster 0 osdmap e535: 8 total, 8 up, 8 in 2024-03-30T15:21:55.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:55 smithi072 bash[28946]: audit 2024-03-30T15:21:54.534349+0000 mon.a (mon.0) 3008 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-03-30T15:21:55.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:55 smithi172 bash[23680]: cluster 2024-03-30T15:21:54.209677+0000 mgr.y (mgr.14526) 555 : cluster 0 pgmap v866: 228 pgs: 228 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:21:55.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:55 smithi172 bash[23680]: audit 2024-03-30T15:21:54.524995+0000 mon.a (mon.0) 3006 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-100","var": "hit_set_period","val": "600"}]': finished 2024-03-30T15:21:55.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:55 smithi172 bash[23680]: cluster 2024-03-30T15:21:54.532740+0000 mon.a (mon.0) 3007 : cluster 0 osdmap e535: 8 total, 8 up, 8 in 2024-03-30T15:21:55.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:55 smithi172 bash[23680]: audit 2024-03-30T15:21:54.534349+0000 mon.a (mon.0) 3008 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-03-30T15:21:56.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:56 smithi072 bash[21573]: cluster 2024-03-30T15:21:55.525193+0000 mon.a (mon.0) 3009 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:21:56.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:56 smithi072 bash[21573]: audit 2024-03-30T15:21:55.527450+0000 mon.a (mon.0) 3010 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-100","var": "hit_set_type","val": "explicit_object"}]': finished 2024-03-30T15:21:56.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:56 smithi072 bash[21573]: cluster 2024-03-30T15:21:55.535032+0000 mon.a (mon.0) 3011 : cluster 0 osdmap e536: 8 total, 8 up, 8 in 2024-03-30T15:21:56.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:56 smithi072 bash[21573]: audit 2024-03-30T15:21:55.536736+0000 mon.a (mon.0) 3012 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-03-30T15:21:56.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:56 smithi072 bash[21573]: audit 2024-03-30T15:21:56.530094+0000 mon.a (mon.0) 3013 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-100","var": "min_read_recency_for_promote","val": "10000"}]': finished 2024-03-30T15:21:56.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:56 smithi072 bash[28946]: cluster 2024-03-30T15:21:55.525193+0000 mon.a (mon.0) 3009 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:21:56.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:56 smithi072 bash[28946]: audit 2024-03-30T15:21:55.527450+0000 mon.a (mon.0) 3010 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-100","var": "hit_set_type","val": "explicit_object"}]': finished 2024-03-30T15:21:56.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:56 smithi072 bash[28946]: cluster 2024-03-30T15:21:55.535032+0000 mon.a (mon.0) 3011 : cluster 0 osdmap e536: 8 total, 8 up, 8 in 2024-03-30T15:21:56.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:56 smithi072 bash[28946]: audit 2024-03-30T15:21:55.536736+0000 mon.a (mon.0) 3012 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-03-30T15:21:56.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:56 smithi072 bash[28946]: audit 2024-03-30T15:21:56.530094+0000 mon.a (mon.0) 3013 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-100","var": "min_read_recency_for_promote","val": "10000"}]': finished 2024-03-30T15:21:56.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:56 smithi172 bash[23680]: cluster 2024-03-30T15:21:55.525193+0000 mon.a (mon.0) 3009 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:21:56.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:56 smithi172 bash[23680]: audit 2024-03-30T15:21:55.527450+0000 mon.a (mon.0) 3010 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-100","var": "hit_set_type","val": "explicit_object"}]': finished 2024-03-30T15:21:56.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:56 smithi172 bash[23680]: cluster 2024-03-30T15:21:55.535032+0000 mon.a (mon.0) 3011 : cluster 0 osdmap e536: 8 total, 8 up, 8 in 2024-03-30T15:21:56.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:56 smithi172 bash[23680]: audit 2024-03-30T15:21:55.536736+0000 mon.a (mon.0) 3012 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-03-30T15:21:56.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:56 smithi172 bash[23680]: audit 2024-03-30T15:21:56.530094+0000 mon.a (mon.0) 3013 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-100","var": "min_read_recency_for_promote","val": "10000"}]': finished 2024-03-30T15:21:57.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:57 smithi072 bash[21573]: cluster 2024-03-30T15:21:56.211788+0000 mgr.y (mgr.14526) 556 : cluster 0 pgmap v869: 228 pgs: 228 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:21:57.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:57 smithi072 bash[21573]: cluster 2024-03-30T15:21:56.537931+0000 mon.a (mon.0) 3014 : cluster 0 osdmap e537: 8 total, 8 up, 8 in 2024-03-30T15:21:57.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:57 smithi072 bash[21573]: audit 2024-03-30T15:21:56.613727+0000 mon.a (mon.0) 3015 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:21:57.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:57 smithi072 bash[28946]: cluster 2024-03-30T15:21:56.211788+0000 mgr.y (mgr.14526) 556 : cluster 0 pgmap v869: 228 pgs: 228 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:21:57.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:57 smithi072 bash[28946]: cluster 2024-03-30T15:21:56.537931+0000 mon.a (mon.0) 3014 : cluster 0 osdmap e537: 8 total, 8 up, 8 in 2024-03-30T15:21:57.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:57 smithi072 bash[28946]: audit 2024-03-30T15:21:56.613727+0000 mon.a (mon.0) 3015 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:21:57.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:57 smithi172 bash[23680]: cluster 2024-03-30T15:21:56.211788+0000 mgr.y (mgr.14526) 556 : cluster 0 pgmap v869: 228 pgs: 228 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:21:57.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:57 smithi172 bash[23680]: cluster 2024-03-30T15:21:56.537931+0000 mon.a (mon.0) 3014 : cluster 0 osdmap e537: 8 total, 8 up, 8 in 2024-03-30T15:21:57.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:57 smithi172 bash[23680]: audit 2024-03-30T15:21:56.613727+0000 mon.a (mon.0) 3015 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:21:58.917 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:58 smithi072 bash[28946]: audit 2024-03-30T15:21:57.557964+0000 mon.a (mon.0) 3016 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:21:58.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:58 smithi072 bash[28946]: cluster 2024-03-30T15:21:57.565844+0000 mon.a (mon.0) 3017 : cluster 0 osdmap e538: 8 total, 8 up, 8 in 2024-03-30T15:21:58.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:21:58 smithi072 bash[28946]: audit 2024-03-30T15:21:57.566894+0000 mon.a (mon.0) 3018 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-100"}]: dispatch 2024-03-30T15:21:58.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:58 smithi072 bash[21573]: audit 2024-03-30T15:21:57.557964+0000 mon.a (mon.0) 3016 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:21:58.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:58 smithi072 bash[21573]: cluster 2024-03-30T15:21:57.565844+0000 mon.a (mon.0) 3017 : cluster 0 osdmap e538: 8 total, 8 up, 8 in 2024-03-30T15:21:58.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:21:58 smithi072 bash[21573]: audit 2024-03-30T15:21:57.566894+0000 mon.a (mon.0) 3018 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-100"}]: dispatch 2024-03-30T15:21:58.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:58 smithi172 bash[23680]: audit 2024-03-30T15:21:57.557964+0000 mon.a (mon.0) 3016 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]': finished 2024-03-30T15:21:58.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:58 smithi172 bash[23680]: cluster 2024-03-30T15:21:57.565844+0000 mon.a (mon.0) 3017 : cluster 0 osdmap e538: 8 total, 8 up, 8 in 2024-03-30T15:21:58.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:21:58 smithi172 bash[23680]: audit 2024-03-30T15:21:57.566894+0000 mon.a (mon.0) 3018 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-100"}]: dispatch 2024-03-30T15:22:00.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:00 smithi072 bash[21573]: cluster 2024-03-30T15:21:58.212585+0000 mgr.y (mgr.14526) 557 : cluster 0 pgmap v872: 228 pgs: 228 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:22:00.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:00 smithi072 bash[21573]: audit 2024-03-30T15:21:58.566655+0000 mon.a (mon.0) 3019 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-100"}]': finished 2024-03-30T15:22:00.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:00 smithi072 bash[21573]: cluster 2024-03-30T15:21:58.575884+0000 mon.a (mon.0) 3020 : cluster 0 osdmap e539: 8 total, 8 up, 8 in 2024-03-30T15:22:00.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:00 smithi072 bash[28946]: cluster 2024-03-30T15:21:58.212585+0000 mgr.y (mgr.14526) 557 : cluster 0 pgmap v872: 228 pgs: 228 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:22:00.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:00 smithi072 bash[28946]: audit 2024-03-30T15:21:58.566655+0000 mon.a (mon.0) 3019 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-100"}]': finished 2024-03-30T15:22:00.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:00 smithi072 bash[28946]: cluster 2024-03-30T15:21:58.575884+0000 mon.a (mon.0) 3020 : cluster 0 osdmap e539: 8 total, 8 up, 8 in 2024-03-30T15:22:00.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:00 smithi172 bash[23680]: cluster 2024-03-30T15:21:58.212585+0000 mgr.y (mgr.14526) 557 : cluster 0 pgmap v872: 228 pgs: 228 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:22:00.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:00 smithi172 bash[23680]: audit 2024-03-30T15:21:58.566655+0000 mon.a (mon.0) 3019 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-100"}]': finished 2024-03-30T15:22:00.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:00 smithi172 bash[23680]: cluster 2024-03-30T15:21:58.575884+0000 mon.a (mon.0) 3020 : cluster 0 osdmap e539: 8 total, 8 up, 8 in 2024-03-30T15:22:01.417 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:22:01 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:22:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:22:01.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:01 smithi072 bash[21573]: cluster 2024-03-30T15:21:59.576882+0000 mon.a (mon.0) 3021 : cluster 0 osdmap e540: 8 total, 8 up, 8 in 2024-03-30T15:22:01.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:01 smithi072 bash[21573]: cluster 2024-03-30T15:22:00.213391+0000 mgr.y (mgr.14526) 558 : cluster 0 pgmap v875: 196 pgs: 196 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:22:01.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:01 smithi072 bash[21573]: cluster 2024-03-30T15:22:00.581114+0000 mon.a (mon.0) 3022 : cluster 0 osdmap e541: 8 total, 8 up, 8 in 2024-03-30T15:22:01.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:01 smithi072 bash[21573]: audit 2024-03-30T15:22:00.584806+0000 mon.a (mon.0) 3023 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:22:01.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:01 smithi072 bash[28946]: cluster 2024-03-30T15:21:59.576882+0000 mon.a (mon.0) 3021 : cluster 0 osdmap e540: 8 total, 8 up, 8 in 2024-03-30T15:22:01.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:01 smithi072 bash[28946]: cluster 2024-03-30T15:22:00.213391+0000 mgr.y (mgr.14526) 558 : cluster 0 pgmap v875: 196 pgs: 196 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:22:01.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:01 smithi072 bash[28946]: cluster 2024-03-30T15:22:00.581114+0000 mon.a (mon.0) 3022 : cluster 0 osdmap e541: 8 total, 8 up, 8 in 2024-03-30T15:22:01.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:01 smithi072 bash[28946]: audit 2024-03-30T15:22:00.584806+0000 mon.a (mon.0) 3023 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:22:01.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:01 smithi172 bash[23680]: cluster 2024-03-30T15:21:59.576882+0000 mon.a (mon.0) 3021 : cluster 0 osdmap e540: 8 total, 8 up, 8 in 2024-03-30T15:22:01.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:01 smithi172 bash[23680]: cluster 2024-03-30T15:22:00.213391+0000 mgr.y (mgr.14526) 558 : cluster 0 pgmap v875: 196 pgs: 196 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:22:01.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:01 smithi172 bash[23680]: cluster 2024-03-30T15:22:00.581114+0000 mon.a (mon.0) 3022 : cluster 0 osdmap e541: 8 total, 8 up, 8 in 2024-03-30T15:22:01.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:01 smithi172 bash[23680]: audit 2024-03-30T15:22:00.584806+0000 mon.a (mon.0) 3023 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:22:01.966 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:22:01 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:22:02.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:02 smithi072 bash[21573]: audit 2024-03-30T15:22:01.493238+0000 mgr.y (mgr.14526) 559 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:22:02.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:02 smithi072 bash[21573]: audit 2024-03-30T15:22:01.576253+0000 mon.a (mon.0) 3024 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-102","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:22:02.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:02 smithi072 bash[21573]: cluster 2024-03-30T15:22:01.591060+0000 mon.a (mon.0) 3025 : cluster 0 osdmap e542: 8 total, 8 up, 8 in 2024-03-30T15:22:02.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:02 smithi072 bash[21573]: audit 2024-03-30T15:22:01.595415+0000 mon.a (mon.0) 3026 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:22:02.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:02 smithi072 bash[21573]: audit 2024-03-30T15:22:01.611041+0000 mon.a (mon.0) 3027 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-102","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-30T15:22:02.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:02 smithi072 bash[28946]: audit 2024-03-30T15:22:01.493238+0000 mgr.y (mgr.14526) 559 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:22:02.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:02 smithi072 bash[28946]: audit 2024-03-30T15:22:01.576253+0000 mon.a (mon.0) 3024 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-102","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:22:02.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:02 smithi072 bash[28946]: cluster 2024-03-30T15:22:01.591060+0000 mon.a (mon.0) 3025 : cluster 0 osdmap e542: 8 total, 8 up, 8 in 2024-03-30T15:22:02.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:02 smithi072 bash[28946]: audit 2024-03-30T15:22:01.595415+0000 mon.a (mon.0) 3026 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:22:02.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:02 smithi072 bash[28946]: audit 2024-03-30T15:22:01.611041+0000 mon.a (mon.0) 3027 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-102","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-30T15:22:02.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:02 smithi172 bash[23680]: audit 2024-03-30T15:22:01.493238+0000 mgr.y (mgr.14526) 559 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:22:02.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:02 smithi172 bash[23680]: audit 2024-03-30T15:22:01.576253+0000 mon.a (mon.0) 3024 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-102","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:22:02.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:02 smithi172 bash[23680]: cluster 2024-03-30T15:22:01.591060+0000 mon.a (mon.0) 3025 : cluster 0 osdmap e542: 8 total, 8 up, 8 in 2024-03-30T15:22:02.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:02 smithi172 bash[23680]: audit 2024-03-30T15:22:01.595415+0000 mon.a (mon.0) 3026 : audit 0 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-03-30T15:22:02.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:02 smithi172 bash[23680]: audit 2024-03-30T15:22:01.611041+0000 mon.a (mon.0) 3027 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-102","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-03-30T15:22:03.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:03 smithi072 bash[21573]: cluster 2024-03-30T15:22:02.214219+0000 mgr.y (mgr.14526) 560 : cluster 0 pgmap v878: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 655 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:22:03.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:03 smithi072 bash[21573]: audit 2024-03-30T15:22:02.585325+0000 mon.a (mon.0) 3028 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-102","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-30T15:22:03.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:03 smithi072 bash[21573]: cluster 2024-03-30T15:22:02.595224+0000 mon.a (mon.0) 3029 : cluster 0 osdmap e543: 8 total, 8 up, 8 in 2024-03-30T15:22:03.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:03 smithi072 bash[21573]: audit 2024-03-30T15:22:02.596407+0000 mon.a (mon.0) 3030 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-03-30T15:22:03.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:03 smithi072 bash[28946]: cluster 2024-03-30T15:22:02.214219+0000 mgr.y (mgr.14526) 560 : cluster 0 pgmap v878: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 655 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:22:03.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:03 smithi072 bash[28946]: audit 2024-03-30T15:22:02.585325+0000 mon.a (mon.0) 3028 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-102","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-30T15:22:03.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:03 smithi072 bash[28946]: cluster 2024-03-30T15:22:02.595224+0000 mon.a (mon.0) 3029 : cluster 0 osdmap e543: 8 total, 8 up, 8 in 2024-03-30T15:22:03.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:03 smithi072 bash[28946]: audit 2024-03-30T15:22:02.596407+0000 mon.a (mon.0) 3030 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-03-30T15:22:03.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:03 smithi172 bash[23680]: cluster 2024-03-30T15:22:02.214219+0000 mgr.y (mgr.14526) 560 : cluster 0 pgmap v878: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 655 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:22:03.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:03 smithi172 bash[23680]: audit 2024-03-30T15:22:02.585325+0000 mon.a (mon.0) 3028 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-102","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-03-30T15:22:03.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:03 smithi172 bash[23680]: cluster 2024-03-30T15:22:02.595224+0000 mon.a (mon.0) 3029 : cluster 0 osdmap e543: 8 total, 8 up, 8 in 2024-03-30T15:22:03.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:03 smithi172 bash[23680]: audit 2024-03-30T15:22:02.596407+0000 mon.a (mon.0) 3030 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-03-30T15:22:04.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:04 smithi072 bash[21573]: audit 2024-03-30T15:22:03.596161+0000 mon.a (mon.0) 3031 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-03-30T15:22:04.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:04 smithi072 bash[21573]: cluster 2024-03-30T15:22:03.602785+0000 mon.a (mon.0) 3032 : cluster 0 osdmap e544: 8 total, 8 up, 8 in 2024-03-30T15:22:04.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:04 smithi072 bash[21573]: audit 2024-03-30T15:22:03.603727+0000 mon.a (mon.0) 3033 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-102","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-30T15:22:04.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:04 smithi072 bash[28946]: audit 2024-03-30T15:22:03.596161+0000 mon.a (mon.0) 3031 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-03-30T15:22:04.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:04 smithi072 bash[28946]: cluster 2024-03-30T15:22:03.602785+0000 mon.a (mon.0) 3032 : cluster 0 osdmap e544: 8 total, 8 up, 8 in 2024-03-30T15:22:04.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:04 smithi072 bash[28946]: audit 2024-03-30T15:22:03.603727+0000 mon.a (mon.0) 3033 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-102","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-30T15:22:04.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:04 smithi172 bash[23680]: audit 2024-03-30T15:22:03.596161+0000 mon.a (mon.0) 3031 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-03-30T15:22:04.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:04 smithi172 bash[23680]: cluster 2024-03-30T15:22:03.602785+0000 mon.a (mon.0) 3032 : cluster 0 osdmap e544: 8 total, 8 up, 8 in 2024-03-30T15:22:04.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:04 smithi172 bash[23680]: audit 2024-03-30T15:22:03.603727+0000 mon.a (mon.0) 3033 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-102","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-03-30T15:22:05.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:05 smithi072 bash[21573]: cluster 2024-03-30T15:22:04.215050+0000 mgr.y (mgr.14526) 561 : cluster 0 pgmap v881: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 655 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:22:05.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:05 smithi072 bash[21573]: audit 2024-03-30T15:22:04.598934+0000 mon.a (mon.0) 3034 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-102","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-03-30T15:22:05.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:05 smithi072 bash[21573]: cluster 2024-03-30T15:22:04.605979+0000 mon.a (mon.0) 3035 : cluster 0 osdmap e545: 8 total, 8 up, 8 in 2024-03-30T15:22:05.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:05 smithi072 bash[21573]: audit 2024-03-30T15:22:04.673612+0000 mon.a (mon.0) 3036 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:22:05.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:05 smithi072 bash[21573]: audit 2024-03-30T15:22:04.674505+0000 mon.a (mon.0) 3037 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-102"}]: dispatch 2024-03-30T15:22:05.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:05 smithi072 bash[28946]: cluster 2024-03-30T15:22:04.215050+0000 mgr.y (mgr.14526) 561 : cluster 0 pgmap v881: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 655 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:22:05.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:05 smithi072 bash[28946]: audit 2024-03-30T15:22:04.598934+0000 mon.a (mon.0) 3034 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-102","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-03-30T15:22:05.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:05 smithi072 bash[28946]: cluster 2024-03-30T15:22:04.605979+0000 mon.a (mon.0) 3035 : cluster 0 osdmap e545: 8 total, 8 up, 8 in 2024-03-30T15:22:05.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:05 smithi072 bash[28946]: audit 2024-03-30T15:22:04.673612+0000 mon.a (mon.0) 3036 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:22:05.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:05 smithi072 bash[28946]: audit 2024-03-30T15:22:04.674505+0000 mon.a (mon.0) 3037 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-102"}]: dispatch 2024-03-30T15:22:05.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:05 smithi172 bash[23680]: cluster 2024-03-30T15:22:04.215050+0000 mgr.y (mgr.14526) 561 : cluster 0 pgmap v881: 228 pgs: 32 creating+peering, 196 active+clean; 8.4 MiB data, 655 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:22:05.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:05 smithi172 bash[23680]: audit 2024-03-30T15:22:04.598934+0000 mon.a (mon.0) 3034 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-102","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-03-30T15:22:05.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:05 smithi172 bash[23680]: cluster 2024-03-30T15:22:04.605979+0000 mon.a (mon.0) 3035 : cluster 0 osdmap e545: 8 total, 8 up, 8 in 2024-03-30T15:22:05.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:05 smithi172 bash[23680]: audit 2024-03-30T15:22:04.673612+0000 mon.a (mon.0) 3036 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-6"}]: dispatch 2024-03-30T15:22:05.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:05 smithi172 bash[23680]: audit 2024-03-30T15:22:04.674505+0000 mon.a (mon.0) 3037 : audit 1 from='client.? 172.21.15.72:0/3319149585' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-6", "tierpool": "test-rados-api-smithi072-64344-102"}]: dispatch 2024-03-30T15:22:06.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:06 smithi072 bash[21573]: cluster 2024-03-30T15:22:05.622294+0000 mon.a (mon.0) 3038 : cluster 0 osdmap e546: 8 total, 8 up, 8 in 2024-03-30T15:22:06.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:06 smithi072 bash[21573]: cluster 2024-03-30T15:22:06.623615+0000 mon.a (mon.0) 3039 : cluster 0 osdmap e547: 8 total, 8 up, 8 in 2024-03-30T15:22:06.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:06 smithi072 bash[28946]: cluster 2024-03-30T15:22:05.622294+0000 mon.a (mon.0) 3038 : cluster 0 osdmap e546: 8 total, 8 up, 8 in 2024-03-30T15:22:06.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:06 smithi072 bash[28946]: cluster 2024-03-30T15:22:06.623615+0000 mon.a (mon.0) 3039 : cluster 0 osdmap e547: 8 total, 8 up, 8 in 2024-03-30T15:22:06.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:06 smithi172 bash[23680]: cluster 2024-03-30T15:22:05.622294+0000 mon.a (mon.0) 3038 : cluster 0 osdmap e546: 8 total, 8 up, 8 in 2024-03-30T15:22:06.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:06 smithi172 bash[23680]: cluster 2024-03-30T15:22:06.623615+0000 mon.a (mon.0) 3039 : cluster 0 osdmap e547: 8 total, 8 up, 8 in 2024-03-30T15:22:07.917 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:07 smithi072 bash[21573]: cluster 2024-03-30T15:22:06.216976+0000 mgr.y (mgr.14526) 562 : cluster 0 pgmap v884: 196 pgs: 196 active+clean; 8.4 MiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-30T15:22:07.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:07 smithi072 bash[21573]: audit 2024-03-30T15:22:06.681120+0000 mon.a (mon.0) 3040 : audit 1 from='client.? 172.21.15.72:0/3012464028' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi072-64344-104"}]: dispatch 2024-03-30T15:22:07.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:07 smithi072 bash[21573]: audit 2024-03-30T15:22:06.682573+0000 mon.a (mon.0) 3041 : audit 1 from='client.? 172.21.15.72:0/3012464028' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi072-64344-104"}]: dispatch 2024-03-30T15:22:07.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:07 smithi072 bash[21573]: audit 2024-03-30T15:22:06.683003+0000 mon.a (mon.0) 3042 : audit 1 from='client.? 172.21.15.72:0/3012464028' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi072-64344-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:22:07.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:07 smithi072 bash[21573]: audit 2024-03-30T15:22:06.873693+0000 mon.c (mon.2) 490 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:22:07.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:07 smithi072 bash[28946]: cluster 2024-03-30T15:22:06.216976+0000 mgr.y (mgr.14526) 562 : cluster 0 pgmap v884: 196 pgs: 196 active+clean; 8.4 MiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-30T15:22:07.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:07 smithi072 bash[28946]: audit 2024-03-30T15:22:06.681120+0000 mon.a (mon.0) 3040 : audit 1 from='client.? 172.21.15.72:0/3012464028' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi072-64344-104"}]: dispatch 2024-03-30T15:22:07.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:07 smithi072 bash[28946]: audit 2024-03-30T15:22:06.682573+0000 mon.a (mon.0) 3041 : audit 1 from='client.? 172.21.15.72:0/3012464028' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi072-64344-104"}]: dispatch 2024-03-30T15:22:07.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:07 smithi072 bash[28946]: audit 2024-03-30T15:22:06.683003+0000 mon.a (mon.0) 3042 : audit 1 from='client.? 172.21.15.72:0/3012464028' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi072-64344-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:22:07.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:07 smithi072 bash[28946]: audit 2024-03-30T15:22:06.873693+0000 mon.c (mon.2) 490 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:22:07.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:07 smithi172 bash[23680]: cluster 2024-03-30T15:22:06.216976+0000 mgr.y (mgr.14526) 562 : cluster 0 pgmap v884: 196 pgs: 196 active+clean; 8.4 MiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-30T15:22:07.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:07 smithi172 bash[23680]: audit 2024-03-30T15:22:06.681120+0000 mon.a (mon.0) 3040 : audit 1 from='client.? 172.21.15.72:0/3012464028' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi072-64344-104"}]: dispatch 2024-03-30T15:22:07.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:07 smithi172 bash[23680]: audit 2024-03-30T15:22:06.682573+0000 mon.a (mon.0) 3041 : audit 1 from='client.? 172.21.15.72:0/3012464028' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi072-64344-104"}]: dispatch 2024-03-30T15:22:07.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:07 smithi172 bash[23680]: audit 2024-03-30T15:22:06.683003+0000 mon.a (mon.0) 3042 : audit 1 from='client.? 172.21.15.72:0/3012464028' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi072-64344-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:22:07.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:07 smithi172 bash[23680]: audit 2024-03-30T15:22:06.873693+0000 mon.c (mon.2) 490 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:22:09.417 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:09 smithi072 bash[21573]: audit 2024-03-30T15:22:07.646704+0000 mon.a (mon.0) 3043 : audit 1 from='client.? 172.21.15.72:0/3012464028' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi072-64344-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:22:09.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:09 smithi072 bash[21573]: cluster 2024-03-30T15:22:07.652006+0000 mon.a (mon.0) 3044 : cluster 0 osdmap e548: 8 total, 8 up, 8 in 2024-03-30T15:22:09.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:09 smithi072 bash[21573]: audit 2024-03-30T15:22:07.652967+0000 mon.a (mon.0) 3045 : audit 1 from='client.? 172.21.15.72:0/3012464028' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi072-64344-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi072-64344-104"}]: dispatch 2024-03-30T15:22:09.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:09 smithi072 bash[28946]: audit 2024-03-30T15:22:07.646704+0000 mon.a (mon.0) 3043 : audit 1 from='client.? 172.21.15.72:0/3012464028' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi072-64344-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:22:09.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:09 smithi072 bash[28946]: cluster 2024-03-30T15:22:07.652006+0000 mon.a (mon.0) 3044 : cluster 0 osdmap e548: 8 total, 8 up, 8 in 2024-03-30T15:22:09.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:09 smithi072 bash[28946]: audit 2024-03-30T15:22:07.652967+0000 mon.a (mon.0) 3045 : audit 1 from='client.? 172.21.15.72:0/3012464028' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi072-64344-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi072-64344-104"}]: dispatch 2024-03-30T15:22:09.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:09 smithi172 bash[23680]: audit 2024-03-30T15:22:07.646704+0000 mon.a (mon.0) 3043 : audit 1 from='client.? 172.21.15.72:0/3012464028' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi072-64344-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:22:09.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:09 smithi172 bash[23680]: cluster 2024-03-30T15:22:07.652006+0000 mon.a (mon.0) 3044 : cluster 0 osdmap e548: 8 total, 8 up, 8 in 2024-03-30T15:22:09.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:09 smithi172 bash[23680]: audit 2024-03-30T15:22:07.652967+0000 mon.a (mon.0) 3045 : audit 1 from='client.? 172.21.15.72:0/3012464028' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi072-64344-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi072-64344-104"}]: dispatch 2024-03-30T15:22:10.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:10 smithi072 bash[28946]: cluster 2024-03-30T15:22:08.217861+0000 mgr.y (mgr.14526) 563 : cluster 0 pgmap v887: 164 pgs: 164 active+clean; 582 KiB data, 656 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:22:10.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:10 smithi072 bash[28946]: cluster 2024-03-30T15:22:09.101577+0000 mon.a (mon.0) 3046 : cluster 0 osdmap e549: 8 total, 8 up, 8 in 2024-03-30T15:22:10.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:10 smithi072 bash[28946]: audit 2024-03-30T15:22:09.653370+0000 mon.a (mon.0) 3047 : audit 1 from='client.? 172.21.15.72:0/3012464028' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi072-64344-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi072-64344-104"}]': finished 2024-03-30T15:22:10.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:10 smithi072 bash[28946]: cluster 2024-03-30T15:22:09.666631+0000 mon.a (mon.0) 3048 : cluster 0 osdmap e550: 8 total, 8 up, 8 in 2024-03-30T15:22:10.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:10 smithi072 bash[21573]: cluster 2024-03-30T15:22:08.217861+0000 mgr.y (mgr.14526) 563 : cluster 0 pgmap v887: 164 pgs: 164 active+clean; 582 KiB data, 656 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:22:10.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:10 smithi072 bash[21573]: cluster 2024-03-30T15:22:09.101577+0000 mon.a (mon.0) 3046 : cluster 0 osdmap e549: 8 total, 8 up, 8 in 2024-03-30T15:22:10.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:10 smithi072 bash[21573]: audit 2024-03-30T15:22:09.653370+0000 mon.a (mon.0) 3047 : audit 1 from='client.? 172.21.15.72:0/3012464028' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi072-64344-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi072-64344-104"}]': finished 2024-03-30T15:22:10.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:10 smithi072 bash[21573]: cluster 2024-03-30T15:22:09.666631+0000 mon.a (mon.0) 3048 : cluster 0 osdmap e550: 8 total, 8 up, 8 in 2024-03-30T15:22:10.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:10 smithi172 bash[23680]: cluster 2024-03-30T15:22:08.217861+0000 mgr.y (mgr.14526) 563 : cluster 0 pgmap v887: 164 pgs: 164 active+clean; 582 KiB data, 656 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:22:10.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:10 smithi172 bash[23680]: cluster 2024-03-30T15:22:09.101577+0000 mon.a (mon.0) 3046 : cluster 0 osdmap e549: 8 total, 8 up, 8 in 2024-03-30T15:22:10.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:10 smithi172 bash[23680]: audit 2024-03-30T15:22:09.653370+0000 mon.a (mon.0) 3047 : audit 1 from='client.? 172.21.15.72:0/3012464028' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi072-64344-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi072-64344-104"}]': finished 2024-03-30T15:22:10.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:10 smithi172 bash[23680]: cluster 2024-03-30T15:22:09.666631+0000 mon.a (mon.0) 3048 : cluster 0 osdmap e550: 8 total, 8 up, 8 in 2024-03-30T15:22:11.417 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:22:11 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:22:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:22:11.966 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:22:11 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:22:11.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:11 smithi172 bash[23680]: cluster 2024-03-30T15:22:10.218671+0000 mgr.y (mgr.14526) 564 : cluster 0 pgmap v890: 172 pgs: 8 unknown, 164 active+clean; 582 KiB data, 656 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:22:11.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:11 smithi172 bash[23680]: cluster 2024-03-30T15:22:10.664364+0000 mon.a (mon.0) 3049 : cluster 0 osdmap e551: 8 total, 8 up, 8 in 2024-03-30T15:22:11.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:11 smithi172 bash[23680]: cluster 2024-03-30T15:22:11.175515+0000 mon.a (mon.0) 3050 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:22:12.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:11 smithi072 bash[21573]: cluster 2024-03-30T15:22:10.218671+0000 mgr.y (mgr.14526) 564 : cluster 0 pgmap v890: 172 pgs: 8 unknown, 164 active+clean; 582 KiB data, 656 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:22:12.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:11 smithi072 bash[21573]: cluster 2024-03-30T15:22:10.664364+0000 mon.a (mon.0) 3049 : cluster 0 osdmap e551: 8 total, 8 up, 8 in 2024-03-30T15:22:12.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:11 smithi072 bash[21573]: cluster 2024-03-30T15:22:11.175515+0000 mon.a (mon.0) 3050 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:22:12.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:11 smithi072 bash[28946]: cluster 2024-03-30T15:22:10.218671+0000 mgr.y (mgr.14526) 564 : cluster 0 pgmap v890: 172 pgs: 8 unknown, 164 active+clean; 582 KiB data, 656 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:22:12.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:11 smithi072 bash[28946]: cluster 2024-03-30T15:22:10.664364+0000 mon.a (mon.0) 3049 : cluster 0 osdmap e551: 8 total, 8 up, 8 in 2024-03-30T15:22:12.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:11 smithi072 bash[28946]: cluster 2024-03-30T15:22:11.175515+0000 mon.a (mon.0) 3050 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:22:13.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:13 smithi072 bash[21573]: audit 2024-03-30T15:22:11.497331+0000 mgr.y (mgr.14526) 565 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:22:13.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:13 smithi072 bash[21573]: cluster 2024-03-30T15:22:11.668249+0000 mon.a (mon.0) 3051 : cluster 0 osdmap e552: 8 total, 8 up, 8 in 2024-03-30T15:22:13.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:13 smithi072 bash[21573]: audit 2024-03-30T15:22:11.677092+0000 mon.c (mon.2) 491 : audit 1 from='client.? 172.21.15.72:0/875360517' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:22:13.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:13 smithi072 bash[21573]: audit 2024-03-30T15:22:11.688396+0000 mon.a (mon.0) 3052 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:22:13.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:13 smithi072 bash[21573]: audit 2024-03-30T15:22:12.662920+0000 mon.a (mon.0) 3053 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-107","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:22:13.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:13 smithi072 bash[21573]: cluster 2024-03-30T15:22:12.671737+0000 mon.a (mon.0) 3054 : cluster 0 osdmap e553: 8 total, 8 up, 8 in 2024-03-30T15:22:13.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:13 smithi072 bash[28946]: audit 2024-03-30T15:22:11.497331+0000 mgr.y (mgr.14526) 565 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:22:13.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:13 smithi072 bash[28946]: cluster 2024-03-30T15:22:11.668249+0000 mon.a (mon.0) 3051 : cluster 0 osdmap e552: 8 total, 8 up, 8 in 2024-03-30T15:22:13.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:13 smithi072 bash[28946]: audit 2024-03-30T15:22:11.677092+0000 mon.c (mon.2) 491 : audit 1 from='client.? 172.21.15.72:0/875360517' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:22:13.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:13 smithi072 bash[28946]: audit 2024-03-30T15:22:11.688396+0000 mon.a (mon.0) 3052 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:22:13.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:13 smithi072 bash[28946]: audit 2024-03-30T15:22:12.662920+0000 mon.a (mon.0) 3053 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-107","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:22:13.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:13 smithi072 bash[28946]: cluster 2024-03-30T15:22:12.671737+0000 mon.a (mon.0) 3054 : cluster 0 osdmap e553: 8 total, 8 up, 8 in 2024-03-30T15:22:13.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:13 smithi172 bash[23680]: audit 2024-03-30T15:22:11.497331+0000 mgr.y (mgr.14526) 565 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:22:13.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:13 smithi172 bash[23680]: cluster 2024-03-30T15:22:11.668249+0000 mon.a (mon.0) 3051 : cluster 0 osdmap e552: 8 total, 8 up, 8 in 2024-03-30T15:22:13.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:13 smithi172 bash[23680]: audit 2024-03-30T15:22:11.677092+0000 mon.c (mon.2) 491 : audit 1 from='client.? 172.21.15.72:0/875360517' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:22:13.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:13 smithi172 bash[23680]: audit 2024-03-30T15:22:11.688396+0000 mon.a (mon.0) 3052 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:22:13.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:13 smithi172 bash[23680]: audit 2024-03-30T15:22:12.662920+0000 mon.a (mon.0) 3053 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-107","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:22:13.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:13 smithi172 bash[23680]: cluster 2024-03-30T15:22:12.671737+0000 mon.a (mon.0) 3054 : cluster 0 osdmap e553: 8 total, 8 up, 8 in 2024-03-30T15:22:14.417 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:14 smithi072 bash[28946]: cluster 2024-03-30T15:22:12.219449+0000 mgr.y (mgr.14526) 566 : cluster 0 pgmap v893: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:22:14.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:14 smithi072 bash[28946]: cluster 2024-03-30T15:22:13.679139+0000 mon.a (mon.0) 3055 : cluster 0 osdmap e554: 8 total, 8 up, 8 in 2024-03-30T15:22:14.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:14 smithi072 bash[28946]: audit 2024-03-30T15:22:13.682572+0000 mon.c (mon.2) 492 : audit 1 from='client.? 172.21.15.72:0/875360517' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:22:14.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:14 smithi072 bash[28946]: audit 2024-03-30T15:22:13.684765+0000 mon.a (mon.0) 3056 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:22:14.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:14 smithi072 bash[21573]: cluster 2024-03-30T15:22:12.219449+0000 mgr.y (mgr.14526) 566 : cluster 0 pgmap v893: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:22:14.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:14 smithi072 bash[21573]: cluster 2024-03-30T15:22:13.679139+0000 mon.a (mon.0) 3055 : cluster 0 osdmap e554: 8 total, 8 up, 8 in 2024-03-30T15:22:14.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:14 smithi072 bash[21573]: audit 2024-03-30T15:22:13.682572+0000 mon.c (mon.2) 492 : audit 1 from='client.? 172.21.15.72:0/875360517' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:22:14.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:14 smithi072 bash[21573]: audit 2024-03-30T15:22:13.684765+0000 mon.a (mon.0) 3056 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:22:14.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:14 smithi172 bash[23680]: cluster 2024-03-30T15:22:12.219449+0000 mgr.y (mgr.14526) 566 : cluster 0 pgmap v893: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:22:14.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:14 smithi172 bash[23680]: cluster 2024-03-30T15:22:13.679139+0000 mon.a (mon.0) 3055 : cluster 0 osdmap e554: 8 total, 8 up, 8 in 2024-03-30T15:22:14.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:14 smithi172 bash[23680]: audit 2024-03-30T15:22:13.682572+0000 mon.c (mon.2) 492 : audit 1 from='client.? 172.21.15.72:0/875360517' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:22:14.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:14 smithi172 bash[23680]: audit 2024-03-30T15:22:13.684765+0000 mon.a (mon.0) 3056 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:22:15.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:15 smithi172 bash[23680]: cluster 2024-03-30T15:22:14.220310+0000 mgr.y (mgr.14526) 567 : cluster 0 pgmap v896: 236 pgs: 64 unknown, 172 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:22:15.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:15 smithi172 bash[23680]: audit 2024-03-30T15:22:14.669729+0000 mon.a (mon.0) 3057 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-107-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:22:15.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:15 smithi172 bash[23680]: cluster 2024-03-30T15:22:14.678771+0000 mon.a (mon.0) 3058 : cluster 0 osdmap e555: 8 total, 8 up, 8 in 2024-03-30T15:22:15.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:15 smithi172 bash[23680]: audit 2024-03-30T15:22:14.683205+0000 mon.c (mon.2) 493 : audit 1 from='client.? 172.21.15.72:0/875360517' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-107", "tierpool": "test-rados-api-smithi072-64344-107-cache"}]: dispatch 2024-03-30T15:22:15.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:15 smithi172 bash[23680]: audit 2024-03-30T15:22:14.684493+0000 mon.a (mon.0) 3059 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-107", "tierpool": "test-rados-api-smithi072-64344-107-cache"}]: dispatch 2024-03-30T15:22:16.167 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:15 smithi072 bash[28946]: cluster 2024-03-30T15:22:14.220310+0000 mgr.y (mgr.14526) 567 : cluster 0 pgmap v896: 236 pgs: 64 unknown, 172 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:22:16.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:15 smithi072 bash[28946]: audit 2024-03-30T15:22:14.669729+0000 mon.a (mon.0) 3057 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-107-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:22:16.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:15 smithi072 bash[28946]: cluster 2024-03-30T15:22:14.678771+0000 mon.a (mon.0) 3058 : cluster 0 osdmap e555: 8 total, 8 up, 8 in 2024-03-30T15:22:16.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:15 smithi072 bash[28946]: audit 2024-03-30T15:22:14.683205+0000 mon.c (mon.2) 493 : audit 1 from='client.? 172.21.15.72:0/875360517' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-107", "tierpool": "test-rados-api-smithi072-64344-107-cache"}]: dispatch 2024-03-30T15:22:16.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:15 smithi072 bash[28946]: audit 2024-03-30T15:22:14.684493+0000 mon.a (mon.0) 3059 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-107", "tierpool": "test-rados-api-smithi072-64344-107-cache"}]: dispatch 2024-03-30T15:22:16.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:15 smithi072 bash[21573]: cluster 2024-03-30T15:22:14.220310+0000 mgr.y (mgr.14526) 567 : cluster 0 pgmap v896: 236 pgs: 64 unknown, 172 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:22:16.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:15 smithi072 bash[21573]: audit 2024-03-30T15:22:14.669729+0000 mon.a (mon.0) 3057 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-107-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:22:16.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:15 smithi072 bash[21573]: cluster 2024-03-30T15:22:14.678771+0000 mon.a (mon.0) 3058 : cluster 0 osdmap e555: 8 total, 8 up, 8 in 2024-03-30T15:22:16.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:15 smithi072 bash[21573]: audit 2024-03-30T15:22:14.683205+0000 mon.c (mon.2) 493 : audit 1 from='client.? 172.21.15.72:0/875360517' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-107", "tierpool": "test-rados-api-smithi072-64344-107-cache"}]: dispatch 2024-03-30T15:22:16.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:15 smithi072 bash[21573]: audit 2024-03-30T15:22:14.684493+0000 mon.a (mon.0) 3059 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-107", "tierpool": "test-rados-api-smithi072-64344-107-cache"}]: dispatch 2024-03-30T15:22:16.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:16 smithi172 bash[23680]: audit 2024-03-30T15:22:15.672409+0000 mon.a (mon.0) 3060 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-107", "tierpool": "test-rados-api-smithi072-64344-107-cache"}]': finished 2024-03-30T15:22:16.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:16 smithi172 bash[23680]: cluster 2024-03-30T15:22:15.679367+0000 mon.a (mon.0) 3061 : cluster 0 osdmap e556: 8 total, 8 up, 8 in 2024-03-30T15:22:16.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:16 smithi172 bash[23680]: audit 2024-03-30T15:22:15.680981+0000 mon.c (mon.2) 494 : audit 1 from='client.? 172.21.15.72:0/875360517' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-107", "overlaypool": "test-rados-api-smithi072-64344-107-cache"}]: dispatch 2024-03-30T15:22:16.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:16 smithi172 bash[23680]: audit 2024-03-30T15:22:15.683090+0000 mon.a (mon.0) 3062 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-107", "overlaypool": "test-rados-api-smithi072-64344-107-cache"}]: dispatch 2024-03-30T15:22:16.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:16 smithi172 bash[23680]: audit 2024-03-30T15:22:16.675223+0000 mon.a (mon.0) 3063 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-107", "overlaypool": "test-rados-api-smithi072-64344-107-cache"}]': finished 2024-03-30T15:22:16.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:16 smithi172 bash[23680]: cluster 2024-03-30T15:22:16.682452+0000 mon.a (mon.0) 3064 : cluster 0 osdmap e557: 8 total, 8 up, 8 in 2024-03-30T15:22:17.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:16 smithi072 bash[28946]: audit 2024-03-30T15:22:15.672409+0000 mon.a (mon.0) 3060 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-107", "tierpool": "test-rados-api-smithi072-64344-107-cache"}]': finished 2024-03-30T15:22:17.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:16 smithi072 bash[28946]: cluster 2024-03-30T15:22:15.679367+0000 mon.a (mon.0) 3061 : cluster 0 osdmap e556: 8 total, 8 up, 8 in 2024-03-30T15:22:17.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:16 smithi072 bash[28946]: audit 2024-03-30T15:22:15.680981+0000 mon.c (mon.2) 494 : audit 1 from='client.? 172.21.15.72:0/875360517' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-107", "overlaypool": "test-rados-api-smithi072-64344-107-cache"}]: dispatch 2024-03-30T15:22:17.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:16 smithi072 bash[28946]: audit 2024-03-30T15:22:15.683090+0000 mon.a (mon.0) 3062 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-107", "overlaypool": "test-rados-api-smithi072-64344-107-cache"}]: dispatch 2024-03-30T15:22:17.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:16 smithi072 bash[28946]: audit 2024-03-30T15:22:16.675223+0000 mon.a (mon.0) 3063 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-107", "overlaypool": "test-rados-api-smithi072-64344-107-cache"}]': finished 2024-03-30T15:22:17.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:16 smithi072 bash[28946]: cluster 2024-03-30T15:22:16.682452+0000 mon.a (mon.0) 3064 : cluster 0 osdmap e557: 8 total, 8 up, 8 in 2024-03-30T15:22:17.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:16 smithi072 bash[21573]: audit 2024-03-30T15:22:15.672409+0000 mon.a (mon.0) 3060 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-107", "tierpool": "test-rados-api-smithi072-64344-107-cache"}]': finished 2024-03-30T15:22:17.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:16 smithi072 bash[21573]: cluster 2024-03-30T15:22:15.679367+0000 mon.a (mon.0) 3061 : cluster 0 osdmap e556: 8 total, 8 up, 8 in 2024-03-30T15:22:17.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:16 smithi072 bash[21573]: audit 2024-03-30T15:22:15.680981+0000 mon.c (mon.2) 494 : audit 1 from='client.? 172.21.15.72:0/875360517' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-107", "overlaypool": "test-rados-api-smithi072-64344-107-cache"}]: dispatch 2024-03-30T15:22:17.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:16 smithi072 bash[21573]: audit 2024-03-30T15:22:15.683090+0000 mon.a (mon.0) 3062 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-107", "overlaypool": "test-rados-api-smithi072-64344-107-cache"}]: dispatch 2024-03-30T15:22:17.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:16 smithi072 bash[21573]: audit 2024-03-30T15:22:16.675223+0000 mon.a (mon.0) 3063 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-107", "overlaypool": "test-rados-api-smithi072-64344-107-cache"}]': finished 2024-03-30T15:22:17.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:16 smithi072 bash[21573]: cluster 2024-03-30T15:22:16.682452+0000 mon.a (mon.0) 3064 : cluster 0 osdmap e557: 8 total, 8 up, 8 in 2024-03-30T15:22:17.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:17 smithi172 bash[23680]: cluster 2024-03-30T15:22:16.222441+0000 mgr.y (mgr.14526) 568 : cluster 0 pgmap v899: 236 pgs: 236 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:22:17.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:17 smithi172 bash[23680]: audit 2024-03-30T15:22:16.683782+0000 mon.c (mon.2) 495 : audit 1 from='client.? 172.21.15.72:0/875360517' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-107-cache", "mode": "writeback"}]: dispatch 2024-03-30T15:22:17.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:17 smithi172 bash[23680]: cluster 2024-03-30T15:22:16.684847+0000 mon.a (mon.0) 3065 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:22:17.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:17 smithi172 bash[23680]: audit 2024-03-30T15:22:16.685563+0000 mon.a (mon.0) 3066 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-107-cache", "mode": "writeback"}]: dispatch 2024-03-30T15:22:17.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:17 smithi172 bash[23680]: cluster 2024-03-30T15:22:17.675596+0000 mon.a (mon.0) 3067 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:22:17.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:17 smithi172 bash[23680]: audit 2024-03-30T15:22:17.677952+0000 mon.a (mon.0) 3068 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-107-cache", "mode": "writeback"}]': finished 2024-03-30T15:22:17.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:17 smithi172 bash[23680]: cluster 2024-03-30T15:22:17.685245+0000 mon.a (mon.0) 3069 : cluster 0 osdmap e558: 8 total, 8 up, 8 in 2024-03-30T15:22:18.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:17 smithi072 bash[21573]: cluster 2024-03-30T15:22:16.222441+0000 mgr.y (mgr.14526) 568 : cluster 0 pgmap v899: 236 pgs: 236 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:22:18.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:17 smithi072 bash[21573]: audit 2024-03-30T15:22:16.683782+0000 mon.c (mon.2) 495 : audit 1 from='client.? 172.21.15.72:0/875360517' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-107-cache", "mode": "writeback"}]: dispatch 2024-03-30T15:22:18.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:17 smithi072 bash[21573]: cluster 2024-03-30T15:22:16.684847+0000 mon.a (mon.0) 3065 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:22:18.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:17 smithi072 bash[21573]: audit 2024-03-30T15:22:16.685563+0000 mon.a (mon.0) 3066 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-107-cache", "mode": "writeback"}]: dispatch 2024-03-30T15:22:18.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:17 smithi072 bash[21573]: cluster 2024-03-30T15:22:17.675596+0000 mon.a (mon.0) 3067 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:22:18.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:17 smithi072 bash[21573]: audit 2024-03-30T15:22:17.677952+0000 mon.a (mon.0) 3068 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-107-cache", "mode": "writeback"}]': finished 2024-03-30T15:22:18.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:17 smithi072 bash[21573]: cluster 2024-03-30T15:22:17.685245+0000 mon.a (mon.0) 3069 : cluster 0 osdmap e558: 8 total, 8 up, 8 in 2024-03-30T15:22:18.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:17 smithi072 bash[28946]: cluster 2024-03-30T15:22:16.222441+0000 mgr.y (mgr.14526) 568 : cluster 0 pgmap v899: 236 pgs: 236 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:22:18.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:17 smithi072 bash[28946]: audit 2024-03-30T15:22:16.683782+0000 mon.c (mon.2) 495 : audit 1 from='client.? 172.21.15.72:0/875360517' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-107-cache", "mode": "writeback"}]: dispatch 2024-03-30T15:22:18.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:17 smithi072 bash[28946]: cluster 2024-03-30T15:22:16.684847+0000 mon.a (mon.0) 3065 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:22:18.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:17 smithi072 bash[28946]: audit 2024-03-30T15:22:16.685563+0000 mon.a (mon.0) 3066 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-107-cache", "mode": "writeback"}]: dispatch 2024-03-30T15:22:18.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:17 smithi072 bash[28946]: cluster 2024-03-30T15:22:17.675596+0000 mon.a (mon.0) 3067 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:22:18.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:17 smithi072 bash[28946]: audit 2024-03-30T15:22:17.677952+0000 mon.a (mon.0) 3068 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-107-cache", "mode": "writeback"}]': finished 2024-03-30T15:22:18.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:17 smithi072 bash[28946]: cluster 2024-03-30T15:22:17.685245+0000 mon.a (mon.0) 3069 : cluster 0 osdmap e558: 8 total, 8 up, 8 in 2024-03-30T15:22:18.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:18 smithi172 bash[23680]: audit 2024-03-30T15:22:17.714629+0000 mon.c (mon.2) 496 : audit 1 from='client.? 172.21.15.72:0/875360517' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-107"}]: dispatch 2024-03-30T15:22:18.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:18 smithi172 bash[23680]: audit 2024-03-30T15:22:17.715137+0000 mon.a (mon.0) 3070 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-107"}]: dispatch 2024-03-30T15:22:19.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:18 smithi072 bash[21573]: audit 2024-03-30T15:22:17.714629+0000 mon.c (mon.2) 496 : audit 1 from='client.? 172.21.15.72:0/875360517' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-107"}]: dispatch 2024-03-30T15:22:19.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:18 smithi072 bash[21573]: audit 2024-03-30T15:22:17.715137+0000 mon.a (mon.0) 3070 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-107"}]: dispatch 2024-03-30T15:22:19.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:18 smithi072 bash[28946]: audit 2024-03-30T15:22:17.714629+0000 mon.c (mon.2) 496 : audit 1 from='client.? 172.21.15.72:0/875360517' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-107"}]: dispatch 2024-03-30T15:22:19.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:18 smithi072 bash[28946]: audit 2024-03-30T15:22:17.715137+0000 mon.a (mon.0) 3070 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-107"}]: dispatch 2024-03-30T15:22:19.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:19 smithi172 bash[23680]: cluster 2024-03-30T15:22:18.223278+0000 mgr.y (mgr.14526) 569 : cluster 0 pgmap v902: 236 pgs: 236 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:22:19.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:19 smithi172 bash[23680]: audit 2024-03-30T15:22:18.702287+0000 mon.a (mon.0) 3071 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-107"}]': finished 2024-03-30T15:22:19.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:19 smithi172 bash[23680]: cluster 2024-03-30T15:22:18.709423+0000 mon.a (mon.0) 3072 : cluster 0 osdmap e559: 8 total, 8 up, 8 in 2024-03-30T15:22:19.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:19 smithi172 bash[23680]: audit 2024-03-30T15:22:18.712719+0000 mon.c (mon.2) 497 : audit 1 from='client.? 172.21.15.72:0/875360517' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-107", "tierpool": "test-rados-api-smithi072-64344-107-cache"}]: dispatch 2024-03-30T15:22:19.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:19 smithi172 bash[23680]: audit 2024-03-30T15:22:18.717153+0000 mon.a (mon.0) 3073 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-107", "tierpool": "test-rados-api-smithi072-64344-107-cache"}]: dispatch 2024-03-30T15:22:20.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:19 smithi072 bash[21573]: cluster 2024-03-30T15:22:18.223278+0000 mgr.y (mgr.14526) 569 : cluster 0 pgmap v902: 236 pgs: 236 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:22:20.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:19 smithi072 bash[21573]: audit 2024-03-30T15:22:18.702287+0000 mon.a (mon.0) 3071 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-107"}]': finished 2024-03-30T15:22:20.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:19 smithi072 bash[21573]: cluster 2024-03-30T15:22:18.709423+0000 mon.a (mon.0) 3072 : cluster 0 osdmap e559: 8 total, 8 up, 8 in 2024-03-30T15:22:20.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:19 smithi072 bash[21573]: audit 2024-03-30T15:22:18.712719+0000 mon.c (mon.2) 497 : audit 1 from='client.? 172.21.15.72:0/875360517' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-107", "tierpool": "test-rados-api-smithi072-64344-107-cache"}]: dispatch 2024-03-30T15:22:20.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:19 smithi072 bash[21573]: audit 2024-03-30T15:22:18.717153+0000 mon.a (mon.0) 3073 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-107", "tierpool": "test-rados-api-smithi072-64344-107-cache"}]: dispatch 2024-03-30T15:22:20.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:19 smithi072 bash[28946]: cluster 2024-03-30T15:22:18.223278+0000 mgr.y (mgr.14526) 569 : cluster 0 pgmap v902: 236 pgs: 236 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:22:20.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:19 smithi072 bash[28946]: audit 2024-03-30T15:22:18.702287+0000 mon.a (mon.0) 3071 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-107"}]': finished 2024-03-30T15:22:20.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:19 smithi072 bash[28946]: cluster 2024-03-30T15:22:18.709423+0000 mon.a (mon.0) 3072 : cluster 0 osdmap e559: 8 total, 8 up, 8 in 2024-03-30T15:22:20.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:19 smithi072 bash[28946]: audit 2024-03-30T15:22:18.712719+0000 mon.c (mon.2) 497 : audit 1 from='client.? 172.21.15.72:0/875360517' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-107", "tierpool": "test-rados-api-smithi072-64344-107-cache"}]: dispatch 2024-03-30T15:22:20.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:19 smithi072 bash[28946]: audit 2024-03-30T15:22:18.717153+0000 mon.a (mon.0) 3073 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-107", "tierpool": "test-rados-api-smithi072-64344-107-cache"}]: dispatch 2024-03-30T15:22:21.030 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:20 smithi072 bash[21573]: cluster 2024-03-30T15:22:19.702745+0000 mon.a (mon.0) 3074 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:22:21.031 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:20 smithi072 bash[21573]: audit 2024-03-30T15:22:19.704959+0000 mon.a (mon.0) 3075 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-107", "tierpool": "test-rados-api-smithi072-64344-107-cache"}]': finished 2024-03-30T15:22:21.031 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:20 smithi072 bash[21573]: cluster 2024-03-30T15:22:19.712565+0000 mon.a (mon.0) 3076 : cluster 0 osdmap e560: 8 total, 8 up, 8 in 2024-03-30T15:22:21.031 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:20 smithi072 bash[28946]: cluster 2024-03-30T15:22:19.702745+0000 mon.a (mon.0) 3074 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:22:21.031 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:20 smithi072 bash[28946]: audit 2024-03-30T15:22:19.704959+0000 mon.a (mon.0) 3075 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-107", "tierpool": "test-rados-api-smithi072-64344-107-cache"}]': finished 2024-03-30T15:22:21.031 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:20 smithi072 bash[28946]: cluster 2024-03-30T15:22:19.712565+0000 mon.a (mon.0) 3076 : cluster 0 osdmap e560: 8 total, 8 up, 8 in 2024-03-30T15:22:21.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:20 smithi172 bash[23680]: cluster 2024-03-30T15:22:19.702745+0000 mon.a (mon.0) 3074 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:22:21.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:20 smithi172 bash[23680]: audit 2024-03-30T15:22:19.704959+0000 mon.a (mon.0) 3075 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-107", "tierpool": "test-rados-api-smithi072-64344-107-cache"}]': finished 2024-03-30T15:22:21.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:20 smithi172 bash[23680]: cluster 2024-03-30T15:22:19.712565+0000 mon.a (mon.0) 3076 : cluster 0 osdmap e560: 8 total, 8 up, 8 in 2024-03-30T15:22:21.417 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:22:21 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:22:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:22:21.966 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:22:21 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:22:21.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:21 smithi172 bash[23680]: cluster 2024-03-30T15:22:20.224080+0000 mgr.y (mgr.14526) 570 : cluster 0 pgmap v905: 236 pgs: 236 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:22:21.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:21 smithi172 bash[23680]: cluster 2024-03-30T15:22:20.735508+0000 mon.a (mon.0) 3077 : cluster 0 osdmap e561: 8 total, 8 up, 8 in 2024-03-30T15:22:22.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:21 smithi072 bash[21573]: cluster 2024-03-30T15:22:20.224080+0000 mgr.y (mgr.14526) 570 : cluster 0 pgmap v905: 236 pgs: 236 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:22:22.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:21 smithi072 bash[21573]: cluster 2024-03-30T15:22:20.735508+0000 mon.a (mon.0) 3077 : cluster 0 osdmap e561: 8 total, 8 up, 8 in 2024-03-30T15:22:22.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:21 smithi072 bash[28946]: cluster 2024-03-30T15:22:20.224080+0000 mgr.y (mgr.14526) 570 : cluster 0 pgmap v905: 236 pgs: 236 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:22:22.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:21 smithi072 bash[28946]: cluster 2024-03-30T15:22:20.735508+0000 mon.a (mon.0) 3077 : cluster 0 osdmap e561: 8 total, 8 up, 8 in 2024-03-30T15:22:23.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:22 smithi072 bash[21573]: audit 2024-03-30T15:22:21.499837+0000 mgr.y (mgr.14526) 571 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:22:23.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:22 smithi072 bash[21573]: cluster 2024-03-30T15:22:21.734095+0000 mon.a (mon.0) 3078 : cluster 0 osdmap e562: 8 total, 8 up, 8 in 2024-03-30T15:22:23.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:22 smithi072 bash[21573]: audit 2024-03-30T15:22:21.768514+0000 mon.a (mon.0) 3079 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi072-64344-109"}]: dispatch 2024-03-30T15:22:23.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:22 smithi072 bash[21573]: audit 2024-03-30T15:22:21.769614+0000 mon.a (mon.0) 3080 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi072-64344-109"}]: dispatch 2024-03-30T15:22:23.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:22 smithi072 bash[21573]: audit 2024-03-30T15:22:21.770067+0000 mon.a (mon.0) 3081 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi072-64344-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:22:23.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:22 smithi072 bash[21573]: audit 2024-03-30T15:22:21.906867+0000 mon.c (mon.2) 498 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:22:23.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:22 smithi072 bash[28946]: audit 2024-03-30T15:22:21.499837+0000 mgr.y (mgr.14526) 571 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:22:23.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:22 smithi072 bash[28946]: cluster 2024-03-30T15:22:21.734095+0000 mon.a (mon.0) 3078 : cluster 0 osdmap e562: 8 total, 8 up, 8 in 2024-03-30T15:22:23.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:22 smithi072 bash[28946]: audit 2024-03-30T15:22:21.768514+0000 mon.a (mon.0) 3079 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi072-64344-109"}]: dispatch 2024-03-30T15:22:23.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:22 smithi072 bash[28946]: audit 2024-03-30T15:22:21.769614+0000 mon.a (mon.0) 3080 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi072-64344-109"}]: dispatch 2024-03-30T15:22:23.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:22 smithi072 bash[28946]: audit 2024-03-30T15:22:21.770067+0000 mon.a (mon.0) 3081 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi072-64344-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:22:23.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:22 smithi072 bash[28946]: audit 2024-03-30T15:22:21.906867+0000 mon.c (mon.2) 498 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:22:23.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:22 smithi172 bash[23680]: audit 2024-03-30T15:22:21.499837+0000 mgr.y (mgr.14526) 571 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:22:23.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:22 smithi172 bash[23680]: cluster 2024-03-30T15:22:21.734095+0000 mon.a (mon.0) 3078 : cluster 0 osdmap e562: 8 total, 8 up, 8 in 2024-03-30T15:22:23.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:22 smithi172 bash[23680]: audit 2024-03-30T15:22:21.768514+0000 mon.a (mon.0) 3079 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi072-64344-109"}]: dispatch 2024-03-30T15:22:23.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:22 smithi172 bash[23680]: audit 2024-03-30T15:22:21.769614+0000 mon.a (mon.0) 3080 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi072-64344-109"}]: dispatch 2024-03-30T15:22:23.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:22 smithi172 bash[23680]: audit 2024-03-30T15:22:21.770067+0000 mon.a (mon.0) 3081 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi072-64344-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:22:23.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:22 smithi172 bash[23680]: audit 2024-03-30T15:22:21.906867+0000 mon.c (mon.2) 498 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:22:24.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:23 smithi072 bash[21573]: cluster 2024-03-30T15:22:22.224900+0000 mgr.y (mgr.14526) 572 : cluster 0 pgmap v908: 172 pgs: 172 active+clean; 582 KiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:22:24.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:23 smithi072 bash[21573]: audit 2024-03-30T15:22:22.753999+0000 mon.a (mon.0) 3082 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi072-64344-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:22:24.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:23 smithi072 bash[21573]: cluster 2024-03-30T15:22:22.759608+0000 mon.a (mon.0) 3083 : cluster 0 osdmap e563: 8 total, 8 up, 8 in 2024-03-30T15:22:24.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:23 smithi072 bash[21573]: audit 2024-03-30T15:22:22.760704+0000 mon.a (mon.0) 3084 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi072-64344-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi072-64344-109"}]: dispatch 2024-03-30T15:22:24.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:23 smithi072 bash[21573]: audit 2024-03-30T15:22:22.941548+0000 mon.c (mon.2) 499 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:22:24.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:23 smithi072 bash[21573]: audit 2024-03-30T15:22:23.623372+0000 mon.c (mon.2) 500 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:22:24.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:23 smithi072 bash[21573]: audit 2024-03-30T15:22:23.624866+0000 mon.c (mon.2) 501 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:22:24.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:23 smithi072 bash[21573]: audit 2024-03-30T15:22:23.632563+0000 mon.a (mon.0) 3085 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:22:24.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:23 smithi072 bash[28946]: cluster 2024-03-30T15:22:22.224900+0000 mgr.y (mgr.14526) 572 : cluster 0 pgmap v908: 172 pgs: 172 active+clean; 582 KiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:22:24.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:23 smithi072 bash[28946]: audit 2024-03-30T15:22:22.753999+0000 mon.a (mon.0) 3082 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi072-64344-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:22:24.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:23 smithi072 bash[28946]: cluster 2024-03-30T15:22:22.759608+0000 mon.a (mon.0) 3083 : cluster 0 osdmap e563: 8 total, 8 up, 8 in 2024-03-30T15:22:24.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:23 smithi072 bash[28946]: audit 2024-03-30T15:22:22.760704+0000 mon.a (mon.0) 3084 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi072-64344-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi072-64344-109"}]: dispatch 2024-03-30T15:22:24.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:23 smithi072 bash[28946]: audit 2024-03-30T15:22:22.941548+0000 mon.c (mon.2) 499 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:22:24.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:23 smithi072 bash[28946]: audit 2024-03-30T15:22:23.623372+0000 mon.c (mon.2) 500 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:22:24.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:23 smithi072 bash[28946]: audit 2024-03-30T15:22:23.624866+0000 mon.c (mon.2) 501 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:22:24.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:23 smithi072 bash[28946]: audit 2024-03-30T15:22:23.632563+0000 mon.a (mon.0) 3085 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:22:24.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:23 smithi172 bash[23680]: cluster 2024-03-30T15:22:22.224900+0000 mgr.y (mgr.14526) 572 : cluster 0 pgmap v908: 172 pgs: 172 active+clean; 582 KiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:22:24.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:23 smithi172 bash[23680]: audit 2024-03-30T15:22:22.753999+0000 mon.a (mon.0) 3082 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi072-64344-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:22:24.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:23 smithi172 bash[23680]: cluster 2024-03-30T15:22:22.759608+0000 mon.a (mon.0) 3083 : cluster 0 osdmap e563: 8 total, 8 up, 8 in 2024-03-30T15:22:24.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:23 smithi172 bash[23680]: audit 2024-03-30T15:22:22.760704+0000 mon.a (mon.0) 3084 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi072-64344-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi072-64344-109"}]: dispatch 2024-03-30T15:22:24.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:23 smithi172 bash[23680]: audit 2024-03-30T15:22:22.941548+0000 mon.c (mon.2) 499 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:22:24.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:23 smithi172 bash[23680]: audit 2024-03-30T15:22:23.623372+0000 mon.c (mon.2) 500 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:22:24.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:23 smithi172 bash[23680]: audit 2024-03-30T15:22:23.624866+0000 mon.c (mon.2) 501 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:22:24.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:23 smithi172 bash[23680]: audit 2024-03-30T15:22:23.632563+0000 mon.a (mon.0) 3085 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:22:25.167 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:24 smithi072 bash[21573]: cluster 2024-03-30T15:22:24.225184+0000 mon.a (mon.0) 3086 : cluster 0 osdmap e564: 8 total, 8 up, 8 in 2024-03-30T15:22:25.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:24 smithi072 bash[28946]: cluster 2024-03-30T15:22:24.225184+0000 mon.a (mon.0) 3086 : cluster 0 osdmap e564: 8 total, 8 up, 8 in 2024-03-30T15:22:25.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:24 smithi172 bash[23680]: cluster 2024-03-30T15:22:24.225184+0000 mon.a (mon.0) 3086 : cluster 0 osdmap e564: 8 total, 8 up, 8 in 2024-03-30T15:22:26.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:25 smithi072 bash[28946]: cluster 2024-03-30T15:22:24.225513+0000 mgr.y (mgr.14526) 573 : cluster 0 pgmap v911: 172 pgs: 172 active+clean; 582 KiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:22:26.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:25 smithi072 bash[28946]: audit 2024-03-30T15:22:24.782118+0000 mon.a (mon.0) 3087 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi072-64344-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi072-64344-109"}]': finished 2024-03-30T15:22:26.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:25 smithi072 bash[28946]: cluster 2024-03-30T15:22:24.787506+0000 mon.a (mon.0) 3088 : cluster 0 osdmap e565: 8 total, 8 up, 8 in 2024-03-30T15:22:26.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:25 smithi072 bash[21573]: cluster 2024-03-30T15:22:24.225513+0000 mgr.y (mgr.14526) 573 : cluster 0 pgmap v911: 172 pgs: 172 active+clean; 582 KiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:22:26.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:25 smithi072 bash[21573]: audit 2024-03-30T15:22:24.782118+0000 mon.a (mon.0) 3087 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi072-64344-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi072-64344-109"}]': finished 2024-03-30T15:22:26.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:25 smithi072 bash[21573]: cluster 2024-03-30T15:22:24.787506+0000 mon.a (mon.0) 3088 : cluster 0 osdmap e565: 8 total, 8 up, 8 in 2024-03-30T15:22:26.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:25 smithi172 bash[23680]: cluster 2024-03-30T15:22:24.225513+0000 mgr.y (mgr.14526) 573 : cluster 0 pgmap v911: 172 pgs: 172 active+clean; 582 KiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:22:26.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:25 smithi172 bash[23680]: audit 2024-03-30T15:22:24.782118+0000 mon.a (mon.0) 3087 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi072-64344-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi072-64344-109"}]': finished 2024-03-30T15:22:26.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:25 smithi172 bash[23680]: cluster 2024-03-30T15:22:24.787506+0000 mon.a (mon.0) 3088 : cluster 0 osdmap e565: 8 total, 8 up, 8 in 2024-03-30T15:22:27.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:26 smithi072 bash[21573]: cluster 2024-03-30T15:22:25.797548+0000 mon.a (mon.0) 3089 : cluster 0 osdmap e566: 8 total, 8 up, 8 in 2024-03-30T15:22:27.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:26 smithi072 bash[21573]: audit 2024-03-30T15:22:25.806460+0000 mon.a (mon.0) 3090 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-109-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:22:27.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:26 smithi072 bash[21573]: cluster 2024-03-30T15:22:26.227502+0000 mgr.y (mgr.14526) 574 : cluster 0 pgmap v914: 212 pgs: 32 creating+peering, 180 active+clean; 582 KiB data, 637 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:22:27.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:26 smithi072 bash[21573]: audit 2024-03-30T15:22:26.789739+0000 mon.a (mon.0) 3091 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-109-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:22:27.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:26 smithi072 bash[21573]: cluster 2024-03-30T15:22:26.797393+0000 mon.a (mon.0) 3092 : cluster 0 osdmap e567: 8 total, 8 up, 8 in 2024-03-30T15:22:27.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:26 smithi072 bash[21573]: audit 2024-03-30T15:22:26.801712+0000 mon.a (mon.0) 3093 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-109", "tierpool": "test-rados-api-smithi072-64344-109-cache"}]: dispatch 2024-03-30T15:22:27.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:26 smithi072 bash[28946]: cluster 2024-03-30T15:22:25.797548+0000 mon.a (mon.0) 3089 : cluster 0 osdmap e566: 8 total, 8 up, 8 in 2024-03-30T15:22:27.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:26 smithi072 bash[28946]: audit 2024-03-30T15:22:25.806460+0000 mon.a (mon.0) 3090 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-109-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:22:27.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:26 smithi072 bash[28946]: cluster 2024-03-30T15:22:26.227502+0000 mgr.y (mgr.14526) 574 : cluster 0 pgmap v914: 212 pgs: 32 creating+peering, 180 active+clean; 582 KiB data, 637 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:22:27.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:26 smithi072 bash[28946]: audit 2024-03-30T15:22:26.789739+0000 mon.a (mon.0) 3091 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-109-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:22:27.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:26 smithi072 bash[28946]: cluster 2024-03-30T15:22:26.797393+0000 mon.a (mon.0) 3092 : cluster 0 osdmap e567: 8 total, 8 up, 8 in 2024-03-30T15:22:27.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:26 smithi072 bash[28946]: audit 2024-03-30T15:22:26.801712+0000 mon.a (mon.0) 3093 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-109", "tierpool": "test-rados-api-smithi072-64344-109-cache"}]: dispatch 2024-03-30T15:22:27.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:26 smithi172 bash[23680]: cluster 2024-03-30T15:22:25.797548+0000 mon.a (mon.0) 3089 : cluster 0 osdmap e566: 8 total, 8 up, 8 in 2024-03-30T15:22:27.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:26 smithi172 bash[23680]: audit 2024-03-30T15:22:25.806460+0000 mon.a (mon.0) 3090 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-109-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:22:27.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:26 smithi172 bash[23680]: cluster 2024-03-30T15:22:26.227502+0000 mgr.y (mgr.14526) 574 : cluster 0 pgmap v914: 212 pgs: 32 creating+peering, 180 active+clean; 582 KiB data, 637 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:22:27.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:26 smithi172 bash[23680]: audit 2024-03-30T15:22:26.789739+0000 mon.a (mon.0) 3091 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-109-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:22:27.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:26 smithi172 bash[23680]: cluster 2024-03-30T15:22:26.797393+0000 mon.a (mon.0) 3092 : cluster 0 osdmap e567: 8 total, 8 up, 8 in 2024-03-30T15:22:27.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:26 smithi172 bash[23680]: audit 2024-03-30T15:22:26.801712+0000 mon.a (mon.0) 3093 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-109", "tierpool": "test-rados-api-smithi072-64344-109-cache"}]: dispatch 2024-03-30T15:22:28.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:27 smithi072 bash[21573]: cluster 2024-03-30T15:22:26.812723+0000 mon.a (mon.0) 3094 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:22:28.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:27 smithi072 bash[21573]: audit 2024-03-30T15:22:27.792647+0000 mon.a (mon.0) 3095 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-109", "tierpool": "test-rados-api-smithi072-64344-109-cache"}]': finished 2024-03-30T15:22:28.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:27 smithi072 bash[21573]: cluster 2024-03-30T15:22:27.799811+0000 mon.a (mon.0) 3096 : cluster 0 osdmap e568: 8 total, 8 up, 8 in 2024-03-30T15:22:28.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:27 smithi072 bash[21573]: audit 2024-03-30T15:22:27.800713+0000 mon.a (mon.0) 3097 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-109", "overlaypool": "test-rados-api-smithi072-64344-109-cache"}]: dispatch 2024-03-30T15:22:28.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:27 smithi072 bash[28946]: cluster 2024-03-30T15:22:26.812723+0000 mon.a (mon.0) 3094 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:22:28.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:27 smithi072 bash[28946]: audit 2024-03-30T15:22:27.792647+0000 mon.a (mon.0) 3095 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-109", "tierpool": "test-rados-api-smithi072-64344-109-cache"}]': finished 2024-03-30T15:22:28.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:27 smithi072 bash[28946]: cluster 2024-03-30T15:22:27.799811+0000 mon.a (mon.0) 3096 : cluster 0 osdmap e568: 8 total, 8 up, 8 in 2024-03-30T15:22:28.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:27 smithi072 bash[28946]: audit 2024-03-30T15:22:27.800713+0000 mon.a (mon.0) 3097 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-109", "overlaypool": "test-rados-api-smithi072-64344-109-cache"}]: dispatch 2024-03-30T15:22:28.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:27 smithi172 bash[23680]: cluster 2024-03-30T15:22:26.812723+0000 mon.a (mon.0) 3094 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:22:28.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:27 smithi172 bash[23680]: audit 2024-03-30T15:22:27.792647+0000 mon.a (mon.0) 3095 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-109", "tierpool": "test-rados-api-smithi072-64344-109-cache"}]': finished 2024-03-30T15:22:28.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:27 smithi172 bash[23680]: cluster 2024-03-30T15:22:27.799811+0000 mon.a (mon.0) 3096 : cluster 0 osdmap e568: 8 total, 8 up, 8 in 2024-03-30T15:22:28.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:27 smithi172 bash[23680]: audit 2024-03-30T15:22:27.800713+0000 mon.a (mon.0) 3097 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-109", "overlaypool": "test-rados-api-smithi072-64344-109-cache"}]: dispatch 2024-03-30T15:22:30.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:29 smithi072 bash[21573]: cluster 2024-03-30T15:22:28.228381+0000 mgr.y (mgr.14526) 575 : cluster 0 pgmap v917: 212 pgs: 32 creating+peering, 180 active+clean; 582 KiB data, 637 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:22:30.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:29 smithi072 bash[21573]: audit 2024-03-30T15:22:28.795497+0000 mon.a (mon.0) 3098 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-109", "overlaypool": "test-rados-api-smithi072-64344-109-cache"}]': finished 2024-03-30T15:22:30.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:29 smithi072 bash[21573]: cluster 2024-03-30T15:22:28.803809+0000 mon.a (mon.0) 3099 : cluster 0 osdmap e569: 8 total, 8 up, 8 in 2024-03-30T15:22:30.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:29 smithi072 bash[21573]: audit 2024-03-30T15:22:28.805907+0000 mon.a (mon.0) 3100 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-109-cache", "mode": "writeback"}]: dispatch 2024-03-30T15:22:30.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:29 smithi072 bash[28946]: cluster 2024-03-30T15:22:28.228381+0000 mgr.y (mgr.14526) 575 : cluster 0 pgmap v917: 212 pgs: 32 creating+peering, 180 active+clean; 582 KiB data, 637 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:22:30.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:29 smithi072 bash[28946]: audit 2024-03-30T15:22:28.795497+0000 mon.a (mon.0) 3098 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-109", "overlaypool": "test-rados-api-smithi072-64344-109-cache"}]': finished 2024-03-30T15:22:30.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:29 smithi072 bash[28946]: cluster 2024-03-30T15:22:28.803809+0000 mon.a (mon.0) 3099 : cluster 0 osdmap e569: 8 total, 8 up, 8 in 2024-03-30T15:22:30.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:29 smithi072 bash[28946]: audit 2024-03-30T15:22:28.805907+0000 mon.a (mon.0) 3100 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-109-cache", "mode": "writeback"}]: dispatch 2024-03-30T15:22:30.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:29 smithi172 bash[23680]: cluster 2024-03-30T15:22:28.228381+0000 mgr.y (mgr.14526) 575 : cluster 0 pgmap v917: 212 pgs: 32 creating+peering, 180 active+clean; 582 KiB data, 637 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:22:30.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:29 smithi172 bash[23680]: audit 2024-03-30T15:22:28.795497+0000 mon.a (mon.0) 3098 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-109", "overlaypool": "test-rados-api-smithi072-64344-109-cache"}]': finished 2024-03-30T15:22:30.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:29 smithi172 bash[23680]: cluster 2024-03-30T15:22:28.803809+0000 mon.a (mon.0) 3099 : cluster 0 osdmap e569: 8 total, 8 up, 8 in 2024-03-30T15:22:30.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:29 smithi172 bash[23680]: audit 2024-03-30T15:22:28.805907+0000 mon.a (mon.0) 3100 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-109-cache", "mode": "writeback"}]: dispatch 2024-03-30T15:22:31.168 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:22:31 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:22:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:22:31.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:30 smithi072 bash[21573]: cluster 2024-03-30T15:22:29.795854+0000 mon.a (mon.0) 3101 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:22:31.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:30 smithi072 bash[21573]: audit 2024-03-30T15:22:29.798278+0000 mon.a (mon.0) 3102 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-109-cache", "mode": "writeback"}]': finished 2024-03-30T15:22:31.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:30 smithi072 bash[21573]: cluster 2024-03-30T15:22:29.805831+0000 mon.a (mon.0) 3103 : cluster 0 osdmap e570: 8 total, 8 up, 8 in 2024-03-30T15:22:31.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:30 smithi072 bash[21573]: audit 2024-03-30T15:22:29.808357+0000 mon.a (mon.0) 3104 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-109-cache","var": "hit_set_count","val": "2"}]: dispatch 2024-03-30T15:22:31.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:30 smithi072 bash[21573]: cluster 2024-03-30T15:22:30.229245+0000 mgr.y (mgr.14526) 576 : cluster 0 pgmap v920: 212 pgs: 32 creating+peering, 180 active+clean; 582 KiB data, 637 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:22:31.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:30 smithi072 bash[21573]: audit 2024-03-30T15:22:30.801139+0000 mon.a (mon.0) 3105 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-109-cache","var": "hit_set_count","val": "2"}]': finished 2024-03-30T15:22:31.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:30 smithi072 bash[21573]: cluster 2024-03-30T15:22:30.808286+0000 mon.a (mon.0) 3106 : cluster 0 osdmap e571: 8 total, 8 up, 8 in 2024-03-30T15:22:31.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:30 smithi072 bash[21573]: audit 2024-03-30T15:22:30.811091+0000 mon.a (mon.0) 3107 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-109-cache","var": "hit_set_period","val": "600"}]: dispatch 2024-03-30T15:22:31.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:30 smithi072 bash[28946]: cluster 2024-03-30T15:22:29.795854+0000 mon.a (mon.0) 3101 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:22:31.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:30 smithi072 bash[28946]: audit 2024-03-30T15:22:29.798278+0000 mon.a (mon.0) 3102 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-109-cache", "mode": "writeback"}]': finished 2024-03-30T15:22:31.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:30 smithi072 bash[28946]: cluster 2024-03-30T15:22:29.805831+0000 mon.a (mon.0) 3103 : cluster 0 osdmap e570: 8 total, 8 up, 8 in 2024-03-30T15:22:31.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:30 smithi072 bash[28946]: audit 2024-03-30T15:22:29.808357+0000 mon.a (mon.0) 3104 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-109-cache","var": "hit_set_count","val": "2"}]: dispatch 2024-03-30T15:22:31.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:30 smithi072 bash[28946]: cluster 2024-03-30T15:22:30.229245+0000 mgr.y (mgr.14526) 576 : cluster 0 pgmap v920: 212 pgs: 32 creating+peering, 180 active+clean; 582 KiB data, 637 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:22:31.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:30 smithi072 bash[28946]: audit 2024-03-30T15:22:30.801139+0000 mon.a (mon.0) 3105 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-109-cache","var": "hit_set_count","val": "2"}]': finished 2024-03-30T15:22:31.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:30 smithi072 bash[28946]: cluster 2024-03-30T15:22:30.808286+0000 mon.a (mon.0) 3106 : cluster 0 osdmap e571: 8 total, 8 up, 8 in 2024-03-30T15:22:31.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:30 smithi072 bash[28946]: audit 2024-03-30T15:22:30.811091+0000 mon.a (mon.0) 3107 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-109-cache","var": "hit_set_period","val": "600"}]: dispatch 2024-03-30T15:22:31.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:30 smithi172 bash[23680]: cluster 2024-03-30T15:22:29.795854+0000 mon.a (mon.0) 3101 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:22:31.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:30 smithi172 bash[23680]: audit 2024-03-30T15:22:29.798278+0000 mon.a (mon.0) 3102 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-109-cache", "mode": "writeback"}]': finished 2024-03-30T15:22:31.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:30 smithi172 bash[23680]: cluster 2024-03-30T15:22:29.805831+0000 mon.a (mon.0) 3103 : cluster 0 osdmap e570: 8 total, 8 up, 8 in 2024-03-30T15:22:31.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:30 smithi172 bash[23680]: audit 2024-03-30T15:22:29.808357+0000 mon.a (mon.0) 3104 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-109-cache","var": "hit_set_count","val": "2"}]: dispatch 2024-03-30T15:22:31.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:30 smithi172 bash[23680]: cluster 2024-03-30T15:22:30.229245+0000 mgr.y (mgr.14526) 576 : cluster 0 pgmap v920: 212 pgs: 32 creating+peering, 180 active+clean; 582 KiB data, 637 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:22:31.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:30 smithi172 bash[23680]: audit 2024-03-30T15:22:30.801139+0000 mon.a (mon.0) 3105 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-109-cache","var": "hit_set_count","val": "2"}]': finished 2024-03-30T15:22:31.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:30 smithi172 bash[23680]: cluster 2024-03-30T15:22:30.808286+0000 mon.a (mon.0) 3106 : cluster 0 osdmap e571: 8 total, 8 up, 8 in 2024-03-30T15:22:31.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:30 smithi172 bash[23680]: audit 2024-03-30T15:22:30.811091+0000 mon.a (mon.0) 3107 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-109-cache","var": "hit_set_period","val": "600"}]: dispatch 2024-03-30T15:22:31.966 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:22:31 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:22:33.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:32 smithi072 bash[21573]: audit 2024-03-30T15:22:31.511450+0000 mgr.y (mgr.14526) 577 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:22:33.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:32 smithi072 bash[21573]: audit 2024-03-30T15:22:31.803795+0000 mon.a (mon.0) 3108 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-109-cache","var": "hit_set_period","val": "600"}]': finished 2024-03-30T15:22:33.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:32 smithi072 bash[21573]: cluster 2024-03-30T15:22:31.811695+0000 mon.a (mon.0) 3109 : cluster 0 osdmap e572: 8 total, 8 up, 8 in 2024-03-30T15:22:33.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:32 smithi072 bash[21573]: audit 2024-03-30T15:22:31.813342+0000 mon.a (mon.0) 3110 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-109-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-03-30T15:22:33.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:32 smithi072 bash[21573]: cluster 2024-03-30T15:22:32.274165+0000 mon.a (mon.0) 3111 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:22:33.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:32 smithi072 bash[28946]: audit 2024-03-30T15:22:31.511450+0000 mgr.y (mgr.14526) 577 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:22:33.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:32 smithi072 bash[28946]: audit 2024-03-30T15:22:31.803795+0000 mon.a (mon.0) 3108 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-109-cache","var": "hit_set_period","val": "600"}]': finished 2024-03-30T15:22:33.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:32 smithi072 bash[28946]: cluster 2024-03-30T15:22:31.811695+0000 mon.a (mon.0) 3109 : cluster 0 osdmap e572: 8 total, 8 up, 8 in 2024-03-30T15:22:33.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:32 smithi072 bash[28946]: audit 2024-03-30T15:22:31.813342+0000 mon.a (mon.0) 3110 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-109-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-03-30T15:22:33.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:32 smithi072 bash[28946]: cluster 2024-03-30T15:22:32.274165+0000 mon.a (mon.0) 3111 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:22:33.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:32 smithi172 bash[23680]: audit 2024-03-30T15:22:31.511450+0000 mgr.y (mgr.14526) 577 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:22:33.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:32 smithi172 bash[23680]: audit 2024-03-30T15:22:31.803795+0000 mon.a (mon.0) 3108 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-109-cache","var": "hit_set_period","val": "600"}]': finished 2024-03-30T15:22:33.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:32 smithi172 bash[23680]: cluster 2024-03-30T15:22:31.811695+0000 mon.a (mon.0) 3109 : cluster 0 osdmap e572: 8 total, 8 up, 8 in 2024-03-30T15:22:33.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:32 smithi172 bash[23680]: audit 2024-03-30T15:22:31.813342+0000 mon.a (mon.0) 3110 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-109-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-03-30T15:22:33.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:32 smithi172 bash[23680]: cluster 2024-03-30T15:22:32.274165+0000 mon.a (mon.0) 3111 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:22:34.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:33 smithi072 bash[21573]: cluster 2024-03-30T15:22:32.230203+0000 mgr.y (mgr.14526) 578 : cluster 0 pgmap v923: 212 pgs: 212 active+clean; 582 KiB data, 641 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:22:34.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:33 smithi072 bash[21573]: cluster 2024-03-30T15:22:32.804693+0000 mon.a (mon.0) 3112 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:22:34.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:33 smithi072 bash[21573]: audit 2024-03-30T15:22:32.816490+0000 mon.a (mon.0) 3113 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-109-cache","var": "hit_set_type","val": "explicit_object"}]': finished 2024-03-30T15:22:34.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:33 smithi072 bash[21573]: cluster 2024-03-30T15:22:32.829954+0000 mon.a (mon.0) 3114 : cluster 0 osdmap e573: 8 total, 8 up, 8 in 2024-03-30T15:22:34.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:33 smithi072 bash[21573]: audit 2024-03-30T15:22:32.832228+0000 mon.a (mon.0) 3115 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-109-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2024-03-30T15:22:34.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:33 smithi072 bash[28946]: cluster 2024-03-30T15:22:32.230203+0000 mgr.y (mgr.14526) 578 : cluster 0 pgmap v923: 212 pgs: 212 active+clean; 582 KiB data, 641 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:22:34.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:33 smithi072 bash[28946]: cluster 2024-03-30T15:22:32.804693+0000 mon.a (mon.0) 3112 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:22:34.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:33 smithi072 bash[28946]: audit 2024-03-30T15:22:32.816490+0000 mon.a (mon.0) 3113 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-109-cache","var": "hit_set_type","val": "explicit_object"}]': finished 2024-03-30T15:22:34.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:33 smithi072 bash[28946]: cluster 2024-03-30T15:22:32.829954+0000 mon.a (mon.0) 3114 : cluster 0 osdmap e573: 8 total, 8 up, 8 in 2024-03-30T15:22:34.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:33 smithi072 bash[28946]: audit 2024-03-30T15:22:32.832228+0000 mon.a (mon.0) 3115 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-109-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2024-03-30T15:22:34.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:33 smithi172 bash[23680]: cluster 2024-03-30T15:22:32.230203+0000 mgr.y (mgr.14526) 578 : cluster 0 pgmap v923: 212 pgs: 212 active+clean; 582 KiB data, 641 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:22:34.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:33 smithi172 bash[23680]: cluster 2024-03-30T15:22:32.804693+0000 mon.a (mon.0) 3112 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:22:34.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:33 smithi172 bash[23680]: audit 2024-03-30T15:22:32.816490+0000 mon.a (mon.0) 3113 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-109-cache","var": "hit_set_type","val": "explicit_object"}]': finished 2024-03-30T15:22:34.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:33 smithi172 bash[23680]: cluster 2024-03-30T15:22:32.829954+0000 mon.a (mon.0) 3114 : cluster 0 osdmap e573: 8 total, 8 up, 8 in 2024-03-30T15:22:34.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:33 smithi172 bash[23680]: audit 2024-03-30T15:22:32.832228+0000 mon.a (mon.0) 3115 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-109-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2024-03-30T15:22:35.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:34 smithi072 bash[21573]: audit 2024-03-30T15:22:33.819575+0000 mon.a (mon.0) 3116 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-109-cache","var": "min_read_recency_for_promote","val": "4"}]': finished 2024-03-30T15:22:35.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:34 smithi072 bash[21573]: cluster 2024-03-30T15:22:33.826928+0000 mon.a (mon.0) 3117 : cluster 0 osdmap e574: 8 total, 8 up, 8 in 2024-03-30T15:22:35.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:34 smithi072 bash[21573]: audit 2024-03-30T15:22:33.900275+0000 mon.a (mon.0) 3118 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-109"}]: dispatch 2024-03-30T15:22:35.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:34 smithi072 bash[21573]: cluster 2024-03-30T15:22:34.231086+0000 mgr.y (mgr.14526) 579 : cluster 0 pgmap v926: 212 pgs: 212 active+clean; 582 KiB data, 641 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:22:35.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:34 smithi072 bash[28946]: audit 2024-03-30T15:22:33.819575+0000 mon.a (mon.0) 3116 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-109-cache","var": "min_read_recency_for_promote","val": "4"}]': finished 2024-03-30T15:22:35.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:34 smithi072 bash[28946]: cluster 2024-03-30T15:22:33.826928+0000 mon.a (mon.0) 3117 : cluster 0 osdmap e574: 8 total, 8 up, 8 in 2024-03-30T15:22:35.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:34 smithi072 bash[28946]: audit 2024-03-30T15:22:33.900275+0000 mon.a (mon.0) 3118 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-109"}]: dispatch 2024-03-30T15:22:35.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:34 smithi072 bash[28946]: cluster 2024-03-30T15:22:34.231086+0000 mgr.y (mgr.14526) 579 : cluster 0 pgmap v926: 212 pgs: 212 active+clean; 582 KiB data, 641 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:22:35.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:34 smithi172 bash[23680]: audit 2024-03-30T15:22:33.819575+0000 mon.a (mon.0) 3116 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-109-cache","var": "min_read_recency_for_promote","val": "4"}]': finished 2024-03-30T15:22:35.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:34 smithi172 bash[23680]: cluster 2024-03-30T15:22:33.826928+0000 mon.a (mon.0) 3117 : cluster 0 osdmap e574: 8 total, 8 up, 8 in 2024-03-30T15:22:35.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:34 smithi172 bash[23680]: audit 2024-03-30T15:22:33.900275+0000 mon.a (mon.0) 3118 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-109"}]: dispatch 2024-03-30T15:22:35.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:34 smithi172 bash[23680]: cluster 2024-03-30T15:22:34.231086+0000 mgr.y (mgr.14526) 579 : cluster 0 pgmap v926: 212 pgs: 212 active+clean; 582 KiB data, 641 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:22:36.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:35 smithi072 bash[28946]: audit 2024-03-30T15:22:34.847270+0000 mon.a (mon.0) 3119 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-109"}]': finished 2024-03-30T15:22:36.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:35 smithi072 bash[28946]: cluster 2024-03-30T15:22:34.859404+0000 mon.a (mon.0) 3120 : cluster 0 osdmap e575: 8 total, 8 up, 8 in 2024-03-30T15:22:36.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:35 smithi072 bash[28946]: audit 2024-03-30T15:22:34.860684+0000 mon.a (mon.0) 3121 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-109", "tierpool": "test-rados-api-smithi072-64344-109-cache"}]: dispatch 2024-03-30T15:22:36.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:35 smithi072 bash[21573]: audit 2024-03-30T15:22:34.847270+0000 mon.a (mon.0) 3119 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-109"}]': finished 2024-03-30T15:22:36.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:35 smithi072 bash[21573]: cluster 2024-03-30T15:22:34.859404+0000 mon.a (mon.0) 3120 : cluster 0 osdmap e575: 8 total, 8 up, 8 in 2024-03-30T15:22:36.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:35 smithi072 bash[21573]: audit 2024-03-30T15:22:34.860684+0000 mon.a (mon.0) 3121 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-109", "tierpool": "test-rados-api-smithi072-64344-109-cache"}]: dispatch 2024-03-30T15:22:36.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:35 smithi172 bash[23680]: audit 2024-03-30T15:22:34.847270+0000 mon.a (mon.0) 3119 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-109"}]': finished 2024-03-30T15:22:36.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:35 smithi172 bash[23680]: cluster 2024-03-30T15:22:34.859404+0000 mon.a (mon.0) 3120 : cluster 0 osdmap e575: 8 total, 8 up, 8 in 2024-03-30T15:22:36.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:35 smithi172 bash[23680]: audit 2024-03-30T15:22:34.860684+0000 mon.a (mon.0) 3121 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-109", "tierpool": "test-rados-api-smithi072-64344-109-cache"}]: dispatch 2024-03-30T15:22:37.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:36 smithi072 bash[28946]: audit 2024-03-30T15:22:35.850117+0000 mon.a (mon.0) 3122 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-109", "tierpool": "test-rados-api-smithi072-64344-109-cache"}]': finished 2024-03-30T15:22:37.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:36 smithi072 bash[28946]: cluster 2024-03-30T15:22:35.858917+0000 mon.a (mon.0) 3123 : cluster 0 osdmap e576: 8 total, 8 up, 8 in 2024-03-30T15:22:37.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:36 smithi072 bash[28946]: cluster 2024-03-30T15:22:36.233190+0000 mgr.y (mgr.14526) 580 : cluster 0 pgmap v929: 212 pgs: 212 active+clean; 582 KiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-30T15:22:37.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:36 smithi072 bash[28946]: cluster 2024-03-30T15:22:36.861452+0000 mon.a (mon.0) 3124 : cluster 0 osdmap e577: 8 total, 8 up, 8 in 2024-03-30T15:22:37.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:36 smithi072 bash[21573]: audit 2024-03-30T15:22:35.850117+0000 mon.a (mon.0) 3122 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-109", "tierpool": "test-rados-api-smithi072-64344-109-cache"}]': finished 2024-03-30T15:22:37.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:36 smithi072 bash[21573]: cluster 2024-03-30T15:22:35.858917+0000 mon.a (mon.0) 3123 : cluster 0 osdmap e576: 8 total, 8 up, 8 in 2024-03-30T15:22:37.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:36 smithi072 bash[21573]: cluster 2024-03-30T15:22:36.233190+0000 mgr.y (mgr.14526) 580 : cluster 0 pgmap v929: 212 pgs: 212 active+clean; 582 KiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-30T15:22:37.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:36 smithi072 bash[21573]: cluster 2024-03-30T15:22:36.861452+0000 mon.a (mon.0) 3124 : cluster 0 osdmap e577: 8 total, 8 up, 8 in 2024-03-30T15:22:37.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:36 smithi172 bash[23680]: audit 2024-03-30T15:22:35.850117+0000 mon.a (mon.0) 3122 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-109", "tierpool": "test-rados-api-smithi072-64344-109-cache"}]': finished 2024-03-30T15:22:37.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:36 smithi172 bash[23680]: cluster 2024-03-30T15:22:35.858917+0000 mon.a (mon.0) 3123 : cluster 0 osdmap e576: 8 total, 8 up, 8 in 2024-03-30T15:22:37.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:36 smithi172 bash[23680]: cluster 2024-03-30T15:22:36.233190+0000 mgr.y (mgr.14526) 580 : cluster 0 pgmap v929: 212 pgs: 212 active+clean; 582 KiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-30T15:22:37.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:36 smithi172 bash[23680]: cluster 2024-03-30T15:22:36.861452+0000 mon.a (mon.0) 3124 : cluster 0 osdmap e577: 8 total, 8 up, 8 in 2024-03-30T15:22:38.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:37 smithi072 bash[21573]: audit 2024-03-30T15:22:36.940102+0000 mon.c (mon.2) 502 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:22:38.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:37 smithi072 bash[21573]: cluster 2024-03-30T15:22:37.275264+0000 mon.a (mon.0) 3125 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:22:38.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:37 smithi072 bash[21573]: cluster 2024-03-30T15:22:37.865031+0000 mon.a (mon.0) 3126 : cluster 0 osdmap e578: 8 total, 8 up, 8 in 2024-03-30T15:22:38.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:37 smithi072 bash[21573]: audit 2024-03-30T15:22:37.867018+0000 mon.a (mon.0) 3127 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi072-64344-109"}]: dispatch 2024-03-30T15:22:38.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:37 smithi072 bash[28946]: audit 2024-03-30T15:22:36.940102+0000 mon.c (mon.2) 502 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:22:38.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:37 smithi072 bash[28946]: cluster 2024-03-30T15:22:37.275264+0000 mon.a (mon.0) 3125 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:22:38.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:37 smithi072 bash[28946]: cluster 2024-03-30T15:22:37.865031+0000 mon.a (mon.0) 3126 : cluster 0 osdmap e578: 8 total, 8 up, 8 in 2024-03-30T15:22:38.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:37 smithi072 bash[28946]: audit 2024-03-30T15:22:37.867018+0000 mon.a (mon.0) 3127 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi072-64344-109"}]: dispatch 2024-03-30T15:22:38.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:37 smithi172 bash[23680]: audit 2024-03-30T15:22:36.940102+0000 mon.c (mon.2) 502 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:22:38.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:37 smithi172 bash[23680]: cluster 2024-03-30T15:22:37.275264+0000 mon.a (mon.0) 3125 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:22:38.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:37 smithi172 bash[23680]: cluster 2024-03-30T15:22:37.865031+0000 mon.a (mon.0) 3126 : cluster 0 osdmap e578: 8 total, 8 up, 8 in 2024-03-30T15:22:38.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:37 smithi172 bash[23680]: audit 2024-03-30T15:22:37.867018+0000 mon.a (mon.0) 3127 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi072-64344-109"}]: dispatch 2024-03-30T15:22:39.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:38 smithi072 bash[21573]: cluster 2024-03-30T15:22:38.233929+0000 mgr.y (mgr.14526) 581 : cluster 0 pgmap v932: 172 pgs: 172 active+clean; 582 KiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:22:39.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:38 smithi072 bash[21573]: audit 2024-03-30T15:22:38.860158+0000 mon.a (mon.0) 3128 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi072-64344-109"}]': finished 2024-03-30T15:22:39.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:38 smithi072 bash[21573]: cluster 2024-03-30T15:22:38.867636+0000 mon.a (mon.0) 3129 : cluster 0 osdmap e579: 8 total, 8 up, 8 in 2024-03-30T15:22:39.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:38 smithi072 bash[21573]: audit 2024-03-30T15:22:38.869378+0000 mon.a (mon.0) 3130 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi072-64344-109"}]: dispatch 2024-03-30T15:22:39.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:38 smithi072 bash[28946]: cluster 2024-03-30T15:22:38.233929+0000 mgr.y (mgr.14526) 581 : cluster 0 pgmap v932: 172 pgs: 172 active+clean; 582 KiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:22:39.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:38 smithi072 bash[28946]: audit 2024-03-30T15:22:38.860158+0000 mon.a (mon.0) 3128 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi072-64344-109"}]': finished 2024-03-30T15:22:39.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:38 smithi072 bash[28946]: cluster 2024-03-30T15:22:38.867636+0000 mon.a (mon.0) 3129 : cluster 0 osdmap e579: 8 total, 8 up, 8 in 2024-03-30T15:22:39.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:38 smithi072 bash[28946]: audit 2024-03-30T15:22:38.869378+0000 mon.a (mon.0) 3130 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi072-64344-109"}]: dispatch 2024-03-30T15:22:39.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:38 smithi172 bash[23680]: cluster 2024-03-30T15:22:38.233929+0000 mgr.y (mgr.14526) 581 : cluster 0 pgmap v932: 172 pgs: 172 active+clean; 582 KiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:22:39.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:38 smithi172 bash[23680]: audit 2024-03-30T15:22:38.860158+0000 mon.a (mon.0) 3128 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi072-64344-109"}]': finished 2024-03-30T15:22:39.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:38 smithi172 bash[23680]: cluster 2024-03-30T15:22:38.867636+0000 mon.a (mon.0) 3129 : cluster 0 osdmap e579: 8 total, 8 up, 8 in 2024-03-30T15:22:39.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:38 smithi172 bash[23680]: audit 2024-03-30T15:22:38.869378+0000 mon.a (mon.0) 3130 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi072-64344-109"}]: dispatch 2024-03-30T15:22:41.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:40 smithi072 bash[21573]: audit 2024-03-30T15:22:39.863632+0000 mon.a (mon.0) 3131 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi072-64344-109"}]': finished 2024-03-30T15:22:41.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:40 smithi072 bash[21573]: cluster 2024-03-30T15:22:39.872676+0000 mon.a (mon.0) 3132 : cluster 0 osdmap e580: 8 total, 8 up, 8 in 2024-03-30T15:22:41.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:40 smithi072 bash[21573]: cluster 2024-03-30T15:22:40.234731+0000 mgr.y (mgr.14526) 582 : cluster 0 pgmap v935: 172 pgs: 172 active+clean; 582 KiB data, 642 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:22:41.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:40 smithi072 bash[28946]: audit 2024-03-30T15:22:39.863632+0000 mon.a (mon.0) 3131 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi072-64344-109"}]': finished 2024-03-30T15:22:41.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:40 smithi072 bash[28946]: cluster 2024-03-30T15:22:39.872676+0000 mon.a (mon.0) 3132 : cluster 0 osdmap e580: 8 total, 8 up, 8 in 2024-03-30T15:22:41.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:40 smithi072 bash[28946]: cluster 2024-03-30T15:22:40.234731+0000 mgr.y (mgr.14526) 582 : cluster 0 pgmap v935: 172 pgs: 172 active+clean; 582 KiB data, 642 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:22:41.169 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:22:41 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:22:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:22:41.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:40 smithi172 bash[23680]: audit 2024-03-30T15:22:39.863632+0000 mon.a (mon.0) 3131 : audit 1 from='client.? 172.21.15.72:0/498863418' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi072-64344-109"}]': finished 2024-03-30T15:22:41.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:40 smithi172 bash[23680]: cluster 2024-03-30T15:22:39.872676+0000 mon.a (mon.0) 3132 : cluster 0 osdmap e580: 8 total, 8 up, 8 in 2024-03-30T15:22:41.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:40 smithi172 bash[23680]: cluster 2024-03-30T15:22:40.234731+0000 mgr.y (mgr.14526) 582 : cluster 0 pgmap v935: 172 pgs: 172 active+clean; 582 KiB data, 642 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:22:41.877 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:22:41 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:22:42.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:41 smithi072 bash[21573]: cluster 2024-03-30T15:22:40.873554+0000 mon.a (mon.0) 3133 : cluster 0 osdmap e581: 8 total, 8 up, 8 in 2024-03-30T15:22:42.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:41 smithi072 bash[21573]: audit 2024-03-30T15:22:40.877138+0000 mon.a (mon.0) 3134 : audit 1 from='client.? 172.21.15.72:0/3012464028' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi072-64344-104"}]: dispatch 2024-03-30T15:22:42.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:41 smithi072 bash[21573]: audit 2024-03-30T15:22:41.522986+0000 mgr.y (mgr.14526) 583 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:22:42.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:41 smithi072 bash[21573]: audit 2024-03-30T15:22:41.868914+0000 mon.a (mon.0) 3135 : audit 1 from='client.? 172.21.15.72:0/3012464028' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi072-64344-104"}]': finished 2024-03-30T15:22:42.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:41 smithi072 bash[21573]: cluster 2024-03-30T15:22:41.876777+0000 mon.a (mon.0) 3136 : cluster 0 osdmap e582: 8 total, 8 up, 8 in 2024-03-30T15:22:42.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:41 smithi072 bash[21573]: audit 2024-03-30T15:22:41.877540+0000 mon.a (mon.0) 3137 : audit 1 from='client.? 172.21.15.72:0/3012464028' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi072-64344-104"}]: dispatch 2024-03-30T15:22:42.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:41 smithi072 bash[28946]: cluster 2024-03-30T15:22:40.873554+0000 mon.a (mon.0) 3133 : cluster 0 osdmap e581: 8 total, 8 up, 8 in 2024-03-30T15:22:42.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:41 smithi072 bash[28946]: audit 2024-03-30T15:22:40.877138+0000 mon.a (mon.0) 3134 : audit 1 from='client.? 172.21.15.72:0/3012464028' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi072-64344-104"}]: dispatch 2024-03-30T15:22:42.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:41 smithi072 bash[28946]: audit 2024-03-30T15:22:41.522986+0000 mgr.y (mgr.14526) 583 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:22:42.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:41 smithi072 bash[28946]: audit 2024-03-30T15:22:41.868914+0000 mon.a (mon.0) 3135 : audit 1 from='client.? 172.21.15.72:0/3012464028' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi072-64344-104"}]': finished 2024-03-30T15:22:42.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:41 smithi072 bash[28946]: cluster 2024-03-30T15:22:41.876777+0000 mon.a (mon.0) 3136 : cluster 0 osdmap e582: 8 total, 8 up, 8 in 2024-03-30T15:22:42.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:41 smithi072 bash[28946]: audit 2024-03-30T15:22:41.877540+0000 mon.a (mon.0) 3137 : audit 1 from='client.? 172.21.15.72:0/3012464028' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi072-64344-104"}]: dispatch 2024-03-30T15:22:42.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:41 smithi172 bash[23680]: cluster 2024-03-30T15:22:40.873554+0000 mon.a (mon.0) 3133 : cluster 0 osdmap e581: 8 total, 8 up, 8 in 2024-03-30T15:22:42.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:41 smithi172 bash[23680]: audit 2024-03-30T15:22:40.877138+0000 mon.a (mon.0) 3134 : audit 1 from='client.? 172.21.15.72:0/3012464028' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi072-64344-104"}]: dispatch 2024-03-30T15:22:42.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:41 smithi172 bash[23680]: audit 2024-03-30T15:22:41.522986+0000 mgr.y (mgr.14526) 583 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:22:42.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:41 smithi172 bash[23680]: audit 2024-03-30T15:22:41.868914+0000 mon.a (mon.0) 3135 : audit 1 from='client.? 172.21.15.72:0/3012464028' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi072-64344-104"}]': finished 2024-03-30T15:22:42.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:41 smithi172 bash[23680]: cluster 2024-03-30T15:22:41.876777+0000 mon.a (mon.0) 3136 : cluster 0 osdmap e582: 8 total, 8 up, 8 in 2024-03-30T15:22:42.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:41 smithi172 bash[23680]: audit 2024-03-30T15:22:41.877540+0000 mon.a (mon.0) 3137 : audit 1 from='client.? 172.21.15.72:0/3012464028' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi072-64344-104"}]: dispatch 2024-03-30T15:22:43.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:42 smithi072 bash[21573]: cluster 2024-03-30T15:22:42.235515+0000 mgr.y (mgr.14526) 584 : cluster 0 pgmap v938: 164 pgs: 164 active+clean; 582 KiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-03-30T15:22:43.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:42 smithi072 bash[21573]: cluster 2024-03-30T15:22:42.276407+0000 mon.a (mon.0) 3138 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:22:43.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:42 smithi072 bash[21573]: audit 2024-03-30T15:22:42.872447+0000 mon.a (mon.0) 3139 : audit 1 from='client.? 172.21.15.72:0/3012464028' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi072-64344-104"}]': finished 2024-03-30T15:22:43.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:42 smithi072 bash[21573]: cluster 2024-03-30T15:22:42.879449+0000 mon.a (mon.0) 3140 : cluster 0 osdmap e583: 8 total, 8 up, 8 in 2024-03-30T15:22:43.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:42 smithi072 bash[28946]: cluster 2024-03-30T15:22:42.235515+0000 mgr.y (mgr.14526) 584 : cluster 0 pgmap v938: 164 pgs: 164 active+clean; 582 KiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-03-30T15:22:43.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:42 smithi072 bash[28946]: cluster 2024-03-30T15:22:42.276407+0000 mon.a (mon.0) 3138 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:22:43.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:42 smithi072 bash[28946]: audit 2024-03-30T15:22:42.872447+0000 mon.a (mon.0) 3139 : audit 1 from='client.? 172.21.15.72:0/3012464028' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi072-64344-104"}]': finished 2024-03-30T15:22:43.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:42 smithi072 bash[28946]: cluster 2024-03-30T15:22:42.879449+0000 mon.a (mon.0) 3140 : cluster 0 osdmap e583: 8 total, 8 up, 8 in 2024-03-30T15:22:43.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:42 smithi172 bash[23680]: cluster 2024-03-30T15:22:42.235515+0000 mgr.y (mgr.14526) 584 : cluster 0 pgmap v938: 164 pgs: 164 active+clean; 582 KiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-03-30T15:22:43.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:42 smithi172 bash[23680]: cluster 2024-03-30T15:22:42.276407+0000 mon.a (mon.0) 3138 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:22:43.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:42 smithi172 bash[23680]: audit 2024-03-30T15:22:42.872447+0000 mon.a (mon.0) 3139 : audit 1 from='client.? 172.21.15.72:0/3012464028' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi072-64344-104"}]': finished 2024-03-30T15:22:43.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:42 smithi172 bash[23680]: cluster 2024-03-30T15:22:42.879449+0000 mon.a (mon.0) 3140 : cluster 0 osdmap e583: 8 total, 8 up, 8 in 2024-03-30T15:22:44.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:43 smithi072 bash[21573]: audit 2024-03-30T15:22:42.927641+0000 mon.a (mon.0) 3141 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:22:44.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:43 smithi072 bash[21573]: audit 2024-03-30T15:22:42.929174+0000 mon.a (mon.0) 3142 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:22:44.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:43 smithi072 bash[21573]: audit 2024-03-30T15:22:42.929691+0000 mon.a (mon.0) 3143 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi072-64344-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:22:44.168 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:43 smithi072 bash[28946]: audit 2024-03-30T15:22:42.927641+0000 mon.a (mon.0) 3141 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:22:44.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:43 smithi072 bash[28946]: audit 2024-03-30T15:22:42.929174+0000 mon.a (mon.0) 3142 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:22:44.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:43 smithi072 bash[28946]: audit 2024-03-30T15:22:42.929691+0000 mon.a (mon.0) 3143 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi072-64344-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:22:44.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:43 smithi172 bash[23680]: audit 2024-03-30T15:22:42.927641+0000 mon.a (mon.0) 3141 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:22:44.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:43 smithi172 bash[23680]: audit 2024-03-30T15:22:42.929174+0000 mon.a (mon.0) 3142 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:22:44.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:43 smithi172 bash[23680]: audit 2024-03-30T15:22:42.929691+0000 mon.a (mon.0) 3143 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi072-64344-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-03-30T15:22:45.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:45 smithi072 bash[21573]: audit 2024-03-30T15:22:43.896129+0000 mon.a (mon.0) 3144 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi072-64344-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:22:45.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:45 smithi072 bash[21573]: cluster 2024-03-30T15:22:43.903761+0000 mon.a (mon.0) 3145 : cluster 0 osdmap e584: 8 total, 8 up, 8 in 2024-03-30T15:22:45.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:45 smithi072 bash[21573]: audit 2024-03-30T15:22:43.905734+0000 mon.a (mon.0) 3146 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi072-64344-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:22:45.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:45 smithi072 bash[21573]: cluster 2024-03-30T15:22:44.236274+0000 mgr.y (mgr.14526) 585 : cluster 0 pgmap v941: 164 pgs: 164 active+clean; 582 KiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-03-30T15:22:45.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:45 smithi072 bash[28946]: audit 2024-03-30T15:22:43.896129+0000 mon.a (mon.0) 3144 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi072-64344-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:22:45.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:45 smithi072 bash[28946]: cluster 2024-03-30T15:22:43.903761+0000 mon.a (mon.0) 3145 : cluster 0 osdmap e584: 8 total, 8 up, 8 in 2024-03-30T15:22:45.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:45 smithi072 bash[28946]: audit 2024-03-30T15:22:43.905734+0000 mon.a (mon.0) 3146 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi072-64344-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:22:45.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:45 smithi072 bash[28946]: cluster 2024-03-30T15:22:44.236274+0000 mgr.y (mgr.14526) 585 : cluster 0 pgmap v941: 164 pgs: 164 active+clean; 582 KiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-03-30T15:22:45.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:45 smithi172 bash[23680]: audit 2024-03-30T15:22:43.896129+0000 mon.a (mon.0) 3144 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi072-64344-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-03-30T15:22:45.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:45 smithi172 bash[23680]: cluster 2024-03-30T15:22:43.903761+0000 mon.a (mon.0) 3145 : cluster 0 osdmap e584: 8 total, 8 up, 8 in 2024-03-30T15:22:45.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:45 smithi172 bash[23680]: audit 2024-03-30T15:22:43.905734+0000 mon.a (mon.0) 3146 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi072-64344-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:22:45.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:45 smithi172 bash[23680]: cluster 2024-03-30T15:22:44.236274+0000 mgr.y (mgr.14526) 585 : cluster 0 pgmap v941: 164 pgs: 164 active+clean; 582 KiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-03-30T15:22:46.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:46 smithi072 bash[21573]: cluster 2024-03-30T15:22:45.356637+0000 mon.a (mon.0) 3147 : cluster 0 osdmap e585: 8 total, 8 up, 8 in 2024-03-30T15:22:46.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:46 smithi072 bash[21573]: audit 2024-03-30T15:22:45.902857+0000 mon.a (mon.0) 3148 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi072-64344-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:22:46.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:46 smithi072 bash[21573]: cluster 2024-03-30T15:22:45.909102+0000 mon.a (mon.0) 3149 : cluster 0 osdmap e586: 8 total, 8 up, 8 in 2024-03-30T15:22:46.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:46 smithi072 bash[28946]: cluster 2024-03-30T15:22:45.356637+0000 mon.a (mon.0) 3147 : cluster 0 osdmap e585: 8 total, 8 up, 8 in 2024-03-30T15:22:46.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:46 smithi072 bash[28946]: audit 2024-03-30T15:22:45.902857+0000 mon.a (mon.0) 3148 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi072-64344-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:22:46.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:46 smithi072 bash[28946]: cluster 2024-03-30T15:22:45.909102+0000 mon.a (mon.0) 3149 : cluster 0 osdmap e586: 8 total, 8 up, 8 in 2024-03-30T15:22:46.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:46 smithi172 bash[23680]: cluster 2024-03-30T15:22:45.356637+0000 mon.a (mon.0) 3147 : cluster 0 osdmap e585: 8 total, 8 up, 8 in 2024-03-30T15:22:46.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:46 smithi172 bash[23680]: audit 2024-03-30T15:22:45.902857+0000 mon.a (mon.0) 3148 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi072-64344-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:22:46.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:46 smithi172 bash[23680]: cluster 2024-03-30T15:22:45.909102+0000 mon.a (mon.0) 3149 : cluster 0 osdmap e586: 8 total, 8 up, 8 in 2024-03-30T15:22:47.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:47 smithi072 bash[28946]: cluster 2024-03-30T15:22:46.238001+0000 mgr.y (mgr.14526) 586 : cluster 0 pgmap v944: 172 pgs: 8 creating+peering, 164 active+clean; 582 KiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:22:47.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:47 smithi072 bash[28946]: cluster 2024-03-30T15:22:46.920007+0000 mon.a (mon.0) 3150 : cluster 0 osdmap e587: 8 total, 8 up, 8 in 2024-03-30T15:22:47.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:47 smithi072 bash[28946]: audit 2024-03-30T15:22:46.947795+0000 mon.a (mon.0) 3151 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:22:47.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:47 smithi072 bash[21573]: cluster 2024-03-30T15:22:46.238001+0000 mgr.y (mgr.14526) 586 : cluster 0 pgmap v944: 172 pgs: 8 creating+peering, 164 active+clean; 582 KiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:22:47.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:47 smithi072 bash[21573]: cluster 2024-03-30T15:22:46.920007+0000 mon.a (mon.0) 3150 : cluster 0 osdmap e587: 8 total, 8 up, 8 in 2024-03-30T15:22:47.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:47 smithi072 bash[21573]: audit 2024-03-30T15:22:46.947795+0000 mon.a (mon.0) 3151 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:22:47.716 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:47 smithi172 bash[23680]: cluster 2024-03-30T15:22:46.238001+0000 mgr.y (mgr.14526) 586 : cluster 0 pgmap v944: 172 pgs: 8 creating+peering, 164 active+clean; 582 KiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:22:47.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:47 smithi172 bash[23680]: cluster 2024-03-30T15:22:46.920007+0000 mon.a (mon.0) 3150 : cluster 0 osdmap e587: 8 total, 8 up, 8 in 2024-03-30T15:22:47.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:47 smithi172 bash[23680]: audit 2024-03-30T15:22:46.947795+0000 mon.a (mon.0) 3151 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:22:49.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:48 smithi172 bash[23680]: audit 2024-03-30T15:22:47.916172+0000 mon.a (mon.0) 3152 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-112","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:22:49.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:48 smithi172 bash[23680]: cluster 2024-03-30T15:22:47.926197+0000 mon.a (mon.0) 3153 : cluster 0 osdmap e588: 8 total, 8 up, 8 in 2024-03-30T15:22:49.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:48 smithi172 bash[23680]: audit 2024-03-30T15:22:47.976468+0000 mon.a (mon.0) 3154 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-112", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:22:49.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:48 smithi172 bash[23680]: cluster 2024-03-30T15:22:48.238832+0000 mgr.y (mgr.14526) 587 : cluster 0 pgmap v947: 204 pgs: 32 unknown, 8 creating+peering, 164 active+clean; 582 KiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:22:49.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:48 smithi072 bash[21573]: audit 2024-03-30T15:22:47.916172+0000 mon.a (mon.0) 3152 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-112","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:22:49.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:48 smithi072 bash[21573]: cluster 2024-03-30T15:22:47.926197+0000 mon.a (mon.0) 3153 : cluster 0 osdmap e588: 8 total, 8 up, 8 in 2024-03-30T15:22:49.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:48 smithi072 bash[21573]: audit 2024-03-30T15:22:47.976468+0000 mon.a (mon.0) 3154 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-112", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:22:49.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:48 smithi072 bash[21573]: cluster 2024-03-30T15:22:48.238832+0000 mgr.y (mgr.14526) 587 : cluster 0 pgmap v947: 204 pgs: 32 unknown, 8 creating+peering, 164 active+clean; 582 KiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:22:49.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:48 smithi072 bash[28946]: audit 2024-03-30T15:22:47.916172+0000 mon.a (mon.0) 3152 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-112","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:22:49.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:48 smithi072 bash[28946]: cluster 2024-03-30T15:22:47.926197+0000 mon.a (mon.0) 3153 : cluster 0 osdmap e588: 8 total, 8 up, 8 in 2024-03-30T15:22:49.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:48 smithi072 bash[28946]: audit 2024-03-30T15:22:47.976468+0000 mon.a (mon.0) 3154 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-112", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:22:49.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:48 smithi072 bash[28946]: cluster 2024-03-30T15:22:48.238832+0000 mgr.y (mgr.14526) 587 : cluster 0 pgmap v947: 204 pgs: 32 unknown, 8 creating+peering, 164 active+clean; 582 KiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:22:50.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:49 smithi172 bash[23680]: audit 2024-03-30T15:22:48.927646+0000 mon.a (mon.0) 3155 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-112", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:22:50.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:49 smithi172 bash[23680]: cluster 2024-03-30T15:22:48.938052+0000 mon.a (mon.0) 3156 : cluster 0 osdmap e589: 8 total, 8 up, 8 in 2024-03-30T15:22:50.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:49 smithi172 bash[23680]: audit 2024-03-30T15:22:48.939987+0000 mon.a (mon.0) 3157 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-112"}]: dispatch 2024-03-30T15:22:50.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:49 smithi072 bash[21573]: audit 2024-03-30T15:22:48.927646+0000 mon.a (mon.0) 3155 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-112", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:22:50.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:49 smithi072 bash[21573]: cluster 2024-03-30T15:22:48.938052+0000 mon.a (mon.0) 3156 : cluster 0 osdmap e589: 8 total, 8 up, 8 in 2024-03-30T15:22:50.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:49 smithi072 bash[21573]: audit 2024-03-30T15:22:48.939987+0000 mon.a (mon.0) 3157 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-112"}]: dispatch 2024-03-30T15:22:50.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:49 smithi072 bash[28946]: audit 2024-03-30T15:22:48.927646+0000 mon.a (mon.0) 3155 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-112", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:22:50.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:49 smithi072 bash[28946]: cluster 2024-03-30T15:22:48.938052+0000 mon.a (mon.0) 3156 : cluster 0 osdmap e589: 8 total, 8 up, 8 in 2024-03-30T15:22:50.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:49 smithi072 bash[28946]: audit 2024-03-30T15:22:48.939987+0000 mon.a (mon.0) 3157 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-112"}]: dispatch 2024-03-30T15:22:51.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:50 smithi172 bash[23680]: audit 2024-03-30T15:22:49.930652+0000 mon.a (mon.0) 3158 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-112"}]': finished 2024-03-30T15:22:51.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:50 smithi172 bash[23680]: cluster 2024-03-30T15:22:49.939013+0000 mon.a (mon.0) 3159 : cluster 0 osdmap e590: 8 total, 8 up, 8 in 2024-03-30T15:22:51.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:50 smithi172 bash[23680]: audit 2024-03-30T15:22:50.014049+0000 mon.a (mon.0) 3160 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:22:51.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:50 smithi172 bash[23680]: cluster 2024-03-30T15:22:50.239676+0000 mgr.y (mgr.14526) 588 : cluster 0 pgmap v950: 204 pgs: 32 unknown, 8 creating+peering, 164 active+clean; 582 KiB data, 643 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:22:51.418 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:22:51 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:22:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:22:51.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:50 smithi072 bash[21573]: audit 2024-03-30T15:22:49.930652+0000 mon.a (mon.0) 3158 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-112"}]': finished 2024-03-30T15:22:51.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:50 smithi072 bash[21573]: cluster 2024-03-30T15:22:49.939013+0000 mon.a (mon.0) 3159 : cluster 0 osdmap e590: 8 total, 8 up, 8 in 2024-03-30T15:22:51.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:50 smithi072 bash[21573]: audit 2024-03-30T15:22:50.014049+0000 mon.a (mon.0) 3160 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:22:51.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:50 smithi072 bash[21573]: cluster 2024-03-30T15:22:50.239676+0000 mgr.y (mgr.14526) 588 : cluster 0 pgmap v950: 204 pgs: 32 unknown, 8 creating+peering, 164 active+clean; 582 KiB data, 643 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:22:51.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:50 smithi072 bash[28946]: audit 2024-03-30T15:22:49.930652+0000 mon.a (mon.0) 3158 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-112"}]': finished 2024-03-30T15:22:51.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:50 smithi072 bash[28946]: cluster 2024-03-30T15:22:49.939013+0000 mon.a (mon.0) 3159 : cluster 0 osdmap e590: 8 total, 8 up, 8 in 2024-03-30T15:22:51.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:50 smithi072 bash[28946]: audit 2024-03-30T15:22:50.014049+0000 mon.a (mon.0) 3160 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:22:51.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:50 smithi072 bash[28946]: cluster 2024-03-30T15:22:50.239676+0000 mgr.y (mgr.14526) 588 : cluster 0 pgmap v950: 204 pgs: 32 unknown, 8 creating+peering, 164 active+clean; 582 KiB data, 643 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:22:51.967 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:22:51 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:22:52.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:51 smithi072 bash[21573]: audit 2024-03-30T15:22:50.953617+0000 mon.a (mon.0) 3161 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:22:52.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:51 smithi072 bash[21573]: cluster 2024-03-30T15:22:50.963692+0000 mon.a (mon.0) 3162 : cluster 0 osdmap e591: 8 total, 8 up, 8 in 2024-03-30T15:22:52.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:51 smithi072 bash[21573]: audit 2024-03-30T15:22:50.966260+0000 mon.a (mon.0) 3163 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-112"}]: dispatch 2024-03-30T15:22:52.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:51 smithi072 bash[21573]: audit 2024-03-30T15:22:51.534491+0000 mgr.y (mgr.14526) 589 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:22:52.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:51 smithi072 bash[28946]: audit 2024-03-30T15:22:50.953617+0000 mon.a (mon.0) 3161 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:22:52.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:51 smithi072 bash[28946]: cluster 2024-03-30T15:22:50.963692+0000 mon.a (mon.0) 3162 : cluster 0 osdmap e591: 8 total, 8 up, 8 in 2024-03-30T15:22:52.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:51 smithi072 bash[28946]: audit 2024-03-30T15:22:50.966260+0000 mon.a (mon.0) 3163 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-112"}]: dispatch 2024-03-30T15:22:52.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:51 smithi072 bash[28946]: audit 2024-03-30T15:22:51.534491+0000 mgr.y (mgr.14526) 589 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:22:52.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:51 smithi172 bash[23680]: audit 2024-03-30T15:22:50.953617+0000 mon.a (mon.0) 3161 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:22:52.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:51 smithi172 bash[23680]: cluster 2024-03-30T15:22:50.963692+0000 mon.a (mon.0) 3162 : cluster 0 osdmap e591: 8 total, 8 up, 8 in 2024-03-30T15:22:52.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:51 smithi172 bash[23680]: audit 2024-03-30T15:22:50.966260+0000 mon.a (mon.0) 3163 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-112"}]: dispatch 2024-03-30T15:22:52.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:51 smithi172 bash[23680]: audit 2024-03-30T15:22:51.534491+0000 mgr.y (mgr.14526) 589 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:22:53.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:52 smithi072 bash[21573]: audit 2024-03-30T15:22:51.956425+0000 mon.a (mon.0) 3164 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-112"}]': finished 2024-03-30T15:22:53.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:52 smithi072 bash[21573]: cluster 2024-03-30T15:22:51.963459+0000 mon.a (mon.0) 3165 : cluster 0 osdmap e592: 8 total, 8 up, 8 in 2024-03-30T15:22:53.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:52 smithi072 bash[21573]: audit 2024-03-30T15:22:51.979620+0000 mon.c (mon.2) 503 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:22:53.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:52 smithi072 bash[21573]: cluster 2024-03-30T15:22:52.240480+0000 mgr.y (mgr.14526) 590 : cluster 0 pgmap v953: 204 pgs: 204 active+clean; 582 KiB data, 644 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 2 op/s 2024-03-30T15:22:53.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:52 smithi072 bash[28946]: audit 2024-03-30T15:22:51.956425+0000 mon.a (mon.0) 3164 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-112"}]': finished 2024-03-30T15:22:53.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:52 smithi072 bash[28946]: cluster 2024-03-30T15:22:51.963459+0000 mon.a (mon.0) 3165 : cluster 0 osdmap e592: 8 total, 8 up, 8 in 2024-03-30T15:22:53.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:52 smithi072 bash[28946]: audit 2024-03-30T15:22:51.979620+0000 mon.c (mon.2) 503 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:22:53.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:52 smithi072 bash[28946]: cluster 2024-03-30T15:22:52.240480+0000 mgr.y (mgr.14526) 590 : cluster 0 pgmap v953: 204 pgs: 204 active+clean; 582 KiB data, 644 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 2 op/s 2024-03-30T15:22:53.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:52 smithi172 bash[23680]: audit 2024-03-30T15:22:51.956425+0000 mon.a (mon.0) 3164 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-112"}]': finished 2024-03-30T15:22:53.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:52 smithi172 bash[23680]: cluster 2024-03-30T15:22:51.963459+0000 mon.a (mon.0) 3165 : cluster 0 osdmap e592: 8 total, 8 up, 8 in 2024-03-30T15:22:53.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:52 smithi172 bash[23680]: audit 2024-03-30T15:22:51.979620+0000 mon.c (mon.2) 503 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:22:53.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:52 smithi172 bash[23680]: cluster 2024-03-30T15:22:52.240480+0000 mgr.y (mgr.14526) 590 : cluster 0 pgmap v953: 204 pgs: 204 active+clean; 582 KiB data, 644 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 2 op/s 2024-03-30T15:22:54.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:53 smithi072 bash[21573]: cluster 2024-03-30T15:22:52.970252+0000 mon.a (mon.0) 3166 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:22:54.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:53 smithi072 bash[21573]: cluster 2024-03-30T15:22:52.988309+0000 mon.a (mon.0) 3167 : cluster 0 osdmap e593: 8 total, 8 up, 8 in 2024-03-30T15:22:54.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:53 smithi072 bash[28946]: cluster 2024-03-30T15:22:52.970252+0000 mon.a (mon.0) 3166 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:22:54.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:53 smithi072 bash[28946]: cluster 2024-03-30T15:22:52.988309+0000 mon.a (mon.0) 3167 : cluster 0 osdmap e593: 8 total, 8 up, 8 in 2024-03-30T15:22:54.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:53 smithi172 bash[23680]: cluster 2024-03-30T15:22:52.970252+0000 mon.a (mon.0) 3166 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:22:54.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:53 smithi172 bash[23680]: cluster 2024-03-30T15:22:52.988309+0000 mon.a (mon.0) 3167 : cluster 0 osdmap e593: 8 total, 8 up, 8 in 2024-03-30T15:22:55.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:55 smithi072 bash[21573]: cluster 2024-03-30T15:22:53.994865+0000 mon.a (mon.0) 3168 : cluster 0 osdmap e594: 8 total, 8 up, 8 in 2024-03-30T15:22:55.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:55 smithi072 bash[21573]: audit 2024-03-30T15:22:54.001484+0000 mon.a (mon.0) 3169 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:22:55.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:55 smithi072 bash[21573]: cluster 2024-03-30T15:22:54.241345+0000 mgr.y (mgr.14526) 591 : cluster 0 pgmap v956: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 644 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:22:55.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:55 smithi072 bash[28946]: cluster 2024-03-30T15:22:53.994865+0000 mon.a (mon.0) 3168 : cluster 0 osdmap e594: 8 total, 8 up, 8 in 2024-03-30T15:22:55.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:55 smithi072 bash[28946]: audit 2024-03-30T15:22:54.001484+0000 mon.a (mon.0) 3169 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:22:55.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:55 smithi072 bash[28946]: cluster 2024-03-30T15:22:54.241345+0000 mgr.y (mgr.14526) 591 : cluster 0 pgmap v956: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 644 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:22:55.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:55 smithi172 bash[23680]: cluster 2024-03-30T15:22:53.994865+0000 mon.a (mon.0) 3168 : cluster 0 osdmap e594: 8 total, 8 up, 8 in 2024-03-30T15:22:55.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:55 smithi172 bash[23680]: audit 2024-03-30T15:22:54.001484+0000 mon.a (mon.0) 3169 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:22:55.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:55 smithi172 bash[23680]: cluster 2024-03-30T15:22:54.241345+0000 mgr.y (mgr.14526) 591 : cluster 0 pgmap v956: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 644 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:22:56.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:56 smithi072 bash[21573]: audit 2024-03-30T15:22:54.998952+0000 mon.a (mon.0) 3170 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-114","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:22:56.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:56 smithi072 bash[21573]: cluster 2024-03-30T15:22:55.008358+0000 mon.a (mon.0) 3171 : cluster 0 osdmap e595: 8 total, 8 up, 8 in 2024-03-30T15:22:56.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:56 smithi072 bash[21573]: audit 2024-03-30T15:22:55.052567+0000 mon.a (mon.0) 3172 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-114", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:22:56.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:56 smithi072 bash[28946]: audit 2024-03-30T15:22:54.998952+0000 mon.a (mon.0) 3170 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-114","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:22:56.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:56 smithi072 bash[28946]: cluster 2024-03-30T15:22:55.008358+0000 mon.a (mon.0) 3171 : cluster 0 osdmap e595: 8 total, 8 up, 8 in 2024-03-30T15:22:56.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:56 smithi072 bash[28946]: audit 2024-03-30T15:22:55.052567+0000 mon.a (mon.0) 3172 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-114", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:22:56.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:56 smithi172 bash[23680]: audit 2024-03-30T15:22:54.998952+0000 mon.a (mon.0) 3170 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-114","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:22:56.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:56 smithi172 bash[23680]: cluster 2024-03-30T15:22:55.008358+0000 mon.a (mon.0) 3171 : cluster 0 osdmap e595: 8 total, 8 up, 8 in 2024-03-30T15:22:56.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:56 smithi172 bash[23680]: audit 2024-03-30T15:22:55.052567+0000 mon.a (mon.0) 3172 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-114", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:22:57.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:57 smithi072 bash[21573]: audit 2024-03-30T15:22:56.001811+0000 mon.a (mon.0) 3173 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-114", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:22:57.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:57 smithi072 bash[21573]: cluster 2024-03-30T15:22:56.010312+0000 mon.a (mon.0) 3174 : cluster 0 osdmap e596: 8 total, 8 up, 8 in 2024-03-30T15:22:57.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:57 smithi072 bash[21573]: audit 2024-03-30T15:22:56.012271+0000 mon.a (mon.0) 3175 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-114"}]: dispatch 2024-03-30T15:22:57.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:57 smithi072 bash[21573]: cluster 2024-03-30T15:22:56.242317+0000 mgr.y (mgr.14526) 592 : cluster 0 pgmap v959: 204 pgs: 204 active+clean; 582 KiB data, 653 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T15:22:57.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:57 smithi072 bash[21573]: audit 2024-03-30T15:22:57.004404+0000 mon.a (mon.0) 3176 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-114"}]': finished 2024-03-30T15:22:57.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:57 smithi072 bash[21573]: cluster 2024-03-30T15:22:57.012648+0000 mon.a (mon.0) 3177 : cluster 0 osdmap e597: 8 total, 8 up, 8 in 2024-03-30T15:22:57.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:57 smithi072 bash[21573]: audit 2024-03-30T15:22:57.013872+0000 mon.a (mon.0) 3178 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-114", "mode": "writeback"}]: dispatch 2024-03-30T15:22:57.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:57 smithi072 bash[28946]: audit 2024-03-30T15:22:56.001811+0000 mon.a (mon.0) 3173 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-114", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:22:57.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:57 smithi072 bash[28946]: cluster 2024-03-30T15:22:56.010312+0000 mon.a (mon.0) 3174 : cluster 0 osdmap e596: 8 total, 8 up, 8 in 2024-03-30T15:22:57.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:57 smithi072 bash[28946]: audit 2024-03-30T15:22:56.012271+0000 mon.a (mon.0) 3175 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-114"}]: dispatch 2024-03-30T15:22:57.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:57 smithi072 bash[28946]: cluster 2024-03-30T15:22:56.242317+0000 mgr.y (mgr.14526) 592 : cluster 0 pgmap v959: 204 pgs: 204 active+clean; 582 KiB data, 653 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T15:22:57.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:57 smithi072 bash[28946]: audit 2024-03-30T15:22:57.004404+0000 mon.a (mon.0) 3176 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-114"}]': finished 2024-03-30T15:22:57.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:57 smithi072 bash[28946]: cluster 2024-03-30T15:22:57.012648+0000 mon.a (mon.0) 3177 : cluster 0 osdmap e597: 8 total, 8 up, 8 in 2024-03-30T15:22:57.421 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:57 smithi072 bash[28946]: audit 2024-03-30T15:22:57.013872+0000 mon.a (mon.0) 3178 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-114", "mode": "writeback"}]: dispatch 2024-03-30T15:22:57.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:57 smithi172 bash[23680]: audit 2024-03-30T15:22:56.001811+0000 mon.a (mon.0) 3173 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-114", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:22:57.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:57 smithi172 bash[23680]: cluster 2024-03-30T15:22:56.010312+0000 mon.a (mon.0) 3174 : cluster 0 osdmap e596: 8 total, 8 up, 8 in 2024-03-30T15:22:57.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:57 smithi172 bash[23680]: audit 2024-03-30T15:22:56.012271+0000 mon.a (mon.0) 3175 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-114"}]: dispatch 2024-03-30T15:22:57.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:57 smithi172 bash[23680]: cluster 2024-03-30T15:22:56.242317+0000 mgr.y (mgr.14526) 592 : cluster 0 pgmap v959: 204 pgs: 204 active+clean; 582 KiB data, 653 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T15:22:57.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:57 smithi172 bash[23680]: audit 2024-03-30T15:22:57.004404+0000 mon.a (mon.0) 3176 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-114"}]': finished 2024-03-30T15:22:57.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:57 smithi172 bash[23680]: cluster 2024-03-30T15:22:57.012648+0000 mon.a (mon.0) 3177 : cluster 0 osdmap e597: 8 total, 8 up, 8 in 2024-03-30T15:22:57.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:57 smithi172 bash[23680]: audit 2024-03-30T15:22:57.013872+0000 mon.a (mon.0) 3178 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-114", "mode": "writeback"}]: dispatch 2024-03-30T15:22:58.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:58 smithi072 bash[21573]: cluster 2024-03-30T15:22:58.004825+0000 mon.a (mon.0) 3179 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:22:58.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:58 smithi072 bash[21573]: audit 2024-03-30T15:22:58.007352+0000 mon.a (mon.0) 3180 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-114", "mode": "writeback"}]': finished 2024-03-30T15:22:58.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:58 smithi072 bash[21573]: cluster 2024-03-30T15:22:58.015971+0000 mon.a (mon.0) 3181 : cluster 0 osdmap e598: 8 total, 8 up, 8 in 2024-03-30T15:22:58.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:58 smithi072 bash[28946]: cluster 2024-03-30T15:22:58.004825+0000 mon.a (mon.0) 3179 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:22:58.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:58 smithi072 bash[28946]: audit 2024-03-30T15:22:58.007352+0000 mon.a (mon.0) 3180 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-114", "mode": "writeback"}]': finished 2024-03-30T15:22:58.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:58 smithi072 bash[28946]: cluster 2024-03-30T15:22:58.015971+0000 mon.a (mon.0) 3181 : cluster 0 osdmap e598: 8 total, 8 up, 8 in 2024-03-30T15:22:58.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:58 smithi172 bash[23680]: cluster 2024-03-30T15:22:58.004825+0000 mon.a (mon.0) 3179 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:22:58.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:58 smithi172 bash[23680]: audit 2024-03-30T15:22:58.007352+0000 mon.a (mon.0) 3180 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-114", "mode": "writeback"}]': finished 2024-03-30T15:22:58.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:58 smithi172 bash[23680]: cluster 2024-03-30T15:22:58.015971+0000 mon.a (mon.0) 3181 : cluster 0 osdmap e598: 8 total, 8 up, 8 in 2024-03-30T15:22:59.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:59 smithi072 bash[21573]: audit 2024-03-30T15:22:58.124561+0000 mon.a (mon.0) 3182 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:22:59.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:22:59 smithi072 bash[21573]: cluster 2024-03-30T15:22:58.243173+0000 mgr.y (mgr.14526) 593 : cluster 0 pgmap v962: 204 pgs: 204 active+clean; 582 KiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:22:59.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:59 smithi072 bash[28946]: audit 2024-03-30T15:22:58.124561+0000 mon.a (mon.0) 3182 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:22:59.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:22:59 smithi072 bash[28946]: cluster 2024-03-30T15:22:58.243173+0000 mgr.y (mgr.14526) 593 : cluster 0 pgmap v962: 204 pgs: 204 active+clean; 582 KiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:22:59.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:59 smithi172 bash[23680]: audit 2024-03-30T15:22:58.124561+0000 mon.a (mon.0) 3182 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:22:59.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:22:59 smithi172 bash[23680]: cluster 2024-03-30T15:22:58.243173+0000 mgr.y (mgr.14526) 593 : cluster 0 pgmap v962: 204 pgs: 204 active+clean; 582 KiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:23:00.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:00 smithi072 bash[21573]: audit 2024-03-30T15:22:59.049311+0000 mon.a (mon.0) 3183 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:23:00.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:00 smithi072 bash[21573]: cluster 2024-03-30T15:22:59.057531+0000 mon.a (mon.0) 3184 : cluster 0 osdmap e599: 8 total, 8 up, 8 in 2024-03-30T15:23:00.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:00 smithi072 bash[21573]: audit 2024-03-30T15:22:59.061734+0000 mon.a (mon.0) 3185 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-114"}]: dispatch 2024-03-30T15:23:00.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:00 smithi072 bash[28946]: audit 2024-03-30T15:22:59.049311+0000 mon.a (mon.0) 3183 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:23:00.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:00 smithi072 bash[28946]: cluster 2024-03-30T15:22:59.057531+0000 mon.a (mon.0) 3184 : cluster 0 osdmap e599: 8 total, 8 up, 8 in 2024-03-30T15:23:00.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:00 smithi072 bash[28946]: audit 2024-03-30T15:22:59.061734+0000 mon.a (mon.0) 3185 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-114"}]: dispatch 2024-03-30T15:23:00.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:00 smithi172 bash[23680]: audit 2024-03-30T15:22:59.049311+0000 mon.a (mon.0) 3183 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:23:00.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:00 smithi172 bash[23680]: cluster 2024-03-30T15:22:59.057531+0000 mon.a (mon.0) 3184 : cluster 0 osdmap e599: 8 total, 8 up, 8 in 2024-03-30T15:23:00.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:00 smithi172 bash[23680]: audit 2024-03-30T15:22:59.061734+0000 mon.a (mon.0) 3185 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-114"}]: dispatch 2024-03-30T15:23:01.418 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:23:01 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:23:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:23:01.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:01 smithi072 bash[21573]: cluster 2024-03-30T15:23:00.049547+0000 mon.a (mon.0) 3186 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:23:01.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:01 smithi072 bash[21573]: audit 2024-03-30T15:23:00.052091+0000 mon.a (mon.0) 3187 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-114"}]': finished 2024-03-30T15:23:01.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:01 smithi072 bash[21573]: cluster 2024-03-30T15:23:00.059538+0000 mon.a (mon.0) 3188 : cluster 0 osdmap e600: 8 total, 8 up, 8 in 2024-03-30T15:23:01.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:01 smithi072 bash[21573]: cluster 2024-03-30T15:23:00.243987+0000 mgr.y (mgr.14526) 594 : cluster 0 pgmap v965: 204 pgs: 204 active+clean; 582 KiB data, 653 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:23:01.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:01 smithi072 bash[28946]: cluster 2024-03-30T15:23:00.049547+0000 mon.a (mon.0) 3186 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:23:01.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:01 smithi072 bash[28946]: audit 2024-03-30T15:23:00.052091+0000 mon.a (mon.0) 3187 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-114"}]': finished 2024-03-30T15:23:01.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:01 smithi072 bash[28946]: cluster 2024-03-30T15:23:00.059538+0000 mon.a (mon.0) 3188 : cluster 0 osdmap e600: 8 total, 8 up, 8 in 2024-03-30T15:23:01.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:01 smithi072 bash[28946]: cluster 2024-03-30T15:23:00.243987+0000 mgr.y (mgr.14526) 594 : cluster 0 pgmap v965: 204 pgs: 204 active+clean; 582 KiB data, 653 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:23:01.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:01 smithi172 bash[23680]: cluster 2024-03-30T15:23:00.049547+0000 mon.a (mon.0) 3186 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:23:01.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:01 smithi172 bash[23680]: audit 2024-03-30T15:23:00.052091+0000 mon.a (mon.0) 3187 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-114"}]': finished 2024-03-30T15:23:01.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:01 smithi172 bash[23680]: cluster 2024-03-30T15:23:00.059538+0000 mon.a (mon.0) 3188 : cluster 0 osdmap e600: 8 total, 8 up, 8 in 2024-03-30T15:23:01.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:01 smithi172 bash[23680]: cluster 2024-03-30T15:23:00.243987+0000 mgr.y (mgr.14526) 594 : cluster 0 pgmap v965: 204 pgs: 204 active+clean; 582 KiB data, 653 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:23:01.967 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:23:01 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:23:02.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:02 smithi072 bash[21573]: cluster 2024-03-30T15:23:01.064934+0000 mon.a (mon.0) 3189 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:23:02.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:02 smithi072 bash[21573]: cluster 2024-03-30T15:23:01.084639+0000 mon.a (mon.0) 3190 : cluster 0 osdmap e601: 8 total, 8 up, 8 in 2024-03-30T15:23:02.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:02 smithi072 bash[21573]: audit 2024-03-30T15:23:01.545949+0000 mgr.y (mgr.14526) 595 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:23:02.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:02 smithi072 bash[28946]: cluster 2024-03-30T15:23:01.064934+0000 mon.a (mon.0) 3189 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:23:02.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:02 smithi072 bash[28946]: cluster 2024-03-30T15:23:01.084639+0000 mon.a (mon.0) 3190 : cluster 0 osdmap e601: 8 total, 8 up, 8 in 2024-03-30T15:23:02.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:02 smithi072 bash[28946]: audit 2024-03-30T15:23:01.545949+0000 mgr.y (mgr.14526) 595 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:23:02.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:02 smithi172 bash[23680]: cluster 2024-03-30T15:23:01.064934+0000 mon.a (mon.0) 3189 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:23:02.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:02 smithi172 bash[23680]: cluster 2024-03-30T15:23:01.084639+0000 mon.a (mon.0) 3190 : cluster 0 osdmap e601: 8 total, 8 up, 8 in 2024-03-30T15:23:02.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:02 smithi172 bash[23680]: audit 2024-03-30T15:23:01.545949+0000 mgr.y (mgr.14526) 595 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:23:03.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:03 smithi072 bash[21573]: cluster 2024-03-30T15:23:02.101535+0000 mon.a (mon.0) 3191 : cluster 0 osdmap e602: 8 total, 8 up, 8 in 2024-03-30T15:23:03.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:03 smithi072 bash[21573]: audit 2024-03-30T15:23:02.105354+0000 mon.a (mon.0) 3192 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:23:03.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:03 smithi072 bash[21573]: cluster 2024-03-30T15:23:02.244837+0000 mgr.y (mgr.14526) 596 : cluster 0 pgmap v968: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:23:03.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:03 smithi072 bash[28946]: cluster 2024-03-30T15:23:02.101535+0000 mon.a (mon.0) 3191 : cluster 0 osdmap e602: 8 total, 8 up, 8 in 2024-03-30T15:23:03.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:03 smithi072 bash[28946]: audit 2024-03-30T15:23:02.105354+0000 mon.a (mon.0) 3192 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:23:03.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:03 smithi072 bash[28946]: cluster 2024-03-30T15:23:02.244837+0000 mgr.y (mgr.14526) 596 : cluster 0 pgmap v968: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:23:03.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:03 smithi172 bash[23680]: cluster 2024-03-30T15:23:02.101535+0000 mon.a (mon.0) 3191 : cluster 0 osdmap e602: 8 total, 8 up, 8 in 2024-03-30T15:23:03.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:03 smithi172 bash[23680]: audit 2024-03-30T15:23:02.105354+0000 mon.a (mon.0) 3192 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:23:03.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:03 smithi172 bash[23680]: cluster 2024-03-30T15:23:02.244837+0000 mgr.y (mgr.14526) 596 : cluster 0 pgmap v968: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:23:04.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:04 smithi072 bash[21573]: audit 2024-03-30T15:23:03.100524+0000 mon.a (mon.0) 3193 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-116","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:23:04.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:04 smithi072 bash[21573]: cluster 2024-03-30T15:23:03.111197+0000 mon.a (mon.0) 3194 : cluster 0 osdmap e603: 8 total, 8 up, 8 in 2024-03-30T15:23:04.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:04 smithi072 bash[28946]: audit 2024-03-30T15:23:03.100524+0000 mon.a (mon.0) 3193 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-116","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:23:04.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:04 smithi072 bash[28946]: cluster 2024-03-30T15:23:03.111197+0000 mon.a (mon.0) 3194 : cluster 0 osdmap e603: 8 total, 8 up, 8 in 2024-03-30T15:23:04.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:04 smithi172 bash[23680]: audit 2024-03-30T15:23:03.100524+0000 mon.a (mon.0) 3193 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-116","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:23:04.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:04 smithi172 bash[23680]: cluster 2024-03-30T15:23:03.111197+0000 mon.a (mon.0) 3194 : cluster 0 osdmap e603: 8 total, 8 up, 8 in 2024-03-30T15:23:05.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:05 smithi072 bash[21573]: cluster 2024-03-30T15:23:04.119340+0000 mon.a (mon.0) 3195 : cluster 0 osdmap e604: 8 total, 8 up, 8 in 2024-03-30T15:23:05.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:05 smithi072 bash[21573]: audit 2024-03-30T15:23:04.143525+0000 mon.a (mon.0) 3196 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-116", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:23:05.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:05 smithi072 bash[21573]: cluster 2024-03-30T15:23:04.245693+0000 mgr.y (mgr.14526) 597 : cluster 0 pgmap v971: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:23:05.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:05 smithi072 bash[28946]: cluster 2024-03-30T15:23:04.119340+0000 mon.a (mon.0) 3195 : cluster 0 osdmap e604: 8 total, 8 up, 8 in 2024-03-30T15:23:05.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:05 smithi072 bash[28946]: audit 2024-03-30T15:23:04.143525+0000 mon.a (mon.0) 3196 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-116", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:23:05.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:05 smithi072 bash[28946]: cluster 2024-03-30T15:23:04.245693+0000 mgr.y (mgr.14526) 597 : cluster 0 pgmap v971: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:23:05.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:05 smithi172 bash[23680]: cluster 2024-03-30T15:23:04.119340+0000 mon.a (mon.0) 3195 : cluster 0 osdmap e604: 8 total, 8 up, 8 in 2024-03-30T15:23:05.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:05 smithi172 bash[23680]: audit 2024-03-30T15:23:04.143525+0000 mon.a (mon.0) 3196 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-116", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:23:05.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:05 smithi172 bash[23680]: cluster 2024-03-30T15:23:04.245693+0000 mgr.y (mgr.14526) 597 : cluster 0 pgmap v971: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:23:06.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:06 smithi072 bash[21573]: audit 2024-03-30T15:23:05.120682+0000 mon.a (mon.0) 3197 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-116", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:23:06.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:06 smithi072 bash[21573]: cluster 2024-03-30T15:23:05.130068+0000 mon.a (mon.0) 3198 : cluster 0 osdmap e605: 8 total, 8 up, 8 in 2024-03-30T15:23:06.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:06 smithi072 bash[21573]: audit 2024-03-30T15:23:05.131386+0000 mon.a (mon.0) 3199 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-116"}]: dispatch 2024-03-30T15:23:06.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:06 smithi072 bash[28946]: audit 2024-03-30T15:23:05.120682+0000 mon.a (mon.0) 3197 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-116", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:23:06.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:06 smithi072 bash[28946]: cluster 2024-03-30T15:23:05.130068+0000 mon.a (mon.0) 3198 : cluster 0 osdmap e605: 8 total, 8 up, 8 in 2024-03-30T15:23:06.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:06 smithi072 bash[28946]: audit 2024-03-30T15:23:05.131386+0000 mon.a (mon.0) 3199 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-116"}]: dispatch 2024-03-30T15:23:06.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:06 smithi172 bash[23680]: audit 2024-03-30T15:23:05.120682+0000 mon.a (mon.0) 3197 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-116", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:23:06.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:06 smithi172 bash[23680]: cluster 2024-03-30T15:23:05.130068+0000 mon.a (mon.0) 3198 : cluster 0 osdmap e605: 8 total, 8 up, 8 in 2024-03-30T15:23:06.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:06 smithi172 bash[23680]: audit 2024-03-30T15:23:05.131386+0000 mon.a (mon.0) 3199 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-116"}]: dispatch 2024-03-30T15:23:07.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:07 smithi072 bash[21573]: audit 2024-03-30T15:23:06.130703+0000 mon.a (mon.0) 3200 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-116"}]': finished 2024-03-30T15:23:07.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:07 smithi072 bash[21573]: cluster 2024-03-30T15:23:06.138122+0000 mon.a (mon.0) 3201 : cluster 0 osdmap e606: 8 total, 8 up, 8 in 2024-03-30T15:23:07.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:07 smithi072 bash[21573]: audit 2024-03-30T15:23:06.139290+0000 mon.a (mon.0) 3202 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-116", "mode": "writeback"}]: dispatch 2024-03-30T15:23:07.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:07 smithi072 bash[21573]: cluster 2024-03-30T15:23:06.246532+0000 mgr.y (mgr.14526) 598 : cluster 0 pgmap v974: 204 pgs: 204 active+clean; 582 KiB data, 654 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-03-30T15:23:07.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:07 smithi072 bash[21573]: audit 2024-03-30T15:23:07.019327+0000 mon.c (mon.2) 504 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:23:07.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:07 smithi072 bash[28946]: audit 2024-03-30T15:23:06.130703+0000 mon.a (mon.0) 3200 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-116"}]': finished 2024-03-30T15:23:07.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:07 smithi072 bash[28946]: cluster 2024-03-30T15:23:06.138122+0000 mon.a (mon.0) 3201 : cluster 0 osdmap e606: 8 total, 8 up, 8 in 2024-03-30T15:23:07.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:07 smithi072 bash[28946]: audit 2024-03-30T15:23:06.139290+0000 mon.a (mon.0) 3202 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-116", "mode": "writeback"}]: dispatch 2024-03-30T15:23:07.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:07 smithi072 bash[28946]: cluster 2024-03-30T15:23:06.246532+0000 mgr.y (mgr.14526) 598 : cluster 0 pgmap v974: 204 pgs: 204 active+clean; 582 KiB data, 654 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-03-30T15:23:07.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:07 smithi072 bash[28946]: audit 2024-03-30T15:23:07.019327+0000 mon.c (mon.2) 504 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:23:07.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:07 smithi172 bash[23680]: audit 2024-03-30T15:23:06.130703+0000 mon.a (mon.0) 3200 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-116"}]': finished 2024-03-30T15:23:07.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:07 smithi172 bash[23680]: cluster 2024-03-30T15:23:06.138122+0000 mon.a (mon.0) 3201 : cluster 0 osdmap e606: 8 total, 8 up, 8 in 2024-03-30T15:23:07.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:07 smithi172 bash[23680]: audit 2024-03-30T15:23:06.139290+0000 mon.a (mon.0) 3202 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-116", "mode": "writeback"}]: dispatch 2024-03-30T15:23:07.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:07 smithi172 bash[23680]: cluster 2024-03-30T15:23:06.246532+0000 mgr.y (mgr.14526) 598 : cluster 0 pgmap v974: 204 pgs: 204 active+clean; 582 KiB data, 654 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-03-30T15:23:07.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:07 smithi172 bash[23680]: audit 2024-03-30T15:23:07.019327+0000 mon.c (mon.2) 504 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:23:08.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:08 smithi072 bash[21573]: cluster 2024-03-30T15:23:07.131617+0000 mon.a (mon.0) 3203 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:23:08.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:08 smithi072 bash[21573]: audit 2024-03-30T15:23:07.140031+0000 mon.a (mon.0) 3204 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-116", "mode": "writeback"}]': finished 2024-03-30T15:23:08.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:08 smithi072 bash[21573]: cluster 2024-03-30T15:23:07.149500+0000 mon.a (mon.0) 3205 : cluster 0 osdmap e607: 8 total, 8 up, 8 in 2024-03-30T15:23:08.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:08 smithi072 bash[21573]: audit 2024-03-30T15:23:07.186849+0000 mon.a (mon.0) 3206 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "326.0"}]: dispatch 2024-03-30T15:23:08.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:08 smithi072 bash[21573]: audit 2024-03-30T15:23:07.187302+0000 mgr.y (mgr.14526) 599 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "326.0"}]: dispatch 2024-03-30T15:23:08.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:08 smithi072 bash[21573]: cluster 2024-03-30T15:23:07.282720+0000 mon.a (mon.0) 3207 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:23:08.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:08 smithi072 bash[21573]: cluster 2024-03-30T15:23:07.343538+0000 osd.4 (osd.4) 11 : cluster 0 326.0 scrub starts 2024-03-30T15:23:08.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:08 smithi072 bash[21573]: cluster 2024-03-30T15:23:07.346164+0000 osd.4 (osd.4) 12 : cluster 0 326.0 scrub ok 2024-03-30T15:23:08.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:08 smithi072 bash[28946]: cluster 2024-03-30T15:23:07.131617+0000 mon.a (mon.0) 3203 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:23:08.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:08 smithi072 bash[28946]: audit 2024-03-30T15:23:07.140031+0000 mon.a (mon.0) 3204 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-116", "mode": "writeback"}]': finished 2024-03-30T15:23:08.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:08 smithi072 bash[28946]: cluster 2024-03-30T15:23:07.149500+0000 mon.a (mon.0) 3205 : cluster 0 osdmap e607: 8 total, 8 up, 8 in 2024-03-30T15:23:08.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:08 smithi072 bash[28946]: audit 2024-03-30T15:23:07.186849+0000 mon.a (mon.0) 3206 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "326.0"}]: dispatch 2024-03-30T15:23:08.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:08 smithi072 bash[28946]: audit 2024-03-30T15:23:07.187302+0000 mgr.y (mgr.14526) 599 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "326.0"}]: dispatch 2024-03-30T15:23:08.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:08 smithi072 bash[28946]: cluster 2024-03-30T15:23:07.282720+0000 mon.a (mon.0) 3207 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:23:08.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:08 smithi072 bash[28946]: cluster 2024-03-30T15:23:07.343538+0000 osd.4 (osd.4) 11 : cluster 0 326.0 scrub starts 2024-03-30T15:23:08.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:08 smithi072 bash[28946]: cluster 2024-03-30T15:23:07.346164+0000 osd.4 (osd.4) 12 : cluster 0 326.0 scrub ok 2024-03-30T15:23:08.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:08 smithi172 bash[23680]: cluster 2024-03-30T15:23:07.131617+0000 mon.a (mon.0) 3203 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:23:08.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:08 smithi172 bash[23680]: audit 2024-03-30T15:23:07.140031+0000 mon.a (mon.0) 3204 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-116", "mode": "writeback"}]': finished 2024-03-30T15:23:08.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:08 smithi172 bash[23680]: cluster 2024-03-30T15:23:07.149500+0000 mon.a (mon.0) 3205 : cluster 0 osdmap e607: 8 total, 8 up, 8 in 2024-03-30T15:23:08.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:08 smithi172 bash[23680]: audit 2024-03-30T15:23:07.186849+0000 mon.a (mon.0) 3206 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "326.0"}]: dispatch 2024-03-30T15:23:08.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:08 smithi172 bash[23680]: audit 2024-03-30T15:23:07.187302+0000 mgr.y (mgr.14526) 599 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "326.0"}]: dispatch 2024-03-30T15:23:08.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:08 smithi172 bash[23680]: cluster 2024-03-30T15:23:07.282720+0000 mon.a (mon.0) 3207 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:23:08.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:08 smithi172 bash[23680]: cluster 2024-03-30T15:23:07.343538+0000 osd.4 (osd.4) 11 : cluster 0 326.0 scrub starts 2024-03-30T15:23:08.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:08 smithi172 bash[23680]: cluster 2024-03-30T15:23:07.346164+0000 osd.4 (osd.4) 12 : cluster 0 326.0 scrub ok 2024-03-30T15:23:09.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:09 smithi072 bash[21573]: cluster 2024-03-30T15:23:08.247302+0000 mgr.y (mgr.14526) 600 : cluster 0 pgmap v976: 204 pgs: 204 active+clean; 582 KiB data, 654 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-03-30T15:23:09.418 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:09 smithi072 bash[28946]: cluster 2024-03-30T15:23:08.247302+0000 mgr.y (mgr.14526) 600 : cluster 0 pgmap v976: 204 pgs: 204 active+clean; 582 KiB data, 654 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-03-30T15:23:09.466 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:09 smithi172 bash[23680]: cluster 2024-03-30T15:23:08.247302+0000 mgr.y (mgr.14526) 600 : cluster 0 pgmap v976: 204 pgs: 204 active+clean; 582 KiB data, 654 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-03-30T15:23:11.302 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:23:11 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:23:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:23:11.554 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:11 smithi172 bash[23680]: cluster 2024-03-30T15:23:10.248079+0000 mgr.y (mgr.14526) 601 : cluster 0 pgmap v977: 204 pgs: 204 active+clean; 582 KiB data, 654 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 1.2 KiB/s wr, 2 op/s 2024-03-30T15:23:11.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:11 smithi072 bash[21573]: cluster 2024-03-30T15:23:10.248079+0000 mgr.y (mgr.14526) 601 : cluster 0 pgmap v977: 204 pgs: 204 active+clean; 582 KiB data, 654 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 1.2 KiB/s wr, 2 op/s 2024-03-30T15:23:11.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:11 smithi072 bash[28946]: cluster 2024-03-30T15:23:10.248079+0000 mgr.y (mgr.14526) 601 : cluster 0 pgmap v977: 204 pgs: 204 active+clean; 582 KiB data, 654 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 1.2 KiB/s wr, 2 op/s 2024-03-30T15:23:11.967 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:23:11 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:23:12.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:12 smithi072 bash[21573]: audit 2024-03-30T15:23:11.557428+0000 mgr.y (mgr.14526) 602 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:23:12.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:12 smithi072 bash[28946]: audit 2024-03-30T15:23:11.557428+0000 mgr.y (mgr.14526) 602 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:23:12.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:12 smithi172 bash[23680]: audit 2024-03-30T15:23:11.557428+0000 mgr.y (mgr.14526) 602 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:23:13.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:13 smithi072 bash[21573]: cluster 2024-03-30T15:23:12.250174+0000 mgr.y (mgr.14526) 603 : cluster 0 pgmap v978: 204 pgs: 204 active+clean; 582 KiB data, 654 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1005 B/s wr, 3 op/s 2024-03-30T15:23:13.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:13 smithi072 bash[28946]: cluster 2024-03-30T15:23:12.250174+0000 mgr.y (mgr.14526) 603 : cluster 0 pgmap v978: 204 pgs: 204 active+clean; 582 KiB data, 654 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1005 B/s wr, 3 op/s 2024-03-30T15:23:13.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:13 smithi172 bash[23680]: cluster 2024-03-30T15:23:12.250174+0000 mgr.y (mgr.14526) 603 : cluster 0 pgmap v978: 204 pgs: 204 active+clean; 582 KiB data, 654 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1005 B/s wr, 3 op/s 2024-03-30T15:23:15.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:15 smithi072 bash[21573]: cluster 2024-03-30T15:23:14.251000+0000 mgr.y (mgr.14526) 604 : cluster 0 pgmap v979: 204 pgs: 204 active+clean; 582 KiB data, 654 MiB used, 715 GiB / 715 GiB avail; 882 B/s rd, 1 op/s 2024-03-30T15:23:15.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:15 smithi072 bash[28946]: cluster 2024-03-30T15:23:14.251000+0000 mgr.y (mgr.14526) 604 : cluster 0 pgmap v979: 204 pgs: 204 active+clean; 582 KiB data, 654 MiB used, 715 GiB / 715 GiB avail; 882 B/s rd, 1 op/s 2024-03-30T15:23:15.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:15 smithi172 bash[23680]: cluster 2024-03-30T15:23:14.251000+0000 mgr.y (mgr.14526) 604 : cluster 0 pgmap v979: 204 pgs: 204 active+clean; 582 KiB data, 654 MiB used, 715 GiB / 715 GiB avail; 882 B/s rd, 1 op/s 2024-03-30T15:23:17.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:17 smithi072 bash[21573]: cluster 2024-03-30T15:23:16.253121+0000 mgr.y (mgr.14526) 605 : cluster 0 pgmap v980: 204 pgs: 204 active+clean; 582 KiB data, 654 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:23:17.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:17 smithi072 bash[28946]: cluster 2024-03-30T15:23:16.253121+0000 mgr.y (mgr.14526) 605 : cluster 0 pgmap v980: 204 pgs: 204 active+clean; 582 KiB data, 654 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:23:17.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:17 smithi172 bash[23680]: cluster 2024-03-30T15:23:16.253121+0000 mgr.y (mgr.14526) 605 : cluster 0 pgmap v980: 204 pgs: 204 active+clean; 582 KiB data, 654 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:23:19.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:19 smithi072 bash[21573]: cluster 2024-03-30T15:23:18.254006+0000 mgr.y (mgr.14526) 606 : cluster 0 pgmap v981: 204 pgs: 204 active+clean; 582 KiB data, 654 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T15:23:19.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:19 smithi072 bash[28946]: cluster 2024-03-30T15:23:18.254006+0000 mgr.y (mgr.14526) 606 : cluster 0 pgmap v981: 204 pgs: 204 active+clean; 582 KiB data, 654 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T15:23:19.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:19 smithi172 bash[23680]: cluster 2024-03-30T15:23:18.254006+0000 mgr.y (mgr.14526) 606 : cluster 0 pgmap v981: 204 pgs: 204 active+clean; 582 KiB data, 654 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T15:23:21.330 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:23:21 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:23:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:23:21.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:21 smithi072 bash[21573]: cluster 2024-03-30T15:23:20.254805+0000 mgr.y (mgr.14526) 607 : cluster 0 pgmap v982: 204 pgs: 204 active+clean; 582 KiB data, 654 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-03-30T15:23:21.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:21 smithi072 bash[28946]: cluster 2024-03-30T15:23:20.254805+0000 mgr.y (mgr.14526) 607 : cluster 0 pgmap v982: 204 pgs: 204 active+clean; 582 KiB data, 654 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-03-30T15:23:21.717 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:23:21 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:23:21.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:21 smithi172 bash[23680]: cluster 2024-03-30T15:23:20.254805+0000 mgr.y (mgr.14526) 607 : cluster 0 pgmap v982: 204 pgs: 204 active+clean; 582 KiB data, 654 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-03-30T15:23:22.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:22 smithi072 bash[21573]: audit 2024-03-30T15:23:21.565335+0000 mgr.y (mgr.14526) 608 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:23:22.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:22 smithi072 bash[21573]: audit 2024-03-30T15:23:22.058533+0000 mon.a (mon.0) 3208 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:23:22.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:22 smithi072 bash[21573]: audit 2024-03-30T15:23:22.061422+0000 mon.c (mon.2) 505 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:23:22.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:22 smithi072 bash[28946]: audit 2024-03-30T15:23:21.565335+0000 mgr.y (mgr.14526) 608 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:23:22.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:22 smithi072 bash[28946]: audit 2024-03-30T15:23:22.058533+0000 mon.a (mon.0) 3208 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:23:22.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:22 smithi072 bash[28946]: audit 2024-03-30T15:23:22.061422+0000 mon.c (mon.2) 505 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:23:22.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:22 smithi172 bash[23680]: audit 2024-03-30T15:23:21.565335+0000 mgr.y (mgr.14526) 608 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:23:22.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:22 smithi172 bash[23680]: audit 2024-03-30T15:23:22.058533+0000 mon.a (mon.0) 3208 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:23:22.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:22 smithi172 bash[23680]: audit 2024-03-30T15:23:22.061422+0000 mon.c (mon.2) 505 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:23:23.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:23 smithi072 bash[28946]: cluster 2024-03-30T15:23:22.256952+0000 mgr.y (mgr.14526) 609 : cluster 0 pgmap v983: 204 pgs: 204 active+clean; 582 KiB data, 654 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-03-30T15:23:23.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:23 smithi072 bash[28946]: cluster 2024-03-30T15:23:23.073999+0000 mon.a (mon.0) 3209 : cluster 0 osdmap e608: 8 total, 8 up, 8 in 2024-03-30T15:23:23.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:23 smithi072 bash[28946]: audit 2024-03-30T15:23:23.148664+0000 mon.a (mon.0) 3210 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:23:23.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:23 smithi072 bash[21573]: cluster 2024-03-30T15:23:22.256952+0000 mgr.y (mgr.14526) 609 : cluster 0 pgmap v983: 204 pgs: 204 active+clean; 582 KiB data, 654 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-03-30T15:23:23.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:23 smithi072 bash[21573]: cluster 2024-03-30T15:23:23.073999+0000 mon.a (mon.0) 3209 : cluster 0 osdmap e608: 8 total, 8 up, 8 in 2024-03-30T15:23:23.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:23 smithi072 bash[21573]: audit 2024-03-30T15:23:23.148664+0000 mon.a (mon.0) 3210 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:23:23.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:23 smithi172 bash[23680]: cluster 2024-03-30T15:23:22.256952+0000 mgr.y (mgr.14526) 609 : cluster 0 pgmap v983: 204 pgs: 204 active+clean; 582 KiB data, 654 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-03-30T15:23:23.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:23 smithi172 bash[23680]: cluster 2024-03-30T15:23:23.073999+0000 mon.a (mon.0) 3209 : cluster 0 osdmap e608: 8 total, 8 up, 8 in 2024-03-30T15:23:23.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:23 smithi172 bash[23680]: audit 2024-03-30T15:23:23.148664+0000 mon.a (mon.0) 3210 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:23:24.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:24 smithi072 bash[28946]: audit 2024-03-30T15:23:23.711776+0000 mon.c (mon.2) 506 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:23:24.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:24 smithi072 bash[28946]: audit 2024-03-30T15:23:24.069924+0000 mon.a (mon.0) 3211 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:23:24.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:24 smithi072 bash[28946]: cluster 2024-03-30T15:23:24.077464+0000 mon.a (mon.0) 3212 : cluster 0 osdmap e609: 8 total, 8 up, 8 in 2024-03-30T15:23:24.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:24 smithi072 bash[28946]: audit 2024-03-30T15:23:24.079070+0000 mon.a (mon.0) 3213 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-116"}]: dispatch 2024-03-30T15:23:24.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:24 smithi072 bash[21573]: audit 2024-03-30T15:23:23.711776+0000 mon.c (mon.2) 506 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:23:24.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:24 smithi072 bash[21573]: audit 2024-03-30T15:23:24.069924+0000 mon.a (mon.0) 3211 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:23:24.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:24 smithi072 bash[21573]: cluster 2024-03-30T15:23:24.077464+0000 mon.a (mon.0) 3212 : cluster 0 osdmap e609: 8 total, 8 up, 8 in 2024-03-30T15:23:24.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:24 smithi072 bash[21573]: audit 2024-03-30T15:23:24.079070+0000 mon.a (mon.0) 3213 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-116"}]: dispatch 2024-03-30T15:23:24.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:24 smithi172 bash[23680]: audit 2024-03-30T15:23:23.711776+0000 mon.c (mon.2) 506 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:23:24.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:24 smithi172 bash[23680]: audit 2024-03-30T15:23:24.069924+0000 mon.a (mon.0) 3211 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:23:24.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:24 smithi172 bash[23680]: cluster 2024-03-30T15:23:24.077464+0000 mon.a (mon.0) 3212 : cluster 0 osdmap e609: 8 total, 8 up, 8 in 2024-03-30T15:23:24.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:24 smithi172 bash[23680]: audit 2024-03-30T15:23:24.079070+0000 mon.a (mon.0) 3213 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-116"}]: dispatch 2024-03-30T15:23:25.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:25 smithi072 bash[21573]: cluster 2024-03-30T15:23:24.257482+0000 mgr.y (mgr.14526) 610 : cluster 0 pgmap v986: 204 pgs: 204 active+clean; 582 KiB data, 654 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-30T15:23:25.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:25 smithi072 bash[21573]: audit 2024-03-30T15:23:24.449404+0000 mon.c (mon.2) 507 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:23:25.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:25 smithi072 bash[21573]: audit 2024-03-30T15:23:24.450802+0000 mon.c (mon.2) 508 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:23:25.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:25 smithi072 bash[21573]: audit 2024-03-30T15:23:24.457964+0000 mon.a (mon.0) 3214 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:23:25.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:25 smithi072 bash[21573]: cluster 2024-03-30T15:23:25.070916+0000 mon.a (mon.0) 3215 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:23:25.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:25 smithi072 bash[21573]: audit 2024-03-30T15:23:25.081383+0000 mon.a (mon.0) 3216 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-116"}]': finished 2024-03-30T15:23:25.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:25 smithi072 bash[21573]: cluster 2024-03-30T15:23:25.088972+0000 mon.a (mon.0) 3217 : cluster 0 osdmap e610: 8 total, 8 up, 8 in 2024-03-30T15:23:25.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:25 smithi072 bash[28946]: cluster 2024-03-30T15:23:24.257482+0000 mgr.y (mgr.14526) 610 : cluster 0 pgmap v986: 204 pgs: 204 active+clean; 582 KiB data, 654 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-30T15:23:25.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:25 smithi072 bash[28946]: audit 2024-03-30T15:23:24.449404+0000 mon.c (mon.2) 507 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:23:25.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:25 smithi072 bash[28946]: audit 2024-03-30T15:23:24.450802+0000 mon.c (mon.2) 508 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:23:25.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:25 smithi072 bash[28946]: audit 2024-03-30T15:23:24.457964+0000 mon.a (mon.0) 3214 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:23:25.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:25 smithi072 bash[28946]: cluster 2024-03-30T15:23:25.070916+0000 mon.a (mon.0) 3215 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:23:25.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:25 smithi072 bash[28946]: audit 2024-03-30T15:23:25.081383+0000 mon.a (mon.0) 3216 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-116"}]': finished 2024-03-30T15:23:25.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:25 smithi072 bash[28946]: cluster 2024-03-30T15:23:25.088972+0000 mon.a (mon.0) 3217 : cluster 0 osdmap e610: 8 total, 8 up, 8 in 2024-03-30T15:23:25.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:25 smithi172 bash[23680]: cluster 2024-03-30T15:23:24.257482+0000 mgr.y (mgr.14526) 610 : cluster 0 pgmap v986: 204 pgs: 204 active+clean; 582 KiB data, 654 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-30T15:23:25.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:25 smithi172 bash[23680]: audit 2024-03-30T15:23:24.449404+0000 mon.c (mon.2) 507 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:23:25.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:25 smithi172 bash[23680]: audit 2024-03-30T15:23:24.450802+0000 mon.c (mon.2) 508 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:23:25.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:25 smithi172 bash[23680]: audit 2024-03-30T15:23:24.457964+0000 mon.a (mon.0) 3214 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:23:25.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:25 smithi172 bash[23680]: cluster 2024-03-30T15:23:25.070916+0000 mon.a (mon.0) 3215 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:23:25.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:25 smithi172 bash[23680]: audit 2024-03-30T15:23:25.081383+0000 mon.a (mon.0) 3216 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-116"}]': finished 2024-03-30T15:23:25.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:25 smithi172 bash[23680]: cluster 2024-03-30T15:23:25.088972+0000 mon.a (mon.0) 3217 : cluster 0 osdmap e610: 8 total, 8 up, 8 in 2024-03-30T15:23:27.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:27 smithi072 bash[21573]: cluster 2024-03-30T15:23:26.096488+0000 mon.a (mon.0) 3218 : cluster 0 osdmap e611: 8 total, 8 up, 8 in 2024-03-30T15:23:27.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:27 smithi072 bash[21573]: cluster 2024-03-30T15:23:26.258184+0000 mgr.y (mgr.14526) 611 : cluster 0 pgmap v989: 172 pgs: 172 active+clean; 582 KiB data, 655 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-03-30T15:23:27.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:27 smithi072 bash[28946]: cluster 2024-03-30T15:23:26.096488+0000 mon.a (mon.0) 3218 : cluster 0 osdmap e611: 8 total, 8 up, 8 in 2024-03-30T15:23:27.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:27 smithi072 bash[28946]: cluster 2024-03-30T15:23:26.258184+0000 mgr.y (mgr.14526) 611 : cluster 0 pgmap v989: 172 pgs: 172 active+clean; 582 KiB data, 655 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-03-30T15:23:27.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:27 smithi172 bash[23680]: cluster 2024-03-30T15:23:26.096488+0000 mon.a (mon.0) 3218 : cluster 0 osdmap e611: 8 total, 8 up, 8 in 2024-03-30T15:23:27.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:27 smithi172 bash[23680]: cluster 2024-03-30T15:23:26.258184+0000 mgr.y (mgr.14526) 611 : cluster 0 pgmap v989: 172 pgs: 172 active+clean; 582 KiB data, 655 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-03-30T15:23:28.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:28 smithi072 bash[21573]: cluster 2024-03-30T15:23:27.107666+0000 mon.a (mon.0) 3219 : cluster 0 osdmap e612: 8 total, 8 up, 8 in 2024-03-30T15:23:28.418 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:28 smithi072 bash[21573]: audit 2024-03-30T15:23:27.110978+0000 mon.a (mon.0) 3220 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:23:28.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:28 smithi072 bash[21573]: audit 2024-03-30T15:23:27.291522+0000 mon.a (mon.0) 3221 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-118","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:23:28.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:28 smithi072 bash[21573]: cluster 2024-03-30T15:23:27.303190+0000 mon.a (mon.0) 3222 : cluster 0 osdmap e613: 8 total, 8 up, 8 in 2024-03-30T15:23:28.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:28 smithi072 bash[28946]: cluster 2024-03-30T15:23:27.107666+0000 mon.a (mon.0) 3219 : cluster 0 osdmap e612: 8 total, 8 up, 8 in 2024-03-30T15:23:28.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:28 smithi072 bash[28946]: audit 2024-03-30T15:23:27.110978+0000 mon.a (mon.0) 3220 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:23:28.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:28 smithi072 bash[28946]: audit 2024-03-30T15:23:27.291522+0000 mon.a (mon.0) 3221 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-118","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:23:28.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:28 smithi072 bash[28946]: cluster 2024-03-30T15:23:27.303190+0000 mon.a (mon.0) 3222 : cluster 0 osdmap e613: 8 total, 8 up, 8 in 2024-03-30T15:23:28.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:28 smithi172 bash[23680]: cluster 2024-03-30T15:23:27.107666+0000 mon.a (mon.0) 3219 : cluster 0 osdmap e612: 8 total, 8 up, 8 in 2024-03-30T15:23:28.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:28 smithi172 bash[23680]: audit 2024-03-30T15:23:27.110978+0000 mon.a (mon.0) 3220 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:23:28.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:28 smithi172 bash[23680]: audit 2024-03-30T15:23:27.291522+0000 mon.a (mon.0) 3221 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-118","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:23:28.467 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:28 smithi172 bash[23680]: cluster 2024-03-30T15:23:27.303190+0000 mon.a (mon.0) 3222 : cluster 0 osdmap e613: 8 total, 8 up, 8 in 2024-03-30T15:23:29.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:29 smithi072 bash[21573]: cluster 2024-03-30T15:23:28.259007+0000 mgr.y (mgr.14526) 612 : cluster 0 pgmap v992: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 655 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-03-30T15:23:29.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:29 smithi072 bash[21573]: cluster 2024-03-30T15:23:28.302691+0000 mon.a (mon.0) 3223 : cluster 0 osdmap e614: 8 total, 8 up, 8 in 2024-03-30T15:23:29.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:29 smithi072 bash[21573]: audit 2024-03-30T15:23:28.318781+0000 mon.a (mon.0) 3224 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-118", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:23:29.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:29 smithi072 bash[28946]: cluster 2024-03-30T15:23:28.259007+0000 mgr.y (mgr.14526) 612 : cluster 0 pgmap v992: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 655 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-03-30T15:23:29.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:29 smithi072 bash[28946]: cluster 2024-03-30T15:23:28.302691+0000 mon.a (mon.0) 3223 : cluster 0 osdmap e614: 8 total, 8 up, 8 in 2024-03-30T15:23:29.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:29 smithi072 bash[28946]: audit 2024-03-30T15:23:28.318781+0000 mon.a (mon.0) 3224 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-118", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:23:29.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:29 smithi172 bash[23680]: cluster 2024-03-30T15:23:28.259007+0000 mgr.y (mgr.14526) 612 : cluster 0 pgmap v992: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 655 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-03-30T15:23:29.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:29 smithi172 bash[23680]: cluster 2024-03-30T15:23:28.302691+0000 mon.a (mon.0) 3223 : cluster 0 osdmap e614: 8 total, 8 up, 8 in 2024-03-30T15:23:29.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:29 smithi172 bash[23680]: audit 2024-03-30T15:23:28.318781+0000 mon.a (mon.0) 3224 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-118", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:23:30.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:30 smithi072 bash[21573]: audit 2024-03-30T15:23:29.296734+0000 mon.a (mon.0) 3225 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-118", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:23:30.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:30 smithi072 bash[21573]: cluster 2024-03-30T15:23:29.304139+0000 mon.a (mon.0) 3226 : cluster 0 osdmap e615: 8 total, 8 up, 8 in 2024-03-30T15:23:30.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:30 smithi072 bash[21573]: audit 2024-03-30T15:23:29.307590+0000 mon.a (mon.0) 3227 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-118"}]: dispatch 2024-03-30T15:23:30.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:30 smithi072 bash[21573]: audit 2024-03-30T15:23:30.299635+0000 mon.a (mon.0) 3228 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-118"}]': finished 2024-03-30T15:23:30.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:30 smithi072 bash[21573]: cluster 2024-03-30T15:23:30.307834+0000 mon.a (mon.0) 3229 : cluster 0 osdmap e616: 8 total, 8 up, 8 in 2024-03-30T15:23:30.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:30 smithi072 bash[28946]: audit 2024-03-30T15:23:29.296734+0000 mon.a (mon.0) 3225 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-118", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:23:30.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:30 smithi072 bash[28946]: cluster 2024-03-30T15:23:29.304139+0000 mon.a (mon.0) 3226 : cluster 0 osdmap e615: 8 total, 8 up, 8 in 2024-03-30T15:23:30.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:30 smithi072 bash[28946]: audit 2024-03-30T15:23:29.307590+0000 mon.a (mon.0) 3227 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-118"}]: dispatch 2024-03-30T15:23:30.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:30 smithi072 bash[28946]: audit 2024-03-30T15:23:30.299635+0000 mon.a (mon.0) 3228 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-118"}]': finished 2024-03-30T15:23:30.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:30 smithi072 bash[28946]: cluster 2024-03-30T15:23:30.307834+0000 mon.a (mon.0) 3229 : cluster 0 osdmap e616: 8 total, 8 up, 8 in 2024-03-30T15:23:30.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:30 smithi172 bash[23680]: audit 2024-03-30T15:23:29.296734+0000 mon.a (mon.0) 3225 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-118", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:23:30.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:30 smithi172 bash[23680]: cluster 2024-03-30T15:23:29.304139+0000 mon.a (mon.0) 3226 : cluster 0 osdmap e615: 8 total, 8 up, 8 in 2024-03-30T15:23:30.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:30 smithi172 bash[23680]: audit 2024-03-30T15:23:29.307590+0000 mon.a (mon.0) 3227 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-118"}]: dispatch 2024-03-30T15:23:30.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:30 smithi172 bash[23680]: audit 2024-03-30T15:23:30.299635+0000 mon.a (mon.0) 3228 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-118"}]': finished 2024-03-30T15:23:30.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:30 smithi172 bash[23680]: cluster 2024-03-30T15:23:30.307834+0000 mon.a (mon.0) 3229 : cluster 0 osdmap e616: 8 total, 8 up, 8 in 2024-03-30T15:23:31.320 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:23:31 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:23:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:23:31.574 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:31 smithi172 bash[23680]: cluster 2024-03-30T15:23:30.259781+0000 mgr.y (mgr.14526) 613 : cluster 0 pgmap v995: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 655 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:23:31.574 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:31 smithi172 bash[23680]: audit 2024-03-30T15:23:30.309407+0000 mon.a (mon.0) 3230 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-118", "mode": "writeback"}]: dispatch 2024-03-30T15:23:31.574 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:31 smithi172 bash[23680]: cluster 2024-03-30T15:23:31.299940+0000 mon.a (mon.0) 3231 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:23:31.574 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:31 smithi172 bash[23680]: audit 2024-03-30T15:23:31.302288+0000 mon.a (mon.0) 3232 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-118", "mode": "writeback"}]': finished 2024-03-30T15:23:31.574 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:31 smithi172 bash[23680]: cluster 2024-03-30T15:23:31.308969+0000 mon.a (mon.0) 3233 : cluster 0 osdmap e617: 8 total, 8 up, 8 in 2024-03-30T15:23:31.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:31 smithi072 bash[21573]: cluster 2024-03-30T15:23:30.259781+0000 mgr.y (mgr.14526) 613 : cluster 0 pgmap v995: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 655 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:23:31.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:31 smithi072 bash[21573]: audit 2024-03-30T15:23:30.309407+0000 mon.a (mon.0) 3230 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-118", "mode": "writeback"}]: dispatch 2024-03-30T15:23:31.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:31 smithi072 bash[21573]: cluster 2024-03-30T15:23:31.299940+0000 mon.a (mon.0) 3231 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:23:31.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:31 smithi072 bash[21573]: audit 2024-03-30T15:23:31.302288+0000 mon.a (mon.0) 3232 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-118", "mode": "writeback"}]': finished 2024-03-30T15:23:31.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:31 smithi072 bash[21573]: cluster 2024-03-30T15:23:31.308969+0000 mon.a (mon.0) 3233 : cluster 0 osdmap e617: 8 total, 8 up, 8 in 2024-03-30T15:23:31.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:31 smithi072 bash[28946]: cluster 2024-03-30T15:23:30.259781+0000 mgr.y (mgr.14526) 613 : cluster 0 pgmap v995: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 655 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:23:31.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:31 smithi072 bash[28946]: audit 2024-03-30T15:23:30.309407+0000 mon.a (mon.0) 3230 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-118", "mode": "writeback"}]: dispatch 2024-03-30T15:23:31.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:31 smithi072 bash[28946]: cluster 2024-03-30T15:23:31.299940+0000 mon.a (mon.0) 3231 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:23:31.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:31 smithi072 bash[28946]: audit 2024-03-30T15:23:31.302288+0000 mon.a (mon.0) 3232 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-118", "mode": "writeback"}]': finished 2024-03-30T15:23:31.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:31 smithi072 bash[28946]: cluster 2024-03-30T15:23:31.308969+0000 mon.a (mon.0) 3233 : cluster 0 osdmap e617: 8 total, 8 up, 8 in 2024-03-30T15:23:31.967 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:23:31 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:23:32.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:32 smithi072 bash[21573]: audit 2024-03-30T15:23:31.464788+0000 mon.c (mon.2) 509 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "327.2", "id": [3, 7]}]: dispatch 2024-03-30T15:23:32.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:32 smithi072 bash[21573]: audit 2024-03-30T15:23:31.465317+0000 mon.c (mon.2) 510 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "327.5", "id": [3, 5]}]: dispatch 2024-03-30T15:23:32.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:32 smithi072 bash[21573]: audit 2024-03-30T15:23:31.465718+0000 mon.a (mon.0) 3234 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "327.2", "id": [3, 7]}]: dispatch 2024-03-30T15:23:32.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:32 smithi072 bash[21573]: audit 2024-03-30T15:23:31.465737+0000 mon.c (mon.2) 511 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "327.1e", "id": [0, 2]}]: dispatch 2024-03-30T15:23:32.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:32 smithi072 bash[21573]: audit 2024-03-30T15:23:31.466853+0000 mon.a (mon.0) 3235 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "327.5", "id": [3, 5]}]: dispatch 2024-03-30T15:23:32.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:32 smithi072 bash[21573]: audit 2024-03-30T15:23:31.467343+0000 mon.a (mon.0) 3236 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "327.1e", "id": [0, 2]}]: dispatch 2024-03-30T15:23:32.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:32 smithi072 bash[21573]: audit 2024-03-30T15:23:31.576778+0000 mgr.y (mgr.14526) 614 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:23:32.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:32 smithi072 bash[21573]: audit 2024-03-30T15:23:32.305310+0000 mon.a (mon.0) 3237 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "327.2", "id": [3, 7]}]': finished 2024-03-30T15:23:32.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:32 smithi072 bash[21573]: audit 2024-03-30T15:23:32.305642+0000 mon.a (mon.0) 3238 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "327.5", "id": [3, 5]}]': finished 2024-03-30T15:23:32.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:32 smithi072 bash[21573]: audit 2024-03-30T15:23:32.305798+0000 mon.a (mon.0) 3239 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "327.1e", "id": [0, 2]}]': finished 2024-03-30T15:23:32.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:32 smithi072 bash[21573]: cluster 2024-03-30T15:23:32.312199+0000 mon.a (mon.0) 3240 : cluster 0 osdmap e618: 8 total, 8 up, 8 in 2024-03-30T15:23:32.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:32 smithi072 bash[28946]: audit 2024-03-30T15:23:31.464788+0000 mon.c (mon.2) 509 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "327.2", "id": [3, 7]}]: dispatch 2024-03-30T15:23:32.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:32 smithi072 bash[28946]: audit 2024-03-30T15:23:31.465317+0000 mon.c (mon.2) 510 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "327.5", "id": [3, 5]}]: dispatch 2024-03-30T15:23:32.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:32 smithi072 bash[28946]: audit 2024-03-30T15:23:31.465718+0000 mon.a (mon.0) 3234 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "327.2", "id": [3, 7]}]: dispatch 2024-03-30T15:23:32.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:32 smithi072 bash[28946]: audit 2024-03-30T15:23:31.465737+0000 mon.c (mon.2) 511 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "327.1e", "id": [0, 2]}]: dispatch 2024-03-30T15:23:32.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:32 smithi072 bash[28946]: audit 2024-03-30T15:23:31.466853+0000 mon.a (mon.0) 3235 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "327.5", "id": [3, 5]}]: dispatch 2024-03-30T15:23:32.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:32 smithi072 bash[28946]: audit 2024-03-30T15:23:31.467343+0000 mon.a (mon.0) 3236 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "327.1e", "id": [0, 2]}]: dispatch 2024-03-30T15:23:32.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:32 smithi072 bash[28946]: audit 2024-03-30T15:23:31.576778+0000 mgr.y (mgr.14526) 614 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:23:32.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:32 smithi072 bash[28946]: audit 2024-03-30T15:23:32.305310+0000 mon.a (mon.0) 3237 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "327.2", "id": [3, 7]}]': finished 2024-03-30T15:23:32.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:32 smithi072 bash[28946]: audit 2024-03-30T15:23:32.305642+0000 mon.a (mon.0) 3238 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "327.5", "id": [3, 5]}]': finished 2024-03-30T15:23:32.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:32 smithi072 bash[28946]: audit 2024-03-30T15:23:32.305798+0000 mon.a (mon.0) 3239 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "327.1e", "id": [0, 2]}]': finished 2024-03-30T15:23:32.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:32 smithi072 bash[28946]: cluster 2024-03-30T15:23:32.312199+0000 mon.a (mon.0) 3240 : cluster 0 osdmap e618: 8 total, 8 up, 8 in 2024-03-30T15:23:32.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:32 smithi172 bash[23680]: audit 2024-03-30T15:23:31.464788+0000 mon.c (mon.2) 509 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "327.2", "id": [3, 7]}]: dispatch 2024-03-30T15:23:32.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:32 smithi172 bash[23680]: audit 2024-03-30T15:23:31.465317+0000 mon.c (mon.2) 510 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "327.5", "id": [3, 5]}]: dispatch 2024-03-30T15:23:32.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:32 smithi172 bash[23680]: audit 2024-03-30T15:23:31.465718+0000 mon.a (mon.0) 3234 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "327.2", "id": [3, 7]}]: dispatch 2024-03-30T15:23:32.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:32 smithi172 bash[23680]: audit 2024-03-30T15:23:31.465737+0000 mon.c (mon.2) 511 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "327.1e", "id": [0, 2]}]: dispatch 2024-03-30T15:23:32.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:32 smithi172 bash[23680]: audit 2024-03-30T15:23:31.466853+0000 mon.a (mon.0) 3235 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "327.5", "id": [3, 5]}]: dispatch 2024-03-30T15:23:32.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:32 smithi172 bash[23680]: audit 2024-03-30T15:23:31.467343+0000 mon.a (mon.0) 3236 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "327.1e", "id": [0, 2]}]: dispatch 2024-03-30T15:23:32.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:32 smithi172 bash[23680]: audit 2024-03-30T15:23:31.576778+0000 mgr.y (mgr.14526) 614 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:23:32.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:32 smithi172 bash[23680]: audit 2024-03-30T15:23:32.305310+0000 mon.a (mon.0) 3237 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "327.2", "id": [3, 7]}]': finished 2024-03-30T15:23:32.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:32 smithi172 bash[23680]: audit 2024-03-30T15:23:32.305642+0000 mon.a (mon.0) 3238 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "327.5", "id": [3, 5]}]': finished 2024-03-30T15:23:32.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:32 smithi172 bash[23680]: audit 2024-03-30T15:23:32.305798+0000 mon.a (mon.0) 3239 : audit 1 from='mgr.14526 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "327.1e", "id": [0, 2]}]': finished 2024-03-30T15:23:32.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:32 smithi172 bash[23680]: cluster 2024-03-30T15:23:32.312199+0000 mon.a (mon.0) 3240 : cluster 0 osdmap e618: 8 total, 8 up, 8 in 2024-03-30T15:23:33.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:33 smithi072 bash[21573]: cluster 2024-03-30T15:23:32.260580+0000 mgr.y (mgr.14526) 615 : cluster 0 pgmap v998: 204 pgs: 204 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-03-30T15:23:33.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:33 smithi072 bash[21573]: cluster 2024-03-30T15:23:33.315379+0000 mon.a (mon.0) 3241 : cluster 0 osdmap e619: 8 total, 8 up, 8 in 2024-03-30T15:23:33.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:33 smithi072 bash[28946]: cluster 2024-03-30T15:23:32.260580+0000 mgr.y (mgr.14526) 615 : cluster 0 pgmap v998: 204 pgs: 204 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-03-30T15:23:33.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:33 smithi072 bash[28946]: cluster 2024-03-30T15:23:33.315379+0000 mon.a (mon.0) 3241 : cluster 0 osdmap e619: 8 total, 8 up, 8 in 2024-03-30T15:23:33.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:33 smithi172 bash[23680]: cluster 2024-03-30T15:23:32.260580+0000 mgr.y (mgr.14526) 615 : cluster 0 pgmap v998: 204 pgs: 204 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-03-30T15:23:33.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:33 smithi172 bash[23680]: cluster 2024-03-30T15:23:33.315379+0000 mon.a (mon.0) 3241 : cluster 0 osdmap e619: 8 total, 8 up, 8 in 2024-03-30T15:23:34.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:34 smithi072 bash[21573]: audit 2024-03-30T15:23:33.378039+0000 mon.a (mon.0) 3242 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:23:34.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:34 smithi072 bash[28946]: audit 2024-03-30T15:23:33.378039+0000 mon.a (mon.0) 3242 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:23:34.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:34 smithi172 bash[23680]: audit 2024-03-30T15:23:33.378039+0000 mon.a (mon.0) 3242 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:23:35.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:35 smithi072 bash[21573]: cluster 2024-03-30T15:23:34.261422+0000 mgr.y (mgr.14526) 616 : cluster 0 pgmap v1001: 204 pgs: 204 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-03-30T15:23:35.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:35 smithi072 bash[21573]: audit 2024-03-30T15:23:34.366356+0000 mon.a (mon.0) 3243 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:23:35.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:35 smithi072 bash[21573]: cluster 2024-03-30T15:23:34.374908+0000 mon.a (mon.0) 3244 : cluster 0 osdmap e620: 8 total, 8 up, 8 in 2024-03-30T15:23:35.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:35 smithi072 bash[21573]: audit 2024-03-30T15:23:34.376032+0000 mon.a (mon.0) 3245 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-118"}]: dispatch 2024-03-30T15:23:35.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:35 smithi072 bash[28946]: cluster 2024-03-30T15:23:34.261422+0000 mgr.y (mgr.14526) 616 : cluster 0 pgmap v1001: 204 pgs: 204 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-03-30T15:23:35.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:35 smithi072 bash[28946]: audit 2024-03-30T15:23:34.366356+0000 mon.a (mon.0) 3243 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:23:35.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:35 smithi072 bash[28946]: cluster 2024-03-30T15:23:34.374908+0000 mon.a (mon.0) 3244 : cluster 0 osdmap e620: 8 total, 8 up, 8 in 2024-03-30T15:23:35.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:35 smithi072 bash[28946]: audit 2024-03-30T15:23:34.376032+0000 mon.a (mon.0) 3245 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-118"}]: dispatch 2024-03-30T15:23:35.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:35 smithi172 bash[23680]: cluster 2024-03-30T15:23:34.261422+0000 mgr.y (mgr.14526) 616 : cluster 0 pgmap v1001: 204 pgs: 204 active+clean; 582 KiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-03-30T15:23:35.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:35 smithi172 bash[23680]: audit 2024-03-30T15:23:34.366356+0000 mon.a (mon.0) 3243 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:23:35.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:35 smithi172 bash[23680]: cluster 2024-03-30T15:23:34.374908+0000 mon.a (mon.0) 3244 : cluster 0 osdmap e620: 8 total, 8 up, 8 in 2024-03-30T15:23:35.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:35 smithi172 bash[23680]: audit 2024-03-30T15:23:34.376032+0000 mon.a (mon.0) 3245 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-118"}]: dispatch 2024-03-30T15:23:36.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:36 smithi072 bash[21573]: cluster 2024-03-30T15:23:35.366837+0000 mon.a (mon.0) 3246 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:23:36.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:36 smithi072 bash[21573]: audit 2024-03-30T15:23:35.369360+0000 mon.a (mon.0) 3247 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-118"}]': finished 2024-03-30T15:23:36.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:36 smithi072 bash[21573]: cluster 2024-03-30T15:23:35.377345+0000 mon.a (mon.0) 3248 : cluster 0 osdmap e621: 8 total, 8 up, 8 in 2024-03-30T15:23:36.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:36 smithi072 bash[28946]: cluster 2024-03-30T15:23:35.366837+0000 mon.a (mon.0) 3246 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:23:36.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:36 smithi072 bash[28946]: audit 2024-03-30T15:23:35.369360+0000 mon.a (mon.0) 3247 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-118"}]': finished 2024-03-30T15:23:36.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:36 smithi072 bash[28946]: cluster 2024-03-30T15:23:35.377345+0000 mon.a (mon.0) 3248 : cluster 0 osdmap e621: 8 total, 8 up, 8 in 2024-03-30T15:23:36.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:36 smithi172 bash[23680]: cluster 2024-03-30T15:23:35.366837+0000 mon.a (mon.0) 3246 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:23:36.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:36 smithi172 bash[23680]: audit 2024-03-30T15:23:35.369360+0000 mon.a (mon.0) 3247 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-118"}]': finished 2024-03-30T15:23:36.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:36 smithi172 bash[23680]: cluster 2024-03-30T15:23:35.377345+0000 mon.a (mon.0) 3248 : cluster 0 osdmap e621: 8 total, 8 up, 8 in 2024-03-30T15:23:37.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:37 smithi072 bash[21573]: cluster 2024-03-30T15:23:36.263453+0000 mgr.y (mgr.14526) 617 : cluster 0 pgmap v1004: 204 pgs: 204 active+clean; 582 KiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:23:37.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:37 smithi072 bash[21573]: cluster 2024-03-30T15:23:36.381811+0000 mon.a (mon.0) 3249 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:23:37.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:37 smithi072 bash[21573]: cluster 2024-03-30T15:23:36.403417+0000 mon.a (mon.0) 3250 : cluster 0 osdmap e622: 8 total, 8 up, 8 in 2024-03-30T15:23:37.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:37 smithi072 bash[21573]: audit 2024-03-30T15:23:37.104718+0000 mon.a (mon.0) 3251 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:23:37.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:37 smithi072 bash[21573]: audit 2024-03-30T15:23:37.107555+0000 mon.c (mon.2) 512 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:23:37.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:37 smithi072 bash[21573]: cluster 2024-03-30T15:23:37.306924+0000 mon.a (mon.0) 3252 : cluster 0 osdmap e623: 8 total, 8 up, 8 in 2024-03-30T15:23:37.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:37 smithi072 bash[21573]: audit 2024-03-30T15:23:37.315619+0000 mon.a (mon.0) 3253 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:23:37.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:37 smithi072 bash[28946]: cluster 2024-03-30T15:23:36.263453+0000 mgr.y (mgr.14526) 617 : cluster 0 pgmap v1004: 204 pgs: 204 active+clean; 582 KiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:23:37.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:37 smithi072 bash[28946]: cluster 2024-03-30T15:23:36.381811+0000 mon.a (mon.0) 3249 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:23:37.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:37 smithi072 bash[28946]: cluster 2024-03-30T15:23:36.403417+0000 mon.a (mon.0) 3250 : cluster 0 osdmap e622: 8 total, 8 up, 8 in 2024-03-30T15:23:37.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:37 smithi072 bash[28946]: audit 2024-03-30T15:23:37.104718+0000 mon.a (mon.0) 3251 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:23:37.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:37 smithi072 bash[28946]: audit 2024-03-30T15:23:37.107555+0000 mon.c (mon.2) 512 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:23:37.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:37 smithi072 bash[28946]: cluster 2024-03-30T15:23:37.306924+0000 mon.a (mon.0) 3252 : cluster 0 osdmap e623: 8 total, 8 up, 8 in 2024-03-30T15:23:37.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:37 smithi072 bash[28946]: audit 2024-03-30T15:23:37.315619+0000 mon.a (mon.0) 3253 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:23:37.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:37 smithi172 bash[23680]: cluster 2024-03-30T15:23:36.263453+0000 mgr.y (mgr.14526) 617 : cluster 0 pgmap v1004: 204 pgs: 204 active+clean; 582 KiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:23:37.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:37 smithi172 bash[23680]: cluster 2024-03-30T15:23:36.381811+0000 mon.a (mon.0) 3249 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:23:37.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:37 smithi172 bash[23680]: cluster 2024-03-30T15:23:36.403417+0000 mon.a (mon.0) 3250 : cluster 0 osdmap e622: 8 total, 8 up, 8 in 2024-03-30T15:23:37.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:37 smithi172 bash[23680]: audit 2024-03-30T15:23:37.104718+0000 mon.a (mon.0) 3251 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:23:37.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:37 smithi172 bash[23680]: audit 2024-03-30T15:23:37.107555+0000 mon.c (mon.2) 512 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:23:37.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:37 smithi172 bash[23680]: cluster 2024-03-30T15:23:37.306924+0000 mon.a (mon.0) 3252 : cluster 0 osdmap e623: 8 total, 8 up, 8 in 2024-03-30T15:23:37.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:37 smithi172 bash[23680]: audit 2024-03-30T15:23:37.315619+0000 mon.a (mon.0) 3253 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:23:39.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:39 smithi072 bash[21573]: cluster 2024-03-30T15:23:38.264331+0000 mgr.y (mgr.14526) 618 : cluster 0 pgmap v1007: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:23:39.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:39 smithi072 bash[21573]: audit 2024-03-30T15:23:38.301079+0000 mon.a (mon.0) 3254 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-120","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:23:39.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:39 smithi072 bash[21573]: cluster 2024-03-30T15:23:38.309515+0000 mon.a (mon.0) 3255 : cluster 0 osdmap e624: 8 total, 8 up, 8 in 2024-03-30T15:23:39.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:39 smithi072 bash[21573]: audit 2024-03-30T15:23:38.364060+0000 mon.a (mon.0) 3256 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-120", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:23:39.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:39 smithi072 bash[28946]: cluster 2024-03-30T15:23:38.264331+0000 mgr.y (mgr.14526) 618 : cluster 0 pgmap v1007: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:23:39.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:39 smithi072 bash[28946]: audit 2024-03-30T15:23:38.301079+0000 mon.a (mon.0) 3254 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-120","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:23:39.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:39 smithi072 bash[28946]: cluster 2024-03-30T15:23:38.309515+0000 mon.a (mon.0) 3255 : cluster 0 osdmap e624: 8 total, 8 up, 8 in 2024-03-30T15:23:39.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:39 smithi072 bash[28946]: audit 2024-03-30T15:23:38.364060+0000 mon.a (mon.0) 3256 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-120", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:23:39.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:39 smithi172 bash[23680]: cluster 2024-03-30T15:23:38.264331+0000 mgr.y (mgr.14526) 618 : cluster 0 pgmap v1007: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:23:39.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:39 smithi172 bash[23680]: audit 2024-03-30T15:23:38.301079+0000 mon.a (mon.0) 3254 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-120","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:23:39.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:39 smithi172 bash[23680]: cluster 2024-03-30T15:23:38.309515+0000 mon.a (mon.0) 3255 : cluster 0 osdmap e624: 8 total, 8 up, 8 in 2024-03-30T15:23:39.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:39 smithi172 bash[23680]: audit 2024-03-30T15:23:38.364060+0000 mon.a (mon.0) 3256 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-120", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:23:40.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:40 smithi072 bash[21573]: audit 2024-03-30T15:23:39.315013+0000 mon.a (mon.0) 3257 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-120", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:23:40.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:40 smithi072 bash[21573]: cluster 2024-03-30T15:23:39.323380+0000 mon.a (mon.0) 3258 : cluster 0 osdmap e625: 8 total, 8 up, 8 in 2024-03-30T15:23:40.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:40 smithi072 bash[21573]: audit 2024-03-30T15:23:39.324788+0000 mon.a (mon.0) 3259 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-120"}]: dispatch 2024-03-30T15:23:40.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:40 smithi072 bash[28946]: audit 2024-03-30T15:23:39.315013+0000 mon.a (mon.0) 3257 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-120", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:23:40.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:40 smithi072 bash[28946]: cluster 2024-03-30T15:23:39.323380+0000 mon.a (mon.0) 3258 : cluster 0 osdmap e625: 8 total, 8 up, 8 in 2024-03-30T15:23:40.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:40 smithi072 bash[28946]: audit 2024-03-30T15:23:39.324788+0000 mon.a (mon.0) 3259 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-120"}]: dispatch 2024-03-30T15:23:40.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:40 smithi172 bash[23680]: audit 2024-03-30T15:23:39.315013+0000 mon.a (mon.0) 3257 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-120", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:23:40.744 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:40 smithi172 bash[23680]: cluster 2024-03-30T15:23:39.323380+0000 mon.a (mon.0) 3258 : cluster 0 osdmap e625: 8 total, 8 up, 8 in 2024-03-30T15:23:40.744 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:40 smithi172 bash[23680]: audit 2024-03-30T15:23:39.324788+0000 mon.a (mon.0) 3259 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-120"}]: dispatch 2024-03-30T15:23:41.325 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:23:41 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:23:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:23:41.583 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:41 smithi172 bash[23680]: cluster 2024-03-30T15:23:40.265167+0000 mgr.y (mgr.14526) 619 : cluster 0 pgmap v1010: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 640 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:23:41.583 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:41 smithi172 bash[23680]: audit 2024-03-30T15:23:40.326545+0000 mon.a (mon.0) 3260 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-120"}]': finished 2024-03-30T15:23:41.583 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:41 smithi172 bash[23680]: cluster 2024-03-30T15:23:40.338866+0000 mon.a (mon.0) 3261 : cluster 0 osdmap e626: 8 total, 8 up, 8 in 2024-03-30T15:23:41.583 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:41 smithi172 bash[23680]: audit 2024-03-30T15:23:40.340517+0000 mon.a (mon.0) 3262 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-120", "mode": "writeback"}]: dispatch 2024-03-30T15:23:41.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:41 smithi072 bash[21573]: cluster 2024-03-30T15:23:40.265167+0000 mgr.y (mgr.14526) 619 : cluster 0 pgmap v1010: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 640 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:23:41.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:41 smithi072 bash[21573]: audit 2024-03-30T15:23:40.326545+0000 mon.a (mon.0) 3260 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-120"}]': finished 2024-03-30T15:23:41.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:41 smithi072 bash[21573]: cluster 2024-03-30T15:23:40.338866+0000 mon.a (mon.0) 3261 : cluster 0 osdmap e626: 8 total, 8 up, 8 in 2024-03-30T15:23:41.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:41 smithi072 bash[21573]: audit 2024-03-30T15:23:40.340517+0000 mon.a (mon.0) 3262 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-120", "mode": "writeback"}]: dispatch 2024-03-30T15:23:41.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:41 smithi072 bash[28946]: cluster 2024-03-30T15:23:40.265167+0000 mgr.y (mgr.14526) 619 : cluster 0 pgmap v1010: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 640 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:23:41.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:41 smithi072 bash[28946]: audit 2024-03-30T15:23:40.326545+0000 mon.a (mon.0) 3260 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-120"}]': finished 2024-03-30T15:23:41.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:41 smithi072 bash[28946]: cluster 2024-03-30T15:23:40.338866+0000 mon.a (mon.0) 3261 : cluster 0 osdmap e626: 8 total, 8 up, 8 in 2024-03-30T15:23:41.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:41 smithi072 bash[28946]: audit 2024-03-30T15:23:40.340517+0000 mon.a (mon.0) 3262 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-120", "mode": "writeback"}]: dispatch 2024-03-30T15:23:41.967 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:23:41 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:23:42.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:42 smithi072 bash[21573]: cluster 2024-03-30T15:23:41.327436+0000 mon.a (mon.0) 3263 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:23:42.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:42 smithi072 bash[21573]: audit 2024-03-30T15:23:41.339374+0000 mon.a (mon.0) 3264 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-120", "mode": "writeback"}]': finished 2024-03-30T15:23:42.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:42 smithi072 bash[21573]: cluster 2024-03-30T15:23:41.346275+0000 mon.a (mon.0) 3265 : cluster 0 osdmap e627: 8 total, 8 up, 8 in 2024-03-30T15:23:42.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:42 smithi072 bash[21573]: audit 2024-03-30T15:23:41.496476+0000 mon.a (mon.0) 3266 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:23:42.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:42 smithi072 bash[21573]: audit 2024-03-30T15:23:41.585314+0000 mgr.y (mgr.14526) 620 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:23:42.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:42 smithi072 bash[21573]: cluster 2024-03-30T15:23:42.295266+0000 mon.a (mon.0) 3267 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:23:42.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:42 smithi072 bash[28946]: cluster 2024-03-30T15:23:41.327436+0000 mon.a (mon.0) 3263 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:23:42.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:42 smithi072 bash[28946]: audit 2024-03-30T15:23:41.339374+0000 mon.a (mon.0) 3264 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-120", "mode": "writeback"}]': finished 2024-03-30T15:23:42.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:42 smithi072 bash[28946]: cluster 2024-03-30T15:23:41.346275+0000 mon.a (mon.0) 3265 : cluster 0 osdmap e627: 8 total, 8 up, 8 in 2024-03-30T15:23:42.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:42 smithi072 bash[28946]: audit 2024-03-30T15:23:41.496476+0000 mon.a (mon.0) 3266 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:23:42.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:42 smithi072 bash[28946]: audit 2024-03-30T15:23:41.585314+0000 mgr.y (mgr.14526) 620 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:23:42.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:42 smithi072 bash[28946]: cluster 2024-03-30T15:23:42.295266+0000 mon.a (mon.0) 3267 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:23:42.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:42 smithi172 bash[23680]: cluster 2024-03-30T15:23:41.327436+0000 mon.a (mon.0) 3263 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:23:42.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:42 smithi172 bash[23680]: audit 2024-03-30T15:23:41.339374+0000 mon.a (mon.0) 3264 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-120", "mode": "writeback"}]': finished 2024-03-30T15:23:42.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:42 smithi172 bash[23680]: cluster 2024-03-30T15:23:41.346275+0000 mon.a (mon.0) 3265 : cluster 0 osdmap e627: 8 total, 8 up, 8 in 2024-03-30T15:23:42.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:42 smithi172 bash[23680]: audit 2024-03-30T15:23:41.496476+0000 mon.a (mon.0) 3266 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:23:42.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:42 smithi172 bash[23680]: audit 2024-03-30T15:23:41.585314+0000 mgr.y (mgr.14526) 620 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:23:42.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:42 smithi172 bash[23680]: cluster 2024-03-30T15:23:42.295266+0000 mon.a (mon.0) 3267 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:23:43.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:43 smithi072 bash[21573]: cluster 2024-03-30T15:23:42.265929+0000 mgr.y (mgr.14526) 621 : cluster 0 pgmap v1013: 204 pgs: 204 active+clean; 582 KiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:23:43.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:43 smithi072 bash[21573]: audit 2024-03-30T15:23:42.347726+0000 mon.a (mon.0) 3268 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:23:43.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:43 smithi072 bash[21573]: cluster 2024-03-30T15:23:42.354343+0000 mon.a (mon.0) 3269 : cluster 0 osdmap e628: 8 total, 8 up, 8 in 2024-03-30T15:23:43.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:43 smithi072 bash[21573]: audit 2024-03-30T15:23:42.356356+0000 mon.a (mon.0) 3270 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-120"}]: dispatch 2024-03-30T15:23:43.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:43 smithi072 bash[28946]: cluster 2024-03-30T15:23:42.265929+0000 mgr.y (mgr.14526) 621 : cluster 0 pgmap v1013: 204 pgs: 204 active+clean; 582 KiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:23:43.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:43 smithi072 bash[28946]: audit 2024-03-30T15:23:42.347726+0000 mon.a (mon.0) 3268 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:23:43.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:43 smithi072 bash[28946]: cluster 2024-03-30T15:23:42.354343+0000 mon.a (mon.0) 3269 : cluster 0 osdmap e628: 8 total, 8 up, 8 in 2024-03-30T15:23:43.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:43 smithi072 bash[28946]: audit 2024-03-30T15:23:42.356356+0000 mon.a (mon.0) 3270 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-120"}]: dispatch 2024-03-30T15:23:43.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:43 smithi172 bash[23680]: cluster 2024-03-30T15:23:42.265929+0000 mgr.y (mgr.14526) 621 : cluster 0 pgmap v1013: 204 pgs: 204 active+clean; 582 KiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:23:43.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:43 smithi172 bash[23680]: audit 2024-03-30T15:23:42.347726+0000 mon.a (mon.0) 3268 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:23:43.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:43 smithi172 bash[23680]: cluster 2024-03-30T15:23:42.354343+0000 mon.a (mon.0) 3269 : cluster 0 osdmap e628: 8 total, 8 up, 8 in 2024-03-30T15:23:43.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:43 smithi172 bash[23680]: audit 2024-03-30T15:23:42.356356+0000 mon.a (mon.0) 3270 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-120"}]: dispatch 2024-03-30T15:23:45.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:44 smithi072 bash[21573]: cluster 2024-03-30T15:23:43.348068+0000 mon.a (mon.0) 3271 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:23:45.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:44 smithi072 bash[21573]: audit 2024-03-30T15:23:43.350441+0000 mon.a (mon.0) 3272 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-120"}]': finished 2024-03-30T15:23:45.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:44 smithi072 bash[21573]: cluster 2024-03-30T15:23:43.357944+0000 mon.a (mon.0) 3273 : cluster 0 osdmap e629: 8 total, 8 up, 8 in 2024-03-30T15:23:45.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:44 smithi072 bash[28946]: cluster 2024-03-30T15:23:43.348068+0000 mon.a (mon.0) 3271 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:23:45.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:44 smithi072 bash[28946]: audit 2024-03-30T15:23:43.350441+0000 mon.a (mon.0) 3272 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-120"}]': finished 2024-03-30T15:23:45.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:44 smithi072 bash[28946]: cluster 2024-03-30T15:23:43.357944+0000 mon.a (mon.0) 3273 : cluster 0 osdmap e629: 8 total, 8 up, 8 in 2024-03-30T15:23:45.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:44 smithi172 bash[23680]: cluster 2024-03-30T15:23:43.348068+0000 mon.a (mon.0) 3271 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:23:45.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:44 smithi172 bash[23680]: audit 2024-03-30T15:23:43.350441+0000 mon.a (mon.0) 3272 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-120"}]': finished 2024-03-30T15:23:45.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:44 smithi172 bash[23680]: cluster 2024-03-30T15:23:43.357944+0000 mon.a (mon.0) 3273 : cluster 0 osdmap e629: 8 total, 8 up, 8 in 2024-03-30T15:23:46.168 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:45 smithi072 bash[21573]: cluster 2024-03-30T15:23:44.266693+0000 mgr.y (mgr.14526) 622 : cluster 0 pgmap v1016: 204 pgs: 204 active+clean; 582 KiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:23:46.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:45 smithi072 bash[21573]: cluster 2024-03-30T15:23:44.374470+0000 mon.a (mon.0) 3274 : cluster 0 osdmap e630: 8 total, 8 up, 8 in 2024-03-30T15:23:46.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:45 smithi072 bash[21573]: cluster 2024-03-30T15:23:45.377832+0000 mon.a (mon.0) 3275 : cluster 0 osdmap e631: 8 total, 8 up, 8 in 2024-03-30T15:23:46.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:45 smithi072 bash[21573]: audit 2024-03-30T15:23:45.385212+0000 mon.a (mon.0) 3276 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:23:46.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:45 smithi072 bash[28946]: cluster 2024-03-30T15:23:44.266693+0000 mgr.y (mgr.14526) 622 : cluster 0 pgmap v1016: 204 pgs: 204 active+clean; 582 KiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:23:46.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:45 smithi072 bash[28946]: cluster 2024-03-30T15:23:44.374470+0000 mon.a (mon.0) 3274 : cluster 0 osdmap e630: 8 total, 8 up, 8 in 2024-03-30T15:23:46.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:45 smithi072 bash[28946]: cluster 2024-03-30T15:23:45.377832+0000 mon.a (mon.0) 3275 : cluster 0 osdmap e631: 8 total, 8 up, 8 in 2024-03-30T15:23:46.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:45 smithi072 bash[28946]: audit 2024-03-30T15:23:45.385212+0000 mon.a (mon.0) 3276 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:23:46.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:45 smithi172 bash[23680]: cluster 2024-03-30T15:23:44.266693+0000 mgr.y (mgr.14526) 622 : cluster 0 pgmap v1016: 204 pgs: 204 active+clean; 582 KiB data, 666 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:23:46.217 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:45 smithi172 bash[23680]: cluster 2024-03-30T15:23:44.374470+0000 mon.a (mon.0) 3274 : cluster 0 osdmap e630: 8 total, 8 up, 8 in 2024-03-30T15:23:46.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:45 smithi172 bash[23680]: cluster 2024-03-30T15:23:45.377832+0000 mon.a (mon.0) 3275 : cluster 0 osdmap e631: 8 total, 8 up, 8 in 2024-03-30T15:23:46.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:45 smithi172 bash[23680]: audit 2024-03-30T15:23:45.385212+0000 mon.a (mon.0) 3276 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:23:47.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:47 smithi072 bash[21573]: cluster 2024-03-30T15:23:46.268803+0000 mgr.y (mgr.14526) 623 : cluster 0 pgmap v1019: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 667 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:23:47.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:47 smithi072 bash[21573]: audit 2024-03-30T15:23:46.373409+0000 mon.a (mon.0) 3277 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-122","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:23:47.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:47 smithi072 bash[21573]: cluster 2024-03-30T15:23:46.382343+0000 mon.a (mon.0) 3278 : cluster 0 osdmap e632: 8 total, 8 up, 8 in 2024-03-30T15:23:47.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:47 smithi072 bash[21573]: audit 2024-03-30T15:23:46.414091+0000 mon.a (mon.0) 3279 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-122", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:23:47.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:47 smithi072 bash[21573]: cluster 2024-03-30T15:23:47.296492+0000 mon.a (mon.0) 3280 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:23:47.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:47 smithi072 bash[28946]: cluster 2024-03-30T15:23:46.268803+0000 mgr.y (mgr.14526) 623 : cluster 0 pgmap v1019: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 667 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:23:47.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:47 smithi072 bash[28946]: audit 2024-03-30T15:23:46.373409+0000 mon.a (mon.0) 3277 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-122","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:23:47.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:47 smithi072 bash[28946]: cluster 2024-03-30T15:23:46.382343+0000 mon.a (mon.0) 3278 : cluster 0 osdmap e632: 8 total, 8 up, 8 in 2024-03-30T15:23:47.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:47 smithi072 bash[28946]: audit 2024-03-30T15:23:46.414091+0000 mon.a (mon.0) 3279 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-122", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:23:47.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:47 smithi072 bash[28946]: cluster 2024-03-30T15:23:47.296492+0000 mon.a (mon.0) 3280 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:23:47.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:47 smithi172 bash[23680]: cluster 2024-03-30T15:23:46.268803+0000 mgr.y (mgr.14526) 623 : cluster 0 pgmap v1019: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 667 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:23:47.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:47 smithi172 bash[23680]: audit 2024-03-30T15:23:46.373409+0000 mon.a (mon.0) 3277 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-122","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:23:47.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:47 smithi172 bash[23680]: cluster 2024-03-30T15:23:46.382343+0000 mon.a (mon.0) 3278 : cluster 0 osdmap e632: 8 total, 8 up, 8 in 2024-03-30T15:23:47.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:47 smithi172 bash[23680]: audit 2024-03-30T15:23:46.414091+0000 mon.a (mon.0) 3279 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-122", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:23:47.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:47 smithi172 bash[23680]: cluster 2024-03-30T15:23:47.296492+0000 mon.a (mon.0) 3280 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:23:48.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:48 smithi072 bash[21573]: audit 2024-03-30T15:23:47.376113+0000 mon.a (mon.0) 3281 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-122", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:23:48.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:48 smithi072 bash[21573]: cluster 2024-03-30T15:23:47.385020+0000 mon.a (mon.0) 3282 : cluster 0 osdmap e633: 8 total, 8 up, 8 in 2024-03-30T15:23:48.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:48 smithi072 bash[21573]: audit 2024-03-30T15:23:47.386595+0000 mon.a (mon.0) 3283 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-122"}]: dispatch 2024-03-30T15:23:48.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:48 smithi072 bash[21573]: audit 2024-03-30T15:23:48.379547+0000 mon.a (mon.0) 3284 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-122"}]': finished 2024-03-30T15:23:48.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:48 smithi072 bash[21573]: cluster 2024-03-30T15:23:48.387583+0000 mon.a (mon.0) 3285 : cluster 0 osdmap e634: 8 total, 8 up, 8 in 2024-03-30T15:23:48.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:48 smithi072 bash[21573]: audit 2024-03-30T15:23:48.388790+0000 mon.a (mon.0) 3286 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-122", "mode": "writeback"}]: dispatch 2024-03-30T15:23:48.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:48 smithi072 bash[28946]: audit 2024-03-30T15:23:47.376113+0000 mon.a (mon.0) 3281 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-122", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:23:48.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:48 smithi072 bash[28946]: cluster 2024-03-30T15:23:47.385020+0000 mon.a (mon.0) 3282 : cluster 0 osdmap e633: 8 total, 8 up, 8 in 2024-03-30T15:23:48.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:48 smithi072 bash[28946]: audit 2024-03-30T15:23:47.386595+0000 mon.a (mon.0) 3283 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-122"}]: dispatch 2024-03-30T15:23:48.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:48 smithi072 bash[28946]: audit 2024-03-30T15:23:48.379547+0000 mon.a (mon.0) 3284 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-122"}]': finished 2024-03-30T15:23:48.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:48 smithi072 bash[28946]: cluster 2024-03-30T15:23:48.387583+0000 mon.a (mon.0) 3285 : cluster 0 osdmap e634: 8 total, 8 up, 8 in 2024-03-30T15:23:48.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:48 smithi072 bash[28946]: audit 2024-03-30T15:23:48.388790+0000 mon.a (mon.0) 3286 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-122", "mode": "writeback"}]: dispatch 2024-03-30T15:23:48.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:48 smithi172 bash[23680]: audit 2024-03-30T15:23:47.376113+0000 mon.a (mon.0) 3281 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-122", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:23:48.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:48 smithi172 bash[23680]: cluster 2024-03-30T15:23:47.385020+0000 mon.a (mon.0) 3282 : cluster 0 osdmap e633: 8 total, 8 up, 8 in 2024-03-30T15:23:48.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:48 smithi172 bash[23680]: audit 2024-03-30T15:23:47.386595+0000 mon.a (mon.0) 3283 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-122"}]: dispatch 2024-03-30T15:23:48.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:48 smithi172 bash[23680]: audit 2024-03-30T15:23:48.379547+0000 mon.a (mon.0) 3284 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-122"}]': finished 2024-03-30T15:23:48.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:48 smithi172 bash[23680]: cluster 2024-03-30T15:23:48.387583+0000 mon.a (mon.0) 3285 : cluster 0 osdmap e634: 8 total, 8 up, 8 in 2024-03-30T15:23:48.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:48 smithi172 bash[23680]: audit 2024-03-30T15:23:48.388790+0000 mon.a (mon.0) 3286 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-122", "mode": "writeback"}]: dispatch 2024-03-30T15:23:49.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:49 smithi072 bash[21573]: cluster 2024-03-30T15:23:48.269743+0000 mgr.y (mgr.14526) 624 : cluster 0 pgmap v1022: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 667 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:23:49.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:49 smithi072 bash[21573]: cluster 2024-03-30T15:23:49.379793+0000 mon.a (mon.0) 3287 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:23:49.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:49 smithi072 bash[21573]: audit 2024-03-30T15:23:49.382254+0000 mon.a (mon.0) 3288 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-122", "mode": "writeback"}]': finished 2024-03-30T15:23:49.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:49 smithi072 bash[21573]: cluster 2024-03-30T15:23:49.390308+0000 mon.a (mon.0) 3289 : cluster 0 osdmap e635: 8 total, 8 up, 8 in 2024-03-30T15:23:49.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:49 smithi072 bash[28946]: cluster 2024-03-30T15:23:48.269743+0000 mgr.y (mgr.14526) 624 : cluster 0 pgmap v1022: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 667 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:23:49.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:49 smithi072 bash[28946]: cluster 2024-03-30T15:23:49.379793+0000 mon.a (mon.0) 3287 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:23:49.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:49 smithi072 bash[28946]: audit 2024-03-30T15:23:49.382254+0000 mon.a (mon.0) 3288 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-122", "mode": "writeback"}]': finished 2024-03-30T15:23:49.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:49 smithi072 bash[28946]: cluster 2024-03-30T15:23:49.390308+0000 mon.a (mon.0) 3289 : cluster 0 osdmap e635: 8 total, 8 up, 8 in 2024-03-30T15:23:49.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:49 smithi172 bash[23680]: cluster 2024-03-30T15:23:48.269743+0000 mgr.y (mgr.14526) 624 : cluster 0 pgmap v1022: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 667 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:23:49.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:49 smithi172 bash[23680]: cluster 2024-03-30T15:23:49.379793+0000 mon.a (mon.0) 3287 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:23:49.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:49 smithi172 bash[23680]: audit 2024-03-30T15:23:49.382254+0000 mon.a (mon.0) 3288 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-122", "mode": "writeback"}]': finished 2024-03-30T15:23:49.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:49 smithi172 bash[23680]: cluster 2024-03-30T15:23:49.390308+0000 mon.a (mon.0) 3289 : cluster 0 osdmap e635: 8 total, 8 up, 8 in 2024-03-30T15:23:50.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:50 smithi072 bash[21573]: audit 2024-03-30T15:23:49.517216+0000 mon.a (mon.0) 3290 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:23:50.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:50 smithi072 bash[28946]: audit 2024-03-30T15:23:49.517216+0000 mon.a (mon.0) 3290 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:23:50.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:50 smithi172 bash[23680]: audit 2024-03-30T15:23:49.517216+0000 mon.a (mon.0) 3290 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:23:51.418 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:23:51 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:23:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:23:51.717 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:23:51 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:23:51.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:51 smithi172 bash[23680]: cluster 2024-03-30T15:23:50.270561+0000 mgr.y (mgr.14526) 625 : cluster 0 pgmap v1025: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 667 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:23:51.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:51 smithi172 bash[23680]: audit 2024-03-30T15:23:50.422357+0000 mon.a (mon.0) 3291 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:23:51.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:51 smithi172 bash[23680]: cluster 2024-03-30T15:23:50.429935+0000 mon.a (mon.0) 3292 : cluster 0 osdmap e636: 8 total, 8 up, 8 in 2024-03-30T15:23:51.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:51 smithi172 bash[23680]: audit 2024-03-30T15:23:50.434225+0000 mon.a (mon.0) 3293 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-122"}]: dispatch 2024-03-30T15:23:51.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:51 smithi072 bash[21573]: cluster 2024-03-30T15:23:50.270561+0000 mgr.y (mgr.14526) 625 : cluster 0 pgmap v1025: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 667 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:23:51.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:51 smithi072 bash[21573]: audit 2024-03-30T15:23:50.422357+0000 mon.a (mon.0) 3291 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:23:51.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:51 smithi072 bash[21573]: cluster 2024-03-30T15:23:50.429935+0000 mon.a (mon.0) 3292 : cluster 0 osdmap e636: 8 total, 8 up, 8 in 2024-03-30T15:23:51.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:51 smithi072 bash[21573]: audit 2024-03-30T15:23:50.434225+0000 mon.a (mon.0) 3293 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-122"}]: dispatch 2024-03-30T15:23:51.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:51 smithi072 bash[28946]: cluster 2024-03-30T15:23:50.270561+0000 mgr.y (mgr.14526) 625 : cluster 0 pgmap v1025: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 667 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:23:51.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:51 smithi072 bash[28946]: audit 2024-03-30T15:23:50.422357+0000 mon.a (mon.0) 3291 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:23:51.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:51 smithi072 bash[28946]: cluster 2024-03-30T15:23:50.429935+0000 mon.a (mon.0) 3292 : cluster 0 osdmap e636: 8 total, 8 up, 8 in 2024-03-30T15:23:51.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:51 smithi072 bash[28946]: audit 2024-03-30T15:23:50.434225+0000 mon.a (mon.0) 3293 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-122"}]: dispatch 2024-03-30T15:23:52.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:52 smithi172 bash[23680]: cluster 2024-03-30T15:23:51.422831+0000 mon.a (mon.0) 3294 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:23:52.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:52 smithi172 bash[23680]: audit 2024-03-30T15:23:51.425307+0000 mon.a (mon.0) 3295 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-122"}]': finished 2024-03-30T15:23:52.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:52 smithi172 bash[23680]: cluster 2024-03-30T15:23:51.433680+0000 mon.a (mon.0) 3296 : cluster 0 osdmap e637: 8 total, 8 up, 8 in 2024-03-30T15:23:52.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:52 smithi172 bash[23680]: audit 2024-03-30T15:23:51.593377+0000 mgr.y (mgr.14526) 626 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:23:52.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:52 smithi172 bash[23680]: audit 2024-03-30T15:23:52.140046+0000 mon.c (mon.2) 513 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:23:52.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:52 smithi172 bash[23680]: cluster 2024-03-30T15:23:52.297805+0000 mon.a (mon.0) 3297 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:23:52.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:52 smithi072 bash[21573]: cluster 2024-03-30T15:23:51.422831+0000 mon.a (mon.0) 3294 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:23:52.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:52 smithi072 bash[21573]: audit 2024-03-30T15:23:51.425307+0000 mon.a (mon.0) 3295 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-122"}]': finished 2024-03-30T15:23:52.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:52 smithi072 bash[21573]: cluster 2024-03-30T15:23:51.433680+0000 mon.a (mon.0) 3296 : cluster 0 osdmap e637: 8 total, 8 up, 8 in 2024-03-30T15:23:52.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:52 smithi072 bash[21573]: audit 2024-03-30T15:23:51.593377+0000 mgr.y (mgr.14526) 626 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:23:52.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:52 smithi072 bash[21573]: audit 2024-03-30T15:23:52.140046+0000 mon.c (mon.2) 513 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:23:52.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:52 smithi072 bash[21573]: cluster 2024-03-30T15:23:52.297805+0000 mon.a (mon.0) 3297 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:23:52.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:52 smithi072 bash[28946]: cluster 2024-03-30T15:23:51.422831+0000 mon.a (mon.0) 3294 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:23:52.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:52 smithi072 bash[28946]: audit 2024-03-30T15:23:51.425307+0000 mon.a (mon.0) 3295 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-122"}]': finished 2024-03-30T15:23:52.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:52 smithi072 bash[28946]: cluster 2024-03-30T15:23:51.433680+0000 mon.a (mon.0) 3296 : cluster 0 osdmap e637: 8 total, 8 up, 8 in 2024-03-30T15:23:52.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:52 smithi072 bash[28946]: audit 2024-03-30T15:23:51.593377+0000 mgr.y (mgr.14526) 626 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:23:52.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:52 smithi072 bash[28946]: audit 2024-03-30T15:23:52.140046+0000 mon.c (mon.2) 513 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:23:52.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:52 smithi072 bash[28946]: cluster 2024-03-30T15:23:52.297805+0000 mon.a (mon.0) 3297 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:23:53.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:53 smithi172 bash[23680]: cluster 2024-03-30T15:23:52.271305+0000 mgr.y (mgr.14526) 627 : cluster 0 pgmap v1028: 204 pgs: 204 active+clean; 582 KiB data, 667 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 3 op/s 2024-03-30T15:23:53.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:53 smithi172 bash[23680]: cluster 2024-03-30T15:23:52.457844+0000 mon.a (mon.0) 3298 : cluster 0 osdmap e638: 8 total, 8 up, 8 in 2024-03-30T15:23:53.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:53 smithi072 bash[21573]: cluster 2024-03-30T15:23:52.271305+0000 mgr.y (mgr.14526) 627 : cluster 0 pgmap v1028: 204 pgs: 204 active+clean; 582 KiB data, 667 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 3 op/s 2024-03-30T15:23:53.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:53 smithi072 bash[21573]: cluster 2024-03-30T15:23:52.457844+0000 mon.a (mon.0) 3298 : cluster 0 osdmap e638: 8 total, 8 up, 8 in 2024-03-30T15:23:53.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:53 smithi072 bash[28946]: cluster 2024-03-30T15:23:52.271305+0000 mgr.y (mgr.14526) 627 : cluster 0 pgmap v1028: 204 pgs: 204 active+clean; 582 KiB data, 667 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 3 op/s 2024-03-30T15:23:53.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:53 smithi072 bash[28946]: cluster 2024-03-30T15:23:52.457844+0000 mon.a (mon.0) 3298 : cluster 0 osdmap e638: 8 total, 8 up, 8 in 2024-03-30T15:23:54.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:54 smithi072 bash[21573]: cluster 2024-03-30T15:23:53.469784+0000 mon.a (mon.0) 3299 : cluster 0 osdmap e639: 8 total, 8 up, 8 in 2024-03-30T15:23:54.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:54 smithi072 bash[21573]: audit 2024-03-30T15:23:53.475031+0000 mon.a (mon.0) 3300 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:23:54.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:54 smithi072 bash[28946]: cluster 2024-03-30T15:23:53.469784+0000 mon.a (mon.0) 3299 : cluster 0 osdmap e639: 8 total, 8 up, 8 in 2024-03-30T15:23:54.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:54 smithi072 bash[28946]: audit 2024-03-30T15:23:53.475031+0000 mon.a (mon.0) 3300 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:23:54.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:54 smithi172 bash[23680]: cluster 2024-03-30T15:23:53.469784+0000 mon.a (mon.0) 3299 : cluster 0 osdmap e639: 8 total, 8 up, 8 in 2024-03-30T15:23:54.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:54 smithi172 bash[23680]: audit 2024-03-30T15:23:53.475031+0000 mon.a (mon.0) 3300 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:23:55.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:55 smithi072 bash[21573]: cluster 2024-03-30T15:23:54.272145+0000 mgr.y (mgr.14526) 628 : cluster 0 pgmap v1031: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 667 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-03-30T15:23:55.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:55 smithi072 bash[21573]: audit 2024-03-30T15:23:54.472250+0000 mon.a (mon.0) 3301 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-124","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:23:55.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:55 smithi072 bash[21573]: cluster 2024-03-30T15:23:54.483498+0000 mon.a (mon.0) 3302 : cluster 0 osdmap e640: 8 total, 8 up, 8 in 2024-03-30T15:23:55.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:55 smithi072 bash[28946]: cluster 2024-03-30T15:23:54.272145+0000 mgr.y (mgr.14526) 628 : cluster 0 pgmap v1031: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 667 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-03-30T15:23:55.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:55 smithi072 bash[28946]: audit 2024-03-30T15:23:54.472250+0000 mon.a (mon.0) 3301 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-124","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:23:55.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:55 smithi072 bash[28946]: cluster 2024-03-30T15:23:54.483498+0000 mon.a (mon.0) 3302 : cluster 0 osdmap e640: 8 total, 8 up, 8 in 2024-03-30T15:23:55.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:55 smithi172 bash[23680]: cluster 2024-03-30T15:23:54.272145+0000 mgr.y (mgr.14526) 628 : cluster 0 pgmap v1031: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 667 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-03-30T15:23:55.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:55 smithi172 bash[23680]: audit 2024-03-30T15:23:54.472250+0000 mon.a (mon.0) 3301 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-124","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:23:55.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:55 smithi172 bash[23680]: cluster 2024-03-30T15:23:54.483498+0000 mon.a (mon.0) 3302 : cluster 0 osdmap e640: 8 total, 8 up, 8 in 2024-03-30T15:23:56.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:56 smithi072 bash[21573]: cluster 2024-03-30T15:23:55.488966+0000 mon.a (mon.0) 3303 : cluster 0 osdmap e641: 8 total, 8 up, 8 in 2024-03-30T15:23:56.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:56 smithi072 bash[21573]: audit 2024-03-30T15:23:55.514494+0000 mon.a (mon.0) 3304 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-124", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:23:56.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:56 smithi072 bash[28946]: cluster 2024-03-30T15:23:55.488966+0000 mon.a (mon.0) 3303 : cluster 0 osdmap e641: 8 total, 8 up, 8 in 2024-03-30T15:23:56.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:56 smithi072 bash[28946]: audit 2024-03-30T15:23:55.514494+0000 mon.a (mon.0) 3304 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-124", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:23:56.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:56 smithi172 bash[23680]: cluster 2024-03-30T15:23:55.488966+0000 mon.a (mon.0) 3303 : cluster 0 osdmap e641: 8 total, 8 up, 8 in 2024-03-30T15:23:56.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:56 smithi172 bash[23680]: audit 2024-03-30T15:23:55.514494+0000 mon.a (mon.0) 3304 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-124", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:23:57.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:57 smithi072 bash[21573]: cluster 2024-03-30T15:23:56.274137+0000 mgr.y (mgr.14526) 629 : cluster 0 pgmap v1034: 204 pgs: 204 active+clean; 582 KiB data, 672 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1.7 KiB/s wr, 1 op/s 2024-03-30T15:23:57.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:57 smithi072 bash[21573]: audit 2024-03-30T15:23:56.494068+0000 mon.a (mon.0) 3305 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-124", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:23:57.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:57 smithi072 bash[21573]: cluster 2024-03-30T15:23:56.503791+0000 mon.a (mon.0) 3306 : cluster 0 osdmap e642: 8 total, 8 up, 8 in 2024-03-30T15:23:57.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:57 smithi072 bash[21573]: audit 2024-03-30T15:23:56.507137+0000 mon.a (mon.0) 3307 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-124"}]: dispatch 2024-03-30T15:23:57.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:57 smithi072 bash[28946]: cluster 2024-03-30T15:23:56.274137+0000 mgr.y (mgr.14526) 629 : cluster 0 pgmap v1034: 204 pgs: 204 active+clean; 582 KiB data, 672 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1.7 KiB/s wr, 1 op/s 2024-03-30T15:23:57.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:57 smithi072 bash[28946]: audit 2024-03-30T15:23:56.494068+0000 mon.a (mon.0) 3305 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-124", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:23:57.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:57 smithi072 bash[28946]: cluster 2024-03-30T15:23:56.503791+0000 mon.a (mon.0) 3306 : cluster 0 osdmap e642: 8 total, 8 up, 8 in 2024-03-30T15:23:57.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:57 smithi072 bash[28946]: audit 2024-03-30T15:23:56.507137+0000 mon.a (mon.0) 3307 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-124"}]: dispatch 2024-03-30T15:23:57.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:57 smithi172 bash[23680]: cluster 2024-03-30T15:23:56.274137+0000 mgr.y (mgr.14526) 629 : cluster 0 pgmap v1034: 204 pgs: 204 active+clean; 582 KiB data, 672 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1.7 KiB/s wr, 1 op/s 2024-03-30T15:23:57.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:57 smithi172 bash[23680]: audit 2024-03-30T15:23:56.494068+0000 mon.a (mon.0) 3305 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-124", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:23:57.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:57 smithi172 bash[23680]: cluster 2024-03-30T15:23:56.503791+0000 mon.a (mon.0) 3306 : cluster 0 osdmap e642: 8 total, 8 up, 8 in 2024-03-30T15:23:57.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:57 smithi172 bash[23680]: audit 2024-03-30T15:23:56.507137+0000 mon.a (mon.0) 3307 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-124"}]: dispatch 2024-03-30T15:23:58.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:58 smithi072 bash[21573]: audit 2024-03-30T15:23:57.496858+0000 mon.a (mon.0) 3308 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-124"}]': finished 2024-03-30T15:23:58.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:58 smithi072 bash[21573]: cluster 2024-03-30T15:23:57.504343+0000 mon.a (mon.0) 3309 : cluster 0 osdmap e643: 8 total, 8 up, 8 in 2024-03-30T15:23:58.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:58 smithi072 bash[21573]: audit 2024-03-30T15:23:57.506444+0000 mon.a (mon.0) 3310 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-124", "mode": "writeback"}]: dispatch 2024-03-30T15:23:58.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:58 smithi072 bash[21573]: cluster 2024-03-30T15:23:58.497486+0000 mon.a (mon.0) 3311 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:23:58.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:58 smithi072 bash[21573]: audit 2024-03-30T15:23:58.499989+0000 mon.a (mon.0) 3312 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-124", "mode": "writeback"}]': finished 2024-03-30T15:23:58.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:58 smithi072 bash[28946]: audit 2024-03-30T15:23:57.496858+0000 mon.a (mon.0) 3308 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-124"}]': finished 2024-03-30T15:23:58.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:58 smithi072 bash[28946]: cluster 2024-03-30T15:23:57.504343+0000 mon.a (mon.0) 3309 : cluster 0 osdmap e643: 8 total, 8 up, 8 in 2024-03-30T15:23:58.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:58 smithi072 bash[28946]: audit 2024-03-30T15:23:57.506444+0000 mon.a (mon.0) 3310 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-124", "mode": "writeback"}]: dispatch 2024-03-30T15:23:58.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:58 smithi072 bash[28946]: cluster 2024-03-30T15:23:58.497486+0000 mon.a (mon.0) 3311 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:23:58.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:58 smithi072 bash[28946]: audit 2024-03-30T15:23:58.499989+0000 mon.a (mon.0) 3312 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-124", "mode": "writeback"}]': finished 2024-03-30T15:23:58.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:58 smithi172 bash[23680]: audit 2024-03-30T15:23:57.496858+0000 mon.a (mon.0) 3308 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-124"}]': finished 2024-03-30T15:23:58.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:58 smithi172 bash[23680]: cluster 2024-03-30T15:23:57.504343+0000 mon.a (mon.0) 3309 : cluster 0 osdmap e643: 8 total, 8 up, 8 in 2024-03-30T15:23:58.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:58 smithi172 bash[23680]: audit 2024-03-30T15:23:57.506444+0000 mon.a (mon.0) 3310 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-124", "mode": "writeback"}]: dispatch 2024-03-30T15:23:58.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:58 smithi172 bash[23680]: cluster 2024-03-30T15:23:58.497486+0000 mon.a (mon.0) 3311 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:23:58.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:58 smithi172 bash[23680]: audit 2024-03-30T15:23:58.499989+0000 mon.a (mon.0) 3312 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-124", "mode": "writeback"}]': finished 2024-03-30T15:23:59.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:59 smithi072 bash[21573]: cluster 2024-03-30T15:23:58.274976+0000 mgr.y (mgr.14526) 630 : cluster 0 pgmap v1037: 204 pgs: 204 active+clean; 582 KiB data, 672 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-03-30T15:23:59.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:23:59 smithi072 bash[21573]: cluster 2024-03-30T15:23:58.508337+0000 mon.a (mon.0) 3313 : cluster 0 osdmap e644: 8 total, 8 up, 8 in 2024-03-30T15:23:59.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:59 smithi072 bash[28946]: cluster 2024-03-30T15:23:58.274976+0000 mgr.y (mgr.14526) 630 : cluster 0 pgmap v1037: 204 pgs: 204 active+clean; 582 KiB data, 672 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-03-30T15:23:59.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:23:59 smithi072 bash[28946]: cluster 2024-03-30T15:23:58.508337+0000 mon.a (mon.0) 3313 : cluster 0 osdmap e644: 8 total, 8 up, 8 in 2024-03-30T15:23:59.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:59 smithi172 bash[23680]: cluster 2024-03-30T15:23:58.274976+0000 mgr.y (mgr.14526) 630 : cluster 0 pgmap v1037: 204 pgs: 204 active+clean; 582 KiB data, 672 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-03-30T15:23:59.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:23:59 smithi172 bash[23680]: cluster 2024-03-30T15:23:58.508337+0000 mon.a (mon.0) 3313 : cluster 0 osdmap e644: 8 total, 8 up, 8 in 2024-03-30T15:24:00.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:00 smithi072 bash[21573]: cluster 2024-03-30T15:23:59.544678+0000 mon.a (mon.0) 3314 : cluster 0 osdmap e645: 8 total, 8 up, 8 in 2024-03-30T15:24:00.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:00 smithi072 bash[21573]: audit 2024-03-30T15:23:59.608695+0000 mon.a (mon.0) 3315 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:24:00.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:00 smithi072 bash[28946]: cluster 2024-03-30T15:23:59.544678+0000 mon.a (mon.0) 3314 : cluster 0 osdmap e645: 8 total, 8 up, 8 in 2024-03-30T15:24:00.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:00 smithi072 bash[28946]: audit 2024-03-30T15:23:59.608695+0000 mon.a (mon.0) 3315 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:24:00.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:00 smithi172 bash[23680]: cluster 2024-03-30T15:23:59.544678+0000 mon.a (mon.0) 3314 : cluster 0 osdmap e645: 8 total, 8 up, 8 in 2024-03-30T15:24:00.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:00 smithi172 bash[23680]: audit 2024-03-30T15:23:59.608695+0000 mon.a (mon.0) 3315 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:24:01.418 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:24:01 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:24:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:24:01.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:01 smithi072 bash[21573]: cluster 2024-03-30T15:24:00.275849+0000 mgr.y (mgr.14526) 631 : cluster 0 pgmap v1040: 204 pgs: 204 active+clean; 582 KiB data, 672 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:24:01.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:01 smithi072 bash[21573]: audit 2024-03-30T15:24:00.542211+0000 mon.a (mon.0) 3316 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:24:01.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:01 smithi072 bash[21573]: cluster 2024-03-30T15:24:00.554465+0000 mon.a (mon.0) 3317 : cluster 0 osdmap e646: 8 total, 8 up, 8 in 2024-03-30T15:24:01.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:01 smithi072 bash[21573]: audit 2024-03-30T15:24:00.558219+0000 mon.a (mon.0) 3318 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-124"}]: dispatch 2024-03-30T15:24:01.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:01 smithi072 bash[28946]: cluster 2024-03-30T15:24:00.275849+0000 mgr.y (mgr.14526) 631 : cluster 0 pgmap v1040: 204 pgs: 204 active+clean; 582 KiB data, 672 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:24:01.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:01 smithi072 bash[28946]: audit 2024-03-30T15:24:00.542211+0000 mon.a (mon.0) 3316 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:24:01.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:01 smithi072 bash[28946]: cluster 2024-03-30T15:24:00.554465+0000 mon.a (mon.0) 3317 : cluster 0 osdmap e646: 8 total, 8 up, 8 in 2024-03-30T15:24:01.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:01 smithi072 bash[28946]: audit 2024-03-30T15:24:00.558219+0000 mon.a (mon.0) 3318 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-124"}]: dispatch 2024-03-30T15:24:01.967 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:24:01 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:24:01.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:01 smithi172 bash[23680]: cluster 2024-03-30T15:24:00.275849+0000 mgr.y (mgr.14526) 631 : cluster 0 pgmap v1040: 204 pgs: 204 active+clean; 582 KiB data, 672 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:24:01.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:01 smithi172 bash[23680]: audit 2024-03-30T15:24:00.542211+0000 mon.a (mon.0) 3316 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:24:01.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:01 smithi172 bash[23680]: cluster 2024-03-30T15:24:00.554465+0000 mon.a (mon.0) 3317 : cluster 0 osdmap e646: 8 total, 8 up, 8 in 2024-03-30T15:24:01.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:01 smithi172 bash[23680]: audit 2024-03-30T15:24:00.558219+0000 mon.a (mon.0) 3318 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-124"}]: dispatch 2024-03-30T15:24:02.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:02 smithi072 bash[21573]: cluster 2024-03-30T15:24:01.542607+0000 mon.a (mon.0) 3319 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:24:02.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:02 smithi072 bash[21573]: audit 2024-03-30T15:24:01.544930+0000 mon.a (mon.0) 3320 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-124"}]': finished 2024-03-30T15:24:02.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:02 smithi072 bash[21573]: cluster 2024-03-30T15:24:01.554139+0000 mon.a (mon.0) 3321 : cluster 0 osdmap e647: 8 total, 8 up, 8 in 2024-03-30T15:24:02.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:02 smithi072 bash[21573]: audit 2024-03-30T15:24:01.602798+0000 mgr.y (mgr.14526) 632 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:24:02.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:02 smithi072 bash[28946]: cluster 2024-03-30T15:24:01.542607+0000 mon.a (mon.0) 3319 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:24:02.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:02 smithi072 bash[28946]: audit 2024-03-30T15:24:01.544930+0000 mon.a (mon.0) 3320 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-124"}]': finished 2024-03-30T15:24:02.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:02 smithi072 bash[28946]: cluster 2024-03-30T15:24:01.554139+0000 mon.a (mon.0) 3321 : cluster 0 osdmap e647: 8 total, 8 up, 8 in 2024-03-30T15:24:02.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:02 smithi072 bash[28946]: audit 2024-03-30T15:24:01.602798+0000 mgr.y (mgr.14526) 632 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:24:02.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:02 smithi172 bash[23680]: cluster 2024-03-30T15:24:01.542607+0000 mon.a (mon.0) 3319 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:24:02.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:02 smithi172 bash[23680]: audit 2024-03-30T15:24:01.544930+0000 mon.a (mon.0) 3320 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-124"}]': finished 2024-03-30T15:24:02.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:02 smithi172 bash[23680]: cluster 2024-03-30T15:24:01.554139+0000 mon.a (mon.0) 3321 : cluster 0 osdmap e647: 8 total, 8 up, 8 in 2024-03-30T15:24:02.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:02 smithi172 bash[23680]: audit 2024-03-30T15:24:01.602798+0000 mgr.y (mgr.14526) 632 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:24:03.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:03 smithi072 bash[21573]: cluster 2024-03-30T15:24:02.276709+0000 mgr.y (mgr.14526) 633 : cluster 0 pgmap v1043: 204 pgs: 204 active+clean; 582 KiB data, 673 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 0 B/s wr, 4 op/s 2024-03-30T15:24:03.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:03 smithi072 bash[21573]: cluster 2024-03-30T15:24:02.559233+0000 mon.a (mon.0) 3322 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:24:03.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:03 smithi072 bash[21573]: cluster 2024-03-30T15:24:02.585264+0000 mon.a (mon.0) 3323 : cluster 0 osdmap e648: 8 total, 8 up, 8 in 2024-03-30T15:24:03.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:03 smithi072 bash[28946]: cluster 2024-03-30T15:24:02.276709+0000 mgr.y (mgr.14526) 633 : cluster 0 pgmap v1043: 204 pgs: 204 active+clean; 582 KiB data, 673 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 0 B/s wr, 4 op/s 2024-03-30T15:24:03.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:03 smithi072 bash[28946]: cluster 2024-03-30T15:24:02.559233+0000 mon.a (mon.0) 3322 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:24:03.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:03 smithi072 bash[28946]: cluster 2024-03-30T15:24:02.585264+0000 mon.a (mon.0) 3323 : cluster 0 osdmap e648: 8 total, 8 up, 8 in 2024-03-30T15:24:03.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:03 smithi172 bash[23680]: cluster 2024-03-30T15:24:02.276709+0000 mgr.y (mgr.14526) 633 : cluster 0 pgmap v1043: 204 pgs: 204 active+clean; 582 KiB data, 673 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 0 B/s wr, 4 op/s 2024-03-30T15:24:03.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:03 smithi172 bash[23680]: cluster 2024-03-30T15:24:02.559233+0000 mon.a (mon.0) 3322 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:24:03.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:03 smithi172 bash[23680]: cluster 2024-03-30T15:24:02.585264+0000 mon.a (mon.0) 3323 : cluster 0 osdmap e648: 8 total, 8 up, 8 in 2024-03-30T15:24:04.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:04 smithi072 bash[21573]: cluster 2024-03-30T15:24:03.590222+0000 mon.a (mon.0) 3324 : cluster 0 osdmap e649: 8 total, 8 up, 8 in 2024-03-30T15:24:04.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:04 smithi072 bash[21573]: audit 2024-03-30T15:24:03.597143+0000 mon.a (mon.0) 3325 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:24:04.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:04 smithi072 bash[21573]: audit 2024-03-30T15:24:04.578126+0000 mon.a (mon.0) 3326 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-126","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:24:04.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:04 smithi072 bash[21573]: cluster 2024-03-30T15:24:04.585665+0000 mon.a (mon.0) 3327 : cluster 0 osdmap e650: 8 total, 8 up, 8 in 2024-03-30T15:24:04.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:04 smithi072 bash[21573]: audit 2024-03-30T15:24:04.588125+0000 mon.a (mon.0) 3328 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-126", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:24:04.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:04 smithi072 bash[28946]: cluster 2024-03-30T15:24:03.590222+0000 mon.a (mon.0) 3324 : cluster 0 osdmap e649: 8 total, 8 up, 8 in 2024-03-30T15:24:04.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:04 smithi072 bash[28946]: audit 2024-03-30T15:24:03.597143+0000 mon.a (mon.0) 3325 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:24:04.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:04 smithi072 bash[28946]: audit 2024-03-30T15:24:04.578126+0000 mon.a (mon.0) 3326 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-126","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:24:04.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:04 smithi072 bash[28946]: cluster 2024-03-30T15:24:04.585665+0000 mon.a (mon.0) 3327 : cluster 0 osdmap e650: 8 total, 8 up, 8 in 2024-03-30T15:24:04.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:04 smithi072 bash[28946]: audit 2024-03-30T15:24:04.588125+0000 mon.a (mon.0) 3328 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-126", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:24:04.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:04 smithi172 bash[23680]: cluster 2024-03-30T15:24:03.590222+0000 mon.a (mon.0) 3324 : cluster 0 osdmap e649: 8 total, 8 up, 8 in 2024-03-30T15:24:04.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:04 smithi172 bash[23680]: audit 2024-03-30T15:24:03.597143+0000 mon.a (mon.0) 3325 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:24:04.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:04 smithi172 bash[23680]: audit 2024-03-30T15:24:04.578126+0000 mon.a (mon.0) 3326 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-126","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:24:04.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:04 smithi172 bash[23680]: cluster 2024-03-30T15:24:04.585665+0000 mon.a (mon.0) 3327 : cluster 0 osdmap e650: 8 total, 8 up, 8 in 2024-03-30T15:24:04.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:04 smithi172 bash[23680]: audit 2024-03-30T15:24:04.588125+0000 mon.a (mon.0) 3328 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-126", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:24:05.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:05 smithi072 bash[21573]: cluster 2024-03-30T15:24:04.277549+0000 mgr.y (mgr.14526) 634 : cluster 0 pgmap v1046: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 673 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:24:05.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:05 smithi072 bash[21573]: audit 2024-03-30T15:24:05.580781+0000 mon.a (mon.0) 3329 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-126", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:24:05.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:05 smithi072 bash[21573]: cluster 2024-03-30T15:24:05.588057+0000 mon.a (mon.0) 3330 : cluster 0 osdmap e651: 8 total, 8 up, 8 in 2024-03-30T15:24:05.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:05 smithi072 bash[21573]: audit 2024-03-30T15:24:05.588759+0000 mon.a (mon.0) 3331 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-126"}]: dispatch 2024-03-30T15:24:05.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:05 smithi072 bash[28946]: cluster 2024-03-30T15:24:04.277549+0000 mgr.y (mgr.14526) 634 : cluster 0 pgmap v1046: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 673 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:24:05.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:05 smithi072 bash[28946]: audit 2024-03-30T15:24:05.580781+0000 mon.a (mon.0) 3329 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-126", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:24:05.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:05 smithi072 bash[28946]: cluster 2024-03-30T15:24:05.588057+0000 mon.a (mon.0) 3330 : cluster 0 osdmap e651: 8 total, 8 up, 8 in 2024-03-30T15:24:05.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:05 smithi072 bash[28946]: audit 2024-03-30T15:24:05.588759+0000 mon.a (mon.0) 3331 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-126"}]: dispatch 2024-03-30T15:24:05.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:05 smithi172 bash[23680]: cluster 2024-03-30T15:24:04.277549+0000 mgr.y (mgr.14526) 634 : cluster 0 pgmap v1046: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 673 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:24:05.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:05 smithi172 bash[23680]: audit 2024-03-30T15:24:05.580781+0000 mon.a (mon.0) 3329 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-126", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:24:05.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:05 smithi172 bash[23680]: cluster 2024-03-30T15:24:05.588057+0000 mon.a (mon.0) 3330 : cluster 0 osdmap e651: 8 total, 8 up, 8 in 2024-03-30T15:24:05.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:05 smithi172 bash[23680]: audit 2024-03-30T15:24:05.588759+0000 mon.a (mon.0) 3331 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-126"}]: dispatch 2024-03-30T15:24:07.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:07 smithi072 bash[21573]: cluster 2024-03-30T15:24:06.279566+0000 mgr.y (mgr.14526) 635 : cluster 0 pgmap v1049: 204 pgs: 204 active+clean; 582 KiB data, 673 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:24:07.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:07 smithi072 bash[21573]: audit 2024-03-30T15:24:06.583574+0000 mon.a (mon.0) 3332 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-126"}]': finished 2024-03-30T15:24:07.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:07 smithi072 bash[21573]: cluster 2024-03-30T15:24:06.590836+0000 mon.a (mon.0) 3333 : cluster 0 osdmap e652: 8 total, 8 up, 8 in 2024-03-30T15:24:07.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:07 smithi072 bash[21573]: audit 2024-03-30T15:24:06.591633+0000 mon.a (mon.0) 3334 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-126", "mode": "writeback"}]: dispatch 2024-03-30T15:24:07.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:07 smithi072 bash[21573]: audit 2024-03-30T15:24:07.173304+0000 mon.c (mon.2) 514 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:24:07.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:07 smithi072 bash[21573]: cluster 2024-03-30T15:24:07.302697+0000 mon.a (mon.0) 3335 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:24:07.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:07 smithi072 bash[21573]: audit 2024-03-30T15:24:07.305197+0000 mon.a (mon.0) 3336 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-126", "mode": "writeback"}]': finished 2024-03-30T15:24:07.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:07 smithi072 bash[21573]: cluster 2024-03-30T15:24:07.312438+0000 mon.a (mon.0) 3337 : cluster 0 osdmap e653: 8 total, 8 up, 8 in 2024-03-30T15:24:07.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:07 smithi072 bash[21573]: audit 2024-03-30T15:24:07.461924+0000 mon.a (mon.0) 3338 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:24:07.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:07 smithi072 bash[28946]: cluster 2024-03-30T15:24:06.279566+0000 mgr.y (mgr.14526) 635 : cluster 0 pgmap v1049: 204 pgs: 204 active+clean; 582 KiB data, 673 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:24:07.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:07 smithi072 bash[28946]: audit 2024-03-30T15:24:06.583574+0000 mon.a (mon.0) 3332 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-126"}]': finished 2024-03-30T15:24:07.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:07 smithi072 bash[28946]: cluster 2024-03-30T15:24:06.590836+0000 mon.a (mon.0) 3333 : cluster 0 osdmap e652: 8 total, 8 up, 8 in 2024-03-30T15:24:07.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:07 smithi072 bash[28946]: audit 2024-03-30T15:24:06.591633+0000 mon.a (mon.0) 3334 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-126", "mode": "writeback"}]: dispatch 2024-03-30T15:24:07.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:07 smithi072 bash[28946]: audit 2024-03-30T15:24:07.173304+0000 mon.c (mon.2) 514 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:24:07.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:07 smithi072 bash[28946]: cluster 2024-03-30T15:24:07.302697+0000 mon.a (mon.0) 3335 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:24:07.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:07 smithi072 bash[28946]: audit 2024-03-30T15:24:07.305197+0000 mon.a (mon.0) 3336 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-126", "mode": "writeback"}]': finished 2024-03-30T15:24:07.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:07 smithi072 bash[28946]: cluster 2024-03-30T15:24:07.312438+0000 mon.a (mon.0) 3337 : cluster 0 osdmap e653: 8 total, 8 up, 8 in 2024-03-30T15:24:07.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:07 smithi072 bash[28946]: audit 2024-03-30T15:24:07.461924+0000 mon.a (mon.0) 3338 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:24:07.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:07 smithi172 bash[23680]: cluster 2024-03-30T15:24:06.279566+0000 mgr.y (mgr.14526) 635 : cluster 0 pgmap v1049: 204 pgs: 204 active+clean; 582 KiB data, 673 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:24:07.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:07 smithi172 bash[23680]: audit 2024-03-30T15:24:06.583574+0000 mon.a (mon.0) 3332 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-126"}]': finished 2024-03-30T15:24:07.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:07 smithi172 bash[23680]: cluster 2024-03-30T15:24:06.590836+0000 mon.a (mon.0) 3333 : cluster 0 osdmap e652: 8 total, 8 up, 8 in 2024-03-30T15:24:07.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:07 smithi172 bash[23680]: audit 2024-03-30T15:24:06.591633+0000 mon.a (mon.0) 3334 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-126", "mode": "writeback"}]: dispatch 2024-03-30T15:24:07.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:07 smithi172 bash[23680]: audit 2024-03-30T15:24:07.173304+0000 mon.c (mon.2) 514 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:24:07.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:07 smithi172 bash[23680]: cluster 2024-03-30T15:24:07.302697+0000 mon.a (mon.0) 3335 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:24:07.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:07 smithi172 bash[23680]: audit 2024-03-30T15:24:07.305197+0000 mon.a (mon.0) 3336 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-126", "mode": "writeback"}]': finished 2024-03-30T15:24:07.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:07 smithi172 bash[23680]: cluster 2024-03-30T15:24:07.312438+0000 mon.a (mon.0) 3337 : cluster 0 osdmap e653: 8 total, 8 up, 8 in 2024-03-30T15:24:07.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:07 smithi172 bash[23680]: audit 2024-03-30T15:24:07.461924+0000 mon.a (mon.0) 3338 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:24:09.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:09 smithi072 bash[21573]: cluster 2024-03-30T15:24:08.280342+0000 mgr.y (mgr.14526) 636 : cluster 0 pgmap v1052: 204 pgs: 204 active+clean; 582 KiB data, 673 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:24:09.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:09 smithi072 bash[21573]: audit 2024-03-30T15:24:08.307765+0000 mon.a (mon.0) 3339 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:24:09.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:09 smithi072 bash[21573]: cluster 2024-03-30T15:24:08.317644+0000 mon.a (mon.0) 3340 : cluster 0 osdmap e654: 8 total, 8 up, 8 in 2024-03-30T15:24:09.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:09 smithi072 bash[21573]: audit 2024-03-30T15:24:08.320064+0000 mon.a (mon.0) 3341 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-126"}]: dispatch 2024-03-30T15:24:09.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:09 smithi072 bash[28946]: cluster 2024-03-30T15:24:08.280342+0000 mgr.y (mgr.14526) 636 : cluster 0 pgmap v1052: 204 pgs: 204 active+clean; 582 KiB data, 673 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:24:09.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:09 smithi072 bash[28946]: audit 2024-03-30T15:24:08.307765+0000 mon.a (mon.0) 3339 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:24:09.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:09 smithi072 bash[28946]: cluster 2024-03-30T15:24:08.317644+0000 mon.a (mon.0) 3340 : cluster 0 osdmap e654: 8 total, 8 up, 8 in 2024-03-30T15:24:09.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:09 smithi072 bash[28946]: audit 2024-03-30T15:24:08.320064+0000 mon.a (mon.0) 3341 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-126"}]: dispatch 2024-03-30T15:24:09.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:09 smithi172 bash[23680]: cluster 2024-03-30T15:24:08.280342+0000 mgr.y (mgr.14526) 636 : cluster 0 pgmap v1052: 204 pgs: 204 active+clean; 582 KiB data, 673 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:24:09.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:09 smithi172 bash[23680]: audit 2024-03-30T15:24:08.307765+0000 mon.a (mon.0) 3339 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:24:09.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:09 smithi172 bash[23680]: cluster 2024-03-30T15:24:08.317644+0000 mon.a (mon.0) 3340 : cluster 0 osdmap e654: 8 total, 8 up, 8 in 2024-03-30T15:24:09.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:09 smithi172 bash[23680]: audit 2024-03-30T15:24:08.320064+0000 mon.a (mon.0) 3341 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-126"}]: dispatch 2024-03-30T15:24:10.351 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: require_osd_release = squid 2024-03-30T15:24:10.351 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TierFlushDuringFlush (9124 ms) 2024-03-30T15:24:10.351 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2024-03-30T15:24:10.351 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: require_osd_release = squid 2024-03-30T15:24:10.351 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapHasChunk (6071 ms) 2024-03-30T15:24:10.351 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollback 2024-03-30T15:24:10.351 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: require_osd_release = squid 2024-03-30T15:24:10.351 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRollback (5062 ms) 2024-03-30T15:24:10.352 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2024-03-30T15:24:10.352 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: require_osd_release = squid 2024-03-30T15:24:10.352 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRollbackRefcount (25186 ms) 2024-03-30T15:24:10.352 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictRollback 2024-03-30T15:24:10.352 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: require_osd_release = squid 2024-03-30T15:24:10.352 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvictRollback (14073 ms) 2024-03-30T15:24:10.352 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PropagateBaseTierError 2024-03-30T15:24:10.352 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PropagateBaseTierError (12121 ms) 2024-03-30T15:24:10.352 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HelloWriteReturn 2024-03-30T15:24:10.352 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: 00000000 79 6f 75 20 6d 69 67 68 74 20 73 65 65 20 74 68 |you might see th| 2024-03-30T15:24:10.352 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: 00000010 69 73 |is| 2024-03-30T15:24:10.352 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: 00000012 2024-03-30T15:24:10.352 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HelloWriteReturn (12066 ms) 2024-03-30T15:24:10.352 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2024-03-30T15:24:10.353 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: require_osd_release = squid 2024-03-30T15:24:10.353 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier (6044 ms) 2024-03-30T15:24:10.353 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [----------] 48 tests from LibRadosTwoPoolsPP (569648 ms total) 2024-03-30T15:24:10.353 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: 2024-03-30T15:24:10.353 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP 2024-03-30T15:24:10.353 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.Dirty 2024-03-30T15:24:10.353 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.Dirty (1021 ms) 2024-03-30T15:24:10.353 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.FlushWriteRaces 2024-03-30T15:24:10.353 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.FlushWriteRaces (11046 ms) 2024-03-30T15:24:10.353 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.CallForcesPromote 2024-03-30T15:24:10.353 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.CallForcesPromote (18135 ms) 2024-03-30T15:24:10.353 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.HitSetNone 2024-03-30T15:24:10.353 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.HitSetNone (4 ms) 2024-03-30T15:24:10.353 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP (30206 ms total) 2024-03-30T15:24:10.353 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: 2024-03-30T15:24:10.354 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP 2024-03-30T15:24:10.354 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Overlay 2024-03-30T15:24:10.354 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Overlay (7072 ms) 2024-03-30T15:24:10.354 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Promote 2024-03-30T15:24:10.354 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Promote (8095 ms) 2024-03-30T15:24:10.354 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnap 2024-03-30T15:24:10.354 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: waiting for scrub... 2024-03-30T15:24:10.354 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: done waiting 2024-03-30T15:24:10.354 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteSnap (25023 ms) 2024-03-30T15:24:10.354 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2024-03-30T15:24:10.354 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace (10298 ms) 2024-03-30T15:24:10.354 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Whiteout 2024-03-30T15:24:10.354 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Whiteout (7970 ms) 2024-03-30T15:24:10.354 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Evict 2024-03-30T15:24:10.355 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Evict (8081 ms) 2024-03-30T15:24:10.355 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.EvictSnap 2024-03-30T15:24:10.355 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.EvictSnap (10132 ms) 2024-03-30T15:24:10.355 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlush 2024-03-30T15:24:10.668 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:10 smithi072 bash[28946]: cluster 2024-03-30T15:24:09.308066+0000 mon.a (mon.0) 3342 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:24:10.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:10 smithi072 bash[28946]: audit 2024-03-30T15:24:09.310313+0000 mon.a (mon.0) 3343 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-126"}]': finished 2024-03-30T15:24:10.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:10 smithi072 bash[28946]: cluster 2024-03-30T15:24:09.319871+0000 mon.a (mon.0) 3344 : cluster 0 osdmap e655: 8 total, 8 up, 8 in 2024-03-30T15:24:10.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:10 smithi072 bash[21573]: cluster 2024-03-30T15:24:09.308066+0000 mon.a (mon.0) 3342 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:24:10.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:10 smithi072 bash[21573]: audit 2024-03-30T15:24:09.310313+0000 mon.a (mon.0) 3343 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-126"}]': finished 2024-03-30T15:24:10.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:10 smithi072 bash[21573]: cluster 2024-03-30T15:24:09.319871+0000 mon.a (mon.0) 3344 : cluster 0 osdmap e655: 8 total, 8 up, 8 in 2024-03-30T15:24:10.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:10 smithi172 bash[23680]: cluster 2024-03-30T15:24:09.308066+0000 mon.a (mon.0) 3342 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:24:10.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:10 smithi172 bash[23680]: audit 2024-03-30T15:24:09.310313+0000 mon.a (mon.0) 3343 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-126"}]': finished 2024-03-30T15:24:10.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:10 smithi172 bash[23680]: cluster 2024-03-30T15:24:09.319871+0000 mon.a (mon.0) 3344 : cluster 0 osdmap e655: 8 total, 8 up, 8 in 2024-03-30T15:24:11.366 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:24:11 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:24:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:24:11.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:11 smithi072 bash[21573]: cluster 2024-03-30T15:24:10.281256+0000 mgr.y (mgr.14526) 637 : cluster 0 pgmap v1055: 204 pgs: 204 active+clean; 582 KiB data, 673 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:24:11.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:11 smithi072 bash[21573]: cluster 2024-03-30T15:24:10.327321+0000 mon.a (mon.0) 3345 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:24:11.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:11 smithi072 bash[21573]: cluster 2024-03-30T15:24:10.352718+0000 mon.a (mon.0) 3346 : cluster 0 osdmap e656: 8 total, 8 up, 8 in 2024-03-30T15:24:11.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:11 smithi072 bash[28946]: cluster 2024-03-30T15:24:10.281256+0000 mgr.y (mgr.14526) 637 : cluster 0 pgmap v1055: 204 pgs: 204 active+clean; 582 KiB data, 673 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:24:11.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:11 smithi072 bash[28946]: cluster 2024-03-30T15:24:10.327321+0000 mon.a (mon.0) 3345 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:24:11.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:11 smithi072 bash[28946]: cluster 2024-03-30T15:24:10.352718+0000 mon.a (mon.0) 3346 : cluster 0 osdmap e656: 8 total, 8 up, 8 in 2024-03-30T15:24:11.717 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:24:11 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:24:11.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:11 smithi172 bash[23680]: cluster 2024-03-30T15:24:10.281256+0000 mgr.y (mgr.14526) 637 : cluster 0 pgmap v1055: 204 pgs: 204 active+clean; 582 KiB data, 673 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:24:11.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:11 smithi172 bash[23680]: cluster 2024-03-30T15:24:10.327321+0000 mon.a (mon.0) 3345 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:24:11.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:11 smithi172 bash[23680]: cluster 2024-03-30T15:24:10.352718+0000 mon.a (mon.0) 3346 : cluster 0 osdmap e656: 8 total, 8 up, 8 in 2024-03-30T15:24:12.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:12 smithi072 bash[21573]: cluster 2024-03-30T15:24:11.355589+0000 mon.a (mon.0) 3347 : cluster 0 osdmap e657: 8 total, 8 up, 8 in 2024-03-30T15:24:12.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:12 smithi072 bash[21573]: audit 2024-03-30T15:24:11.367470+0000 mon.a (mon.0) 3348 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:24:12.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:12 smithi072 bash[21573]: audit 2024-03-30T15:24:11.614179+0000 mgr.y (mgr.14526) 638 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:24:12.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:12 smithi072 bash[21573]: audit 2024-03-30T15:24:12.346411+0000 mon.a (mon.0) 3349 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-128","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:24:12.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:12 smithi072 bash[21573]: cluster 2024-03-30T15:24:12.353654+0000 mon.a (mon.0) 3350 : cluster 0 osdmap e658: 8 total, 8 up, 8 in 2024-03-30T15:24:12.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:12 smithi072 bash[21573]: audit 2024-03-30T15:24:12.368382+0000 mon.a (mon.0) 3351 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-128", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:24:12.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:12 smithi072 bash[28946]: cluster 2024-03-30T15:24:11.355589+0000 mon.a (mon.0) 3347 : cluster 0 osdmap e657: 8 total, 8 up, 8 in 2024-03-30T15:24:12.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:12 smithi072 bash[28946]: audit 2024-03-30T15:24:11.367470+0000 mon.a (mon.0) 3348 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:24:12.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:12 smithi072 bash[28946]: audit 2024-03-30T15:24:11.614179+0000 mgr.y (mgr.14526) 638 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:24:12.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:12 smithi072 bash[28946]: audit 2024-03-30T15:24:12.346411+0000 mon.a (mon.0) 3349 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-128","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:24:12.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:12 smithi072 bash[28946]: cluster 2024-03-30T15:24:12.353654+0000 mon.a (mon.0) 3350 : cluster 0 osdmap e658: 8 total, 8 up, 8 in 2024-03-30T15:24:12.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:12 smithi072 bash[28946]: audit 2024-03-30T15:24:12.368382+0000 mon.a (mon.0) 3351 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-128", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:24:12.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:12 smithi172 bash[23680]: cluster 2024-03-30T15:24:11.355589+0000 mon.a (mon.0) 3347 : cluster 0 osdmap e657: 8 total, 8 up, 8 in 2024-03-30T15:24:12.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:12 smithi172 bash[23680]: audit 2024-03-30T15:24:11.367470+0000 mon.a (mon.0) 3348 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:24:12.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:12 smithi172 bash[23680]: audit 2024-03-30T15:24:11.614179+0000 mgr.y (mgr.14526) 638 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:24:12.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:12 smithi172 bash[23680]: audit 2024-03-30T15:24:12.346411+0000 mon.a (mon.0) 3349 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-128","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:24:12.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:12 smithi172 bash[23680]: cluster 2024-03-30T15:24:12.353654+0000 mon.a (mon.0) 3350 : cluster 0 osdmap e658: 8 total, 8 up, 8 in 2024-03-30T15:24:12.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:12 smithi172 bash[23680]: audit 2024-03-30T15:24:12.368382+0000 mon.a (mon.0) 3351 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-128", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:24:13.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:13 smithi072 bash[21573]: cluster 2024-03-30T15:24:12.282034+0000 mgr.y (mgr.14526) 639 : cluster 0 pgmap v1058: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 678 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:24:13.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:13 smithi072 bash[21573]: audit 2024-03-30T15:24:13.349128+0000 mon.a (mon.0) 3352 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-128", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:24:13.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:13 smithi072 bash[21573]: cluster 2024-03-30T15:24:13.357155+0000 mon.a (mon.0) 3353 : cluster 0 osdmap e659: 8 total, 8 up, 8 in 2024-03-30T15:24:13.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:13 smithi072 bash[21573]: audit 2024-03-30T15:24:13.358490+0000 mon.a (mon.0) 3354 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-128"}]: dispatch 2024-03-30T15:24:13.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:13 smithi072 bash[28946]: cluster 2024-03-30T15:24:12.282034+0000 mgr.y (mgr.14526) 639 : cluster 0 pgmap v1058: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 678 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:24:13.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:13 smithi072 bash[28946]: audit 2024-03-30T15:24:13.349128+0000 mon.a (mon.0) 3352 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-128", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:24:13.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:13 smithi072 bash[28946]: cluster 2024-03-30T15:24:13.357155+0000 mon.a (mon.0) 3353 : cluster 0 osdmap e659: 8 total, 8 up, 8 in 2024-03-30T15:24:13.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:13 smithi072 bash[28946]: audit 2024-03-30T15:24:13.358490+0000 mon.a (mon.0) 3354 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-128"}]: dispatch 2024-03-30T15:24:13.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:13 smithi172 bash[23680]: cluster 2024-03-30T15:24:12.282034+0000 mgr.y (mgr.14526) 639 : cluster 0 pgmap v1058: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 678 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:24:13.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:13 smithi172 bash[23680]: audit 2024-03-30T15:24:13.349128+0000 mon.a (mon.0) 3352 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-128", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:24:13.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:13 smithi172 bash[23680]: cluster 2024-03-30T15:24:13.357155+0000 mon.a (mon.0) 3353 : cluster 0 osdmap e659: 8 total, 8 up, 8 in 2024-03-30T15:24:13.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:13 smithi172 bash[23680]: audit 2024-03-30T15:24:13.358490+0000 mon.a (mon.0) 3354 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-128"}]: dispatch 2024-03-30T15:24:15.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:15 smithi072 bash[21573]: cluster 2024-03-30T15:24:14.282830+0000 mgr.y (mgr.14526) 640 : cluster 0 pgmap v1061: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 678 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:24:15.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:15 smithi072 bash[21573]: audit 2024-03-30T15:24:14.351640+0000 mon.a (mon.0) 3355 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-128"}]': finished 2024-03-30T15:24:15.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:15 smithi072 bash[21573]: cluster 2024-03-30T15:24:14.360646+0000 mon.a (mon.0) 3356 : cluster 0 osdmap e660: 8 total, 8 up, 8 in 2024-03-30T15:24:15.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:15 smithi072 bash[21573]: audit 2024-03-30T15:24:14.364806+0000 mon.a (mon.0) 3357 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-128", "mode": "writeback"}]: dispatch 2024-03-30T15:24:15.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:15 smithi072 bash[28946]: cluster 2024-03-30T15:24:14.282830+0000 mgr.y (mgr.14526) 640 : cluster 0 pgmap v1061: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 678 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:24:15.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:15 smithi072 bash[28946]: audit 2024-03-30T15:24:14.351640+0000 mon.a (mon.0) 3355 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-128"}]': finished 2024-03-30T15:24:15.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:15 smithi072 bash[28946]: cluster 2024-03-30T15:24:14.360646+0000 mon.a (mon.0) 3356 : cluster 0 osdmap e660: 8 total, 8 up, 8 in 2024-03-30T15:24:15.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:15 smithi072 bash[28946]: audit 2024-03-30T15:24:14.364806+0000 mon.a (mon.0) 3357 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-128", "mode": "writeback"}]: dispatch 2024-03-30T15:24:15.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:15 smithi172 bash[23680]: cluster 2024-03-30T15:24:14.282830+0000 mgr.y (mgr.14526) 640 : cluster 0 pgmap v1061: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 678 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:24:15.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:15 smithi172 bash[23680]: audit 2024-03-30T15:24:14.351640+0000 mon.a (mon.0) 3355 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-128"}]': finished 2024-03-30T15:24:15.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:15 smithi172 bash[23680]: cluster 2024-03-30T15:24:14.360646+0000 mon.a (mon.0) 3356 : cluster 0 osdmap e660: 8 total, 8 up, 8 in 2024-03-30T15:24:15.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:15 smithi172 bash[23680]: audit 2024-03-30T15:24:14.364806+0000 mon.a (mon.0) 3357 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-128", "mode": "writeback"}]: dispatch 2024-03-30T15:24:16.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:16 smithi072 bash[21573]: cluster 2024-03-30T15:24:15.352069+0000 mon.a (mon.0) 3358 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:24:16.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:16 smithi072 bash[21573]: audit 2024-03-30T15:24:15.354333+0000 mon.a (mon.0) 3359 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-128", "mode": "writeback"}]': finished 2024-03-30T15:24:16.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:16 smithi072 bash[21573]: cluster 2024-03-30T15:24:15.362261+0000 mon.a (mon.0) 3360 : cluster 0 osdmap e661: 8 total, 8 up, 8 in 2024-03-30T15:24:16.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:16 smithi072 bash[28946]: cluster 2024-03-30T15:24:15.352069+0000 mon.a (mon.0) 3358 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:24:16.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:16 smithi072 bash[28946]: audit 2024-03-30T15:24:15.354333+0000 mon.a (mon.0) 3359 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-128", "mode": "writeback"}]': finished 2024-03-30T15:24:16.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:16 smithi072 bash[28946]: cluster 2024-03-30T15:24:15.362261+0000 mon.a (mon.0) 3360 : cluster 0 osdmap e661: 8 total, 8 up, 8 in 2024-03-30T15:24:16.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:16 smithi172 bash[23680]: cluster 2024-03-30T15:24:15.352069+0000 mon.a (mon.0) 3358 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:24:16.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:16 smithi172 bash[23680]: audit 2024-03-30T15:24:15.354333+0000 mon.a (mon.0) 3359 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-128", "mode": "writeback"}]': finished 2024-03-30T15:24:16.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:16 smithi172 bash[23680]: cluster 2024-03-30T15:24:15.362261+0000 mon.a (mon.0) 3360 : cluster 0 osdmap e661: 8 total, 8 up, 8 in 2024-03-30T15:24:17.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:17 smithi072 bash[21573]: cluster 2024-03-30T15:24:16.284871+0000 mgr.y (mgr.14526) 641 : cluster 0 pgmap v1064: 204 pgs: 204 active+clean; 582 KiB data, 679 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 1 op/s 2024-03-30T15:24:17.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:17 smithi072 bash[21573]: cluster 2024-03-30T15:24:17.310125+0000 mon.a (mon.0) 3361 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:24:17.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:17 smithi072 bash[28946]: cluster 2024-03-30T15:24:16.284871+0000 mgr.y (mgr.14526) 641 : cluster 0 pgmap v1064: 204 pgs: 204 active+clean; 582 KiB data, 679 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 1 op/s 2024-03-30T15:24:17.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:17 smithi072 bash[28946]: cluster 2024-03-30T15:24:17.310125+0000 mon.a (mon.0) 3361 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:24:17.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:17 smithi172 bash[23680]: cluster 2024-03-30T15:24:16.284871+0000 mgr.y (mgr.14526) 641 : cluster 0 pgmap v1064: 204 pgs: 204 active+clean; 582 KiB data, 679 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 1 op/s 2024-03-30T15:24:17.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:17 smithi172 bash[23680]: cluster 2024-03-30T15:24:17.310125+0000 mon.a (mon.0) 3361 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:24:19.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:19 smithi072 bash[21573]: cluster 2024-03-30T15:24:18.285642+0000 mgr.y (mgr.14526) 642 : cluster 0 pgmap v1065: 204 pgs: 204 active+clean; 582 KiB data, 679 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 344 B/s wr, 1 op/s 2024-03-30T15:24:19.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:19 smithi072 bash[28946]: cluster 2024-03-30T15:24:18.285642+0000 mgr.y (mgr.14526) 642 : cluster 0 pgmap v1065: 204 pgs: 204 active+clean; 582 KiB data, 679 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 344 B/s wr, 1 op/s 2024-03-30T15:24:19.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:19 smithi172 bash[23680]: cluster 2024-03-30T15:24:18.285642+0000 mgr.y (mgr.14526) 642 : cluster 0 pgmap v1065: 204 pgs: 204 active+clean; 582 KiB data, 679 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 344 B/s wr, 1 op/s 2024-03-30T15:24:21.386 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:24:21 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:24:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:24:21.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:21 smithi072 bash[21573]: cluster 2024-03-30T15:24:20.286466+0000 mgr.y (mgr.14526) 643 : cluster 0 pgmap v1066: 204 pgs: 204 active+clean; 582 KiB data, 679 MiB used, 715 GiB / 715 GiB avail; 885 B/s rd, 295 B/s wr, 1 op/s 2024-03-30T15:24:21.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:21 smithi072 bash[21573]: audit 2024-03-30T15:24:20.522483+0000 mon.a (mon.0) 3362 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:24:21.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:21 smithi072 bash[28946]: cluster 2024-03-30T15:24:20.286466+0000 mgr.y (mgr.14526) 643 : cluster 0 pgmap v1066: 204 pgs: 204 active+clean; 582 KiB data, 679 MiB used, 715 GiB / 715 GiB avail; 885 B/s rd, 295 B/s wr, 1 op/s 2024-03-30T15:24:21.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:21 smithi072 bash[28946]: audit 2024-03-30T15:24:20.522483+0000 mon.a (mon.0) 3362 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:24:21.717 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:24:21 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:24:21.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:21 smithi172 bash[23680]: cluster 2024-03-30T15:24:20.286466+0000 mgr.y (mgr.14526) 643 : cluster 0 pgmap v1066: 204 pgs: 204 active+clean; 582 KiB data, 679 MiB used, 715 GiB / 715 GiB avail; 885 B/s rd, 295 B/s wr, 1 op/s 2024-03-30T15:24:21.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:21 smithi172 bash[23680]: audit 2024-03-30T15:24:20.522483+0000 mon.a (mon.0) 3362 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:24:22.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:22 smithi072 bash[21573]: audit 2024-03-30T15:24:21.400961+0000 mon.a (mon.0) 3363 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:24:22.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:22 smithi072 bash[21573]: cluster 2024-03-30T15:24:21.410433+0000 mon.a (mon.0) 3364 : cluster 0 osdmap e662: 8 total, 8 up, 8 in 2024-03-30T15:24:22.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:22 smithi072 bash[21573]: audit 2024-03-30T15:24:21.411171+0000 mon.a (mon.0) 3365 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-128"}]: dispatch 2024-03-30T15:24:22.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:22 smithi072 bash[21573]: audit 2024-03-30T15:24:21.623453+0000 mgr.y (mgr.14526) 644 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:24:22.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:22 smithi072 bash[21573]: audit 2024-03-30T15:24:22.213628+0000 mon.a (mon.0) 3366 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:24:22.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:22 smithi072 bash[21573]: audit 2024-03-30T15:24:22.216374+0000 mon.c (mon.2) 515 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:24:22.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:22 smithi072 bash[28946]: audit 2024-03-30T15:24:21.400961+0000 mon.a (mon.0) 3363 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:24:22.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:22 smithi072 bash[28946]: cluster 2024-03-30T15:24:21.410433+0000 mon.a (mon.0) 3364 : cluster 0 osdmap e662: 8 total, 8 up, 8 in 2024-03-30T15:24:22.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:22 smithi072 bash[28946]: audit 2024-03-30T15:24:21.411171+0000 mon.a (mon.0) 3365 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-128"}]: dispatch 2024-03-30T15:24:22.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:22 smithi072 bash[28946]: audit 2024-03-30T15:24:21.623453+0000 mgr.y (mgr.14526) 644 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:24:22.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:22 smithi072 bash[28946]: audit 2024-03-30T15:24:22.213628+0000 mon.a (mon.0) 3366 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:24:22.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:22 smithi072 bash[28946]: audit 2024-03-30T15:24:22.216374+0000 mon.c (mon.2) 515 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:24:22.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:22 smithi172 bash[23680]: audit 2024-03-30T15:24:21.400961+0000 mon.a (mon.0) 3363 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:24:22.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:22 smithi172 bash[23680]: cluster 2024-03-30T15:24:21.410433+0000 mon.a (mon.0) 3364 : cluster 0 osdmap e662: 8 total, 8 up, 8 in 2024-03-30T15:24:22.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:22 smithi172 bash[23680]: audit 2024-03-30T15:24:21.411171+0000 mon.a (mon.0) 3365 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-128"}]: dispatch 2024-03-30T15:24:22.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:22 smithi172 bash[23680]: audit 2024-03-30T15:24:21.623453+0000 mgr.y (mgr.14526) 644 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:24:22.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:22 smithi172 bash[23680]: audit 2024-03-30T15:24:22.213628+0000 mon.a (mon.0) 3366 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:24:22.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:22 smithi172 bash[23680]: audit 2024-03-30T15:24:22.216374+0000 mon.c (mon.2) 515 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:24:23.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:23 smithi072 bash[21573]: cluster 2024-03-30T15:24:22.287273+0000 mgr.y (mgr.14526) 645 : cluster 0 pgmap v1068: 204 pgs: 204 active+clean; 582 KiB data, 679 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 258 B/s wr, 1 op/s 2024-03-30T15:24:23.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:23 smithi072 bash[21573]: cluster 2024-03-30T15:24:22.401360+0000 mon.a (mon.0) 3367 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:24:23.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:23 smithi072 bash[21573]: audit 2024-03-30T15:24:22.405566+0000 mon.a (mon.0) 3368 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-128"}]': finished 2024-03-30T15:24:23.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:23 smithi072 bash[21573]: cluster 2024-03-30T15:24:22.414953+0000 mon.a (mon.0) 3369 : cluster 0 osdmap e663: 8 total, 8 up, 8 in 2024-03-30T15:24:23.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:23 smithi072 bash[28946]: cluster 2024-03-30T15:24:22.287273+0000 mgr.y (mgr.14526) 645 : cluster 0 pgmap v1068: 204 pgs: 204 active+clean; 582 KiB data, 679 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 258 B/s wr, 1 op/s 2024-03-30T15:24:23.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:23 smithi072 bash[28946]: cluster 2024-03-30T15:24:22.401360+0000 mon.a (mon.0) 3367 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:24:23.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:23 smithi072 bash[28946]: audit 2024-03-30T15:24:22.405566+0000 mon.a (mon.0) 3368 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-128"}]': finished 2024-03-30T15:24:23.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:23 smithi072 bash[28946]: cluster 2024-03-30T15:24:22.414953+0000 mon.a (mon.0) 3369 : cluster 0 osdmap e663: 8 total, 8 up, 8 in 2024-03-30T15:24:23.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:23 smithi172 bash[23680]: cluster 2024-03-30T15:24:22.287273+0000 mgr.y (mgr.14526) 645 : cluster 0 pgmap v1068: 204 pgs: 204 active+clean; 582 KiB data, 679 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 258 B/s wr, 1 op/s 2024-03-30T15:24:23.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:23 smithi172 bash[23680]: cluster 2024-03-30T15:24:22.401360+0000 mon.a (mon.0) 3367 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:24:23.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:23 smithi172 bash[23680]: audit 2024-03-30T15:24:22.405566+0000 mon.a (mon.0) 3368 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-128"}]': finished 2024-03-30T15:24:23.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:23 smithi172 bash[23680]: cluster 2024-03-30T15:24:22.414953+0000 mon.a (mon.0) 3369 : cluster 0 osdmap e663: 8 total, 8 up, 8 in 2024-03-30T15:24:24.717 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:24 smithi172 bash[23680]: cluster 2024-03-30T15:24:23.436621+0000 mon.a (mon.0) 3370 : cluster 0 osdmap e664: 8 total, 8 up, 8 in 2024-03-30T15:24:24.918 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:24 smithi072 bash[28946]: cluster 2024-03-30T15:24:23.436621+0000 mon.a (mon.0) 3370 : cluster 0 osdmap e664: 8 total, 8 up, 8 in 2024-03-30T15:24:24.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:24 smithi072 bash[21573]: cluster 2024-03-30T15:24:23.436621+0000 mon.a (mon.0) 3370 : cluster 0 osdmap e664: 8 total, 8 up, 8 in 2024-03-30T15:24:25.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:25 smithi072 bash[21573]: cluster 2024-03-30T15:24:24.288032+0000 mgr.y (mgr.14526) 646 : cluster 0 pgmap v1071: 172 pgs: 172 active+clean; 582 KiB data, 679 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-03-30T15:24:25.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:25 smithi072 bash[21573]: cluster 2024-03-30T15:24:24.450239+0000 mon.a (mon.0) 3371 : cluster 0 osdmap e665: 8 total, 8 up, 8 in 2024-03-30T15:24:25.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:25 smithi072 bash[21573]: audit 2024-03-30T15:24:24.455808+0000 mon.a (mon.0) 3372 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:24:25.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:25 smithi072 bash[21573]: audit 2024-03-30T15:24:24.527863+0000 mon.c (mon.2) 516 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:24:25.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:25 smithi072 bash[21573]: audit 2024-03-30T15:24:25.215263+0000 mon.c (mon.2) 517 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:24:25.923 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:25 smithi072 bash[21573]: audit 2024-03-30T15:24:25.217023+0000 mon.c (mon.2) 518 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:24:25.923 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:25 smithi072 bash[21573]: audit 2024-03-30T15:24:25.224383+0000 mon.a (mon.0) 3373 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:24:25.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:25 smithi072 bash[28946]: cluster 2024-03-30T15:24:24.288032+0000 mgr.y (mgr.14526) 646 : cluster 0 pgmap v1071: 172 pgs: 172 active+clean; 582 KiB data, 679 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-03-30T15:24:25.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:25 smithi072 bash[28946]: cluster 2024-03-30T15:24:24.450239+0000 mon.a (mon.0) 3371 : cluster 0 osdmap e665: 8 total, 8 up, 8 in 2024-03-30T15:24:25.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:25 smithi072 bash[28946]: audit 2024-03-30T15:24:24.455808+0000 mon.a (mon.0) 3372 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:24:25.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:25 smithi072 bash[28946]: audit 2024-03-30T15:24:24.527863+0000 mon.c (mon.2) 516 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:24:25.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:25 smithi072 bash[28946]: audit 2024-03-30T15:24:25.215263+0000 mon.c (mon.2) 517 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:24:25.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:25 smithi072 bash[28946]: audit 2024-03-30T15:24:25.217023+0000 mon.c (mon.2) 518 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:24:25.923 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:25 smithi072 bash[28946]: audit 2024-03-30T15:24:25.224383+0000 mon.a (mon.0) 3373 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:24:25.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:25 smithi172 bash[23680]: cluster 2024-03-30T15:24:24.288032+0000 mgr.y (mgr.14526) 646 : cluster 0 pgmap v1071: 172 pgs: 172 active+clean; 582 KiB data, 679 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-03-30T15:24:25.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:25 smithi172 bash[23680]: cluster 2024-03-30T15:24:24.450239+0000 mon.a (mon.0) 3371 : cluster 0 osdmap e665: 8 total, 8 up, 8 in 2024-03-30T15:24:25.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:25 smithi172 bash[23680]: audit 2024-03-30T15:24:24.455808+0000 mon.a (mon.0) 3372 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:24:25.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:25 smithi172 bash[23680]: audit 2024-03-30T15:24:24.527863+0000 mon.c (mon.2) 516 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:24:25.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:25 smithi172 bash[23680]: audit 2024-03-30T15:24:25.215263+0000 mon.c (mon.2) 517 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:24:25.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:25 smithi172 bash[23680]: audit 2024-03-30T15:24:25.217023+0000 mon.c (mon.2) 518 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:24:25.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:25 smithi172 bash[23680]: audit 2024-03-30T15:24:25.224383+0000 mon.a (mon.0) 3373 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:24:26.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:26 smithi072 bash[21573]: audit 2024-03-30T15:24:25.444799+0000 mon.a (mon.0) 3374 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-130","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:24:26.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:26 smithi072 bash[21573]: cluster 2024-03-30T15:24:25.453666+0000 mon.a (mon.0) 3375 : cluster 0 osdmap e666: 8 total, 8 up, 8 in 2024-03-30T15:24:26.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:26 smithi072 bash[21573]: audit 2024-03-30T15:24:25.460085+0000 mon.a (mon.0) 3376 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-130", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:24:26.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:26 smithi072 bash[21573]: audit 2024-03-30T15:24:26.447585+0000 mon.a (mon.0) 3377 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-130", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:24:26.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:26 smithi072 bash[21573]: cluster 2024-03-30T15:24:26.460484+0000 mon.a (mon.0) 3378 : cluster 0 osdmap e667: 8 total, 8 up, 8 in 2024-03-30T15:24:26.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:26 smithi072 bash[21573]: audit 2024-03-30T15:24:26.462720+0000 mon.a (mon.0) 3379 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-130"}]: dispatch 2024-03-30T15:24:26.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:26 smithi072 bash[28946]: audit 2024-03-30T15:24:25.444799+0000 mon.a (mon.0) 3374 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-130","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:24:26.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:26 smithi072 bash[28946]: cluster 2024-03-30T15:24:25.453666+0000 mon.a (mon.0) 3375 : cluster 0 osdmap e666: 8 total, 8 up, 8 in 2024-03-30T15:24:26.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:26 smithi072 bash[28946]: audit 2024-03-30T15:24:25.460085+0000 mon.a (mon.0) 3376 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-130", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:24:26.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:26 smithi072 bash[28946]: audit 2024-03-30T15:24:26.447585+0000 mon.a (mon.0) 3377 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-130", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:24:26.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:26 smithi072 bash[28946]: cluster 2024-03-30T15:24:26.460484+0000 mon.a (mon.0) 3378 : cluster 0 osdmap e667: 8 total, 8 up, 8 in 2024-03-30T15:24:26.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:26 smithi072 bash[28946]: audit 2024-03-30T15:24:26.462720+0000 mon.a (mon.0) 3379 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-130"}]: dispatch 2024-03-30T15:24:26.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:26 smithi172 bash[23680]: audit 2024-03-30T15:24:25.444799+0000 mon.a (mon.0) 3374 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-130","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:24:26.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:26 smithi172 bash[23680]: cluster 2024-03-30T15:24:25.453666+0000 mon.a (mon.0) 3375 : cluster 0 osdmap e666: 8 total, 8 up, 8 in 2024-03-30T15:24:26.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:26 smithi172 bash[23680]: audit 2024-03-30T15:24:25.460085+0000 mon.a (mon.0) 3376 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-130", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:24:26.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:26 smithi172 bash[23680]: audit 2024-03-30T15:24:26.447585+0000 mon.a (mon.0) 3377 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-130", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:24:26.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:26 smithi172 bash[23680]: cluster 2024-03-30T15:24:26.460484+0000 mon.a (mon.0) 3378 : cluster 0 osdmap e667: 8 total, 8 up, 8 in 2024-03-30T15:24:26.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:26 smithi172 bash[23680]: audit 2024-03-30T15:24:26.462720+0000 mon.a (mon.0) 3379 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-130"}]: dispatch 2024-03-30T15:24:27.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:27 smithi072 bash[21573]: cluster 2024-03-30T15:24:26.290023+0000 mgr.y (mgr.14526) 647 : cluster 0 pgmap v1074: 204 pgs: 204 active+clean; 582 KiB data, 697 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T15:24:27.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:27 smithi072 bash[21573]: audit 2024-03-30T15:24:27.450251+0000 mon.a (mon.0) 3380 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-130"}]': finished 2024-03-30T15:24:27.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:27 smithi072 bash[21573]: cluster 2024-03-30T15:24:27.458953+0000 mon.a (mon.0) 3381 : cluster 0 osdmap e668: 8 total, 8 up, 8 in 2024-03-30T15:24:27.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:27 smithi072 bash[21573]: audit 2024-03-30T15:24:27.462668+0000 mon.a (mon.0) 3382 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-130", "mode": "writeback"}]: dispatch 2024-03-30T15:24:27.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:27 smithi072 bash[28946]: cluster 2024-03-30T15:24:26.290023+0000 mgr.y (mgr.14526) 647 : cluster 0 pgmap v1074: 204 pgs: 204 active+clean; 582 KiB data, 697 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T15:24:27.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:27 smithi072 bash[28946]: audit 2024-03-30T15:24:27.450251+0000 mon.a (mon.0) 3380 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-130"}]': finished 2024-03-30T15:24:27.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:27 smithi072 bash[28946]: cluster 2024-03-30T15:24:27.458953+0000 mon.a (mon.0) 3381 : cluster 0 osdmap e668: 8 total, 8 up, 8 in 2024-03-30T15:24:27.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:27 smithi072 bash[28946]: audit 2024-03-30T15:24:27.462668+0000 mon.a (mon.0) 3382 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-130", "mode": "writeback"}]: dispatch 2024-03-30T15:24:27.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:27 smithi172 bash[23680]: cluster 2024-03-30T15:24:26.290023+0000 mgr.y (mgr.14526) 647 : cluster 0 pgmap v1074: 204 pgs: 204 active+clean; 582 KiB data, 697 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T15:24:27.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:27 smithi172 bash[23680]: audit 2024-03-30T15:24:27.450251+0000 mon.a (mon.0) 3380 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-130"}]': finished 2024-03-30T15:24:27.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:27 smithi172 bash[23680]: cluster 2024-03-30T15:24:27.458953+0000 mon.a (mon.0) 3381 : cluster 0 osdmap e668: 8 total, 8 up, 8 in 2024-03-30T15:24:27.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:27 smithi172 bash[23680]: audit 2024-03-30T15:24:27.462668+0000 mon.a (mon.0) 3382 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-130", "mode": "writeback"}]: dispatch 2024-03-30T15:24:28.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:28 smithi072 bash[21573]: cluster 2024-03-30T15:24:28.450649+0000 mon.a (mon.0) 3383 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:24:28.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:28 smithi072 bash[21573]: audit 2024-03-30T15:24:28.453157+0000 mon.a (mon.0) 3384 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-130", "mode": "writeback"}]': finished 2024-03-30T15:24:28.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:28 smithi072 bash[21573]: cluster 2024-03-30T15:24:28.460355+0000 mon.a (mon.0) 3385 : cluster 0 osdmap e669: 8 total, 8 up, 8 in 2024-03-30T15:24:28.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:28 smithi072 bash[28946]: cluster 2024-03-30T15:24:28.450649+0000 mon.a (mon.0) 3383 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:24:28.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:28 smithi072 bash[28946]: audit 2024-03-30T15:24:28.453157+0000 mon.a (mon.0) 3384 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-130", "mode": "writeback"}]': finished 2024-03-30T15:24:28.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:28 smithi072 bash[28946]: cluster 2024-03-30T15:24:28.460355+0000 mon.a (mon.0) 3385 : cluster 0 osdmap e669: 8 total, 8 up, 8 in 2024-03-30T15:24:28.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:28 smithi172 bash[23680]: cluster 2024-03-30T15:24:28.450649+0000 mon.a (mon.0) 3383 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:24:28.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:28 smithi172 bash[23680]: audit 2024-03-30T15:24:28.453157+0000 mon.a (mon.0) 3384 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-130", "mode": "writeback"}]': finished 2024-03-30T15:24:28.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:28 smithi172 bash[23680]: cluster 2024-03-30T15:24:28.460355+0000 mon.a (mon.0) 3385 : cluster 0 osdmap e669: 8 total, 8 up, 8 in 2024-03-30T15:24:29.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:29 smithi072 bash[28946]: cluster 2024-03-30T15:24:28.290855+0000 mgr.y (mgr.14526) 648 : cluster 0 pgmap v1077: 204 pgs: 204 active+clean; 582 KiB data, 697 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:24:29.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:29 smithi072 bash[28946]: audit 2024-03-30T15:24:28.680261+0000 mon.a (mon.0) 3386 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:24:29.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:29 smithi072 bash[21573]: cluster 2024-03-30T15:24:28.290855+0000 mgr.y (mgr.14526) 648 : cluster 0 pgmap v1077: 204 pgs: 204 active+clean; 582 KiB data, 697 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:24:29.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:29 smithi072 bash[21573]: audit 2024-03-30T15:24:28.680261+0000 mon.a (mon.0) 3386 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:24:29.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:29 smithi172 bash[23680]: cluster 2024-03-30T15:24:28.290855+0000 mgr.y (mgr.14526) 648 : cluster 0 pgmap v1077: 204 pgs: 204 active+clean; 582 KiB data, 697 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:24:29.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:29 smithi172 bash[23680]: audit 2024-03-30T15:24:28.680261+0000 mon.a (mon.0) 3386 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:24:30.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:30 smithi072 bash[21573]: audit 2024-03-30T15:24:29.515098+0000 mon.a (mon.0) 3387 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:24:30.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:30 smithi072 bash[21573]: cluster 2024-03-30T15:24:29.524423+0000 mon.a (mon.0) 3388 : cluster 0 osdmap e670: 8 total, 8 up, 8 in 2024-03-30T15:24:30.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:30 smithi072 bash[21573]: audit 2024-03-30T15:24:29.525954+0000 mon.a (mon.0) 3389 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-130"}]: dispatch 2024-03-30T15:24:30.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:30 smithi072 bash[28946]: audit 2024-03-30T15:24:29.515098+0000 mon.a (mon.0) 3387 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:24:30.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:30 smithi072 bash[28946]: cluster 2024-03-30T15:24:29.524423+0000 mon.a (mon.0) 3388 : cluster 0 osdmap e670: 8 total, 8 up, 8 in 2024-03-30T15:24:30.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:30 smithi072 bash[28946]: audit 2024-03-30T15:24:29.525954+0000 mon.a (mon.0) 3389 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-130"}]: dispatch 2024-03-30T15:24:30.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:30 smithi172 bash[23680]: audit 2024-03-30T15:24:29.515098+0000 mon.a (mon.0) 3387 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:24:30.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:30 smithi172 bash[23680]: cluster 2024-03-30T15:24:29.524423+0000 mon.a (mon.0) 3388 : cluster 0 osdmap e670: 8 total, 8 up, 8 in 2024-03-30T15:24:30.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:30 smithi172 bash[23680]: audit 2024-03-30T15:24:29.525954+0000 mon.a (mon.0) 3389 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-130"}]: dispatch 2024-03-30T15:24:31.418 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:24:31 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:24:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:24:31.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:31 smithi072 bash[28946]: cluster 2024-03-30T15:24:30.291651+0000 mgr.y (mgr.14526) 649 : cluster 0 pgmap v1080: 204 pgs: 204 active+clean; 582 KiB data, 697 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:24:31.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:31 smithi072 bash[28946]: cluster 2024-03-30T15:24:30.516074+0000 mon.a (mon.0) 3390 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:24:31.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:31 smithi072 bash[28946]: audit 2024-03-30T15:24:30.524387+0000 mon.a (mon.0) 3391 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-130"}]': finished 2024-03-30T15:24:31.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:31 smithi072 bash[28946]: cluster 2024-03-30T15:24:30.532625+0000 mon.a (mon.0) 3392 : cluster 0 osdmap e671: 8 total, 8 up, 8 in 2024-03-30T15:24:31.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:31 smithi072 bash[21573]: cluster 2024-03-30T15:24:30.291651+0000 mgr.y (mgr.14526) 649 : cluster 0 pgmap v1080: 204 pgs: 204 active+clean; 582 KiB data, 697 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:24:31.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:31 smithi072 bash[21573]: cluster 2024-03-30T15:24:30.516074+0000 mon.a (mon.0) 3390 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:24:31.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:31 smithi072 bash[21573]: audit 2024-03-30T15:24:30.524387+0000 mon.a (mon.0) 3391 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-130"}]': finished 2024-03-30T15:24:31.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:31 smithi072 bash[21573]: cluster 2024-03-30T15:24:30.532625+0000 mon.a (mon.0) 3392 : cluster 0 osdmap e671: 8 total, 8 up, 8 in 2024-03-30T15:24:31.968 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:24:31 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:24:31.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:31 smithi172 bash[23680]: cluster 2024-03-30T15:24:30.291651+0000 mgr.y (mgr.14526) 649 : cluster 0 pgmap v1080: 204 pgs: 204 active+clean; 582 KiB data, 697 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:24:31.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:31 smithi172 bash[23680]: cluster 2024-03-30T15:24:30.516074+0000 mon.a (mon.0) 3390 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:24:31.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:31 smithi172 bash[23680]: audit 2024-03-30T15:24:30.524387+0000 mon.a (mon.0) 3391 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-130"}]': finished 2024-03-30T15:24:31.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:31 smithi172 bash[23680]: cluster 2024-03-30T15:24:30.532625+0000 mon.a (mon.0) 3392 : cluster 0 osdmap e671: 8 total, 8 up, 8 in 2024-03-30T15:24:32.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:32 smithi072 bash[21573]: cluster 2024-03-30T15:24:31.544810+0000 mon.a (mon.0) 3393 : cluster 0 osdmap e672: 8 total, 8 up, 8 in 2024-03-30T15:24:32.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:32 smithi072 bash[21573]: audit 2024-03-30T15:24:31.633370+0000 mgr.y (mgr.14526) 650 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:24:32.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:32 smithi072 bash[28946]: cluster 2024-03-30T15:24:31.544810+0000 mon.a (mon.0) 3393 : cluster 0 osdmap e672: 8 total, 8 up, 8 in 2024-03-30T15:24:32.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:32 smithi072 bash[28946]: audit 2024-03-30T15:24:31.633370+0000 mgr.y (mgr.14526) 650 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:24:32.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:32 smithi172 bash[23680]: cluster 2024-03-30T15:24:31.544810+0000 mon.a (mon.0) 3393 : cluster 0 osdmap e672: 8 total, 8 up, 8 in 2024-03-30T15:24:32.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:32 smithi172 bash[23680]: audit 2024-03-30T15:24:31.633370+0000 mgr.y (mgr.14526) 650 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:24:33.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:33 smithi072 bash[21573]: cluster 2024-03-30T15:24:32.292677+0000 mgr.y (mgr.14526) 651 : cluster 0 pgmap v1083: 172 pgs: 172 active+clean; 582 KiB data, 698 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:24:33.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:33 smithi072 bash[21573]: cluster 2024-03-30T15:24:32.556470+0000 mon.a (mon.0) 3394 : cluster 0 osdmap e673: 8 total, 8 up, 8 in 2024-03-30T15:24:33.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:33 smithi072 bash[21573]: audit 2024-03-30T15:24:32.579786+0000 mon.a (mon.0) 3395 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:24:33.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:33 smithi072 bash[28946]: cluster 2024-03-30T15:24:32.292677+0000 mgr.y (mgr.14526) 651 : cluster 0 pgmap v1083: 172 pgs: 172 active+clean; 582 KiB data, 698 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:24:33.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:33 smithi072 bash[28946]: cluster 2024-03-30T15:24:32.556470+0000 mon.a (mon.0) 3394 : cluster 0 osdmap e673: 8 total, 8 up, 8 in 2024-03-30T15:24:33.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:33 smithi072 bash[28946]: audit 2024-03-30T15:24:32.579786+0000 mon.a (mon.0) 3395 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:24:33.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:33 smithi172 bash[23680]: cluster 2024-03-30T15:24:32.292677+0000 mgr.y (mgr.14526) 651 : cluster 0 pgmap v1083: 172 pgs: 172 active+clean; 582 KiB data, 698 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:24:33.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:33 smithi172 bash[23680]: cluster 2024-03-30T15:24:32.556470+0000 mon.a (mon.0) 3394 : cluster 0 osdmap e673: 8 total, 8 up, 8 in 2024-03-30T15:24:33.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:33 smithi172 bash[23680]: audit 2024-03-30T15:24:32.579786+0000 mon.a (mon.0) 3395 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:24:34.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:34 smithi072 bash[28946]: audit 2024-03-30T15:24:33.559633+0000 mon.a (mon.0) 3396 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-132","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:24:34.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:34 smithi072 bash[28946]: cluster 2024-03-30T15:24:33.567357+0000 mon.a (mon.0) 3397 : cluster 0 osdmap e674: 8 total, 8 up, 8 in 2024-03-30T15:24:34.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:34 smithi072 bash[28946]: audit 2024-03-30T15:24:33.571279+0000 mon.a (mon.0) 3398 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-132", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:24:34.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:34 smithi072 bash[21573]: audit 2024-03-30T15:24:33.559633+0000 mon.a (mon.0) 3396 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-132","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:24:34.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:34 smithi072 bash[21573]: cluster 2024-03-30T15:24:33.567357+0000 mon.a (mon.0) 3397 : cluster 0 osdmap e674: 8 total, 8 up, 8 in 2024-03-30T15:24:34.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:34 smithi072 bash[21573]: audit 2024-03-30T15:24:33.571279+0000 mon.a (mon.0) 3398 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-132", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:24:34.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:34 smithi172 bash[23680]: audit 2024-03-30T15:24:33.559633+0000 mon.a (mon.0) 3396 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-132","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:24:34.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:34 smithi172 bash[23680]: cluster 2024-03-30T15:24:33.567357+0000 mon.a (mon.0) 3397 : cluster 0 osdmap e674: 8 total, 8 up, 8 in 2024-03-30T15:24:34.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:34 smithi172 bash[23680]: audit 2024-03-30T15:24:33.571279+0000 mon.a (mon.0) 3398 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-132", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:24:35.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:35 smithi072 bash[21573]: cluster 2024-03-30T15:24:34.293534+0000 mgr.y (mgr.14526) 652 : cluster 0 pgmap v1086: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 698 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:24:35.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:35 smithi072 bash[21573]: audit 2024-03-30T15:24:34.568406+0000 mon.a (mon.0) 3399 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-132", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:24:35.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:35 smithi072 bash[21573]: cluster 2024-03-30T15:24:34.577065+0000 mon.a (mon.0) 3400 : cluster 0 osdmap e675: 8 total, 8 up, 8 in 2024-03-30T15:24:35.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:35 smithi072 bash[21573]: audit 2024-03-30T15:24:34.579114+0000 mon.a (mon.0) 3401 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-132"}]: dispatch 2024-03-30T15:24:35.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:35 smithi072 bash[28946]: cluster 2024-03-30T15:24:34.293534+0000 mgr.y (mgr.14526) 652 : cluster 0 pgmap v1086: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 698 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:24:35.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:35 smithi072 bash[28946]: audit 2024-03-30T15:24:34.568406+0000 mon.a (mon.0) 3399 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-132", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:24:35.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:35 smithi072 bash[28946]: cluster 2024-03-30T15:24:34.577065+0000 mon.a (mon.0) 3400 : cluster 0 osdmap e675: 8 total, 8 up, 8 in 2024-03-30T15:24:35.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:35 smithi072 bash[28946]: audit 2024-03-30T15:24:34.579114+0000 mon.a (mon.0) 3401 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-132"}]: dispatch 2024-03-30T15:24:35.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:35 smithi172 bash[23680]: cluster 2024-03-30T15:24:34.293534+0000 mgr.y (mgr.14526) 652 : cluster 0 pgmap v1086: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 698 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-03-30T15:24:35.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:35 smithi172 bash[23680]: audit 2024-03-30T15:24:34.568406+0000 mon.a (mon.0) 3399 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-132", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:24:35.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:35 smithi172 bash[23680]: cluster 2024-03-30T15:24:34.577065+0000 mon.a (mon.0) 3400 : cluster 0 osdmap e675: 8 total, 8 up, 8 in 2024-03-30T15:24:35.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:35 smithi172 bash[23680]: audit 2024-03-30T15:24:34.579114+0000 mon.a (mon.0) 3401 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-132"}]: dispatch 2024-03-30T15:24:36.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:36 smithi072 bash[21573]: audit 2024-03-30T15:24:35.571421+0000 mon.a (mon.0) 3402 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-132"}]': finished 2024-03-30T15:24:36.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:36 smithi072 bash[21573]: cluster 2024-03-30T15:24:35.578889+0000 mon.a (mon.0) 3403 : cluster 0 osdmap e676: 8 total, 8 up, 8 in 2024-03-30T15:24:36.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:36 smithi072 bash[21573]: audit 2024-03-30T15:24:35.580767+0000 mon.a (mon.0) 3404 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-132", "mode": "writeback"}]: dispatch 2024-03-30T15:24:36.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:36 smithi072 bash[21573]: cluster 2024-03-30T15:24:36.571747+0000 mon.a (mon.0) 3405 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:24:36.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:36 smithi072 bash[21573]: audit 2024-03-30T15:24:36.573951+0000 mon.a (mon.0) 3406 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-132", "mode": "writeback"}]': finished 2024-03-30T15:24:36.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:36 smithi072 bash[21573]: cluster 2024-03-30T15:24:36.580833+0000 mon.a (mon.0) 3407 : cluster 0 osdmap e677: 8 total, 8 up, 8 in 2024-03-30T15:24:36.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:36 smithi072 bash[28946]: audit 2024-03-30T15:24:35.571421+0000 mon.a (mon.0) 3402 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-132"}]': finished 2024-03-30T15:24:36.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:36 smithi072 bash[28946]: cluster 2024-03-30T15:24:35.578889+0000 mon.a (mon.0) 3403 : cluster 0 osdmap e676: 8 total, 8 up, 8 in 2024-03-30T15:24:36.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:36 smithi072 bash[28946]: audit 2024-03-30T15:24:35.580767+0000 mon.a (mon.0) 3404 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-132", "mode": "writeback"}]: dispatch 2024-03-30T15:24:36.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:36 smithi072 bash[28946]: cluster 2024-03-30T15:24:36.571747+0000 mon.a (mon.0) 3405 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:24:36.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:36 smithi072 bash[28946]: audit 2024-03-30T15:24:36.573951+0000 mon.a (mon.0) 3406 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-132", "mode": "writeback"}]': finished 2024-03-30T15:24:36.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:36 smithi072 bash[28946]: cluster 2024-03-30T15:24:36.580833+0000 mon.a (mon.0) 3407 : cluster 0 osdmap e677: 8 total, 8 up, 8 in 2024-03-30T15:24:36.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:36 smithi172 bash[23680]: audit 2024-03-30T15:24:35.571421+0000 mon.a (mon.0) 3402 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-132"}]': finished 2024-03-30T15:24:36.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:36 smithi172 bash[23680]: cluster 2024-03-30T15:24:35.578889+0000 mon.a (mon.0) 3403 : cluster 0 osdmap e676: 8 total, 8 up, 8 in 2024-03-30T15:24:36.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:36 smithi172 bash[23680]: audit 2024-03-30T15:24:35.580767+0000 mon.a (mon.0) 3404 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-132", "mode": "writeback"}]: dispatch 2024-03-30T15:24:36.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:36 smithi172 bash[23680]: cluster 2024-03-30T15:24:36.571747+0000 mon.a (mon.0) 3405 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:24:36.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:36 smithi172 bash[23680]: audit 2024-03-30T15:24:36.573951+0000 mon.a (mon.0) 3406 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-132", "mode": "writeback"}]': finished 2024-03-30T15:24:36.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:36 smithi172 bash[23680]: cluster 2024-03-30T15:24:36.580833+0000 mon.a (mon.0) 3407 : cluster 0 osdmap e677: 8 total, 8 up, 8 in 2024-03-30T15:24:37.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:37 smithi072 bash[21573]: cluster 2024-03-30T15:24:36.295502+0000 mgr.y (mgr.14526) 653 : cluster 0 pgmap v1089: 204 pgs: 204 active+clean; 582 KiB data, 700 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:24:37.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:37 smithi072 bash[21573]: audit 2024-03-30T15:24:37.249667+0000 mon.c (mon.2) 519 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:24:37.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:37 smithi072 bash[28946]: cluster 2024-03-30T15:24:36.295502+0000 mgr.y (mgr.14526) 653 : cluster 0 pgmap v1089: 204 pgs: 204 active+clean; 582 KiB data, 700 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:24:37.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:37 smithi072 bash[28946]: audit 2024-03-30T15:24:37.249667+0000 mon.c (mon.2) 519 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:24:37.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:37 smithi172 bash[23680]: cluster 2024-03-30T15:24:36.295502+0000 mgr.y (mgr.14526) 653 : cluster 0 pgmap v1089: 204 pgs: 204 active+clean; 582 KiB data, 700 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:24:37.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:37 smithi172 bash[23680]: audit 2024-03-30T15:24:37.249667+0000 mon.c (mon.2) 519 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:24:38.918 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:38 smithi072 bash[21573]: cluster 2024-03-30T15:24:37.612594+0000 mon.a (mon.0) 3408 : cluster 0 osdmap e678: 8 total, 8 up, 8 in 2024-03-30T15:24:38.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:38 smithi072 bash[28946]: cluster 2024-03-30T15:24:37.612594+0000 mon.a (mon.0) 3408 : cluster 0 osdmap e678: 8 total, 8 up, 8 in 2024-03-30T15:24:38.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:38 smithi172 bash[23680]: cluster 2024-03-30T15:24:37.612594+0000 mon.a (mon.0) 3408 : cluster 0 osdmap e678: 8 total, 8 up, 8 in 2024-03-30T15:24:39.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:39 smithi072 bash[21573]: cluster 2024-03-30T15:24:38.296300+0000 mgr.y (mgr.14526) 654 : cluster 0 pgmap v1092: 204 pgs: 204 active+clean; 582 KiB data, 700 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:24:39.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:39 smithi072 bash[21573]: cluster 2024-03-30T15:24:38.625312+0000 mon.a (mon.0) 3409 : cluster 0 osdmap e679: 8 total, 8 up, 8 in 2024-03-30T15:24:39.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:39 smithi072 bash[21573]: audit 2024-03-30T15:24:38.720176+0000 mon.a (mon.0) 3410 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:24:39.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:39 smithi072 bash[28946]: cluster 2024-03-30T15:24:38.296300+0000 mgr.y (mgr.14526) 654 : cluster 0 pgmap v1092: 204 pgs: 204 active+clean; 582 KiB data, 700 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:24:39.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:39 smithi072 bash[28946]: cluster 2024-03-30T15:24:38.625312+0000 mon.a (mon.0) 3409 : cluster 0 osdmap e679: 8 total, 8 up, 8 in 2024-03-30T15:24:39.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:39 smithi072 bash[28946]: audit 2024-03-30T15:24:38.720176+0000 mon.a (mon.0) 3410 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:24:39.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:39 smithi172 bash[23680]: cluster 2024-03-30T15:24:38.296300+0000 mgr.y (mgr.14526) 654 : cluster 0 pgmap v1092: 204 pgs: 204 active+clean; 582 KiB data, 700 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:24:39.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:39 smithi172 bash[23680]: cluster 2024-03-30T15:24:38.625312+0000 mon.a (mon.0) 3409 : cluster 0 osdmap e679: 8 total, 8 up, 8 in 2024-03-30T15:24:39.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:39 smithi172 bash[23680]: audit 2024-03-30T15:24:38.720176+0000 mon.a (mon.0) 3410 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:24:40.468 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:24:40 smithi172 bash[50795]: logger=sqlstore.transactions t=2024-03-30T15:24:40.029365646Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-03-30T15:24:40.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:40 smithi072 bash[21573]: audit 2024-03-30T15:24:39.617799+0000 mon.a (mon.0) 3411 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:24:40.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:40 smithi072 bash[21573]: cluster 2024-03-30T15:24:39.626329+0000 mon.a (mon.0) 3412 : cluster 0 osdmap e680: 8 total, 8 up, 8 in 2024-03-30T15:24:40.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:40 smithi072 bash[21573]: audit 2024-03-30T15:24:39.647583+0000 mon.a (mon.0) 3413 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-132"}]: dispatch 2024-03-30T15:24:40.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:40 smithi072 bash[28946]: audit 2024-03-30T15:24:39.617799+0000 mon.a (mon.0) 3411 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:24:40.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:40 smithi072 bash[28946]: cluster 2024-03-30T15:24:39.626329+0000 mon.a (mon.0) 3412 : cluster 0 osdmap e680: 8 total, 8 up, 8 in 2024-03-30T15:24:40.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:40 smithi072 bash[28946]: audit 2024-03-30T15:24:39.647583+0000 mon.a (mon.0) 3413 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-132"}]: dispatch 2024-03-30T15:24:40.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:40 smithi172 bash[23680]: audit 2024-03-30T15:24:39.617799+0000 mon.a (mon.0) 3411 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:24:40.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:40 smithi172 bash[23680]: cluster 2024-03-30T15:24:39.626329+0000 mon.a (mon.0) 3412 : cluster 0 osdmap e680: 8 total, 8 up, 8 in 2024-03-30T15:24:40.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:40 smithi172 bash[23680]: audit 2024-03-30T15:24:39.647583+0000 mon.a (mon.0) 3413 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-132"}]: dispatch 2024-03-30T15:24:41.418 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:24:41 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:24:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:24:41.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:41 smithi072 bash[21573]: cluster 2024-03-30T15:24:40.297089+0000 mgr.y (mgr.14526) 655 : cluster 0 pgmap v1095: 204 pgs: 204 active+clean; 582 KiB data, 700 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:24:41.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:41 smithi072 bash[21573]: audit 2024-03-30T15:24:40.643990+0000 mon.a (mon.0) 3414 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-132"}]': finished 2024-03-30T15:24:41.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:41 smithi072 bash[21573]: cluster 2024-03-30T15:24:40.657408+0000 mon.a (mon.0) 3415 : cluster 0 osdmap e681: 8 total, 8 up, 8 in 2024-03-30T15:24:41.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:41 smithi072 bash[28946]: cluster 2024-03-30T15:24:40.297089+0000 mgr.y (mgr.14526) 655 : cluster 0 pgmap v1095: 204 pgs: 204 active+clean; 582 KiB data, 700 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:24:41.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:41 smithi072 bash[28946]: audit 2024-03-30T15:24:40.643990+0000 mon.a (mon.0) 3414 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-132"}]': finished 2024-03-30T15:24:41.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:41 smithi072 bash[28946]: cluster 2024-03-30T15:24:40.657408+0000 mon.a (mon.0) 3415 : cluster 0 osdmap e681: 8 total, 8 up, 8 in 2024-03-30T15:24:41.968 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:24:41 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:24:41.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:41 smithi172 bash[23680]: cluster 2024-03-30T15:24:40.297089+0000 mgr.y (mgr.14526) 655 : cluster 0 pgmap v1095: 204 pgs: 204 active+clean; 582 KiB data, 700 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:24:41.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:41 smithi172 bash[23680]: audit 2024-03-30T15:24:40.643990+0000 mon.a (mon.0) 3414 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-132"}]': finished 2024-03-30T15:24:41.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:41 smithi172 bash[23680]: cluster 2024-03-30T15:24:40.657408+0000 mon.a (mon.0) 3415 : cluster 0 osdmap e681: 8 total, 8 up, 8 in 2024-03-30T15:24:42.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:42 smithi172 bash[23680]: audit 2024-03-30T15:24:41.641326+0000 mgr.y (mgr.14526) 656 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:24:42.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:42 smithi172 bash[23680]: cluster 2024-03-30T15:24:41.654107+0000 mon.a (mon.0) 3416 : cluster 0 osdmap e682: 8 total, 8 up, 8 in 2024-03-30T15:24:42.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:42 smithi172 bash[23680]: audit 2024-03-30T15:24:41.730709+0000 mon.a (mon.0) 3417 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:24:43.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:42 smithi072 bash[21573]: audit 2024-03-30T15:24:41.641326+0000 mgr.y (mgr.14526) 656 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:24:43.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:42 smithi072 bash[21573]: cluster 2024-03-30T15:24:41.654107+0000 mon.a (mon.0) 3416 : cluster 0 osdmap e682: 8 total, 8 up, 8 in 2024-03-30T15:24:43.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:42 smithi072 bash[21573]: audit 2024-03-30T15:24:41.730709+0000 mon.a (mon.0) 3417 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:24:43.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:42 smithi072 bash[28946]: audit 2024-03-30T15:24:41.641326+0000 mgr.y (mgr.14526) 656 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:24:43.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:42 smithi072 bash[28946]: cluster 2024-03-30T15:24:41.654107+0000 mon.a (mon.0) 3416 : cluster 0 osdmap e682: 8 total, 8 up, 8 in 2024-03-30T15:24:43.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:42 smithi072 bash[28946]: audit 2024-03-30T15:24:41.730709+0000 mon.a (mon.0) 3417 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:24:43.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:43 smithi172 bash[23680]: cluster 2024-03-30T15:24:42.297910+0000 mgr.y (mgr.14526) 657 : cluster 0 pgmap v1098: 204 pgs: 204 active+clean; 582 KiB data, 700 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-03-30T15:24:43.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:43 smithi172 bash[23680]: audit 2024-03-30T15:24:42.670733+0000 mon.a (mon.0) 3418 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:24:43.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:43 smithi172 bash[23680]: cluster 2024-03-30T15:24:42.679764+0000 mon.a (mon.0) 3419 : cluster 0 osdmap e683: 8 total, 8 up, 8 in 2024-03-30T15:24:43.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:43 smithi172 bash[23680]: audit 2024-03-30T15:24:42.681952+0000 mon.a (mon.0) 3420 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-132"}]: dispatch 2024-03-30T15:24:44.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:43 smithi072 bash[28946]: cluster 2024-03-30T15:24:42.297910+0000 mgr.y (mgr.14526) 657 : cluster 0 pgmap v1098: 204 pgs: 204 active+clean; 582 KiB data, 700 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-03-30T15:24:44.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:43 smithi072 bash[28946]: audit 2024-03-30T15:24:42.670733+0000 mon.a (mon.0) 3418 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:24:44.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:43 smithi072 bash[28946]: cluster 2024-03-30T15:24:42.679764+0000 mon.a (mon.0) 3419 : cluster 0 osdmap e683: 8 total, 8 up, 8 in 2024-03-30T15:24:44.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:43 smithi072 bash[28946]: audit 2024-03-30T15:24:42.681952+0000 mon.a (mon.0) 3420 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-132"}]: dispatch 2024-03-30T15:24:44.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:43 smithi072 bash[21573]: cluster 2024-03-30T15:24:42.297910+0000 mgr.y (mgr.14526) 657 : cluster 0 pgmap v1098: 204 pgs: 204 active+clean; 582 KiB data, 700 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-03-30T15:24:44.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:43 smithi072 bash[21573]: audit 2024-03-30T15:24:42.670733+0000 mon.a (mon.0) 3418 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:24:44.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:43 smithi072 bash[21573]: cluster 2024-03-30T15:24:42.679764+0000 mon.a (mon.0) 3419 : cluster 0 osdmap e683: 8 total, 8 up, 8 in 2024-03-30T15:24:44.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:43 smithi072 bash[21573]: audit 2024-03-30T15:24:42.681952+0000 mon.a (mon.0) 3420 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-132"}]: dispatch 2024-03-30T15:24:44.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:44 smithi172 bash[23680]: cluster 2024-03-30T15:24:43.671174+0000 mon.a (mon.0) 3421 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:24:44.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:44 smithi172 bash[23680]: audit 2024-03-30T15:24:43.673745+0000 mon.a (mon.0) 3422 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-132"}]': finished 2024-03-30T15:24:44.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:44 smithi172 bash[23680]: cluster 2024-03-30T15:24:43.681716+0000 mon.a (mon.0) 3423 : cluster 0 osdmap e684: 8 total, 8 up, 8 in 2024-03-30T15:24:45.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:44 smithi072 bash[28946]: cluster 2024-03-30T15:24:43.671174+0000 mon.a (mon.0) 3421 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:24:45.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:44 smithi072 bash[28946]: audit 2024-03-30T15:24:43.673745+0000 mon.a (mon.0) 3422 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-132"}]': finished 2024-03-30T15:24:45.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:44 smithi072 bash[28946]: cluster 2024-03-30T15:24:43.681716+0000 mon.a (mon.0) 3423 : cluster 0 osdmap e684: 8 total, 8 up, 8 in 2024-03-30T15:24:45.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:44 smithi072 bash[21573]: cluster 2024-03-30T15:24:43.671174+0000 mon.a (mon.0) 3421 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:24:45.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:44 smithi072 bash[21573]: audit 2024-03-30T15:24:43.673745+0000 mon.a (mon.0) 3422 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-132"}]': finished 2024-03-30T15:24:45.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:44 smithi072 bash[21573]: cluster 2024-03-30T15:24:43.681716+0000 mon.a (mon.0) 3423 : cluster 0 osdmap e684: 8 total, 8 up, 8 in 2024-03-30T15:24:45.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:45 smithi172 bash[23680]: cluster 2024-03-30T15:24:44.298742+0000 mgr.y (mgr.14526) 658 : cluster 0 pgmap v1101: 204 pgs: 204 active+clean; 582 KiB data, 700 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-03-30T15:24:45.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:45 smithi172 bash[23680]: cluster 2024-03-30T15:24:44.684303+0000 mon.a (mon.0) 3424 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:24:45.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:45 smithi172 bash[23680]: cluster 2024-03-30T15:24:44.706250+0000 mon.a (mon.0) 3425 : cluster 0 osdmap e685: 8 total, 8 up, 8 in 2024-03-30T15:24:46.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:45 smithi072 bash[28946]: cluster 2024-03-30T15:24:44.298742+0000 mgr.y (mgr.14526) 658 : cluster 0 pgmap v1101: 204 pgs: 204 active+clean; 582 KiB data, 700 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-03-30T15:24:46.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:45 smithi072 bash[28946]: cluster 2024-03-30T15:24:44.684303+0000 mon.a (mon.0) 3424 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:24:46.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:45 smithi072 bash[28946]: cluster 2024-03-30T15:24:44.706250+0000 mon.a (mon.0) 3425 : cluster 0 osdmap e685: 8 total, 8 up, 8 in 2024-03-30T15:24:46.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:45 smithi072 bash[21573]: cluster 2024-03-30T15:24:44.298742+0000 mgr.y (mgr.14526) 658 : cluster 0 pgmap v1101: 204 pgs: 204 active+clean; 582 KiB data, 700 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-03-30T15:24:46.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:45 smithi072 bash[21573]: cluster 2024-03-30T15:24:44.684303+0000 mon.a (mon.0) 3424 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:24:46.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:45 smithi072 bash[21573]: cluster 2024-03-30T15:24:44.706250+0000 mon.a (mon.0) 3425 : cluster 0 osdmap e685: 8 total, 8 up, 8 in 2024-03-30T15:24:47.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:46 smithi072 bash[21573]: cluster 2024-03-30T15:24:45.720492+0000 mon.a (mon.0) 3426 : cluster 0 osdmap e686: 8 total, 8 up, 8 in 2024-03-30T15:24:47.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:46 smithi072 bash[21573]: audit 2024-03-30T15:24:45.728302+0000 mon.a (mon.0) 3427 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:24:47.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:46 smithi072 bash[28946]: cluster 2024-03-30T15:24:45.720492+0000 mon.a (mon.0) 3426 : cluster 0 osdmap e686: 8 total, 8 up, 8 in 2024-03-30T15:24:47.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:46 smithi072 bash[28946]: audit 2024-03-30T15:24:45.728302+0000 mon.a (mon.0) 3427 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:24:47.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:46 smithi172 bash[23680]: cluster 2024-03-30T15:24:45.720492+0000 mon.a (mon.0) 3426 : cluster 0 osdmap e686: 8 total, 8 up, 8 in 2024-03-30T15:24:47.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:46 smithi172 bash[23680]: audit 2024-03-30T15:24:45.728302+0000 mon.a (mon.0) 3427 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:24:48.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:47 smithi072 bash[21573]: cluster 2024-03-30T15:24:46.300829+0000 mgr.y (mgr.14526) 659 : cluster 0 pgmap v1104: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 701 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-03-30T15:24:48.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:47 smithi072 bash[21573]: audit 2024-03-30T15:24:46.723176+0000 mon.a (mon.0) 3428 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-134","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:24:48.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:47 smithi072 bash[21573]: cluster 2024-03-30T15:24:46.732705+0000 mon.a (mon.0) 3429 : cluster 0 osdmap e687: 8 total, 8 up, 8 in 2024-03-30T15:24:48.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:47 smithi072 bash[21573]: audit 2024-03-30T15:24:46.749530+0000 mon.a (mon.0) 3430 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-134", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:24:48.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:47 smithi072 bash[21573]: audit 2024-03-30T15:24:47.321476+0000 mon.a (mon.0) 3431 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-134", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:24:48.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:47 smithi072 bash[21573]: cluster 2024-03-30T15:24:47.328402+0000 mon.a (mon.0) 3432 : cluster 0 osdmap e688: 8 total, 8 up, 8 in 2024-03-30T15:24:48.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:47 smithi072 bash[21573]: audit 2024-03-30T15:24:47.329783+0000 mon.a (mon.0) 3433 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-134"}]: dispatch 2024-03-30T15:24:48.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:47 smithi072 bash[28946]: cluster 2024-03-30T15:24:46.300829+0000 mgr.y (mgr.14526) 659 : cluster 0 pgmap v1104: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 701 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-03-30T15:24:48.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:47 smithi072 bash[28946]: audit 2024-03-30T15:24:46.723176+0000 mon.a (mon.0) 3428 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-134","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:24:48.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:47 smithi072 bash[28946]: cluster 2024-03-30T15:24:46.732705+0000 mon.a (mon.0) 3429 : cluster 0 osdmap e687: 8 total, 8 up, 8 in 2024-03-30T15:24:48.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:47 smithi072 bash[28946]: audit 2024-03-30T15:24:46.749530+0000 mon.a (mon.0) 3430 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-134", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:24:48.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:47 smithi072 bash[28946]: audit 2024-03-30T15:24:47.321476+0000 mon.a (mon.0) 3431 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-134", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:24:48.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:47 smithi072 bash[28946]: cluster 2024-03-30T15:24:47.328402+0000 mon.a (mon.0) 3432 : cluster 0 osdmap e688: 8 total, 8 up, 8 in 2024-03-30T15:24:48.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:47 smithi072 bash[28946]: audit 2024-03-30T15:24:47.329783+0000 mon.a (mon.0) 3433 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-134"}]: dispatch 2024-03-30T15:24:48.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:47 smithi172 bash[23680]: cluster 2024-03-30T15:24:46.300829+0000 mgr.y (mgr.14526) 659 : cluster 0 pgmap v1104: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 701 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-03-30T15:24:48.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:47 smithi172 bash[23680]: audit 2024-03-30T15:24:46.723176+0000 mon.a (mon.0) 3428 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-134","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:24:48.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:47 smithi172 bash[23680]: cluster 2024-03-30T15:24:46.732705+0000 mon.a (mon.0) 3429 : cluster 0 osdmap e687: 8 total, 8 up, 8 in 2024-03-30T15:24:48.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:47 smithi172 bash[23680]: audit 2024-03-30T15:24:46.749530+0000 mon.a (mon.0) 3430 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-134", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:24:48.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:47 smithi172 bash[23680]: audit 2024-03-30T15:24:47.321476+0000 mon.a (mon.0) 3431 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-134", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:24:48.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:47 smithi172 bash[23680]: cluster 2024-03-30T15:24:47.328402+0000 mon.a (mon.0) 3432 : cluster 0 osdmap e688: 8 total, 8 up, 8 in 2024-03-30T15:24:48.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:47 smithi172 bash[23680]: audit 2024-03-30T15:24:47.329783+0000 mon.a (mon.0) 3433 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-134"}]: dispatch 2024-03-30T15:24:49.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:49 smithi072 bash[21573]: cluster 2024-03-30T15:24:48.301645+0000 mgr.y (mgr.14526) 660 : cluster 0 pgmap v1107: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 701 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-03-30T15:24:49.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:49 smithi072 bash[21573]: audit 2024-03-30T15:24:48.324143+0000 mon.a (mon.0) 3434 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-134"}]': finished 2024-03-30T15:24:49.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:49 smithi072 bash[21573]: cluster 2024-03-30T15:24:48.331874+0000 mon.a (mon.0) 3435 : cluster 0 osdmap e689: 8 total, 8 up, 8 in 2024-03-30T15:24:49.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:49 smithi072 bash[21573]: audit 2024-03-30T15:24:48.333443+0000 mon.a (mon.0) 3436 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-134", "mode": "writeback"}]: dispatch 2024-03-30T15:24:49.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:49 smithi072 bash[28946]: cluster 2024-03-30T15:24:48.301645+0000 mgr.y (mgr.14526) 660 : cluster 0 pgmap v1107: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 701 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-03-30T15:24:49.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:49 smithi072 bash[28946]: audit 2024-03-30T15:24:48.324143+0000 mon.a (mon.0) 3434 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-134"}]': finished 2024-03-30T15:24:49.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:49 smithi072 bash[28946]: cluster 2024-03-30T15:24:48.331874+0000 mon.a (mon.0) 3435 : cluster 0 osdmap e689: 8 total, 8 up, 8 in 2024-03-30T15:24:49.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:49 smithi072 bash[28946]: audit 2024-03-30T15:24:48.333443+0000 mon.a (mon.0) 3436 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-134", "mode": "writeback"}]: dispatch 2024-03-30T15:24:49.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:49 smithi172 bash[23680]: cluster 2024-03-30T15:24:48.301645+0000 mgr.y (mgr.14526) 660 : cluster 0 pgmap v1107: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 701 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-03-30T15:24:49.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:49 smithi172 bash[23680]: audit 2024-03-30T15:24:48.324143+0000 mon.a (mon.0) 3434 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-134"}]': finished 2024-03-30T15:24:49.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:49 smithi172 bash[23680]: cluster 2024-03-30T15:24:48.331874+0000 mon.a (mon.0) 3435 : cluster 0 osdmap e689: 8 total, 8 up, 8 in 2024-03-30T15:24:49.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:49 smithi172 bash[23680]: audit 2024-03-30T15:24:48.333443+0000 mon.a (mon.0) 3436 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-134", "mode": "writeback"}]: dispatch 2024-03-30T15:24:50.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:50 smithi072 bash[21573]: cluster 2024-03-30T15:24:49.324491+0000 mon.a (mon.0) 3437 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:24:50.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:50 smithi072 bash[21573]: audit 2024-03-30T15:24:49.326990+0000 mon.a (mon.0) 3438 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-134", "mode": "writeback"}]': finished 2024-03-30T15:24:50.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:50 smithi072 bash[21573]: cluster 2024-03-30T15:24:49.333757+0000 mon.a (mon.0) 3439 : cluster 0 osdmap e690: 8 total, 8 up, 8 in 2024-03-30T15:24:50.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:50 smithi072 bash[21573]: audit 2024-03-30T15:24:49.452469+0000 mon.a (mon.0) 3440 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:24:50.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:50 smithi072 bash[28946]: cluster 2024-03-30T15:24:49.324491+0000 mon.a (mon.0) 3437 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:24:50.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:50 smithi072 bash[28946]: audit 2024-03-30T15:24:49.326990+0000 mon.a (mon.0) 3438 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-134", "mode": "writeback"}]': finished 2024-03-30T15:24:50.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:50 smithi072 bash[28946]: cluster 2024-03-30T15:24:49.333757+0000 mon.a (mon.0) 3439 : cluster 0 osdmap e690: 8 total, 8 up, 8 in 2024-03-30T15:24:50.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:50 smithi072 bash[28946]: audit 2024-03-30T15:24:49.452469+0000 mon.a (mon.0) 3440 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:24:50.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:50 smithi172 bash[23680]: cluster 2024-03-30T15:24:49.324491+0000 mon.a (mon.0) 3437 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:24:50.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:50 smithi172 bash[23680]: audit 2024-03-30T15:24:49.326990+0000 mon.a (mon.0) 3438 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-134", "mode": "writeback"}]': finished 2024-03-30T15:24:50.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:50 smithi172 bash[23680]: cluster 2024-03-30T15:24:49.333757+0000 mon.a (mon.0) 3439 : cluster 0 osdmap e690: 8 total, 8 up, 8 in 2024-03-30T15:24:50.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:50 smithi172 bash[23680]: audit 2024-03-30T15:24:49.452469+0000 mon.a (mon.0) 3440 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:24:51.364 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:24:51 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:24:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:24:51.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:51 smithi172 bash[23680]: cluster 2024-03-30T15:24:50.302464+0000 mgr.y (mgr.14526) 661 : cluster 0 pgmap v1110: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 701 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:24:51.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:51 smithi172 bash[23680]: audit 2024-03-30T15:24:50.349544+0000 mon.a (mon.0) 3441 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:24:51.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:51 smithi172 bash[23680]: cluster 2024-03-30T15:24:50.358273+0000 mon.a (mon.0) 3442 : cluster 0 osdmap e691: 8 total, 8 up, 8 in 2024-03-30T15:24:51.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:51 smithi172 bash[23680]: audit 2024-03-30T15:24:50.360925+0000 mon.a (mon.0) 3443 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-134"}]: dispatch 2024-03-30T15:24:51.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:51 smithi072 bash[28946]: cluster 2024-03-30T15:24:50.302464+0000 mgr.y (mgr.14526) 661 : cluster 0 pgmap v1110: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 701 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:24:51.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:51 smithi072 bash[28946]: audit 2024-03-30T15:24:50.349544+0000 mon.a (mon.0) 3441 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:24:51.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:51 smithi072 bash[28946]: cluster 2024-03-30T15:24:50.358273+0000 mon.a (mon.0) 3442 : cluster 0 osdmap e691: 8 total, 8 up, 8 in 2024-03-30T15:24:51.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:51 smithi072 bash[28946]: audit 2024-03-30T15:24:50.360925+0000 mon.a (mon.0) 3443 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-134"}]: dispatch 2024-03-30T15:24:51.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:51 smithi072 bash[21573]: cluster 2024-03-30T15:24:50.302464+0000 mgr.y (mgr.14526) 661 : cluster 0 pgmap v1110: 204 pgs: 32 creating+peering, 172 active+clean; 582 KiB data, 701 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:24:51.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:51 smithi072 bash[21573]: audit 2024-03-30T15:24:50.349544+0000 mon.a (mon.0) 3441 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:24:51.670 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:51 smithi072 bash[21573]: cluster 2024-03-30T15:24:50.358273+0000 mon.a (mon.0) 3442 : cluster 0 osdmap e691: 8 total, 8 up, 8 in 2024-03-30T15:24:51.670 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:51 smithi072 bash[21573]: audit 2024-03-30T15:24:50.360925+0000 mon.a (mon.0) 3443 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-134"}]: dispatch 2024-03-30T15:24:51.967 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:24:51 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:24:53.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:52 smithi072 bash[21573]: cluster 2024-03-30T15:24:51.349993+0000 mon.a (mon.0) 3444 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:24:53.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:52 smithi072 bash[21573]: audit 2024-03-30T15:24:51.352595+0000 mon.a (mon.0) 3445 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-134"}]': finished 2024-03-30T15:24:53.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:52 smithi072 bash[21573]: cluster 2024-03-30T15:24:51.361679+0000 mon.a (mon.0) 3446 : cluster 0 osdmap e692: 8 total, 8 up, 8 in 2024-03-30T15:24:53.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:52 smithi072 bash[21573]: audit 2024-03-30T15:24:51.652943+0000 mgr.y (mgr.14526) 662 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:24:53.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:52 smithi072 bash[21573]: audit 2024-03-30T15:24:52.290461+0000 mon.a (mon.0) 3447 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:24:53.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:52 smithi072 bash[21573]: audit 2024-03-30T15:24:52.295456+0000 mon.c (mon.2) 520 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:24:53.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:52 smithi072 bash[21573]: cluster 2024-03-30T15:24:52.320712+0000 mon.a (mon.0) 3448 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:24:53.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:52 smithi072 bash[28946]: cluster 2024-03-30T15:24:51.349993+0000 mon.a (mon.0) 3444 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:24:53.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:52 smithi072 bash[28946]: audit 2024-03-30T15:24:51.352595+0000 mon.a (mon.0) 3445 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-134"}]': finished 2024-03-30T15:24:53.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:52 smithi072 bash[28946]: cluster 2024-03-30T15:24:51.361679+0000 mon.a (mon.0) 3446 : cluster 0 osdmap e692: 8 total, 8 up, 8 in 2024-03-30T15:24:53.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:52 smithi072 bash[28946]: audit 2024-03-30T15:24:51.652943+0000 mgr.y (mgr.14526) 662 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:24:53.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:52 smithi072 bash[28946]: audit 2024-03-30T15:24:52.290461+0000 mon.a (mon.0) 3447 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:24:53.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:52 smithi072 bash[28946]: audit 2024-03-30T15:24:52.295456+0000 mon.c (mon.2) 520 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:24:53.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:52 smithi072 bash[28946]: cluster 2024-03-30T15:24:52.320712+0000 mon.a (mon.0) 3448 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:24:53.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:52 smithi172 bash[23680]: cluster 2024-03-30T15:24:51.349993+0000 mon.a (mon.0) 3444 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:24:53.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:52 smithi172 bash[23680]: audit 2024-03-30T15:24:51.352595+0000 mon.a (mon.0) 3445 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-134"}]': finished 2024-03-30T15:24:53.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:52 smithi172 bash[23680]: cluster 2024-03-30T15:24:51.361679+0000 mon.a (mon.0) 3446 : cluster 0 osdmap e692: 8 total, 8 up, 8 in 2024-03-30T15:24:53.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:52 smithi172 bash[23680]: audit 2024-03-30T15:24:51.652943+0000 mgr.y (mgr.14526) 662 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:24:53.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:52 smithi172 bash[23680]: audit 2024-03-30T15:24:52.290461+0000 mon.a (mon.0) 3447 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:24:53.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:52 smithi172 bash[23680]: audit 2024-03-30T15:24:52.295456+0000 mon.c (mon.2) 520 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:24:53.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:52 smithi172 bash[23680]: cluster 2024-03-30T15:24:52.320712+0000 mon.a (mon.0) 3448 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:24:54.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:53 smithi072 bash[21573]: cluster 2024-03-30T15:24:52.306875+0000 mgr.y (mgr.14526) 663 : cluster 0 pgmap v1113: 204 pgs: 204 active+clean; 582 KiB data, 702 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-03-30T15:24:54.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:53 smithi072 bash[21573]: cluster 2024-03-30T15:24:52.377509+0000 mon.a (mon.0) 3449 : cluster 0 osdmap e693: 8 total, 8 up, 8 in 2024-03-30T15:24:54.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:53 smithi072 bash[21573]: cluster 2024-03-30T15:24:53.382388+0000 mon.a (mon.0) 3450 : cluster 0 osdmap e694: 8 total, 8 up, 8 in 2024-03-30T15:24:54.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:53 smithi072 bash[21573]: audit 2024-03-30T15:24:53.394776+0000 mon.a (mon.0) 3451 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:24:54.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:53 smithi072 bash[28946]: cluster 2024-03-30T15:24:52.306875+0000 mgr.y (mgr.14526) 663 : cluster 0 pgmap v1113: 204 pgs: 204 active+clean; 582 KiB data, 702 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-03-30T15:24:54.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:53 smithi072 bash[28946]: cluster 2024-03-30T15:24:52.377509+0000 mon.a (mon.0) 3449 : cluster 0 osdmap e693: 8 total, 8 up, 8 in 2024-03-30T15:24:54.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:53 smithi072 bash[28946]: cluster 2024-03-30T15:24:53.382388+0000 mon.a (mon.0) 3450 : cluster 0 osdmap e694: 8 total, 8 up, 8 in 2024-03-30T15:24:54.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:53 smithi072 bash[28946]: audit 2024-03-30T15:24:53.394776+0000 mon.a (mon.0) 3451 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:24:54.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:53 smithi172 bash[23680]: cluster 2024-03-30T15:24:52.306875+0000 mgr.y (mgr.14526) 663 : cluster 0 pgmap v1113: 204 pgs: 204 active+clean; 582 KiB data, 702 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-03-30T15:24:54.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:53 smithi172 bash[23680]: cluster 2024-03-30T15:24:52.377509+0000 mon.a (mon.0) 3449 : cluster 0 osdmap e693: 8 total, 8 up, 8 in 2024-03-30T15:24:54.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:53 smithi172 bash[23680]: cluster 2024-03-30T15:24:53.382388+0000 mon.a (mon.0) 3450 : cluster 0 osdmap e694: 8 total, 8 up, 8 in 2024-03-30T15:24:54.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:53 smithi172 bash[23680]: audit 2024-03-30T15:24:53.394776+0000 mon.a (mon.0) 3451 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:24:55.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:55 smithi072 bash[21573]: cluster 2024-03-30T15:24:54.307732+0000 mgr.y (mgr.14526) 664 : cluster 0 pgmap v1116: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 702 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-03-30T15:24:55.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:55 smithi072 bash[21573]: audit 2024-03-30T15:24:54.376195+0000 mon.a (mon.0) 3452 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-136","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:24:55.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:55 smithi072 bash[21573]: cluster 2024-03-30T15:24:54.389111+0000 mon.a (mon.0) 3453 : cluster 0 osdmap e695: 8 total, 8 up, 8 in 2024-03-30T15:24:55.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:55 smithi072 bash[21573]: audit 2024-03-30T15:24:54.393981+0000 mon.a (mon.0) 3454 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-136", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:24:55.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:55 smithi072 bash[28946]: cluster 2024-03-30T15:24:54.307732+0000 mgr.y (mgr.14526) 664 : cluster 0 pgmap v1116: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 702 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-03-30T15:24:55.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:55 smithi072 bash[28946]: audit 2024-03-30T15:24:54.376195+0000 mon.a (mon.0) 3452 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-136","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:24:55.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:55 smithi072 bash[28946]: cluster 2024-03-30T15:24:54.389111+0000 mon.a (mon.0) 3453 : cluster 0 osdmap e695: 8 total, 8 up, 8 in 2024-03-30T15:24:55.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:55 smithi072 bash[28946]: audit 2024-03-30T15:24:54.393981+0000 mon.a (mon.0) 3454 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-136", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:24:55.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:55 smithi172 bash[23680]: cluster 2024-03-30T15:24:54.307732+0000 mgr.y (mgr.14526) 664 : cluster 0 pgmap v1116: 204 pgs: 32 unknown, 172 active+clean; 582 KiB data, 702 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-03-30T15:24:55.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:55 smithi172 bash[23680]: audit 2024-03-30T15:24:54.376195+0000 mon.a (mon.0) 3452 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-136","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:24:55.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:55 smithi172 bash[23680]: cluster 2024-03-30T15:24:54.389111+0000 mon.a (mon.0) 3453 : cluster 0 osdmap e695: 8 total, 8 up, 8 in 2024-03-30T15:24:55.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:55 smithi172 bash[23680]: audit 2024-03-30T15:24:54.393981+0000 mon.a (mon.0) 3454 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-136", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:24:56.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:56 smithi072 bash[21573]: audit 2024-03-30T15:24:55.378978+0000 mon.a (mon.0) 3455 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-136", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:24:56.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:56 smithi072 bash[21573]: cluster 2024-03-30T15:24:55.386850+0000 mon.a (mon.0) 3456 : cluster 0 osdmap e696: 8 total, 8 up, 8 in 2024-03-30T15:24:56.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:56 smithi072 bash[21573]: audit 2024-03-30T15:24:55.389058+0000 mon.a (mon.0) 3457 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-136"}]: dispatch 2024-03-30T15:24:56.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:56 smithi072 bash[21573]: audit 2024-03-30T15:24:56.381701+0000 mon.a (mon.0) 3458 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-136"}]': finished 2024-03-30T15:24:56.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:56 smithi072 bash[21573]: cluster 2024-03-30T15:24:56.390515+0000 mon.a (mon.0) 3459 : cluster 0 osdmap e697: 8 total, 8 up, 8 in 2024-03-30T15:24:56.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:56 smithi072 bash[28946]: audit 2024-03-30T15:24:55.378978+0000 mon.a (mon.0) 3455 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-136", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:24:56.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:56 smithi072 bash[28946]: cluster 2024-03-30T15:24:55.386850+0000 mon.a (mon.0) 3456 : cluster 0 osdmap e696: 8 total, 8 up, 8 in 2024-03-30T15:24:56.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:56 smithi072 bash[28946]: audit 2024-03-30T15:24:55.389058+0000 mon.a (mon.0) 3457 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-136"}]: dispatch 2024-03-30T15:24:56.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:56 smithi072 bash[28946]: audit 2024-03-30T15:24:56.381701+0000 mon.a (mon.0) 3458 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-136"}]': finished 2024-03-30T15:24:56.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:56 smithi072 bash[28946]: cluster 2024-03-30T15:24:56.390515+0000 mon.a (mon.0) 3459 : cluster 0 osdmap e697: 8 total, 8 up, 8 in 2024-03-30T15:24:56.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:56 smithi172 bash[23680]: audit 2024-03-30T15:24:55.378978+0000 mon.a (mon.0) 3455 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-136", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:24:56.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:56 smithi172 bash[23680]: cluster 2024-03-30T15:24:55.386850+0000 mon.a (mon.0) 3456 : cluster 0 osdmap e696: 8 total, 8 up, 8 in 2024-03-30T15:24:56.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:56 smithi172 bash[23680]: audit 2024-03-30T15:24:55.389058+0000 mon.a (mon.0) 3457 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-136"}]: dispatch 2024-03-30T15:24:56.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:56 smithi172 bash[23680]: audit 2024-03-30T15:24:56.381701+0000 mon.a (mon.0) 3458 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-136"}]': finished 2024-03-30T15:24:56.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:56 smithi172 bash[23680]: cluster 2024-03-30T15:24:56.390515+0000 mon.a (mon.0) 3459 : cluster 0 osdmap e697: 8 total, 8 up, 8 in 2024-03-30T15:24:57.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:57 smithi072 bash[21573]: cluster 2024-03-30T15:24:56.309908+0000 mgr.y (mgr.14526) 665 : cluster 0 pgmap v1119: 204 pgs: 204 active+clean; 582 KiB data, 732 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:24:57.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:57 smithi072 bash[21573]: audit 2024-03-30T15:24:56.392429+0000 mon.a (mon.0) 3460 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-136", "mode": "writeback"}]: dispatch 2024-03-30T15:24:57.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:57 smithi072 bash[21573]: cluster 2024-03-30T15:24:57.382036+0000 mon.a (mon.0) 3461 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:24:57.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:57 smithi072 bash[21573]: audit 2024-03-30T15:24:57.384536+0000 mon.a (mon.0) 3462 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-136", "mode": "writeback"}]': finished 2024-03-30T15:24:57.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:57 smithi072 bash[21573]: cluster 2024-03-30T15:24:57.391782+0000 mon.a (mon.0) 3463 : cluster 0 osdmap e698: 8 total, 8 up, 8 in 2024-03-30T15:24:57.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:57 smithi072 bash[28946]: cluster 2024-03-30T15:24:56.309908+0000 mgr.y (mgr.14526) 665 : cluster 0 pgmap v1119: 204 pgs: 204 active+clean; 582 KiB data, 732 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:24:57.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:57 smithi072 bash[28946]: audit 2024-03-30T15:24:56.392429+0000 mon.a (mon.0) 3460 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-136", "mode": "writeback"}]: dispatch 2024-03-30T15:24:57.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:57 smithi072 bash[28946]: cluster 2024-03-30T15:24:57.382036+0000 mon.a (mon.0) 3461 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:24:57.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:57 smithi072 bash[28946]: audit 2024-03-30T15:24:57.384536+0000 mon.a (mon.0) 3462 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-136", "mode": "writeback"}]': finished 2024-03-30T15:24:57.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:57 smithi072 bash[28946]: cluster 2024-03-30T15:24:57.391782+0000 mon.a (mon.0) 3463 : cluster 0 osdmap e698: 8 total, 8 up, 8 in 2024-03-30T15:24:57.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:57 smithi172 bash[23680]: cluster 2024-03-30T15:24:56.309908+0000 mgr.y (mgr.14526) 665 : cluster 0 pgmap v1119: 204 pgs: 204 active+clean; 582 KiB data, 732 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:24:57.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:57 smithi172 bash[23680]: audit 2024-03-30T15:24:56.392429+0000 mon.a (mon.0) 3460 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-136", "mode": "writeback"}]: dispatch 2024-03-30T15:24:57.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:57 smithi172 bash[23680]: cluster 2024-03-30T15:24:57.382036+0000 mon.a (mon.0) 3461 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:24:57.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:57 smithi172 bash[23680]: audit 2024-03-30T15:24:57.384536+0000 mon.a (mon.0) 3462 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-136", "mode": "writeback"}]': finished 2024-03-30T15:24:57.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:57 smithi172 bash[23680]: cluster 2024-03-30T15:24:57.391782+0000 mon.a (mon.0) 3463 : cluster 0 osdmap e698: 8 total, 8 up, 8 in 2024-03-30T15:24:58.668 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:58 smithi072 bash[21573]: audit 2024-03-30T15:24:57.522788+0000 mon.a (mon.0) 3464 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:24:58.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:58 smithi072 bash[28946]: audit 2024-03-30T15:24:57.522788+0000 mon.a (mon.0) 3464 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:24:58.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:58 smithi172 bash[23680]: audit 2024-03-30T15:24:57.522788+0000 mon.a (mon.0) 3464 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:24:59.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:59 smithi172 bash[23680]: cluster 2024-03-30T15:24:58.310720+0000 mgr.y (mgr.14526) 666 : cluster 0 pgmap v1122: 204 pgs: 204 active+clean; 582 KiB data, 732 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:24:59.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:59 smithi172 bash[23680]: audit 2024-03-30T15:24:58.418055+0000 mon.a (mon.0) 3465 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:24:59.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:59 smithi172 bash[23680]: cluster 2024-03-30T15:24:58.425052+0000 mon.a (mon.0) 3466 : cluster 0 osdmap e699: 8 total, 8 up, 8 in 2024-03-30T15:24:59.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:24:59 smithi172 bash[23680]: audit 2024-03-30T15:24:58.427006+0000 mon.a (mon.0) 3467 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-136"}]: dispatch 2024-03-30T15:24:59.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:59 smithi072 bash[21573]: cluster 2024-03-30T15:24:58.310720+0000 mgr.y (mgr.14526) 666 : cluster 0 pgmap v1122: 204 pgs: 204 active+clean; 582 KiB data, 732 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:24:59.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:59 smithi072 bash[21573]: audit 2024-03-30T15:24:58.418055+0000 mon.a (mon.0) 3465 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:24:59.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:59 smithi072 bash[21573]: cluster 2024-03-30T15:24:58.425052+0000 mon.a (mon.0) 3466 : cluster 0 osdmap e699: 8 total, 8 up, 8 in 2024-03-30T15:24:59.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:24:59 smithi072 bash[21573]: audit 2024-03-30T15:24:58.427006+0000 mon.a (mon.0) 3467 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-136"}]: dispatch 2024-03-30T15:24:59.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:59 smithi072 bash[28946]: cluster 2024-03-30T15:24:58.310720+0000 mgr.y (mgr.14526) 666 : cluster 0 pgmap v1122: 204 pgs: 204 active+clean; 582 KiB data, 732 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:24:59.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:59 smithi072 bash[28946]: audit 2024-03-30T15:24:58.418055+0000 mon.a (mon.0) 3465 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:24:59.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:59 smithi072 bash[28946]: cluster 2024-03-30T15:24:58.425052+0000 mon.a (mon.0) 3466 : cluster 0 osdmap e699: 8 total, 8 up, 8 in 2024-03-30T15:24:59.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:24:59 smithi072 bash[28946]: audit 2024-03-30T15:24:58.427006+0000 mon.a (mon.0) 3467 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-136"}]: dispatch 2024-03-30T15:25:00.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:00 smithi172 bash[23680]: cluster 2024-03-30T15:24:59.418470+0000 mon.a (mon.0) 3468 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:25:00.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:00 smithi172 bash[23680]: audit 2024-03-30T15:24:59.420959+0000 mon.a (mon.0) 3469 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-136"}]': finished 2024-03-30T15:25:00.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:00 smithi172 bash[23680]: cluster 2024-03-30T15:24:59.428126+0000 mon.a (mon.0) 3470 : cluster 0 osdmap e700: 8 total, 8 up, 8 in 2024-03-30T15:25:00.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:00 smithi072 bash[21573]: cluster 2024-03-30T15:24:59.418470+0000 mon.a (mon.0) 3468 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:25:00.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:00 smithi072 bash[21573]: audit 2024-03-30T15:24:59.420959+0000 mon.a (mon.0) 3469 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-136"}]': finished 2024-03-30T15:25:00.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:00 smithi072 bash[21573]: cluster 2024-03-30T15:24:59.428126+0000 mon.a (mon.0) 3470 : cluster 0 osdmap e700: 8 total, 8 up, 8 in 2024-03-30T15:25:00.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:00 smithi072 bash[28946]: cluster 2024-03-30T15:24:59.418470+0000 mon.a (mon.0) 3468 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:25:00.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:00 smithi072 bash[28946]: audit 2024-03-30T15:24:59.420959+0000 mon.a (mon.0) 3469 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-136"}]': finished 2024-03-30T15:25:00.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:00 smithi072 bash[28946]: cluster 2024-03-30T15:24:59.428126+0000 mon.a (mon.0) 3470 : cluster 0 osdmap e700: 8 total, 8 up, 8 in 2024-03-30T15:25:01.419 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:25:01 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:25:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:25:01.662 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:01 smithi172 bash[23680]: cluster 2024-03-30T15:25:00.311553+0000 mgr.y (mgr.14526) 667 : cluster 0 pgmap v1125: 204 pgs: 204 active+clean; 582 KiB data, 732 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:25:01.663 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:01 smithi172 bash[23680]: cluster 2024-03-30T15:25:00.433298+0000 mon.a (mon.0) 3471 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:25:01.663 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:01 smithi172 bash[23680]: cluster 2024-03-30T15:25:00.450758+0000 mon.a (mon.0) 3472 : cluster 0 osdmap e701: 8 total, 8 up, 8 in 2024-03-30T15:25:01.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:01 smithi072 bash[21573]: cluster 2024-03-30T15:25:00.311553+0000 mgr.y (mgr.14526) 667 : cluster 0 pgmap v1125: 204 pgs: 204 active+clean; 582 KiB data, 732 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:25:01.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:01 smithi072 bash[21573]: cluster 2024-03-30T15:25:00.433298+0000 mon.a (mon.0) 3471 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:25:01.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:01 smithi072 bash[21573]: cluster 2024-03-30T15:25:00.450758+0000 mon.a (mon.0) 3472 : cluster 0 osdmap e701: 8 total, 8 up, 8 in 2024-03-30T15:25:01.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:01 smithi072 bash[28946]: cluster 2024-03-30T15:25:00.311553+0000 mgr.y (mgr.14526) 667 : cluster 0 pgmap v1125: 204 pgs: 204 active+clean; 582 KiB data, 732 MiB used, 715 GiB / 715 GiB avail 2024-03-30T15:25:01.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:01 smithi072 bash[28946]: cluster 2024-03-30T15:25:00.433298+0000 mon.a (mon.0) 3471 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:25:01.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:01 smithi072 bash[28946]: cluster 2024-03-30T15:25:00.450758+0000 mon.a (mon.0) 3472 : cluster 0 osdmap e701: 8 total, 8 up, 8 in 2024-03-30T15:25:01.967 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:25:01 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:25:02.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:02 smithi072 bash[21573]: cluster 2024-03-30T15:25:01.456277+0000 mon.a (mon.0) 3473 : cluster 0 osdmap e702: 8 total, 8 up, 8 in 2024-03-30T15:25:02.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:02 smithi072 bash[21573]: audit 2024-03-30T15:25:01.477121+0000 mon.a (mon.0) 3474 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:25:02.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:02 smithi072 bash[21573]: audit 2024-03-30T15:25:01.664506+0000 mgr.y (mgr.14526) 668 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:25:02.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:02 smithi072 bash[28946]: cluster 2024-03-30T15:25:01.456277+0000 mon.a (mon.0) 3473 : cluster 0 osdmap e702: 8 total, 8 up, 8 in 2024-03-30T15:25:02.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:02 smithi072 bash[28946]: audit 2024-03-30T15:25:01.477121+0000 mon.a (mon.0) 3474 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:25:02.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:02 smithi072 bash[28946]: audit 2024-03-30T15:25:01.664506+0000 mgr.y (mgr.14526) 668 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:25:02.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:02 smithi172 bash[23680]: cluster 2024-03-30T15:25:01.456277+0000 mon.a (mon.0) 3473 : cluster 0 osdmap e702: 8 total, 8 up, 8 in 2024-03-30T15:25:02.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:02 smithi172 bash[23680]: audit 2024-03-30T15:25:01.477121+0000 mon.a (mon.0) 3474 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:25:02.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:02 smithi172 bash[23680]: audit 2024-03-30T15:25:01.664506+0000 mgr.y (mgr.14526) 668 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:25:03.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:03 smithi072 bash[21573]: cluster 2024-03-30T15:25:02.312446+0000 mgr.y (mgr.14526) 669 : cluster 0 pgmap v1128: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-03-30T15:25:03.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:03 smithi072 bash[21573]: audit 2024-03-30T15:25:02.451473+0000 mon.a (mon.0) 3475 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-138","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:25:03.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:03 smithi072 bash[21573]: cluster 2024-03-30T15:25:02.461137+0000 mon.a (mon.0) 3476 : cluster 0 osdmap e703: 8 total, 8 up, 8 in 2024-03-30T15:25:03.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:03 smithi072 bash[21573]: audit 2024-03-30T15:25:02.468395+0000 mon.a (mon.0) 3477 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-138", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:25:03.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:03 smithi072 bash[21573]: audit 2024-03-30T15:25:03.454296+0000 mon.a (mon.0) 3478 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-138", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:25:03.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:03 smithi072 bash[21573]: cluster 2024-03-30T15:25:03.462107+0000 mon.a (mon.0) 3479 : cluster 0 osdmap e704: 8 total, 8 up, 8 in 2024-03-30T15:25:03.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:03 smithi072 bash[21573]: audit 2024-03-30T15:25:03.465422+0000 mon.a (mon.0) 3480 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-138","var": "hit_set_count","val": "2"}]: dispatch 2024-03-30T15:25:03.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:03 smithi072 bash[28946]: cluster 2024-03-30T15:25:02.312446+0000 mgr.y (mgr.14526) 669 : cluster 0 pgmap v1128: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-03-30T15:25:03.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:03 smithi072 bash[28946]: audit 2024-03-30T15:25:02.451473+0000 mon.a (mon.0) 3475 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-138","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:25:03.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:03 smithi072 bash[28946]: cluster 2024-03-30T15:25:02.461137+0000 mon.a (mon.0) 3476 : cluster 0 osdmap e703: 8 total, 8 up, 8 in 2024-03-30T15:25:03.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:03 smithi072 bash[28946]: audit 2024-03-30T15:25:02.468395+0000 mon.a (mon.0) 3477 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-138", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:25:03.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:03 smithi072 bash[28946]: audit 2024-03-30T15:25:03.454296+0000 mon.a (mon.0) 3478 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-138", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:25:03.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:03 smithi072 bash[28946]: cluster 2024-03-30T15:25:03.462107+0000 mon.a (mon.0) 3479 : cluster 0 osdmap e704: 8 total, 8 up, 8 in 2024-03-30T15:25:03.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:03 smithi072 bash[28946]: audit 2024-03-30T15:25:03.465422+0000 mon.a (mon.0) 3480 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-138","var": "hit_set_count","val": "2"}]: dispatch 2024-03-30T15:25:03.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:03 smithi172 bash[23680]: cluster 2024-03-30T15:25:02.312446+0000 mgr.y (mgr.14526) 669 : cluster 0 pgmap v1128: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-03-30T15:25:03.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:03 smithi172 bash[23680]: audit 2024-03-30T15:25:02.451473+0000 mon.a (mon.0) 3475 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-138","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:25:03.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:03 smithi172 bash[23680]: cluster 2024-03-30T15:25:02.461137+0000 mon.a (mon.0) 3476 : cluster 0 osdmap e703: 8 total, 8 up, 8 in 2024-03-30T15:25:03.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:03 smithi172 bash[23680]: audit 2024-03-30T15:25:02.468395+0000 mon.a (mon.0) 3477 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-138", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:25:03.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:03 smithi172 bash[23680]: audit 2024-03-30T15:25:03.454296+0000 mon.a (mon.0) 3478 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-138", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:25:03.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:03 smithi172 bash[23680]: cluster 2024-03-30T15:25:03.462107+0000 mon.a (mon.0) 3479 : cluster 0 osdmap e704: 8 total, 8 up, 8 in 2024-03-30T15:25:03.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:03 smithi172 bash[23680]: audit 2024-03-30T15:25:03.465422+0000 mon.a (mon.0) 3480 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-138","var": "hit_set_count","val": "2"}]: dispatch 2024-03-30T15:25:05.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:05 smithi072 bash[21573]: cluster 2024-03-30T15:25:04.313309+0000 mgr.y (mgr.14526) 670 : cluster 0 pgmap v1131: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-03-30T15:25:05.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:05 smithi072 bash[21573]: audit 2024-03-30T15:25:04.457059+0000 mon.a (mon.0) 3481 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-138","var": "hit_set_count","val": "2"}]': finished 2024-03-30T15:25:05.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:05 smithi072 bash[21573]: cluster 2024-03-30T15:25:04.464253+0000 mon.a (mon.0) 3482 : cluster 0 osdmap e705: 8 total, 8 up, 8 in 2024-03-30T15:25:05.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:05 smithi072 bash[21573]: audit 2024-03-30T15:25:04.465948+0000 mon.a (mon.0) 3483 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-138","var": "hit_set_period","val": "600"}]: dispatch 2024-03-30T15:25:05.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:05 smithi072 bash[28946]: cluster 2024-03-30T15:25:04.313309+0000 mgr.y (mgr.14526) 670 : cluster 0 pgmap v1131: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-03-30T15:25:05.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:05 smithi072 bash[28946]: audit 2024-03-30T15:25:04.457059+0000 mon.a (mon.0) 3481 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-138","var": "hit_set_count","val": "2"}]': finished 2024-03-30T15:25:05.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:05 smithi072 bash[28946]: cluster 2024-03-30T15:25:04.464253+0000 mon.a (mon.0) 3482 : cluster 0 osdmap e705: 8 total, 8 up, 8 in 2024-03-30T15:25:05.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:05 smithi072 bash[28946]: audit 2024-03-30T15:25:04.465948+0000 mon.a (mon.0) 3483 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-138","var": "hit_set_period","val": "600"}]: dispatch 2024-03-30T15:25:05.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:05 smithi172 bash[23680]: cluster 2024-03-30T15:25:04.313309+0000 mgr.y (mgr.14526) 670 : cluster 0 pgmap v1131: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 738 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-03-30T15:25:05.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:05 smithi172 bash[23680]: audit 2024-03-30T15:25:04.457059+0000 mon.a (mon.0) 3481 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-138","var": "hit_set_count","val": "2"}]': finished 2024-03-30T15:25:05.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:05 smithi172 bash[23680]: cluster 2024-03-30T15:25:04.464253+0000 mon.a (mon.0) 3482 : cluster 0 osdmap e705: 8 total, 8 up, 8 in 2024-03-30T15:25:05.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:05 smithi172 bash[23680]: audit 2024-03-30T15:25:04.465948+0000 mon.a (mon.0) 3483 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-138","var": "hit_set_period","val": "600"}]: dispatch 2024-03-30T15:25:06.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:06 smithi072 bash[28946]: audit 2024-03-30T15:25:05.459870+0000 mon.a (mon.0) 3484 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-138","var": "hit_set_period","val": "600"}]': finished 2024-03-30T15:25:06.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:06 smithi072 bash[28946]: cluster 2024-03-30T15:25:05.467248+0000 mon.a (mon.0) 3485 : cluster 0 osdmap e706: 8 total, 8 up, 8 in 2024-03-30T15:25:06.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:06 smithi072 bash[28946]: audit 2024-03-30T15:25:05.470721+0000 mon.a (mon.0) 3486 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-138","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-03-30T15:25:06.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:06 smithi072 bash[28946]: audit 2024-03-30T15:25:06.462358+0000 mon.a (mon.0) 3487 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-138","var": "hit_set_type","val": "explicit_object"}]': finished 2024-03-30T15:25:06.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:06 smithi072 bash[21573]: audit 2024-03-30T15:25:05.459870+0000 mon.a (mon.0) 3484 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-138","var": "hit_set_period","val": "600"}]': finished 2024-03-30T15:25:06.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:06 smithi072 bash[21573]: cluster 2024-03-30T15:25:05.467248+0000 mon.a (mon.0) 3485 : cluster 0 osdmap e706: 8 total, 8 up, 8 in 2024-03-30T15:25:06.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:06 smithi072 bash[21573]: audit 2024-03-30T15:25:05.470721+0000 mon.a (mon.0) 3486 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-138","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-03-30T15:25:06.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:06 smithi072 bash[21573]: audit 2024-03-30T15:25:06.462358+0000 mon.a (mon.0) 3487 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-138","var": "hit_set_type","val": "explicit_object"}]': finished 2024-03-30T15:25:06.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:06 smithi172 bash[23680]: audit 2024-03-30T15:25:05.459870+0000 mon.a (mon.0) 3484 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-138","var": "hit_set_period","val": "600"}]': finished 2024-03-30T15:25:06.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:06 smithi172 bash[23680]: cluster 2024-03-30T15:25:05.467248+0000 mon.a (mon.0) 3485 : cluster 0 osdmap e706: 8 total, 8 up, 8 in 2024-03-30T15:25:06.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:06 smithi172 bash[23680]: audit 2024-03-30T15:25:05.470721+0000 mon.a (mon.0) 3486 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-138","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-03-30T15:25:06.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:06 smithi172 bash[23680]: audit 2024-03-30T15:25:06.462358+0000 mon.a (mon.0) 3487 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-138","var": "hit_set_type","val": "explicit_object"}]': finished 2024-03-30T15:25:07.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:07 smithi072 bash[21573]: cluster 2024-03-30T15:25:06.315233+0000 mgr.y (mgr.14526) 671 : cluster 0 pgmap v1134: 204 pgs: 204 active+clean; 4.4 MiB data, 757 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:25:07.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:07 smithi072 bash[21573]: cluster 2024-03-30T15:25:06.469213+0000 mon.a (mon.0) 3488 : cluster 0 osdmap e707: 8 total, 8 up, 8 in 2024-03-30T15:25:07.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:07 smithi072 bash[21573]: cluster 2024-03-30T15:25:07.324697+0000 mon.a (mon.0) 3489 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:25:07.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:07 smithi072 bash[21573]: audit 2024-03-30T15:25:07.330737+0000 mon.c (mon.2) 521 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:25:07.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:07 smithi072 bash[28946]: cluster 2024-03-30T15:25:06.315233+0000 mgr.y (mgr.14526) 671 : cluster 0 pgmap v1134: 204 pgs: 204 active+clean; 4.4 MiB data, 757 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:25:07.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:07 smithi072 bash[28946]: cluster 2024-03-30T15:25:06.469213+0000 mon.a (mon.0) 3488 : cluster 0 osdmap e707: 8 total, 8 up, 8 in 2024-03-30T15:25:07.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:07 smithi072 bash[28946]: cluster 2024-03-30T15:25:07.324697+0000 mon.a (mon.0) 3489 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:25:07.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:07 smithi072 bash[28946]: audit 2024-03-30T15:25:07.330737+0000 mon.c (mon.2) 521 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:25:07.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:07 smithi172 bash[23680]: cluster 2024-03-30T15:25:06.315233+0000 mgr.y (mgr.14526) 671 : cluster 0 pgmap v1134: 204 pgs: 204 active+clean; 4.4 MiB data, 757 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:25:07.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:07 smithi172 bash[23680]: cluster 2024-03-30T15:25:06.469213+0000 mon.a (mon.0) 3488 : cluster 0 osdmap e707: 8 total, 8 up, 8 in 2024-03-30T15:25:07.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:07 smithi172 bash[23680]: cluster 2024-03-30T15:25:07.324697+0000 mon.a (mon.0) 3489 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:25:07.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:07 smithi172 bash[23680]: audit 2024-03-30T15:25:07.330737+0000 mon.c (mon.2) 521 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:25:08.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:08 smithi072 bash[21573]: audit 2024-03-30T15:25:07.507554+0000 mon.a (mon.0) 3490 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:25:08.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:08 smithi072 bash[21573]: audit 2024-03-30T15:25:07.508565+0000 mon.a (mon.0) 3491 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-138"}]: dispatch 2024-03-30T15:25:08.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:08 smithi072 bash[28946]: audit 2024-03-30T15:25:07.507554+0000 mon.a (mon.0) 3490 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:25:08.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:08 smithi072 bash[28946]: audit 2024-03-30T15:25:07.508565+0000 mon.a (mon.0) 3491 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-138"}]: dispatch 2024-03-30T15:25:08.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:08 smithi172 bash[23680]: audit 2024-03-30T15:25:07.507554+0000 mon.a (mon.0) 3490 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:25:08.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:08 smithi172 bash[23680]: audit 2024-03-30T15:25:07.508565+0000 mon.a (mon.0) 3491 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-138"}]: dispatch 2024-03-30T15:25:10.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:09 smithi172 bash[23680]: cluster 2024-03-30T15:25:08.316065+0000 mgr.y (mgr.14526) 672 : cluster 0 pgmap v1136: 204 pgs: 204 active+clean; 4.4 MiB data, 757 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T15:25:10.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:09 smithi172 bash[23680]: audit 2024-03-30T15:25:08.503269+0000 mon.a (mon.0) 3492 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-138"}]': finished 2024-03-30T15:25:10.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:09 smithi172 bash[23680]: cluster 2024-03-30T15:25:08.512027+0000 mon.a (mon.0) 3493 : cluster 0 osdmap e708: 8 total, 8 up, 8 in 2024-03-30T15:25:10.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:09 smithi072 bash[21573]: cluster 2024-03-30T15:25:08.316065+0000 mgr.y (mgr.14526) 672 : cluster 0 pgmap v1136: 204 pgs: 204 active+clean; 4.4 MiB data, 757 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T15:25:10.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:09 smithi072 bash[21573]: audit 2024-03-30T15:25:08.503269+0000 mon.a (mon.0) 3492 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-138"}]': finished 2024-03-30T15:25:10.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:09 smithi072 bash[21573]: cluster 2024-03-30T15:25:08.512027+0000 mon.a (mon.0) 3493 : cluster 0 osdmap e708: 8 total, 8 up, 8 in 2024-03-30T15:25:10.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:09 smithi072 bash[28946]: cluster 2024-03-30T15:25:08.316065+0000 mgr.y (mgr.14526) 672 : cluster 0 pgmap v1136: 204 pgs: 204 active+clean; 4.4 MiB data, 757 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T15:25:10.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:09 smithi072 bash[28946]: audit 2024-03-30T15:25:08.503269+0000 mon.a (mon.0) 3492 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-138"}]': finished 2024-03-30T15:25:10.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:09 smithi072 bash[28946]: cluster 2024-03-30T15:25:08.512027+0000 mon.a (mon.0) 3493 : cluster 0 osdmap e708: 8 total, 8 up, 8 in 2024-03-30T15:25:11.419 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:25:11 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:25:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:25:11.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:10 smithi072 bash[21573]: cluster 2024-03-30T15:25:09.512986+0000 mon.a (mon.0) 3494 : cluster 0 osdmap e709: 8 total, 8 up, 8 in 2024-03-30T15:25:11.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:10 smithi072 bash[21573]: cluster 2024-03-30T15:25:10.316838+0000 mgr.y (mgr.14526) 673 : cluster 0 pgmap v1139: 172 pgs: 172 active+clean; 4.4 MiB data, 757 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T15:25:11.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:10 smithi072 bash[21573]: cluster 2024-03-30T15:25:10.518595+0000 mon.a (mon.0) 3495 : cluster 0 osdmap e710: 8 total, 8 up, 8 in 2024-03-30T15:25:11.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:10 smithi072 bash[21573]: audit 2024-03-30T15:25:10.526289+0000 mon.a (mon.0) 3496 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:25:11.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:10 smithi072 bash[28946]: cluster 2024-03-30T15:25:09.512986+0000 mon.a (mon.0) 3494 : cluster 0 osdmap e709: 8 total, 8 up, 8 in 2024-03-30T15:25:11.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:10 smithi072 bash[28946]: cluster 2024-03-30T15:25:10.316838+0000 mgr.y (mgr.14526) 673 : cluster 0 pgmap v1139: 172 pgs: 172 active+clean; 4.4 MiB data, 757 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T15:25:11.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:10 smithi072 bash[28946]: cluster 2024-03-30T15:25:10.518595+0000 mon.a (mon.0) 3495 : cluster 0 osdmap e710: 8 total, 8 up, 8 in 2024-03-30T15:25:11.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:10 smithi072 bash[28946]: audit 2024-03-30T15:25:10.526289+0000 mon.a (mon.0) 3496 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:25:11.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:10 smithi172 bash[23680]: cluster 2024-03-30T15:25:09.512986+0000 mon.a (mon.0) 3494 : cluster 0 osdmap e709: 8 total, 8 up, 8 in 2024-03-30T15:25:11.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:10 smithi172 bash[23680]: cluster 2024-03-30T15:25:10.316838+0000 mgr.y (mgr.14526) 673 : cluster 0 pgmap v1139: 172 pgs: 172 active+clean; 4.4 MiB data, 757 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T15:25:11.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:10 smithi172 bash[23680]: cluster 2024-03-30T15:25:10.518595+0000 mon.a (mon.0) 3495 : cluster 0 osdmap e710: 8 total, 8 up, 8 in 2024-03-30T15:25:11.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:10 smithi172 bash[23680]: audit 2024-03-30T15:25:10.526289+0000 mon.a (mon.0) 3496 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:25:11.968 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:25:11 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:25:12.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:12 smithi072 bash[21573]: audit 2024-03-30T15:25:11.512884+0000 mon.a (mon.0) 3497 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-140","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:25:12.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:12 smithi072 bash[21573]: cluster 2024-03-30T15:25:11.522205+0000 mon.a (mon.0) 3498 : cluster 0 osdmap e711: 8 total, 8 up, 8 in 2024-03-30T15:25:12.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:12 smithi072 bash[21573]: audit 2024-03-30T15:25:11.525661+0000 mon.a (mon.0) 3499 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-140", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:25:12.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:12 smithi072 bash[21573]: audit 2024-03-30T15:25:11.675911+0000 mgr.y (mgr.14526) 674 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:25:12.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:12 smithi072 bash[28946]: audit 2024-03-30T15:25:11.512884+0000 mon.a (mon.0) 3497 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-140","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:25:12.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:12 smithi072 bash[28946]: cluster 2024-03-30T15:25:11.522205+0000 mon.a (mon.0) 3498 : cluster 0 osdmap e711: 8 total, 8 up, 8 in 2024-03-30T15:25:12.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:12 smithi072 bash[28946]: audit 2024-03-30T15:25:11.525661+0000 mon.a (mon.0) 3499 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-140", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:25:12.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:12 smithi072 bash[28946]: audit 2024-03-30T15:25:11.675911+0000 mgr.y (mgr.14526) 674 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:25:12.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:12 smithi172 bash[23680]: audit 2024-03-30T15:25:11.512884+0000 mon.a (mon.0) 3497 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-140","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:25:12.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:12 smithi172 bash[23680]: cluster 2024-03-30T15:25:11.522205+0000 mon.a (mon.0) 3498 : cluster 0 osdmap e711: 8 total, 8 up, 8 in 2024-03-30T15:25:12.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:12 smithi172 bash[23680]: audit 2024-03-30T15:25:11.525661+0000 mon.a (mon.0) 3499 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-140", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:25:12.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:12 smithi172 bash[23680]: audit 2024-03-30T15:25:11.675911+0000 mgr.y (mgr.14526) 674 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:25:13.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:13 smithi072 bash[21573]: cluster 2024-03-30T15:25:12.317670+0000 mgr.y (mgr.14526) 675 : cluster 0 pgmap v1142: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 757 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:25:13.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:13 smithi072 bash[21573]: audit 2024-03-30T15:25:12.522138+0000 mon.a (mon.0) 3500 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-140", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:25:13.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:13 smithi072 bash[21573]: cluster 2024-03-30T15:25:12.530868+0000 mon.a (mon.0) 3501 : cluster 0 osdmap e712: 8 total, 8 up, 8 in 2024-03-30T15:25:13.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:13 smithi072 bash[21573]: audit 2024-03-30T15:25:12.532341+0000 mon.a (mon.0) 3502 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-140","var": "hit_set_count","val": "3"}]: dispatch 2024-03-30T15:25:13.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:13 smithi072 bash[28946]: cluster 2024-03-30T15:25:12.317670+0000 mgr.y (mgr.14526) 675 : cluster 0 pgmap v1142: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 757 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:25:13.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:13 smithi072 bash[28946]: audit 2024-03-30T15:25:12.522138+0000 mon.a (mon.0) 3500 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-140", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:25:13.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:13 smithi072 bash[28946]: cluster 2024-03-30T15:25:12.530868+0000 mon.a (mon.0) 3501 : cluster 0 osdmap e712: 8 total, 8 up, 8 in 2024-03-30T15:25:13.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:13 smithi072 bash[28946]: audit 2024-03-30T15:25:12.532341+0000 mon.a (mon.0) 3502 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-140","var": "hit_set_count","val": "3"}]: dispatch 2024-03-30T15:25:13.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:13 smithi172 bash[23680]: cluster 2024-03-30T15:25:12.317670+0000 mgr.y (mgr.14526) 675 : cluster 0 pgmap v1142: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 757 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:25:13.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:13 smithi172 bash[23680]: audit 2024-03-30T15:25:12.522138+0000 mon.a (mon.0) 3500 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-140", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:25:13.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:13 smithi172 bash[23680]: cluster 2024-03-30T15:25:12.530868+0000 mon.a (mon.0) 3501 : cluster 0 osdmap e712: 8 total, 8 up, 8 in 2024-03-30T15:25:13.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:13 smithi172 bash[23680]: audit 2024-03-30T15:25:12.532341+0000 mon.a (mon.0) 3502 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-140","var": "hit_set_count","val": "3"}]: dispatch 2024-03-30T15:25:14.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:14 smithi072 bash[21573]: audit 2024-03-30T15:25:13.524911+0000 mon.a (mon.0) 3503 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-140","var": "hit_set_count","val": "3"}]': finished 2024-03-30T15:25:14.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:14 smithi072 bash[21573]: cluster 2024-03-30T15:25:13.532256+0000 mon.a (mon.0) 3504 : cluster 0 osdmap e713: 8 total, 8 up, 8 in 2024-03-30T15:25:14.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:14 smithi072 bash[21573]: audit 2024-03-30T15:25:13.534144+0000 mon.a (mon.0) 3505 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-140","var": "hit_set_period","val": "3"}]: dispatch 2024-03-30T15:25:14.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:14 smithi072 bash[21573]: audit 2024-03-30T15:25:14.527724+0000 mon.a (mon.0) 3506 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-140","var": "hit_set_period","val": "3"}]': finished 2024-03-30T15:25:14.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:14 smithi072 bash[21573]: cluster 2024-03-30T15:25:14.534246+0000 mon.a (mon.0) 3507 : cluster 0 osdmap e714: 8 total, 8 up, 8 in 2024-03-30T15:25:14.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:14 smithi072 bash[21573]: audit 2024-03-30T15:25:14.534833+0000 mon.a (mon.0) 3508 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-140","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-30T15:25:14.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:14 smithi072 bash[28946]: audit 2024-03-30T15:25:13.524911+0000 mon.a (mon.0) 3503 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-140","var": "hit_set_count","val": "3"}]': finished 2024-03-30T15:25:14.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:14 smithi072 bash[28946]: cluster 2024-03-30T15:25:13.532256+0000 mon.a (mon.0) 3504 : cluster 0 osdmap e713: 8 total, 8 up, 8 in 2024-03-30T15:25:14.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:14 smithi072 bash[28946]: audit 2024-03-30T15:25:13.534144+0000 mon.a (mon.0) 3505 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-140","var": "hit_set_period","val": "3"}]: dispatch 2024-03-30T15:25:14.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:14 smithi072 bash[28946]: audit 2024-03-30T15:25:14.527724+0000 mon.a (mon.0) 3506 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-140","var": "hit_set_period","val": "3"}]': finished 2024-03-30T15:25:14.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:14 smithi072 bash[28946]: cluster 2024-03-30T15:25:14.534246+0000 mon.a (mon.0) 3507 : cluster 0 osdmap e714: 8 total, 8 up, 8 in 2024-03-30T15:25:14.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:14 smithi072 bash[28946]: audit 2024-03-30T15:25:14.534833+0000 mon.a (mon.0) 3508 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-140","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-30T15:25:14.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:14 smithi172 bash[23680]: audit 2024-03-30T15:25:13.524911+0000 mon.a (mon.0) 3503 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-140","var": "hit_set_count","val": "3"}]': finished 2024-03-30T15:25:14.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:14 smithi172 bash[23680]: cluster 2024-03-30T15:25:13.532256+0000 mon.a (mon.0) 3504 : cluster 0 osdmap e713: 8 total, 8 up, 8 in 2024-03-30T15:25:14.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:14 smithi172 bash[23680]: audit 2024-03-30T15:25:13.534144+0000 mon.a (mon.0) 3505 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-140","var": "hit_set_period","val": "3"}]: dispatch 2024-03-30T15:25:14.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:14 smithi172 bash[23680]: audit 2024-03-30T15:25:14.527724+0000 mon.a (mon.0) 3506 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-140","var": "hit_set_period","val": "3"}]': finished 2024-03-30T15:25:14.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:14 smithi172 bash[23680]: cluster 2024-03-30T15:25:14.534246+0000 mon.a (mon.0) 3507 : cluster 0 osdmap e714: 8 total, 8 up, 8 in 2024-03-30T15:25:14.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:14 smithi172 bash[23680]: audit 2024-03-30T15:25:14.534833+0000 mon.a (mon.0) 3508 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-140","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-30T15:25:15.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:15 smithi072 bash[21573]: cluster 2024-03-30T15:25:14.318481+0000 mgr.y (mgr.14526) 676 : cluster 0 pgmap v1145: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 757 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:25:15.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:15 smithi072 bash[21573]: audit 2024-03-30T15:25:15.530349+0000 mon.a (mon.0) 3509 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-140","var": "hit_set_type","val": "bloom"}]': finished 2024-03-30T15:25:15.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:15 smithi072 bash[21573]: cluster 2024-03-30T15:25:15.536600+0000 mon.a (mon.0) 3510 : cluster 0 osdmap e715: 8 total, 8 up, 8 in 2024-03-30T15:25:15.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:15 smithi072 bash[21573]: audit 2024-03-30T15:25:15.540423+0000 mon.a (mon.0) 3511 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-140","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-03-30T15:25:15.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:15 smithi072 bash[28946]: cluster 2024-03-30T15:25:14.318481+0000 mgr.y (mgr.14526) 676 : cluster 0 pgmap v1145: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 757 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:25:15.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:15 smithi072 bash[28946]: audit 2024-03-30T15:25:15.530349+0000 mon.a (mon.0) 3509 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-140","var": "hit_set_type","val": "bloom"}]': finished 2024-03-30T15:25:15.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:15 smithi072 bash[28946]: cluster 2024-03-30T15:25:15.536600+0000 mon.a (mon.0) 3510 : cluster 0 osdmap e715: 8 total, 8 up, 8 in 2024-03-30T15:25:15.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:15 smithi072 bash[28946]: audit 2024-03-30T15:25:15.540423+0000 mon.a (mon.0) 3511 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-140","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-03-30T15:25:15.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:15 smithi172 bash[23680]: cluster 2024-03-30T15:25:14.318481+0000 mgr.y (mgr.14526) 676 : cluster 0 pgmap v1145: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 757 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:25:15.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:15 smithi172 bash[23680]: audit 2024-03-30T15:25:15.530349+0000 mon.a (mon.0) 3509 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-140","var": "hit_set_type","val": "bloom"}]': finished 2024-03-30T15:25:15.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:15 smithi172 bash[23680]: cluster 2024-03-30T15:25:15.536600+0000 mon.a (mon.0) 3510 : cluster 0 osdmap e715: 8 total, 8 up, 8 in 2024-03-30T15:25:15.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:15 smithi172 bash[23680]: audit 2024-03-30T15:25:15.540423+0000 mon.a (mon.0) 3511 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-140","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-03-30T15:25:17.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:17 smithi072 bash[21573]: cluster 2024-03-30T15:25:16.320588+0000 mgr.y (mgr.14526) 677 : cluster 0 pgmap v1148: 204 pgs: 204 active+clean; 4.4 MiB data, 762 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:25:17.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:17 smithi072 bash[21573]: audit 2024-03-30T15:25:16.534338+0000 mon.a (mon.0) 3512 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-140","var": "hit_set_fpp","val": ".01"}]': finished 2024-03-30T15:25:17.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:17 smithi072 bash[21573]: cluster 2024-03-30T15:25:16.541455+0000 mon.a (mon.0) 3513 : cluster 0 osdmap e716: 8 total, 8 up, 8 in 2024-03-30T15:25:17.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:17 smithi072 bash[28946]: cluster 2024-03-30T15:25:16.320588+0000 mgr.y (mgr.14526) 677 : cluster 0 pgmap v1148: 204 pgs: 204 active+clean; 4.4 MiB data, 762 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:25:17.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:17 smithi072 bash[28946]: audit 2024-03-30T15:25:16.534338+0000 mon.a (mon.0) 3512 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-140","var": "hit_set_fpp","val": ".01"}]': finished 2024-03-30T15:25:17.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:17 smithi072 bash[28946]: cluster 2024-03-30T15:25:16.541455+0000 mon.a (mon.0) 3513 : cluster 0 osdmap e716: 8 total, 8 up, 8 in 2024-03-30T15:25:17.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:17 smithi172 bash[23680]: cluster 2024-03-30T15:25:16.320588+0000 mgr.y (mgr.14526) 677 : cluster 0 pgmap v1148: 204 pgs: 204 active+clean; 4.4 MiB data, 762 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:25:17.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:17 smithi172 bash[23680]: audit 2024-03-30T15:25:16.534338+0000 mon.a (mon.0) 3512 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-140","var": "hit_set_fpp","val": ".01"}]': finished 2024-03-30T15:25:17.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:17 smithi172 bash[23680]: cluster 2024-03-30T15:25:16.541455+0000 mon.a (mon.0) 3513 : cluster 0 osdmap e716: 8 total, 8 up, 8 in 2024-03-30T15:25:19.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:19 smithi072 bash[21573]: cluster 2024-03-30T15:25:18.321420+0000 mgr.y (mgr.14526) 678 : cluster 0 pgmap v1150: 204 pgs: 204 active+clean; 4.4 MiB data, 762 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T15:25:19.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:19 smithi072 bash[28946]: cluster 2024-03-30T15:25:18.321420+0000 mgr.y (mgr.14526) 678 : cluster 0 pgmap v1150: 204 pgs: 204 active+clean; 4.4 MiB data, 762 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T15:25:19.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:19 smithi172 bash[23680]: cluster 2024-03-30T15:25:18.321420+0000 mgr.y (mgr.14526) 678 : cluster 0 pgmap v1150: 204 pgs: 204 active+clean; 4.4 MiB data, 762 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T15:25:21.419 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:25:21 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:25:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:25:21.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:21 smithi072 bash[21573]: cluster 2024-03-30T15:25:20.322401+0000 mgr.y (mgr.14526) 679 : cluster 0 pgmap v1151: 204 pgs: 204 active+clean; 4.4 MiB data, 762 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:25:21.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:21 smithi072 bash[28946]: cluster 2024-03-30T15:25:20.322401+0000 mgr.y (mgr.14526) 679 : cluster 0 pgmap v1151: 204 pgs: 204 active+clean; 4.4 MiB data, 762 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:25:21.968 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:25:21 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:25:21.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:21 smithi172 bash[23680]: cluster 2024-03-30T15:25:20.322401+0000 mgr.y (mgr.14526) 679 : cluster 0 pgmap v1151: 204 pgs: 204 active+clean; 4.4 MiB data, 762 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:25:22.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:22 smithi072 bash[21573]: audit 2024-03-30T15:25:21.687398+0000 mgr.y (mgr.14526) 680 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:25:22.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:22 smithi072 bash[21573]: audit 2024-03-30T15:25:22.363618+0000 mon.c (mon.2) 522 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:25:22.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:22 smithi072 bash[28946]: audit 2024-03-30T15:25:21.687398+0000 mgr.y (mgr.14526) 680 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:25:22.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:22 smithi072 bash[28946]: audit 2024-03-30T15:25:22.363618+0000 mon.c (mon.2) 522 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:25:22.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:22 smithi172 bash[23680]: audit 2024-03-30T15:25:21.687398+0000 mgr.y (mgr.14526) 680 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:25:22.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:22 smithi172 bash[23680]: audit 2024-03-30T15:25:22.363618+0000 mon.c (mon.2) 522 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:25:23.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:23 smithi072 bash[21573]: cluster 2024-03-30T15:25:22.324588+0000 mgr.y (mgr.14526) 681 : cluster 0 pgmap v1152: 204 pgs: 204 active+clean; 4.4 MiB data, 762 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 5.3 KiB/s wr, 2 op/s 2024-03-30T15:25:23.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:23 smithi072 bash[28946]: cluster 2024-03-30T15:25:22.324588+0000 mgr.y (mgr.14526) 681 : cluster 0 pgmap v1152: 204 pgs: 204 active+clean; 4.4 MiB data, 762 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 5.3 KiB/s wr, 2 op/s 2024-03-30T15:25:23.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:23 smithi172 bash[23680]: cluster 2024-03-30T15:25:22.324588+0000 mgr.y (mgr.14526) 681 : cluster 0 pgmap v1152: 204 pgs: 204 active+clean; 4.4 MiB data, 762 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 5.3 KiB/s wr, 2 op/s 2024-03-30T15:25:25.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:25 smithi072 bash[21573]: cluster 2024-03-30T15:25:24.325583+0000 mgr.y (mgr.14526) 682 : cluster 0 pgmap v1153: 204 pgs: 204 active+clean; 4.4 MiB data, 762 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 4.7 KiB/s wr, 1 op/s 2024-03-30T15:25:25.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:25 smithi072 bash[21573]: audit 2024-03-30T15:25:25.305261+0000 mon.c (mon.2) 523 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:25:25.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:25 smithi072 bash[28946]: cluster 2024-03-30T15:25:24.325583+0000 mgr.y (mgr.14526) 682 : cluster 0 pgmap v1153: 204 pgs: 204 active+clean; 4.4 MiB data, 762 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 4.7 KiB/s wr, 1 op/s 2024-03-30T15:25:25.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:25 smithi072 bash[28946]: audit 2024-03-30T15:25:25.305261+0000 mon.c (mon.2) 523 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:25:25.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:25 smithi172 bash[23680]: cluster 2024-03-30T15:25:24.325583+0000 mgr.y (mgr.14526) 682 : cluster 0 pgmap v1153: 204 pgs: 204 active+clean; 4.4 MiB data, 762 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 4.7 KiB/s wr, 1 op/s 2024-03-30T15:25:25.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:25 smithi172 bash[23680]: audit 2024-03-30T15:25:25.305261+0000 mon.c (mon.2) 523 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:25:26.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:26 smithi072 bash[21573]: audit 2024-03-30T15:25:26.031642+0000 mon.c (mon.2) 524 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:25:26.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:26 smithi072 bash[21573]: audit 2024-03-30T15:25:26.033327+0000 mon.c (mon.2) 525 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:25:26.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:26 smithi072 bash[21573]: audit 2024-03-30T15:25:26.045344+0000 mon.a (mon.0) 3514 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:25:26.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:26 smithi072 bash[28946]: audit 2024-03-30T15:25:26.031642+0000 mon.c (mon.2) 524 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:25:26.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:26 smithi072 bash[28946]: audit 2024-03-30T15:25:26.033327+0000 mon.c (mon.2) 525 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:25:26.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:26 smithi072 bash[28946]: audit 2024-03-30T15:25:26.045344+0000 mon.a (mon.0) 3514 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:25:26.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:26 smithi172 bash[23680]: audit 2024-03-30T15:25:26.031642+0000 mon.c (mon.2) 524 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:25:26.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:26 smithi172 bash[23680]: audit 2024-03-30T15:25:26.033327+0000 mon.c (mon.2) 525 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:25:26.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:26 smithi172 bash[23680]: audit 2024-03-30T15:25:26.045344+0000 mon.a (mon.0) 3514 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:25:27.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:27 smithi072 bash[21573]: cluster 2024-03-30T15:25:26.327744+0000 mgr.y (mgr.14526) 683 : cluster 0 pgmap v1154: 204 pgs: 204 active+clean; 4.5 MiB data, 762 MiB used, 714 GiB / 715 GiB avail; 920 B/s rd, 8.3 KiB/s wr, 2 op/s 2024-03-30T15:25:27.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:27 smithi072 bash[28946]: cluster 2024-03-30T15:25:26.327744+0000 mgr.y (mgr.14526) 683 : cluster 0 pgmap v1154: 204 pgs: 204 active+clean; 4.5 MiB data, 762 MiB used, 714 GiB / 715 GiB avail; 920 B/s rd, 8.3 KiB/s wr, 2 op/s 2024-03-30T15:25:27.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:27 smithi172 bash[23680]: cluster 2024-03-30T15:25:26.327744+0000 mgr.y (mgr.14526) 683 : cluster 0 pgmap v1154: 204 pgs: 204 active+clean; 4.5 MiB data, 762 MiB used, 714 GiB / 715 GiB avail; 920 B/s rd, 8.3 KiB/s wr, 2 op/s 2024-03-30T15:25:29.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:29 smithi072 bash[21573]: cluster 2024-03-30T15:25:28.328560+0000 mgr.y (mgr.14526) 684 : cluster 0 pgmap v1155: 204 pgs: 204 active+clean; 4.5 MiB data, 762 MiB used, 714 GiB / 715 GiB avail; 781 B/s rd, 7.0 KiB/s wr, 1 op/s 2024-03-30T15:25:29.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:29 smithi072 bash[21573]: audit 2024-03-30T15:25:28.635318+0000 mon.a (mon.0) 3515 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:25:29.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:29 smithi072 bash[21573]: audit 2024-03-30T15:25:28.636286+0000 mon.a (mon.0) 3516 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-140"}]: dispatch 2024-03-30T15:25:29.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:29 smithi072 bash[28946]: cluster 2024-03-30T15:25:28.328560+0000 mgr.y (mgr.14526) 684 : cluster 0 pgmap v1155: 204 pgs: 204 active+clean; 4.5 MiB data, 762 MiB used, 714 GiB / 715 GiB avail; 781 B/s rd, 7.0 KiB/s wr, 1 op/s 2024-03-30T15:25:29.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:29 smithi072 bash[28946]: audit 2024-03-30T15:25:28.635318+0000 mon.a (mon.0) 3515 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:25:29.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:29 smithi072 bash[28946]: audit 2024-03-30T15:25:28.636286+0000 mon.a (mon.0) 3516 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-140"}]: dispatch 2024-03-30T15:25:29.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:29 smithi172 bash[23680]: cluster 2024-03-30T15:25:28.328560+0000 mgr.y (mgr.14526) 684 : cluster 0 pgmap v1155: 204 pgs: 204 active+clean; 4.5 MiB data, 762 MiB used, 714 GiB / 715 GiB avail; 781 B/s rd, 7.0 KiB/s wr, 1 op/s 2024-03-30T15:25:29.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:29 smithi172 bash[23680]: audit 2024-03-30T15:25:28.635318+0000 mon.a (mon.0) 3515 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:25:29.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:29 smithi172 bash[23680]: audit 2024-03-30T15:25:28.636286+0000 mon.a (mon.0) 3516 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-140"}]: dispatch 2024-03-30T15:25:30.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:30 smithi072 bash[21573]: audit 2024-03-30T15:25:29.574693+0000 mon.a (mon.0) 3517 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-140"}]': finished 2024-03-30T15:25:30.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:30 smithi072 bash[21573]: cluster 2024-03-30T15:25:29.582889+0000 mon.a (mon.0) 3518 : cluster 0 osdmap e717: 8 total, 8 up, 8 in 2024-03-30T15:25:30.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:30 smithi072 bash[28946]: audit 2024-03-30T15:25:29.574693+0000 mon.a (mon.0) 3517 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-140"}]': finished 2024-03-30T15:25:30.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:30 smithi072 bash[28946]: cluster 2024-03-30T15:25:29.582889+0000 mon.a (mon.0) 3518 : cluster 0 osdmap e717: 8 total, 8 up, 8 in 2024-03-30T15:25:30.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:30 smithi172 bash[23680]: audit 2024-03-30T15:25:29.574693+0000 mon.a (mon.0) 3517 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-140"}]': finished 2024-03-30T15:25:30.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:30 smithi172 bash[23680]: cluster 2024-03-30T15:25:29.582889+0000 mon.a (mon.0) 3518 : cluster 0 osdmap e717: 8 total, 8 up, 8 in 2024-03-30T15:25:31.419 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:25:31 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:25:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:25:31.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:31 smithi072 bash[28946]: cluster 2024-03-30T15:25:30.329402+0000 mgr.y (mgr.14526) 685 : cluster 0 pgmap v1157: 204 pgs: 204 active+clean; 4.5 MiB data, 762 MiB used, 714 GiB / 715 GiB avail; 920 B/s rd, 8.3 KiB/s wr, 2 op/s 2024-03-30T15:25:31.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:31 smithi072 bash[28946]: cluster 2024-03-30T15:25:30.587651+0000 mon.a (mon.0) 3519 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:25:31.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:31 smithi072 bash[28946]: cluster 2024-03-30T15:25:30.605207+0000 mon.a (mon.0) 3520 : cluster 0 osdmap e718: 8 total, 8 up, 8 in 2024-03-30T15:25:31.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:31 smithi072 bash[21573]: cluster 2024-03-30T15:25:30.329402+0000 mgr.y (mgr.14526) 685 : cluster 0 pgmap v1157: 204 pgs: 204 active+clean; 4.5 MiB data, 762 MiB used, 714 GiB / 715 GiB avail; 920 B/s rd, 8.3 KiB/s wr, 2 op/s 2024-03-30T15:25:31.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:31 smithi072 bash[21573]: cluster 2024-03-30T15:25:30.587651+0000 mon.a (mon.0) 3519 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:25:31.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:31 smithi072 bash[21573]: cluster 2024-03-30T15:25:30.605207+0000 mon.a (mon.0) 3520 : cluster 0 osdmap e718: 8 total, 8 up, 8 in 2024-03-30T15:25:31.968 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:25:31 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:25:31.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:31 smithi172 bash[23680]: cluster 2024-03-30T15:25:30.329402+0000 mgr.y (mgr.14526) 685 : cluster 0 pgmap v1157: 204 pgs: 204 active+clean; 4.5 MiB data, 762 MiB used, 714 GiB / 715 GiB avail; 920 B/s rd, 8.3 KiB/s wr, 2 op/s 2024-03-30T15:25:31.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:31 smithi172 bash[23680]: cluster 2024-03-30T15:25:30.587651+0000 mon.a (mon.0) 3519 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:25:31.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:31 smithi172 bash[23680]: cluster 2024-03-30T15:25:30.605207+0000 mon.a (mon.0) 3520 : cluster 0 osdmap e718: 8 total, 8 up, 8 in 2024-03-30T15:25:32.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:32 smithi072 bash[21573]: cluster 2024-03-30T15:25:31.619701+0000 mon.a (mon.0) 3521 : cluster 0 osdmap e719: 8 total, 8 up, 8 in 2024-03-30T15:25:32.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:32 smithi072 bash[21573]: audit 2024-03-30T15:25:31.622682+0000 mon.a (mon.0) 3522 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:25:32.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:32 smithi072 bash[21573]: audit 2024-03-30T15:25:31.697525+0000 mgr.y (mgr.14526) 686 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:25:32.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:32 smithi072 bash[28946]: cluster 2024-03-30T15:25:31.619701+0000 mon.a (mon.0) 3521 : cluster 0 osdmap e719: 8 total, 8 up, 8 in 2024-03-30T15:25:32.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:32 smithi072 bash[28946]: audit 2024-03-30T15:25:31.622682+0000 mon.a (mon.0) 3522 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:25:32.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:32 smithi072 bash[28946]: audit 2024-03-30T15:25:31.697525+0000 mgr.y (mgr.14526) 686 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:25:32.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:32 smithi172 bash[23680]: cluster 2024-03-30T15:25:31.619701+0000 mon.a (mon.0) 3521 : cluster 0 osdmap e719: 8 total, 8 up, 8 in 2024-03-30T15:25:32.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:32 smithi172 bash[23680]: audit 2024-03-30T15:25:31.622682+0000 mon.a (mon.0) 3522 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:25:32.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:32 smithi172 bash[23680]: audit 2024-03-30T15:25:31.697525+0000 mgr.y (mgr.14526) 686 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:25:33.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:33 smithi072 bash[28946]: cluster 2024-03-30T15:25:32.330169+0000 mgr.y (mgr.14526) 687 : cluster 0 pgmap v1160: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 762 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:25:33.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:33 smithi072 bash[28946]: audit 2024-03-30T15:25:32.621254+0000 mon.a (mon.0) 3523 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-142","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:25:33.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:33 smithi072 bash[28946]: cluster 2024-03-30T15:25:32.630034+0000 mon.a (mon.0) 3524 : cluster 0 osdmap e720: 8 total, 8 up, 8 in 2024-03-30T15:25:33.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:33 smithi072 bash[28946]: audit 2024-03-30T15:25:32.738634+0000 mon.a (mon.0) 3525 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-142", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:25:33.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:33 smithi072 bash[21573]: cluster 2024-03-30T15:25:32.330169+0000 mgr.y (mgr.14526) 687 : cluster 0 pgmap v1160: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 762 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:25:33.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:33 smithi072 bash[21573]: audit 2024-03-30T15:25:32.621254+0000 mon.a (mon.0) 3523 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-142","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:25:33.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:33 smithi072 bash[21573]: cluster 2024-03-30T15:25:32.630034+0000 mon.a (mon.0) 3524 : cluster 0 osdmap e720: 8 total, 8 up, 8 in 2024-03-30T15:25:33.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:33 smithi072 bash[21573]: audit 2024-03-30T15:25:32.738634+0000 mon.a (mon.0) 3525 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-142", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:25:33.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:33 smithi172 bash[23680]: cluster 2024-03-30T15:25:32.330169+0000 mgr.y (mgr.14526) 687 : cluster 0 pgmap v1160: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 762 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:25:33.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:33 smithi172 bash[23680]: audit 2024-03-30T15:25:32.621254+0000 mon.a (mon.0) 3523 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-142","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:25:33.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:33 smithi172 bash[23680]: cluster 2024-03-30T15:25:32.630034+0000 mon.a (mon.0) 3524 : cluster 0 osdmap e720: 8 total, 8 up, 8 in 2024-03-30T15:25:33.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:33 smithi172 bash[23680]: audit 2024-03-30T15:25:32.738634+0000 mon.a (mon.0) 3525 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-142", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:25:34.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:34 smithi072 bash[28946]: audit 2024-03-30T15:25:33.632899+0000 mon.a (mon.0) 3526 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-142", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:25:34.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:34 smithi072 bash[28946]: cluster 2024-03-30T15:25:33.640059+0000 mon.a (mon.0) 3527 : cluster 0 osdmap e721: 8 total, 8 up, 8 in 2024-03-30T15:25:34.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:34 smithi072 bash[28946]: audit 2024-03-30T15:25:33.641646+0000 mon.a (mon.0) 3528 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-142"}]: dispatch 2024-03-30T15:25:34.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:34 smithi072 bash[21573]: audit 2024-03-30T15:25:33.632899+0000 mon.a (mon.0) 3526 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-142", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:25:34.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:34 smithi072 bash[21573]: cluster 2024-03-30T15:25:33.640059+0000 mon.a (mon.0) 3527 : cluster 0 osdmap e721: 8 total, 8 up, 8 in 2024-03-30T15:25:34.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:34 smithi072 bash[21573]: audit 2024-03-30T15:25:33.641646+0000 mon.a (mon.0) 3528 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-142"}]: dispatch 2024-03-30T15:25:34.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:34 smithi172 bash[23680]: audit 2024-03-30T15:25:33.632899+0000 mon.a (mon.0) 3526 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-142", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:25:34.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:34 smithi172 bash[23680]: cluster 2024-03-30T15:25:33.640059+0000 mon.a (mon.0) 3527 : cluster 0 osdmap e721: 8 total, 8 up, 8 in 2024-03-30T15:25:34.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:34 smithi172 bash[23680]: audit 2024-03-30T15:25:33.641646+0000 mon.a (mon.0) 3528 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-142"}]: dispatch 2024-03-30T15:25:35.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:35 smithi072 bash[21573]: cluster 2024-03-30T15:25:34.331094+0000 mgr.y (mgr.14526) 688 : cluster 0 pgmap v1163: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 762 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:25:35.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:35 smithi072 bash[21573]: audit 2024-03-30T15:25:34.644524+0000 mon.a (mon.0) 3529 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-142"}]': finished 2024-03-30T15:25:35.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:35 smithi072 bash[21573]: cluster 2024-03-30T15:25:34.654733+0000 mon.a (mon.0) 3530 : cluster 0 osdmap e722: 8 total, 8 up, 8 in 2024-03-30T15:25:35.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:35 smithi072 bash[21573]: audit 2024-03-30T15:25:34.657565+0000 mon.a (mon.0) 3531 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-142", "mode": "writeback"}]: dispatch 2024-03-30T15:25:35.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:35 smithi072 bash[28946]: cluster 2024-03-30T15:25:34.331094+0000 mgr.y (mgr.14526) 688 : cluster 0 pgmap v1163: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 762 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:25:35.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:35 smithi072 bash[28946]: audit 2024-03-30T15:25:34.644524+0000 mon.a (mon.0) 3529 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-142"}]': finished 2024-03-30T15:25:35.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:35 smithi072 bash[28946]: cluster 2024-03-30T15:25:34.654733+0000 mon.a (mon.0) 3530 : cluster 0 osdmap e722: 8 total, 8 up, 8 in 2024-03-30T15:25:35.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:35 smithi072 bash[28946]: audit 2024-03-30T15:25:34.657565+0000 mon.a (mon.0) 3531 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-142", "mode": "writeback"}]: dispatch 2024-03-30T15:25:35.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:35 smithi172 bash[23680]: cluster 2024-03-30T15:25:34.331094+0000 mgr.y (mgr.14526) 688 : cluster 0 pgmap v1163: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 762 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:25:35.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:35 smithi172 bash[23680]: audit 2024-03-30T15:25:34.644524+0000 mon.a (mon.0) 3529 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-142"}]': finished 2024-03-30T15:25:35.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:35 smithi172 bash[23680]: cluster 2024-03-30T15:25:34.654733+0000 mon.a (mon.0) 3530 : cluster 0 osdmap e722: 8 total, 8 up, 8 in 2024-03-30T15:25:35.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:35 smithi172 bash[23680]: audit 2024-03-30T15:25:34.657565+0000 mon.a (mon.0) 3531 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-142", "mode": "writeback"}]: dispatch 2024-03-30T15:25:36.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:36 smithi072 bash[21573]: cluster 2024-03-30T15:25:35.644901+0000 mon.a (mon.0) 3532 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:25:36.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:36 smithi072 bash[21573]: audit 2024-03-30T15:25:35.647436+0000 mon.a (mon.0) 3533 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-142", "mode": "writeback"}]': finished 2024-03-30T15:25:36.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:36 smithi072 bash[21573]: cluster 2024-03-30T15:25:35.655060+0000 mon.a (mon.0) 3534 : cluster 0 osdmap e723: 8 total, 8 up, 8 in 2024-03-30T15:25:36.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:36 smithi072 bash[21573]: audit 2024-03-30T15:25:35.658408+0000 mon.a (mon.0) 3535 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-142","var": "hit_set_count","val": "2"}]: dispatch 2024-03-30T15:25:36.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:36 smithi072 bash[21573]: audit 2024-03-30T15:25:36.650174+0000 mon.a (mon.0) 3536 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-142","var": "hit_set_count","val": "2"}]': finished 2024-03-30T15:25:36.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:36 smithi072 bash[21573]: cluster 2024-03-30T15:25:36.657188+0000 mon.a (mon.0) 3537 : cluster 0 osdmap e724: 8 total, 8 up, 8 in 2024-03-30T15:25:36.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:36 smithi072 bash[21573]: audit 2024-03-30T15:25:36.658422+0000 mon.a (mon.0) 3538 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-142","var": "hit_set_period","val": "600"}]: dispatch 2024-03-30T15:25:36.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:36 smithi072 bash[28946]: cluster 2024-03-30T15:25:35.644901+0000 mon.a (mon.0) 3532 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:25:36.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:36 smithi072 bash[28946]: audit 2024-03-30T15:25:35.647436+0000 mon.a (mon.0) 3533 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-142", "mode": "writeback"}]': finished 2024-03-30T15:25:36.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:36 smithi072 bash[28946]: cluster 2024-03-30T15:25:35.655060+0000 mon.a (mon.0) 3534 : cluster 0 osdmap e723: 8 total, 8 up, 8 in 2024-03-30T15:25:36.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:36 smithi072 bash[28946]: audit 2024-03-30T15:25:35.658408+0000 mon.a (mon.0) 3535 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-142","var": "hit_set_count","val": "2"}]: dispatch 2024-03-30T15:25:36.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:36 smithi072 bash[28946]: audit 2024-03-30T15:25:36.650174+0000 mon.a (mon.0) 3536 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-142","var": "hit_set_count","val": "2"}]': finished 2024-03-30T15:25:36.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:36 smithi072 bash[28946]: cluster 2024-03-30T15:25:36.657188+0000 mon.a (mon.0) 3537 : cluster 0 osdmap e724: 8 total, 8 up, 8 in 2024-03-30T15:25:36.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:36 smithi072 bash[28946]: audit 2024-03-30T15:25:36.658422+0000 mon.a (mon.0) 3538 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-142","var": "hit_set_period","val": "600"}]: dispatch 2024-03-30T15:25:36.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:36 smithi172 bash[23680]: cluster 2024-03-30T15:25:35.644901+0000 mon.a (mon.0) 3532 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:25:36.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:36 smithi172 bash[23680]: audit 2024-03-30T15:25:35.647436+0000 mon.a (mon.0) 3533 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-142", "mode": "writeback"}]': finished 2024-03-30T15:25:36.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:36 smithi172 bash[23680]: cluster 2024-03-30T15:25:35.655060+0000 mon.a (mon.0) 3534 : cluster 0 osdmap e723: 8 total, 8 up, 8 in 2024-03-30T15:25:36.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:36 smithi172 bash[23680]: audit 2024-03-30T15:25:35.658408+0000 mon.a (mon.0) 3535 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-142","var": "hit_set_count","val": "2"}]: dispatch 2024-03-30T15:25:36.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:36 smithi172 bash[23680]: audit 2024-03-30T15:25:36.650174+0000 mon.a (mon.0) 3536 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-142","var": "hit_set_count","val": "2"}]': finished 2024-03-30T15:25:36.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:36 smithi172 bash[23680]: cluster 2024-03-30T15:25:36.657188+0000 mon.a (mon.0) 3537 : cluster 0 osdmap e724: 8 total, 8 up, 8 in 2024-03-30T15:25:36.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:36 smithi172 bash[23680]: audit 2024-03-30T15:25:36.658422+0000 mon.a (mon.0) 3538 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-142","var": "hit_set_period","val": "600"}]: dispatch 2024-03-30T15:25:37.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:37 smithi172 bash[23680]: cluster 2024-03-30T15:25:36.333459+0000 mgr.y (mgr.14526) 689 : cluster 0 pgmap v1166: 204 pgs: 204 active+clean; 4.4 MiB data, 781 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-03-30T15:25:37.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:37 smithi172 bash[23680]: cluster 2024-03-30T15:25:37.334470+0000 mon.a (mon.0) 3539 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:25:37.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:37 smithi172 bash[23680]: audit 2024-03-30T15:25:37.403240+0000 mon.a (mon.0) 3540 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:25:37.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:37 smithi172 bash[23680]: audit 2024-03-30T15:25:37.406174+0000 mon.c (mon.2) 526 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:25:37.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:37 smithi172 bash[23680]: audit 2024-03-30T15:25:37.654884+0000 mon.a (mon.0) 3541 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-142","var": "hit_set_period","val": "600"}]': finished 2024-03-30T15:25:37.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:37 smithi172 bash[23680]: cluster 2024-03-30T15:25:37.665241+0000 mon.a (mon.0) 3542 : cluster 0 osdmap e725: 8 total, 8 up, 8 in 2024-03-30T15:25:37.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:37 smithi172 bash[23680]: audit 2024-03-30T15:25:37.666797+0000 mon.a (mon.0) 3543 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-142","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-30T15:25:38.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:37 smithi072 bash[21573]: cluster 2024-03-30T15:25:36.333459+0000 mgr.y (mgr.14526) 689 : cluster 0 pgmap v1166: 204 pgs: 204 active+clean; 4.4 MiB data, 781 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-03-30T15:25:38.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:37 smithi072 bash[21573]: cluster 2024-03-30T15:25:37.334470+0000 mon.a (mon.0) 3539 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:25:38.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:37 smithi072 bash[21573]: audit 2024-03-30T15:25:37.403240+0000 mon.a (mon.0) 3540 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:25:38.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:37 smithi072 bash[21573]: audit 2024-03-30T15:25:37.406174+0000 mon.c (mon.2) 526 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:25:38.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:37 smithi072 bash[21573]: audit 2024-03-30T15:25:37.654884+0000 mon.a (mon.0) 3541 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-142","var": "hit_set_period","val": "600"}]': finished 2024-03-30T15:25:38.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:37 smithi072 bash[21573]: cluster 2024-03-30T15:25:37.665241+0000 mon.a (mon.0) 3542 : cluster 0 osdmap e725: 8 total, 8 up, 8 in 2024-03-30T15:25:38.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:37 smithi072 bash[21573]: audit 2024-03-30T15:25:37.666797+0000 mon.a (mon.0) 3543 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-142","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-30T15:25:38.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:37 smithi072 bash[28946]: cluster 2024-03-30T15:25:36.333459+0000 mgr.y (mgr.14526) 689 : cluster 0 pgmap v1166: 204 pgs: 204 active+clean; 4.4 MiB data, 781 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-03-30T15:25:38.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:37 smithi072 bash[28946]: cluster 2024-03-30T15:25:37.334470+0000 mon.a (mon.0) 3539 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:25:38.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:37 smithi072 bash[28946]: audit 2024-03-30T15:25:37.403240+0000 mon.a (mon.0) 3540 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:25:38.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:37 smithi072 bash[28946]: audit 2024-03-30T15:25:37.406174+0000 mon.c (mon.2) 526 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:25:38.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:37 smithi072 bash[28946]: audit 2024-03-30T15:25:37.654884+0000 mon.a (mon.0) 3541 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-142","var": "hit_set_period","val": "600"}]': finished 2024-03-30T15:25:38.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:37 smithi072 bash[28946]: cluster 2024-03-30T15:25:37.665241+0000 mon.a (mon.0) 3542 : cluster 0 osdmap e725: 8 total, 8 up, 8 in 2024-03-30T15:25:38.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:37 smithi072 bash[28946]: audit 2024-03-30T15:25:37.666797+0000 mon.a (mon.0) 3543 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-142","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-30T15:25:38.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:38 smithi172 bash[23680]: cluster 2024-03-30T15:25:38.655267+0000 mon.a (mon.0) 3544 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:25:38.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:38 smithi172 bash[23680]: audit 2024-03-30T15:25:38.657543+0000 mon.a (mon.0) 3545 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-142","var": "hit_set_type","val": "bloom"}]': finished 2024-03-30T15:25:38.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:38 smithi172 bash[23680]: cluster 2024-03-30T15:25:38.665768+0000 mon.a (mon.0) 3546 : cluster 0 osdmap e726: 8 total, 8 up, 8 in 2024-03-30T15:25:38.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:38 smithi172 bash[23680]: audit 2024-03-30T15:25:38.666885+0000 mon.a (mon.0) 3547 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-142","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-03-30T15:25:39.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:38 smithi072 bash[21573]: cluster 2024-03-30T15:25:38.655267+0000 mon.a (mon.0) 3544 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:25:39.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:38 smithi072 bash[21573]: audit 2024-03-30T15:25:38.657543+0000 mon.a (mon.0) 3545 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-142","var": "hit_set_type","val": "bloom"}]': finished 2024-03-30T15:25:39.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:38 smithi072 bash[21573]: cluster 2024-03-30T15:25:38.665768+0000 mon.a (mon.0) 3546 : cluster 0 osdmap e726: 8 total, 8 up, 8 in 2024-03-30T15:25:39.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:38 smithi072 bash[21573]: audit 2024-03-30T15:25:38.666885+0000 mon.a (mon.0) 3547 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-142","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-03-30T15:25:39.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:38 smithi072 bash[28946]: cluster 2024-03-30T15:25:38.655267+0000 mon.a (mon.0) 3544 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:25:39.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:38 smithi072 bash[28946]: audit 2024-03-30T15:25:38.657543+0000 mon.a (mon.0) 3545 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-142","var": "hit_set_type","val": "bloom"}]': finished 2024-03-30T15:25:39.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:38 smithi072 bash[28946]: cluster 2024-03-30T15:25:38.665768+0000 mon.a (mon.0) 3546 : cluster 0 osdmap e726: 8 total, 8 up, 8 in 2024-03-30T15:25:39.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:38 smithi072 bash[28946]: audit 2024-03-30T15:25:38.666885+0000 mon.a (mon.0) 3547 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-142","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-03-30T15:25:39.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:39 smithi172 bash[23680]: cluster 2024-03-30T15:25:38.334308+0000 mgr.y (mgr.14526) 690 : cluster 0 pgmap v1169: 204 pgs: 204 active+clean; 4.4 MiB data, 781 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-03-30T15:25:39.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:39 smithi172 bash[23680]: audit 2024-03-30T15:25:39.660113+0000 mon.a (mon.0) 3548 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-142","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-03-30T15:25:39.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:39 smithi172 bash[23680]: cluster 2024-03-30T15:25:39.666896+0000 mon.a (mon.0) 3549 : cluster 0 osdmap e727: 8 total, 8 up, 8 in 2024-03-30T15:25:39.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:39 smithi172 bash[23680]: audit 2024-03-30T15:25:39.673775+0000 mon.a (mon.0) 3550 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-142","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-03-30T15:25:40.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:39 smithi072 bash[21573]: cluster 2024-03-30T15:25:38.334308+0000 mgr.y (mgr.14526) 690 : cluster 0 pgmap v1169: 204 pgs: 204 active+clean; 4.4 MiB data, 781 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-03-30T15:25:40.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:39 smithi072 bash[21573]: audit 2024-03-30T15:25:39.660113+0000 mon.a (mon.0) 3548 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-142","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-03-30T15:25:40.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:39 smithi072 bash[21573]: cluster 2024-03-30T15:25:39.666896+0000 mon.a (mon.0) 3549 : cluster 0 osdmap e727: 8 total, 8 up, 8 in 2024-03-30T15:25:40.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:39 smithi072 bash[21573]: audit 2024-03-30T15:25:39.673775+0000 mon.a (mon.0) 3550 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-142","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-03-30T15:25:40.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:39 smithi072 bash[28946]: cluster 2024-03-30T15:25:38.334308+0000 mgr.y (mgr.14526) 690 : cluster 0 pgmap v1169: 204 pgs: 204 active+clean; 4.4 MiB data, 781 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-03-30T15:25:40.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:39 smithi072 bash[28946]: audit 2024-03-30T15:25:39.660113+0000 mon.a (mon.0) 3548 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-142","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-03-30T15:25:40.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:39 smithi072 bash[28946]: cluster 2024-03-30T15:25:39.666896+0000 mon.a (mon.0) 3549 : cluster 0 osdmap e727: 8 total, 8 up, 8 in 2024-03-30T15:25:40.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:39 smithi072 bash[28946]: audit 2024-03-30T15:25:39.673775+0000 mon.a (mon.0) 3550 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-142","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-03-30T15:25:41.419 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:25:41 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:25:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:25:41.968 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:25:41 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:25:41.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:41 smithi172 bash[23680]: cluster 2024-03-30T15:25:40.335111+0000 mgr.y (mgr.14526) 691 : cluster 0 pgmap v1172: 204 pgs: 204 active+clean; 4.4 MiB data, 781 MiB used, 714 GiB / 715 GiB avail 2024-03-30T15:25:41.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:41 smithi172 bash[23680]: audit 2024-03-30T15:25:40.663567+0000 mon.a (mon.0) 3551 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-142","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-03-30T15:25:41.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:41 smithi172 bash[23680]: cluster 2024-03-30T15:25:40.673574+0000 mon.a (mon.0) 3552 : cluster 0 osdmap e728: 8 total, 8 up, 8 in 2024-03-30T15:25:41.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:41 smithi172 bash[23680]: audit 2024-03-30T15:25:40.675945+0000 mon.a (mon.0) 3553 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-142","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-03-30T15:25:42.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:41 smithi072 bash[21573]: cluster 2024-03-30T15:25:40.335111+0000 mgr.y (mgr.14526) 691 : cluster 0 pgmap v1172: 204 pgs: 204 active+clean; 4.4 MiB data, 781 MiB used, 714 GiB / 715 GiB avail 2024-03-30T15:25:42.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:41 smithi072 bash[21573]: audit 2024-03-30T15:25:40.663567+0000 mon.a (mon.0) 3551 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-142","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-03-30T15:25:42.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:41 smithi072 bash[21573]: cluster 2024-03-30T15:25:40.673574+0000 mon.a (mon.0) 3552 : cluster 0 osdmap e728: 8 total, 8 up, 8 in 2024-03-30T15:25:42.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:41 smithi072 bash[21573]: audit 2024-03-30T15:25:40.675945+0000 mon.a (mon.0) 3553 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-142","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-03-30T15:25:42.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:41 smithi072 bash[28946]: cluster 2024-03-30T15:25:40.335111+0000 mgr.y (mgr.14526) 691 : cluster 0 pgmap v1172: 204 pgs: 204 active+clean; 4.4 MiB data, 781 MiB used, 714 GiB / 715 GiB avail 2024-03-30T15:25:42.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:41 smithi072 bash[28946]: audit 2024-03-30T15:25:40.663567+0000 mon.a (mon.0) 3551 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-142","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-03-30T15:25:42.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:41 smithi072 bash[28946]: cluster 2024-03-30T15:25:40.673574+0000 mon.a (mon.0) 3552 : cluster 0 osdmap e728: 8 total, 8 up, 8 in 2024-03-30T15:25:42.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:41 smithi072 bash[28946]: audit 2024-03-30T15:25:40.675945+0000 mon.a (mon.0) 3553 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-142","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-03-30T15:25:42.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:42 smithi172 bash[23680]: audit 2024-03-30T15:25:41.666099+0000 mon.a (mon.0) 3554 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-142","var": "hit_set_search_last_n","val": "1"}]': finished 2024-03-30T15:25:42.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:42 smithi172 bash[23680]: cluster 2024-03-30T15:25:41.672797+0000 mon.a (mon.0) 3555 : cluster 0 osdmap e729: 8 total, 8 up, 8 in 2024-03-30T15:25:42.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:42 smithi172 bash[23680]: audit 2024-03-30T15:25:41.705308+0000 mgr.y (mgr.14526) 692 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:25:42.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:42 smithi172 bash[23680]: audit 2024-03-30T15:25:41.773536+0000 mon.a (mon.0) 3556 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:25:43.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:42 smithi072 bash[21573]: audit 2024-03-30T15:25:41.666099+0000 mon.a (mon.0) 3554 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-142","var": "hit_set_search_last_n","val": "1"}]': finished 2024-03-30T15:25:43.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:42 smithi072 bash[21573]: cluster 2024-03-30T15:25:41.672797+0000 mon.a (mon.0) 3555 : cluster 0 osdmap e729: 8 total, 8 up, 8 in 2024-03-30T15:25:43.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:42 smithi072 bash[21573]: audit 2024-03-30T15:25:41.705308+0000 mgr.y (mgr.14526) 692 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:25:43.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:42 smithi072 bash[21573]: audit 2024-03-30T15:25:41.773536+0000 mon.a (mon.0) 3556 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:25:43.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:42 smithi072 bash[28946]: audit 2024-03-30T15:25:41.666099+0000 mon.a (mon.0) 3554 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-142","var": "hit_set_search_last_n","val": "1"}]': finished 2024-03-30T15:25:43.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:42 smithi072 bash[28946]: cluster 2024-03-30T15:25:41.672797+0000 mon.a (mon.0) 3555 : cluster 0 osdmap e729: 8 total, 8 up, 8 in 2024-03-30T15:25:43.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:42 smithi072 bash[28946]: audit 2024-03-30T15:25:41.705308+0000 mgr.y (mgr.14526) 692 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:25:43.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:42 smithi072 bash[28946]: audit 2024-03-30T15:25:41.773536+0000 mon.a (mon.0) 3556 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:25:43.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:43 smithi172 bash[23680]: cluster 2024-03-30T15:25:42.336011+0000 mgr.y (mgr.14526) 693 : cluster 0 pgmap v1175: 204 pgs: 204 active+clean; 4.4 MiB data, 781 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:25:43.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:43 smithi172 bash[23680]: audit 2024-03-30T15:25:42.689249+0000 mon.a (mon.0) 3557 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:25:43.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:43 smithi172 bash[23680]: cluster 2024-03-30T15:25:42.700405+0000 mon.a (mon.0) 3558 : cluster 0 osdmap e730: 8 total, 8 up, 8 in 2024-03-30T15:25:43.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:43 smithi172 bash[23680]: audit 2024-03-30T15:25:42.702322+0000 mon.a (mon.0) 3559 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-142"}]: dispatch 2024-03-30T15:25:44.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:43 smithi072 bash[28946]: cluster 2024-03-30T15:25:42.336011+0000 mgr.y (mgr.14526) 693 : cluster 0 pgmap v1175: 204 pgs: 204 active+clean; 4.4 MiB data, 781 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:25:44.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:43 smithi072 bash[28946]: audit 2024-03-30T15:25:42.689249+0000 mon.a (mon.0) 3557 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:25:44.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:43 smithi072 bash[28946]: cluster 2024-03-30T15:25:42.700405+0000 mon.a (mon.0) 3558 : cluster 0 osdmap e730: 8 total, 8 up, 8 in 2024-03-30T15:25:44.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:43 smithi072 bash[28946]: audit 2024-03-30T15:25:42.702322+0000 mon.a (mon.0) 3559 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-142"}]: dispatch 2024-03-30T15:25:44.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:43 smithi072 bash[21573]: cluster 2024-03-30T15:25:42.336011+0000 mgr.y (mgr.14526) 693 : cluster 0 pgmap v1175: 204 pgs: 204 active+clean; 4.4 MiB data, 781 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:25:44.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:43 smithi072 bash[21573]: audit 2024-03-30T15:25:42.689249+0000 mon.a (mon.0) 3557 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:25:44.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:43 smithi072 bash[21573]: cluster 2024-03-30T15:25:42.700405+0000 mon.a (mon.0) 3558 : cluster 0 osdmap e730: 8 total, 8 up, 8 in 2024-03-30T15:25:44.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:43 smithi072 bash[21573]: audit 2024-03-30T15:25:42.702322+0000 mon.a (mon.0) 3559 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-142"}]: dispatch 2024-03-30T15:25:45.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:44 smithi072 bash[28946]: audit 2024-03-30T15:25:43.691798+0000 mon.a (mon.0) 3560 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-142"}]': finished 2024-03-30T15:25:45.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:44 smithi072 bash[28946]: cluster 2024-03-30T15:25:43.701372+0000 mon.a (mon.0) 3561 : cluster 0 osdmap e731: 8 total, 8 up, 8 in 2024-03-30T15:25:45.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:44 smithi072 bash[28946]: audit 2024-03-30T15:25:43.764059+0000 mon.a (mon.0) 3562 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:25:45.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:44 smithi072 bash[28946]: audit 2024-03-30T15:25:43.764954+0000 mon.a (mon.0) 3563 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-142"}]: dispatch 2024-03-30T15:25:45.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:44 smithi072 bash[21573]: audit 2024-03-30T15:25:43.691798+0000 mon.a (mon.0) 3560 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-142"}]': finished 2024-03-30T15:25:45.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:44 smithi072 bash[21573]: cluster 2024-03-30T15:25:43.701372+0000 mon.a (mon.0) 3561 : cluster 0 osdmap e731: 8 total, 8 up, 8 in 2024-03-30T15:25:45.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:44 smithi072 bash[21573]: audit 2024-03-30T15:25:43.764059+0000 mon.a (mon.0) 3562 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:25:45.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:44 smithi072 bash[21573]: audit 2024-03-30T15:25:43.764954+0000 mon.a (mon.0) 3563 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-142"}]: dispatch 2024-03-30T15:25:45.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:44 smithi172 bash[23680]: audit 2024-03-30T15:25:43.691798+0000 mon.a (mon.0) 3560 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-142"}]': finished 2024-03-30T15:25:45.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:44 smithi172 bash[23680]: cluster 2024-03-30T15:25:43.701372+0000 mon.a (mon.0) 3561 : cluster 0 osdmap e731: 8 total, 8 up, 8 in 2024-03-30T15:25:45.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:44 smithi172 bash[23680]: audit 2024-03-30T15:25:43.764059+0000 mon.a (mon.0) 3562 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:25:45.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:44 smithi172 bash[23680]: audit 2024-03-30T15:25:43.764954+0000 mon.a (mon.0) 3563 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-142"}]: dispatch 2024-03-30T15:25:46.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:45 smithi072 bash[28946]: cluster 2024-03-30T15:25:44.336867+0000 mgr.y (mgr.14526) 694 : cluster 0 pgmap v1178: 204 pgs: 204 active+clean; 4.4 MiB data, 781 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:25:46.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:45 smithi072 bash[28946]: cluster 2024-03-30T15:25:44.705884+0000 mon.a (mon.0) 3564 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:25:46.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:45 smithi072 bash[28946]: cluster 2024-03-30T15:25:44.728277+0000 mon.a (mon.0) 3565 : cluster 0 osdmap e732: 8 total, 8 up, 8 in 2024-03-30T15:25:46.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:45 smithi072 bash[21573]: cluster 2024-03-30T15:25:44.336867+0000 mgr.y (mgr.14526) 694 : cluster 0 pgmap v1178: 204 pgs: 204 active+clean; 4.4 MiB data, 781 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:25:46.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:45 smithi072 bash[21573]: cluster 2024-03-30T15:25:44.705884+0000 mon.a (mon.0) 3564 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:25:46.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:45 smithi072 bash[21573]: cluster 2024-03-30T15:25:44.728277+0000 mon.a (mon.0) 3565 : cluster 0 osdmap e732: 8 total, 8 up, 8 in 2024-03-30T15:25:46.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:45 smithi172 bash[23680]: cluster 2024-03-30T15:25:44.336867+0000 mgr.y (mgr.14526) 694 : cluster 0 pgmap v1178: 204 pgs: 204 active+clean; 4.4 MiB data, 781 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:25:46.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:45 smithi172 bash[23680]: cluster 2024-03-30T15:25:44.705884+0000 mon.a (mon.0) 3564 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:25:46.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:45 smithi172 bash[23680]: cluster 2024-03-30T15:25:44.728277+0000 mon.a (mon.0) 3565 : cluster 0 osdmap e732: 8 total, 8 up, 8 in 2024-03-30T15:25:47.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:46 smithi072 bash[28946]: cluster 2024-03-30T15:25:45.733315+0000 mon.a (mon.0) 3566 : cluster 0 osdmap e733: 8 total, 8 up, 8 in 2024-03-30T15:25:47.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:46 smithi072 bash[28946]: audit 2024-03-30T15:25:45.748065+0000 mon.a (mon.0) 3567 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:25:47.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:46 smithi072 bash[21573]: cluster 2024-03-30T15:25:45.733315+0000 mon.a (mon.0) 3566 : cluster 0 osdmap e733: 8 total, 8 up, 8 in 2024-03-30T15:25:47.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:46 smithi072 bash[21573]: audit 2024-03-30T15:25:45.748065+0000 mon.a (mon.0) 3567 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:25:47.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:46 smithi172 bash[23680]: cluster 2024-03-30T15:25:45.733315+0000 mon.a (mon.0) 3566 : cluster 0 osdmap e733: 8 total, 8 up, 8 in 2024-03-30T15:25:47.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:46 smithi172 bash[23680]: audit 2024-03-30T15:25:45.748065+0000 mon.a (mon.0) 3567 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:25:48.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:47 smithi072 bash[21573]: cluster 2024-03-30T15:25:46.338787+0000 mgr.y (mgr.14526) 695 : cluster 0 pgmap v1181: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 782 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-03-30T15:25:48.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:47 smithi072 bash[21573]: audit 2024-03-30T15:25:46.726501+0000 mon.a (mon.0) 3568 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-144","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:25:48.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:47 smithi072 bash[21573]: cluster 2024-03-30T15:25:46.733979+0000 mon.a (mon.0) 3569 : cluster 0 osdmap e734: 8 total, 8 up, 8 in 2024-03-30T15:25:48.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:47 smithi072 bash[21573]: audit 2024-03-30T15:25:46.788774+0000 mon.a (mon.0) 3570 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-144", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:25:48.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:47 smithi072 bash[21573]: audit 2024-03-30T15:25:47.750090+0000 mon.a (mon.0) 3571 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-144", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:25:48.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:47 smithi072 bash[21573]: cluster 2024-03-30T15:25:47.757778+0000 mon.a (mon.0) 3572 : cluster 0 osdmap e735: 8 total, 8 up, 8 in 2024-03-30T15:25:48.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:47 smithi072 bash[21573]: audit 2024-03-30T15:25:47.760921+0000 mon.a (mon.0) 3573 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-144"}]: dispatch 2024-03-30T15:25:48.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:47 smithi072 bash[28946]: cluster 2024-03-30T15:25:46.338787+0000 mgr.y (mgr.14526) 695 : cluster 0 pgmap v1181: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 782 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-03-30T15:25:48.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:47 smithi072 bash[28946]: audit 2024-03-30T15:25:46.726501+0000 mon.a (mon.0) 3568 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-144","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:25:48.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:47 smithi072 bash[28946]: cluster 2024-03-30T15:25:46.733979+0000 mon.a (mon.0) 3569 : cluster 0 osdmap e734: 8 total, 8 up, 8 in 2024-03-30T15:25:48.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:47 smithi072 bash[28946]: audit 2024-03-30T15:25:46.788774+0000 mon.a (mon.0) 3570 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-144", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:25:48.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:47 smithi072 bash[28946]: audit 2024-03-30T15:25:47.750090+0000 mon.a (mon.0) 3571 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-144", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:25:48.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:47 smithi072 bash[28946]: cluster 2024-03-30T15:25:47.757778+0000 mon.a (mon.0) 3572 : cluster 0 osdmap e735: 8 total, 8 up, 8 in 2024-03-30T15:25:48.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:47 smithi072 bash[28946]: audit 2024-03-30T15:25:47.760921+0000 mon.a (mon.0) 3573 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-144"}]: dispatch 2024-03-30T15:25:48.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:47 smithi172 bash[23680]: cluster 2024-03-30T15:25:46.338787+0000 mgr.y (mgr.14526) 695 : cluster 0 pgmap v1181: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 782 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-03-30T15:25:48.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:47 smithi172 bash[23680]: audit 2024-03-30T15:25:46.726501+0000 mon.a (mon.0) 3568 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-144","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:25:48.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:47 smithi172 bash[23680]: cluster 2024-03-30T15:25:46.733979+0000 mon.a (mon.0) 3569 : cluster 0 osdmap e734: 8 total, 8 up, 8 in 2024-03-30T15:25:48.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:47 smithi172 bash[23680]: audit 2024-03-30T15:25:46.788774+0000 mon.a (mon.0) 3570 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-144", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:25:48.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:47 smithi172 bash[23680]: audit 2024-03-30T15:25:47.750090+0000 mon.a (mon.0) 3571 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-144", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:25:48.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:47 smithi172 bash[23680]: cluster 2024-03-30T15:25:47.757778+0000 mon.a (mon.0) 3572 : cluster 0 osdmap e735: 8 total, 8 up, 8 in 2024-03-30T15:25:48.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:47 smithi172 bash[23680]: audit 2024-03-30T15:25:47.760921+0000 mon.a (mon.0) 3573 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-144"}]: dispatch 2024-03-30T15:25:50.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:49 smithi072 bash[21573]: cluster 2024-03-30T15:25:48.339707+0000 mgr.y (mgr.14526) 696 : cluster 0 pgmap v1184: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 782 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-03-30T15:25:50.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:49 smithi072 bash[21573]: audit 2024-03-30T15:25:48.753014+0000 mon.a (mon.0) 3574 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-144"}]': finished 2024-03-30T15:25:50.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:49 smithi072 bash[21573]: cluster 2024-03-30T15:25:48.760277+0000 mon.a (mon.0) 3575 : cluster 0 osdmap e736: 8 total, 8 up, 8 in 2024-03-30T15:25:50.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:49 smithi072 bash[21573]: audit 2024-03-30T15:25:48.762220+0000 mon.a (mon.0) 3576 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-144", "mode": "readproxy"}]: dispatch 2024-03-30T15:25:50.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:49 smithi072 bash[28946]: cluster 2024-03-30T15:25:48.339707+0000 mgr.y (mgr.14526) 696 : cluster 0 pgmap v1184: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 782 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-03-30T15:25:50.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:49 smithi072 bash[28946]: audit 2024-03-30T15:25:48.753014+0000 mon.a (mon.0) 3574 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-144"}]': finished 2024-03-30T15:25:50.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:49 smithi072 bash[28946]: cluster 2024-03-30T15:25:48.760277+0000 mon.a (mon.0) 3575 : cluster 0 osdmap e736: 8 total, 8 up, 8 in 2024-03-30T15:25:50.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:49 smithi072 bash[28946]: audit 2024-03-30T15:25:48.762220+0000 mon.a (mon.0) 3576 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-144", "mode": "readproxy"}]: dispatch 2024-03-30T15:25:50.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:49 smithi172 bash[23680]: cluster 2024-03-30T15:25:48.339707+0000 mgr.y (mgr.14526) 696 : cluster 0 pgmap v1184: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 782 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-03-30T15:25:50.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:49 smithi172 bash[23680]: audit 2024-03-30T15:25:48.753014+0000 mon.a (mon.0) 3574 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-144"}]': finished 2024-03-30T15:25:50.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:49 smithi172 bash[23680]: cluster 2024-03-30T15:25:48.760277+0000 mon.a (mon.0) 3575 : cluster 0 osdmap e736: 8 total, 8 up, 8 in 2024-03-30T15:25:50.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:49 smithi172 bash[23680]: audit 2024-03-30T15:25:48.762220+0000 mon.a (mon.0) 3576 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-144", "mode": "readproxy"}]: dispatch 2024-03-30T15:25:51.033 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:50 smithi072 bash[21573]: cluster 2024-03-30T15:25:49.753293+0000 mon.a (mon.0) 3577 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:25:51.033 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:50 smithi072 bash[21573]: audit 2024-03-30T15:25:49.755771+0000 mon.a (mon.0) 3578 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-144", "mode": "readproxy"}]': finished 2024-03-30T15:25:51.033 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:50 smithi072 bash[21573]: cluster 2024-03-30T15:25:49.764195+0000 mon.a (mon.0) 3579 : cluster 0 osdmap e737: 8 total, 8 up, 8 in 2024-03-30T15:25:51.034 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:50 smithi072 bash[28946]: cluster 2024-03-30T15:25:49.753293+0000 mon.a (mon.0) 3577 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:25:51.034 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:50 smithi072 bash[28946]: audit 2024-03-30T15:25:49.755771+0000 mon.a (mon.0) 3578 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-144", "mode": "readproxy"}]': finished 2024-03-30T15:25:51.034 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:50 smithi072 bash[28946]: cluster 2024-03-30T15:25:49.764195+0000 mon.a (mon.0) 3579 : cluster 0 osdmap e737: 8 total, 8 up, 8 in 2024-03-30T15:25:51.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:50 smithi172 bash[23680]: cluster 2024-03-30T15:25:49.753293+0000 mon.a (mon.0) 3577 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:25:51.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:50 smithi172 bash[23680]: audit 2024-03-30T15:25:49.755771+0000 mon.a (mon.0) 3578 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-144", "mode": "readproxy"}]': finished 2024-03-30T15:25:51.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:50 smithi172 bash[23680]: cluster 2024-03-30T15:25:49.764195+0000 mon.a (mon.0) 3579 : cluster 0 osdmap e737: 8 total, 8 up, 8 in 2024-03-30T15:25:51.419 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:25:51 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:25:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:25:51.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:51 smithi172 bash[23680]: cluster 2024-03-30T15:25:50.340561+0000 mgr.y (mgr.14526) 697 : cluster 0 pgmap v1187: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 782 MiB used, 714 GiB / 715 GiB avail 2024-03-30T15:25:51.968 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:25:51 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:25:52.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:51 smithi072 bash[21573]: cluster 2024-03-30T15:25:50.340561+0000 mgr.y (mgr.14526) 697 : cluster 0 pgmap v1187: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 782 MiB used, 714 GiB / 715 GiB avail 2024-03-30T15:25:52.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:51 smithi072 bash[28946]: cluster 2024-03-30T15:25:50.340561+0000 mgr.y (mgr.14526) 697 : cluster 0 pgmap v1187: 204 pgs: 32 creating+peering, 172 active+clean; 4.4 MiB data, 782 MiB used, 714 GiB / 715 GiB avail 2024-03-30T15:25:53.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:52 smithi072 bash[21573]: audit 2024-03-30T15:25:51.716694+0000 mgr.y (mgr.14526) 698 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:25:53.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:52 smithi072 bash[21573]: cluster 2024-03-30T15:25:52.338104+0000 mon.a (mon.0) 3580 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:25:53.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:52 smithi072 bash[21573]: audit 2024-03-30T15:25:52.439392+0000 mon.c (mon.2) 527 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:25:53.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:52 smithi072 bash[28946]: audit 2024-03-30T15:25:51.716694+0000 mgr.y (mgr.14526) 698 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:25:53.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:52 smithi072 bash[28946]: cluster 2024-03-30T15:25:52.338104+0000 mon.a (mon.0) 3580 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:25:53.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:52 smithi072 bash[28946]: audit 2024-03-30T15:25:52.439392+0000 mon.c (mon.2) 527 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:25:53.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:52 smithi172 bash[23680]: audit 2024-03-30T15:25:51.716694+0000 mgr.y (mgr.14526) 698 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:25:53.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:52 smithi172 bash[23680]: cluster 2024-03-30T15:25:52.338104+0000 mon.a (mon.0) 3580 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:25:53.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:52 smithi172 bash[23680]: audit 2024-03-30T15:25:52.439392+0000 mon.c (mon.2) 527 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:25:54.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:53 smithi072 bash[21573]: cluster 2024-03-30T15:25:52.342728+0000 mgr.y (mgr.14526) 699 : cluster 0 pgmap v1188: 204 pgs: 204 active+clean; 4.4 MiB data, 787 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 182 B/s wr, 1 op/s 2024-03-30T15:25:54.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:53 smithi072 bash[28946]: cluster 2024-03-30T15:25:52.342728+0000 mgr.y (mgr.14526) 699 : cluster 0 pgmap v1188: 204 pgs: 204 active+clean; 4.4 MiB data, 787 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 182 B/s wr, 1 op/s 2024-03-30T15:25:54.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:53 smithi172 bash[23680]: cluster 2024-03-30T15:25:52.342728+0000 mgr.y (mgr.14526) 699 : cluster 0 pgmap v1188: 204 pgs: 204 active+clean; 4.4 MiB data, 787 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 182 B/s wr, 1 op/s 2024-03-30T15:25:56.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:55 smithi072 bash[21573]: cluster 2024-03-30T15:25:54.343577+0000 mgr.y (mgr.14526) 700 : cluster 0 pgmap v1189: 204 pgs: 204 active+clean; 4.4 MiB data, 787 MiB used, 714 GiB / 715 GiB avail; 932 B/s rd, 155 B/s wr, 1 op/s 2024-03-30T15:25:56.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:55 smithi072 bash[28946]: cluster 2024-03-30T15:25:54.343577+0000 mgr.y (mgr.14526) 700 : cluster 0 pgmap v1189: 204 pgs: 204 active+clean; 4.4 MiB data, 787 MiB used, 714 GiB / 715 GiB avail; 932 B/s rd, 155 B/s wr, 1 op/s 2024-03-30T15:25:56.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:55 smithi172 bash[23680]: cluster 2024-03-30T15:25:54.343577+0000 mgr.y (mgr.14526) 700 : cluster 0 pgmap v1189: 204 pgs: 204 active+clean; 4.4 MiB data, 787 MiB used, 714 GiB / 715 GiB avail; 932 B/s rd, 155 B/s wr, 1 op/s 2024-03-30T15:25:58.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:57 smithi072 bash[21573]: cluster 2024-03-30T15:25:56.345542+0000 mgr.y (mgr.14526) 701 : cluster 0 pgmap v1190: 204 pgs: 204 active+clean; 4.4 MiB data, 787 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 127 B/s wr, 1 op/s 2024-03-30T15:25:58.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:57 smithi072 bash[28946]: cluster 2024-03-30T15:25:56.345542+0000 mgr.y (mgr.14526) 701 : cluster 0 pgmap v1190: 204 pgs: 204 active+clean; 4.4 MiB data, 787 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 127 B/s wr, 1 op/s 2024-03-30T15:25:58.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:57 smithi172 bash[23680]: cluster 2024-03-30T15:25:56.345542+0000 mgr.y (mgr.14526) 701 : cluster 0 pgmap v1190: 204 pgs: 204 active+clean; 4.4 MiB data, 787 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 127 B/s wr, 1 op/s 2024-03-30T15:26:00.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:25:59 smithi072 bash[28946]: cluster 2024-03-30T15:25:58.346363+0000 mgr.y (mgr.14526) 702 : cluster 0 pgmap v1191: 204 pgs: 204 active+clean; 4.4 MiB data, 787 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 106 B/s wr, 1 op/s 2024-03-30T15:26:00.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:25:59 smithi072 bash[21573]: cluster 2024-03-30T15:25:58.346363+0000 mgr.y (mgr.14526) 702 : cluster 0 pgmap v1191: 204 pgs: 204 active+clean; 4.4 MiB data, 787 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 106 B/s wr, 1 op/s 2024-03-30T15:26:00.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:25:59 smithi172 bash[23680]: cluster 2024-03-30T15:25:58.346363+0000 mgr.y (mgr.14526) 702 : cluster 0 pgmap v1191: 204 pgs: 204 active+clean; 4.4 MiB data, 787 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 106 B/s wr, 1 op/s 2024-03-30T15:26:01.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:00 smithi072 bash[21573]: audit 2024-03-30T15:26:00.067459+0000 mon.a (mon.0) 3581 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:26:01.169 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:26:01 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:26:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:26:01.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:00 smithi072 bash[28946]: audit 2024-03-30T15:26:00.067459+0000 mon.a (mon.0) 3581 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:26:01.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:00 smithi172 bash[23680]: audit 2024-03-30T15:26:00.067459+0000 mon.a (mon.0) 3581 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:26:02.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:01 smithi072 bash[21573]: cluster 2024-03-30T15:26:00.347134+0000 mgr.y (mgr.14526) 703 : cluster 0 pgmap v1192: 204 pgs: 204 active+clean; 4.4 MiB data, 787 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 96 B/s wr, 1 op/s 2024-03-30T15:26:02.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:01 smithi072 bash[21573]: audit 2024-03-30T15:26:00.837916+0000 mon.a (mon.0) 3582 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:26:02.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:01 smithi072 bash[21573]: cluster 2024-03-30T15:26:00.848340+0000 mon.a (mon.0) 3583 : cluster 0 osdmap e738: 8 total, 8 up, 8 in 2024-03-30T15:26:02.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:01 smithi072 bash[21573]: audit 2024-03-30T15:26:00.850224+0000 mon.a (mon.0) 3584 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-144"}]: dispatch 2024-03-30T15:26:02.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:01 smithi072 bash[28946]: cluster 2024-03-30T15:26:00.347134+0000 mgr.y (mgr.14526) 703 : cluster 0 pgmap v1192: 204 pgs: 204 active+clean; 4.4 MiB data, 787 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 96 B/s wr, 1 op/s 2024-03-30T15:26:02.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:01 smithi072 bash[28946]: audit 2024-03-30T15:26:00.837916+0000 mon.a (mon.0) 3582 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:26:02.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:01 smithi072 bash[28946]: cluster 2024-03-30T15:26:00.848340+0000 mon.a (mon.0) 3583 : cluster 0 osdmap e738: 8 total, 8 up, 8 in 2024-03-30T15:26:02.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:01 smithi072 bash[28946]: audit 2024-03-30T15:26:00.850224+0000 mon.a (mon.0) 3584 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-144"}]: dispatch 2024-03-30T15:26:02.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:26:01 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:26:02.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:01 smithi172 bash[23680]: cluster 2024-03-30T15:26:00.347134+0000 mgr.y (mgr.14526) 703 : cluster 0 pgmap v1192: 204 pgs: 204 active+clean; 4.4 MiB data, 787 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 96 B/s wr, 1 op/s 2024-03-30T15:26:02.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:01 smithi172 bash[23680]: audit 2024-03-30T15:26:00.837916+0000 mon.a (mon.0) 3582 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:26:02.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:01 smithi172 bash[23680]: cluster 2024-03-30T15:26:00.848340+0000 mon.a (mon.0) 3583 : cluster 0 osdmap e738: 8 total, 8 up, 8 in 2024-03-30T15:26:02.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:01 smithi172 bash[23680]: audit 2024-03-30T15:26:00.850224+0000 mon.a (mon.0) 3584 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-144"}]: dispatch 2024-03-30T15:26:03.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:02 smithi072 bash[21573]: audit 2024-03-30T15:26:01.728162+0000 mgr.y (mgr.14526) 704 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:26:03.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:02 smithi072 bash[21573]: cluster 2024-03-30T15:26:01.838362+0000 mon.a (mon.0) 3585 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:26:03.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:02 smithi072 bash[21573]: audit 2024-03-30T15:26:01.840989+0000 mon.a (mon.0) 3586 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-144"}]': finished 2024-03-30T15:26:03.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:02 smithi072 bash[21573]: cluster 2024-03-30T15:26:01.848337+0000 mon.a (mon.0) 3587 : cluster 0 osdmap e739: 8 total, 8 up, 8 in 2024-03-30T15:26:03.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:02 smithi072 bash[21573]: audit 2024-03-30T15:26:01.914271+0000 mon.a (mon.0) 3588 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:26:03.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:02 smithi072 bash[21573]: audit 2024-03-30T15:26:01.915198+0000 mon.a (mon.0) 3589 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-144"}]: dispatch 2024-03-30T15:26:03.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:02 smithi072 bash[21573]: cluster 2024-03-30T15:26:02.347980+0000 mgr.y (mgr.14526) 705 : cluster 0 pgmap v1195: 204 pgs: 204 active+clean; 4.4 MiB data, 787 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:26:03.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:02 smithi072 bash[28946]: audit 2024-03-30T15:26:01.728162+0000 mgr.y (mgr.14526) 704 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:26:03.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:02 smithi072 bash[28946]: cluster 2024-03-30T15:26:01.838362+0000 mon.a (mon.0) 3585 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:26:03.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:02 smithi072 bash[28946]: audit 2024-03-30T15:26:01.840989+0000 mon.a (mon.0) 3586 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-144"}]': finished 2024-03-30T15:26:03.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:02 smithi072 bash[28946]: cluster 2024-03-30T15:26:01.848337+0000 mon.a (mon.0) 3587 : cluster 0 osdmap e739: 8 total, 8 up, 8 in 2024-03-30T15:26:03.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:02 smithi072 bash[28946]: audit 2024-03-30T15:26:01.914271+0000 mon.a (mon.0) 3588 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:26:03.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:02 smithi072 bash[28946]: audit 2024-03-30T15:26:01.915198+0000 mon.a (mon.0) 3589 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-144"}]: dispatch 2024-03-30T15:26:03.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:02 smithi072 bash[28946]: cluster 2024-03-30T15:26:02.347980+0000 mgr.y (mgr.14526) 705 : cluster 0 pgmap v1195: 204 pgs: 204 active+clean; 4.4 MiB data, 787 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:26:03.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:02 smithi172 bash[23680]: audit 2024-03-30T15:26:01.728162+0000 mgr.y (mgr.14526) 704 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:26:03.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:02 smithi172 bash[23680]: cluster 2024-03-30T15:26:01.838362+0000 mon.a (mon.0) 3585 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:26:03.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:02 smithi172 bash[23680]: audit 2024-03-30T15:26:01.840989+0000 mon.a (mon.0) 3586 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-144"}]': finished 2024-03-30T15:26:03.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:02 smithi172 bash[23680]: cluster 2024-03-30T15:26:01.848337+0000 mon.a (mon.0) 3587 : cluster 0 osdmap e739: 8 total, 8 up, 8 in 2024-03-30T15:26:03.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:02 smithi172 bash[23680]: audit 2024-03-30T15:26:01.914271+0000 mon.a (mon.0) 3588 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:26:03.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:02 smithi172 bash[23680]: audit 2024-03-30T15:26:01.915198+0000 mon.a (mon.0) 3589 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-144"}]: dispatch 2024-03-30T15:26:03.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:02 smithi172 bash[23680]: cluster 2024-03-30T15:26:02.347980+0000 mgr.y (mgr.14526) 705 : cluster 0 pgmap v1195: 204 pgs: 204 active+clean; 4.4 MiB data, 787 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:26:04.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:03 smithi072 bash[21573]: cluster 2024-03-30T15:26:02.855465+0000 mon.a (mon.0) 3590 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:26:04.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:03 smithi072 bash[21573]: cluster 2024-03-30T15:26:02.875893+0000 mon.a (mon.0) 3591 : cluster 0 osdmap e740: 8 total, 8 up, 8 in 2024-03-30T15:26:04.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:03 smithi072 bash[28946]: cluster 2024-03-30T15:26:02.855465+0000 mon.a (mon.0) 3590 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:26:04.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:03 smithi072 bash[28946]: cluster 2024-03-30T15:26:02.875893+0000 mon.a (mon.0) 3591 : cluster 0 osdmap e740: 8 total, 8 up, 8 in 2024-03-30T15:26:04.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:03 smithi172 bash[23680]: cluster 2024-03-30T15:26:02.855465+0000 mon.a (mon.0) 3590 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:26:04.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:03 smithi172 bash[23680]: cluster 2024-03-30T15:26:02.875893+0000 mon.a (mon.0) 3591 : cluster 0 osdmap e740: 8 total, 8 up, 8 in 2024-03-30T15:26:05.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:04 smithi072 bash[21573]: cluster 2024-03-30T15:26:03.888772+0000 mon.a (mon.0) 3592 : cluster 0 osdmap e741: 8 total, 8 up, 8 in 2024-03-30T15:26:05.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:04 smithi072 bash[21573]: audit 2024-03-30T15:26:03.896394+0000 mon.a (mon.0) 3593 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-146","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:26:05.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:04 smithi072 bash[21573]: cluster 2024-03-30T15:26:04.348820+0000 mgr.y (mgr.14526) 706 : cluster 0 pgmap v1198: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 787 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:26:05.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:04 smithi072 bash[28946]: cluster 2024-03-30T15:26:03.888772+0000 mon.a (mon.0) 3592 : cluster 0 osdmap e741: 8 total, 8 up, 8 in 2024-03-30T15:26:05.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:04 smithi072 bash[28946]: audit 2024-03-30T15:26:03.896394+0000 mon.a (mon.0) 3593 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-146","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:26:05.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:04 smithi072 bash[28946]: cluster 2024-03-30T15:26:04.348820+0000 mgr.y (mgr.14526) 706 : cluster 0 pgmap v1198: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 787 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:26:05.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:04 smithi172 bash[23680]: cluster 2024-03-30T15:26:03.888772+0000 mon.a (mon.0) 3592 : cluster 0 osdmap e741: 8 total, 8 up, 8 in 2024-03-30T15:26:05.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:04 smithi172 bash[23680]: audit 2024-03-30T15:26:03.896394+0000 mon.a (mon.0) 3593 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-146","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:26:05.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:04 smithi172 bash[23680]: cluster 2024-03-30T15:26:04.348820+0000 mgr.y (mgr.14526) 706 : cluster 0 pgmap v1198: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 787 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:26:06.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:05 smithi072 bash[21573]: audit 2024-03-30T15:26:04.892911+0000 mon.a (mon.0) 3594 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-146","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:26:06.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:05 smithi072 bash[21573]: cluster 2024-03-30T15:26:04.904108+0000 mon.a (mon.0) 3595 : cluster 0 osdmap e742: 8 total, 8 up, 8 in 2024-03-30T15:26:06.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:05 smithi072 bash[21573]: audit 2024-03-30T15:26:04.959542+0000 mon.a (mon.0) 3596 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-146", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:26:06.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:05 smithi072 bash[28946]: audit 2024-03-30T15:26:04.892911+0000 mon.a (mon.0) 3594 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-146","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:26:06.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:05 smithi072 bash[28946]: cluster 2024-03-30T15:26:04.904108+0000 mon.a (mon.0) 3595 : cluster 0 osdmap e742: 8 total, 8 up, 8 in 2024-03-30T15:26:06.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:05 smithi072 bash[28946]: audit 2024-03-30T15:26:04.959542+0000 mon.a (mon.0) 3596 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-146", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:26:06.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:05 smithi172 bash[23680]: audit 2024-03-30T15:26:04.892911+0000 mon.a (mon.0) 3594 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-146","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:26:06.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:05 smithi172 bash[23680]: cluster 2024-03-30T15:26:04.904108+0000 mon.a (mon.0) 3595 : cluster 0 osdmap e742: 8 total, 8 up, 8 in 2024-03-30T15:26:06.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:05 smithi172 bash[23680]: audit 2024-03-30T15:26:04.959542+0000 mon.a (mon.0) 3596 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-146", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:26:07.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:06 smithi072 bash[21573]: audit 2024-03-30T15:26:05.895827+0000 mon.a (mon.0) 3597 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-146", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:26:07.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:06 smithi072 bash[21573]: cluster 2024-03-30T15:26:05.902913+0000 mon.a (mon.0) 3598 : cluster 0 osdmap e743: 8 total, 8 up, 8 in 2024-03-30T15:26:07.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:06 smithi072 bash[21573]: audit 2024-03-30T15:26:05.905692+0000 mon.a (mon.0) 3599 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-146"}]: dispatch 2024-03-30T15:26:07.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:06 smithi072 bash[21573]: cluster 2024-03-30T15:26:06.350744+0000 mgr.y (mgr.14526) 707 : cluster 0 pgmap v1201: 204 pgs: 204 active+clean; 4.4 MiB data, 805 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-03-30T15:26:07.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:06 smithi072 bash[21573]: audit 2024-03-30T15:26:06.898532+0000 mon.a (mon.0) 3600 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-146"}]': finished 2024-03-30T15:26:07.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:06 smithi072 bash[21573]: cluster 2024-03-30T15:26:06.905781+0000 mon.a (mon.0) 3601 : cluster 0 osdmap e744: 8 total, 8 up, 8 in 2024-03-30T15:26:07.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:06 smithi072 bash[28946]: audit 2024-03-30T15:26:05.895827+0000 mon.a (mon.0) 3597 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-146", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:26:07.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:06 smithi072 bash[28946]: cluster 2024-03-30T15:26:05.902913+0000 mon.a (mon.0) 3598 : cluster 0 osdmap e743: 8 total, 8 up, 8 in 2024-03-30T15:26:07.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:06 smithi072 bash[28946]: audit 2024-03-30T15:26:05.905692+0000 mon.a (mon.0) 3599 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-146"}]: dispatch 2024-03-30T15:26:07.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:06 smithi072 bash[28946]: cluster 2024-03-30T15:26:06.350744+0000 mgr.y (mgr.14526) 707 : cluster 0 pgmap v1201: 204 pgs: 204 active+clean; 4.4 MiB data, 805 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-03-30T15:26:07.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:06 smithi072 bash[28946]: audit 2024-03-30T15:26:06.898532+0000 mon.a (mon.0) 3600 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-146"}]': finished 2024-03-30T15:26:07.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:06 smithi072 bash[28946]: cluster 2024-03-30T15:26:06.905781+0000 mon.a (mon.0) 3601 : cluster 0 osdmap e744: 8 total, 8 up, 8 in 2024-03-30T15:26:07.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:06 smithi172 bash[23680]: audit 2024-03-30T15:26:05.895827+0000 mon.a (mon.0) 3597 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-146", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:26:07.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:06 smithi172 bash[23680]: cluster 2024-03-30T15:26:05.902913+0000 mon.a (mon.0) 3598 : cluster 0 osdmap e743: 8 total, 8 up, 8 in 2024-03-30T15:26:07.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:06 smithi172 bash[23680]: audit 2024-03-30T15:26:05.905692+0000 mon.a (mon.0) 3599 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-146"}]: dispatch 2024-03-30T15:26:07.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:06 smithi172 bash[23680]: cluster 2024-03-30T15:26:06.350744+0000 mgr.y (mgr.14526) 707 : cluster 0 pgmap v1201: 204 pgs: 204 active+clean; 4.4 MiB data, 805 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-03-30T15:26:07.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:06 smithi172 bash[23680]: audit 2024-03-30T15:26:06.898532+0000 mon.a (mon.0) 3600 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi072-64344-111", "overlaypool": "test-rados-api-smithi072-64344-146"}]': finished 2024-03-30T15:26:07.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:06 smithi172 bash[23680]: cluster 2024-03-30T15:26:06.905781+0000 mon.a (mon.0) 3601 : cluster 0 osdmap e744: 8 total, 8 up, 8 in 2024-03-30T15:26:08.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:07 smithi072 bash[21573]: audit 2024-03-30T15:26:06.907976+0000 mon.a (mon.0) 3602 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-146", "mode": "writeback"}]: dispatch 2024-03-30T15:26:08.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:07 smithi072 bash[21573]: audit 2024-03-30T15:26:07.480658+0000 mon.a (mon.0) 3603 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:26:08.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:07 smithi072 bash[21573]: audit 2024-03-30T15:26:07.483198+0000 mon.c (mon.2) 528 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:26:08.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:07 smithi072 bash[21573]: cluster 2024-03-30T15:26:07.898953+0000 mon.a (mon.0) 3604 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:26:08.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:07 smithi072 bash[21573]: audit 2024-03-30T15:26:07.901350+0000 mon.a (mon.0) 3605 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-146", "mode": "writeback"}]': finished 2024-03-30T15:26:08.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:07 smithi072 bash[21573]: cluster 2024-03-30T15:26:07.908906+0000 mon.a (mon.0) 3606 : cluster 0 osdmap e745: 8 total, 8 up, 8 in 2024-03-30T15:26:08.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:07 smithi072 bash[28946]: audit 2024-03-30T15:26:06.907976+0000 mon.a (mon.0) 3602 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-146", "mode": "writeback"}]: dispatch 2024-03-30T15:26:08.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:07 smithi072 bash[28946]: audit 2024-03-30T15:26:07.480658+0000 mon.a (mon.0) 3603 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:26:08.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:07 smithi072 bash[28946]: audit 2024-03-30T15:26:07.483198+0000 mon.c (mon.2) 528 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:26:08.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:07 smithi072 bash[28946]: cluster 2024-03-30T15:26:07.898953+0000 mon.a (mon.0) 3604 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:26:08.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:07 smithi072 bash[28946]: audit 2024-03-30T15:26:07.901350+0000 mon.a (mon.0) 3605 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-146", "mode": "writeback"}]': finished 2024-03-30T15:26:08.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:07 smithi072 bash[28946]: cluster 2024-03-30T15:26:07.908906+0000 mon.a (mon.0) 3606 : cluster 0 osdmap e745: 8 total, 8 up, 8 in 2024-03-30T15:26:08.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:07 smithi172 bash[23680]: audit 2024-03-30T15:26:06.907976+0000 mon.a (mon.0) 3602 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-146", "mode": "writeback"}]: dispatch 2024-03-30T15:26:08.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:07 smithi172 bash[23680]: audit 2024-03-30T15:26:07.480658+0000 mon.a (mon.0) 3603 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:26:08.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:07 smithi172 bash[23680]: audit 2024-03-30T15:26:07.483198+0000 mon.c (mon.2) 528 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:26:08.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:07 smithi172 bash[23680]: cluster 2024-03-30T15:26:07.898953+0000 mon.a (mon.0) 3604 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-03-30T15:26:08.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:07 smithi172 bash[23680]: audit 2024-03-30T15:26:07.901350+0000 mon.a (mon.0) 3605 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi072-64344-146", "mode": "writeback"}]': finished 2024-03-30T15:26:08.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:07 smithi172 bash[23680]: cluster 2024-03-30T15:26:07.908906+0000 mon.a (mon.0) 3606 : cluster 0 osdmap e745: 8 total, 8 up, 8 in 2024-03-30T15:26:09.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:08 smithi072 bash[21573]: audit 2024-03-30T15:26:07.990419+0000 mon.a (mon.0) 3607 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-146","var": "hit_set_count","val": "2"}]: dispatch 2024-03-30T15:26:09.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:08 smithi072 bash[21573]: cluster 2024-03-30T15:26:08.351559+0000 mgr.y (mgr.14526) 708 : cluster 0 pgmap v1204: 204 pgs: 204 active+clean; 4.4 MiB data, 805 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-03-30T15:26:09.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:08 smithi072 bash[28946]: audit 2024-03-30T15:26:07.990419+0000 mon.a (mon.0) 3607 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-146","var": "hit_set_count","val": "2"}]: dispatch 2024-03-30T15:26:09.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:08 smithi072 bash[28946]: cluster 2024-03-30T15:26:08.351559+0000 mgr.y (mgr.14526) 708 : cluster 0 pgmap v1204: 204 pgs: 204 active+clean; 4.4 MiB data, 805 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-03-30T15:26:09.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:08 smithi172 bash[23680]: audit 2024-03-30T15:26:07.990419+0000 mon.a (mon.0) 3607 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-146","var": "hit_set_count","val": "2"}]: dispatch 2024-03-30T15:26:09.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:08 smithi172 bash[23680]: cluster 2024-03-30T15:26:08.351559+0000 mgr.y (mgr.14526) 708 : cluster 0 pgmap v1204: 204 pgs: 204 active+clean; 4.4 MiB data, 805 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-03-30T15:26:10.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:09 smithi172 bash[23680]: audit 2024-03-30T15:26:08.926066+0000 mon.a (mon.0) 3608 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-146","var": "hit_set_count","val": "2"}]': finished 2024-03-30T15:26:10.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:09 smithi172 bash[23680]: cluster 2024-03-30T15:26:08.933954+0000 mon.a (mon.0) 3609 : cluster 0 osdmap e746: 8 total, 8 up, 8 in 2024-03-30T15:26:10.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:09 smithi172 bash[23680]: audit 2024-03-30T15:26:08.935305+0000 mon.a (mon.0) 3610 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-146","var": "hit_set_period","val": "600"}]: dispatch 2024-03-30T15:26:10.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:09 smithi072 bash[21573]: audit 2024-03-30T15:26:08.926066+0000 mon.a (mon.0) 3608 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-146","var": "hit_set_count","val": "2"}]': finished 2024-03-30T15:26:10.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:09 smithi072 bash[21573]: cluster 2024-03-30T15:26:08.933954+0000 mon.a (mon.0) 3609 : cluster 0 osdmap e746: 8 total, 8 up, 8 in 2024-03-30T15:26:10.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:09 smithi072 bash[21573]: audit 2024-03-30T15:26:08.935305+0000 mon.a (mon.0) 3610 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-146","var": "hit_set_period","val": "600"}]: dispatch 2024-03-30T15:26:10.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:09 smithi072 bash[28946]: audit 2024-03-30T15:26:08.926066+0000 mon.a (mon.0) 3608 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-146","var": "hit_set_count","val": "2"}]': finished 2024-03-30T15:26:10.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:09 smithi072 bash[28946]: cluster 2024-03-30T15:26:08.933954+0000 mon.a (mon.0) 3609 : cluster 0 osdmap e746: 8 total, 8 up, 8 in 2024-03-30T15:26:10.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:09 smithi072 bash[28946]: audit 2024-03-30T15:26:08.935305+0000 mon.a (mon.0) 3610 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-146","var": "hit_set_period","val": "600"}]: dispatch 2024-03-30T15:26:11.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:10 smithi172 bash[23680]: audit 2024-03-30T15:26:09.938030+0000 mon.a (mon.0) 3611 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-146","var": "hit_set_period","val": "600"}]': finished 2024-03-30T15:26:11.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:10 smithi172 bash[23680]: cluster 2024-03-30T15:26:09.945896+0000 mon.a (mon.0) 3612 : cluster 0 osdmap e747: 8 total, 8 up, 8 in 2024-03-30T15:26:11.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:10 smithi172 bash[23680]: audit 2024-03-30T15:26:09.948802+0000 mon.a (mon.0) 3613 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-146","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-30T15:26:11.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:10 smithi172 bash[23680]: cluster 2024-03-30T15:26:10.352349+0000 mgr.y (mgr.14526) 709 : cluster 0 pgmap v1207: 204 pgs: 204 active+clean; 4.4 MiB data, 805 MiB used, 714 GiB / 715 GiB avail 2024-03-30T15:26:11.419 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:26:11 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:26:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:26:11.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:10 smithi072 bash[21573]: audit 2024-03-30T15:26:09.938030+0000 mon.a (mon.0) 3611 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-146","var": "hit_set_period","val": "600"}]': finished 2024-03-30T15:26:11.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:10 smithi072 bash[21573]: cluster 2024-03-30T15:26:09.945896+0000 mon.a (mon.0) 3612 : cluster 0 osdmap e747: 8 total, 8 up, 8 in 2024-03-30T15:26:11.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:10 smithi072 bash[21573]: audit 2024-03-30T15:26:09.948802+0000 mon.a (mon.0) 3613 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-146","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-30T15:26:11.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:10 smithi072 bash[21573]: cluster 2024-03-30T15:26:10.352349+0000 mgr.y (mgr.14526) 709 : cluster 0 pgmap v1207: 204 pgs: 204 active+clean; 4.4 MiB data, 805 MiB used, 714 GiB / 715 GiB avail 2024-03-30T15:26:11.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:10 smithi072 bash[28946]: audit 2024-03-30T15:26:09.938030+0000 mon.a (mon.0) 3611 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-146","var": "hit_set_period","val": "600"}]': finished 2024-03-30T15:26:11.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:10 smithi072 bash[28946]: cluster 2024-03-30T15:26:09.945896+0000 mon.a (mon.0) 3612 : cluster 0 osdmap e747: 8 total, 8 up, 8 in 2024-03-30T15:26:11.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:10 smithi072 bash[28946]: audit 2024-03-30T15:26:09.948802+0000 mon.a (mon.0) 3613 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-146","var": "hit_set_type","val": "bloom"}]: dispatch 2024-03-30T15:26:11.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:10 smithi072 bash[28946]: cluster 2024-03-30T15:26:10.352349+0000 mgr.y (mgr.14526) 709 : cluster 0 pgmap v1207: 204 pgs: 204 active+clean; 4.4 MiB data, 805 MiB used, 714 GiB / 715 GiB avail 2024-03-30T15:26:12.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:26:11 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:26:12.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:11 smithi172 bash[23680]: cluster 2024-03-30T15:26:10.939081+0000 mon.a (mon.0) 3614 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:26:12.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:11 smithi172 bash[23680]: audit 2024-03-30T15:26:10.950987+0000 mon.a (mon.0) 3615 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-146","var": "hit_set_type","val": "bloom"}]': finished 2024-03-30T15:26:12.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:11 smithi172 bash[23680]: cluster 2024-03-30T15:26:10.957727+0000 mon.a (mon.0) 3616 : cluster 0 osdmap e748: 8 total, 8 up, 8 in 2024-03-30T15:26:12.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:11 smithi172 bash[23680]: audit 2024-03-30T15:26:10.961259+0000 mon.a (mon.0) 3617 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-146","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-03-30T15:26:12.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:11 smithi172 bash[23680]: audit 2024-03-30T15:26:11.739631+0000 mgr.y (mgr.14526) 710 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:26:12.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:11 smithi072 bash[21573]: cluster 2024-03-30T15:26:10.939081+0000 mon.a (mon.0) 3614 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:26:12.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:11 smithi072 bash[21573]: audit 2024-03-30T15:26:10.950987+0000 mon.a (mon.0) 3615 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-146","var": "hit_set_type","val": "bloom"}]': finished 2024-03-30T15:26:12.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:11 smithi072 bash[21573]: cluster 2024-03-30T15:26:10.957727+0000 mon.a (mon.0) 3616 : cluster 0 osdmap e748: 8 total, 8 up, 8 in 2024-03-30T15:26:12.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:11 smithi072 bash[21573]: audit 2024-03-30T15:26:10.961259+0000 mon.a (mon.0) 3617 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-146","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-03-30T15:26:12.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:11 smithi072 bash[21573]: audit 2024-03-30T15:26:11.739631+0000 mgr.y (mgr.14526) 710 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:26:12.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:11 smithi072 bash[28946]: cluster 2024-03-30T15:26:10.939081+0000 mon.a (mon.0) 3614 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-03-30T15:26:12.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:11 smithi072 bash[28946]: audit 2024-03-30T15:26:10.950987+0000 mon.a (mon.0) 3615 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-146","var": "hit_set_type","val": "bloom"}]': finished 2024-03-30T15:26:12.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:11 smithi072 bash[28946]: cluster 2024-03-30T15:26:10.957727+0000 mon.a (mon.0) 3616 : cluster 0 osdmap e748: 8 total, 8 up, 8 in 2024-03-30T15:26:12.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:11 smithi072 bash[28946]: audit 2024-03-30T15:26:10.961259+0000 mon.a (mon.0) 3617 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-146","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-03-30T15:26:12.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:11 smithi072 bash[28946]: audit 2024-03-30T15:26:11.739631+0000 mgr.y (mgr.14526) 710 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:26:13.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:12 smithi172 bash[23680]: audit 2024-03-30T15:26:11.953371+0000 mon.a (mon.0) 3618 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-146","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-03-30T15:26:13.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:12 smithi172 bash[23680]: cluster 2024-03-30T15:26:11.960285+0000 mon.a (mon.0) 3619 : cluster 0 osdmap e749: 8 total, 8 up, 8 in 2024-03-30T15:26:13.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:12 smithi172 bash[23680]: audit 2024-03-30T15:26:11.961682+0000 mon.a (mon.0) 3620 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-146","var": "target_max_objects","val": "1"}]: dispatch 2024-03-30T15:26:13.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:12 smithi172 bash[23680]: cluster 2024-03-30T15:26:12.352828+0000 mon.a (mon.0) 3621 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:26:13.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:12 smithi172 bash[23680]: cluster 2024-03-30T15:26:12.353207+0000 mgr.y (mgr.14526) 711 : cluster 0 pgmap v1210: 204 pgs: 204 active+clean; 4.4 MiB data, 806 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-30T15:26:13.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:12 smithi072 bash[21573]: audit 2024-03-30T15:26:11.953371+0000 mon.a (mon.0) 3618 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-146","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-03-30T15:26:13.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:12 smithi072 bash[21573]: cluster 2024-03-30T15:26:11.960285+0000 mon.a (mon.0) 3619 : cluster 0 osdmap e749: 8 total, 8 up, 8 in 2024-03-30T15:26:13.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:12 smithi072 bash[21573]: audit 2024-03-30T15:26:11.961682+0000 mon.a (mon.0) 3620 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-146","var": "target_max_objects","val": "1"}]: dispatch 2024-03-30T15:26:13.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:12 smithi072 bash[21573]: cluster 2024-03-30T15:26:12.352828+0000 mon.a (mon.0) 3621 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:26:13.420 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:12 smithi072 bash[21573]: cluster 2024-03-30T15:26:12.353207+0000 mgr.y (mgr.14526) 711 : cluster 0 pgmap v1210: 204 pgs: 204 active+clean; 4.4 MiB data, 806 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-30T15:26:13.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:12 smithi072 bash[28946]: audit 2024-03-30T15:26:11.953371+0000 mon.a (mon.0) 3618 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-146","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-03-30T15:26:13.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:12 smithi072 bash[28946]: cluster 2024-03-30T15:26:11.960285+0000 mon.a (mon.0) 3619 : cluster 0 osdmap e749: 8 total, 8 up, 8 in 2024-03-30T15:26:13.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:12 smithi072 bash[28946]: audit 2024-03-30T15:26:11.961682+0000 mon.a (mon.0) 3620 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-146","var": "target_max_objects","val": "1"}]: dispatch 2024-03-30T15:26:13.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:12 smithi072 bash[28946]: cluster 2024-03-30T15:26:12.352828+0000 mon.a (mon.0) 3621 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:26:13.420 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:12 smithi072 bash[28946]: cluster 2024-03-30T15:26:12.353207+0000 mgr.y (mgr.14526) 711 : cluster 0 pgmap v1210: 204 pgs: 204 active+clean; 4.4 MiB data, 806 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-30T15:26:14.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:13 smithi072 bash[21573]: audit 2024-03-30T15:26:12.956210+0000 mon.a (mon.0) 3622 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-146","var": "target_max_objects","val": "1"}]': finished 2024-03-30T15:26:14.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:13 smithi072 bash[21573]: cluster 2024-03-30T15:26:12.963005+0000 mon.a (mon.0) 3623 : cluster 0 osdmap e750: 8 total, 8 up, 8 in 2024-03-30T15:26:14.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:13 smithi072 bash[28946]: audit 2024-03-30T15:26:12.956210+0000 mon.a (mon.0) 3622 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-146","var": "target_max_objects","val": "1"}]': finished 2024-03-30T15:26:14.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:13 smithi072 bash[28946]: cluster 2024-03-30T15:26:12.963005+0000 mon.a (mon.0) 3623 : cluster 0 osdmap e750: 8 total, 8 up, 8 in 2024-03-30T15:26:14.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:13 smithi172 bash[23680]: audit 2024-03-30T15:26:12.956210+0000 mon.a (mon.0) 3622 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-146","var": "target_max_objects","val": "1"}]': finished 2024-03-30T15:26:14.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:13 smithi172 bash[23680]: cluster 2024-03-30T15:26:12.963005+0000 mon.a (mon.0) 3623 : cluster 0 osdmap e750: 8 total, 8 up, 8 in 2024-03-30T15:26:15.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:14 smithi072 bash[21573]: cluster 2024-03-30T15:26:14.354036+0000 mgr.y (mgr.14526) 712 : cluster 0 pgmap v1212: 204 pgs: 204 active+clean; 4.4 MiB data, 806 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-30T15:26:15.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:14 smithi072 bash[28946]: cluster 2024-03-30T15:26:14.354036+0000 mgr.y (mgr.14526) 712 : cluster 0 pgmap v1212: 204 pgs: 204 active+clean; 4.4 MiB data, 806 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-30T15:26:15.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:14 smithi172 bash[23680]: cluster 2024-03-30T15:26:14.354036+0000 mgr.y (mgr.14526) 712 : cluster 0 pgmap v1212: 204 pgs: 204 active+clean; 4.4 MiB data, 806 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-30T15:26:16.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:15 smithi072 bash[21573]: cluster 2024-03-30T15:26:14.970314+0000 mon.a (mon.0) 3624 : cluster 3 Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-03-30T15:26:16.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:15 smithi072 bash[28946]: cluster 2024-03-30T15:26:14.970314+0000 mon.a (mon.0) 3624 : cluster 3 Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-03-30T15:26:16.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:15 smithi172 bash[23680]: cluster 2024-03-30T15:26:14.970314+0000 mon.a (mon.0) 3624 : cluster 3 Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-03-30T15:26:17.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:16 smithi072 bash[21573]: cluster 2024-03-30T15:26:16.356111+0000 mgr.y (mgr.14526) 713 : cluster 0 pgmap v1213: 204 pgs: 204 active+clean; 4.4 MiB data, 810 MiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-30T15:26:17.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:16 smithi072 bash[28946]: cluster 2024-03-30T15:26:16.356111+0000 mgr.y (mgr.14526) 713 : cluster 0 pgmap v1213: 204 pgs: 204 active+clean; 4.4 MiB data, 810 MiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-30T15:26:17.468 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:16 smithi172 bash[23680]: cluster 2024-03-30T15:26:16.356111+0000 mgr.y (mgr.14526) 713 : cluster 0 pgmap v1213: 204 pgs: 204 active+clean; 4.4 MiB data, 810 MiB used, 714 GiB / 715 GiB avail; 2.3 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-30T15:26:19.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:19 smithi072 bash[21573]: cluster 2024-03-30T15:26:18.356976+0000 mgr.y (mgr.14526) 714 : cluster 0 pgmap v1214: 204 pgs: 204 active+clean; 4.4 MiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1.9 KiB/s rd, 0 B/s wr, 2 op/s 2024-03-30T15:26:19.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:19 smithi072 bash[28946]: cluster 2024-03-30T15:26:18.356976+0000 mgr.y (mgr.14526) 714 : cluster 0 pgmap v1214: 204 pgs: 204 active+clean; 4.4 MiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1.9 KiB/s rd, 0 B/s wr, 2 op/s 2024-03-30T15:26:19.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:19 smithi172 bash[23680]: cluster 2024-03-30T15:26:18.356976+0000 mgr.y (mgr.14526) 714 : cluster 0 pgmap v1214: 204 pgs: 204 active+clean; 4.4 MiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1.9 KiB/s rd, 0 B/s wr, 2 op/s 2024-03-30T15:26:21.415 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:26:21 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:26:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:26:21.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:21 smithi072 bash[21573]: cluster 2024-03-30T15:26:20.357833+0000 mgr.y (mgr.14526) 715 : cluster 0 pgmap v1215: 204 pgs: 204 active+clean; 4.4 MiB data, 810 MiB used, 714 GiB / 715 GiB avail; 609 B/s rd, 0 B/s wr, 0 op/s 2024-03-30T15:26:21.669 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:21 smithi072 bash[28946]: cluster 2024-03-30T15:26:20.357833+0000 mgr.y (mgr.14526) 715 : cluster 0 pgmap v1215: 204 pgs: 204 active+clean; 4.4 MiB data, 810 MiB used, 714 GiB / 715 GiB avail; 609 B/s rd, 0 B/s wr, 0 op/s 2024-03-30T15:26:21.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:21 smithi172 bash[23680]: cluster 2024-03-30T15:26:20.357833+0000 mgr.y (mgr.14526) 715 : cluster 0 pgmap v1215: 204 pgs: 204 active+clean; 4.4 MiB data, 810 MiB used, 714 GiB / 715 GiB avail; 609 B/s rd, 0 B/s wr, 0 op/s 2024-03-30T15:26:22.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:26:21 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:26:22.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:22 smithi172 bash[23680]: audit 2024-03-30T15:26:21.751120+0000 mgr.y (mgr.14526) 716 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:26:22.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:22 smithi072 bash[21573]: audit 2024-03-30T15:26:21.751120+0000 mgr.y (mgr.14526) 716 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:26:22.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:22 smithi072 bash[28946]: audit 2024-03-30T15:26:21.751120+0000 mgr.y (mgr.14526) 716 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:26:23.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:23 smithi072 bash[21573]: cluster 2024-03-30T15:26:22.359929+0000 mgr.y (mgr.14526) 717 : cluster 0 pgmap v1216: 204 pgs: 204 active+clean; 4.4 MiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:26:23.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:23 smithi072 bash[21573]: audit 2024-03-30T15:26:22.515323+0000 mon.a (mon.0) 3625 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:26:23.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:23 smithi072 bash[21573]: audit 2024-03-30T15:26:22.518146+0000 mon.c (mon.2) 529 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:26:23.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:23 smithi072 bash[21573]: audit 2024-03-30T15:26:22.986377+0000 mon.a (mon.0) 3626 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:26:23.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:23 smithi072 bash[28946]: cluster 2024-03-30T15:26:22.359929+0000 mgr.y (mgr.14526) 717 : cluster 0 pgmap v1216: 204 pgs: 204 active+clean; 4.4 MiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:26:23.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:23 smithi072 bash[28946]: audit 2024-03-30T15:26:22.515323+0000 mon.a (mon.0) 3625 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:26:23.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:23 smithi072 bash[28946]: audit 2024-03-30T15:26:22.518146+0000 mon.c (mon.2) 529 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:26:23.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:23 smithi072 bash[28946]: audit 2024-03-30T15:26:22.986377+0000 mon.a (mon.0) 3626 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:26:23.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:23 smithi172 bash[23680]: cluster 2024-03-30T15:26:22.359929+0000 mgr.y (mgr.14526) 717 : cluster 0 pgmap v1216: 204 pgs: 204 active+clean; 4.4 MiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:26:23.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:23 smithi172 bash[23680]: audit 2024-03-30T15:26:22.515323+0000 mon.a (mon.0) 3625 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:26:23.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:23 smithi172 bash[23680]: audit 2024-03-30T15:26:22.518146+0000 mon.c (mon.2) 529 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:26:23.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:23 smithi172 bash[23680]: audit 2024-03-30T15:26:22.986377+0000 mon.a (mon.0) 3626 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:26:24.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:24 smithi072 bash[21573]: audit 2024-03-30T15:26:23.513217+0000 mon.a (mon.0) 3627 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:26:24.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:24 smithi072 bash[21573]: cluster 2024-03-30T15:26:23.520572+0000 mon.a (mon.0) 3628 : cluster 0 osdmap e751: 8 total, 8 up, 8 in 2024-03-30T15:26:24.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:24 smithi072 bash[21573]: audit 2024-03-30T15:26:23.523996+0000 mon.a (mon.0) 3629 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-146"}]: dispatch 2024-03-30T15:26:24.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:24 smithi072 bash[21573]: audit 2024-03-30T15:26:24.515963+0000 mon.a (mon.0) 3630 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-146"}]': finished 2024-03-30T15:26:24.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:24 smithi072 bash[21573]: cluster 2024-03-30T15:26:24.523118+0000 mon.a (mon.0) 3631 : cluster 0 osdmap e752: 8 total, 8 up, 8 in 2024-03-30T15:26:24.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:24 smithi072 bash[28946]: audit 2024-03-30T15:26:23.513217+0000 mon.a (mon.0) 3627 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:26:24.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:24 smithi072 bash[28946]: cluster 2024-03-30T15:26:23.520572+0000 mon.a (mon.0) 3628 : cluster 0 osdmap e751: 8 total, 8 up, 8 in 2024-03-30T15:26:24.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:24 smithi072 bash[28946]: audit 2024-03-30T15:26:23.523996+0000 mon.a (mon.0) 3629 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-146"}]: dispatch 2024-03-30T15:26:24.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:24 smithi072 bash[28946]: audit 2024-03-30T15:26:24.515963+0000 mon.a (mon.0) 3630 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-146"}]': finished 2024-03-30T15:26:24.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:24 smithi072 bash[28946]: cluster 2024-03-30T15:26:24.523118+0000 mon.a (mon.0) 3631 : cluster 0 osdmap e752: 8 total, 8 up, 8 in 2024-03-30T15:26:24.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:24 smithi172 bash[23680]: audit 2024-03-30T15:26:23.513217+0000 mon.a (mon.0) 3627 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:26:24.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:24 smithi172 bash[23680]: cluster 2024-03-30T15:26:23.520572+0000 mon.a (mon.0) 3628 : cluster 0 osdmap e751: 8 total, 8 up, 8 in 2024-03-30T15:26:24.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:24 smithi172 bash[23680]: audit 2024-03-30T15:26:23.523996+0000 mon.a (mon.0) 3629 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-146"}]: dispatch 2024-03-30T15:26:24.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:24 smithi172 bash[23680]: audit 2024-03-30T15:26:24.515963+0000 mon.a (mon.0) 3630 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-146"}]': finished 2024-03-30T15:26:24.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:24 smithi172 bash[23680]: cluster 2024-03-30T15:26:24.523118+0000 mon.a (mon.0) 3631 : cluster 0 osdmap e752: 8 total, 8 up, 8 in 2024-03-30T15:26:25.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:25 smithi072 bash[21573]: cluster 2024-03-30T15:26:24.360903+0000 mgr.y (mgr.14526) 718 : cluster 0 pgmap v1218: 204 pgs: 204 active+clean; 4.4 MiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:26:25.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:25 smithi072 bash[21573]: audit 2024-03-30T15:26:24.592001+0000 mon.a (mon.0) 3632 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:26:25.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:25 smithi072 bash[21573]: audit 2024-03-30T15:26:24.592868+0000 mon.a (mon.0) 3633 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-146"}]: dispatch 2024-03-30T15:26:25.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:25 smithi072 bash[28946]: cluster 2024-03-30T15:26:24.360903+0000 mgr.y (mgr.14526) 718 : cluster 0 pgmap v1218: 204 pgs: 204 active+clean; 4.4 MiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:26:25.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:25 smithi072 bash[28946]: audit 2024-03-30T15:26:24.592001+0000 mon.a (mon.0) 3632 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:26:25.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:25 smithi072 bash[28946]: audit 2024-03-30T15:26:24.592868+0000 mon.a (mon.0) 3633 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-146"}]: dispatch 2024-03-30T15:26:25.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:25 smithi172 bash[23680]: cluster 2024-03-30T15:26:24.360903+0000 mgr.y (mgr.14526) 718 : cluster 0 pgmap v1218: 204 pgs: 204 active+clean; 4.4 MiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-03-30T15:26:25.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:25 smithi172 bash[23680]: audit 2024-03-30T15:26:24.592001+0000 mon.a (mon.0) 3632 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:26:25.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:25 smithi172 bash[23680]: audit 2024-03-30T15:26:24.592868+0000 mon.a (mon.0) 3633 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-146"}]: dispatch 2024-03-30T15:26:26.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:26 smithi072 bash[21573]: cluster 2024-03-30T15:26:25.555064+0000 mon.a (mon.0) 3634 : cluster 0 osdmap e753: 8 total, 8 up, 8 in 2024-03-30T15:26:26.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:26 smithi072 bash[21573]: audit 2024-03-30T15:26:26.137048+0000 mon.c (mon.2) 530 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:26:26.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:26 smithi072 bash[28946]: cluster 2024-03-30T15:26:25.555064+0000 mon.a (mon.0) 3634 : cluster 0 osdmap e753: 8 total, 8 up, 8 in 2024-03-30T15:26:26.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:26 smithi072 bash[28946]: audit 2024-03-30T15:26:26.137048+0000 mon.c (mon.2) 530 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:26:26.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:26 smithi172 bash[23680]: cluster 2024-03-30T15:26:25.555064+0000 mon.a (mon.0) 3634 : cluster 0 osdmap e753: 8 total, 8 up, 8 in 2024-03-30T15:26:26.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:26 smithi172 bash[23680]: audit 2024-03-30T15:26:26.137048+0000 mon.c (mon.2) 530 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:26:27.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:27 smithi072 bash[21573]: cluster 2024-03-30T15:26:26.362807+0000 mgr.y (mgr.14526) 719 : cluster 0 pgmap v1221: 172 pgs: 172 active+clean; 4.4 MiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T15:26:27.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:27 smithi072 bash[21573]: cluster 2024-03-30T15:26:26.548970+0000 mon.a (mon.0) 3635 : cluster 1 Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-03-30T15:26:27.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:27 smithi072 bash[21573]: cluster 2024-03-30T15:26:26.574223+0000 mon.a (mon.0) 3636 : cluster 0 osdmap e754: 8 total, 8 up, 8 in 2024-03-30T15:26:27.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:27 smithi072 bash[21573]: audit 2024-03-30T15:26:26.578317+0000 mon.a (mon.0) 3637 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-148","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:26:27.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:27 smithi072 bash[21573]: audit 2024-03-30T15:26:26.812079+0000 mon.c (mon.2) 531 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:26:27.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:27 smithi072 bash[21573]: audit 2024-03-30T15:26:26.813594+0000 mon.c (mon.2) 532 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:26:27.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:27 smithi072 bash[21573]: audit 2024-03-30T15:26:26.826029+0000 mon.a (mon.0) 3638 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:26:27.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:27 smithi072 bash[28946]: cluster 2024-03-30T15:26:26.362807+0000 mgr.y (mgr.14526) 719 : cluster 0 pgmap v1221: 172 pgs: 172 active+clean; 4.4 MiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T15:26:27.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:27 smithi072 bash[28946]: cluster 2024-03-30T15:26:26.548970+0000 mon.a (mon.0) 3635 : cluster 1 Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-03-30T15:26:27.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:27 smithi072 bash[28946]: cluster 2024-03-30T15:26:26.574223+0000 mon.a (mon.0) 3636 : cluster 0 osdmap e754: 8 total, 8 up, 8 in 2024-03-30T15:26:27.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:27 smithi072 bash[28946]: audit 2024-03-30T15:26:26.578317+0000 mon.a (mon.0) 3637 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-148","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:26:27.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:27 smithi072 bash[28946]: audit 2024-03-30T15:26:26.812079+0000 mon.c (mon.2) 531 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:26:27.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:27 smithi072 bash[28946]: audit 2024-03-30T15:26:26.813594+0000 mon.c (mon.2) 532 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:26:27.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:27 smithi072 bash[28946]: audit 2024-03-30T15:26:26.826029+0000 mon.a (mon.0) 3638 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:26:27.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:27 smithi172 bash[23680]: cluster 2024-03-30T15:26:26.362807+0000 mgr.y (mgr.14526) 719 : cluster 0 pgmap v1221: 172 pgs: 172 active+clean; 4.4 MiB data, 810 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T15:26:27.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:27 smithi172 bash[23680]: cluster 2024-03-30T15:26:26.548970+0000 mon.a (mon.0) 3635 : cluster 1 Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-03-30T15:26:27.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:27 smithi172 bash[23680]: cluster 2024-03-30T15:26:26.574223+0000 mon.a (mon.0) 3636 : cluster 0 osdmap e754: 8 total, 8 up, 8 in 2024-03-30T15:26:27.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:27 smithi172 bash[23680]: audit 2024-03-30T15:26:26.578317+0000 mon.a (mon.0) 3637 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-148","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:26:27.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:27 smithi172 bash[23680]: audit 2024-03-30T15:26:26.812079+0000 mon.c (mon.2) 531 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:26:27.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:27 smithi172 bash[23680]: audit 2024-03-30T15:26:26.813594+0000 mon.c (mon.2) 532 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:26:27.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:27 smithi172 bash[23680]: audit 2024-03-30T15:26:26.826029+0000 mon.a (mon.0) 3638 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:26:28.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:28 smithi072 bash[21573]: audit 2024-03-30T15:26:27.566443+0000 mon.a (mon.0) 3639 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-148","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:26:28.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:28 smithi072 bash[21573]: cluster 2024-03-30T15:26:27.577357+0000 mon.a (mon.0) 3640 : cluster 0 osdmap e755: 8 total, 8 up, 8 in 2024-03-30T15:26:28.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:28 smithi072 bash[21573]: audit 2024-03-30T15:26:27.635197+0000 mon.a (mon.0) 3641 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-148", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:26:28.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:28 smithi072 bash[28946]: audit 2024-03-30T15:26:27.566443+0000 mon.a (mon.0) 3639 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-148","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:26:28.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:28 smithi072 bash[28946]: cluster 2024-03-30T15:26:27.577357+0000 mon.a (mon.0) 3640 : cluster 0 osdmap e755: 8 total, 8 up, 8 in 2024-03-30T15:26:28.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:28 smithi072 bash[28946]: audit 2024-03-30T15:26:27.635197+0000 mon.a (mon.0) 3641 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-148", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:26:28.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:28 smithi172 bash[23680]: audit 2024-03-30T15:26:27.566443+0000 mon.a (mon.0) 3639 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-148","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:26:28.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:28 smithi172 bash[23680]: cluster 2024-03-30T15:26:27.577357+0000 mon.a (mon.0) 3640 : cluster 0 osdmap e755: 8 total, 8 up, 8 in 2024-03-30T15:26:28.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:28 smithi172 bash[23680]: audit 2024-03-30T15:26:27.635197+0000 mon.a (mon.0) 3641 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-148", "force_nonempty": "--force-nonempty" }]: dispatch 2024-03-30T15:26:29.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:29 smithi072 bash[21573]: cluster 2024-03-30T15:26:28.363640+0000 mgr.y (mgr.14526) 720 : cluster 0 pgmap v1224: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 810 MiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-03-30T15:26:29.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:29 smithi072 bash[21573]: audit 2024-03-30T15:26:28.600300+0000 mon.a (mon.0) 3642 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-148", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:26:29.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:29 smithi072 bash[21573]: cluster 2024-03-30T15:26:28.608880+0000 mon.a (mon.0) 3643 : cluster 0 osdmap e756: 8 total, 8 up, 8 in 2024-03-30T15:26:29.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:29 smithi072 bash[21573]: audit 2024-03-30T15:26:28.635896+0000 mon.a (mon.0) 3644 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-148"}]: dispatch 2024-03-30T15:26:29.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:29 smithi072 bash[28946]: cluster 2024-03-30T15:26:28.363640+0000 mgr.y (mgr.14526) 720 : cluster 0 pgmap v1224: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 810 MiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-03-30T15:26:29.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:29 smithi072 bash[28946]: audit 2024-03-30T15:26:28.600300+0000 mon.a (mon.0) 3642 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-148", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:26:29.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:29 smithi072 bash[28946]: cluster 2024-03-30T15:26:28.608880+0000 mon.a (mon.0) 3643 : cluster 0 osdmap e756: 8 total, 8 up, 8 in 2024-03-30T15:26:29.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:29 smithi072 bash[28946]: audit 2024-03-30T15:26:28.635896+0000 mon.a (mon.0) 3644 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-148"}]: dispatch 2024-03-30T15:26:29.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:29 smithi172 bash[23680]: cluster 2024-03-30T15:26:28.363640+0000 mgr.y (mgr.14526) 720 : cluster 0 pgmap v1224: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 810 MiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-03-30T15:26:29.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:29 smithi172 bash[23680]: audit 2024-03-30T15:26:28.600300+0000 mon.a (mon.0) 3642 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-148", "force_nonempty": "--force-nonempty" }]': finished 2024-03-30T15:26:29.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:29 smithi172 bash[23680]: cluster 2024-03-30T15:26:28.608880+0000 mon.a (mon.0) 3643 : cluster 0 osdmap e756: 8 total, 8 up, 8 in 2024-03-30T15:26:29.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:29 smithi172 bash[23680]: audit 2024-03-30T15:26:28.635896+0000 mon.a (mon.0) 3644 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-148"}]: dispatch 2024-03-30T15:26:30.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:30 smithi072 bash[21573]: audit 2024-03-30T15:26:29.602893+0000 mon.a (mon.0) 3645 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-148"}]': finished 2024-03-30T15:26:30.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:30 smithi072 bash[21573]: cluster 2024-03-30T15:26:29.610122+0000 mon.a (mon.0) 3646 : cluster 0 osdmap e757: 8 total, 8 up, 8 in 2024-03-30T15:26:30.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:30 smithi072 bash[21573]: audit 2024-03-30T15:26:29.714952+0000 mon.a (mon.0) 3647 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:26:30.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:30 smithi072 bash[21573]: audit 2024-03-30T15:26:29.715872+0000 mon.a (mon.0) 3648 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-148"}]: dispatch 2024-03-30T15:26:30.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:30 smithi072 bash[28946]: audit 2024-03-30T15:26:29.602893+0000 mon.a (mon.0) 3645 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-148"}]': finished 2024-03-30T15:26:30.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:30 smithi072 bash[28946]: cluster 2024-03-30T15:26:29.610122+0000 mon.a (mon.0) 3646 : cluster 0 osdmap e757: 8 total, 8 up, 8 in 2024-03-30T15:26:30.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:30 smithi072 bash[28946]: audit 2024-03-30T15:26:29.714952+0000 mon.a (mon.0) 3647 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:26:30.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:30 smithi072 bash[28946]: audit 2024-03-30T15:26:29.715872+0000 mon.a (mon.0) 3648 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-148"}]: dispatch 2024-03-30T15:26:30.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:30 smithi172 bash[23680]: audit 2024-03-30T15:26:29.602893+0000 mon.a (mon.0) 3645 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-148"}]': finished 2024-03-30T15:26:30.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:30 smithi172 bash[23680]: cluster 2024-03-30T15:26:29.610122+0000 mon.a (mon.0) 3646 : cluster 0 osdmap e757: 8 total, 8 up, 8 in 2024-03-30T15:26:30.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:30 smithi172 bash[23680]: audit 2024-03-30T15:26:29.714952+0000 mon.a (mon.0) 3647 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:26:30.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:30 smithi172 bash[23680]: audit 2024-03-30T15:26:29.715872+0000 mon.a (mon.0) 3648 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-148"}]: dispatch 2024-03-30T15:26:31.419 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:26:31 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:26:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:26:31.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:31 smithi072 bash[21573]: cluster 2024-03-30T15:26:30.364487+0000 mgr.y (mgr.14526) 721 : cluster 0 pgmap v1227: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 810 MiB used, 714 GiB / 715 GiB avail 2024-03-30T15:26:31.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:31 smithi072 bash[21573]: cluster 2024-03-30T15:26:30.617464+0000 mon.a (mon.0) 3649 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:26:31.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:31 smithi072 bash[21573]: cluster 2024-03-30T15:26:30.636747+0000 mon.a (mon.0) 3650 : cluster 0 osdmap e758: 8 total, 8 up, 8 in 2024-03-30T15:26:31.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:31 smithi072 bash[28946]: cluster 2024-03-30T15:26:30.364487+0000 mgr.y (mgr.14526) 721 : cluster 0 pgmap v1227: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 810 MiB used, 714 GiB / 715 GiB avail 2024-03-30T15:26:31.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:31 smithi072 bash[28946]: cluster 2024-03-30T15:26:30.617464+0000 mon.a (mon.0) 3649 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:26:31.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:31 smithi072 bash[28946]: cluster 2024-03-30T15:26:30.636747+0000 mon.a (mon.0) 3650 : cluster 0 osdmap e758: 8 total, 8 up, 8 in 2024-03-30T15:26:31.968 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:26:31 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:26:31.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:31 smithi172 bash[23680]: cluster 2024-03-30T15:26:30.364487+0000 mgr.y (mgr.14526) 721 : cluster 0 pgmap v1227: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 810 MiB used, 714 GiB / 715 GiB avail 2024-03-30T15:26:31.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:31 smithi172 bash[23680]: cluster 2024-03-30T15:26:30.617464+0000 mon.a (mon.0) 3649 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:26:31.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:31 smithi172 bash[23680]: cluster 2024-03-30T15:26:30.636747+0000 mon.a (mon.0) 3650 : cluster 0 osdmap e758: 8 total, 8 up, 8 in 2024-03-30T15:26:32.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:32 smithi072 bash[21573]: cluster 2024-03-30T15:26:31.652826+0000 mon.a (mon.0) 3651 : cluster 0 osdmap e759: 8 total, 8 up, 8 in 2024-03-30T15:26:32.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:32 smithi072 bash[21573]: audit 2024-03-30T15:26:31.656764+0000 mon.a (mon.0) 3652 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-150","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:26:32.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:32 smithi072 bash[21573]: audit 2024-03-30T15:26:31.762687+0000 mgr.y (mgr.14526) 722 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:26:32.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:32 smithi072 bash[28946]: cluster 2024-03-30T15:26:31.652826+0000 mon.a (mon.0) 3651 : cluster 0 osdmap e759: 8 total, 8 up, 8 in 2024-03-30T15:26:32.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:32 smithi072 bash[28946]: audit 2024-03-30T15:26:31.656764+0000 mon.a (mon.0) 3652 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-150","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:26:32.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:32 smithi072 bash[28946]: audit 2024-03-30T15:26:31.762687+0000 mgr.y (mgr.14526) 722 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:26:32.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:32 smithi172 bash[23680]: cluster 2024-03-30T15:26:31.652826+0000 mon.a (mon.0) 3651 : cluster 0 osdmap e759: 8 total, 8 up, 8 in 2024-03-30T15:26:32.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:32 smithi172 bash[23680]: audit 2024-03-30T15:26:31.656764+0000 mon.a (mon.0) 3652 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-150","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:26:32.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:32 smithi172 bash[23680]: audit 2024-03-30T15:26:31.762687+0000 mgr.y (mgr.14526) 722 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:26:33.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:33 smithi072 bash[28946]: cluster 2024-03-30T15:26:32.365316+0000 mgr.y (mgr.14526) 723 : cluster 0 pgmap v1230: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 811 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-03-30T15:26:33.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:33 smithi072 bash[28946]: audit 2024-03-30T15:26:32.654042+0000 mon.a (mon.0) 3653 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-150","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:26:33.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:33 smithi072 bash[28946]: cluster 2024-03-30T15:26:32.663774+0000 mon.a (mon.0) 3654 : cluster 0 osdmap e760: 8 total, 8 up, 8 in 2024-03-30T15:26:33.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:33 smithi072 bash[28946]: audit 2024-03-30T15:26:32.743254+0000 mon.a (mon.0) 3655 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:26:33.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:33 smithi072 bash[28946]: audit 2024-03-30T15:26:32.743764+0000 mon.a (mon.0) 3656 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-150"}]: dispatch 2024-03-30T15:26:33.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:33 smithi072 bash[21573]: cluster 2024-03-30T15:26:32.365316+0000 mgr.y (mgr.14526) 723 : cluster 0 pgmap v1230: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 811 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-03-30T15:26:33.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:33 smithi072 bash[21573]: audit 2024-03-30T15:26:32.654042+0000 mon.a (mon.0) 3653 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-150","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:26:33.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:33 smithi072 bash[21573]: cluster 2024-03-30T15:26:32.663774+0000 mon.a (mon.0) 3654 : cluster 0 osdmap e760: 8 total, 8 up, 8 in 2024-03-30T15:26:33.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:33 smithi072 bash[21573]: audit 2024-03-30T15:26:32.743254+0000 mon.a (mon.0) 3655 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:26:33.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:33 smithi072 bash[21573]: audit 2024-03-30T15:26:32.743764+0000 mon.a (mon.0) 3656 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-150"}]: dispatch 2024-03-30T15:26:33.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:33 smithi172 bash[23680]: cluster 2024-03-30T15:26:32.365316+0000 mgr.y (mgr.14526) 723 : cluster 0 pgmap v1230: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 811 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-03-30T15:26:33.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:33 smithi172 bash[23680]: audit 2024-03-30T15:26:32.654042+0000 mon.a (mon.0) 3653 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-150","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:26:33.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:33 smithi172 bash[23680]: cluster 2024-03-30T15:26:32.663774+0000 mon.a (mon.0) 3654 : cluster 0 osdmap e760: 8 total, 8 up, 8 in 2024-03-30T15:26:33.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:33 smithi172 bash[23680]: audit 2024-03-30T15:26:32.743254+0000 mon.a (mon.0) 3655 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:26:33.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:33 smithi172 bash[23680]: audit 2024-03-30T15:26:32.743764+0000 mon.a (mon.0) 3656 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-150"}]: dispatch 2024-03-30T15:26:34.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:34 smithi172 bash[23680]: cluster 2024-03-30T15:26:33.671830+0000 mon.a (mon.0) 3657 : cluster 0 osdmap e761: 8 total, 8 up, 8 in 2024-03-30T15:26:35.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:34 smithi072 bash[21573]: cluster 2024-03-30T15:26:33.671830+0000 mon.a (mon.0) 3657 : cluster 0 osdmap e761: 8 total, 8 up, 8 in 2024-03-30T15:26:35.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:34 smithi072 bash[28946]: cluster 2024-03-30T15:26:33.671830+0000 mon.a (mon.0) 3657 : cluster 0 osdmap e761: 8 total, 8 up, 8 in 2024-03-30T15:26:35.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:35 smithi172 bash[23680]: cluster 2024-03-30T15:26:34.366152+0000 mgr.y (mgr.14526) 724 : cluster 0 pgmap v1233: 172 pgs: 172 active+clean; 4.4 MiB data, 811 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-03-30T15:26:35.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:35 smithi172 bash[23680]: cluster 2024-03-30T15:26:34.685984+0000 mon.a (mon.0) 3658 : cluster 0 osdmap e762: 8 total, 8 up, 8 in 2024-03-30T15:26:35.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:35 smithi172 bash[23680]: audit 2024-03-30T15:26:34.692177+0000 mon.a (mon.0) 3659 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-152","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:26:36.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:35 smithi072 bash[21573]: cluster 2024-03-30T15:26:34.366152+0000 mgr.y (mgr.14526) 724 : cluster 0 pgmap v1233: 172 pgs: 172 active+clean; 4.4 MiB data, 811 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-03-30T15:26:36.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:35 smithi072 bash[21573]: cluster 2024-03-30T15:26:34.685984+0000 mon.a (mon.0) 3658 : cluster 0 osdmap e762: 8 total, 8 up, 8 in 2024-03-30T15:26:36.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:35 smithi072 bash[21573]: audit 2024-03-30T15:26:34.692177+0000 mon.a (mon.0) 3659 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-152","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:26:36.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:35 smithi072 bash[28946]: cluster 2024-03-30T15:26:34.366152+0000 mgr.y (mgr.14526) 724 : cluster 0 pgmap v1233: 172 pgs: 172 active+clean; 4.4 MiB data, 811 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-03-30T15:26:36.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:35 smithi072 bash[28946]: cluster 2024-03-30T15:26:34.685984+0000 mon.a (mon.0) 3658 : cluster 0 osdmap e762: 8 total, 8 up, 8 in 2024-03-30T15:26:36.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:35 smithi072 bash[28946]: audit 2024-03-30T15:26:34.692177+0000 mon.a (mon.0) 3659 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-152","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:26:36.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:36 smithi172 bash[23680]: audit 2024-03-30T15:26:35.681369+0000 mon.a (mon.0) 3660 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-152","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:26:36.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:36 smithi172 bash[23680]: cluster 2024-03-30T15:26:35.690961+0000 mon.a (mon.0) 3661 : cluster 0 osdmap e763: 8 total, 8 up, 8 in 2024-03-30T15:26:36.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:36 smithi172 bash[23680]: audit 2024-03-30T15:26:35.788881+0000 mon.a (mon.0) 3662 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:26:36.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:36 smithi172 bash[23680]: audit 2024-03-30T15:26:35.789373+0000 mon.a (mon.0) 3663 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-152"}]: dispatch 2024-03-30T15:26:37.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:36 smithi072 bash[21573]: audit 2024-03-30T15:26:35.681369+0000 mon.a (mon.0) 3660 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-152","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:26:37.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:36 smithi072 bash[21573]: cluster 2024-03-30T15:26:35.690961+0000 mon.a (mon.0) 3661 : cluster 0 osdmap e763: 8 total, 8 up, 8 in 2024-03-30T15:26:37.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:36 smithi072 bash[21573]: audit 2024-03-30T15:26:35.788881+0000 mon.a (mon.0) 3662 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:26:37.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:36 smithi072 bash[21573]: audit 2024-03-30T15:26:35.789373+0000 mon.a (mon.0) 3663 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-152"}]: dispatch 2024-03-30T15:26:37.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:36 smithi072 bash[28946]: audit 2024-03-30T15:26:35.681369+0000 mon.a (mon.0) 3660 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-152","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:26:37.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:36 smithi072 bash[28946]: cluster 2024-03-30T15:26:35.690961+0000 mon.a (mon.0) 3661 : cluster 0 osdmap e763: 8 total, 8 up, 8 in 2024-03-30T15:26:37.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:36 smithi072 bash[28946]: audit 2024-03-30T15:26:35.788881+0000 mon.a (mon.0) 3662 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:26:37.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:36 smithi072 bash[28946]: audit 2024-03-30T15:26:35.789373+0000 mon.a (mon.0) 3663 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-152"}]: dispatch 2024-03-30T15:26:37.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:37 smithi172 bash[23680]: cluster 2024-03-30T15:26:36.368163+0000 mgr.y (mgr.14526) 725 : cluster 0 pgmap v1236: 204 pgs: 204 active+clean; 4.4 MiB data, 796 MiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-03-30T15:26:37.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:37 smithi172 bash[23680]: cluster 2024-03-30T15:26:36.718701+0000 mon.a (mon.0) 3664 : cluster 0 osdmap e764: 8 total, 8 up, 8 in 2024-03-30T15:26:37.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:37 smithi172 bash[23680]: cluster 2024-03-30T15:26:37.359063+0000 mon.a (mon.0) 3665 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:26:37.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:37 smithi172 bash[23680]: audit 2024-03-30T15:26:37.560209+0000 mon.a (mon.0) 3666 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:26:37.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:37 smithi172 bash[23680]: audit 2024-03-30T15:26:37.562988+0000 mon.c (mon.2) 533 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:26:38.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:37 smithi072 bash[28946]: cluster 2024-03-30T15:26:36.368163+0000 mgr.y (mgr.14526) 725 : cluster 0 pgmap v1236: 204 pgs: 204 active+clean; 4.4 MiB data, 796 MiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-03-30T15:26:38.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:37 smithi072 bash[28946]: cluster 2024-03-30T15:26:36.718701+0000 mon.a (mon.0) 3664 : cluster 0 osdmap e764: 8 total, 8 up, 8 in 2024-03-30T15:26:38.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:37 smithi072 bash[28946]: cluster 2024-03-30T15:26:37.359063+0000 mon.a (mon.0) 3665 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:26:38.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:37 smithi072 bash[28946]: audit 2024-03-30T15:26:37.560209+0000 mon.a (mon.0) 3666 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:26:38.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:37 smithi072 bash[28946]: audit 2024-03-30T15:26:37.562988+0000 mon.c (mon.2) 533 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:26:38.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:37 smithi072 bash[21573]: cluster 2024-03-30T15:26:36.368163+0000 mgr.y (mgr.14526) 725 : cluster 0 pgmap v1236: 204 pgs: 204 active+clean; 4.4 MiB data, 796 MiB used, 714 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-03-30T15:26:38.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:37 smithi072 bash[21573]: cluster 2024-03-30T15:26:36.718701+0000 mon.a (mon.0) 3664 : cluster 0 osdmap e764: 8 total, 8 up, 8 in 2024-03-30T15:26:38.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:37 smithi072 bash[21573]: cluster 2024-03-30T15:26:37.359063+0000 mon.a (mon.0) 3665 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:26:38.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:37 smithi072 bash[21573]: audit 2024-03-30T15:26:37.560209+0000 mon.a (mon.0) 3666 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:26:38.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:37 smithi072 bash[21573]: audit 2024-03-30T15:26:37.562988+0000 mon.c (mon.2) 533 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:26:39.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:38 smithi072 bash[21573]: cluster 2024-03-30T15:26:37.727645+0000 mon.a (mon.0) 3667 : cluster 0 osdmap e765: 8 total, 8 up, 8 in 2024-03-30T15:26:39.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:38 smithi072 bash[21573]: audit 2024-03-30T15:26:37.731098+0000 mon.a (mon.0) 3668 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-154","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:26:39.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:38 smithi072 bash[28946]: cluster 2024-03-30T15:26:37.727645+0000 mon.a (mon.0) 3667 : cluster 0 osdmap e765: 8 total, 8 up, 8 in 2024-03-30T15:26:39.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:38 smithi072 bash[28946]: audit 2024-03-30T15:26:37.731098+0000 mon.a (mon.0) 3668 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-154","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:26:39.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:38 smithi172 bash[23680]: cluster 2024-03-30T15:26:37.727645+0000 mon.a (mon.0) 3667 : cluster 0 osdmap e765: 8 total, 8 up, 8 in 2024-03-30T15:26:39.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:38 smithi172 bash[23680]: audit 2024-03-30T15:26:37.731098+0000 mon.a (mon.0) 3668 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-154","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-03-30T15:26:40.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:39 smithi072 bash[21573]: cluster 2024-03-30T15:26:38.368975+0000 mgr.y (mgr.14526) 726 : cluster 0 pgmap v1239: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 796 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2024-03-30T15:26:40.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:39 smithi072 bash[21573]: audit 2024-03-30T15:26:38.730704+0000 mon.a (mon.0) 3669 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-154","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:26:40.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:39 smithi072 bash[21573]: cluster 2024-03-30T15:26:38.742037+0000 mon.a (mon.0) 3670 : cluster 0 osdmap e766: 8 total, 8 up, 8 in 2024-03-30T15:26:40.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:39 smithi072 bash[21573]: audit 2024-03-30T15:26:38.747384+0000 mon.a (mon.0) 3671 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-111","var": "dedup_tier","val": "test-rados-api-smithi072-64344-154"}]: dispatch 2024-03-30T15:26:40.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:39 smithi072 bash[21573]: audit 2024-03-30T15:26:38.805161+0000 mon.a (mon.0) 3672 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:26:40.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:39 smithi072 bash[21573]: audit 2024-03-30T15:26:38.805685+0000 mon.a (mon.0) 3673 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-154"}]: dispatch 2024-03-30T15:26:40.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:39 smithi072 bash[28946]: cluster 2024-03-30T15:26:38.368975+0000 mgr.y (mgr.14526) 726 : cluster 0 pgmap v1239: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 796 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2024-03-30T15:26:40.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:39 smithi072 bash[28946]: audit 2024-03-30T15:26:38.730704+0000 mon.a (mon.0) 3669 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-154","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:26:40.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:39 smithi072 bash[28946]: cluster 2024-03-30T15:26:38.742037+0000 mon.a (mon.0) 3670 : cluster 0 osdmap e766: 8 total, 8 up, 8 in 2024-03-30T15:26:40.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:39 smithi072 bash[28946]: audit 2024-03-30T15:26:38.747384+0000 mon.a (mon.0) 3671 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-111","var": "dedup_tier","val": "test-rados-api-smithi072-64344-154"}]: dispatch 2024-03-30T15:26:40.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:39 smithi072 bash[28946]: audit 2024-03-30T15:26:38.805161+0000 mon.a (mon.0) 3672 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:26:40.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:39 smithi072 bash[28946]: audit 2024-03-30T15:26:38.805685+0000 mon.a (mon.0) 3673 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-154"}]: dispatch 2024-03-30T15:26:40.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:39 smithi172 bash[23680]: cluster 2024-03-30T15:26:38.368975+0000 mgr.y (mgr.14526) 726 : cluster 0 pgmap v1239: 204 pgs: 32 unknown, 172 active+clean; 4.4 MiB data, 796 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2024-03-30T15:26:40.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:39 smithi172 bash[23680]: audit 2024-03-30T15:26:38.730704+0000 mon.a (mon.0) 3669 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi072-64344-154","app": "rados","yes_i_really_mean_it": true}]': finished 2024-03-30T15:26:40.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:39 smithi172 bash[23680]: cluster 2024-03-30T15:26:38.742037+0000 mon.a (mon.0) 3670 : cluster 0 osdmap e766: 8 total, 8 up, 8 in 2024-03-30T15:26:40.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:39 smithi172 bash[23680]: audit 2024-03-30T15:26:38.747384+0000 mon.a (mon.0) 3671 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi072-64344-111","var": "dedup_tier","val": "test-rados-api-smithi072-64344-154"}]: dispatch 2024-03-30T15:26:40.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:39 smithi172 bash[23680]: audit 2024-03-30T15:26:38.805161+0000 mon.a (mon.0) 3672 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:26:40.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:39 smithi172 bash[23680]: audit 2024-03-30T15:26:38.805685+0000 mon.a (mon.0) 3673 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi072-64344-111", "tierpool": "test-rados-api-smithi072-64344-154"}]: dispatch 2024-03-30T15:26:41.032 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:40 smithi072 bash[21573]: cluster 2024-03-30T15:26:39.748466+0000 mon.a (mon.0) 3674 : cluster 0 osdmap e767: 8 total, 8 up, 8 in 2024-03-30T15:26:41.032 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:40 smithi072 bash[28946]: cluster 2024-03-30T15:26:39.748466+0000 mon.a (mon.0) 3674 : cluster 0 osdmap e767: 8 total, 8 up, 8 in 2024-03-30T15:26:41.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:40 smithi172 bash[23680]: cluster 2024-03-30T15:26:39.748466+0000 mon.a (mon.0) 3674 : cluster 0 osdmap e767: 8 total, 8 up, 8 in 2024-03-30T15:26:41.419 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:26:41 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:26:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:26:42.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:41 smithi072 bash[21573]: cluster 2024-03-30T15:26:40.369856+0000 mgr.y (mgr.14526) 727 : cluster 0 pgmap v1242: 172 pgs: 172 active+clean; 4.4 MiB data, 796 MiB used, 714 GiB / 715 GiB avail 2024-03-30T15:26:42.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:41 smithi072 bash[21573]: cluster 2024-03-30T15:26:40.751947+0000 mon.a (mon.0) 3675 : cluster 0 osdmap e768: 8 total, 8 up, 8 in 2024-03-30T15:26:42.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:41 smithi072 bash[21573]: audit 2024-03-30T15:26:40.754327+0000 mon.a (mon.0) 3676 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:26:42.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:41 smithi072 bash[21573]: audit 2024-03-30T15:26:41.746659+0000 mon.a (mon.0) 3677 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:26:42.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:41 smithi072 bash[28946]: cluster 2024-03-30T15:26:40.369856+0000 mgr.y (mgr.14526) 727 : cluster 0 pgmap v1242: 172 pgs: 172 active+clean; 4.4 MiB data, 796 MiB used, 714 GiB / 715 GiB avail 2024-03-30T15:26:42.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:41 smithi072 bash[28946]: cluster 2024-03-30T15:26:40.751947+0000 mon.a (mon.0) 3675 : cluster 0 osdmap e768: 8 total, 8 up, 8 in 2024-03-30T15:26:42.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:41 smithi072 bash[28946]: audit 2024-03-30T15:26:40.754327+0000 mon.a (mon.0) 3676 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:26:42.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:41 smithi072 bash[28946]: audit 2024-03-30T15:26:41.746659+0000 mon.a (mon.0) 3677 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:26:42.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:26:41 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:26:42.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:41 smithi172 bash[23680]: cluster 2024-03-30T15:26:40.369856+0000 mgr.y (mgr.14526) 727 : cluster 0 pgmap v1242: 172 pgs: 172 active+clean; 4.4 MiB data, 796 MiB used, 714 GiB / 715 GiB avail 2024-03-30T15:26:42.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:41 smithi172 bash[23680]: cluster 2024-03-30T15:26:40.751947+0000 mon.a (mon.0) 3675 : cluster 0 osdmap e768: 8 total, 8 up, 8 in 2024-03-30T15:26:42.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:41 smithi172 bash[23680]: audit 2024-03-30T15:26:40.754327+0000 mon.a (mon.0) 3676 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:26:42.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:41 smithi172 bash[23680]: audit 2024-03-30T15:26:41.746659+0000 mon.a (mon.0) 3677 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:26:42.770 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TryFlush (7763 ms) 2024-03-30T15:26:42.770 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FailedFlush 2024-03-30T15:26:42.771 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FailedFlush (13085 ms) 2024-03-30T15:26:42.771 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Flush 2024-03-30T15:26:42.771 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Flush (8107 ms) 2024-03-30T15:26:42.771 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushSnap 2024-03-30T15:26:42.771 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FlushSnap (13161 ms) 2024-03-30T15:26:42.771 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2024-03-30T15:26:42.771 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FlushTryFlushRaces (7673 ms) 2024-03-30T15:26:42.771 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlushReadRace 2024-03-30T15:26:42.771 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TryFlushReadRace (8073 ms) 2024-03-30T15:26:42.771 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetRead 2024-03-30T15:26:42.771 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: hmm, no HitSet yet 2024-03-30T15:26:42.771 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: ok, hit_set contains 337:602f83fe:::foo:head 2024-03-30T15:26:42.772 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.HitSetRead (9066 ms) 2024-03-30T15:26:42.772 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetTrim 2024-03-30T15:26:42.772 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: got ls 1711812317,0 2024-03-30T15:26:42.772 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: first is 1711812317 2024-03-30T15:26:42.772 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: got ls 1711812317,0 2024-03-30T15:26:42.772 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: got ls 1711812317,0 2024-03-30T15:26:42.772 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: got ls 1711812317,1711812319,1711812320,0 2024-03-30T15:26:42.772 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: got ls 1711812317,1711812319,1711812320,0 2024-03-30T15:26:42.772 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: got ls 1711812317,1711812319,1711812320,0 2024-03-30T15:26:42.772 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: got ls 1711812317,1711812319,1711812320,1711812322,1711812323,0 2024-03-30T15:26:42.772 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: got ls 1711812317,1711812319,1711812320,1711812322,1711812323,0 2024-03-30T15:26:42.772 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: got ls 1711812317,1711812319,1711812320,1711812322,1711812323,0 2024-03-30T15:26:42.772 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: got ls 1711812317,1711812319,1711812320,1711812322,1711812323,1711812325,1711812326,0 2024-03-30T15:26:42.773 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: got ls 1711812317,1711812319,1711812320,1711812322,1711812323,1711812325,1711812326,0 2024-03-30T15:26:42.773 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: got ls 1711812317,1711812319,1711812320,1711812322,1711812323,1711812325,1711812326,0 2024-03-30T15:26:42.773 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: got ls 1711812320,1711812322,1711812323,1711812325,1711812326,1711812328,1711812329,0 2024-03-30T15:26:42.773 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: first now 1711812320, trimmed 2024-03-30T15:26:42.773 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.HitSetTrim (21091 ms) 2024-03-30T15:26:42.773 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2024-03-30T15:26:42.773 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: foo0 2024-03-30T15:26:42.773 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: verifying foo0 is eventually promoted 2024-03-30T15:26:42.773 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteOn2ndRead (14119 ms) 2024-03-30T15:26:42.773 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ProxyRead 2024-03-30T15:26:42.773 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.ProxyRead (18150 ms) 2024-03-30T15:26:42.773 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.CachePin 2024-03-30T15:26:42.774 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.CachePin (22683 ms) 2024-03-30T15:26:42.774 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetRedirectRead 2024-03-30T15:26:42.774 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.SetRedirectRead (5076 ms) 2024-03-30T15:26:42.774 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetChunkRead 2024-03-30T15:26:42.774 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.SetChunkRead (3035 ms) 2024-03-30T15:26:42.774 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2024-03-30T15:26:42.774 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.ManifestPromoteRead (3048 ms) 2024-03-30T15:26:42.774 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TrySetDedupTier 2024-03-30T15:26:42.774 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TrySetDedupTier (3028 ms) 2024-03-30T15:26:42.774 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP (233830 ms total) 2024-03-30T15:26:42.774 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: 2024-03-30T15:26:42.774 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [----------] Global test environment tear-down 2024-03-30T15:26:42.774 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [==========] 77 tests from 4 test suites ran. (890724 ms total) 2024-03-30T15:26:42.775 INFO:tasks.workunit.client.0.smithi072.stdout: api_tier_pp: [ PASSED ] 77 tests. 2024-03-30T15:26:42.779 INFO:tasks.workunit.client.0.smithi072.stderr:+ for t in "${!pids[@]}" 2024-03-30T15:26:42.780 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64190 2024-03-30T15:26:42.780 INFO:tasks.workunit.client.0.smithi072.stderr:+ wait 64190 2024-03-30T15:26:42.780 INFO:tasks.workunit.client.0.smithi072.stderr:+ for t in "${!pids[@]}" 2024-03-30T15:26:42.780 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64371 2024-03-30T15:26:42.780 INFO:tasks.workunit.client.0.smithi072.stderr:+ wait 64371 2024-03-30T15:26:42.780 INFO:tasks.workunit.client.0.smithi072.stderr:+ for t in "${!pids[@]}" 2024-03-30T15:26:42.780 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64681 2024-03-30T15:26:42.780 INFO:tasks.workunit.client.0.smithi072.stderr:+ wait 64681 2024-03-30T15:26:42.780 INFO:tasks.workunit.client.0.smithi072.stderr:+ for t in "${!pids[@]}" 2024-03-30T15:26:42.780 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64514 2024-03-30T15:26:42.780 INFO:tasks.workunit.client.0.smithi072.stderr:+ wait 64514 2024-03-30T15:26:42.780 INFO:tasks.workunit.client.0.smithi072.stderr:+ for t in "${!pids[@]}" 2024-03-30T15:26:42.780 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64423 2024-03-30T15:26:42.781 INFO:tasks.workunit.client.0.smithi072.stderr:+ wait 64423 2024-03-30T15:26:42.781 INFO:tasks.workunit.client.0.smithi072.stderr:+ for t in "${!pids[@]}" 2024-03-30T15:26:42.781 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64292 2024-03-30T15:26:42.781 INFO:tasks.workunit.client.0.smithi072.stderr:+ wait 64292 2024-03-30T15:26:42.781 INFO:tasks.workunit.client.0.smithi072.stderr:+ for t in "${!pids[@]}" 2024-03-30T15:26:42.781 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64474 2024-03-30T15:26:42.781 INFO:tasks.workunit.client.0.smithi072.stderr:+ wait 64474 2024-03-30T15:26:42.781 INFO:tasks.workunit.client.0.smithi072.stderr:+ for t in "${!pids[@]}" 2024-03-30T15:26:42.781 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64808 2024-03-30T15:26:42.781 INFO:tasks.workunit.client.0.smithi072.stderr:+ wait 64808 2024-03-30T15:26:42.781 INFO:tasks.workunit.client.0.smithi072.stderr:+ for t in "${!pids[@]}" 2024-03-30T15:26:42.781 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64823 2024-03-30T15:26:42.781 INFO:tasks.workunit.client.0.smithi072.stderr:+ wait 64823 2024-03-30T15:26:42.781 INFO:tasks.workunit.client.0.smithi072.stderr:+ for t in "${!pids[@]}" 2024-03-30T15:26:42.782 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64309 2024-03-30T15:26:42.782 INFO:tasks.workunit.client.0.smithi072.stderr:+ wait 64309 2024-03-30T15:26:42.782 INFO:tasks.workunit.client.0.smithi072.stderr:+ for t in "${!pids[@]}" 2024-03-30T15:26:42.782 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64692 2024-03-30T15:26:42.782 INFO:tasks.workunit.client.0.smithi072.stderr:+ wait 64692 2024-03-30T15:26:42.782 INFO:tasks.workunit.client.0.smithi072.stderr:+ for t in "${!pids[@]}" 2024-03-30T15:26:42.782 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64594 2024-03-30T15:26:42.782 INFO:tasks.workunit.client.0.smithi072.stderr:+ wait 64594 2024-03-30T15:26:42.782 INFO:tasks.workunit.client.0.smithi072.stderr:+ for t in "${!pids[@]}" 2024-03-30T15:26:42.782 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64174 2024-03-30T15:26:42.782 INFO:tasks.workunit.client.0.smithi072.stderr:+ wait 64174 2024-03-30T15:26:42.782 INFO:tasks.workunit.client.0.smithi072.stderr:+ for t in "${!pids[@]}" 2024-03-30T15:26:42.782 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64206 2024-03-30T15:26:42.783 INFO:tasks.workunit.client.0.smithi072.stderr:+ wait 64206 2024-03-30T15:26:42.783 INFO:tasks.workunit.client.0.smithi072.stderr:+ for t in "${!pids[@]}" 2024-03-30T15:26:42.783 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64618 2024-03-30T15:26:42.783 INFO:tasks.workunit.client.0.smithi072.stderr:+ wait 64618 2024-03-30T15:26:42.783 INFO:tasks.workunit.client.0.smithi072.stderr:+ for t in "${!pids[@]}" 2024-03-30T15:26:42.783 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64166 2024-03-30T15:26:42.783 INFO:tasks.workunit.client.0.smithi072.stderr:+ wait 64166 2024-03-30T15:26:42.783 INFO:tasks.workunit.client.0.smithi072.stderr:+ for t in "${!pids[@]}" 2024-03-30T15:26:42.783 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64182 2024-03-30T15:26:42.783 INFO:tasks.workunit.client.0.smithi072.stderr:+ wait 64182 2024-03-30T15:26:42.783 INFO:tasks.workunit.client.0.smithi072.stderr:+ for t in "${!pids[@]}" 2024-03-30T15:26:42.783 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64876 2024-03-30T15:26:42.783 INFO:tasks.workunit.client.0.smithi072.stderr:+ wait 64876 2024-03-30T15:26:42.783 INFO:tasks.workunit.client.0.smithi072.stderr:+ for t in "${!pids[@]}" 2024-03-30T15:26:42.783 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64384 2024-03-30T15:26:42.784 INFO:tasks.workunit.client.0.smithi072.stderr:+ wait 64384 2024-03-30T15:26:42.784 INFO:tasks.workunit.client.0.smithi072.stderr:+ for t in "${!pids[@]}" 2024-03-30T15:26:42.784 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64935 2024-03-30T15:26:42.784 INFO:tasks.workunit.client.0.smithi072.stderr:+ wait 64935 2024-03-30T15:26:42.784 INFO:tasks.workunit.client.0.smithi072.stderr:+ for t in "${!pids[@]}" 2024-03-30T15:26:42.784 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64442 2024-03-30T15:26:42.784 INFO:tasks.workunit.client.0.smithi072.stderr:+ wait 64442 2024-03-30T15:26:42.784 INFO:tasks.workunit.client.0.smithi072.stderr:+ for t in "${!pids[@]}" 2024-03-30T15:26:42.784 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64768 2024-03-30T15:26:42.784 INFO:tasks.workunit.client.0.smithi072.stderr:+ wait 64768 2024-03-30T15:26:42.785 INFO:tasks.workunit.client.0.smithi072.stderr:+ for t in "${!pids[@]}" 2024-03-30T15:26:42.785 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64967 2024-03-30T15:26:42.785 INFO:tasks.workunit.client.0.smithi072.stderr:+ wait 64967 2024-03-30T15:26:42.785 INFO:tasks.workunit.client.0.smithi072.stderr:+ for t in "${!pids[@]}" 2024-03-30T15:26:42.785 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64396 2024-03-30T15:26:42.785 INFO:tasks.workunit.client.0.smithi072.stderr:+ wait 64396 2024-03-30T15:26:42.785 INFO:tasks.workunit.client.0.smithi072.stderr:+ for t in "${!pids[@]}" 2024-03-30T15:26:42.785 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64631 2024-03-30T15:26:42.785 INFO:tasks.workunit.client.0.smithi072.stderr:+ wait 64631 2024-03-30T15:26:42.785 INFO:tasks.workunit.client.0.smithi072.stderr:+ for t in "${!pids[@]}" 2024-03-30T15:26:42.785 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64863 2024-03-30T15:26:42.785 INFO:tasks.workunit.client.0.smithi072.stderr:+ wait 64863 2024-03-30T15:26:42.785 INFO:tasks.workunit.client.0.smithi072.stderr:+ for t in "${!pids[@]}" 2024-03-30T15:26:42.785 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64715 2024-03-30T15:26:42.785 INFO:tasks.workunit.client.0.smithi072.stderr:+ wait 64715 2024-03-30T15:26:42.786 INFO:tasks.workunit.client.0.smithi072.stderr:+ for t in "${!pids[@]}" 2024-03-30T15:26:42.786 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64905 2024-03-30T15:26:42.786 INFO:tasks.workunit.client.0.smithi072.stderr:+ wait 64905 2024-03-30T15:26:42.786 INFO:tasks.workunit.client.0.smithi072.stderr:+ for t in "${!pids[@]}" 2024-03-30T15:26:42.786 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64569 2024-03-30T15:26:42.786 INFO:tasks.workunit.client.0.smithi072.stderr:+ wait 64569 2024-03-30T15:26:42.786 INFO:tasks.workunit.client.0.smithi072.stderr:+ for t in "${!pids[@]}" 2024-03-30T15:26:42.786 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64357 2024-03-30T15:26:42.786 INFO:tasks.workunit.client.0.smithi072.stderr:+ wait 64357 2024-03-30T15:26:42.786 INFO:tasks.workunit.client.0.smithi072.stderr:+ for t in "${!pids[@]}" 2024-03-30T15:26:42.786 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64944 2024-03-30T15:26:42.787 INFO:tasks.workunit.client.0.smithi072.stderr:+ wait 64944 2024-03-30T15:26:42.787 INFO:tasks.workunit.client.0.smithi072.stderr:+ for t in "${!pids[@]}" 2024-03-30T15:26:42.787 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64519 2024-03-30T15:26:42.787 INFO:tasks.workunit.client.0.smithi072.stderr:+ wait 64519 2024-03-30T15:26:42.787 INFO:tasks.workunit.client.0.smithi072.stderr:+ for t in "${!pids[@]}" 2024-03-30T15:26:42.787 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64158 2024-03-30T15:26:42.787 INFO:tasks.workunit.client.0.smithi072.stderr:+ wait 64158 2024-03-30T15:26:42.787 INFO:tasks.workunit.client.0.smithi072.stderr:+ for t in "${!pids[@]}" 2024-03-30T15:26:42.787 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64198 2024-03-30T15:26:42.787 INFO:tasks.workunit.client.0.smithi072.stderr:+ wait 64198 2024-03-30T15:26:42.787 INFO:tasks.workunit.client.0.smithi072.stderr:+ for t in "${!pids[@]}" 2024-03-30T15:26:42.787 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64499 2024-03-30T15:26:42.787 INFO:tasks.workunit.client.0.smithi072.stderr:+ wait 64499 2024-03-30T15:26:42.787 INFO:tasks.workunit.client.0.smithi072.stderr:+ for t in "${!pids[@]}" 2024-03-30T15:26:42.788 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64229 2024-03-30T15:26:42.788 INFO:tasks.workunit.client.0.smithi072.stderr:+ wait 64229 2024-03-30T15:26:42.788 INFO:tasks.workunit.client.0.smithi072.stderr:+ for t in "${!pids[@]}" 2024-03-30T15:26:42.788 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64545 2024-03-30T15:26:42.788 INFO:tasks.workunit.client.0.smithi072.stderr:+ wait 64545 2024-03-30T15:26:42.788 INFO:tasks.workunit.client.0.smithi072.stderr:+ for t in "${!pids[@]}" 2024-03-30T15:26:42.788 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64554 2024-03-30T15:26:42.788 INFO:tasks.workunit.client.0.smithi072.stderr:+ wait 64554 2024-03-30T15:26:42.788 INFO:tasks.workunit.client.0.smithi072.stderr:+ for t in "${!pids[@]}" 2024-03-30T15:26:42.788 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=64853 2024-03-30T15:26:42.788 INFO:tasks.workunit.client.0.smithi072.stderr:+ wait 64853 2024-03-30T15:26:42.788 INFO:tasks.workunit.client.0.smithi072.stderr:+ for t in "${!pids[@]}" 2024-03-30T15:26:42.788 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=65000 2024-03-30T15:26:42.788 INFO:tasks.workunit.client.0.smithi072.stderr:+ wait 65000 2024-03-30T15:26:42.789 INFO:tasks.workunit.client.0.smithi072.stderr:+ exit 0 2024-03-30T15:26:42.789 INFO:tasks.workunit.client.0.smithi072.stderr:+ cleanup 2024-03-30T15:26:42.789 INFO:tasks.workunit.client.0.smithi072.stderr:+ pkill -P 64152 2024-03-30T15:26:42.793 INFO:tasks.workunit.client.0.smithi072.stderr:+ true 2024-03-30T15:26:42.794 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-30T15:26:42.794 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-30T15:26:42.808 INFO:tasks.workunit:Running workunits matching rados/test_pool_quota.sh on client.0... 2024-03-30T15:26:42.809 INFO:tasks.workunit:Running workunit rados/test_pool_quota.sh... 2024-03-30T15:26:42.810 DEBUG:teuthology.orchestra.run.smithi072:workunit test rados/test_pool_quota.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5af0400050a123dc31f105425174f106e057276a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_pool_quota.sh 2024-03-30T15:26:42.874 INFO:tasks.workunit.client.0.smithi072.stderr:+ uuidgen 2024-03-30T15:26:42.876 INFO:tasks.workunit.client.0.smithi072.stderr:+ p=4e694c24-7f59-49ba-b14c-a8866b9195f4 2024-03-30T15:26:42.876 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph osd pool create 4e694c24-7f59-49ba-b14c-a8866b9195f4 12 2024-03-30T15:26:43.004 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.004+0000 7f3f36829640 1 -- 172.21.15.72:0/684199657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f3010bcd0 msgr2=0x7f3f3010e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:26:43.004 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.004+0000 7f3f36829640 1 --2- 172.21.15.72:0/684199657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f3010bcd0 0x7f3f3010e170 secure :-1 s=READY pgs=2373 cs=0 l=1 rev1=1 crypto rx=0x7f3f28009bf0 tx=0x7f3f2801cb30 comp rx=0 tx=0).stop 2024-03-30T15:26:43.005 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.004+0000 7f3f36829640 1 -- 172.21.15.72:0/684199657 shutdown_connections 2024-03-30T15:26:43.005 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.004+0000 7f3f36829640 1 --2- 172.21.15.72:0/684199657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f3010bcd0 0x7f3f3010e170 unknown :-1 s=CLOSED pgs=2373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:26:43.005 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.004+0000 7f3f36829640 1 --2- 172.21.15.72:0/684199657 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3f301031c0 0x7f3f3010b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:26:43.005 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.004+0000 7f3f36829640 1 --2- 172.21.15.72:0/684199657 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f301028a0 0x7f3f30102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:26:43.005 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.004+0000 7f3f36829640 1 -- 172.21.15.72:0/684199657 >> 172.21.15.72:0/684199657 conn(0x7f3f300fc110 msgr2=0x7f3f300fe530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:26:43.005 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.004+0000 7f3f36829640 1 -- 172.21.15.72:0/684199657 shutdown_connections 2024-03-30T15:26:43.005 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.004+0000 7f3f36829640 1 -- 172.21.15.72:0/684199657 wait complete. 2024-03-30T15:26:43.005 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.004+0000 7f3f36829640 1 Processor -- start 2024-03-30T15:26:43.005 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.004+0000 7f3f36829640 1 -- start start 2024-03-30T15:26:43.005 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.004+0000 7f3f36829640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f301028a0 0x7f3f3019f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:26:43.005 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.004+0000 7f3f36829640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3f301031c0 0x7f3f3019fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:26:43.005 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.004+0000 7f3f36829640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f3010bcd0 0x7f3f30199ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:26:43.005 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.004+0000 7f3f36829640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f3f30113710 con 0x7f3f301028a0 2024-03-30T15:26:43.006 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.004+0000 7f3f36829640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3f30113590 con 0x7f3f3010bcd0 2024-03-30T15:26:43.006 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.004+0000 7f3f36829640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f3f30113890 con 0x7f3f301031c0 2024-03-30T15:26:43.006 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.004+0000 7f3f2ffff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f301028a0 0x7f3f3019f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:26:43.006 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.004+0000 7f3f27fff640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3f301031c0 0x7f3f3019fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:26:43.006 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.004+0000 7f3f2ffff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f301028a0 0x7f3f3019f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43438/0 (socket says 172.21.15.72:43438) 2024-03-30T15:26:43.006 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.004+0000 7f3f2ffff640 1 -- 172.21.15.72:0/1111560951 learned_addr learned my addr 172.21.15.72:0/1111560951 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T15:26:43.006 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.004+0000 7f3f27fff640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3f301031c0 0x7f3f3019fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:35230/0 (socket says 172.21.15.72:35230) 2024-03-30T15:26:43.006 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.004+0000 7f3f34dc6640 1 --2- 172.21.15.72:0/1111560951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f3010bcd0 0x7f3f30199ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:26:43.006 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.004+0000 7f3f27fff640 1 -- 172.21.15.72:0/1111560951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f3010bcd0 msgr2=0x7f3f30199ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:26:43.006 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.004+0000 7f3f27fff640 1 --2- 172.21.15.72:0/1111560951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f3010bcd0 0x7f3f30199ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:26:43.006 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.004+0000 7f3f27fff640 1 -- 172.21.15.72:0/1111560951 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f301028a0 msgr2=0x7f3f3019f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:26:43.006 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.004+0000 7f3f27fff640 1 --2- 172.21.15.72:0/1111560951 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f301028a0 0x7f3f3019f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:26:43.006 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.004+0000 7f3f27fff640 1 -- 172.21.15.72:0/1111560951 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f3019a1f0 con 0x7f3f301031c0 2024-03-30T15:26:43.007 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.004+0000 7f3f2ffff640 1 --2- 172.21.15.72:0/1111560951 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f301028a0 0x7f3f3019f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T15:26:43.007 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.004+0000 7f3f27fff640 1 --2- 172.21.15.72:0/1111560951 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3f301031c0 0x7f3f3019fe40 secure :-1 s=READY pgs=3245 cs=0 l=1 rev1=1 crypto rx=0x7f3f1800e910 tx=0x7f3f1800edd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:26:43.007 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.004+0000 7f3f2dffb640 1 -- 172.21.15.72:0/1111560951 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f18004440 con 0x7f3f301031c0 2024-03-30T15:26:43.007 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.004+0000 7f3f2dffb640 1 -- 172.21.15.72:0/1111560951 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f3f1800cdf0 con 0x7f3f301031c0 2024-03-30T15:26:43.007 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.004+0000 7f3f36829640 1 -- 172.21.15.72:0/1111560951 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f3019a4e0 con 0x7f3f301031c0 2024-03-30T15:26:43.007 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.004+0000 7f3f2dffb640 1 -- 172.21.15.72:0/1111560951 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f18019480 con 0x7f3f301031c0 2024-03-30T15:26:43.007 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.004+0000 7f3f36829640 1 -- 172.21.15.72:0/1111560951 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f30100430 con 0x7f3f301031c0 2024-03-30T15:26:43.009 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.004+0000 7f3f36829640 1 -- 172.21.15.72:0/1111560951 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f30068a90 con 0x7f3f301031c0 2024-03-30T15:26:43.009 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.008+0000 7f3f2dffb640 1 -- 172.21.15.72:0/1111560951 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 21) ==== 91831+0+0 (secure 0 0 0) 0x7f3f1800c970 con 0x7f3f301031c0 2024-03-30T15:26:43.009 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.008+0000 7f3f2dffb640 1 --2- 172.21.15.72:0/1111560951 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f3f1c06dbc0 0x7f3f1c070080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:26:43.009 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.008+0000 7f3f2ffff640 1 --2- 172.21.15.72:0/1111560951 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f3f1c06dbc0 0x7f3f1c070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:26:43.009 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.008+0000 7f3f2dffb640 1 -- 172.21.15.72:0/1111560951 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(770..770 src has 269..770) ==== 8708+0+0 (secure 0 0 0) 0x7f3f1808e9a0 con 0x7f3f301031c0 2024-03-30T15:26:43.009 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.008+0000 7f3f2ffff640 1 --2- 172.21.15.72:0/1111560951 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f3f1c06dbc0 0x7f3f1c070080 secure :-1 s=READY pgs=3211 cs=0 l=1 rev1=1 crypto rx=0x7f3f3019ac00 tx=0x7f3f2000f890 comp rx=0 tx=0).ready entity=mgr.14526 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:26:43.011 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.012+0000 7f3f2dffb640 1 -- 172.21.15.72:0/1111560951 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f3f1805baa0 con 0x7f3f301031c0 2024-03-30T15:26:43.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:42 smithi072 bash[21573]: cluster 2024-03-30T15:26:41.756870+0000 mon.a (mon.0) 3678 : cluster 0 osdmap e769: 8 total, 8 up, 8 in 2024-03-30T15:26:43.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:42 smithi072 bash[21573]: audit 2024-03-30T15:26:41.761428+0000 mon.a (mon.0) 3679 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:26:43.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:42 smithi072 bash[21573]: audit 2024-03-30T15:26:41.773304+0000 mgr.y (mgr.14526) 728 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:26:43.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:42 smithi072 bash[21573]: audit 2024-03-30T15:26:42.750027+0000 mon.a (mon.0) 3680 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:26:43.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:42 smithi072 bash[21573]: cluster 2024-03-30T15:26:42.757818+0000 mon.a (mon.0) 3681 : cluster 0 osdmap e770: 8 total, 8 up, 8 in 2024-03-30T15:26:43.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:42 smithi072 bash[28946]: cluster 2024-03-30T15:26:41.756870+0000 mon.a (mon.0) 3678 : cluster 0 osdmap e769: 8 total, 8 up, 8 in 2024-03-30T15:26:43.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:42 smithi072 bash[28946]: audit 2024-03-30T15:26:41.761428+0000 mon.a (mon.0) 3679 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:26:43.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:42 smithi072 bash[28946]: audit 2024-03-30T15:26:41.773304+0000 mgr.y (mgr.14526) 728 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:26:43.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:42 smithi072 bash[28946]: audit 2024-03-30T15:26:42.750027+0000 mon.a (mon.0) 3680 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:26:43.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:42 smithi072 bash[28946]: cluster 2024-03-30T15:26:42.757818+0000 mon.a (mon.0) 3681 : cluster 0 osdmap e770: 8 total, 8 up, 8 in 2024-03-30T15:26:43.183 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.184+0000 7f3f36829640 1 -- 172.21.15.72:0/1111560951 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "pg_num": 12} v 0) -- 0x7f3f301006f0 con 0x7f3f301031c0 2024-03-30T15:26:43.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:42 smithi172 bash[23680]: cluster 2024-03-30T15:26:41.756870+0000 mon.a (mon.0) 3678 : cluster 0 osdmap e769: 8 total, 8 up, 8 in 2024-03-30T15:26:43.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:42 smithi172 bash[23680]: audit 2024-03-30T15:26:41.761428+0000 mon.a (mon.0) 3679 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi072-64344-111"}]: dispatch 2024-03-30T15:26:43.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:42 smithi172 bash[23680]: audit 2024-03-30T15:26:41.773304+0000 mgr.y (mgr.14526) 728 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:26:43.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:42 smithi172 bash[23680]: audit 2024-03-30T15:26:42.750027+0000 mon.a (mon.0) 3680 : audit 1 from='client.? 172.21.15.72:0/4026898706' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi072-64344-111"}]': finished 2024-03-30T15:26:43.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:42 smithi172 bash[23680]: cluster 2024-03-30T15:26:42.757818+0000 mon.a (mon.0) 3681 : cluster 0 osdmap e770: 8 total, 8 up, 8 in 2024-03-30T15:26:43.785 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.784+0000 7f3f2dffb640 1 -- 172.21.15.72:0/1111560951 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "pg_num": 12}]=0 pool '4e694c24-7f59-49ba-b14c-a8866b9195f4' created v771) ==== 176+0+0 (secure 0 0 0) 0x7f3f1805f4f0 con 0x7f3f301031c0 2024-03-30T15:26:43.897 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.896+0000 7f3f36829640 1 -- 172.21.15.72:0/1111560951 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "pg_num": 12} v 0) -- 0x7f3f301008c0 con 0x7f3f301031c0 2024-03-30T15:26:43.897 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.900+0000 7f3f2dffb640 1 -- 172.21.15.72:0/1111560951 <== mon.2 v2:172.21.15.72:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "pg_num": 12}]=0 pool '4e694c24-7f59-49ba-b14c-a8866b9195f4' already exists v771) ==== 183+0+0 (secure 0 0 0) 0x7f3f18063d20 con 0x7f3f301031c0 2024-03-30T15:26:43.898 INFO:tasks.workunit.client.0.smithi072.stderr:pool '4e694c24-7f59-49ba-b14c-a8866b9195f4' already exists 2024-03-30T15:26:43.900 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.900+0000 7f3f36829640 1 -- 172.21.15.72:0/1111560951 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f3f1c06dbc0 msgr2=0x7f3f1c070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:26:43.900 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.900+0000 7f3f36829640 1 --2- 172.21.15.72:0/1111560951 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f3f1c06dbc0 0x7f3f1c070080 secure :-1 s=READY pgs=3211 cs=0 l=1 rev1=1 crypto rx=0x7f3f3019ac00 tx=0x7f3f2000f890 comp rx=0 tx=0).stop 2024-03-30T15:26:43.900 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.900+0000 7f3f36829640 1 -- 172.21.15.72:0/1111560951 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3f301031c0 msgr2=0x7f3f3019fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:26:43.900 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.900+0000 7f3f36829640 1 --2- 172.21.15.72:0/1111560951 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3f301031c0 0x7f3f3019fe40 secure :-1 s=READY pgs=3245 cs=0 l=1 rev1=1 crypto rx=0x7f3f1800e910 tx=0x7f3f1800edd0 comp rx=0 tx=0).stop 2024-03-30T15:26:43.901 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.900+0000 7f3f36829640 1 -- 172.21.15.72:0/1111560951 shutdown_connections 2024-03-30T15:26:43.901 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.900+0000 7f3f36829640 1 --2- 172.21.15.72:0/1111560951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f3010bcd0 0x7f3f30199ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:26:43.901 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.900+0000 7f3f36829640 1 --2- 172.21.15.72:0/1111560951 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3f301031c0 0x7f3f3019fe40 unknown :-1 s=CLOSED pgs=3245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:26:43.901 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.900+0000 7f3f36829640 1 --2- 172.21.15.72:0/1111560951 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f3f1c06dbc0 0x7f3f1c070080 unknown :-1 s=CLOSED pgs=3211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:26:43.901 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.900+0000 7f3f36829640 1 --2- 172.21.15.72:0/1111560951 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f301028a0 0x7f3f3019f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:26:43.901 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.900+0000 7f3f36829640 1 -- 172.21.15.72:0/1111560951 >> 172.21.15.72:0/1111560951 conn(0x7f3f300fc110 msgr2=0x7f3f3010d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:26:43.901 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.900+0000 7f3f36829640 1 -- 172.21.15.72:0/1111560951 shutdown_connections 2024-03-30T15:26:43.901 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:43.900+0000 7f3f36829640 1 -- 172.21.15.72:0/1111560951 wait complete. 2024-03-30T15:26:43.915 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph osd pool set-quota 4e694c24-7f59-49ba-b14c-a8866b9195f4 max_objects 10 2024-03-30T15:26:44.039 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:44.036+0000 7f61b4e06640 1 -- 172.21.15.72:0/1068777603 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f61b01020c0 msgr2=0x7f61b010e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:26:44.039 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:44.036+0000 7f61b4e06640 1 --2- 172.21.15.72:0/1068777603 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f61b01020c0 0x7f61b010e5d0 secure :-1 s=READY pgs=3246 cs=0 l=1 rev1=1 crypto rx=0x7f61a8009ce0 tx=0x7f61a801cc80 comp rx=0 tx=0).stop 2024-03-30T15:26:44.039 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:44.036+0000 7f61b4e06640 1 -- 172.21.15.72:0/1068777603 shutdown_connections 2024-03-30T15:26:44.039 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:44.036+0000 7f61b4e06640 1 --2- 172.21.15.72:0/1068777603 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f61b01020c0 0x7f61b010e5d0 unknown :-1 s=CLOSED pgs=3246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:26:44.039 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:44.036+0000 7f61b4e06640 1 --2- 172.21.15.72:0/1068777603 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61b0101700 0x7f61b0101b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:26:44.039 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:44.036+0000 7f61b4e06640 1 --2- 172.21.15.72:0/1068777603 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61b0107700 0x7f61b0107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:26:44.039 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:44.036+0000 7f61b4e06640 1 -- 172.21.15.72:0/1068777603 >> 172.21.15.72:0/1068777603 conn(0x7f61b00fd210 msgr2=0x7f61b00ff630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:26:44.039 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:44.036+0000 7f61b4e06640 1 -- 172.21.15.72:0/1068777603 shutdown_connections 2024-03-30T15:26:44.039 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:44.036+0000 7f61b4e06640 1 -- 172.21.15.72:0/1068777603 wait complete. 2024-03-30T15:26:44.040 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:44.036+0000 7f61b4e06640 1 Processor -- start 2024-03-30T15:26:44.040 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:44.040+0000 7f61b4e06640 1 -- start start 2024-03-30T15:26:44.040 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:44.040+0000 7f61b4e06640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f61b0101700 0x7f61b019f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:26:44.040 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:44.040+0000 7f61b4e06640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61b01020c0 0x7f61b019fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:26:44.040 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:44.040+0000 7f61b4e06640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61b0107700 0x7f61b0199a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:26:44.040 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:44.040+0000 7f61b4e06640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f61b01136f0 con 0x7f61b01020c0 2024-03-30T15:26:44.040 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:44.040+0000 7f61b4e06640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f61b0113570 con 0x7f61b0107700 2024-03-30T15:26:44.040 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:44.040+0000 7f61b4e06640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f61b0113870 con 0x7f61b0101700 2024-03-30T15:26:44.040 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:44.040+0000 7f61ae59c640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f61b0101700 0x7f61b019f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:26:44.040 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:44.040+0000 7f61a7fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61b01020c0 0x7f61b019fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:26:44.040 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:44.040+0000 7f61a7fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61b01020c0 0x7f61b019fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43446/0 (socket says 172.21.15.72:43446) 2024-03-30T15:26:44.040 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:44.040+0000 7f61ae59c640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f61b0101700 0x7f61b019f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:35242/0 (socket says 172.21.15.72:35242) 2024-03-30T15:26:44.040 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:44.040+0000 7f61a7fff640 1 -- 172.21.15.72:0/1627774926 learned_addr learned my addr 172.21.15.72:0/1627774926 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T15:26:44.040 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:44.040+0000 7f61a7fff640 1 -- 172.21.15.72:0/1627774926 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f61b0101700 msgr2=0x7f61b019f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:26:44.040 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:44.040+0000 7f61a7fff640 1 --2- 172.21.15.72:0/1627774926 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f61b0101700 0x7f61b019f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:26:44.041 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:44.040+0000 7f61a7fff640 1 -- 172.21.15.72:0/1627774926 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61b0107700 msgr2=0x7f61b0199a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:26:44.041 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:44.040+0000 7f61a7fff640 1 --2- 172.21.15.72:0/1627774926 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61b0107700 0x7f61b0199a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:26:44.041 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:44.040+0000 7f61a7fff640 1 -- 172.21.15.72:0/1627774926 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61b019a1b0 con 0x7f61b01020c0 2024-03-30T15:26:44.041 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:44.040+0000 7f61ae59c640 1 --2- 172.21.15.72:0/1627774926 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f61b0101700 0x7f61b019f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T15:26:44.041 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:44.040+0000 7f61a7fff640 1 --2- 172.21.15.72:0/1627774926 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61b01020c0 0x7f61b019fe00 secure :-1 s=READY pgs=2374 cs=0 l=1 rev1=1 crypto rx=0x7f619800ea10 tx=0x7f619800eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:26:44.041 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:44.040+0000 7f61a77fe640 1 -- 172.21.15.72:0/1627774926 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f619800cde0 con 0x7f61b01020c0 2024-03-30T15:26:44.041 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:44.040+0000 7f61b4e06640 1 -- 172.21.15.72:0/1627774926 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61b019a4a0 con 0x7f61b01020c0 2024-03-30T15:26:44.041 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:44.040+0000 7f61a77fe640 1 -- 172.21.15.72:0/1627774926 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f61980044a0 con 0x7f61b01020c0 2024-03-30T15:26:44.041 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:44.040+0000 7f61a77fe640 1 -- 172.21.15.72:0/1627774926 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6198010430 con 0x7f61b01020c0 2024-03-30T15:26:44.041 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:44.040+0000 7f61b4e06640 1 -- 172.21.15.72:0/1627774926 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61b01a6790 con 0x7f61b01020c0 2024-03-30T15:26:44.042 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:44.040+0000 7f61b4e06640 1 -- 172.21.15.72:0/1627774926 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61b0068a90 con 0x7f61b01020c0 2024-03-30T15:26:44.042 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:44.040+0000 7f61a77fe640 1 -- 172.21.15.72:0/1627774926 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 21) ==== 91831+0+0 (secure 0 0 0) 0x7f6198003fa0 con 0x7f61b01020c0 2024-03-30T15:26:44.042 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:44.040+0000 7f61a77fe640 1 --2- 172.21.15.72:0/1627774926 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f619c06dbc0 0x7f619c070080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:26:44.042 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:44.040+0000 7f61ae59c640 1 --2- 172.21.15.72:0/1627774926 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f619c06dbc0 0x7f619c070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:26:44.042 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:44.040+0000 7f61a77fe640 1 -- 172.21.15.72:0/1627774926 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(771..771 src has 269..771) ==== 9083+0+0 (secure 0 0 0) 0x7f619808ea10 con 0x7f61b01020c0 2024-03-30T15:26:44.042 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:44.040+0000 7f61ae59c640 1 --2- 172.21.15.72:0/1627774926 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f619c06dbc0 0x7f619c070080 secure :-1 s=READY pgs=3212 cs=0 l=1 rev1=1 crypto rx=0x7f61b019abc0 tx=0x7f61a000a2d0 comp rx=0 tx=0).ready entity=mgr.14526 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:26:44.045 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:44.044+0000 7f61a77fe640 1 -- 172.21.15.72:0/1627774926 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f619805b9a0 con 0x7f61b01020c0 2024-03-30T15:26:44.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:43 smithi072 bash[21573]: cluster 2024-03-30T15:26:42.370651+0000 mgr.y (mgr.14526) 729 : cluster 0 pgmap v1245: 164 pgs: 164 active+clean; 582 KiB data, 806 MiB used, 714 GiB / 715 GiB avail 2024-03-30T15:26:44.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:43 smithi072 bash[21573]: cluster 2024-03-30T15:26:42.764987+0000 mon.a (mon.0) 3682 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:26:44.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:43 smithi072 bash[21573]: audit 2024-03-30T15:26:43.187058+0000 mon.c (mon.2) 534 : audit 1 from='client.? 172.21.15.72:0/1111560951' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "pg_num": 12}]: dispatch 2024-03-30T15:26:44.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:43 smithi072 bash[21573]: audit 2024-03-30T15:26:43.187686+0000 mon.a (mon.0) 3683 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "pg_num": 12}]: dispatch 2024-03-30T15:26:44.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:43 smithi072 bash[28946]: cluster 2024-03-30T15:26:42.370651+0000 mgr.y (mgr.14526) 729 : cluster 0 pgmap v1245: 164 pgs: 164 active+clean; 582 KiB data, 806 MiB used, 714 GiB / 715 GiB avail 2024-03-30T15:26:44.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:43 smithi072 bash[28946]: cluster 2024-03-30T15:26:42.764987+0000 mon.a (mon.0) 3682 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:26:44.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:43 smithi072 bash[28946]: audit 2024-03-30T15:26:43.187058+0000 mon.c (mon.2) 534 : audit 1 from='client.? 172.21.15.72:0/1111560951' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "pg_num": 12}]: dispatch 2024-03-30T15:26:44.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:43 smithi072 bash[28946]: audit 2024-03-30T15:26:43.187686+0000 mon.a (mon.0) 3683 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "pg_num": 12}]: dispatch 2024-03-30T15:26:44.216 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:44.216+0000 7f61b4e06640 1 -- 172.21.15.72:0/1627774926 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "10"} v 0) -- 0x7f61b01a6a20 con 0x7f61b01020c0 2024-03-30T15:26:44.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:43 smithi172 bash[23680]: cluster 2024-03-30T15:26:42.370651+0000 mgr.y (mgr.14526) 729 : cluster 0 pgmap v1245: 164 pgs: 164 active+clean; 582 KiB data, 806 MiB used, 714 GiB / 715 GiB avail 2024-03-30T15:26:44.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:43 smithi172 bash[23680]: cluster 2024-03-30T15:26:42.764987+0000 mon.a (mon.0) 3682 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:26:44.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:43 smithi172 bash[23680]: audit 2024-03-30T15:26:43.187058+0000 mon.c (mon.2) 534 : audit 1 from='client.? 172.21.15.72:0/1111560951' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "pg_num": 12}]: dispatch 2024-03-30T15:26:44.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:43 smithi172 bash[23680]: audit 2024-03-30T15:26:43.187686+0000 mon.a (mon.0) 3683 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "pg_num": 12}]: dispatch 2024-03-30T15:26:44.781 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:44.780+0000 7f61a77fe640 1 -- 172.21.15.72:0/1627774926 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 4e694c24-7f59-49ba-b14c-a8866b9195f4 v772) ==== 223+0+0 (secure 0 0 0) 0x7f619805f3f0 con 0x7f61b01020c0 2024-03-30T15:26:44.915 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:44.916+0000 7f61b4e06640 1 -- 172.21.15.72:0/1627774926 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "10"} v 0) -- 0x7f61b01a6bf0 con 0x7f61b01020c0 2024-03-30T15:26:45.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:44 smithi072 bash[21573]: audit 2024-03-30T15:26:43.781202+0000 mon.a (mon.0) 3684 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "pg_num": 12}]': finished 2024-03-30T15:26:45.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:44 smithi072 bash[21573]: cluster 2024-03-30T15:26:43.787907+0000 mon.a (mon.0) 3685 : cluster 0 osdmap e771: 8 total, 8 up, 8 in 2024-03-30T15:26:45.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:44 smithi072 bash[21573]: audit 2024-03-30T15:26:43.900353+0000 mon.c (mon.2) 535 : audit 1 from='client.? 172.21.15.72:0/1111560951' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "pg_num": 12}]: dispatch 2024-03-30T15:26:45.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:44 smithi072 bash[21573]: audit 2024-03-30T15:26:43.900793+0000 mon.a (mon.0) 3686 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "pg_num": 12}]: dispatch 2024-03-30T15:26:45.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:44 smithi072 bash[21573]: audit 2024-03-30T15:26:44.220243+0000 mon.a (mon.0) 3687 : audit 1 from='client.? 172.21.15.72:0/1627774926' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "10"}]: dispatch 2024-03-30T15:26:45.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:44 smithi072 bash[28946]: audit 2024-03-30T15:26:43.781202+0000 mon.a (mon.0) 3684 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "pg_num": 12}]': finished 2024-03-30T15:26:45.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:44 smithi072 bash[28946]: cluster 2024-03-30T15:26:43.787907+0000 mon.a (mon.0) 3685 : cluster 0 osdmap e771: 8 total, 8 up, 8 in 2024-03-30T15:26:45.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:44 smithi072 bash[28946]: audit 2024-03-30T15:26:43.900353+0000 mon.c (mon.2) 535 : audit 1 from='client.? 172.21.15.72:0/1111560951' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "pg_num": 12}]: dispatch 2024-03-30T15:26:45.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:44 smithi072 bash[28946]: audit 2024-03-30T15:26:43.900793+0000 mon.a (mon.0) 3686 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "pg_num": 12}]: dispatch 2024-03-30T15:26:45.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:44 smithi072 bash[28946]: audit 2024-03-30T15:26:44.220243+0000 mon.a (mon.0) 3687 : audit 1 from='client.? 172.21.15.72:0/1627774926' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "10"}]: dispatch 2024-03-30T15:26:45.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:44 smithi172 bash[23680]: audit 2024-03-30T15:26:43.781202+0000 mon.a (mon.0) 3684 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "pg_num": 12}]': finished 2024-03-30T15:26:45.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:44 smithi172 bash[23680]: cluster 2024-03-30T15:26:43.787907+0000 mon.a (mon.0) 3685 : cluster 0 osdmap e771: 8 total, 8 up, 8 in 2024-03-30T15:26:45.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:44 smithi172 bash[23680]: audit 2024-03-30T15:26:43.900353+0000 mon.c (mon.2) 535 : audit 1 from='client.? 172.21.15.72:0/1111560951' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "pg_num": 12}]: dispatch 2024-03-30T15:26:45.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:44 smithi172 bash[23680]: audit 2024-03-30T15:26:43.900793+0000 mon.a (mon.0) 3686 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "pg_num": 12}]: dispatch 2024-03-30T15:26:45.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:44 smithi172 bash[23680]: audit 2024-03-30T15:26:44.220243+0000 mon.a (mon.0) 3687 : audit 1 from='client.? 172.21.15.72:0/1627774926' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "10"}]: dispatch 2024-03-30T15:26:45.797 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.796+0000 7f61a77fe640 1 -- 172.21.15.72:0/1627774926 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 4e694c24-7f59-49ba-b14c-a8866b9195f4 v773) ==== 223+0+0 (secure 0 0 0) 0x7f6198063c20 con 0x7f61b01020c0 2024-03-30T15:26:45.797 INFO:tasks.workunit.client.0.smithi072.stderr:set-quota max_objects = 10 for pool 4e694c24-7f59-49ba-b14c-a8866b9195f4 2024-03-30T15:26:45.800 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.800+0000 7f61b4e06640 1 -- 172.21.15.72:0/1627774926 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f619c06dbc0 msgr2=0x7f619c070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:26:45.800 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.800+0000 7f61b4e06640 1 --2- 172.21.15.72:0/1627774926 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f619c06dbc0 0x7f619c070080 secure :-1 s=READY pgs=3212 cs=0 l=1 rev1=1 crypto rx=0x7f61b019abc0 tx=0x7f61a000a2d0 comp rx=0 tx=0).stop 2024-03-30T15:26:45.800 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.800+0000 7f61b4e06640 1 -- 172.21.15.72:0/1627774926 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61b01020c0 msgr2=0x7f61b019fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:26:45.800 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.800+0000 7f61b4e06640 1 --2- 172.21.15.72:0/1627774926 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61b01020c0 0x7f61b019fe00 secure :-1 s=READY pgs=2374 cs=0 l=1 rev1=1 crypto rx=0x7f619800ea10 tx=0x7f619800eed0 comp rx=0 tx=0).stop 2024-03-30T15:26:45.801 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.800+0000 7f61b4e06640 1 -- 172.21.15.72:0/1627774926 shutdown_connections 2024-03-30T15:26:45.801 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.800+0000 7f61b4e06640 1 --2- 172.21.15.72:0/1627774926 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61b0107700 0x7f61b0199a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:26:45.801 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.800+0000 7f61b4e06640 1 --2- 172.21.15.72:0/1627774926 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f619c06dbc0 0x7f619c070080 unknown :-1 s=CLOSED pgs=3212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:26:45.801 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.800+0000 7f61b4e06640 1 --2- 172.21.15.72:0/1627774926 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61b01020c0 0x7f61b019fe00 unknown :-1 s=CLOSED pgs=2374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:26:45.801 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.800+0000 7f61b4e06640 1 --2- 172.21.15.72:0/1627774926 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f61b0101700 0x7f61b019f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:26:45.801 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.800+0000 7f61b4e06640 1 -- 172.21.15.72:0/1627774926 >> 172.21.15.72:0/1627774926 conn(0x7f61b00fd210 msgr2=0x7f61b00fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:26:45.801 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.800+0000 7f61b4e06640 1 -- 172.21.15.72:0/1627774926 shutdown_connections 2024-03-30T15:26:45.801 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.800+0000 7f61b4e06640 1 -- 172.21.15.72:0/1627774926 wait complete. 2024-03-30T15:26:45.827 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph osd pool application enable 4e694c24-7f59-49ba-b14c-a8866b9195f4 rados 2024-03-30T15:26:45.953 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.948+0000 7fba7460e640 1 -- 172.21.15.72:0/2142201868 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba6c108950 msgr2=0x7fba6c10c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:26:45.953 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.948+0000 7fba7460e640 1 --2- 172.21.15.72:0/2142201868 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba6c108950 0x7fba6c10c950 secure :-1 s=READY pgs=3247 cs=0 l=1 rev1=1 crypto rx=0x7fba68009bf0 tx=0x7fba6801caa0 comp rx=0 tx=0).stop 2024-03-30T15:26:45.953 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.948+0000 7fba7460e640 1 -- 172.21.15.72:0/2142201868 shutdown_connections 2024-03-30T15:26:45.954 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.948+0000 7fba7460e640 1 --2- 172.21.15.72:0/2142201868 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba6c10d080 0x7fba6c114c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:26:45.954 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.948+0000 7fba7460e640 1 --2- 172.21.15.72:0/2142201868 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba6c108950 0x7fba6c10c950 unknown :-1 s=CLOSED pgs=3247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:26:45.954 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.948+0000 7fba7460e640 1 --2- 172.21.15.72:0/2142201868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba6c107fa0 0x7fba6c108380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:26:45.954 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.948+0000 7fba7460e640 1 -- 172.21.15.72:0/2142201868 >> 172.21.15.72:0/2142201868 conn(0x7fba6c0775b0 msgr2=0x7fba6c106620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:26:45.954 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.948+0000 7fba7460e640 1 -- 172.21.15.72:0/2142201868 shutdown_connections 2024-03-30T15:26:45.955 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.948+0000 7fba7460e640 1 -- 172.21.15.72:0/2142201868 wait complete. 2024-03-30T15:26:45.955 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.948+0000 7fba7460e640 1 Processor -- start 2024-03-30T15:26:45.955 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.948+0000 7fba7460e640 1 -- start start 2024-03-30T15:26:45.955 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.948+0000 7fba7460e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba6c107fa0 0x7fba6c1a03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:26:45.955 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.948+0000 7fba7460e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba6c108950 0x7fba6c1a0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:26:45.955 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.948+0000 7fba7460e640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba6c10d080 0x7fba6c1a4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:26:45.956 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.948+0000 7fba7460e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fba6c119d90 con 0x7fba6c107fa0 2024-03-30T15:26:45.956 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.948+0000 7fba7460e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fba6c119c10 con 0x7fba6c108950 2024-03-30T15:26:45.956 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.948+0000 7fba7460e640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fba6c119f10 con 0x7fba6c10d080 2024-03-30T15:26:45.956 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.948+0000 7fba723aa640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba6c107fa0 0x7fba6c1a03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:26:45.956 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.948+0000 7fba723aa640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba6c107fa0 0x7fba6c1a03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43452/0 (socket says 172.21.15.72:43452) 2024-03-30T15:26:45.957 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.948+0000 7fba72bab640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba6c10d080 0x7fba6c1a4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:26:45.957 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.948+0000 7fba723aa640 1 -- 172.21.15.72:0/2931923990 learned_addr learned my addr 172.21.15.72:0/2931923990 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T15:26:45.957 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.948+0000 7fba723aa640 1 -- 172.21.15.72:0/2931923990 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba6c10d080 msgr2=0x7fba6c1a4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:26:45.957 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.948+0000 7fba723aa640 1 --2- 172.21.15.72:0/2931923990 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba6c10d080 0x7fba6c1a4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:26:45.957 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.948+0000 7fba723aa640 1 -- 172.21.15.72:0/2931923990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba6c108950 msgr2=0x7fba6c1a0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:26:45.957 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.948+0000 7fba723aa640 1 --2- 172.21.15.72:0/2931923990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba6c108950 0x7fba6c1a0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:26:45.958 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.948+0000 7fba723aa640 1 -- 172.21.15.72:0/2931923990 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba6c1a5370 con 0x7fba6c107fa0 2024-03-30T15:26:45.958 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.948+0000 7fba72bab640 1 --2- 172.21.15.72:0/2931923990 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba6c10d080 0x7fba6c1a4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T15:26:45.958 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.948+0000 7fba723aa640 1 --2- 172.21.15.72:0/2931923990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba6c107fa0 0x7fba6c1a03c0 secure :-1 s=READY pgs=2375 cs=0 l=1 rev1=1 crypto rx=0x7fba6000b550 tx=0x7fba6000ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:26:45.958 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.952+0000 7fba5f7fe640 1 -- 172.21.15.72:0/2931923990 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba60014070 con 0x7fba6c107fa0 2024-03-30T15:26:45.959 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.952+0000 7fba7460e640 1 -- 172.21.15.72:0/2931923990 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba6c1a5660 con 0x7fba6c107fa0 2024-03-30T15:26:45.959 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.952+0000 7fba5f7fe640 1 -- 172.21.15.72:0/2931923990 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7fba60010cf0 con 0x7fba6c107fa0 2024-03-30T15:26:45.959 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.952+0000 7fba5f7fe640 1 -- 172.21.15.72:0/2931923990 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba6000fd00 con 0x7fba6c107fa0 2024-03-30T15:26:45.959 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.952+0000 7fba7460e640 1 -- 172.21.15.72:0/2931923990 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba6c1acf40 con 0x7fba6c107fa0 2024-03-30T15:26:45.959 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.952+0000 7fba7460e640 1 -- 172.21.15.72:0/2931923990 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba6c068a90 con 0x7fba6c107fa0 2024-03-30T15:26:45.959 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.952+0000 7fba5f7fe640 1 -- 172.21.15.72:0/2931923990 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 21) ==== 91831+0+0 (secure 0 0 0) 0x7fba60017070 con 0x7fba6c107fa0 2024-03-30T15:26:45.960 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.952+0000 7fba5f7fe640 1 --2- 172.21.15.72:0/2931923990 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fba5806dbc0 0x7fba58070080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:26:45.960 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.952+0000 7fba71ba9640 1 --2- 172.21.15.72:0/2931923990 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fba5806dbc0 0x7fba58070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:26:45.960 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.952+0000 7fba5f7fe640 1 -- 172.21.15.72:0/2931923990 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(773..773 src has 269..773) ==== 9083+0+0 (secure 0 0 0) 0x7fba6008de30 con 0x7fba6c107fa0 2024-03-30T15:26:45.960 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.952+0000 7fba71ba9640 1 --2- 172.21.15.72:0/2931923990 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fba5806dbc0 0x7fba58070080 secure :-1 s=READY pgs=3213 cs=0 l=1 rev1=1 crypto rx=0x7fba6801d010 tx=0x7fba68019840 comp rx=0 tx=0).ready entity=mgr.14526 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:26:45.961 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:45.956+0000 7fba5f7fe640 1 -- 172.21.15.72:0/2931923990 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fba6005e810 con 0x7fba6c107fa0 2024-03-30T15:26:46.130 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:46.132+0000 7fba7460e640 1 -- 172.21.15.72:0/2931923990 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "app": "rados"} v 0) -- 0x7fba6c1ad110 con 0x7fba6c107fa0 2024-03-30T15:26:46.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:45 smithi072 bash[21573]: cluster 2024-03-30T15:26:44.371441+0000 mgr.y (mgr.14526) 730 : cluster 0 pgmap v1248: 176 pgs: 12 unknown, 164 active+clean; 582 KiB data, 806 MiB used, 714 GiB / 715 GiB avail 2024-03-30T15:26:46.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:45 smithi072 bash[21573]: audit 2024-03-30T15:26:44.783960+0000 mon.a (mon.0) 3688 : audit 1 from='client.? 172.21.15.72:0/1627774926' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "10"}]': finished 2024-03-30T15:26:46.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:45 smithi072 bash[21573]: cluster 2024-03-30T15:26:44.789130+0000 mon.a (mon.0) 3689 : cluster 0 osdmap e772: 8 total, 8 up, 8 in 2024-03-30T15:26:46.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:45 smithi072 bash[21573]: audit 2024-03-30T15:26:44.918847+0000 mon.a (mon.0) 3690 : audit 1 from='client.? 172.21.15.72:0/1627774926' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "10"}]: dispatch 2024-03-30T15:26:46.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:45 smithi072 bash[28946]: cluster 2024-03-30T15:26:44.371441+0000 mgr.y (mgr.14526) 730 : cluster 0 pgmap v1248: 176 pgs: 12 unknown, 164 active+clean; 582 KiB data, 806 MiB used, 714 GiB / 715 GiB avail 2024-03-30T15:26:46.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:45 smithi072 bash[28946]: audit 2024-03-30T15:26:44.783960+0000 mon.a (mon.0) 3688 : audit 1 from='client.? 172.21.15.72:0/1627774926' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "10"}]': finished 2024-03-30T15:26:46.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:45 smithi072 bash[28946]: cluster 2024-03-30T15:26:44.789130+0000 mon.a (mon.0) 3689 : cluster 0 osdmap e772: 8 total, 8 up, 8 in 2024-03-30T15:26:46.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:45 smithi072 bash[28946]: audit 2024-03-30T15:26:44.918847+0000 mon.a (mon.0) 3690 : audit 1 from='client.? 172.21.15.72:0/1627774926' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "10"}]: dispatch 2024-03-30T15:26:46.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:45 smithi172 bash[23680]: cluster 2024-03-30T15:26:44.371441+0000 mgr.y (mgr.14526) 730 : cluster 0 pgmap v1248: 176 pgs: 12 unknown, 164 active+clean; 582 KiB data, 806 MiB used, 714 GiB / 715 GiB avail 2024-03-30T15:26:46.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:45 smithi172 bash[23680]: audit 2024-03-30T15:26:44.783960+0000 mon.a (mon.0) 3688 : audit 1 from='client.? 172.21.15.72:0/1627774926' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "10"}]': finished 2024-03-30T15:26:46.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:45 smithi172 bash[23680]: cluster 2024-03-30T15:26:44.789130+0000 mon.a (mon.0) 3689 : cluster 0 osdmap e772: 8 total, 8 up, 8 in 2024-03-30T15:26:46.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:45 smithi172 bash[23680]: audit 2024-03-30T15:26:44.918847+0000 mon.a (mon.0) 3690 : audit 1 from='client.? 172.21.15.72:0/1627774926' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "10"}]: dispatch 2024-03-30T15:26:46.823 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:46.824+0000 7fba5f7fe640 1 -- 172.21.15.72:0/2931923990 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "app": "rados"}]=0 enabled application 'rados' on pool '4e694c24-7f59-49ba-b14c-a8866b9195f4' v774) ==== 213+0+0 (secure 0 0 0) 0x7fba60063040 con 0x7fba6c107fa0 2024-03-30T15:26:46.931 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:46.932+0000 7fba7460e640 1 -- 172.21.15.72:0/2931923990 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "app": "rados"} v 0) -- 0x7fba6c1ad360 con 0x7fba6c107fa0 2024-03-30T15:26:47.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:46 smithi072 bash[21573]: audit 2024-03-30T15:26:45.799691+0000 mon.a (mon.0) 3691 : audit 1 from='client.? 172.21.15.72:0/1627774926' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "10"}]': finished 2024-03-30T15:26:47.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:46 smithi072 bash[21573]: cluster 2024-03-30T15:26:45.807329+0000 mon.a (mon.0) 3692 : cluster 0 osdmap e773: 8 total, 8 up, 8 in 2024-03-30T15:26:47.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:46 smithi072 bash[21573]: audit 2024-03-30T15:26:46.133597+0000 mon.a (mon.0) 3693 : audit 1 from='client.? 172.21.15.72:0/2931923990' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "app": "rados"}]: dispatch 2024-03-30T15:26:47.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:46 smithi072 bash[28946]: audit 2024-03-30T15:26:45.799691+0000 mon.a (mon.0) 3691 : audit 1 from='client.? 172.21.15.72:0/1627774926' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "10"}]': finished 2024-03-30T15:26:47.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:46 smithi072 bash[28946]: cluster 2024-03-30T15:26:45.807329+0000 mon.a (mon.0) 3692 : cluster 0 osdmap e773: 8 total, 8 up, 8 in 2024-03-30T15:26:47.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:46 smithi072 bash[28946]: audit 2024-03-30T15:26:46.133597+0000 mon.a (mon.0) 3693 : audit 1 from='client.? 172.21.15.72:0/2931923990' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "app": "rados"}]: dispatch 2024-03-30T15:26:47.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:46 smithi172 bash[23680]: audit 2024-03-30T15:26:45.799691+0000 mon.a (mon.0) 3691 : audit 1 from='client.? 172.21.15.72:0/1627774926' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "10"}]': finished 2024-03-30T15:26:47.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:46 smithi172 bash[23680]: cluster 2024-03-30T15:26:45.807329+0000 mon.a (mon.0) 3692 : cluster 0 osdmap e773: 8 total, 8 up, 8 in 2024-03-30T15:26:47.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:46 smithi172 bash[23680]: audit 2024-03-30T15:26:46.133597+0000 mon.a (mon.0) 3693 : audit 1 from='client.? 172.21.15.72:0/2931923990' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "app": "rados"}]: dispatch 2024-03-30T15:26:47.825 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:47.824+0000 7fba5f7fe640 1 -- 172.21.15.72:0/2931923990 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "app": "rados"}]=0 enabled application 'rados' on pool '4e694c24-7f59-49ba-b14c-a8866b9195f4' v775) ==== 213+0+0 (secure 0 0 0) 0x7fba6000f4c0 con 0x7fba6c107fa0 2024-03-30T15:26:47.825 INFO:tasks.workunit.client.0.smithi072.stderr:enabled application 'rados' on pool '4e694c24-7f59-49ba-b14c-a8866b9195f4' 2024-03-30T15:26:47.829 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:47.828+0000 7fba7460e640 1 -- 172.21.15.72:0/2931923990 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fba5806dbc0 msgr2=0x7fba58070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:26:47.829 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:47.828+0000 7fba7460e640 1 --2- 172.21.15.72:0/2931923990 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fba5806dbc0 0x7fba58070080 secure :-1 s=READY pgs=3213 cs=0 l=1 rev1=1 crypto rx=0x7fba6801d010 tx=0x7fba68019840 comp rx=0 tx=0).stop 2024-03-30T15:26:47.829 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:47.828+0000 7fba7460e640 1 -- 172.21.15.72:0/2931923990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba6c107fa0 msgr2=0x7fba6c1a03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:26:47.829 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:47.828+0000 7fba7460e640 1 --2- 172.21.15.72:0/2931923990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba6c107fa0 0x7fba6c1a03c0 secure :-1 s=READY pgs=2375 cs=0 l=1 rev1=1 crypto rx=0x7fba6000b550 tx=0x7fba6000ba10 comp rx=0 tx=0).stop 2024-03-30T15:26:47.829 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:47.828+0000 7fba7460e640 1 -- 172.21.15.72:0/2931923990 shutdown_connections 2024-03-30T15:26:47.829 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:47.828+0000 7fba7460e640 1 --2- 172.21.15.72:0/2931923990 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba6c10d080 0x7fba6c1a4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:26:47.829 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:47.828+0000 7fba7460e640 1 --2- 172.21.15.72:0/2931923990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba6c108950 0x7fba6c1a0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:26:47.829 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:47.828+0000 7fba7460e640 1 --2- 172.21.15.72:0/2931923990 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fba5806dbc0 0x7fba58070080 unknown :-1 s=CLOSED pgs=3213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:26:47.829 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:47.828+0000 7fba7460e640 1 --2- 172.21.15.72:0/2931923990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba6c107fa0 0x7fba6c1a03c0 unknown :-1 s=CLOSED pgs=2375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:26:47.829 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:47.828+0000 7fba7460e640 1 -- 172.21.15.72:0/2931923990 >> 172.21.15.72:0/2931923990 conn(0x7fba6c0775b0 msgr2=0x7fba6c077990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:26:47.830 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:47.828+0000 7fba7460e640 1 -- 172.21.15.72:0/2931923990 shutdown_connections 2024-03-30T15:26:47.830 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:26:47.828+0000 7fba7460e640 1 -- 172.21.15.72:0/2931923990 wait complete. 2024-03-30T15:26:47.853 INFO:tasks.workunit.client.0.smithi072.stderr:+ seq 1 10 2024-03-30T15:26:47.862 INFO:tasks.workunit.client.0.smithi072.stderr:+ rados -p 4e694c24-7f59-49ba-b14c-a8866b9195f4 put obj1 /etc/passwd 2024-03-30T15:26:47.904 INFO:tasks.workunit.client.0.smithi072.stderr:+ rados -p 4e694c24-7f59-49ba-b14c-a8866b9195f4 put obj2 /etc/passwd 2024-03-30T15:26:47.942 INFO:tasks.workunit.client.0.smithi072.stderr:+ rados -p 4e694c24-7f59-49ba-b14c-a8866b9195f4 put obj3 /etc/passwd 2024-03-30T15:26:47.981 INFO:tasks.workunit.client.0.smithi072.stderr:+ rados -p 4e694c24-7f59-49ba-b14c-a8866b9195f4 put obj4 /etc/passwd 2024-03-30T15:26:48.017 INFO:tasks.workunit.client.0.smithi072.stderr:+ rados -p 4e694c24-7f59-49ba-b14c-a8866b9195f4 put obj5 /etc/passwd 2024-03-30T15:26:48.057 INFO:tasks.workunit.client.0.smithi072.stderr:+ rados -p 4e694c24-7f59-49ba-b14c-a8866b9195f4 put obj6 /etc/passwd 2024-03-30T15:26:48.096 INFO:tasks.workunit.client.0.smithi072.stderr:+ rados -p 4e694c24-7f59-49ba-b14c-a8866b9195f4 put obj7 /etc/passwd 2024-03-30T15:26:48.133 INFO:tasks.workunit.client.0.smithi072.stderr:+ rados -p 4e694c24-7f59-49ba-b14c-a8866b9195f4 put obj8 /etc/passwd 2024-03-30T15:26:48.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:47 smithi072 bash[21573]: cluster 2024-03-30T15:26:46.373347+0000 mgr.y (mgr.14526) 731 : cluster 0 pgmap v1251: 176 pgs: 176 active+clean; 582 KiB data, 799 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:26:48.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:47 smithi072 bash[21573]: audit 2024-03-30T15:26:46.825547+0000 mon.a (mon.0) 3694 : audit 1 from='client.? 172.21.15.72:0/2931923990' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "app": "rados"}]': finished 2024-03-30T15:26:48.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:47 smithi072 bash[21573]: cluster 2024-03-30T15:26:46.830616+0000 mon.a (mon.0) 3695 : cluster 0 osdmap e774: 8 total, 8 up, 8 in 2024-03-30T15:26:48.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:47 smithi072 bash[21573]: audit 2024-03-30T15:26:46.935236+0000 mon.a (mon.0) 3696 : audit 1 from='client.? 172.21.15.72:0/2931923990' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "app": "rados"}]: dispatch 2024-03-30T15:26:48.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:47 smithi072 bash[28946]: cluster 2024-03-30T15:26:46.373347+0000 mgr.y (mgr.14526) 731 : cluster 0 pgmap v1251: 176 pgs: 176 active+clean; 582 KiB data, 799 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:26:48.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:47 smithi072 bash[28946]: audit 2024-03-30T15:26:46.825547+0000 mon.a (mon.0) 3694 : audit 1 from='client.? 172.21.15.72:0/2931923990' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "app": "rados"}]': finished 2024-03-30T15:26:48.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:47 smithi072 bash[28946]: cluster 2024-03-30T15:26:46.830616+0000 mon.a (mon.0) 3695 : cluster 0 osdmap e774: 8 total, 8 up, 8 in 2024-03-30T15:26:48.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:47 smithi072 bash[28946]: audit 2024-03-30T15:26:46.935236+0000 mon.a (mon.0) 3696 : audit 1 from='client.? 172.21.15.72:0/2931923990' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "app": "rados"}]: dispatch 2024-03-30T15:26:48.170 INFO:tasks.workunit.client.0.smithi072.stderr:+ rados -p 4e694c24-7f59-49ba-b14c-a8866b9195f4 put obj9 /etc/passwd 2024-03-30T15:26:48.206 INFO:tasks.workunit.client.0.smithi072.stderr:+ rados -p 4e694c24-7f59-49ba-b14c-a8866b9195f4 put obj10 /etc/passwd 2024-03-30T15:26:48.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:47 smithi172 bash[23680]: cluster 2024-03-30T15:26:46.373347+0000 mgr.y (mgr.14526) 731 : cluster 0 pgmap v1251: 176 pgs: 176 active+clean; 582 KiB data, 799 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:26:48.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:47 smithi172 bash[23680]: audit 2024-03-30T15:26:46.825547+0000 mon.a (mon.0) 3694 : audit 1 from='client.? 172.21.15.72:0/2931923990' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "app": "rados"}]': finished 2024-03-30T15:26:48.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:47 smithi172 bash[23680]: cluster 2024-03-30T15:26:46.830616+0000 mon.a (mon.0) 3695 : cluster 0 osdmap e774: 8 total, 8 up, 8 in 2024-03-30T15:26:48.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:47 smithi172 bash[23680]: audit 2024-03-30T15:26:46.935236+0000 mon.a (mon.0) 3696 : audit 1 from='client.? 172.21.15.72:0/2931923990' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "app": "rados"}]: dispatch 2024-03-30T15:26:48.243 INFO:tasks.workunit.client.0.smithi072.stderr:+ sleep 30 2024-03-30T15:26:49.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:48 smithi072 bash[21573]: audit 2024-03-30T15:26:47.828113+0000 mon.a (mon.0) 3697 : audit 1 from='client.? 172.21.15.72:0/2931923990' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "app": "rados"}]': finished 2024-03-30T15:26:49.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:48 smithi072 bash[21573]: cluster 2024-03-30T15:26:47.835136+0000 mon.a (mon.0) 3698 : cluster 0 osdmap e775: 8 total, 8 up, 8 in 2024-03-30T15:26:49.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:48 smithi072 bash[28946]: audit 2024-03-30T15:26:47.828113+0000 mon.a (mon.0) 3697 : audit 1 from='client.? 172.21.15.72:0/2931923990' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "app": "rados"}]': finished 2024-03-30T15:26:49.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:48 smithi072 bash[28946]: cluster 2024-03-30T15:26:47.835136+0000 mon.a (mon.0) 3698 : cluster 0 osdmap e775: 8 total, 8 up, 8 in 2024-03-30T15:26:49.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:48 smithi172 bash[23680]: audit 2024-03-30T15:26:47.828113+0000 mon.a (mon.0) 3697 : audit 1 from='client.? 172.21.15.72:0/2931923990' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "app": "rados"}]': finished 2024-03-30T15:26:49.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:48 smithi172 bash[23680]: cluster 2024-03-30T15:26:47.835136+0000 mon.a (mon.0) 3698 : cluster 0 osdmap e775: 8 total, 8 up, 8 in 2024-03-30T15:26:50.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:49 smithi072 bash[21573]: cluster 2024-03-30T15:26:48.374087+0000 mgr.y (mgr.14526) 732 : cluster 0 pgmap v1254: 176 pgs: 176 active+clean; 582 KiB data, 799 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:26:50.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:49 smithi072 bash[21573]: cluster 2024-03-30T15:26:48.845256+0000 mon.a (mon.0) 3699 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:26:50.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:49 smithi072 bash[28946]: cluster 2024-03-30T15:26:48.374087+0000 mgr.y (mgr.14526) 732 : cluster 0 pgmap v1254: 176 pgs: 176 active+clean; 582 KiB data, 799 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:26:50.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:49 smithi072 bash[28946]: cluster 2024-03-30T15:26:48.845256+0000 mon.a (mon.0) 3699 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:26:50.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:49 smithi172 bash[23680]: cluster 2024-03-30T15:26:48.374087+0000 mgr.y (mgr.14526) 732 : cluster 0 pgmap v1254: 176 pgs: 176 active+clean; 582 KiB data, 799 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:26:50.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:49 smithi172 bash[23680]: cluster 2024-03-30T15:26:48.845256+0000 mon.a (mon.0) 3699 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:26:51.419 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:26:51 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:26:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:26:52.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:51 smithi072 bash[28946]: cluster 2024-03-30T15:26:50.374870+0000 mgr.y (mgr.14526) 733 : cluster 0 pgmap v1255: 176 pgs: 176 active+clean; 582 KiB data, 799 MiB used, 714 GiB / 715 GiB avail; 916 B/s rd, 0 op/s 2024-03-30T15:26:52.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:51 smithi072 bash[21573]: cluster 2024-03-30T15:26:50.374870+0000 mgr.y (mgr.14526) 733 : cluster 0 pgmap v1255: 176 pgs: 176 active+clean; 582 KiB data, 799 MiB used, 714 GiB / 715 GiB avail; 916 B/s rd, 0 op/s 2024-03-30T15:26:52.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:26:51 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:26:52.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:51 smithi172 bash[23680]: cluster 2024-03-30T15:26:50.374870+0000 mgr.y (mgr.14526) 733 : cluster 0 pgmap v1255: 176 pgs: 176 active+clean; 582 KiB data, 799 MiB used, 714 GiB / 715 GiB avail; 916 B/s rd, 0 op/s 2024-03-30T15:26:53.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:52 smithi072 bash[21573]: audit 2024-03-30T15:26:51.784590+0000 mgr.y (mgr.14526) 734 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:26:53.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:52 smithi072 bash[21573]: audit 2024-03-30T15:26:52.595367+0000 mon.c (mon.2) 536 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:26:53.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:52 smithi072 bash[28946]: audit 2024-03-30T15:26:51.784590+0000 mgr.y (mgr.14526) 734 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:26:53.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:52 smithi072 bash[28946]: audit 2024-03-30T15:26:52.595367+0000 mon.c (mon.2) 536 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:26:53.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:52 smithi172 bash[23680]: audit 2024-03-30T15:26:51.784590+0000 mgr.y (mgr.14526) 734 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:26:53.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:52 smithi172 bash[23680]: audit 2024-03-30T15:26:52.595367+0000 mon.c (mon.2) 536 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:26:54.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:53 smithi072 bash[21573]: cluster 2024-03-30T15:26:52.376749+0000 mgr.y (mgr.14526) 735 : cluster 0 pgmap v1256: 176 pgs: 176 active+clean; 699 KiB data, 797 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 18 KiB/s wr, 3 op/s 2024-03-30T15:26:54.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:53 smithi072 bash[28946]: cluster 2024-03-30T15:26:52.376749+0000 mgr.y (mgr.14526) 735 : cluster 0 pgmap v1256: 176 pgs: 176 active+clean; 699 KiB data, 797 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 18 KiB/s wr, 3 op/s 2024-03-30T15:26:54.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:53 smithi172 bash[23680]: cluster 2024-03-30T15:26:52.376749+0000 mgr.y (mgr.14526) 735 : cluster 0 pgmap v1256: 176 pgs: 176 active+clean; 699 KiB data, 797 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 18 KiB/s wr, 3 op/s 2024-03-30T15:26:56.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:55 smithi072 bash[21573]: cluster 2024-03-30T15:26:54.377569+0000 mgr.y (mgr.14526) 736 : cluster 0 pgmap v1257: 176 pgs: 176 active+clean; 699 KiB data, 797 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 15 KiB/s wr, 1 op/s 2024-03-30T15:26:56.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:55 smithi072 bash[28946]: cluster 2024-03-30T15:26:54.377569+0000 mgr.y (mgr.14526) 736 : cluster 0 pgmap v1257: 176 pgs: 176 active+clean; 699 KiB data, 797 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 15 KiB/s wr, 1 op/s 2024-03-30T15:26:56.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:55 smithi172 bash[23680]: cluster 2024-03-30T15:26:54.377569+0000 mgr.y (mgr.14526) 736 : cluster 0 pgmap v1257: 176 pgs: 176 active+clean; 699 KiB data, 797 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 15 KiB/s wr, 1 op/s 2024-03-30T15:26:57.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:56 smithi072 bash[21573]: cluster 2024-03-30T15:26:56.379394+0000 mgr.y (mgr.14526) 737 : cluster 0 pgmap v1258: 176 pgs: 176 active+clean; 699 KiB data, 797 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 13 KiB/s wr, 2 op/s 2024-03-30T15:26:57.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:56 smithi072 bash[28946]: cluster 2024-03-30T15:26:56.379394+0000 mgr.y (mgr.14526) 737 : cluster 0 pgmap v1258: 176 pgs: 176 active+clean; 699 KiB data, 797 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 13 KiB/s wr, 2 op/s 2024-03-30T15:26:57.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:56 smithi172 bash[23680]: cluster 2024-03-30T15:26:56.379394+0000 mgr.y (mgr.14526) 737 : cluster 0 pgmap v1258: 176 pgs: 176 active+clean; 699 KiB data, 797 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 13 KiB/s wr, 2 op/s 2024-03-30T15:26:58.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:57 smithi072 bash[28946]: cluster 2024-03-30T15:26:57.378670+0000 mon.a (mon.0) 3700 : cluster 3 pool '4e694c24-7f59-49ba-b14c-a8866b9195f4' is full (reached quota's max_objects: 10) 2024-03-30T15:26:58.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:57 smithi072 bash[28946]: cluster 2024-03-30T15:26:57.379240+0000 mon.a (mon.0) 3701 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-03-30T15:26:58.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:57 smithi072 bash[28946]: cluster 2024-03-30T15:26:57.388617+0000 mon.a (mon.0) 3702 : cluster 0 osdmap e776: 8 total, 8 up, 8 in 2024-03-30T15:26:58.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:57 smithi072 bash[21573]: cluster 2024-03-30T15:26:57.378670+0000 mon.a (mon.0) 3700 : cluster 3 pool '4e694c24-7f59-49ba-b14c-a8866b9195f4' is full (reached quota's max_objects: 10) 2024-03-30T15:26:58.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:57 smithi072 bash[21573]: cluster 2024-03-30T15:26:57.379240+0000 mon.a (mon.0) 3701 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-03-30T15:26:58.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:57 smithi072 bash[21573]: cluster 2024-03-30T15:26:57.388617+0000 mon.a (mon.0) 3702 : cluster 0 osdmap e776: 8 total, 8 up, 8 in 2024-03-30T15:26:58.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:57 smithi172 bash[23680]: cluster 2024-03-30T15:26:57.378670+0000 mon.a (mon.0) 3700 : cluster 3 pool '4e694c24-7f59-49ba-b14c-a8866b9195f4' is full (reached quota's max_objects: 10) 2024-03-30T15:26:58.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:57 smithi172 bash[23680]: cluster 2024-03-30T15:26:57.379240+0000 mon.a (mon.0) 3701 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-03-30T15:26:58.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:57 smithi172 bash[23680]: cluster 2024-03-30T15:26:57.388617+0000 mon.a (mon.0) 3702 : cluster 0 osdmap e776: 8 total, 8 up, 8 in 2024-03-30T15:26:59.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:26:58 smithi072 bash[21573]: cluster 2024-03-30T15:26:58.380153+0000 mgr.y (mgr.14526) 738 : cluster 0 pgmap v1260: 176 pgs: 176 active+clean; 699 KiB data, 797 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-03-30T15:26:59.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:26:58 smithi072 bash[28946]: cluster 2024-03-30T15:26:58.380153+0000 mgr.y (mgr.14526) 738 : cluster 0 pgmap v1260: 176 pgs: 176 active+clean; 699 KiB data, 797 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-03-30T15:26:59.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:26:58 smithi172 bash[23680]: cluster 2024-03-30T15:26:58.380153+0000 mgr.y (mgr.14526) 738 : cluster 0 pgmap v1260: 176 pgs: 176 active+clean; 699 KiB data, 797 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-03-30T15:27:01.419 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:27:01 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:27:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:27:01.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:01 smithi172 bash[23680]: cluster 2024-03-30T15:27:00.381087+0000 mgr.y (mgr.14526) 739 : cluster 0 pgmap v1261: 176 pgs: 176 active+clean; 699 KiB data, 797 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-03-30T15:27:01.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:01 smithi072 bash[21573]: cluster 2024-03-30T15:27:00.381087+0000 mgr.y (mgr.14526) 739 : cluster 0 pgmap v1261: 176 pgs: 176 active+clean; 699 KiB data, 797 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-03-30T15:27:01.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:01 smithi072 bash[28946]: cluster 2024-03-30T15:27:00.381087+0000 mgr.y (mgr.14526) 739 : cluster 0 pgmap v1261: 176 pgs: 176 active+clean; 699 KiB data, 797 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-03-30T15:27:02.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:27:01 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:27:02.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:02 smithi172 bash[23680]: audit 2024-03-30T15:27:01.796082+0000 mgr.y (mgr.14526) 740 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:27:02.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:02 smithi072 bash[21573]: audit 2024-03-30T15:27:01.796082+0000 mgr.y (mgr.14526) 740 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:27:02.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:02 smithi072 bash[28946]: audit 2024-03-30T15:27:01.796082+0000 mgr.y (mgr.14526) 740 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:27:03.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:03 smithi172 bash[23680]: cluster 2024-03-30T15:27:02.382969+0000 mgr.y (mgr.14526) 741 : cluster 0 pgmap v1262: 176 pgs: 176 active+clean; 699 KiB data, 794 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T15:27:03.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:03 smithi072 bash[21573]: cluster 2024-03-30T15:27:02.382969+0000 mgr.y (mgr.14526) 741 : cluster 0 pgmap v1262: 176 pgs: 176 active+clean; 699 KiB data, 794 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T15:27:03.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:03 smithi072 bash[28946]: cluster 2024-03-30T15:27:02.382969+0000 mgr.y (mgr.14526) 741 : cluster 0 pgmap v1262: 176 pgs: 176 active+clean; 699 KiB data, 794 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T15:27:05.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:05 smithi172 bash[23680]: cluster 2024-03-30T15:27:04.383776+0000 mgr.y (mgr.14526) 742 : cluster 0 pgmap v1263: 176 pgs: 176 active+clean; 699 KiB data, 794 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T15:27:05.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:05 smithi072 bash[21573]: cluster 2024-03-30T15:27:04.383776+0000 mgr.y (mgr.14526) 742 : cluster 0 pgmap v1263: 176 pgs: 176 active+clean; 699 KiB data, 794 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T15:27:05.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:05 smithi072 bash[28946]: cluster 2024-03-30T15:27:04.383776+0000 mgr.y (mgr.14526) 742 : cluster 0 pgmap v1263: 176 pgs: 176 active+clean; 699 KiB data, 794 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T15:27:07.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:07 smithi172 bash[23680]: cluster 2024-03-30T15:27:06.385633+0000 mgr.y (mgr.14526) 743 : cluster 0 pgmap v1264: 176 pgs: 176 active+clean; 699 KiB data, 794 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T15:27:07.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:07 smithi072 bash[21573]: cluster 2024-03-30T15:27:06.385633+0000 mgr.y (mgr.14526) 743 : cluster 0 pgmap v1264: 176 pgs: 176 active+clean; 699 KiB data, 794 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T15:27:07.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:07 smithi072 bash[28946]: cluster 2024-03-30T15:27:06.385633+0000 mgr.y (mgr.14526) 743 : cluster 0 pgmap v1264: 176 pgs: 176 active+clean; 699 KiB data, 794 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T15:27:08.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:08 smithi072 bash[28946]: audit 2024-03-30T15:27:07.636590+0000 mon.a (mon.0) 3703 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:27:08.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:08 smithi072 bash[28946]: audit 2024-03-30T15:27:07.639660+0000 mon.c (mon.2) 537 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:27:08.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:08 smithi072 bash[21573]: audit 2024-03-30T15:27:07.636590+0000 mon.a (mon.0) 3703 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:27:08.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:08 smithi072 bash[21573]: audit 2024-03-30T15:27:07.639660+0000 mon.c (mon.2) 537 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:27:08.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:08 smithi172 bash[23680]: audit 2024-03-30T15:27:07.636590+0000 mon.a (mon.0) 3703 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:27:08.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:08 smithi172 bash[23680]: audit 2024-03-30T15:27:07.639660+0000 mon.c (mon.2) 537 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:27:09.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:09 smithi072 bash[21573]: cluster 2024-03-30T15:27:08.386433+0000 mgr.y (mgr.14526) 744 : cluster 0 pgmap v1265: 176 pgs: 176 active+clean; 699 KiB data, 794 MiB used, 714 GiB / 715 GiB avail; 930 B/s rd, 0 op/s 2024-03-30T15:27:09.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:09 smithi072 bash[28946]: cluster 2024-03-30T15:27:08.386433+0000 mgr.y (mgr.14526) 744 : cluster 0 pgmap v1265: 176 pgs: 176 active+clean; 699 KiB data, 794 MiB used, 714 GiB / 715 GiB avail; 930 B/s rd, 0 op/s 2024-03-30T15:27:09.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:09 smithi172 bash[23680]: cluster 2024-03-30T15:27:08.386433+0000 mgr.y (mgr.14526) 744 : cluster 0 pgmap v1265: 176 pgs: 176 active+clean; 699 KiB data, 794 MiB used, 714 GiB / 715 GiB avail; 930 B/s rd, 0 op/s 2024-03-30T15:27:11.419 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:27:11 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:27:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:27:11.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:11 smithi072 bash[21573]: cluster 2024-03-30T15:27:10.387200+0000 mgr.y (mgr.14526) 745 : cluster 0 pgmap v1266: 176 pgs: 176 active+clean; 699 KiB data, 794 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:27:11.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:11 smithi072 bash[28946]: cluster 2024-03-30T15:27:10.387200+0000 mgr.y (mgr.14526) 745 : cluster 0 pgmap v1266: 176 pgs: 176 active+clean; 699 KiB data, 794 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:27:11.968 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:27:11 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:27:11.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:11 smithi172 bash[23680]: cluster 2024-03-30T15:27:10.387200+0000 mgr.y (mgr.14526) 745 : cluster 0 pgmap v1266: 176 pgs: 176 active+clean; 699 KiB data, 794 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:27:12.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:12 smithi072 bash[21573]: audit 2024-03-30T15:27:11.805340+0000 mgr.y (mgr.14526) 746 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:27:12.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:12 smithi072 bash[28946]: audit 2024-03-30T15:27:11.805340+0000 mgr.y (mgr.14526) 746 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:27:12.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:12 smithi172 bash[23680]: audit 2024-03-30T15:27:11.805340+0000 mgr.y (mgr.14526) 746 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:27:13.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:13 smithi072 bash[21573]: cluster 2024-03-30T15:27:12.389098+0000 mgr.y (mgr.14526) 747 : cluster 0 pgmap v1267: 176 pgs: 176 active+clean; 699 KiB data, 794 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:27:13.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:13 smithi072 bash[28946]: cluster 2024-03-30T15:27:12.389098+0000 mgr.y (mgr.14526) 747 : cluster 0 pgmap v1267: 176 pgs: 176 active+clean; 699 KiB data, 794 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:27:13.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:13 smithi172 bash[23680]: cluster 2024-03-30T15:27:12.389098+0000 mgr.y (mgr.14526) 747 : cluster 0 pgmap v1267: 176 pgs: 176 active+clean; 699 KiB data, 794 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:27:15.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:15 smithi072 bash[21573]: cluster 2024-03-30T15:27:14.389812+0000 mgr.y (mgr.14526) 748 : cluster 0 pgmap v1268: 176 pgs: 176 active+clean; 699 KiB data, 794 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:27:15.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:15 smithi072 bash[28946]: cluster 2024-03-30T15:27:14.389812+0000 mgr.y (mgr.14526) 748 : cluster 0 pgmap v1268: 176 pgs: 176 active+clean; 699 KiB data, 794 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:27:15.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:15 smithi172 bash[23680]: cluster 2024-03-30T15:27:14.389812+0000 mgr.y (mgr.14526) 748 : cluster 0 pgmap v1268: 176 pgs: 176 active+clean; 699 KiB data, 794 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:27:17.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:17 smithi172 bash[23680]: cluster 2024-03-30T15:27:16.392765+0000 mgr.y (mgr.14526) 749 : cluster 0 pgmap v1269: 176 pgs: 176 active+clean; 699 KiB data, 794 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:27:18.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:17 smithi072 bash[21573]: cluster 2024-03-30T15:27:16.392765+0000 mgr.y (mgr.14526) 749 : cluster 0 pgmap v1269: 176 pgs: 176 active+clean; 699 KiB data, 794 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:27:18.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:17 smithi072 bash[28946]: cluster 2024-03-30T15:27:16.392765+0000 mgr.y (mgr.14526) 749 : cluster 0 pgmap v1269: 176 pgs: 176 active+clean; 699 KiB data, 794 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:27:18.245 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=132243 2024-03-30T15:27:18.245 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph osd pool set-quota 4e694c24-7f59-49ba-b14c-a8866b9195f4 max_objects 100 2024-03-30T15:27:18.245 INFO:tasks.workunit.client.0.smithi072.stderr:+ rados -p 4e694c24-7f59-49ba-b14c-a8866b9195f4 put onemore /etc/passwd 2024-03-30T15:27:18.377 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:18.376+0000 7f70eb2fe640 1 -- 172.21.15.72:0/1516148098 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70e41038d0 msgr2=0x7f70e4103d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:27:18.377 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:18.376+0000 7f70eb2fe640 1 --2- 172.21.15.72:0/1516148098 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70e41038d0 0x7f70e4103d50 secure :-1 s=READY pgs=2392 cs=0 l=1 rev1=1 crypto rx=0x7f70e0009960 tx=0x7f70e001c7c0 comp rx=0 tx=0).stop 2024-03-30T15:27:18.377 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:18.376+0000 7f70eb2fe640 1 -- 172.21.15.72:0/1516148098 shutdown_connections 2024-03-30T15:27:18.378 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:18.376+0000 7f70eb2fe640 1 --2- 172.21.15.72:0/1516148098 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70e4104290 0x7f70e41107a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:18.378 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:18.376+0000 7f70eb2fe640 1 --2- 172.21.15.72:0/1516148098 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70e41038d0 0x7f70e4103d50 unknown :-1 s=CLOSED pgs=2392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:18.378 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:18.376+0000 7f70eb2fe640 1 --2- 172.21.15.72:0/1516148098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70e41098d0 0x7f70e4109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:18.378 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:18.376+0000 7f70eb2fe640 1 -- 172.21.15.72:0/1516148098 >> 172.21.15.72:0/1516148098 conn(0x7f70e40ff380 msgr2=0x7f70e41017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:27:18.378 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:18.376+0000 7f70eb2fe640 1 -- 172.21.15.72:0/1516148098 shutdown_connections 2024-03-30T15:27:18.378 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:18.376+0000 7f70eb2fe640 1 -- 172.21.15.72:0/1516148098 wait complete. 2024-03-30T15:27:18.378 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:18.376+0000 7f70eb2fe640 1 Processor -- start 2024-03-30T15:27:18.378 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:18.376+0000 7f70eb2fe640 1 -- start start 2024-03-30T15:27:18.378 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:18.376+0000 7f70eb2fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70e41038d0 0x7f70e419bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:27:18.378 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:18.376+0000 7f70eb2fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70e4104290 0x7f70e419c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:27:18.378 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:18.376+0000 7f70eb2fe640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70e41098d0 0x7f70e41a07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:27:18.378 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:18.376+0000 7f70eb2fe640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f70e4115940 con 0x7f70e41038d0 2024-03-30T15:27:18.378 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:18.376+0000 7f70eb2fe640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f70e41157c0 con 0x7f70e4104290 2024-03-30T15:27:18.379 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:18.376+0000 7f70eb2fe640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f70e4115ac0 con 0x7f70e41098d0 2024-03-30T15:27:18.379 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:18.376+0000 7f70e909a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70e41038d0 0x7f70e419bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:27:18.379 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:18.376+0000 7f70e989b640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70e41098d0 0x7f70e41a07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:27:18.379 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:18.376+0000 7f70e909a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70e41038d0 0x7f70e419bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34148/0 (socket says 172.21.15.72:34148) 2024-03-30T15:27:18.379 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:18.376+0000 7f70e909a640 1 -- 172.21.15.72:0/1183359872 learned_addr learned my addr 172.21.15.72:0/1183359872 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T15:27:18.379 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:18.376+0000 7f70e909a640 1 -- 172.21.15.72:0/1183359872 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70e41098d0 msgr2=0x7f70e41a07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:27:18.379 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:18.376+0000 7f70e909a640 1 --2- 172.21.15.72:0/1183359872 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70e41098d0 0x7f70e41a07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:18.379 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:18.376+0000 7f70e909a640 1 -- 172.21.15.72:0/1183359872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70e4104290 msgr2=0x7f70e419c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:27:18.379 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:18.376+0000 7f70e8899640 1 --2- 172.21.15.72:0/1183359872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70e4104290 0x7f70e419c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:27:18.379 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:18.376+0000 7f70e909a640 1 --2- 172.21.15.72:0/1183359872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70e4104290 0x7f70e419c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:18.379 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:18.376+0000 7f70e909a640 1 -- 172.21.15.72:0/1183359872 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e41a0eb0 con 0x7f70e41038d0 2024-03-30T15:27:18.379 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:18.376+0000 7f70e909a640 1 --2- 172.21.15.72:0/1183359872 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70e41038d0 0x7f70e419bf00 secure :-1 s=READY pgs=2393 cs=0 l=1 rev1=1 crypto rx=0x7f70d400b550 tx=0x7f70d400ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:27:18.379 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:18.376+0000 7f70da7fc640 1 -- 172.21.15.72:0/1183359872 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d4014070 con 0x7f70e41038d0 2024-03-30T15:27:18.379 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:18.376+0000 7f70eb2fe640 1 -- 172.21.15.72:0/1183359872 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70e41a11a0 con 0x7f70e41038d0 2024-03-30T15:27:18.380 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:18.376+0000 7f70da7fc640 1 -- 172.21.15.72:0/1183359872 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f70d4010cf0 con 0x7f70e41038d0 2024-03-30T15:27:18.380 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:18.376+0000 7f70da7fc640 1 -- 172.21.15.72:0/1183359872 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d400fd00 con 0x7f70e41038d0 2024-03-30T15:27:18.380 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:18.376+0000 7f70eb2fe640 1 -- 172.21.15.72:0/1183359872 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70e41a8a80 con 0x7f70e41038d0 2024-03-30T15:27:18.381 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:18.380+0000 7f70eb2fe640 1 -- 172.21.15.72:0/1183359872 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70e4068a90 con 0x7f70e41038d0 2024-03-30T15:27:18.381 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:18.380+0000 7f70da7fc640 1 -- 172.21.15.72:0/1183359872 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 21) ==== 91831+0+0 (secure 0 0 0) 0x7f70d4017070 con 0x7f70e41038d0 2024-03-30T15:27:18.381 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:18.380+0000 7f70da7fc640 1 --2- 172.21.15.72:0/1183359872 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f70d006dbc0 0x7f70d0070080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:27:18.381 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:18.380+0000 7f70e8899640 1 --2- 172.21.15.72:0/1183359872 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f70d006dbc0 0x7f70d0070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:27:18.381 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:18.380+0000 7f70da7fc640 1 -- 172.21.15.72:0/1183359872 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(776..776 src has 269..776) ==== 9096+0+0 (secure 0 0 0) 0x7f70d408e1b0 con 0x7f70e41038d0 2024-03-30T15:27:18.381 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:18.380+0000 7f70da7fc640 1 -- 172.21.15.72:0/1183359872 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=777}) -- 0x7f70d00796d0 con 0x7f70e41038d0 2024-03-30T15:27:18.381 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:18.380+0000 7f70e8899640 1 --2- 172.21.15.72:0/1183359872 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f70d006dbc0 0x7f70d0070080 secure :-1 s=READY pgs=3225 cs=0 l=1 rev1=1 crypto rx=0x7f70e0009230 tx=0x7f70e0000bd0 comp rx=0 tx=0).ready entity=mgr.14526 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:27:18.383 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:18.384+0000 7f70da7fc640 1 -- 172.21.15.72:0/1183359872 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f70d405ec00 con 0x7f70e41038d0 2024-03-30T15:27:18.559 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:18.560+0000 7f70eb2fe640 1 -- 172.21.15.72:0/1183359872 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "100"} v 0) -- 0x7f70e419d260 con 0x7f70e41038d0 2024-03-30T15:27:18.682 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:18.680+0000 7f70da7fc640 1 -- 172.21.15.72:0/1183359872 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool 4e694c24-7f59-49ba-b14c-a8866b9195f4 v777) ==== 225+0+0 (secure 0 0 0) 0x7f70e419d260 con 0x7f70e41038d0 2024-03-30T15:27:18.682 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:18.684+0000 7f70da7fc640 1 -- 172.21.15.72:0/1183359872 <== mon.0 v2:172.21.15.72:3300/0 8 ==== osd_map(777..777 src has 269..777) ==== 628+0+0 (secure 0 0 0) 0x7f70d4058c00 con 0x7f70e41038d0 2024-03-30T15:27:18.682 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:18.684+0000 7f70da7fc640 1 -- 172.21.15.72:0/1183359872 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=778}) -- 0x7f70d007a5f0 con 0x7f70e41038d0 2024-03-30T15:27:18.793 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:18.792+0000 7f70eb2fe640 1 -- 172.21.15.72:0/1183359872 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "100"} v 0) -- 0x7f70e4061de0 con 0x7f70e41038d0 2024-03-30T15:27:18.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:18 smithi172 bash[23680]: audit 2024-03-30T15:27:18.563186+0000 mon.a (mon.0) 3704 : audit 1 from='client.? 172.21.15.72:0/1183359872' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "100"}]: dispatch 2024-03-30T15:27:19.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:18 smithi072 bash[21573]: audit 2024-03-30T15:27:18.563186+0000 mon.a (mon.0) 3704 : audit 1 from='client.? 172.21.15.72:0/1183359872' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "100"}]: dispatch 2024-03-30T15:27:19.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:18 smithi072 bash[28946]: audit 2024-03-30T15:27:18.563186+0000 mon.a (mon.0) 3704 : audit 1 from='client.? 172.21.15.72:0/1183359872' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "100"}]: dispatch 2024-03-30T15:27:19.694 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:19.696+0000 7f70da7fc640 1 -- 172.21.15.72:0/1183359872 <== mon.0 v2:172.21.15.72:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool 4e694c24-7f59-49ba-b14c-a8866b9195f4 v778) ==== 225+0+0 (secure 0 0 0) 0x7f70d4063430 con 0x7f70e41038d0 2024-03-30T15:27:19.694 INFO:tasks.workunit.client.0.smithi072.stderr:set-quota max_objects = 100 for pool 4e694c24-7f59-49ba-b14c-a8866b9195f4 2024-03-30T15:27:19.697 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:19.696+0000 7f70eb2fe640 1 -- 172.21.15.72:0/1183359872 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f70d006dbc0 msgr2=0x7f70d0070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:27:19.697 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:19.696+0000 7f70eb2fe640 1 --2- 172.21.15.72:0/1183359872 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f70d006dbc0 0x7f70d0070080 secure :-1 s=READY pgs=3225 cs=0 l=1 rev1=1 crypto rx=0x7f70e0009230 tx=0x7f70e0000bd0 comp rx=0 tx=0).stop 2024-03-30T15:27:19.697 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:19.696+0000 7f70eb2fe640 1 -- 172.21.15.72:0/1183359872 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70e41038d0 msgr2=0x7f70e419bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:27:19.697 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:19.696+0000 7f70eb2fe640 1 --2- 172.21.15.72:0/1183359872 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70e41038d0 0x7f70e419bf00 secure :-1 s=READY pgs=2393 cs=0 l=1 rev1=1 crypto rx=0x7f70d400b550 tx=0x7f70d400ba10 comp rx=0 tx=0).stop 2024-03-30T15:27:19.697 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:19.696+0000 7f70eb2fe640 1 -- 172.21.15.72:0/1183359872 shutdown_connections 2024-03-30T15:27:19.697 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:19.696+0000 7f70eb2fe640 1 --2- 172.21.15.72:0/1183359872 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70e41098d0 0x7f70e41a07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:19.697 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:19.696+0000 7f70eb2fe640 1 --2- 172.21.15.72:0/1183359872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70e4104290 0x7f70e419c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:19.697 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:19.696+0000 7f70eb2fe640 1 --2- 172.21.15.72:0/1183359872 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f70d006dbc0 0x7f70d0070080 unknown :-1 s=CLOSED pgs=3225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:19.697 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:19.696+0000 7f70eb2fe640 1 --2- 172.21.15.72:0/1183359872 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70e41038d0 0x7f70e419bf00 unknown :-1 s=CLOSED pgs=2393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:19.698 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:19.696+0000 7f70eb2fe640 1 -- 172.21.15.72:0/1183359872 >> 172.21.15.72:0/1183359872 conn(0x7f70e40ff380 msgr2=0x7f70e410a750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:27:19.698 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:19.700+0000 7f70eb2fe640 1 -- 172.21.15.72:0/1183359872 shutdown_connections 2024-03-30T15:27:19.698 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:19.700+0000 7f70eb2fe640 1 -- 172.21.15.72:0/1183359872 wait complete. 2024-03-30T15:27:19.721 INFO:tasks.workunit.client.0.smithi072.stderr:+ wait 132243 2024-03-30T15:27:19.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:19 smithi172 bash[23680]: cluster 2024-03-30T15:27:18.393308+0000 mgr.y (mgr.14526) 750 : cluster 0 pgmap v1270: 176 pgs: 176 active+clean; 699 KiB data, 794 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:27:19.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:19 smithi172 bash[23680]: audit 2024-03-30T15:27:18.684508+0000 mon.a (mon.0) 3705 : audit 1 from='client.? 172.21.15.72:0/1183359872' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "100"}]': finished 2024-03-30T15:27:19.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:19 smithi172 bash[23680]: cluster 2024-03-30T15:27:18.691326+0000 mon.a (mon.0) 3706 : cluster 0 osdmap e777: 8 total, 8 up, 8 in 2024-03-30T15:27:19.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:19 smithi172 bash[23680]: audit 2024-03-30T15:27:18.797263+0000 mon.a (mon.0) 3707 : audit 1 from='client.? 172.21.15.72:0/1183359872' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "100"}]: dispatch 2024-03-30T15:27:20.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:19 smithi072 bash[21573]: cluster 2024-03-30T15:27:18.393308+0000 mgr.y (mgr.14526) 750 : cluster 0 pgmap v1270: 176 pgs: 176 active+clean; 699 KiB data, 794 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:27:20.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:19 smithi072 bash[21573]: audit 2024-03-30T15:27:18.684508+0000 mon.a (mon.0) 3705 : audit 1 from='client.? 172.21.15.72:0/1183359872' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "100"}]': finished 2024-03-30T15:27:20.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:19 smithi072 bash[21573]: cluster 2024-03-30T15:27:18.691326+0000 mon.a (mon.0) 3706 : cluster 0 osdmap e777: 8 total, 8 up, 8 in 2024-03-30T15:27:20.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:19 smithi072 bash[21573]: audit 2024-03-30T15:27:18.797263+0000 mon.a (mon.0) 3707 : audit 1 from='client.? 172.21.15.72:0/1183359872' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "100"}]: dispatch 2024-03-30T15:27:20.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:19 smithi072 bash[28946]: cluster 2024-03-30T15:27:18.393308+0000 mgr.y (mgr.14526) 750 : cluster 0 pgmap v1270: 176 pgs: 176 active+clean; 699 KiB data, 794 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:27:20.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:19 smithi072 bash[28946]: audit 2024-03-30T15:27:18.684508+0000 mon.a (mon.0) 3705 : audit 1 from='client.? 172.21.15.72:0/1183359872' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "100"}]': finished 2024-03-30T15:27:20.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:19 smithi072 bash[28946]: cluster 2024-03-30T15:27:18.691326+0000 mon.a (mon.0) 3706 : cluster 0 osdmap e777: 8 total, 8 up, 8 in 2024-03-30T15:27:20.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:19 smithi072 bash[28946]: audit 2024-03-30T15:27:18.797263+0000 mon.a (mon.0) 3707 : audit 1 from='client.? 172.21.15.72:0/1183359872' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "100"}]: dispatch 2024-03-30T15:27:20.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:20 smithi172 bash[23680]: audit 2024-03-30T15:27:19.697048+0000 mon.a (mon.0) 3708 : audit 1 from='client.? 172.21.15.72:0/1183359872' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "100"}]': finished 2024-03-30T15:27:21.019 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:20 smithi172 bash[23680]: cluster 2024-03-30T15:27:19.707983+0000 mon.a (mon.0) 3709 : cluster 0 osdmap e778: 8 total, 8 up, 8 in 2024-03-30T15:27:21.032 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:20 smithi072 bash[21573]: audit 2024-03-30T15:27:19.697048+0000 mon.a (mon.0) 3708 : audit 1 from='client.? 172.21.15.72:0/1183359872' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "100"}]': finished 2024-03-30T15:27:21.032 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:20 smithi072 bash[21573]: cluster 2024-03-30T15:27:19.707983+0000 mon.a (mon.0) 3709 : cluster 0 osdmap e778: 8 total, 8 up, 8 in 2024-03-30T15:27:21.032 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:20 smithi072 bash[28946]: audit 2024-03-30T15:27:19.697048+0000 mon.a (mon.0) 3708 : audit 1 from='client.? 172.21.15.72:0/1183359872' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "100"}]': finished 2024-03-30T15:27:21.033 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:20 smithi072 bash[28946]: cluster 2024-03-30T15:27:19.707983+0000 mon.a (mon.0) 3709 : cluster 0 osdmap e778: 8 total, 8 up, 8 in 2024-03-30T15:27:21.419 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:27:21 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:27:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:27:21.968 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:27:21 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:27:21.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:21 smithi172 bash[23680]: cluster 2024-03-30T15:27:20.394033+0000 mgr.y (mgr.14526) 751 : cluster 0 pgmap v1273: 176 pgs: 176 active+clean; 699 KiB data, 794 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-30T15:27:22.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:21 smithi072 bash[21573]: cluster 2024-03-30T15:27:20.394033+0000 mgr.y (mgr.14526) 751 : cluster 0 pgmap v1273: 176 pgs: 176 active+clean; 699 KiB data, 794 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-30T15:27:22.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:21 smithi072 bash[28946]: cluster 2024-03-30T15:27:20.394033+0000 mgr.y (mgr.14526) 751 : cluster 0 pgmap v1273: 176 pgs: 176 active+clean; 699 KiB data, 794 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-30T15:27:22.413 INFO:tasks.workunit.client.0.smithi072.stderr:+ [ 0 -ne 0 ] 2024-03-30T15:27:22.414 INFO:tasks.workunit.client.0.smithi072.stderr:+ true 2024-03-30T15:27:22.414 INFO:tasks.workunit.client.0.smithi072.stderr:+ rados -p 4e694c24-7f59-49ba-b14c-a8866b9195f4 put twomore /etc/passwd 2024-03-30T15:27:22.460 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph osd pool set-quota 4e694c24-7f59-49ba-b14c-a8866b9195f4 max_bytes 100 2024-03-30T15:27:22.582 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:22.580+0000 7fb7194be640 1 -- 172.21.15.72:0/3195441735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7141098d0 msgr2=0x7fb714109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:27:22.582 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:22.580+0000 7fb7194be640 1 --2- 172.21.15.72:0/3195441735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7141098d0 0x7fb714109cb0 secure :-1 s=READY pgs=2396 cs=0 l=1 rev1=1 crypto rx=0x7fb7040098a0 tx=0x7fb70401c700 comp rx=0 tx=0).stop 2024-03-30T15:27:22.582 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:22.584+0000 7fb7194be640 1 -- 172.21.15.72:0/3195441735 shutdown_connections 2024-03-30T15:27:22.582 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:22.584+0000 7fb7194be640 1 --2- 172.21.15.72:0/3195441735 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb714104290 0x7fb7141107a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:22.582 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:22.584+0000 7fb7194be640 1 --2- 172.21.15.72:0/3195441735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7141038d0 0x7fb714103d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:22.582 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:22.584+0000 7fb7194be640 1 --2- 172.21.15.72:0/3195441735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7141098d0 0x7fb714109cb0 unknown :-1 s=CLOSED pgs=2396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:22.583 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:22.584+0000 7fb7194be640 1 -- 172.21.15.72:0/3195441735 >> 172.21.15.72:0/3195441735 conn(0x7fb7140ff380 msgr2=0x7fb7141017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:27:22.583 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:22.584+0000 7fb7194be640 1 -- 172.21.15.72:0/3195441735 shutdown_connections 2024-03-30T15:27:22.583 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:22.584+0000 7fb7194be640 1 -- 172.21.15.72:0/3195441735 wait complete. 2024-03-30T15:27:22.583 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:22.584+0000 7fb7194be640 1 Processor -- start 2024-03-30T15:27:22.583 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:22.584+0000 7fb7194be640 1 -- start start 2024-03-30T15:27:22.585 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:22.584+0000 7fb7194be640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7141038d0 0x7fb71419bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:27:22.585 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:22.584+0000 7fb7194be640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb714104290 0x7fb71419c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:27:22.585 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:22.584+0000 7fb7194be640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7141098d0 0x7fb7141a0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:27:22.585 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:22.584+0000 7fb7194be640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fb7141158f0 con 0x7fb7141098d0 2024-03-30T15:27:22.585 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:22.584+0000 7fb7194be640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb714115770 con 0x7fb7141038d0 2024-03-30T15:27:22.585 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:22.584+0000 7fb7194be640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fb714115a70 con 0x7fb714104290 2024-03-30T15:27:22.585 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:22.584+0000 7fb7127fc640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb714104290 0x7fb71419c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:27:22.585 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:22.584+0000 7fb7137fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7141098d0 0x7fb7141a0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:27:22.585 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:22.584+0000 7fb7127fc640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb714104290 0x7fb71419c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:51564/0 (socket says 172.21.15.72:51564) 2024-03-30T15:27:22.585 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:22.584+0000 7fb7127fc640 1 -- 172.21.15.72:0/3046146379 learned_addr learned my addr 172.21.15.72:0/3046146379 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T15:27:22.586 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:22.584+0000 7fb712ffd640 1 --2- 172.21.15.72:0/3046146379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7141038d0 0x7fb71419bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:27:22.586 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:22.584+0000 7fb7137fe640 1 -- 172.21.15.72:0/3046146379 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb714104290 msgr2=0x7fb71419c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:27:22.586 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:22.584+0000 7fb7137fe640 1 --2- 172.21.15.72:0/3046146379 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb714104290 0x7fb71419c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:22.586 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:22.584+0000 7fb7137fe640 1 -- 172.21.15.72:0/3046146379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7141038d0 msgr2=0x7fb71419bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:27:22.586 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:22.584+0000 7fb7137fe640 1 --2- 172.21.15.72:0/3046146379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7141038d0 0x7fb71419bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:22.586 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:22.584+0000 7fb7137fe640 1 -- 172.21.15.72:0/3046146379 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7141a0f50 con 0x7fb7141098d0 2024-03-30T15:27:22.586 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:22.584+0000 7fb7127fc640 1 --2- 172.21.15.72:0/3046146379 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb714104290 0x7fb71419c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T15:27:22.586 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:22.584+0000 7fb7137fe640 1 --2- 172.21.15.72:0/3046146379 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7141098d0 0x7fb7141a0870 secure :-1 s=READY pgs=2397 cs=0 l=1 rev1=1 crypto rx=0x7fb70c00efc0 tx=0x7fb70c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:27:22.586 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:22.584+0000 7fb6fbfff640 1 -- 172.21.15.72:0/3046146379 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70c003980 con 0x7fb7141098d0 2024-03-30T15:27:22.586 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:22.584+0000 7fb6fbfff640 1 -- 172.21.15.72:0/3046146379 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7fb70c004020 con 0x7fb7141098d0 2024-03-30T15:27:22.586 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:22.584+0000 7fb7194be640 1 -- 172.21.15.72:0/3046146379 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7141a1240 con 0x7fb7141098d0 2024-03-30T15:27:22.586 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:22.584+0000 7fb6fbfff640 1 -- 172.21.15.72:0/3046146379 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70c00b870 con 0x7fb7141098d0 2024-03-30T15:27:22.586 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:22.584+0000 7fb7194be640 1 -- 172.21.15.72:0/3046146379 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7141a8b20 con 0x7fb7141098d0 2024-03-30T15:27:22.586 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:22.584+0000 7fb7194be640 1 -- 172.21.15.72:0/3046146379 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb714068a90 con 0x7fb7141098d0 2024-03-30T15:27:22.586 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:22.584+0000 7fb6fbfff640 1 -- 172.21.15.72:0/3046146379 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 21) ==== 91831+0+0 (secure 0 0 0) 0x7fb70c01d020 con 0x7fb7141098d0 2024-03-30T15:27:22.587 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:22.588+0000 7fb6fbfff640 1 --2- 172.21.15.72:0/3046146379 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fb6fc06dbc0 0x7fb6fc070080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:27:22.587 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:22.588+0000 7fb712ffd640 1 --2- 172.21.15.72:0/3046146379 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fb6fc06dbc0 0x7fb6fc070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:27:22.587 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:22.588+0000 7fb6fbfff640 1 -- 172.21.15.72:0/3046146379 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(779..779 src has 269..779) ==== 9096+0+0 (secure 0 0 0) 0x7fb70c08e570 con 0x7fb7141098d0 2024-03-30T15:27:22.587 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:22.588+0000 7fb712ffd640 1 --2- 172.21.15.72:0/3046146379 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fb6fc06dbc0 0x7fb6fc070080 secure :-1 s=READY pgs=3227 cs=0 l=1 rev1=1 crypto rx=0x7fb704000c10 tx=0x7fb70401af40 comp rx=0 tx=0).ready entity=mgr.14526 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:27:22.590 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:22.592+0000 7fb6fbfff640 1 -- 172.21.15.72:0/3046146379 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fb70c05b4f0 con 0x7fb7141098d0 2024-03-30T15:27:22.766 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:22.768+0000 7fb7194be640 1 -- 172.21.15.72:0/3046146379 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "100"} v 0) -- 0x7fb7141a8cf0 con 0x7fb7141098d0 2024-03-30T15:27:22.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:22 smithi172 bash[23680]: audit 2024-03-30T15:27:21.810145+0000 mgr.y (mgr.14526) 752 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:27:22.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:22 smithi172 bash[23680]: cluster 2024-03-30T15:27:22.385567+0000 mon.a (mon.0) 3710 : cluster 1 pool '4e694c24-7f59-49ba-b14c-a8866b9195f4' no longer out of quota; removing NO_QUOTA flag 2024-03-30T15:27:22.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:22 smithi172 bash[23680]: cluster 2024-03-30T15:27:22.386120+0000 mon.a (mon.0) 3711 : cluster 1 Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-03-30T15:27:22.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:22 smithi172 bash[23680]: cluster 2024-03-30T15:27:22.398342+0000 mon.a (mon.0) 3712 : cluster 0 osdmap e779: 8 total, 8 up, 8 in 2024-03-30T15:27:22.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:22 smithi172 bash[23680]: audit 2024-03-30T15:27:22.679320+0000 mon.a (mon.0) 3713 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:27:22.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:22 smithi172 bash[23680]: audit 2024-03-30T15:27:22.682128+0000 mon.c (mon.2) 538 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:27:23.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:22 smithi072 bash[21573]: audit 2024-03-30T15:27:21.810145+0000 mgr.y (mgr.14526) 752 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:27:23.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:22 smithi072 bash[21573]: cluster 2024-03-30T15:27:22.385567+0000 mon.a (mon.0) 3710 : cluster 1 pool '4e694c24-7f59-49ba-b14c-a8866b9195f4' no longer out of quota; removing NO_QUOTA flag 2024-03-30T15:27:23.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:22 smithi072 bash[21573]: cluster 2024-03-30T15:27:22.386120+0000 mon.a (mon.0) 3711 : cluster 1 Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-03-30T15:27:23.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:22 smithi072 bash[21573]: cluster 2024-03-30T15:27:22.398342+0000 mon.a (mon.0) 3712 : cluster 0 osdmap e779: 8 total, 8 up, 8 in 2024-03-30T15:27:23.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:22 smithi072 bash[21573]: audit 2024-03-30T15:27:22.679320+0000 mon.a (mon.0) 3713 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:27:23.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:22 smithi072 bash[21573]: audit 2024-03-30T15:27:22.682128+0000 mon.c (mon.2) 538 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:27:23.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:22 smithi072 bash[28946]: audit 2024-03-30T15:27:21.810145+0000 mgr.y (mgr.14526) 752 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:27:23.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:22 smithi072 bash[28946]: cluster 2024-03-30T15:27:22.385567+0000 mon.a (mon.0) 3710 : cluster 1 pool '4e694c24-7f59-49ba-b14c-a8866b9195f4' no longer out of quota; removing NO_QUOTA flag 2024-03-30T15:27:23.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:22 smithi072 bash[28946]: cluster 2024-03-30T15:27:22.386120+0000 mon.a (mon.0) 3711 : cluster 1 Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-03-30T15:27:23.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:22 smithi072 bash[28946]: cluster 2024-03-30T15:27:22.398342+0000 mon.a (mon.0) 3712 : cluster 0 osdmap e779: 8 total, 8 up, 8 in 2024-03-30T15:27:23.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:22 smithi072 bash[28946]: audit 2024-03-30T15:27:22.679320+0000 mon.a (mon.0) 3713 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:27:23.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:22 smithi072 bash[28946]: audit 2024-03-30T15:27:22.682128+0000 mon.c (mon.2) 538 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:27:23.720 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:23.719+0000 7fb6fbfff640 1 -- 172.21.15.72:0/3046146379 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool 4e694c24-7f59-49ba-b14c-a8866b9195f4 v780) ==== 221+0+0 (secure 0 0 0) 0x7fb70c05ef40 con 0x7fb7141098d0 2024-03-30T15:27:23.831 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:23.831+0000 7fb7194be640 1 -- 172.21.15.72:0/3046146379 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "100"} v 0) -- 0x7fb714061de0 con 0x7fb7141098d0 2024-03-30T15:27:23.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:23 smithi172 bash[23680]: cluster 2024-03-30T15:27:22.394902+0000 mgr.y (mgr.14526) 753 : cluster 0 pgmap v1275: 176 pgs: 176 active+clean; 699 KiB data, 792 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:27:23.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:23 smithi172 bash[23680]: audit 2024-03-30T15:27:22.770398+0000 mon.a (mon.0) 3714 : audit 1 from='client.? 172.21.15.72:0/3046146379' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "100"}]: dispatch 2024-03-30T15:27:24.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:23 smithi072 bash[21573]: cluster 2024-03-30T15:27:22.394902+0000 mgr.y (mgr.14526) 753 : cluster 0 pgmap v1275: 176 pgs: 176 active+clean; 699 KiB data, 792 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:27:24.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:23 smithi072 bash[21573]: audit 2024-03-30T15:27:22.770398+0000 mon.a (mon.0) 3714 : audit 1 from='client.? 172.21.15.72:0/3046146379' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "100"}]: dispatch 2024-03-30T15:27:24.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:23 smithi072 bash[28946]: cluster 2024-03-30T15:27:22.394902+0000 mgr.y (mgr.14526) 753 : cluster 0 pgmap v1275: 176 pgs: 176 active+clean; 699 KiB data, 792 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:27:24.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:23 smithi072 bash[28946]: audit 2024-03-30T15:27:22.770398+0000 mon.a (mon.0) 3714 : audit 1 from='client.? 172.21.15.72:0/3046146379' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "100"}]: dispatch 2024-03-30T15:27:24.729 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:24.727+0000 7fb6fbfff640 1 -- 172.21.15.72:0/3046146379 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool 4e694c24-7f59-49ba-b14c-a8866b9195f4 v781) ==== 221+0+0 (secure 0 0 0) 0x7fb70c063770 con 0x7fb7141098d0 2024-03-30T15:27:24.729 INFO:tasks.workunit.client.0.smithi072.stderr:set-quota max_bytes = 100 for pool 4e694c24-7f59-49ba-b14c-a8866b9195f4 2024-03-30T15:27:24.734 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:24.735+0000 7fb7194be640 1 -- 172.21.15.72:0/3046146379 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fb6fc06dbc0 msgr2=0x7fb6fc070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:27:24.734 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:24.735+0000 7fb7194be640 1 --2- 172.21.15.72:0/3046146379 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fb6fc06dbc0 0x7fb6fc070080 secure :-1 s=READY pgs=3227 cs=0 l=1 rev1=1 crypto rx=0x7fb704000c10 tx=0x7fb70401af40 comp rx=0 tx=0).stop 2024-03-30T15:27:24.734 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:24.735+0000 7fb7194be640 1 -- 172.21.15.72:0/3046146379 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7141098d0 msgr2=0x7fb7141a0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:27:24.734 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:24.735+0000 7fb7194be640 1 --2- 172.21.15.72:0/3046146379 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7141098d0 0x7fb7141a0870 secure :-1 s=READY pgs=2397 cs=0 l=1 rev1=1 crypto rx=0x7fb70c00efc0 tx=0x7fb70c00c800 comp rx=0 tx=0).stop 2024-03-30T15:27:24.734 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:24.735+0000 7fb7194be640 1 -- 172.21.15.72:0/3046146379 shutdown_connections 2024-03-30T15:27:24.734 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:24.735+0000 7fb7194be640 1 --2- 172.21.15.72:0/3046146379 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fb6fc06dbc0 0x7fb6fc070080 secure :-1 s=CLOSED pgs=3227 cs=0 l=1 rev1=1 crypto rx=0x7fb704000c10 tx=0x7fb70401af40 comp rx=0 tx=0).stop 2024-03-30T15:27:24.734 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:24.735+0000 7fb7194be640 1 --2- 172.21.15.72:0/3046146379 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7141098d0 0x7fb7141a0870 unknown :-1 s=CLOSED pgs=2397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:24.735 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:24.735+0000 7fb7194be640 1 --2- 172.21.15.72:0/3046146379 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb714104290 0x7fb71419c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:24.735 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:24.735+0000 7fb7194be640 1 --2- 172.21.15.72:0/3046146379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7141038d0 0x7fb71419bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:24.735 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:24.735+0000 7fb7194be640 1 -- 172.21.15.72:0/3046146379 >> 172.21.15.72:0/3046146379 conn(0x7fb7140ff380 msgr2=0x7fb7140ff760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:27:24.735 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:24.735+0000 7fb7194be640 1 -- 172.21.15.72:0/3046146379 shutdown_connections 2024-03-30T15:27:24.737 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:24.735+0000 7fb7194be640 1 -- 172.21.15.72:0/3046146379 wait complete. 2024-03-30T15:27:24.755 INFO:tasks.workunit.client.0.smithi072.stderr:+ sleep 30 2024-03-30T15:27:25.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:24 smithi072 bash[28946]: audit 2024-03-30T15:27:23.722740+0000 mon.a (mon.0) 3715 : audit 1 from='client.? 172.21.15.72:0/3046146379' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "100"}]': finished 2024-03-30T15:27:25.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:24 smithi072 bash[28946]: cluster 2024-03-30T15:27:23.727494+0000 mon.a (mon.0) 3716 : cluster 0 osdmap e780: 8 total, 8 up, 8 in 2024-03-30T15:27:25.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:24 smithi072 bash[28946]: audit 2024-03-30T15:27:23.834705+0000 mon.a (mon.0) 3717 : audit 1 from='client.? 172.21.15.72:0/3046146379' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "100"}]: dispatch 2024-03-30T15:27:25.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:24 smithi072 bash[21573]: audit 2024-03-30T15:27:23.722740+0000 mon.a (mon.0) 3715 : audit 1 from='client.? 172.21.15.72:0/3046146379' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "100"}]': finished 2024-03-30T15:27:25.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:24 smithi072 bash[21573]: cluster 2024-03-30T15:27:23.727494+0000 mon.a (mon.0) 3716 : cluster 0 osdmap e780: 8 total, 8 up, 8 in 2024-03-30T15:27:25.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:24 smithi072 bash[21573]: audit 2024-03-30T15:27:23.834705+0000 mon.a (mon.0) 3717 : audit 1 from='client.? 172.21.15.72:0/3046146379' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "100"}]: dispatch 2024-03-30T15:27:25.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:24 smithi172 bash[23680]: audit 2024-03-30T15:27:23.722740+0000 mon.a (mon.0) 3715 : audit 1 from='client.? 172.21.15.72:0/3046146379' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "100"}]': finished 2024-03-30T15:27:25.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:24 smithi172 bash[23680]: cluster 2024-03-30T15:27:23.727494+0000 mon.a (mon.0) 3716 : cluster 0 osdmap e780: 8 total, 8 up, 8 in 2024-03-30T15:27:25.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:24 smithi172 bash[23680]: audit 2024-03-30T15:27:23.834705+0000 mon.a (mon.0) 3717 : audit 1 from='client.? 172.21.15.72:0/3046146379' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "100"}]: dispatch 2024-03-30T15:27:26.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:25 smithi072 bash[21573]: cluster 2024-03-30T15:27:24.395784+0000 mgr.y (mgr.14526) 754 : cluster 0 pgmap v1277: 176 pgs: 176 active+clean; 699 KiB data, 792 MiB used, 714 GiB / 715 GiB avail; 897 B/s rd, 0 op/s 2024-03-30T15:27:26.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:25 smithi072 bash[21573]: audit 2024-03-30T15:27:24.731662+0000 mon.a (mon.0) 3718 : audit 1 from='client.? 172.21.15.72:0/3046146379' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "100"}]': finished 2024-03-30T15:27:26.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:25 smithi072 bash[21573]: cluster 2024-03-30T15:27:24.744538+0000 mon.a (mon.0) 3719 : cluster 0 osdmap e781: 8 total, 8 up, 8 in 2024-03-30T15:27:26.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:25 smithi072 bash[28946]: cluster 2024-03-30T15:27:24.395784+0000 mgr.y (mgr.14526) 754 : cluster 0 pgmap v1277: 176 pgs: 176 active+clean; 699 KiB data, 792 MiB used, 714 GiB / 715 GiB avail; 897 B/s rd, 0 op/s 2024-03-30T15:27:26.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:25 smithi072 bash[28946]: audit 2024-03-30T15:27:24.731662+0000 mon.a (mon.0) 3718 : audit 1 from='client.? 172.21.15.72:0/3046146379' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "100"}]': finished 2024-03-30T15:27:26.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:25 smithi072 bash[28946]: cluster 2024-03-30T15:27:24.744538+0000 mon.a (mon.0) 3719 : cluster 0 osdmap e781: 8 total, 8 up, 8 in 2024-03-30T15:27:26.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:25 smithi172 bash[23680]: cluster 2024-03-30T15:27:24.395784+0000 mgr.y (mgr.14526) 754 : cluster 0 pgmap v1277: 176 pgs: 176 active+clean; 699 KiB data, 792 MiB used, 714 GiB / 715 GiB avail; 897 B/s rd, 0 op/s 2024-03-30T15:27:26.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:25 smithi172 bash[23680]: audit 2024-03-30T15:27:24.731662+0000 mon.a (mon.0) 3718 : audit 1 from='client.? 172.21.15.72:0/3046146379' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "100"}]': finished 2024-03-30T15:27:26.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:25 smithi172 bash[23680]: cluster 2024-03-30T15:27:24.744538+0000 mon.a (mon.0) 3719 : cluster 0 osdmap e781: 8 total, 8 up, 8 in 2024-03-30T15:27:28.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:27 smithi072 bash[21573]: cluster 2024-03-30T15:27:26.397971+0000 mgr.y (mgr.14526) 755 : cluster 0 pgmap v1279: 176 pgs: 176 active+clean; 723 KiB data, 767 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 4.0 KiB/s wr, 1 op/s 2024-03-30T15:27:28.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:27 smithi072 bash[21573]: audit 2024-03-30T15:27:26.885145+0000 mon.c (mon.2) 539 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:27:28.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:27 smithi072 bash[21573]: cluster 2024-03-30T15:27:27.387752+0000 mon.a (mon.0) 3720 : cluster 3 pool '4e694c24-7f59-49ba-b14c-a8866b9195f4' is full (reached quota's max_bytes: 100 B) 2024-03-30T15:27:28.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:27 smithi072 bash[21573]: cluster 2024-03-30T15:27:27.388189+0000 mon.a (mon.0) 3721 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-03-30T15:27:28.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:27 smithi072 bash[21573]: cluster 2024-03-30T15:27:27.393137+0000 mon.a (mon.0) 3722 : cluster 0 osdmap e782: 8 total, 8 up, 8 in 2024-03-30T15:27:28.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:27 smithi072 bash[21573]: audit 2024-03-30T15:27:27.615625+0000 mon.c (mon.2) 540 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:27:28.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:27 smithi072 bash[21573]: audit 2024-03-30T15:27:27.617253+0000 mon.c (mon.2) 541 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:27:28.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:27 smithi072 bash[21573]: audit 2024-03-30T15:27:27.625054+0000 mon.a (mon.0) 3723 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:27:28.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:27 smithi072 bash[28946]: cluster 2024-03-30T15:27:26.397971+0000 mgr.y (mgr.14526) 755 : cluster 0 pgmap v1279: 176 pgs: 176 active+clean; 723 KiB data, 767 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 4.0 KiB/s wr, 1 op/s 2024-03-30T15:27:28.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:27 smithi072 bash[28946]: audit 2024-03-30T15:27:26.885145+0000 mon.c (mon.2) 539 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:27:28.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:27 smithi072 bash[28946]: cluster 2024-03-30T15:27:27.387752+0000 mon.a (mon.0) 3720 : cluster 3 pool '4e694c24-7f59-49ba-b14c-a8866b9195f4' is full (reached quota's max_bytes: 100 B) 2024-03-30T15:27:28.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:27 smithi072 bash[28946]: cluster 2024-03-30T15:27:27.388189+0000 mon.a (mon.0) 3721 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-03-30T15:27:28.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:27 smithi072 bash[28946]: cluster 2024-03-30T15:27:27.393137+0000 mon.a (mon.0) 3722 : cluster 0 osdmap e782: 8 total, 8 up, 8 in 2024-03-30T15:27:28.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:27 smithi072 bash[28946]: audit 2024-03-30T15:27:27.615625+0000 mon.c (mon.2) 540 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:27:28.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:27 smithi072 bash[28946]: audit 2024-03-30T15:27:27.617253+0000 mon.c (mon.2) 541 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:27:28.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:27 smithi072 bash[28946]: audit 2024-03-30T15:27:27.625054+0000 mon.a (mon.0) 3723 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:27:28.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:27 smithi172 bash[23680]: cluster 2024-03-30T15:27:26.397971+0000 mgr.y (mgr.14526) 755 : cluster 0 pgmap v1279: 176 pgs: 176 active+clean; 723 KiB data, 767 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 4.0 KiB/s wr, 1 op/s 2024-03-30T15:27:28.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:27 smithi172 bash[23680]: audit 2024-03-30T15:27:26.885145+0000 mon.c (mon.2) 539 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:27:28.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:27 smithi172 bash[23680]: cluster 2024-03-30T15:27:27.387752+0000 mon.a (mon.0) 3720 : cluster 3 pool '4e694c24-7f59-49ba-b14c-a8866b9195f4' is full (reached quota's max_bytes: 100 B) 2024-03-30T15:27:28.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:27 smithi172 bash[23680]: cluster 2024-03-30T15:27:27.388189+0000 mon.a (mon.0) 3721 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-03-30T15:27:28.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:27 smithi172 bash[23680]: cluster 2024-03-30T15:27:27.393137+0000 mon.a (mon.0) 3722 : cluster 0 osdmap e782: 8 total, 8 up, 8 in 2024-03-30T15:27:28.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:27 smithi172 bash[23680]: audit 2024-03-30T15:27:27.615625+0000 mon.c (mon.2) 540 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:27:28.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:27 smithi172 bash[23680]: audit 2024-03-30T15:27:27.617253+0000 mon.c (mon.2) 541 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:27:28.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:27 smithi172 bash[23680]: audit 2024-03-30T15:27:27.625054+0000 mon.a (mon.0) 3723 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:27:30.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:29 smithi072 bash[21573]: cluster 2024-03-30T15:27:28.398698+0000 mgr.y (mgr.14526) 756 : cluster 0 pgmap v1281: 176 pgs: 176 active+clean; 723 KiB data, 767 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 4.0 KiB/s wr, 1 op/s 2024-03-30T15:27:30.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:29 smithi072 bash[28946]: cluster 2024-03-30T15:27:28.398698+0000 mgr.y (mgr.14526) 756 : cluster 0 pgmap v1281: 176 pgs: 176 active+clean; 723 KiB data, 767 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 4.0 KiB/s wr, 1 op/s 2024-03-30T15:27:30.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:29 smithi172 bash[23680]: cluster 2024-03-30T15:27:28.398698+0000 mgr.y (mgr.14526) 756 : cluster 0 pgmap v1281: 176 pgs: 176 active+clean; 723 KiB data, 767 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 4.0 KiB/s wr, 1 op/s 2024-03-30T15:27:31.419 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:27:31 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:27:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:27:32.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:31 smithi072 bash[21573]: cluster 2024-03-30T15:27:30.399477+0000 mgr.y (mgr.14526) 757 : cluster 0 pgmap v1282: 176 pgs: 176 active+clean; 723 KiB data, 767 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 3.6 KiB/s wr, 1 op/s 2024-03-30T15:27:32.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:31 smithi072 bash[28946]: cluster 2024-03-30T15:27:30.399477+0000 mgr.y (mgr.14526) 757 : cluster 0 pgmap v1282: 176 pgs: 176 active+clean; 723 KiB data, 767 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 3.6 KiB/s wr, 1 op/s 2024-03-30T15:27:32.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:27:31 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:27:32.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:31 smithi172 bash[23680]: cluster 2024-03-30T15:27:30.399477+0000 mgr.y (mgr.14526) 757 : cluster 0 pgmap v1282: 176 pgs: 176 active+clean; 723 KiB data, 767 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 3.6 KiB/s wr, 1 op/s 2024-03-30T15:27:33.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:32 smithi072 bash[21573]: audit 2024-03-30T15:27:31.821665+0000 mgr.y (mgr.14526) 758 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:27:33.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:32 smithi072 bash[28946]: audit 2024-03-30T15:27:31.821665+0000 mgr.y (mgr.14526) 758 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:27:33.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:32 smithi172 bash[23680]: audit 2024-03-30T15:27:31.821665+0000 mgr.y (mgr.14526) 758 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:27:34.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:33 smithi072 bash[21573]: cluster 2024-03-30T15:27:32.401394+0000 mgr.y (mgr.14526) 759 : cluster 0 pgmap v1283: 176 pgs: 176 active+clean; 723 KiB data, 765 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.0 KiB/s wr, 1 op/s 2024-03-30T15:27:34.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:33 smithi072 bash[28946]: cluster 2024-03-30T15:27:32.401394+0000 mgr.y (mgr.14526) 759 : cluster 0 pgmap v1283: 176 pgs: 176 active+clean; 723 KiB data, 765 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.0 KiB/s wr, 1 op/s 2024-03-30T15:27:34.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:33 smithi172 bash[23680]: cluster 2024-03-30T15:27:32.401394+0000 mgr.y (mgr.14526) 759 : cluster 0 pgmap v1283: 176 pgs: 176 active+clean; 723 KiB data, 765 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.0 KiB/s wr, 1 op/s 2024-03-30T15:27:36.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:35 smithi072 bash[21573]: cluster 2024-03-30T15:27:34.402128+0000 mgr.y (mgr.14526) 760 : cluster 0 pgmap v1284: 176 pgs: 176 active+clean; 723 KiB data, 765 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 2.5 KiB/s wr, 1 op/s 2024-03-30T15:27:36.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:35 smithi072 bash[28946]: cluster 2024-03-30T15:27:34.402128+0000 mgr.y (mgr.14526) 760 : cluster 0 pgmap v1284: 176 pgs: 176 active+clean; 723 KiB data, 765 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 2.5 KiB/s wr, 1 op/s 2024-03-30T15:27:36.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:35 smithi172 bash[23680]: cluster 2024-03-30T15:27:34.402128+0000 mgr.y (mgr.14526) 760 : cluster 0 pgmap v1284: 176 pgs: 176 active+clean; 723 KiB data, 765 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 2.5 KiB/s wr, 1 op/s 2024-03-30T15:27:38.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:37 smithi072 bash[21573]: cluster 2024-03-30T15:27:36.403979+0000 mgr.y (mgr.14526) 761 : cluster 0 pgmap v1285: 176 pgs: 176 active+clean; 723 KiB data, 765 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T15:27:38.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:37 smithi072 bash[21573]: audit 2024-03-30T15:27:37.722083+0000 mon.a (mon.0) 3724 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:27:38.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:37 smithi072 bash[21573]: audit 2024-03-30T15:27:37.725344+0000 mon.c (mon.2) 542 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:27:38.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:37 smithi072 bash[28946]: cluster 2024-03-30T15:27:36.403979+0000 mgr.y (mgr.14526) 761 : cluster 0 pgmap v1285: 176 pgs: 176 active+clean; 723 KiB data, 765 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T15:27:38.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:37 smithi072 bash[28946]: audit 2024-03-30T15:27:37.722083+0000 mon.a (mon.0) 3724 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:27:38.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:37 smithi072 bash[28946]: audit 2024-03-30T15:27:37.725344+0000 mon.c (mon.2) 542 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:27:38.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:37 smithi172 bash[23680]: cluster 2024-03-30T15:27:36.403979+0000 mgr.y (mgr.14526) 761 : cluster 0 pgmap v1285: 176 pgs: 176 active+clean; 723 KiB data, 765 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T15:27:38.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:37 smithi172 bash[23680]: audit 2024-03-30T15:27:37.722083+0000 mon.a (mon.0) 3724 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:27:38.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:37 smithi172 bash[23680]: audit 2024-03-30T15:27:37.725344+0000 mon.c (mon.2) 542 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:27:40.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:39 smithi072 bash[21573]: cluster 2024-03-30T15:27:38.404792+0000 mgr.y (mgr.14526) 762 : cluster 0 pgmap v1286: 176 pgs: 176 active+clean; 723 KiB data, 765 MiB used, 714 GiB / 715 GiB avail; 929 B/s rd, 0 op/s 2024-03-30T15:27:40.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:39 smithi072 bash[28946]: cluster 2024-03-30T15:27:38.404792+0000 mgr.y (mgr.14526) 762 : cluster 0 pgmap v1286: 176 pgs: 176 active+clean; 723 KiB data, 765 MiB used, 714 GiB / 715 GiB avail; 929 B/s rd, 0 op/s 2024-03-30T15:27:40.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:39 smithi172 bash[23680]: cluster 2024-03-30T15:27:38.404792+0000 mgr.y (mgr.14526) 762 : cluster 0 pgmap v1286: 176 pgs: 176 active+clean; 723 KiB data, 765 MiB used, 714 GiB / 715 GiB avail; 929 B/s rd, 0 op/s 2024-03-30T15:27:41.419 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:27:41 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:27:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:27:42.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:41 smithi072 bash[21573]: cluster 2024-03-30T15:27:40.405614+0000 mgr.y (mgr.14526) 763 : cluster 0 pgmap v1287: 176 pgs: 176 active+clean; 723 KiB data, 765 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:27:42.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:41 smithi072 bash[28946]: cluster 2024-03-30T15:27:40.405614+0000 mgr.y (mgr.14526) 763 : cluster 0 pgmap v1287: 176 pgs: 176 active+clean; 723 KiB data, 765 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:27:42.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:27:41 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:27:42.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:41 smithi172 bash[23680]: cluster 2024-03-30T15:27:40.405614+0000 mgr.y (mgr.14526) 763 : cluster 0 pgmap v1287: 176 pgs: 176 active+clean; 723 KiB data, 765 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:27:43.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:42 smithi072 bash[21573]: audit 2024-03-30T15:27:41.833195+0000 mgr.y (mgr.14526) 764 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:27:43.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:42 smithi072 bash[28946]: audit 2024-03-30T15:27:41.833195+0000 mgr.y (mgr.14526) 764 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:27:43.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:42 smithi172 bash[23680]: audit 2024-03-30T15:27:41.833195+0000 mgr.y (mgr.14526) 764 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:27:44.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:43 smithi072 bash[21573]: cluster 2024-03-30T15:27:42.407765+0000 mgr.y (mgr.14526) 765 : cluster 0 pgmap v1288: 176 pgs: 176 active+clean; 723 KiB data, 798 MiB used, 714 GiB / 715 GiB avail; 22 KiB/s rd, 0 B/s wr, 35 op/s 2024-03-30T15:27:44.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:43 smithi072 bash[28946]: cluster 2024-03-30T15:27:42.407765+0000 mgr.y (mgr.14526) 765 : cluster 0 pgmap v1288: 176 pgs: 176 active+clean; 723 KiB data, 798 MiB used, 714 GiB / 715 GiB avail; 22 KiB/s rd, 0 B/s wr, 35 op/s 2024-03-30T15:27:44.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:43 smithi172 bash[23680]: cluster 2024-03-30T15:27:42.407765+0000 mgr.y (mgr.14526) 765 : cluster 0 pgmap v1288: 176 pgs: 176 active+clean; 723 KiB data, 798 MiB used, 714 GiB / 715 GiB avail; 22 KiB/s rd, 0 B/s wr, 35 op/s 2024-03-30T15:27:46.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:45 smithi072 bash[21573]: cluster 2024-03-30T15:27:44.408512+0000 mgr.y (mgr.14526) 766 : cluster 0 pgmap v1289: 176 pgs: 176 active+clean; 723 KiB data, 798 MiB used, 714 GiB / 715 GiB avail; 22 KiB/s rd, 0 B/s wr, 35 op/s 2024-03-30T15:27:46.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:45 smithi072 bash[28946]: cluster 2024-03-30T15:27:44.408512+0000 mgr.y (mgr.14526) 766 : cluster 0 pgmap v1289: 176 pgs: 176 active+clean; 723 KiB data, 798 MiB used, 714 GiB / 715 GiB avail; 22 KiB/s rd, 0 B/s wr, 35 op/s 2024-03-30T15:27:46.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:45 smithi172 bash[23680]: cluster 2024-03-30T15:27:44.408512+0000 mgr.y (mgr.14526) 766 : cluster 0 pgmap v1289: 176 pgs: 176 active+clean; 723 KiB data, 798 MiB used, 714 GiB / 715 GiB avail; 22 KiB/s rd, 0 B/s wr, 35 op/s 2024-03-30T15:27:48.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:47 smithi072 bash[21573]: cluster 2024-03-30T15:27:46.410355+0000 mgr.y (mgr.14526) 767 : cluster 0 pgmap v1290: 176 pgs: 176 active+clean; 723 KiB data, 833 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-03-30T15:27:48.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:47 smithi072 bash[28946]: cluster 2024-03-30T15:27:46.410355+0000 mgr.y (mgr.14526) 767 : cluster 0 pgmap v1290: 176 pgs: 176 active+clean; 723 KiB data, 833 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-03-30T15:27:48.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:47 smithi172 bash[23680]: cluster 2024-03-30T15:27:46.410355+0000 mgr.y (mgr.14526) 767 : cluster 0 pgmap v1290: 176 pgs: 176 active+clean; 723 KiB data, 833 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-03-30T15:27:50.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:49 smithi072 bash[21573]: cluster 2024-03-30T15:27:48.411334+0000 mgr.y (mgr.14526) 768 : cluster 0 pgmap v1291: 176 pgs: 176 active+clean; 723 KiB data, 833 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-03-30T15:27:50.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:49 smithi072 bash[28946]: cluster 2024-03-30T15:27:48.411334+0000 mgr.y (mgr.14526) 768 : cluster 0 pgmap v1291: 176 pgs: 176 active+clean; 723 KiB data, 833 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-03-30T15:27:50.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:49 smithi172 bash[23680]: cluster 2024-03-30T15:27:48.411334+0000 mgr.y (mgr.14526) 768 : cluster 0 pgmap v1291: 176 pgs: 176 active+clean; 723 KiB data, 833 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-03-30T15:27:51.419 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:27:51 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:27:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:27:52.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:51 smithi072 bash[21573]: cluster 2024-03-30T15:27:50.412119+0000 mgr.y (mgr.14526) 769 : cluster 0 pgmap v1292: 176 pgs: 176 active+clean; 723 KiB data, 833 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-03-30T15:27:52.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:51 smithi072 bash[28946]: cluster 2024-03-30T15:27:50.412119+0000 mgr.y (mgr.14526) 769 : cluster 0 pgmap v1292: 176 pgs: 176 active+clean; 723 KiB data, 833 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-03-30T15:27:52.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:27:51 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:27:52.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:51 smithi172 bash[23680]: cluster 2024-03-30T15:27:50.412119+0000 mgr.y (mgr.14526) 769 : cluster 0 pgmap v1292: 176 pgs: 176 active+clean; 723 KiB data, 833 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-03-30T15:27:53.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:52 smithi072 bash[21573]: audit 2024-03-30T15:27:51.844932+0000 mgr.y (mgr.14526) 770 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:27:53.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:52 smithi072 bash[21573]: audit 2024-03-30T15:27:52.758329+0000 mon.c (mon.2) 543 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:27:53.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:52 smithi072 bash[28946]: audit 2024-03-30T15:27:51.844932+0000 mgr.y (mgr.14526) 770 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:27:53.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:52 smithi072 bash[28946]: audit 2024-03-30T15:27:52.758329+0000 mon.c (mon.2) 543 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:27:53.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:52 smithi172 bash[23680]: audit 2024-03-30T15:27:51.844932+0000 mgr.y (mgr.14526) 770 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:27:53.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:52 smithi172 bash[23680]: audit 2024-03-30T15:27:52.758329+0000 mon.c (mon.2) 543 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:27:54.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:53 smithi072 bash[21573]: cluster 2024-03-30T15:27:52.414023+0000 mgr.y (mgr.14526) 771 : cluster 0 pgmap v1293: 176 pgs: 176 active+clean; 723 KiB data, 833 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-03-30T15:27:54.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:53 smithi072 bash[28946]: cluster 2024-03-30T15:27:52.414023+0000 mgr.y (mgr.14526) 771 : cluster 0 pgmap v1293: 176 pgs: 176 active+clean; 723 KiB data, 833 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-03-30T15:27:54.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:53 smithi172 bash[23680]: cluster 2024-03-30T15:27:52.414023+0000 mgr.y (mgr.14526) 771 : cluster 0 pgmap v1293: 176 pgs: 176 active+clean; 723 KiB data, 833 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-03-30T15:27:54.757 INFO:tasks.workunit.client.0.smithi072.stderr:+ pid=132344 2024-03-30T15:27:54.757 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph osd pool set-quota 4e694c24-7f59-49ba-b14c-a8866b9195f4 max_bytes 0 2024-03-30T15:27:54.757 INFO:tasks.workunit.client.0.smithi072.stderr:+ rados -p 4e694c24-7f59-49ba-b14c-a8866b9195f4 put two /etc/passwd 2024-03-30T15:27:54.887 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:54.883+0000 7fc3d2cd8640 1 -- 172.21.15.72:0/1329473755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3cc104290 msgr2=0x7fc3cc1107a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:27:54.888 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:54.883+0000 7fc3d2cd8640 1 --2- 172.21.15.72:0/1329473755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3cc104290 0x7fc3cc1107a0 secure :-1 s=READY pgs=2400 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4009c20 tx=0x7fc3c401ca80 comp rx=0 tx=0).stop 2024-03-30T15:27:54.888 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:54.883+0000 7fc3d2cd8640 1 -- 172.21.15.72:0/1329473755 shutdown_connections 2024-03-30T15:27:54.888 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:54.883+0000 7fc3d2cd8640 1 --2- 172.21.15.72:0/1329473755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3cc104290 0x7fc3cc1107a0 unknown :-1 s=CLOSED pgs=2400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:54.888 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:54.883+0000 7fc3d2cd8640 1 --2- 172.21.15.72:0/1329473755 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3cc1038d0 0x7fc3cc103d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:54.888 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:54.883+0000 7fc3d2cd8640 1 --2- 172.21.15.72:0/1329473755 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3cc1098d0 0x7fc3cc109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:54.888 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:54.883+0000 7fc3d2cd8640 1 -- 172.21.15.72:0/1329473755 >> 172.21.15.72:0/1329473755 conn(0x7fc3cc0ff380 msgr2=0x7fc3cc1017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:27:54.888 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:54.887+0000 7fc3d2cd8640 1 -- 172.21.15.72:0/1329473755 shutdown_connections 2024-03-30T15:27:54.888 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:54.887+0000 7fc3d2cd8640 1 -- 172.21.15.72:0/1329473755 wait complete. 2024-03-30T15:27:54.888 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:54.887+0000 7fc3d2cd8640 1 Processor -- start 2024-03-30T15:27:54.888 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:54.887+0000 7fc3d2cd8640 1 -- start start 2024-03-30T15:27:54.888 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:54.887+0000 7fc3d2cd8640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3cc1038d0 0x7fc3cc19be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:27:54.888 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:54.887+0000 7fc3d2cd8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3cc104290 0x7fc3cc19c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:27:54.888 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:54.887+0000 7fc3d2cd8640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3cc1098d0 0x7fc3cc1a0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:27:54.889 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:54.887+0000 7fc3d2cd8640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc3cc1158c0 con 0x7fc3cc1098d0 2024-03-30T15:27:54.889 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:54.887+0000 7fc3d2cd8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc3cc115740 con 0x7fc3cc104290 2024-03-30T15:27:54.889 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:54.887+0000 7fc3d2cd8640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fc3cc115a40 con 0x7fc3cc1038d0 2024-03-30T15:27:54.889 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:54.887+0000 7fc3d0a74640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3cc1038d0 0x7fc3cc19be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:27:54.889 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:54.887+0000 7fc3d1275640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3cc1098d0 0x7fc3cc1a0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:27:54.889 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:54.887+0000 7fc3d0a74640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3cc1038d0 0x7fc3cc19be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:45396/0 (socket says 172.21.15.72:45396) 2024-03-30T15:27:54.889 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:54.887+0000 7fc3d0a74640 1 -- 172.21.15.72:0/1519083573 learned_addr learned my addr 172.21.15.72:0/1519083573 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T15:27:54.889 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:54.887+0000 7fc3d0a74640 1 -- 172.21.15.72:0/1519083573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3cc104290 msgr2=0x7fc3cc19c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:27:54.889 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:54.887+0000 7fc3d0a74640 1 --2- 172.21.15.72:0/1519083573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3cc104290 0x7fc3cc19c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:54.889 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:54.887+0000 7fc3d0a74640 1 -- 172.21.15.72:0/1519083573 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3cc1098d0 msgr2=0x7fc3cc1a0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:27:54.889 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:54.887+0000 7fc3d0a74640 1 --2- 172.21.15.72:0/1519083573 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3cc1098d0 0x7fc3cc1a0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:54.889 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:54.887+0000 7fc3d0a74640 1 -- 172.21.15.72:0/1519083573 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3cc1a0e30 con 0x7fc3cc1038d0 2024-03-30T15:27:54.889 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:54.887+0000 7fc3d1275640 1 --2- 172.21.15.72:0/1519083573 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3cc1098d0 0x7fc3cc1a0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T15:27:54.889 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:54.887+0000 7fc3d0a74640 1 --2- 172.21.15.72:0/1519083573 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3cc1038d0 0x7fc3cc19be80 secure :-1 s=READY pgs=3267 cs=0 l=1 rev1=1 crypto rx=0x7fc3c000c970 tx=0x7fc3c000ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:27:54.889 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:54.887+0000 7fc3c9ffb640 1 -- 172.21.15.72:0/1519083573 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0007bb0 con 0x7fc3cc1038d0 2024-03-30T15:27:54.890 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:54.887+0000 7fc3c9ffb640 1 -- 172.21.15.72:0/1519083573 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7fc3c0007d50 con 0x7fc3cc1038d0 2024-03-30T15:27:54.890 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:54.887+0000 7fc3d2cd8640 1 -- 172.21.15.72:0/1519083573 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3cc1a1120 con 0x7fc3cc1038d0 2024-03-30T15:27:54.890 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:54.887+0000 7fc3c9ffb640 1 -- 172.21.15.72:0/1519083573 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0004e40 con 0x7fc3cc1038d0 2024-03-30T15:27:54.890 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:54.887+0000 7fc3d2cd8640 1 -- 172.21.15.72:0/1519083573 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3cc1a8a00 con 0x7fc3cc1038d0 2024-03-30T15:27:54.891 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:54.887+0000 7fc3d2cd8640 1 -- 172.21.15.72:0/1519083573 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3cc068a90 con 0x7fc3cc1038d0 2024-03-30T15:27:54.891 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:54.887+0000 7fc3c9ffb640 1 -- 172.21.15.72:0/1519083573 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 21) ==== 91831+0+0 (secure 0 0 0) 0x7fc3c0005000 con 0x7fc3cc1038d0 2024-03-30T15:27:54.891 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:54.887+0000 7fc3c9ffb640 1 --2- 172.21.15.72:0/1519083573 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fc3bc06dbc0 0x7fc3bc070080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:27:54.891 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:54.887+0000 7fc3c9ffb640 1 -- 172.21.15.72:0/1519083573 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(782..782 src has 269..782) ==== 9096+0+0 (secure 0 0 0) 0x7fc3c008e350 con 0x7fc3cc1038d0 2024-03-30T15:27:54.891 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:54.887+0000 7fc3cbfff640 1 --2- 172.21.15.72:0/1519083573 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fc3bc06dbc0 0x7fc3bc070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:27:54.891 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:54.891+0000 7fc3c9ffb640 1 -- 172.21.15.72:0/1519083573 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=783}) -- 0x7fc3bc0796d0 con 0x7fc3cc1038d0 2024-03-30T15:27:54.891 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:54.891+0000 7fc3cbfff640 1 --2- 172.21.15.72:0/1519083573 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fc3bc06dbc0 0x7fc3bc070080 secure :-1 s=READY pgs=3229 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80096c0 tx=0x7fc3b8005d20 comp rx=0 tx=0).ready entity=mgr.14526 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:27:54.894 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:54.895+0000 7fc3c9ffb640 1 -- 172.21.15.72:0/1519083573 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fc3c0014030 con 0x7fc3cc1038d0 2024-03-30T15:27:55.064 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:55.063+0000 7fc3d2cd8640 1 -- 172.21.15.72:0/1519083573 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "0"} v 0) -- 0x7fc3cc1a8bd0 con 0x7fc3cc1038d0 2024-03-30T15:27:55.829 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:55.827+0000 7fc3c9ffb640 1 -- 172.21.15.72:0/1519083573 <== mon.2 v2:172.21.15.72:3301/0 7 ==== osd_map(783..783 src has 269..783) ==== 628+0+0 (secure 0 0 0) 0x7fc3c00c2280 con 0x7fc3cc1038d0 2024-03-30T15:27:55.830 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:55.827+0000 7fc3c9ffb640 1 -- 172.21.15.72:0/1519083573 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=784}) -- 0x7fc3bc07a1d0 con 0x7fc3cc1038d0 2024-03-30T15:27:55.835 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:55.835+0000 7fc3c9ffb640 1 -- 172.21.15.72:0/1519083573 <== mon.2 v2:172.21.15.72:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 4e694c24-7f59-49ba-b14c-a8866b9195f4 v783) ==== 217+0+0 (secure 0 0 0) 0x7fc3c005edc0 con 0x7fc3cc1038d0 2024-03-30T15:27:55.937 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:55.935+0000 7fc3d2cd8640 1 -- 172.21.15.72:0/1519083573 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "0"} v 0) -- 0x7fc3cc1a8e20 con 0x7fc3cc1038d0 2024-03-30T15:27:56.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:55 smithi072 bash[21573]: cluster 2024-03-30T15:27:54.414812+0000 mgr.y (mgr.14526) 772 : cluster 0 pgmap v1294: 176 pgs: 176 active+clean; 723 KiB data, 833 MiB used, 714 GiB / 715 GiB avail; 16 KiB/s rd, 0 B/s wr, 25 op/s 2024-03-30T15:27:56.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:55 smithi072 bash[21573]: audit 2024-03-30T15:27:55.067607+0000 mon.c (mon.2) 544 : audit 1 from='client.? 172.21.15.72:0/1519083573' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-30T15:27:56.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:55 smithi072 bash[21573]: audit 2024-03-30T15:27:55.068170+0000 mon.a (mon.0) 3725 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-30T15:27:56.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:55 smithi072 bash[28946]: cluster 2024-03-30T15:27:54.414812+0000 mgr.y (mgr.14526) 772 : cluster 0 pgmap v1294: 176 pgs: 176 active+clean; 723 KiB data, 833 MiB used, 714 GiB / 715 GiB avail; 16 KiB/s rd, 0 B/s wr, 25 op/s 2024-03-30T15:27:56.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:55 smithi072 bash[28946]: audit 2024-03-30T15:27:55.067607+0000 mon.c (mon.2) 544 : audit 1 from='client.? 172.21.15.72:0/1519083573' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-30T15:27:56.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:55 smithi072 bash[28946]: audit 2024-03-30T15:27:55.068170+0000 mon.a (mon.0) 3725 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-30T15:27:56.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:55 smithi172 bash[23680]: cluster 2024-03-30T15:27:54.414812+0000 mgr.y (mgr.14526) 772 : cluster 0 pgmap v1294: 176 pgs: 176 active+clean; 723 KiB data, 833 MiB used, 714 GiB / 715 GiB avail; 16 KiB/s rd, 0 B/s wr, 25 op/s 2024-03-30T15:27:56.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:55 smithi172 bash[23680]: audit 2024-03-30T15:27:55.067607+0000 mon.c (mon.2) 544 : audit 1 from='client.? 172.21.15.72:0/1519083573' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-30T15:27:56.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:55 smithi172 bash[23680]: audit 2024-03-30T15:27:55.068170+0000 mon.a (mon.0) 3725 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-30T15:27:56.852 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:56.851+0000 7fc3c9ffb640 1 -- 172.21.15.72:0/1519083573 <== mon.2 v2:172.21.15.72:3301/0 9 ==== osd_map(784..784 src has 269..784) ==== 628+0+0 (secure 0 0 0) 0x7fc3c00046d0 con 0x7fc3cc1038d0 2024-03-30T15:27:56.852 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:56.851+0000 7fc3c9ffb640 1 -- 172.21.15.72:0/1519083573 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=785}) -- 0x7fc3bc07a7d0 con 0x7fc3cc1038d0 2024-03-30T15:27:56.858 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:56.859+0000 7fc3c9ffb640 1 -- 172.21.15.72:0/1519083573 <== mon.2 v2:172.21.15.72:3301/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 4e694c24-7f59-49ba-b14c-a8866b9195f4 v784) ==== 217+0+0 (secure 0 0 0) 0x7fc3c00635f0 con 0x7fc3cc1038d0 2024-03-30T15:27:56.858 INFO:tasks.workunit.client.0.smithi072.stderr:set-quota max_bytes = 0 for pool 4e694c24-7f59-49ba-b14c-a8866b9195f4 2024-03-30T15:27:56.863 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:56.863+0000 7fc3d2cd8640 1 -- 172.21.15.72:0/1519083573 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fc3bc06dbc0 msgr2=0x7fc3bc070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:27:56.863 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:56.863+0000 7fc3d2cd8640 1 --2- 172.21.15.72:0/1519083573 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fc3bc06dbc0 0x7fc3bc070080 secure :-1 s=READY pgs=3229 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80096c0 tx=0x7fc3b8005d20 comp rx=0 tx=0).stop 2024-03-30T15:27:56.863 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:56.863+0000 7fc3d2cd8640 1 -- 172.21.15.72:0/1519083573 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3cc1038d0 msgr2=0x7fc3cc19be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:27:56.863 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:56.863+0000 7fc3d2cd8640 1 --2- 172.21.15.72:0/1519083573 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3cc1038d0 0x7fc3cc19be80 secure :-1 s=READY pgs=3267 cs=0 l=1 rev1=1 crypto rx=0x7fc3c000c970 tx=0x7fc3c000ce30 comp rx=0 tx=0).stop 2024-03-30T15:27:56.863 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:56.863+0000 7fc3d2cd8640 1 -- 172.21.15.72:0/1519083573 shutdown_connections 2024-03-30T15:27:56.863 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:56.863+0000 7fc3d2cd8640 1 --2- 172.21.15.72:0/1519083573 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fc3bc06dbc0 0x7fc3bc070080 unknown :-1 s=CLOSED pgs=3229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:56.863 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:56.863+0000 7fc3d2cd8640 1 --2- 172.21.15.72:0/1519083573 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3cc1098d0 0x7fc3cc1a0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:56.863 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:56.863+0000 7fc3d2cd8640 1 --2- 172.21.15.72:0/1519083573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3cc104290 0x7fc3cc19c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:56.864 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:56.863+0000 7fc3d2cd8640 1 --2- 172.21.15.72:0/1519083573 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3cc1038d0 0x7fc3cc19be80 unknown :-1 s=CLOSED pgs=3267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:56.864 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:56.863+0000 7fc3d2cd8640 1 -- 172.21.15.72:0/1519083573 >> 172.21.15.72:0/1519083573 conn(0x7fc3cc0ff380 msgr2=0x7fc3cc0ff760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:27:56.864 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:56.863+0000 7fc3d2cd8640 1 -- 172.21.15.72:0/1519083573 shutdown_connections 2024-03-30T15:27:56.864 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:56.863+0000 7fc3d2cd8640 1 -- 172.21.15.72:0/1519083573 wait complete. 2024-03-30T15:27:56.880 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph osd pool set-quota 4e694c24-7f59-49ba-b14c-a8866b9195f4 max_objects 0 2024-03-30T15:27:56.999 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:56.999+0000 7efd8f600640 1 -- 172.21.15.72:0/3905411224 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd8806a3c0 msgr2=0x7efd8806a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:27:56.999 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:56.999+0000 7efd8f600640 1 --2- 172.21.15.72:0/3905411224 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd8806a3c0 0x7efd8806a820 secure :-1 s=READY pgs=2401 cs=0 l=1 rev1=1 crypto rx=0x7efd78009930 tx=0x7efd7801c7e0 comp rx=0 tx=0).stop 2024-03-30T15:27:57.000 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:56.999+0000 7efd8f600640 1 -- 172.21.15.72:0/3905411224 shutdown_connections 2024-03-30T15:27:57.000 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:56.999+0000 7efd8f600640 1 --2- 172.21.15.72:0/3905411224 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efd8810df50 0x7efd88110360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:57.000 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:56.999+0000 7efd8f600640 1 --2- 172.21.15.72:0/3905411224 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd8806a3c0 0x7efd8806a820 unknown :-1 s=CLOSED pgs=2401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:57.000 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:56.999+0000 7efd8f600640 1 --2- 172.21.15.72:0/3905411224 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd881025e0 0x7efd88069e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:57.000 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:56.999+0000 7efd8f600640 1 -- 172.21.15.72:0/3905411224 >> 172.21.15.72:0/3905411224 conn(0x7efd880774e0 msgr2=0x7efd880778f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:27:57.000 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:56.999+0000 7efd8f600640 1 -- 172.21.15.72:0/3905411224 shutdown_connections 2024-03-30T15:27:57.000 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:56.999+0000 7efd8f600640 1 -- 172.21.15.72:0/3905411224 wait complete. 2024-03-30T15:27:57.002 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:56.999+0000 7efd8f600640 1 Processor -- start 2024-03-30T15:27:57.002 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:56.999+0000 7efd8f600640 1 -- start start 2024-03-30T15:27:57.002 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:56.999+0000 7efd8f600640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd8806a3c0 0x7efd8819beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:27:57.002 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:56.999+0000 7efd8f600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd881025e0 0x7efd8819c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:27:57.002 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:56.999+0000 7efd8f600640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efd8810df50 0x7efd881a0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:27:57.003 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:56.999+0000 7efd8f600640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7efd88115970 con 0x7efd8806a3c0 2024-03-30T15:27:57.003 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:56.999+0000 7efd8f600640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efd881157f0 con 0x7efd881025e0 2024-03-30T15:27:57.003 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:56.999+0000 7efd8f600640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7efd88115af0 con 0x7efd8810df50 2024-03-30T15:27:57.003 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:56.999+0000 7efd8d39c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd8806a3c0 0x7efd8819beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:27:57.003 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:56.999+0000 7efd8d39c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd8806a3c0 0x7efd8819beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34328/0 (socket says 172.21.15.72:34328) 2024-03-30T15:27:57.003 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:56.999+0000 7efd8d39c640 1 -- 172.21.15.72:0/364592282 learned_addr learned my addr 172.21.15.72:0/364592282 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T15:27:57.003 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:56.999+0000 7efd8db9d640 1 --2- 172.21.15.72:0/364592282 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efd8810df50 0x7efd881a0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:27:57.003 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:56.999+0000 7efd8d39c640 1 -- 172.21.15.72:0/364592282 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efd8810df50 msgr2=0x7efd881a0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:27:57.003 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:56.999+0000 7efd8d39c640 1 --2- 172.21.15.72:0/364592282 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efd8810df50 0x7efd881a0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:57.003 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:56.999+0000 7efd8d39c640 1 -- 172.21.15.72:0/364592282 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd881025e0 msgr2=0x7efd8819c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:27:57.003 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:56.999+0000 7efd8d39c640 1 --2- 172.21.15.72:0/364592282 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd881025e0 0x7efd8819c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:57.003 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:56.999+0000 7efd8d39c640 1 -- 172.21.15.72:0/364592282 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd881a0e60 con 0x7efd8806a3c0 2024-03-30T15:27:57.003 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:56.999+0000 7efd8d39c640 1 --2- 172.21.15.72:0/364592282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd8806a3c0 0x7efd8819beb0 secure :-1 s=READY pgs=2402 cs=0 l=1 rev1=1 crypto rx=0x7efd8400cc30 tx=0x7efd8400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:27:57.004 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:56.999+0000 7efd7e7fc640 1 -- 172.21.15.72:0/364592282 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd8400f650 con 0x7efd8806a3c0 2024-03-30T15:27:57.004 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:56.999+0000 7efd7e7fc640 1 -- 172.21.15.72:0/364592282 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7efd8400ae50 con 0x7efd8806a3c0 2024-03-30T15:27:57.004 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:56.999+0000 7efd8f600640 1 -- 172.21.15.72:0/364592282 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd881a1150 con 0x7efd8806a3c0 2024-03-30T15:27:57.004 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:56.999+0000 7efd7e7fc640 1 -- 172.21.15.72:0/364592282 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd84018aa0 con 0x7efd8806a3c0 2024-03-30T15:27:57.004 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:56.999+0000 7efd8f600640 1 -- 172.21.15.72:0/364592282 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd881a8a30 con 0x7efd8806a3c0 2024-03-30T15:27:57.004 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:57.003+0000 7efd8f600640 1 -- 172.21.15.72:0/364592282 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd88100c60 con 0x7efd8806a3c0 2024-03-30T15:27:57.005 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:57.003+0000 7efd7e7fc640 1 -- 172.21.15.72:0/364592282 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 21) ==== 91831+0+0 (secure 0 0 0) 0x7efd84018c40 con 0x7efd8806a3c0 2024-03-30T15:27:57.005 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:57.003+0000 7efd7e7fc640 1 --2- 172.21.15.72:0/364592282 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7efd7406dbc0 0x7efd74070080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:27:57.005 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:57.003+0000 7efd7e7fc640 1 -- 172.21.15.72:0/364592282 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(784..784 src has 269..784) ==== 9096+0+0 (secure 0 0 0) 0x7efd8408ef60 con 0x7efd8806a3c0 2024-03-30T15:27:57.005 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:57.003+0000 7efd8cb9b640 1 --2- 172.21.15.72:0/364592282 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7efd7406dbc0 0x7efd74070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:27:57.005 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:57.003+0000 7efd7e7fc640 1 -- 172.21.15.72:0/364592282 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=785}) -- 0x7efd74079750 con 0x7efd8806a3c0 2024-03-30T15:27:57.005 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:57.003+0000 7efd8cb9b640 1 --2- 172.21.15.72:0/364592282 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7efd7406dbc0 0x7efd74070080 secure :-1 s=READY pgs=3230 cs=0 l=1 rev1=1 crypto rx=0x7efd780b0040 tx=0x7efd78019580 comp rx=0 tx=0).ready entity=mgr.14526 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:27:57.007 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:57.007+0000 7efd7e7fc640 1 -- 172.21.15.72:0/364592282 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7efd84014030 con 0x7efd8806a3c0 2024-03-30T15:27:57.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:56 smithi072 bash[21573]: audit 2024-03-30T15:27:55.830031+0000 mon.a (mon.0) 3726 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "0"}]': finished 2024-03-30T15:27:57.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:56 smithi072 bash[21573]: cluster 2024-03-30T15:27:55.835983+0000 mon.a (mon.0) 3727 : cluster 0 osdmap e783: 8 total, 8 up, 8 in 2024-03-30T15:27:57.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:56 smithi072 bash[21573]: audit 2024-03-30T15:27:55.941262+0000 mon.c (mon.2) 545 : audit 1 from='client.? 172.21.15.72:0/1519083573' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-30T15:27:57.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:56 smithi072 bash[21573]: audit 2024-03-30T15:27:55.942030+0000 mon.a (mon.0) 3728 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-30T15:27:57.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:56 smithi072 bash[28946]: audit 2024-03-30T15:27:55.830031+0000 mon.a (mon.0) 3726 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "0"}]': finished 2024-03-30T15:27:57.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:56 smithi072 bash[28946]: cluster 2024-03-30T15:27:55.835983+0000 mon.a (mon.0) 3727 : cluster 0 osdmap e783: 8 total, 8 up, 8 in 2024-03-30T15:27:57.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:56 smithi072 bash[28946]: audit 2024-03-30T15:27:55.941262+0000 mon.c (mon.2) 545 : audit 1 from='client.? 172.21.15.72:0/1519083573' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-30T15:27:57.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:56 smithi072 bash[28946]: audit 2024-03-30T15:27:55.942030+0000 mon.a (mon.0) 3728 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-30T15:27:57.178 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:57.179+0000 7efd8f600640 1 -- 172.21.15.72:0/364592282 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "0"} v 0) -- 0x7efd88068a90 con 0x7efd8806a3c0 2024-03-30T15:27:57.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:56 smithi172 bash[23680]: audit 2024-03-30T15:27:55.830031+0000 mon.a (mon.0) 3726 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "0"}]': finished 2024-03-30T15:27:57.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:56 smithi172 bash[23680]: cluster 2024-03-30T15:27:55.835983+0000 mon.a (mon.0) 3727 : cluster 0 osdmap e783: 8 total, 8 up, 8 in 2024-03-30T15:27:57.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:56 smithi172 bash[23680]: audit 2024-03-30T15:27:55.941262+0000 mon.c (mon.2) 545 : audit 1 from='client.? 172.21.15.72:0/1519083573' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-30T15:27:57.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:56 smithi172 bash[23680]: audit 2024-03-30T15:27:55.942030+0000 mon.a (mon.0) 3728 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-30T15:27:57.395 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:57.395+0000 7efd7e7fc640 1 -- 172.21.15.72:0/364592282 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 4e694c24-7f59-49ba-b14c-a8866b9195f4 v785) ==== 221+0+0 (secure 0 0 0) 0x7efd88068a90 con 0x7efd8806a3c0 2024-03-30T15:27:57.396 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:57.395+0000 7efd7e7fc640 1 -- 172.21.15.72:0/364592282 <== mon.0 v2:172.21.15.72:3300/0 8 ==== osd_map(785..785 src has 269..785) ==== 628+0+0 (secure 0 0 0) 0x7efd8408c890 con 0x7efd8806a3c0 2024-03-30T15:27:57.396 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:57.395+0000 7efd7e7fc640 1 -- 172.21.15.72:0/364592282 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=786}) -- 0x7efd7407a6e0 con 0x7efd8806a3c0 2024-03-30T15:27:57.507 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:57.507+0000 7efd8f600640 1 -- 172.21.15.72:0/364592282 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "0"} v 0) -- 0x7efd88108610 con 0x7efd8806a3c0 2024-03-30T15:27:58.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:57 smithi072 bash[21573]: cluster 2024-03-30T15:27:56.416767+0000 mgr.y (mgr.14526) 773 : cluster 0 pgmap v1296: 176 pgs: 176 active+clean; 723 KiB data, 833 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T15:27:58.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:57 smithi072 bash[21573]: audit 2024-03-30T15:27:56.852806+0000 mon.a (mon.0) 3729 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "0"}]': finished 2024-03-30T15:27:58.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:57 smithi072 bash[21573]: cluster 2024-03-30T15:27:56.861402+0000 mon.a (mon.0) 3730 : cluster 0 osdmap e784: 8 total, 8 up, 8 in 2024-03-30T15:27:58.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:57 smithi072 bash[21573]: audit 2024-03-30T15:27:57.182122+0000 mon.a (mon.0) 3731 : audit 1 from='client.? 172.21.15.72:0/364592282' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "0"}]: dispatch 2024-03-30T15:27:58.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:57 smithi072 bash[21573]: cluster 2024-03-30T15:27:57.395276+0000 mon.a (mon.0) 3732 : cluster 1 pool '4e694c24-7f59-49ba-b14c-a8866b9195f4' no longer out of quota; removing NO_QUOTA flag 2024-03-30T15:27:58.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:57 smithi072 bash[21573]: cluster 2024-03-30T15:27:57.395772+0000 mon.a (mon.0) 3733 : cluster 1 Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-03-30T15:27:58.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:57 smithi072 bash[21573]: audit 2024-03-30T15:27:57.398230+0000 mon.a (mon.0) 3734 : audit 1 from='client.? 172.21.15.72:0/364592282' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "0"}]': finished 2024-03-30T15:27:58.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:57 smithi072 bash[21573]: cluster 2024-03-30T15:27:57.407412+0000 mon.a (mon.0) 3735 : cluster 0 osdmap e785: 8 total, 8 up, 8 in 2024-03-30T15:27:58.170 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:57 smithi072 bash[21573]: audit 2024-03-30T15:27:57.510970+0000 mon.a (mon.0) 3736 : audit 1 from='client.? 172.21.15.72:0/364592282' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "0"}]: dispatch 2024-03-30T15:27:58.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:57 smithi072 bash[28946]: cluster 2024-03-30T15:27:56.416767+0000 mgr.y (mgr.14526) 773 : cluster 0 pgmap v1296: 176 pgs: 176 active+clean; 723 KiB data, 833 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T15:27:58.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:57 smithi072 bash[28946]: audit 2024-03-30T15:27:56.852806+0000 mon.a (mon.0) 3729 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "0"}]': finished 2024-03-30T15:27:58.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:57 smithi072 bash[28946]: cluster 2024-03-30T15:27:56.861402+0000 mon.a (mon.0) 3730 : cluster 0 osdmap e784: 8 total, 8 up, 8 in 2024-03-30T15:27:58.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:57 smithi072 bash[28946]: audit 2024-03-30T15:27:57.182122+0000 mon.a (mon.0) 3731 : audit 1 from='client.? 172.21.15.72:0/364592282' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "0"}]: dispatch 2024-03-30T15:27:58.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:57 smithi072 bash[28946]: cluster 2024-03-30T15:27:57.395276+0000 mon.a (mon.0) 3732 : cluster 1 pool '4e694c24-7f59-49ba-b14c-a8866b9195f4' no longer out of quota; removing NO_QUOTA flag 2024-03-30T15:27:58.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:57 smithi072 bash[28946]: cluster 2024-03-30T15:27:57.395772+0000 mon.a (mon.0) 3733 : cluster 1 Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-03-30T15:27:58.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:57 smithi072 bash[28946]: audit 2024-03-30T15:27:57.398230+0000 mon.a (mon.0) 3734 : audit 1 from='client.? 172.21.15.72:0/364592282' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "0"}]': finished 2024-03-30T15:27:58.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:57 smithi072 bash[28946]: cluster 2024-03-30T15:27:57.407412+0000 mon.a (mon.0) 3735 : cluster 0 osdmap e785: 8 total, 8 up, 8 in 2024-03-30T15:27:58.171 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:57 smithi072 bash[28946]: audit 2024-03-30T15:27:57.510970+0000 mon.a (mon.0) 3736 : audit 1 from='client.? 172.21.15.72:0/364592282' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "0"}]: dispatch 2024-03-30T15:27:58.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:57 smithi172 bash[23680]: cluster 2024-03-30T15:27:56.416767+0000 mgr.y (mgr.14526) 773 : cluster 0 pgmap v1296: 176 pgs: 176 active+clean; 723 KiB data, 833 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T15:27:58.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:57 smithi172 bash[23680]: audit 2024-03-30T15:27:56.852806+0000 mon.a (mon.0) 3729 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "0"}]': finished 2024-03-30T15:27:58.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:57 smithi172 bash[23680]: cluster 2024-03-30T15:27:56.861402+0000 mon.a (mon.0) 3730 : cluster 0 osdmap e784: 8 total, 8 up, 8 in 2024-03-30T15:27:58.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:57 smithi172 bash[23680]: audit 2024-03-30T15:27:57.182122+0000 mon.a (mon.0) 3731 : audit 1 from='client.? 172.21.15.72:0/364592282' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "0"}]: dispatch 2024-03-30T15:27:58.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:57 smithi172 bash[23680]: cluster 2024-03-30T15:27:57.395276+0000 mon.a (mon.0) 3732 : cluster 1 pool '4e694c24-7f59-49ba-b14c-a8866b9195f4' no longer out of quota; removing NO_QUOTA flag 2024-03-30T15:27:58.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:57 smithi172 bash[23680]: cluster 2024-03-30T15:27:57.395772+0000 mon.a (mon.0) 3733 : cluster 1 Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-03-30T15:27:58.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:57 smithi172 bash[23680]: audit 2024-03-30T15:27:57.398230+0000 mon.a (mon.0) 3734 : audit 1 from='client.? 172.21.15.72:0/364592282' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "0"}]': finished 2024-03-30T15:27:58.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:57 smithi172 bash[23680]: cluster 2024-03-30T15:27:57.407412+0000 mon.a (mon.0) 3735 : cluster 0 osdmap e785: 8 total, 8 up, 8 in 2024-03-30T15:27:58.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:57 smithi172 bash[23680]: audit 2024-03-30T15:27:57.510970+0000 mon.a (mon.0) 3736 : audit 1 from='client.? 172.21.15.72:0/364592282' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "0"}]: dispatch 2024-03-30T15:27:58.398 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.399+0000 7efd7e7fc640 1 -- 172.21.15.72:0/364592282 <== mon.0 v2:172.21.15.72:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 4e694c24-7f59-49ba-b14c-a8866b9195f4 v786) ==== 221+0+0 (secure 0 0 0) 0x7efd84074020 con 0x7efd8806a3c0 2024-03-30T15:27:58.398 INFO:tasks.workunit.client.0.smithi072.stderr:set-quota max_objects = 0 for pool 4e694c24-7f59-49ba-b14c-a8866b9195f4 2024-03-30T15:27:58.401 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.399+0000 7efd8f600640 1 -- 172.21.15.72:0/364592282 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7efd7406dbc0 msgr2=0x7efd74070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:27:58.401 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.399+0000 7efd8f600640 1 --2- 172.21.15.72:0/364592282 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7efd7406dbc0 0x7efd74070080 secure :-1 s=READY pgs=3230 cs=0 l=1 rev1=1 crypto rx=0x7efd780b0040 tx=0x7efd78019580 comp rx=0 tx=0).stop 2024-03-30T15:27:58.401 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.399+0000 7efd8f600640 1 -- 172.21.15.72:0/364592282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd8806a3c0 msgr2=0x7efd8819beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:27:58.401 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.399+0000 7efd8f600640 1 --2- 172.21.15.72:0/364592282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd8806a3c0 0x7efd8819beb0 secure :-1 s=READY pgs=2402 cs=0 l=1 rev1=1 crypto rx=0x7efd8400cc30 tx=0x7efd8400a620 comp rx=0 tx=0).stop 2024-03-30T15:27:58.401 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.399+0000 7efd8f600640 1 -- 172.21.15.72:0/364592282 shutdown_connections 2024-03-30T15:27:58.402 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.399+0000 7efd8f600640 1 --2- 172.21.15.72:0/364592282 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efd8810df50 0x7efd881a0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:58.402 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.399+0000 7efd8f600640 1 --2- 172.21.15.72:0/364592282 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd881025e0 0x7efd8819c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:58.402 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.399+0000 7efd8f600640 1 --2- 172.21.15.72:0/364592282 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7efd7406dbc0 0x7efd74070080 unknown :-1 s=CLOSED pgs=3230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:58.402 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.399+0000 7efd8f600640 1 --2- 172.21.15.72:0/364592282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd8806a3c0 0x7efd8819beb0 unknown :-1 s=CLOSED pgs=2402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:58.402 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.399+0000 7efd8f600640 1 -- 172.21.15.72:0/364592282 >> 172.21.15.72:0/364592282 conn(0x7efd880774e0 msgr2=0x7efd8810fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:27:58.402 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.399+0000 7efd8f600640 1 -- 172.21.15.72:0/364592282 shutdown_connections 2024-03-30T15:27:58.402 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.399+0000 7efd8f600640 1 -- 172.21.15.72:0/364592282 wait complete. 2024-03-30T15:27:58.424 INFO:tasks.workunit.client.0.smithi072.stderr:+ wait 132344 2024-03-30T15:27:58.425 INFO:tasks.workunit.client.0.smithi072.stderr:+ [ 0 -ne 0 ] 2024-03-30T15:27:58.425 INFO:tasks.workunit.client.0.smithi072.stderr:+ true 2024-03-30T15:27:58.425 INFO:tasks.workunit.client.0.smithi072.stderr:+ rados -p 4e694c24-7f59-49ba-b14c-a8866b9195f4 put three /etc/passwd 2024-03-30T15:27:58.466 INFO:tasks.workunit.client.0.smithi072.stderr:+ uuidgen 2024-03-30T15:27:58.466 INFO:tasks.workunit.client.0.smithi072.stderr:+ pp=f4a77c40-1619-47cc-9a4a-97c81ff0ea60 2024-03-30T15:27:58.466 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph osd pool create f4a77c40-1619-47cc-9a4a-97c81ff0ea60 12 2024-03-30T15:27:58.584 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.583+0000 7f54e8956640 1 -- 172.21.15.72:0/4152002625 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54e41038d0 msgr2=0x7f54e4103d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:27:58.584 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.583+0000 7f54e8956640 1 --2- 172.21.15.72:0/4152002625 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54e41038d0 0x7f54e4103d50 secure :-1 s=READY pgs=3270 cs=0 l=1 rev1=1 crypto rx=0x7f54d8009960 tx=0x7f54d801c7c0 comp rx=0 tx=0).stop 2024-03-30T15:27:58.585 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.583+0000 7f54e8956640 1 -- 172.21.15.72:0/4152002625 shutdown_connections 2024-03-30T15:27:58.585 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.583+0000 7f54e8956640 1 --2- 172.21.15.72:0/4152002625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54e4104290 0x7f54e41107a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:58.585 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.583+0000 7f54e8956640 1 --2- 172.21.15.72:0/4152002625 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54e41038d0 0x7f54e4103d50 unknown :-1 s=CLOSED pgs=3270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:58.585 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.583+0000 7f54e8956640 1 --2- 172.21.15.72:0/4152002625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54e41098d0 0x7f54e4109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:58.585 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.583+0000 7f54e8956640 1 -- 172.21.15.72:0/4152002625 >> 172.21.15.72:0/4152002625 conn(0x7f54e40ff380 msgr2=0x7f54e41017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:27:58.585 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.583+0000 7f54e8956640 1 -- 172.21.15.72:0/4152002625 shutdown_connections 2024-03-30T15:27:58.585 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.583+0000 7f54e8956640 1 -- 172.21.15.72:0/4152002625 wait complete. 2024-03-30T15:27:58.585 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.583+0000 7f54e8956640 1 Processor -- start 2024-03-30T15:27:58.585 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.583+0000 7f54e8956640 1 -- start start 2024-03-30T15:27:58.585 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.583+0000 7f54e8956640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54e41038d0 0x7f54e419bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:27:58.585 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.583+0000 7f54e8956640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54e4104290 0x7f54e419c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:27:58.585 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.583+0000 7f54e8956640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54e41098d0 0x7f54e41a07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:27:58.585 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.583+0000 7f54e8956640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f54e41158c0 con 0x7f54e4104290 2024-03-30T15:27:58.585 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.583+0000 7f54e8956640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f54e4115740 con 0x7f54e41038d0 2024-03-30T15:27:58.586 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.583+0000 7f54e8956640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f54e4115a40 con 0x7f54e41098d0 2024-03-30T15:27:58.586 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.583+0000 7f54e1d9b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54e4104290 0x7f54e419c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:27:58.586 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.583+0000 7f54e2d9d640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54e41098d0 0x7f54e41a07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:27:58.586 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.583+0000 7f54e2d9d640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54e41098d0 0x7f54e41a07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43446/0 (socket says 172.21.15.72:43446) 2024-03-30T15:27:58.586 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.583+0000 7f54e1d9b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54e4104290 0x7f54e419c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34378/0 (socket says 172.21.15.72:34378) 2024-03-30T15:27:58.586 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.583+0000 7f54e2d9d640 1 -- 172.21.15.72:0/4093297500 learned_addr learned my addr 172.21.15.72:0/4093297500 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T15:27:58.586 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.583+0000 7f54e259c640 1 --2- 172.21.15.72:0/4093297500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54e41038d0 0x7f54e419bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:27:58.586 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.583+0000 7f54e2d9d640 1 -- 172.21.15.72:0/4093297500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54e41038d0 msgr2=0x7f54e419bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:27:58.586 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.583+0000 7f54e2d9d640 1 --2- 172.21.15.72:0/4093297500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54e41038d0 0x7f54e419bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:58.586 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.583+0000 7f54e2d9d640 1 -- 172.21.15.72:0/4093297500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54e4104290 msgr2=0x7f54e419c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:27:58.586 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.583+0000 7f54e2d9d640 1 --2- 172.21.15.72:0/4093297500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54e4104290 0x7f54e419c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:58.586 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.583+0000 7f54e2d9d640 1 -- 172.21.15.72:0/4093297500 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54e41a0eb0 con 0x7f54e41098d0 2024-03-30T15:27:58.586 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.583+0000 7f54e1d9b640 1 --2- 172.21.15.72:0/4093297500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54e4104290 0x7f54e419c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T15:27:58.587 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.583+0000 7f54e2d9d640 1 --2- 172.21.15.72:0/4093297500 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54e41098d0 0x7f54e41a07d0 secure :-1 s=READY pgs=3271 cs=0 l=1 rev1=1 crypto rx=0x7f54dc00eb20 tx=0x7f54dc00c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:27:58.587 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.583+0000 7f54d37fe640 1 -- 172.21.15.72:0/4093297500 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54dc004b30 con 0x7f54e41098d0 2024-03-30T15:27:58.587 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.583+0000 7f54d37fe640 1 -- 172.21.15.72:0/4093297500 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f54dc004cd0 con 0x7f54e41098d0 2024-03-30T15:27:58.587 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.583+0000 7f54e8956640 1 -- 172.21.15.72:0/4093297500 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54e41a11a0 con 0x7f54e41098d0 2024-03-30T15:27:58.587 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.583+0000 7f54d37fe640 1 -- 172.21.15.72:0/4093297500 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54dc010690 con 0x7f54e41098d0 2024-03-30T15:27:58.587 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.583+0000 7f54e8956640 1 -- 172.21.15.72:0/4093297500 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f54e41a8a80 con 0x7f54e41098d0 2024-03-30T15:27:58.588 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.583+0000 7f54e8956640 1 -- 172.21.15.72:0/4093297500 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54e4068a90 con 0x7f54e41098d0 2024-03-30T15:27:58.588 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.587+0000 7f54d37fe640 1 -- 172.21.15.72:0/4093297500 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 21) ==== 91831+0+0 (secure 0 0 0) 0x7f54dc005020 con 0x7f54e41098d0 2024-03-30T15:27:58.588 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.587+0000 7f54d37fe640 1 --2- 172.21.15.72:0/4093297500 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f54cc06dbc0 0x7f54cc070080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:27:58.588 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.587+0000 7f54d37fe640 1 -- 172.21.15.72:0/4093297500 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(786..786 src has 269..786) ==== 9096+0+0 (secure 0 0 0) 0x7f54dc08ed40 con 0x7f54e41098d0 2024-03-30T15:27:58.588 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.587+0000 7f54e259c640 1 --2- 172.21.15.72:0/4093297500 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f54cc06dbc0 0x7f54cc070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:27:58.588 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.587+0000 7f54e259c640 1 --2- 172.21.15.72:0/4093297500 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f54cc06dbc0 0x7f54cc070080 secure :-1 s=READY pgs=3232 cs=0 l=1 rev1=1 crypto rx=0x7f54d40058d0 tx=0x7f54d4005bf0 comp rx=0 tx=0).ready entity=mgr.14526 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:27:58.591 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.591+0000 7f54d37fe640 1 -- 172.21.15.72:0/4093297500 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f54dc05bc60 con 0x7f54e41098d0 2024-03-30T15:27:58.763 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:58.763+0000 7f54e8956640 1 -- 172.21.15.72:0/4093297500 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "pg_num": 12} v 0) -- 0x7f54e41a8c50 con 0x7f54e41098d0 2024-03-30T15:27:59.432 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.431+0000 7f54d37fe640 1 -- 172.21.15.72:0/4093297500 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "pg_num": 12}]=0 pool 'f4a77c40-1619-47cc-9a4a-97c81ff0ea60' created v787) ==== 176+0+0 (secure 0 0 0) 0x7f54dc05f6b0 con 0x7f54e41098d0 2024-03-30T15:27:59.540 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.539+0000 7f54e8956640 1 -- 172.21.15.72:0/4093297500 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "pg_num": 12} v 0) -- 0x7f54e41a8e20 con 0x7f54e41098d0 2024-03-30T15:27:59.542 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.543+0000 7f54d37fe640 1 -- 172.21.15.72:0/4093297500 <== mon.2 v2:172.21.15.72:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "pg_num": 12}]=0 pool 'f4a77c40-1619-47cc-9a4a-97c81ff0ea60' already exists v787) ==== 183+0+0 (secure 0 0 0) 0x7f54dc063ee0 con 0x7f54e41098d0 2024-03-30T15:27:59.542 INFO:tasks.workunit.client.0.smithi072.stderr:pool 'f4a77c40-1619-47cc-9a4a-97c81ff0ea60' already exists 2024-03-30T15:27:59.545 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.543+0000 7f54e8956640 1 -- 172.21.15.72:0/4093297500 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f54cc06dbc0 msgr2=0x7f54cc070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:27:59.545 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.543+0000 7f54e8956640 1 --2- 172.21.15.72:0/4093297500 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f54cc06dbc0 0x7f54cc070080 secure :-1 s=READY pgs=3232 cs=0 l=1 rev1=1 crypto rx=0x7f54d40058d0 tx=0x7f54d4005bf0 comp rx=0 tx=0).stop 2024-03-30T15:27:59.545 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.543+0000 7f54e8956640 1 -- 172.21.15.72:0/4093297500 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54e41098d0 msgr2=0x7f54e41a07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:27:59.545 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.543+0000 7f54e8956640 1 --2- 172.21.15.72:0/4093297500 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54e41098d0 0x7f54e41a07d0 secure :-1 s=READY pgs=3271 cs=0 l=1 rev1=1 crypto rx=0x7f54dc00eb20 tx=0x7f54dc00c2d0 comp rx=0 tx=0).stop 2024-03-30T15:27:59.545 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.543+0000 7f54e8956640 1 -- 172.21.15.72:0/4093297500 shutdown_connections 2024-03-30T15:27:59.545 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.543+0000 7f54e8956640 1 --2- 172.21.15.72:0/4093297500 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54e41098d0 0x7f54e41a07d0 unknown :-1 s=CLOSED pgs=3271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:59.545 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.543+0000 7f54e8956640 1 --2- 172.21.15.72:0/4093297500 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f54cc06dbc0 0x7f54cc070080 unknown :-1 s=CLOSED pgs=3232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:59.545 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.543+0000 7f54e8956640 1 --2- 172.21.15.72:0/4093297500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54e4104290 0x7f54e419c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:59.545 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.543+0000 7f54e8956640 1 --2- 172.21.15.72:0/4093297500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54e41038d0 0x7f54e419bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:59.545 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.543+0000 7f54e8956640 1 -- 172.21.15.72:0/4093297500 >> 172.21.15.72:0/4093297500 conn(0x7f54e40ff380 msgr2=0x7f54e40ff760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:27:59.546 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.543+0000 7f54e8956640 1 -- 172.21.15.72:0/4093297500 shutdown_connections 2024-03-30T15:27:59.546 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.543+0000 7f54e8956640 1 -- 172.21.15.72:0/4093297500 wait complete. 2024-03-30T15:27:59.559 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph osd pool application enable f4a77c40-1619-47cc-9a4a-97c81ff0ea60 rados 2024-03-30T15:27:59.680 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.679+0000 7f5b8199c640 1 -- 172.21.15.72:0/4091469492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b7c1076e0 msgr2=0x7f5b7c107ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:27:59.680 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.679+0000 7f5b8199c640 1 --2- 172.21.15.72:0/4091469492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b7c1076e0 0x7f5b7c107ac0 secure :-1 s=READY pgs=2404 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c009960 tx=0x7f5b6c01c7c0 comp rx=0 tx=0).stop 2024-03-30T15:27:59.680 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.679+0000 7f5b8199c640 1 -- 172.21.15.72:0/4091469492 shutdown_connections 2024-03-30T15:27:59.680 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.679+0000 7f5b8199c640 1 --2- 172.21.15.72:0/4091469492 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b7c1020a0 0x7f5b7c10e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:59.680 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.679+0000 7f5b8199c640 1 --2- 172.21.15.72:0/4091469492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b7c1016e0 0x7f5b7c101b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:59.680 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.679+0000 7f5b8199c640 1 --2- 172.21.15.72:0/4091469492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b7c1076e0 0x7f5b7c107ac0 unknown :-1 s=CLOSED pgs=2404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:59.680 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.679+0000 7f5b8199c640 1 -- 172.21.15.72:0/4091469492 >> 172.21.15.72:0/4091469492 conn(0x7f5b7c0fd230 msgr2=0x7f5b7c0ff650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:27:59.681 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.679+0000 7f5b8199c640 1 -- 172.21.15.72:0/4091469492 shutdown_connections 2024-03-30T15:27:59.681 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.679+0000 7f5b8199c640 1 -- 172.21.15.72:0/4091469492 wait complete. 2024-03-30T15:27:59.681 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.679+0000 7f5b8199c640 1 Processor -- start 2024-03-30T15:27:59.681 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.679+0000 7f5b8199c640 1 -- start start 2024-03-30T15:27:59.681 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.679+0000 7f5b8199c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b7c1016e0 0x7f5b7c199e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:27:59.681 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.679+0000 7f5b8199c640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b7c1020a0 0x7f5b7c19a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:27:59.681 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.679+0000 7f5b8199c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b7c1076e0 0x7f5b7c19e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:27:59.681 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.679+0000 7f5b8199c640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5b7c113780 con 0x7f5b7c1076e0 2024-03-30T15:27:59.681 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.679+0000 7f5b8199c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5b7c113600 con 0x7f5b7c1016e0 2024-03-30T15:27:59.681 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.679+0000 7f5b8199c640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f5b7c113900 con 0x7f5b7c1020a0 2024-03-30T15:27:59.681 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.679+0000 7f5b7a7fc640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b7c1020a0 0x7f5b7c19a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:27:59.681 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.679+0000 7f5b7b7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b7c1076e0 0x7f5b7c19e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:27:59.681 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.679+0000 7f5b7a7fc640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b7c1020a0 0x7f5b7c19a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43460/0 (socket says 172.21.15.72:43460) 2024-03-30T15:27:59.681 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.679+0000 7f5b7a7fc640 1 -- 172.21.15.72:0/1522493635 learned_addr learned my addr 172.21.15.72:0/1522493635 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T15:27:59.682 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.679+0000 7f5b7affd640 1 --2- 172.21.15.72:0/1522493635 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b7c1016e0 0x7f5b7c199e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:27:59.682 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.679+0000 7f5b7a7fc640 1 -- 172.21.15.72:0/1522493635 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b7c1016e0 msgr2=0x7f5b7c199e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:27:59.682 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.679+0000 7f5b7a7fc640 1 --2- 172.21.15.72:0/1522493635 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b7c1016e0 0x7f5b7c199e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:59.682 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.679+0000 7f5b7a7fc640 1 -- 172.21.15.72:0/1522493635 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b7c1076e0 msgr2=0x7f5b7c19e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:27:59.682 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.679+0000 7f5b7a7fc640 1 --2- 172.21.15.72:0/1522493635 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b7c1076e0 0x7f5b7c19e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:27:59.682 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.679+0000 7f5b7a7fc640 1 -- 172.21.15.72:0/1522493635 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b7c19ed90 con 0x7f5b7c1020a0 2024-03-30T15:27:59.682 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.679+0000 7f5b7b7fe640 1 --2- 172.21.15.72:0/1522493635 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b7c1076e0 0x7f5b7c19e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T15:27:59.682 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.679+0000 7f5b7a7fc640 1 --2- 172.21.15.72:0/1522493635 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b7c1020a0 0x7f5b7c19a370 secure :-1 s=READY pgs=3272 cs=0 l=1 rev1=1 crypto rx=0x7f5b7000b550 tx=0x7f5b7000ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:27:59.682 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.679+0000 7f5b8099a640 1 -- 172.21.15.72:0/1522493635 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b70014070 con 0x7f5b7c1020a0 2024-03-30T15:27:59.682 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.679+0000 7f5b8199c640 1 -- 172.21.15.72:0/1522493635 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b7c19f080 con 0x7f5b7c1020a0 2024-03-30T15:27:59.682 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.679+0000 7f5b8099a640 1 -- 172.21.15.72:0/1522493635 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f5b70010cf0 con 0x7f5b7c1020a0 2024-03-30T15:27:59.682 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.679+0000 7f5b8099a640 1 -- 172.21.15.72:0/1522493635 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b7000fd00 con 0x7f5b7c1020a0 2024-03-30T15:27:59.683 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.679+0000 7f5b8199c640 1 -- 172.21.15.72:0/1522493635 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b7c1a6960 con 0x7f5b7c1020a0 2024-03-30T15:27:59.683 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.679+0000 7f5b8199c640 1 -- 172.21.15.72:0/1522493635 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b68005090 con 0x7f5b7c1020a0 2024-03-30T15:27:59.683 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.679+0000 7f5b8099a640 1 -- 172.21.15.72:0/1522493635 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 21) ==== 91831+0+0 (secure 0 0 0) 0x7f5b70017070 con 0x7f5b7c1020a0 2024-03-30T15:27:59.684 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.683+0000 7f5b8099a640 1 --2- 172.21.15.72:0/1522493635 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f5b6406dbc0 0x7f5b64070080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:27:59.684 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.683+0000 7f5b7affd640 1 --2- 172.21.15.72:0/1522493635 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f5b6406dbc0 0x7f5b64070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:27:59.684 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.683+0000 7f5b8099a640 1 -- 172.21.15.72:0/1522493635 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(787..787 src has 269..787) ==== 9471+0+0 (secure 0 0 0) 0x7f5b7008e190 con 0x7f5b7c1020a0 2024-03-30T15:27:59.684 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.683+0000 7f5b7affd640 1 --2- 172.21.15.72:0/1522493635 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f5b6406dbc0 0x7f5b64070080 secure :-1 s=READY pgs=3233 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c01cca0 tx=0x7f5b6c01b000 comp rx=0 tx=0).ready entity=mgr.14526 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:27:59.686 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.687+0000 7f5b8099a640 1 -- 172.21.15.72:0/1522493635 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f5b7005ea70 con 0x7f5b7c1020a0 2024-03-30T15:27:59.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:59 smithi172 bash[23680]: audit 2024-03-30T15:27:58.400860+0000 mon.a (mon.0) 3737 : audit 1 from='client.? 172.21.15.72:0/364592282' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "0"}]': finished 2024-03-30T15:27:59.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:59 smithi172 bash[23680]: cluster 2024-03-30T15:27:58.410636+0000 mon.a (mon.0) 3738 : cluster 0 osdmap e786: 8 total, 8 up, 8 in 2024-03-30T15:27:59.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:59 smithi172 bash[23680]: cluster 2024-03-30T15:27:58.417414+0000 mgr.y (mgr.14526) 774 : cluster 0 pgmap v1299: 176 pgs: 176 active+clean; 723 KiB data, 833 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:27:59.719 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:59 smithi172 bash[23680]: audit 2024-03-30T15:27:58.767477+0000 mon.c (mon.2) 546 : audit 1 from='client.? 172.21.15.72:0/4093297500' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "pg_num": 12}]: dispatch 2024-03-30T15:27:59.719 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:27:59 smithi172 bash[23680]: audit 2024-03-30T15:27:58.768019+0000 mon.a (mon.0) 3739 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "pg_num": 12}]: dispatch 2024-03-30T15:27:59.844 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:27:59.843+0000 7f5b8199c640 1 -- 172.21.15.72:0/1522493635 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd pool application enable", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "app": "rados"} v 0) -- 0x7f5b68005380 con 0x7f5b7c1020a0 2024-03-30T15:27:59.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:59 smithi072 bash[21573]: audit 2024-03-30T15:27:58.400860+0000 mon.a (mon.0) 3737 : audit 1 from='client.? 172.21.15.72:0/364592282' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "0"}]': finished 2024-03-30T15:27:59.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:59 smithi072 bash[21573]: cluster 2024-03-30T15:27:58.410636+0000 mon.a (mon.0) 3738 : cluster 0 osdmap e786: 8 total, 8 up, 8 in 2024-03-30T15:27:59.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:59 smithi072 bash[21573]: cluster 2024-03-30T15:27:58.417414+0000 mgr.y (mgr.14526) 774 : cluster 0 pgmap v1299: 176 pgs: 176 active+clean; 723 KiB data, 833 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:27:59.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:59 smithi072 bash[21573]: audit 2024-03-30T15:27:58.767477+0000 mon.c (mon.2) 546 : audit 1 from='client.? 172.21.15.72:0/4093297500' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "pg_num": 12}]: dispatch 2024-03-30T15:27:59.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:27:59 smithi072 bash[21573]: audit 2024-03-30T15:27:58.768019+0000 mon.a (mon.0) 3739 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "pg_num": 12}]: dispatch 2024-03-30T15:27:59.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:59 smithi072 bash[28946]: audit 2024-03-30T15:27:58.400860+0000 mon.a (mon.0) 3737 : audit 1 from='client.? 172.21.15.72:0/364592282' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "0"}]': finished 2024-03-30T15:27:59.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:59 smithi072 bash[28946]: cluster 2024-03-30T15:27:58.410636+0000 mon.a (mon.0) 3738 : cluster 0 osdmap e786: 8 total, 8 up, 8 in 2024-03-30T15:27:59.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:59 smithi072 bash[28946]: cluster 2024-03-30T15:27:58.417414+0000 mgr.y (mgr.14526) 774 : cluster 0 pgmap v1299: 176 pgs: 176 active+clean; 723 KiB data, 833 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:27:59.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:59 smithi072 bash[28946]: audit 2024-03-30T15:27:58.767477+0000 mon.c (mon.2) 546 : audit 1 from='client.? 172.21.15.72:0/4093297500' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "pg_num": 12}]: dispatch 2024-03-30T15:27:59.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:27:59 smithi072 bash[28946]: audit 2024-03-30T15:27:58.768019+0000 mon.a (mon.0) 3739 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "pg_num": 12}]: dispatch 2024-03-30T15:28:00.442 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:00.443+0000 7f5b8099a640 1 -- 172.21.15.72:0/1522493635 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "app": "rados"}]=0 enabled application 'rados' on pool 'f4a77c40-1619-47cc-9a4a-97c81ff0ea60' v788) ==== 213+0+0 (secure 0 0 0) 0x7f5b700632a0 con 0x7f5b7c1020a0 2024-03-30T15:28:00.556 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:00.555+0000 7f5b8199c640 1 -- 172.21.15.72:0/1522493635 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd pool application enable", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "app": "rados"} v 0) -- 0x7f5b68005ac0 con 0x7f5b7c1020a0 2024-03-30T15:28:00.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:00 smithi072 bash[21573]: audit 2024-03-30T15:27:59.417856+0000 mon.a (mon.0) 3740 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "pg_num": 12}]': finished 2024-03-30T15:28:00.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:00 smithi072 bash[21573]: cluster 2024-03-30T15:27:59.433179+0000 mon.a (mon.0) 3741 : cluster 0 osdmap e787: 8 total, 8 up, 8 in 2024-03-30T15:28:00.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:00 smithi072 bash[21573]: audit 2024-03-30T15:27:59.544618+0000 mon.c (mon.2) 547 : audit 1 from='client.? 172.21.15.72:0/4093297500' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "pg_num": 12}]: dispatch 2024-03-30T15:28:00.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:00 smithi072 bash[21573]: audit 2024-03-30T15:27:59.545289+0000 mon.a (mon.0) 3742 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "pg_num": 12}]: dispatch 2024-03-30T15:28:00.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:00 smithi072 bash[21573]: audit 2024-03-30T15:27:59.848037+0000 mon.c (mon.2) 548 : audit 1 from='client.? 172.21.15.72:0/1522493635' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "app": "rados"}]: dispatch 2024-03-30T15:28:00.670 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:00 smithi072 bash[21573]: audit 2024-03-30T15:27:59.848578+0000 mon.a (mon.0) 3743 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "app": "rados"}]: dispatch 2024-03-30T15:28:00.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:00 smithi072 bash[28946]: audit 2024-03-30T15:27:59.417856+0000 mon.a (mon.0) 3740 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "pg_num": 12}]': finished 2024-03-30T15:28:00.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:00 smithi072 bash[28946]: cluster 2024-03-30T15:27:59.433179+0000 mon.a (mon.0) 3741 : cluster 0 osdmap e787: 8 total, 8 up, 8 in 2024-03-30T15:28:00.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:00 smithi072 bash[28946]: audit 2024-03-30T15:27:59.544618+0000 mon.c (mon.2) 547 : audit 1 from='client.? 172.21.15.72:0/4093297500' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "pg_num": 12}]: dispatch 2024-03-30T15:28:00.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:00 smithi072 bash[28946]: audit 2024-03-30T15:27:59.545289+0000 mon.a (mon.0) 3742 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "pg_num": 12}]: dispatch 2024-03-30T15:28:00.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:00 smithi072 bash[28946]: audit 2024-03-30T15:27:59.848037+0000 mon.c (mon.2) 548 : audit 1 from='client.? 172.21.15.72:0/1522493635' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "app": "rados"}]: dispatch 2024-03-30T15:28:00.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:00 smithi072 bash[28946]: audit 2024-03-30T15:27:59.848578+0000 mon.a (mon.0) 3743 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "app": "rados"}]: dispatch 2024-03-30T15:28:00.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:00 smithi172 bash[23680]: audit 2024-03-30T15:27:59.417856+0000 mon.a (mon.0) 3740 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "pg_num": 12}]': finished 2024-03-30T15:28:00.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:00 smithi172 bash[23680]: cluster 2024-03-30T15:27:59.433179+0000 mon.a (mon.0) 3741 : cluster 0 osdmap e787: 8 total, 8 up, 8 in 2024-03-30T15:28:00.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:00 smithi172 bash[23680]: audit 2024-03-30T15:27:59.544618+0000 mon.c (mon.2) 547 : audit 1 from='client.? 172.21.15.72:0/4093297500' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "pg_num": 12}]: dispatch 2024-03-30T15:28:00.719 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:00 smithi172 bash[23680]: audit 2024-03-30T15:27:59.545289+0000 mon.a (mon.0) 3742 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "pg_num": 12}]: dispatch 2024-03-30T15:28:00.719 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:00 smithi172 bash[23680]: audit 2024-03-30T15:27:59.848037+0000 mon.c (mon.2) 548 : audit 1 from='client.? 172.21.15.72:0/1522493635' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "app": "rados"}]: dispatch 2024-03-30T15:28:00.719 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:00 smithi172 bash[23680]: audit 2024-03-30T15:27:59.848578+0000 mon.a (mon.0) 3743 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "app": "rados"}]: dispatch 2024-03-30T15:28:01.419 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:28:01 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:28:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:28:01.451 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.451+0000 7f5b8099a640 1 -- 172.21.15.72:0/1522493635 <== mon.2 v2:172.21.15.72:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "app": "rados"}]=0 enabled application 'rados' on pool 'f4a77c40-1619-47cc-9a4a-97c81ff0ea60' v789) ==== 213+0+0 (secure 0 0 0) 0x7f5b70058a70 con 0x7f5b7c1020a0 2024-03-30T15:28:01.451 INFO:tasks.workunit.client.0.smithi072.stderr:enabled application 'rados' on pool 'f4a77c40-1619-47cc-9a4a-97c81ff0ea60' 2024-03-30T15:28:01.455 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.455+0000 7f5b8199c640 1 -- 172.21.15.72:0/1522493635 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f5b6406dbc0 msgr2=0x7f5b64070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:28:01.455 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.455+0000 7f5b8199c640 1 --2- 172.21.15.72:0/1522493635 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f5b6406dbc0 0x7f5b64070080 secure :-1 s=READY pgs=3233 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c01cca0 tx=0x7f5b6c01b000 comp rx=0 tx=0).stop 2024-03-30T15:28:01.455 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.455+0000 7f5b8199c640 1 -- 172.21.15.72:0/1522493635 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b7c1020a0 msgr2=0x7f5b7c19a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:28:01.455 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.455+0000 7f5b8199c640 1 --2- 172.21.15.72:0/1522493635 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b7c1020a0 0x7f5b7c19a370 secure :-1 s=READY pgs=3272 cs=0 l=1 rev1=1 crypto rx=0x7f5b7000b550 tx=0x7f5b7000ba10 comp rx=0 tx=0).stop 2024-03-30T15:28:01.455 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.455+0000 7f5b8199c640 1 -- 172.21.15.72:0/1522493635 shutdown_connections 2024-03-30T15:28:01.455 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.455+0000 7f5b8199c640 1 --2- 172.21.15.72:0/1522493635 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f5b6406dbc0 0x7f5b64070080 unknown :-1 s=CLOSED pgs=3233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:28:01.455 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.455+0000 7f5b8199c640 1 --2- 172.21.15.72:0/1522493635 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b7c1076e0 0x7f5b7c19e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:28:01.455 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.455+0000 7f5b8199c640 1 --2- 172.21.15.72:0/1522493635 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b7c1020a0 0x7f5b7c19a370 unknown :-1 s=CLOSED pgs=3272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:28:01.455 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.455+0000 7f5b8199c640 1 --2- 172.21.15.72:0/1522493635 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b7c1016e0 0x7f5b7c199e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:28:01.455 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.455+0000 7f5b8199c640 1 -- 172.21.15.72:0/1522493635 >> 172.21.15.72:0/1522493635 conn(0x7f5b7c0fd230 msgr2=0x7f5b7c0fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:28:01.455 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.455+0000 7f5b8199c640 1 -- 172.21.15.72:0/1522493635 shutdown_connections 2024-03-30T15:28:01.455 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.455+0000 7f5b8199c640 1 -- 172.21.15.72:0/1522493635 wait complete. 2024-03-30T15:28:01.472 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph osd pool set-quota f4a77c40-1619-47cc-9a4a-97c81ff0ea60 max_objects 10 2024-03-30T15:28:01.595 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.591+0000 7f6284807640 1 -- 172.21.15.72:0/1348676078 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f62801020a0 msgr2=0x7f628010e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:28:01.595 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.591+0000 7f6284807640 1 --2- 172.21.15.72:0/1348676078 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f62801020a0 0x7f628010e5b0 secure :-1 s=READY pgs=3273 cs=0 l=1 rev1=1 crypto rx=0x7f62700098a0 tx=0x7f627001c700 comp rx=0 tx=0).stop 2024-03-30T15:28:01.595 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.591+0000 7f6284807640 1 -- 172.21.15.72:0/1348676078 shutdown_connections 2024-03-30T15:28:01.595 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.591+0000 7f6284807640 1 --2- 172.21.15.72:0/1348676078 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f62801020a0 0x7f628010e5b0 unknown :-1 s=CLOSED pgs=3273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:28:01.595 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.591+0000 7f6284807640 1 --2- 172.21.15.72:0/1348676078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62801016e0 0x7f6280101b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:28:01.595 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.591+0000 7f6284807640 1 --2- 172.21.15.72:0/1348676078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62801076e0 0x7f6280107ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:28:01.595 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.591+0000 7f6284807640 1 -- 172.21.15.72:0/1348676078 >> 172.21.15.72:0/1348676078 conn(0x7f62800fd230 msgr2=0x7f62800ff650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:28:01.595 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.591+0000 7f6284807640 1 -- 172.21.15.72:0/1348676078 shutdown_connections 2024-03-30T15:28:01.595 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.591+0000 7f6284807640 1 -- 172.21.15.72:0/1348676078 wait complete. 2024-03-30T15:28:01.595 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.591+0000 7f6284807640 1 Processor -- start 2024-03-30T15:28:01.595 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.591+0000 7f6284807640 1 -- start start 2024-03-30T15:28:01.596 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.591+0000 7f6284807640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62801016e0 0x7f628019f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:28:01.596 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.591+0000 7f6284807640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f62801020a0 0x7f628019fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:28:01.596 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.591+0000 7f6284807640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62801076e0 0x7f6280199a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:28:01.596 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.591+0000 7f6284807640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f62801136d0 con 0x7f62801016e0 2024-03-30T15:28:01.596 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.591+0000 7f6284807640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6280113550 con 0x7f62801076e0 2024-03-30T15:28:01.596 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.591+0000 7f6284807640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f6280113850 con 0x7f62801020a0 2024-03-30T15:28:01.596 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.591+0000 7f627dd9b640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f62801020a0 0x7f628019fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:28:01.596 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.591+0000 7f627e59c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62801016e0 0x7f628019f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:28:01.596 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.591+0000 7f627dd9b640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f62801020a0 0x7f628019fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43470/0 (socket says 172.21.15.72:43470) 2024-03-30T15:28:01.596 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.595+0000 7f627dd9b640 1 -- 172.21.15.72:0/2501145233 learned_addr learned my addr 172.21.15.72:0/2501145233 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T15:28:01.596 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.595+0000 7f627ed9d640 1 --2- 172.21.15.72:0/2501145233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62801076e0 0x7f6280199a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:28:01.596 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.595+0000 7f627dd9b640 1 -- 172.21.15.72:0/2501145233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62801076e0 msgr2=0x7f6280199a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:28:01.596 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.595+0000 7f627dd9b640 1 --2- 172.21.15.72:0/2501145233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62801076e0 0x7f6280199a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:28:01.596 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.595+0000 7f627dd9b640 1 -- 172.21.15.72:0/2501145233 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62801016e0 msgr2=0x7f628019f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:28:01.597 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.595+0000 7f627dd9b640 1 --2- 172.21.15.72:0/2501145233 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62801016e0 0x7f628019f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:28:01.597 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.595+0000 7f627dd9b640 1 -- 172.21.15.72:0/2501145233 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f628019a1b0 con 0x7f62801020a0 2024-03-30T15:28:01.597 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.595+0000 7f627e59c640 1 --2- 172.21.15.72:0/2501145233 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62801016e0 0x7f628019f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T15:28:01.597 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.595+0000 7f627dd9b640 1 --2- 172.21.15.72:0/2501145233 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f62801020a0 0x7f628019fe00 secure :-1 s=READY pgs=3274 cs=0 l=1 rev1=1 crypto rx=0x7f626800e9d0 tx=0x7f626800ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:28:01.597 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.595+0000 7f62777fe640 1 -- 172.21.15.72:0/2501145233 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f626800cde0 con 0x7f62801020a0 2024-03-30T15:28:01.597 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.595+0000 7f62777fe640 1 -- 172.21.15.72:0/2501145233 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f62680044a0 con 0x7f62801020a0 2024-03-30T15:28:01.597 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.595+0000 7f6284807640 1 -- 172.21.15.72:0/2501145233 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f628019a4a0 con 0x7f62801020a0 2024-03-30T15:28:01.597 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.595+0000 7f62777fe640 1 -- 172.21.15.72:0/2501145233 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6268010430 con 0x7f62801020a0 2024-03-30T15:28:01.597 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.595+0000 7f6284807640 1 -- 172.21.15.72:0/2501145233 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f62801a6790 con 0x7f62801020a0 2024-03-30T15:28:01.598 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.595+0000 7f6284807640 1 -- 172.21.15.72:0/2501145233 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6280102e20 con 0x7f62801020a0 2024-03-30T15:28:01.598 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.595+0000 7f62777fe640 1 -- 172.21.15.72:0/2501145233 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 21) ==== 91831+0+0 (secure 0 0 0) 0x7f6268003f80 con 0x7f62801020a0 2024-03-30T15:28:01.598 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.595+0000 7f62777fe640 1 --2- 172.21.15.72:0/2501145233 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f626c06dbc0 0x7f626c070080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:28:01.598 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.595+0000 7f62777fe640 1 -- 172.21.15.72:0/2501145233 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(789..789 src has 269..789) ==== 9484+0+0 (secure 0 0 0) 0x7f626808ebf0 con 0x7f62801020a0 2024-03-30T15:28:01.598 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.595+0000 7f627e59c640 1 --2- 172.21.15.72:0/2501145233 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f626c06dbc0 0x7f626c070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:28:01.599 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.595+0000 7f627e59c640 1 --2- 172.21.15.72:0/2501145233 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f626c06dbc0 0x7f626c070080 secure :-1 s=READY pgs=3234 cs=0 l=1 rev1=1 crypto rx=0x7f628019abc0 tx=0x7f6278009650 comp rx=0 tx=0).ready entity=mgr.14526 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:28:01.602 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.603+0000 7f62777fe640 1 -- 172.21.15.72:0/2501145233 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f626805ba70 con 0x7f62801020a0 2024-03-30T15:28:01.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:01 smithi172 bash[23680]: cluster 2024-03-30T15:28:00.418246+0000 mgr.y (mgr.14526) 775 : cluster 0 pgmap v1302: 188 pgs: 12 unknown, 176 active+clean; 723 KiB data, 833 MiB used, 714 GiB / 715 GiB avail 2024-03-30T15:28:01.719 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:01 smithi172 bash[23680]: audit 2024-03-30T15:28:00.432364+0000 mon.a (mon.0) 3744 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "app": "rados"}]': finished 2024-03-30T15:28:01.719 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:01 smithi172 bash[23680]: cluster 2024-03-30T15:28:00.445380+0000 mon.a (mon.0) 3745 : cluster 0 osdmap e788: 8 total, 8 up, 8 in 2024-03-30T15:28:01.719 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:01 smithi172 bash[23680]: audit 2024-03-30T15:28:00.560400+0000 mon.c (mon.2) 549 : audit 1 from='client.? 172.21.15.72:0/1522493635' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "app": "rados"}]: dispatch 2024-03-30T15:28:01.719 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:01 smithi172 bash[23680]: audit 2024-03-30T15:28:00.561112+0000 mon.a (mon.0) 3746 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "app": "rados"}]: dispatch 2024-03-30T15:28:01.719 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:01 smithi172 bash[23680]: cluster 2024-03-30T15:28:01.420383+0000 mon.a (mon.0) 3747 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:28:01.773 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:01.771+0000 7f6284807640 1 -- 172.21.15.72:0/2501145233 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "field": "max_objects", "val": "10"} v 0) -- 0x7f62801a6a20 con 0x7f62801020a0 2024-03-30T15:28:01.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:01 smithi072 bash[21573]: cluster 2024-03-30T15:28:00.418246+0000 mgr.y (mgr.14526) 775 : cluster 0 pgmap v1302: 188 pgs: 12 unknown, 176 active+clean; 723 KiB data, 833 MiB used, 714 GiB / 715 GiB avail 2024-03-30T15:28:01.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:01 smithi072 bash[21573]: audit 2024-03-30T15:28:00.432364+0000 mon.a (mon.0) 3744 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "app": "rados"}]': finished 2024-03-30T15:28:01.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:01 smithi072 bash[21573]: cluster 2024-03-30T15:28:00.445380+0000 mon.a (mon.0) 3745 : cluster 0 osdmap e788: 8 total, 8 up, 8 in 2024-03-30T15:28:01.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:01 smithi072 bash[21573]: audit 2024-03-30T15:28:00.560400+0000 mon.c (mon.2) 549 : audit 1 from='client.? 172.21.15.72:0/1522493635' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "app": "rados"}]: dispatch 2024-03-30T15:28:01.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:01 smithi072 bash[21573]: audit 2024-03-30T15:28:00.561112+0000 mon.a (mon.0) 3746 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "app": "rados"}]: dispatch 2024-03-30T15:28:01.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:01 smithi072 bash[21573]: cluster 2024-03-30T15:28:01.420383+0000 mon.a (mon.0) 3747 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:28:01.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:01 smithi072 bash[28946]: cluster 2024-03-30T15:28:00.418246+0000 mgr.y (mgr.14526) 775 : cluster 0 pgmap v1302: 188 pgs: 12 unknown, 176 active+clean; 723 KiB data, 833 MiB used, 714 GiB / 715 GiB avail 2024-03-30T15:28:01.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:01 smithi072 bash[28946]: audit 2024-03-30T15:28:00.432364+0000 mon.a (mon.0) 3744 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "app": "rados"}]': finished 2024-03-30T15:28:01.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:01 smithi072 bash[28946]: cluster 2024-03-30T15:28:00.445380+0000 mon.a (mon.0) 3745 : cluster 0 osdmap e788: 8 total, 8 up, 8 in 2024-03-30T15:28:01.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:01 smithi072 bash[28946]: audit 2024-03-30T15:28:00.560400+0000 mon.c (mon.2) 549 : audit 1 from='client.? 172.21.15.72:0/1522493635' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "app": "rados"}]: dispatch 2024-03-30T15:28:01.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:01 smithi072 bash[28946]: audit 2024-03-30T15:28:00.561112+0000 mon.a (mon.0) 3746 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "app": "rados"}]: dispatch 2024-03-30T15:28:01.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:01 smithi072 bash[28946]: cluster 2024-03-30T15:28:01.420383+0000 mon.a (mon.0) 3747 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:28:02.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:28:01 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:28:02.450 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:02.447+0000 7f62777fe640 1 -- 172.21.15.72:0/2501145233 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool f4a77c40-1619-47cc-9a4a-97c81ff0ea60 v790) ==== 223+0+0 (secure 0 0 0) 0x7f626805f4c0 con 0x7f62801020a0 2024-03-30T15:28:02.561 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:02.559+0000 7f6284807640 1 -- 172.21.15.72:0/2501145233 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "field": "max_objects", "val": "10"} v 0) -- 0x7f628019afb0 con 0x7f62801020a0 2024-03-30T15:28:02.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:02 smithi172 bash[23680]: audit 2024-03-30T15:28:01.442511+0000 mon.a (mon.0) 3748 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "app": "rados"}]': finished 2024-03-30T15:28:02.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:02 smithi172 bash[23680]: cluster 2024-03-30T15:28:01.449872+0000 mon.a (mon.0) 3749 : cluster 0 osdmap e789: 8 total, 8 up, 8 in 2024-03-30T15:28:02.719 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:02 smithi172 bash[23680]: audit 2024-03-30T15:28:01.776815+0000 mon.c (mon.2) 550 : audit 1 from='client.? 172.21.15.72:0/2501145233' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "field": "max_objects", "val": "10"}]: dispatch 2024-03-30T15:28:02.719 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:02 smithi172 bash[23680]: audit 2024-03-30T15:28:01.777317+0000 mon.a (mon.0) 3750 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "field": "max_objects", "val": "10"}]: dispatch 2024-03-30T15:28:02.719 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:02 smithi172 bash[23680]: audit 2024-03-30T15:28:01.850840+0000 mgr.y (mgr.14526) 776 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:28:02.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:02 smithi072 bash[21573]: audit 2024-03-30T15:28:01.442511+0000 mon.a (mon.0) 3748 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "app": "rados"}]': finished 2024-03-30T15:28:02.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:02 smithi072 bash[21573]: cluster 2024-03-30T15:28:01.449872+0000 mon.a (mon.0) 3749 : cluster 0 osdmap e789: 8 total, 8 up, 8 in 2024-03-30T15:28:02.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:02 smithi072 bash[21573]: audit 2024-03-30T15:28:01.776815+0000 mon.c (mon.2) 550 : audit 1 from='client.? 172.21.15.72:0/2501145233' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "field": "max_objects", "val": "10"}]: dispatch 2024-03-30T15:28:02.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:02 smithi072 bash[21573]: audit 2024-03-30T15:28:01.777317+0000 mon.a (mon.0) 3750 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "field": "max_objects", "val": "10"}]: dispatch 2024-03-30T15:28:02.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:02 smithi072 bash[21573]: audit 2024-03-30T15:28:01.850840+0000 mgr.y (mgr.14526) 776 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:28:02.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:02 smithi072 bash[28946]: audit 2024-03-30T15:28:01.442511+0000 mon.a (mon.0) 3748 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "app": "rados"}]': finished 2024-03-30T15:28:02.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:02 smithi072 bash[28946]: cluster 2024-03-30T15:28:01.449872+0000 mon.a (mon.0) 3749 : cluster 0 osdmap e789: 8 total, 8 up, 8 in 2024-03-30T15:28:02.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:02 smithi072 bash[28946]: audit 2024-03-30T15:28:01.776815+0000 mon.c (mon.2) 550 : audit 1 from='client.? 172.21.15.72:0/2501145233' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "field": "max_objects", "val": "10"}]: dispatch 2024-03-30T15:28:02.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:02 smithi072 bash[28946]: audit 2024-03-30T15:28:01.777317+0000 mon.a (mon.0) 3750 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "field": "max_objects", "val": "10"}]: dispatch 2024-03-30T15:28:02.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:02 smithi072 bash[28946]: audit 2024-03-30T15:28:01.850840+0000 mgr.y (mgr.14526) 776 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:28:03.476 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:03.475+0000 7f62777fe640 1 -- 172.21.15.72:0/2501145233 <== mon.2 v2:172.21.15.72:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool f4a77c40-1619-47cc-9a4a-97c81ff0ea60 v791) ==== 223+0+0 (secure 0 0 0) 0x7f6268063cf0 con 0x7f62801020a0 2024-03-30T15:28:03.476 INFO:tasks.workunit.client.0.smithi072.stderr:set-quota max_objects = 10 for pool f4a77c40-1619-47cc-9a4a-97c81ff0ea60 2024-03-30T15:28:03.479 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:03.479+0000 7f6284807640 1 -- 172.21.15.72:0/2501145233 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f626c06dbc0 msgr2=0x7f626c070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:28:03.479 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:03.479+0000 7f6284807640 1 --2- 172.21.15.72:0/2501145233 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f626c06dbc0 0x7f626c070080 secure :-1 s=READY pgs=3234 cs=0 l=1 rev1=1 crypto rx=0x7f628019abc0 tx=0x7f6278009650 comp rx=0 tx=0).stop 2024-03-30T15:28:03.480 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:03.479+0000 7f6284807640 1 -- 172.21.15.72:0/2501145233 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f62801020a0 msgr2=0x7f628019fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:28:03.480 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:03.479+0000 7f6284807640 1 --2- 172.21.15.72:0/2501145233 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f62801020a0 0x7f628019fe00 secure :-1 s=READY pgs=3274 cs=0 l=1 rev1=1 crypto rx=0x7f626800e9d0 tx=0x7f626800ee90 comp rx=0 tx=0).stop 2024-03-30T15:28:03.480 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:03.479+0000 7f6284807640 1 -- 172.21.15.72:0/2501145233 shutdown_connections 2024-03-30T15:28:03.480 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:03.479+0000 7f6284807640 1 --2- 172.21.15.72:0/2501145233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62801076e0 0x7f6280199a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:28:03.480 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:03.479+0000 7f6284807640 1 --2- 172.21.15.72:0/2501145233 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f62801020a0 0x7f628019fe00 unknown :-1 s=CLOSED pgs=3274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:28:03.480 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:03.479+0000 7f6284807640 1 --2- 172.21.15.72:0/2501145233 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f626c06dbc0 0x7f626c070080 unknown :-1 s=CLOSED pgs=3234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:28:03.480 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:03.479+0000 7f6284807640 1 --2- 172.21.15.72:0/2501145233 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62801016e0 0x7f628019f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:28:03.480 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:03.479+0000 7f6284807640 1 -- 172.21.15.72:0/2501145233 >> 172.21.15.72:0/2501145233 conn(0x7f62800fd230 msgr2=0x7f62800fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:28:03.480 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:03.479+0000 7f6284807640 1 -- 172.21.15.72:0/2501145233 shutdown_connections 2024-03-30T15:28:03.480 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:28:03.479+0000 7f6284807640 1 -- 172.21.15.72:0/2501145233 wait complete. 2024-03-30T15:28:03.497 INFO:tasks.workunit.client.0.smithi072.stderr:+ sleep 30 2024-03-30T15:28:03.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:03 smithi172 bash[23680]: cluster 2024-03-30T15:28:02.419110+0000 mgr.y (mgr.14526) 777 : cluster 0 pgmap v1305: 188 pgs: 188 active+clean; 746 KiB data, 828 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.0 KiB/s wr, 1 op/s 2024-03-30T15:28:03.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:03 smithi172 bash[23680]: audit 2024-03-30T15:28:02.445051+0000 mon.a (mon.0) 3751 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "field": "max_objects", "val": "10"}]': finished 2024-03-30T15:28:03.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:03 smithi172 bash[23680]: cluster 2024-03-30T15:28:02.453161+0000 mon.a (mon.0) 3752 : cluster 0 osdmap e790: 8 total, 8 up, 8 in 2024-03-30T15:28:03.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:03 smithi172 bash[23680]: audit 2024-03-30T15:28:02.564574+0000 mon.c (mon.2) 551 : audit 1 from='client.? 172.21.15.72:0/2501145233' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "field": "max_objects", "val": "10"}]: dispatch 2024-03-30T15:28:03.719 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:03 smithi172 bash[23680]: audit 2024-03-30T15:28:02.565201+0000 mon.a (mon.0) 3753 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "field": "max_objects", "val": "10"}]: dispatch 2024-03-30T15:28:03.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:03 smithi072 bash[21573]: cluster 2024-03-30T15:28:02.419110+0000 mgr.y (mgr.14526) 777 : cluster 0 pgmap v1305: 188 pgs: 188 active+clean; 746 KiB data, 828 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.0 KiB/s wr, 1 op/s 2024-03-30T15:28:03.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:03 smithi072 bash[21573]: audit 2024-03-30T15:28:02.445051+0000 mon.a (mon.0) 3751 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "field": "max_objects", "val": "10"}]': finished 2024-03-30T15:28:03.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:03 smithi072 bash[21573]: cluster 2024-03-30T15:28:02.453161+0000 mon.a (mon.0) 3752 : cluster 0 osdmap e790: 8 total, 8 up, 8 in 2024-03-30T15:28:03.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:03 smithi072 bash[21573]: audit 2024-03-30T15:28:02.564574+0000 mon.c (mon.2) 551 : audit 1 from='client.? 172.21.15.72:0/2501145233' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "field": "max_objects", "val": "10"}]: dispatch 2024-03-30T15:28:03.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:03 smithi072 bash[21573]: audit 2024-03-30T15:28:02.565201+0000 mon.a (mon.0) 3753 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "field": "max_objects", "val": "10"}]: dispatch 2024-03-30T15:28:03.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:03 smithi072 bash[28946]: cluster 2024-03-30T15:28:02.419110+0000 mgr.y (mgr.14526) 777 : cluster 0 pgmap v1305: 188 pgs: 188 active+clean; 746 KiB data, 828 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.0 KiB/s wr, 1 op/s 2024-03-30T15:28:03.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:03 smithi072 bash[28946]: audit 2024-03-30T15:28:02.445051+0000 mon.a (mon.0) 3751 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "field": "max_objects", "val": "10"}]': finished 2024-03-30T15:28:03.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:03 smithi072 bash[28946]: cluster 2024-03-30T15:28:02.453161+0000 mon.a (mon.0) 3752 : cluster 0 osdmap e790: 8 total, 8 up, 8 in 2024-03-30T15:28:03.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:03 smithi072 bash[28946]: audit 2024-03-30T15:28:02.564574+0000 mon.c (mon.2) 551 : audit 1 from='client.? 172.21.15.72:0/2501145233' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "field": "max_objects", "val": "10"}]: dispatch 2024-03-30T15:28:03.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:03 smithi072 bash[28946]: audit 2024-03-30T15:28:02.565201+0000 mon.a (mon.0) 3753 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "field": "max_objects", "val": "10"}]: dispatch 2024-03-30T15:28:04.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:04 smithi072 bash[21573]: audit 2024-03-30T15:28:03.470244+0000 mon.a (mon.0) 3754 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "field": "max_objects", "val": "10"}]': finished 2024-03-30T15:28:04.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:04 smithi072 bash[21573]: cluster 2024-03-30T15:28:03.477396+0000 mon.a (mon.0) 3755 : cluster 0 osdmap e791: 8 total, 8 up, 8 in 2024-03-30T15:28:04.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:04 smithi072 bash[28946]: audit 2024-03-30T15:28:03.470244+0000 mon.a (mon.0) 3754 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "field": "max_objects", "val": "10"}]': finished 2024-03-30T15:28:04.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:04 smithi072 bash[28946]: cluster 2024-03-30T15:28:03.477396+0000 mon.a (mon.0) 3755 : cluster 0 osdmap e791: 8 total, 8 up, 8 in 2024-03-30T15:28:04.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:04 smithi172 bash[23680]: audit 2024-03-30T15:28:03.470244+0000 mon.a (mon.0) 3754 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "field": "max_objects", "val": "10"}]': finished 2024-03-30T15:28:04.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:04 smithi172 bash[23680]: cluster 2024-03-30T15:28:03.477396+0000 mon.a (mon.0) 3755 : cluster 0 osdmap e791: 8 total, 8 up, 8 in 2024-03-30T15:28:05.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:05 smithi072 bash[21573]: cluster 2024-03-30T15:28:04.419913+0000 mgr.y (mgr.14526) 778 : cluster 0 pgmap v1308: 188 pgs: 188 active+clean; 746 KiB data, 828 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.0 KiB/s wr, 1 op/s 2024-03-30T15:28:05.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:05 smithi072 bash[28946]: cluster 2024-03-30T15:28:04.419913+0000 mgr.y (mgr.14526) 778 : cluster 0 pgmap v1308: 188 pgs: 188 active+clean; 746 KiB data, 828 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.0 KiB/s wr, 1 op/s 2024-03-30T15:28:05.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:05 smithi172 bash[23680]: cluster 2024-03-30T15:28:04.419913+0000 mgr.y (mgr.14526) 778 : cluster 0 pgmap v1308: 188 pgs: 188 active+clean; 746 KiB data, 828 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.0 KiB/s wr, 1 op/s 2024-03-30T15:28:07.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:07 smithi072 bash[21573]: cluster 2024-03-30T15:28:06.422125+0000 mgr.y (mgr.14526) 779 : cluster 0 pgmap v1309: 188 pgs: 188 active+clean; 746 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 4.0 KiB/s wr, 2 op/s 2024-03-30T15:28:07.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:07 smithi072 bash[21573]: cluster 2024-03-30T15:28:07.398459+0000 mon.a (mon.0) 3756 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:28:07.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:07 smithi072 bash[28946]: cluster 2024-03-30T15:28:06.422125+0000 mgr.y (mgr.14526) 779 : cluster 0 pgmap v1309: 188 pgs: 188 active+clean; 746 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 4.0 KiB/s wr, 2 op/s 2024-03-30T15:28:07.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:07 smithi072 bash[28946]: cluster 2024-03-30T15:28:07.398459+0000 mon.a (mon.0) 3756 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:28:07.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:07 smithi172 bash[23680]: cluster 2024-03-30T15:28:06.422125+0000 mgr.y (mgr.14526) 779 : cluster 0 pgmap v1309: 188 pgs: 188 active+clean; 746 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 4.0 KiB/s wr, 2 op/s 2024-03-30T15:28:07.968 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:07 smithi172 bash[23680]: cluster 2024-03-30T15:28:07.398459+0000 mon.a (mon.0) 3756 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-30T15:28:09.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:08 smithi072 bash[21573]: audit 2024-03-30T15:28:07.797504+0000 mon.a (mon.0) 3757 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:28:09.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:08 smithi072 bash[21573]: audit 2024-03-30T15:28:07.800364+0000 mon.c (mon.2) 552 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:28:09.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:08 smithi072 bash[28946]: audit 2024-03-30T15:28:07.797504+0000 mon.a (mon.0) 3757 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:28:09.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:08 smithi072 bash[28946]: audit 2024-03-30T15:28:07.800364+0000 mon.c (mon.2) 552 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:28:09.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:08 smithi172 bash[23680]: audit 2024-03-30T15:28:07.797504+0000 mon.a (mon.0) 3757 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:28:09.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:08 smithi172 bash[23680]: audit 2024-03-30T15:28:07.800364+0000 mon.c (mon.2) 552 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:28:10.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:09 smithi072 bash[21573]: cluster 2024-03-30T15:28:08.422868+0000 mgr.y (mgr.14526) 780 : cluster 0 pgmap v1310: 188 pgs: 188 active+clean; 746 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 733 B/s rd, 0 op/s 2024-03-30T15:28:10.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:09 smithi072 bash[28946]: cluster 2024-03-30T15:28:08.422868+0000 mgr.y (mgr.14526) 780 : cluster 0 pgmap v1310: 188 pgs: 188 active+clean; 746 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 733 B/s rd, 0 op/s 2024-03-30T15:28:10.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:09 smithi172 bash[23680]: cluster 2024-03-30T15:28:08.422868+0000 mgr.y (mgr.14526) 780 : cluster 0 pgmap v1310: 188 pgs: 188 active+clean; 746 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 733 B/s rd, 0 op/s 2024-03-30T15:28:11.419 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:28:11 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:28:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:28:12.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:11 smithi072 bash[21573]: cluster 2024-03-30T15:28:10.423694+0000 mgr.y (mgr.14526) 781 : cluster 0 pgmap v1311: 188 pgs: 188 active+clean; 746 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-30T15:28:12.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:11 smithi072 bash[28946]: cluster 2024-03-30T15:28:10.423694+0000 mgr.y (mgr.14526) 781 : cluster 0 pgmap v1311: 188 pgs: 188 active+clean; 746 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-30T15:28:12.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:28:11 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:28:12.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:11 smithi172 bash[23680]: cluster 2024-03-30T15:28:10.423694+0000 mgr.y (mgr.14526) 781 : cluster 0 pgmap v1311: 188 pgs: 188 active+clean; 746 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-30T15:28:13.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:12 smithi072 bash[21573]: audit 2024-03-30T15:28:11.855957+0000 mgr.y (mgr.14526) 782 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:28:13.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:12 smithi072 bash[28946]: audit 2024-03-30T15:28:11.855957+0000 mgr.y (mgr.14526) 782 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:28:13.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:12 smithi172 bash[23680]: audit 2024-03-30T15:28:11.855957+0000 mgr.y (mgr.14526) 782 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:28:14.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:13 smithi072 bash[21573]: cluster 2024-03-30T15:28:12.425700+0000 mgr.y (mgr.14526) 783 : cluster 0 pgmap v1312: 188 pgs: 188 active+clean; 746 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T15:28:14.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:13 smithi072 bash[28946]: cluster 2024-03-30T15:28:12.425700+0000 mgr.y (mgr.14526) 783 : cluster 0 pgmap v1312: 188 pgs: 188 active+clean; 746 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T15:28:14.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:13 smithi172 bash[23680]: cluster 2024-03-30T15:28:12.425700+0000 mgr.y (mgr.14526) 783 : cluster 0 pgmap v1312: 188 pgs: 188 active+clean; 746 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T15:28:16.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:15 smithi072 bash[21573]: cluster 2024-03-30T15:28:14.426438+0000 mgr.y (mgr.14526) 784 : cluster 0 pgmap v1313: 188 pgs: 188 active+clean; 746 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 934 B/s rd, 0 op/s 2024-03-30T15:28:16.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:15 smithi072 bash[28946]: cluster 2024-03-30T15:28:14.426438+0000 mgr.y (mgr.14526) 784 : cluster 0 pgmap v1313: 188 pgs: 188 active+clean; 746 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 934 B/s rd, 0 op/s 2024-03-30T15:28:16.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:15 smithi172 bash[23680]: cluster 2024-03-30T15:28:14.426438+0000 mgr.y (mgr.14526) 784 : cluster 0 pgmap v1313: 188 pgs: 188 active+clean; 746 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 934 B/s rd, 0 op/s 2024-03-30T15:28:18.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:17 smithi072 bash[21573]: cluster 2024-03-30T15:28:16.428337+0000 mgr.y (mgr.14526) 785 : cluster 0 pgmap v1314: 188 pgs: 188 active+clean; 746 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:28:18.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:17 smithi072 bash[28946]: cluster 2024-03-30T15:28:16.428337+0000 mgr.y (mgr.14526) 785 : cluster 0 pgmap v1314: 188 pgs: 188 active+clean; 746 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:28:18.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:17 smithi172 bash[23680]: cluster 2024-03-30T15:28:16.428337+0000 mgr.y (mgr.14526) 785 : cluster 0 pgmap v1314: 188 pgs: 188 active+clean; 746 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:28:20.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:19 smithi072 bash[21573]: cluster 2024-03-30T15:28:18.429097+0000 mgr.y (mgr.14526) 786 : cluster 0 pgmap v1315: 188 pgs: 188 active+clean; 746 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:28:20.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:19 smithi072 bash[28946]: cluster 2024-03-30T15:28:18.429097+0000 mgr.y (mgr.14526) 786 : cluster 0 pgmap v1315: 188 pgs: 188 active+clean; 746 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:28:20.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:19 smithi172 bash[23680]: cluster 2024-03-30T15:28:18.429097+0000 mgr.y (mgr.14526) 786 : cluster 0 pgmap v1315: 188 pgs: 188 active+clean; 746 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:28:21.419 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:28:21 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:28:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:28:22.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:21 smithi072 bash[21573]: cluster 2024-03-30T15:28:20.429816+0000 mgr.y (mgr.14526) 787 : cluster 0 pgmap v1316: 188 pgs: 188 active+clean; 746 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:28:22.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:21 smithi072 bash[28946]: cluster 2024-03-30T15:28:20.429816+0000 mgr.y (mgr.14526) 787 : cluster 0 pgmap v1316: 188 pgs: 188 active+clean; 746 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:28:22.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:28:21 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:28:22.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:21 smithi172 bash[23680]: cluster 2024-03-30T15:28:20.429816+0000 mgr.y (mgr.14526) 787 : cluster 0 pgmap v1316: 188 pgs: 188 active+clean; 746 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:28:23.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:22 smithi072 bash[21573]: audit 2024-03-30T15:28:21.867590+0000 mgr.y (mgr.14526) 788 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:28:23.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:22 smithi072 bash[21573]: audit 2024-03-30T15:28:22.833840+0000 mon.c (mon.2) 553 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:28:23.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:22 smithi072 bash[28946]: audit 2024-03-30T15:28:21.867590+0000 mgr.y (mgr.14526) 788 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:28:23.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:22 smithi072 bash[28946]: audit 2024-03-30T15:28:22.833840+0000 mon.c (mon.2) 553 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:28:23.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:22 smithi172 bash[23680]: audit 2024-03-30T15:28:21.867590+0000 mgr.y (mgr.14526) 788 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:28:23.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:22 smithi172 bash[23680]: audit 2024-03-30T15:28:22.833840+0000 mon.c (mon.2) 553 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:28:24.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:23 smithi072 bash[21573]: cluster 2024-03-30T15:28:22.431811+0000 mgr.y (mgr.14526) 789 : cluster 0 pgmap v1317: 188 pgs: 188 active+clean; 746 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:28:24.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:23 smithi072 bash[28946]: cluster 2024-03-30T15:28:22.431811+0000 mgr.y (mgr.14526) 789 : cluster 0 pgmap v1317: 188 pgs: 188 active+clean; 746 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:28:24.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:23 smithi172 bash[23680]: cluster 2024-03-30T15:28:22.431811+0000 mgr.y (mgr.14526) 789 : cluster 0 pgmap v1317: 188 pgs: 188 active+clean; 746 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:28:26.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:25 smithi072 bash[21573]: cluster 2024-03-30T15:28:24.432548+0000 mgr.y (mgr.14526) 790 : cluster 0 pgmap v1318: 188 pgs: 188 active+clean; 746 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:28:26.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:25 smithi072 bash[28946]: cluster 2024-03-30T15:28:24.432548+0000 mgr.y (mgr.14526) 790 : cluster 0 pgmap v1318: 188 pgs: 188 active+clean; 746 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:28:26.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:25 smithi172 bash[23680]: cluster 2024-03-30T15:28:24.432548+0000 mgr.y (mgr.14526) 790 : cluster 0 pgmap v1318: 188 pgs: 188 active+clean; 746 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:28:28.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:27 smithi072 bash[21573]: cluster 2024-03-30T15:28:26.434456+0000 mgr.y (mgr.14526) 791 : cluster 0 pgmap v1319: 188 pgs: 188 active+clean; 746 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:28:28.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:27 smithi072 bash[21573]: audit 2024-03-30T15:28:27.699471+0000 mon.c (mon.2) 554 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:28:28.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:27 smithi072 bash[28946]: cluster 2024-03-30T15:28:26.434456+0000 mgr.y (mgr.14526) 791 : cluster 0 pgmap v1319: 188 pgs: 188 active+clean; 746 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:28:28.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:27 smithi072 bash[28946]: audit 2024-03-30T15:28:27.699471+0000 mon.c (mon.2) 554 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:28:28.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:27 smithi172 bash[23680]: cluster 2024-03-30T15:28:26.434456+0000 mgr.y (mgr.14526) 791 : cluster 0 pgmap v1319: 188 pgs: 188 active+clean; 746 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:28:28.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:27 smithi172 bash[23680]: audit 2024-03-30T15:28:27.699471+0000 mon.c (mon.2) 554 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:28:29.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:29 smithi072 bash[21573]: audit 2024-03-30T15:28:28.232164+0000 mon.a (mon.0) 3758 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:28:29.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:29 smithi072 bash[21573]: audit 2024-03-30T15:28:28.246689+0000 mon.a (mon.0) 3759 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:28:29.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:29 smithi072 bash[21573]: cluster 2024-03-30T15:28:28.435169+0000 mgr.y (mgr.14526) 792 : cluster 0 pgmap v1320: 188 pgs: 188 active+clean; 746 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:28:29.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:29 smithi072 bash[21573]: audit 2024-03-30T15:28:28.901942+0000 mon.c (mon.2) 555 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:28:29.670 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:29 smithi072 bash[21573]: audit 2024-03-30T15:28:28.903731+0000 mon.c (mon.2) 556 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:28:29.670 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:29 smithi072 bash[21573]: audit 2024-03-30T15:28:28.913277+0000 mon.a (mon.0) 3760 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:28:29.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:29 smithi072 bash[28946]: audit 2024-03-30T15:28:28.232164+0000 mon.a (mon.0) 3758 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:28:29.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:29 smithi072 bash[28946]: audit 2024-03-30T15:28:28.246689+0000 mon.a (mon.0) 3759 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:28:29.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:29 smithi072 bash[28946]: cluster 2024-03-30T15:28:28.435169+0000 mgr.y (mgr.14526) 792 : cluster 0 pgmap v1320: 188 pgs: 188 active+clean; 746 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:28:29.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:29 smithi072 bash[28946]: audit 2024-03-30T15:28:28.901942+0000 mon.c (mon.2) 555 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:28:29.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:29 smithi072 bash[28946]: audit 2024-03-30T15:28:28.903731+0000 mon.c (mon.2) 556 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:28:29.670 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:29 smithi072 bash[28946]: audit 2024-03-30T15:28:28.913277+0000 mon.a (mon.0) 3760 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:28:29.719 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:29 smithi172 bash[23680]: audit 2024-03-30T15:28:28.232164+0000 mon.a (mon.0) 3758 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:28:29.719 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:29 smithi172 bash[23680]: audit 2024-03-30T15:28:28.246689+0000 mon.a (mon.0) 3759 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:28:29.719 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:29 smithi172 bash[23680]: cluster 2024-03-30T15:28:28.435169+0000 mgr.y (mgr.14526) 792 : cluster 0 pgmap v1320: 188 pgs: 188 active+clean; 746 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:28:29.719 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:29 smithi172 bash[23680]: audit 2024-03-30T15:28:28.901942+0000 mon.c (mon.2) 555 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:28:29.719 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:29 smithi172 bash[23680]: audit 2024-03-30T15:28:28.903731+0000 mon.c (mon.2) 556 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:28:29.720 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:29 smithi172 bash[23680]: audit 2024-03-30T15:28:28.913277+0000 mon.a (mon.0) 3760 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:28:31.419 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:28:31 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:28:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:28:31.878 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:31 smithi172 bash[23680]: cluster 2024-03-30T15:28:30.436022+0000 mgr.y (mgr.14526) 793 : cluster 0 pgmap v1321: 188 pgs: 188 active+clean; 746 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:28:31.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:31 smithi072 bash[21573]: cluster 2024-03-30T15:28:30.436022+0000 mgr.y (mgr.14526) 793 : cluster 0 pgmap v1321: 188 pgs: 188 active+clean; 746 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:28:31.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:31 smithi072 bash[28946]: cluster 2024-03-30T15:28:30.436022+0000 mgr.y (mgr.14526) 793 : cluster 0 pgmap v1321: 188 pgs: 188 active+clean; 746 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:28:32.218 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:28:31 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:28:32.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:32 smithi072 bash[21573]: audit 2024-03-30T15:28:31.878235+0000 mgr.y (mgr.14526) 794 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:28:32.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:32 smithi072 bash[28946]: audit 2024-03-30T15:28:31.878235+0000 mgr.y (mgr.14526) 794 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:28:32.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:32 smithi172 bash[23680]: audit 2024-03-30T15:28:31.878235+0000 mgr.y (mgr.14526) 794 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:28:33.498 INFO:tasks.workunit.client.0.smithi072.stderr:+ seq 1 10 2024-03-30T15:28:33.499 INFO:tasks.workunit.client.0.smithi072.stderr:+ rados -p f4a77c40-1619-47cc-9a4a-97c81ff0ea60 put obj1 /etc/passwd 2024-03-30T15:28:33.547 INFO:tasks.workunit.client.0.smithi072.stderr:+ rados -p f4a77c40-1619-47cc-9a4a-97c81ff0ea60 put obj2 /etc/passwd 2024-03-30T15:28:33.589 INFO:tasks.workunit.client.0.smithi072.stderr:+ rados -p f4a77c40-1619-47cc-9a4a-97c81ff0ea60 put obj3 /etc/passwd 2024-03-30T15:28:33.626 INFO:tasks.workunit.client.0.smithi072.stderr:+ rados -p f4a77c40-1619-47cc-9a4a-97c81ff0ea60 put obj4 /etc/passwd 2024-03-30T15:28:33.664 INFO:tasks.workunit.client.0.smithi072.stderr:+ rados -p f4a77c40-1619-47cc-9a4a-97c81ff0ea60 put obj5 /etc/passwd 2024-03-30T15:28:33.703 INFO:tasks.workunit.client.0.smithi072.stderr:+ rados -p f4a77c40-1619-47cc-9a4a-97c81ff0ea60 put obj6 /etc/passwd 2024-03-30T15:28:33.739 INFO:tasks.workunit.client.0.smithi072.stderr:+ rados -p f4a77c40-1619-47cc-9a4a-97c81ff0ea60 put obj7 /etc/passwd 2024-03-30T15:28:33.776 INFO:tasks.workunit.client.0.smithi072.stderr:+ rados -p f4a77c40-1619-47cc-9a4a-97c81ff0ea60 put obj8 /etc/passwd 2024-03-30T15:28:33.813 INFO:tasks.workunit.client.0.smithi072.stderr:+ rados -p f4a77c40-1619-47cc-9a4a-97c81ff0ea60 put obj9 /etc/passwd 2024-03-30T15:28:33.851 INFO:tasks.workunit.client.0.smithi072.stderr:+ rados -p f4a77c40-1619-47cc-9a4a-97c81ff0ea60 put obj10 /etc/passwd 2024-03-30T15:28:33.889 INFO:tasks.workunit.client.0.smithi072.stderr:+ sleep 30 2024-03-30T15:28:33.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:33 smithi072 bash[21573]: cluster 2024-03-30T15:28:32.438442+0000 mgr.y (mgr.14526) 795 : cluster 0 pgmap v1322: 188 pgs: 188 active+clean; 746 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:28:33.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:33 smithi072 bash[28946]: cluster 2024-03-30T15:28:32.438442+0000 mgr.y (mgr.14526) 795 : cluster 0 pgmap v1322: 188 pgs: 188 active+clean; 746 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:28:33.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:33 smithi172 bash[23680]: cluster 2024-03-30T15:28:32.438442+0000 mgr.y (mgr.14526) 795 : cluster 0 pgmap v1322: 188 pgs: 188 active+clean; 746 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:28:35.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:35 smithi072 bash[21573]: cluster 2024-03-30T15:28:34.439300+0000 mgr.y (mgr.14526) 796 : cluster 0 pgmap v1323: 188 pgs: 188 active+clean; 746 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:28:35.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:35 smithi072 bash[28946]: cluster 2024-03-30T15:28:34.439300+0000 mgr.y (mgr.14526) 796 : cluster 0 pgmap v1323: 188 pgs: 188 active+clean; 746 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:28:35.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:35 smithi172 bash[23680]: cluster 2024-03-30T15:28:34.439300+0000 mgr.y (mgr.14526) 796 : cluster 0 pgmap v1323: 188 pgs: 188 active+clean; 746 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:28:37.921 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:37 smithi072 bash[21573]: cluster 2024-03-30T15:28:36.441208+0000 mgr.y (mgr.14526) 797 : cluster 0 pgmap v1324: 188 pgs: 188 active+clean; 863 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 10 KiB/s wr, 2 op/s 2024-03-30T15:28:37.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:37 smithi072 bash[21573]: cluster 2024-03-30T15:28:37.405771+0000 mon.a (mon.0) 3761 : cluster 3 pool 'f4a77c40-1619-47cc-9a4a-97c81ff0ea60' is full (reached quota's max_objects: 10) 2024-03-30T15:28:37.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:37 smithi072 bash[21573]: cluster 2024-03-30T15:28:37.406341+0000 mon.a (mon.0) 3762 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-03-30T15:28:37.922 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:37 smithi072 bash[21573]: cluster 2024-03-30T15:28:37.416395+0000 mon.a (mon.0) 3763 : cluster 0 osdmap e792: 8 total, 8 up, 8 in 2024-03-30T15:28:37.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:37 smithi072 bash[28946]: cluster 2024-03-30T15:28:36.441208+0000 mgr.y (mgr.14526) 797 : cluster 0 pgmap v1324: 188 pgs: 188 active+clean; 863 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 10 KiB/s wr, 2 op/s 2024-03-30T15:28:37.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:37 smithi072 bash[28946]: cluster 2024-03-30T15:28:37.405771+0000 mon.a (mon.0) 3761 : cluster 3 pool 'f4a77c40-1619-47cc-9a4a-97c81ff0ea60' is full (reached quota's max_objects: 10) 2024-03-30T15:28:37.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:37 smithi072 bash[28946]: cluster 2024-03-30T15:28:37.406341+0000 mon.a (mon.0) 3762 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-03-30T15:28:37.922 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:37 smithi072 bash[28946]: cluster 2024-03-30T15:28:37.416395+0000 mon.a (mon.0) 3763 : cluster 0 osdmap e792: 8 total, 8 up, 8 in 2024-03-30T15:28:37.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:37 smithi172 bash[23680]: cluster 2024-03-30T15:28:36.441208+0000 mgr.y (mgr.14526) 797 : cluster 0 pgmap v1324: 188 pgs: 188 active+clean; 863 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 10 KiB/s wr, 2 op/s 2024-03-30T15:28:37.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:37 smithi172 bash[23680]: cluster 2024-03-30T15:28:37.405771+0000 mon.a (mon.0) 3761 : cluster 3 pool 'f4a77c40-1619-47cc-9a4a-97c81ff0ea60' is full (reached quota's max_objects: 10) 2024-03-30T15:28:37.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:37 smithi172 bash[23680]: cluster 2024-03-30T15:28:37.406341+0000 mon.a (mon.0) 3762 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-03-30T15:28:37.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:37 smithi172 bash[23680]: cluster 2024-03-30T15:28:37.416395+0000 mon.a (mon.0) 3763 : cluster 0 osdmap e792: 8 total, 8 up, 8 in 2024-03-30T15:28:39.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:38 smithi072 bash[21573]: audit 2024-03-30T15:28:37.878711+0000 mon.a (mon.0) 3764 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:28:39.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:38 smithi072 bash[21573]: audit 2024-03-30T15:28:37.881851+0000 mon.c (mon.2) 557 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:28:39.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:38 smithi072 bash[28946]: audit 2024-03-30T15:28:37.878711+0000 mon.a (mon.0) 3764 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:28:39.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:38 smithi072 bash[28946]: audit 2024-03-30T15:28:37.881851+0000 mon.c (mon.2) 557 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:28:39.218 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:38 smithi172 bash[23680]: audit 2024-03-30T15:28:37.878711+0000 mon.a (mon.0) 3764 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:28:39.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:38 smithi172 bash[23680]: audit 2024-03-30T15:28:37.881851+0000 mon.c (mon.2) 557 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:28:40.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:39 smithi072 bash[21573]: cluster 2024-03-30T15:28:38.441944+0000 mgr.y (mgr.14526) 798 : cluster 0 pgmap v1326: 188 pgs: 188 active+clean; 863 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-03-30T15:28:40.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:39 smithi072 bash[28946]: cluster 2024-03-30T15:28:38.441944+0000 mgr.y (mgr.14526) 798 : cluster 0 pgmap v1326: 188 pgs: 188 active+clean; 863 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-03-30T15:28:40.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:39 smithi172 bash[23680]: cluster 2024-03-30T15:28:38.441944+0000 mgr.y (mgr.14526) 798 : cluster 0 pgmap v1326: 188 pgs: 188 active+clean; 863 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-03-30T15:28:41.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:40 smithi172 bash[23680]: cluster 2024-03-30T15:28:40.442707+0000 mgr.y (mgr.14526) 799 : cluster 0 pgmap v1327: 188 pgs: 188 active+clean; 863 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-03-30T15:28:41.419 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:28:41 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:28:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:28:41.419 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:40 smithi072 bash[21573]: cluster 2024-03-30T15:28:40.442707+0000 mgr.y (mgr.14526) 799 : cluster 0 pgmap v1327: 188 pgs: 188 active+clean; 863 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-03-30T15:28:41.419 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:40 smithi072 bash[28946]: cluster 2024-03-30T15:28:40.442707+0000 mgr.y (mgr.14526) 799 : cluster 0 pgmap v1327: 188 pgs: 188 active+clean; 863 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-03-30T15:28:42.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:28:41 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:28:43.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:43 smithi072 bash[21573]: audit 2024-03-30T15:28:41.887349+0000 mgr.y (mgr.14526) 800 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:28:43.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:43 smithi072 bash[21573]: cluster 2024-03-30T15:28:42.445412+0000 mgr.y (mgr.14526) 801 : cluster 0 pgmap v1328: 188 pgs: 188 active+clean; 863 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-03-30T15:28:43.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:43 smithi072 bash[28946]: audit 2024-03-30T15:28:41.887349+0000 mgr.y (mgr.14526) 800 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:28:43.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:43 smithi072 bash[28946]: cluster 2024-03-30T15:28:42.445412+0000 mgr.y (mgr.14526) 801 : cluster 0 pgmap v1328: 188 pgs: 188 active+clean; 863 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-03-30T15:28:43.970 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:43 smithi172 bash[23680]: audit 2024-03-30T15:28:41.887349+0000 mgr.y (mgr.14526) 800 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:28:43.970 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:43 smithi172 bash[23680]: cluster 2024-03-30T15:28:42.445412+0000 mgr.y (mgr.14526) 801 : cluster 0 pgmap v1328: 188 pgs: 188 active+clean; 863 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-03-30T15:28:45.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:45 smithi072 bash[28946]: cluster 2024-03-30T15:28:44.446230+0000 mgr.y (mgr.14526) 802 : cluster 0 pgmap v1329: 188 pgs: 188 active+clean; 863 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-03-30T15:28:45.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:45 smithi072 bash[21573]: cluster 2024-03-30T15:28:44.446230+0000 mgr.y (mgr.14526) 802 : cluster 0 pgmap v1329: 188 pgs: 188 active+clean; 863 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-03-30T15:28:45.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:45 smithi172 bash[23680]: cluster 2024-03-30T15:28:44.446230+0000 mgr.y (mgr.14526) 802 : cluster 0 pgmap v1329: 188 pgs: 188 active+clean; 863 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-03-30T15:28:47.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:47 smithi072 bash[28946]: cluster 2024-03-30T15:28:46.448633+0000 mgr.y (mgr.14526) 803 : cluster 0 pgmap v1330: 188 pgs: 188 active+clean; 863 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T15:28:47.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:47 smithi072 bash[21573]: cluster 2024-03-30T15:28:46.448633+0000 mgr.y (mgr.14526) 803 : cluster 0 pgmap v1330: 188 pgs: 188 active+clean; 863 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T15:28:47.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:47 smithi172 bash[23680]: cluster 2024-03-30T15:28:46.448633+0000 mgr.y (mgr.14526) 803 : cluster 0 pgmap v1330: 188 pgs: 188 active+clean; 863 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T15:28:49.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:49 smithi072 bash[28946]: cluster 2024-03-30T15:28:48.449464+0000 mgr.y (mgr.14526) 804 : cluster 0 pgmap v1331: 188 pgs: 188 active+clean; 863 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 927 B/s rd, 0 op/s 2024-03-30T15:28:49.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:49 smithi072 bash[21573]: cluster 2024-03-30T15:28:48.449464+0000 mgr.y (mgr.14526) 804 : cluster 0 pgmap v1331: 188 pgs: 188 active+clean; 863 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 927 B/s rd, 0 op/s 2024-03-30T15:28:49.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:49 smithi172 bash[23680]: cluster 2024-03-30T15:28:48.449464+0000 mgr.y (mgr.14526) 804 : cluster 0 pgmap v1331: 188 pgs: 188 active+clean; 863 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 927 B/s rd, 0 op/s 2024-03-30T15:28:51.419 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:28:51 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:28:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:28:51.897 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:51 smithi172 bash[23680]: cluster 2024-03-30T15:28:50.450236+0000 mgr.y (mgr.14526) 805 : cluster 0 pgmap v1332: 188 pgs: 188 active+clean; 863 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:28:51.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:51 smithi072 bash[28946]: cluster 2024-03-30T15:28:50.450236+0000 mgr.y (mgr.14526) 805 : cluster 0 pgmap v1332: 188 pgs: 188 active+clean; 863 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:28:51.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:51 smithi072 bash[21573]: cluster 2024-03-30T15:28:50.450236+0000 mgr.y (mgr.14526) 805 : cluster 0 pgmap v1332: 188 pgs: 188 active+clean; 863 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:28:52.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:28:51 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:28:53.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:53 smithi072 bash[28946]: audit 2024-03-30T15:28:51.898979+0000 mgr.y (mgr.14526) 806 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:28:53.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:53 smithi072 bash[28946]: cluster 2024-03-30T15:28:52.452139+0000 mgr.y (mgr.14526) 807 : cluster 0 pgmap v1333: 188 pgs: 188 active+clean; 863 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:28:53.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:53 smithi072 bash[28946]: audit 2024-03-30T15:28:52.914749+0000 mon.c (mon.2) 558 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:28:53.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:53 smithi072 bash[21573]: audit 2024-03-30T15:28:51.898979+0000 mgr.y (mgr.14526) 806 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:28:53.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:53 smithi072 bash[21573]: cluster 2024-03-30T15:28:52.452139+0000 mgr.y (mgr.14526) 807 : cluster 0 pgmap v1333: 188 pgs: 188 active+clean; 863 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:28:53.920 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:53 smithi072 bash[21573]: audit 2024-03-30T15:28:52.914749+0000 mon.c (mon.2) 558 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:28:53.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:53 smithi172 bash[23680]: audit 2024-03-30T15:28:51.898979+0000 mgr.y (mgr.14526) 806 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:28:53.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:53 smithi172 bash[23680]: cluster 2024-03-30T15:28:52.452139+0000 mgr.y (mgr.14526) 807 : cluster 0 pgmap v1333: 188 pgs: 188 active+clean; 863 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:28:53.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:53 smithi172 bash[23680]: audit 2024-03-30T15:28:52.914749+0000 mon.c (mon.2) 558 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:28:55.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:55 smithi072 bash[21573]: cluster 2024-03-30T15:28:54.452886+0000 mgr.y (mgr.14526) 808 : cluster 0 pgmap v1334: 188 pgs: 188 active+clean; 863 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:28:55.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:55 smithi072 bash[28946]: cluster 2024-03-30T15:28:54.452886+0000 mgr.y (mgr.14526) 808 : cluster 0 pgmap v1334: 188 pgs: 188 active+clean; 863 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:28:55.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:55 smithi172 bash[23680]: cluster 2024-03-30T15:28:54.452886+0000 mgr.y (mgr.14526) 808 : cluster 0 pgmap v1334: 188 pgs: 188 active+clean; 863 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:28:57.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:57 smithi072 bash[21573]: cluster 2024-03-30T15:28:56.454842+0000 mgr.y (mgr.14526) 809 : cluster 0 pgmap v1335: 188 pgs: 188 active+clean; 863 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:28:57.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:57 smithi072 bash[28946]: cluster 2024-03-30T15:28:56.454842+0000 mgr.y (mgr.14526) 809 : cluster 0 pgmap v1335: 188 pgs: 188 active+clean; 863 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:28:57.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:57 smithi172 bash[23680]: cluster 2024-03-30T15:28:56.454842+0000 mgr.y (mgr.14526) 809 : cluster 0 pgmap v1335: 188 pgs: 188 active+clean; 863 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:28:59.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:28:59 smithi072 bash[21573]: cluster 2024-03-30T15:28:58.455592+0000 mgr.y (mgr.14526) 810 : cluster 0 pgmap v1336: 188 pgs: 188 active+clean; 863 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:28:59.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:28:59 smithi072 bash[28946]: cluster 2024-03-30T15:28:58.455592+0000 mgr.y (mgr.14526) 810 : cluster 0 pgmap v1336: 188 pgs: 188 active+clean; 863 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:28:59.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:28:59 smithi172 bash[23680]: cluster 2024-03-30T15:28:58.455592+0000 mgr.y (mgr.14526) 810 : cluster 0 pgmap v1336: 188 pgs: 188 active+clean; 863 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:29:01.419 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:29:01 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:29:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:29:01.908 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:01 smithi172 bash[23680]: cluster 2024-03-30T15:29:00.456393+0000 mgr.y (mgr.14526) 811 : cluster 0 pgmap v1337: 188 pgs: 188 active+clean; 863 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:29:01.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:01 smithi072 bash[21573]: cluster 2024-03-30T15:29:00.456393+0000 mgr.y (mgr.14526) 811 : cluster 0 pgmap v1337: 188 pgs: 188 active+clean; 863 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:29:01.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:01 smithi072 bash[28946]: cluster 2024-03-30T15:29:00.456393+0000 mgr.y (mgr.14526) 811 : cluster 0 pgmap v1337: 188 pgs: 188 active+clean; 863 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:29:02.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:29:01 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:29:03.890 INFO:tasks.workunit.client.0.smithi072.stderr:+ rados -p 4e694c24-7f59-49ba-b14c-a8866b9195f4 put threemore /etc/passwd 2024-03-30T15:29:03.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:03 smithi072 bash[28946]: audit 2024-03-30T15:29:01.910658+0000 mgr.y (mgr.14526) 812 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:29:03.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:03 smithi072 bash[28946]: cluster 2024-03-30T15:29:02.458364+0000 mgr.y (mgr.14526) 813 : cluster 0 pgmap v1338: 188 pgs: 188 active+clean; 863 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:29:03.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:03 smithi072 bash[21573]: audit 2024-03-30T15:29:01.910658+0000 mgr.y (mgr.14526) 812 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:29:03.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:03 smithi072 bash[21573]: cluster 2024-03-30T15:29:02.458364+0000 mgr.y (mgr.14526) 813 : cluster 0 pgmap v1338: 188 pgs: 188 active+clean; 863 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:29:03.937 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph osd pool set-quota 4e694c24-7f59-49ba-b14c-a8866b9195f4 max_bytes 0 2024-03-30T15:29:03.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:03 smithi172 bash[23680]: audit 2024-03-30T15:29:01.910658+0000 mgr.y (mgr.14526) 812 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:29:03.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:03 smithi172 bash[23680]: cluster 2024-03-30T15:29:02.458364+0000 mgr.y (mgr.14526) 813 : cluster 0 pgmap v1338: 188 pgs: 188 active+clean; 863 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:29:04.061 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:04.058+0000 7fc92699c640 1 -- 172.21.15.72:0/1701659746 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9200ffa30 msgr2=0x7fc9200ffe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:29:04.061 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:04.058+0000 7fc92699c640 1 --2- 172.21.15.72:0/1701659746 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9200ffa30 0x7fc9200ffe10 secure :-1 s=READY pgs=2419 cs=0 l=1 rev1=1 crypto rx=0x7fc910009930 tx=0x7fc91001c780 comp rx=0 tx=0).stop 2024-03-30T15:29:04.061 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:04.058+0000 7fc92699c640 1 -- 172.21.15.72:0/1701659746 shutdown_connections 2024-03-30T15:29:04.061 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:04.058+0000 7fc92699c640 1 --2- 172.21.15.72:0/1701659746 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc920109f50 0x7fc9201108d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:29:04.061 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:04.058+0000 7fc92699c640 1 --2- 172.21.15.72:0/1701659746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9201003e0 0x7fc920109820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:29:04.061 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:04.058+0000 7fc92699c640 1 --2- 172.21.15.72:0/1701659746 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9200ffa30 0x7fc9200ffe10 unknown :-1 s=CLOSED pgs=2419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:29:04.061 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:04.058+0000 7fc92699c640 1 -- 172.21.15.72:0/1701659746 >> 172.21.15.72:0/1701659746 conn(0x7fc920076710 msgr2=0x7fc9200fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:29:04.062 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:04.058+0000 7fc92699c640 1 -- 172.21.15.72:0/1701659746 shutdown_connections 2024-03-30T15:29:04.062 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:04.058+0000 7fc92699c640 1 -- 172.21.15.72:0/1701659746 wait complete. 2024-03-30T15:29:04.062 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:04.058+0000 7fc92699c640 1 Processor -- start 2024-03-30T15:29:04.062 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:04.058+0000 7fc92699c640 1 -- start start 2024-03-30T15:29:04.062 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:04.058+0000 7fc92699c640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9200ffa30 0x7fc92019bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:29:04.062 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:04.058+0000 7fc92699c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9201003e0 0x7fc92019c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:29:04.062 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:04.058+0000 7fc92699c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc920109f50 0x7fc9201a07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:29:04.062 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:04.058+0000 7fc92699c640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc920115970 con 0x7fc9201003e0 2024-03-30T15:29:04.062 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:04.058+0000 7fc92699c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc9201157f0 con 0x7fc920109f50 2024-03-30T15:29:04.063 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:04.058+0000 7fc92699c640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fc920115af0 con 0x7fc9200ffa30 2024-03-30T15:29:04.063 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:04.058+0000 7fc91ffff640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9200ffa30 0x7fc92019bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:29:04.063 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:04.058+0000 7fc91f7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9201003e0 0x7fc92019c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:29:04.063 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:04.058+0000 7fc91ffff640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9200ffa30 0x7fc92019bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:53138/0 (socket says 172.21.15.72:53138) 2024-03-30T15:29:04.063 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:04.058+0000 7fc91f7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9201003e0 0x7fc92019c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42652/0 (socket says 172.21.15.72:42652) 2024-03-30T15:29:04.063 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:04.058+0000 7fc91ffff640 1 -- 172.21.15.72:0/3640650829 learned_addr learned my addr 172.21.15.72:0/3640650829 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T15:29:04.063 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:04.058+0000 7fc91ffff640 1 -- 172.21.15.72:0/3640650829 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc920109f50 msgr2=0x7fc9201a07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:29:04.063 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:04.058+0000 7fc91ffff640 1 --2- 172.21.15.72:0/3640650829 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc920109f50 0x7fc9201a07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:29:04.063 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:04.058+0000 7fc91ffff640 1 -- 172.21.15.72:0/3640650829 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9201003e0 msgr2=0x7fc92019c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:29:04.063 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:04.058+0000 7fc91ffff640 1 --2- 172.21.15.72:0/3640650829 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9201003e0 0x7fc92019c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:29:04.063 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:04.058+0000 7fc91ffff640 1 -- 172.21.15.72:0/3640650829 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9201a0ea0 con 0x7fc9200ffa30 2024-03-30T15:29:04.063 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:04.058+0000 7fc91f7fe640 1 --2- 172.21.15.72:0/3640650829 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9201003e0 0x7fc92019c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T15:29:04.064 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:04.058+0000 7fc91ffff640 1 --2- 172.21.15.72:0/3640650829 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9200ffa30 0x7fc92019bef0 secure :-1 s=READY pgs=3294 cs=0 l=1 rev1=1 crypto rx=0x7fc9100a8020 tx=0x7fc9100ad6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:29:04.064 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:04.058+0000 7fc91d7fa640 1 -- 172.21.15.72:0/3640650829 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9100ba020 con 0x7fc9200ffa30 2024-03-30T15:29:04.064 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:04.058+0000 7fc91d7fa640 1 -- 172.21.15.72:0/3640650829 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7fc9100a5a60 con 0x7fc9200ffa30 2024-03-30T15:29:04.064 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:04.058+0000 7fc92699c640 1 -- 172.21.15.72:0/3640650829 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9201a1130 con 0x7fc9200ffa30 2024-03-30T15:29:04.064 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:04.058+0000 7fc91d7fa640 1 -- 172.21.15.72:0/3640650829 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9100b2040 con 0x7fc9200ffa30 2024-03-30T15:29:04.064 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:04.058+0000 7fc92699c640 1 -- 172.21.15.72:0/3640650829 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9201a15c0 con 0x7fc9200ffa30 2024-03-30T15:29:04.065 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:04.062+0000 7fc92699c640 1 -- 172.21.15.72:0/3640650829 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc920068a90 con 0x7fc9200ffa30 2024-03-30T15:29:04.065 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:04.062+0000 7fc91d7fa640 1 -- 172.21.15.72:0/3640650829 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 21) ==== 91831+0+0 (secure 0 0 0) 0x7fc9100bd020 con 0x7fc9200ffa30 2024-03-30T15:29:04.065 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:04.062+0000 7fc91d7fa640 1 --2- 172.21.15.72:0/3640650829 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fc90c06dbc0 0x7fc90c070080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:29:04.065 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:04.062+0000 7fc91d7fa640 1 -- 172.21.15.72:0/3640650829 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(792..792 src has 269..792) ==== 9484+0+0 (secure 0 0 0) 0x7fc910128ab0 con 0x7fc9200ffa30 2024-03-30T15:29:04.065 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:04.062+0000 7fc91f7fe640 1 --2- 172.21.15.72:0/3640650829 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fc90c06dbc0 0x7fc90c070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:29:04.065 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:04.062+0000 7fc91d7fa640 1 -- 172.21.15.72:0/3640650829 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=793}) -- 0x7fc90c079ef0 con 0x7fc9200ffa30 2024-03-30T15:29:04.065 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:04.062+0000 7fc91f7fe640 1 --2- 172.21.15.72:0/3640650829 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fc90c06dbc0 0x7fc90c070080 secure :-1 s=READY pgs=3246 cs=0 l=1 rev1=1 crypto rx=0x7fc9201029a0 tx=0x7fc90800b390 comp rx=0 tx=0).ready entity=mgr.14526 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:29:04.068 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:04.066+0000 7fc91d7fa640 1 -- 172.21.15.72:0/3640650829 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7fc9100c4020 con 0x7fc9200ffa30 2024-03-30T15:29:04.239 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:04.238+0000 7fc92699c640 1 -- 172.21.15.72:0/3640650829 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "0"} v 0) -- 0x7fc9201a8a70 con 0x7fc9200ffa30 2024-03-30T15:29:04.558 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:04.554+0000 7fc91d7fa640 1 -- 172.21.15.72:0/3640650829 <== mon.2 v2:172.21.15.72:3301/0 7 ==== osd_map(793..793 src has 269..793) ==== 628+0+0 (secure 0 0 0) 0x7fc9100f3250 con 0x7fc9200ffa30 2024-03-30T15:29:04.558 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:04.558+0000 7fc91d7fa640 1 -- 172.21.15.72:0/3640650829 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=794}) -- 0x7fc90c07aaa0 con 0x7fc9200ffa30 2024-03-30T15:29:04.564 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:04.562+0000 7fc91d7fa640 1 -- 172.21.15.72:0/3640650829 <== mon.2 v2:172.21.15.72:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 4e694c24-7f59-49ba-b14c-a8866b9195f4 v793) ==== 217+0+0 (secure 0 0 0) 0x7fc9100164f0 con 0x7fc9200ffa30 2024-03-30T15:29:04.672 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:04.670+0000 7fc92699c640 1 -- 172.21.15.72:0/3640650829 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "0"} v 0) -- 0x7fc920061de0 con 0x7fc9200ffa30 2024-03-30T15:29:04.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:04 smithi072 bash[21573]: audit 2024-03-30T15:29:04.243132+0000 mon.c (mon.2) 559 : audit 1 from='client.? 172.21.15.72:0/3640650829' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-30T15:29:04.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:04 smithi072 bash[21573]: audit 2024-03-30T15:29:04.243704+0000 mon.a (mon.0) 3765 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-30T15:29:04.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:04 smithi072 bash[28946]: audit 2024-03-30T15:29:04.243132+0000 mon.c (mon.2) 559 : audit 1 from='client.? 172.21.15.72:0/3640650829' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-30T15:29:04.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:04 smithi072 bash[28946]: audit 2024-03-30T15:29:04.243704+0000 mon.a (mon.0) 3765 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-30T15:29:04.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:04 smithi172 bash[23680]: audit 2024-03-30T15:29:04.243132+0000 mon.c (mon.2) 559 : audit 1 from='client.? 172.21.15.72:0/3640650829' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-30T15:29:04.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:04 smithi172 bash[23680]: audit 2024-03-30T15:29:04.243704+0000 mon.a (mon.0) 3765 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-30T15:29:05.560 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.558+0000 7fc91d7fa640 1 -- 172.21.15.72:0/3640650829 <== mon.2 v2:172.21.15.72:3301/0 9 ==== osd_map(794..794 src has 269..794) ==== 628+0+0 (secure 0 0 0) 0x7fc9101261b0 con 0x7fc9200ffa30 2024-03-30T15:29:05.560 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.558+0000 7fc91d7fa640 1 -- 172.21.15.72:0/3640650829 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=795}) -- 0x7fc90c07af10 con 0x7fc9200ffa30 2024-03-30T15:29:05.568 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.566+0000 7fc91d7fa640 1 -- 172.21.15.72:0/3640650829 <== mon.2 v2:172.21.15.72:3301/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 4e694c24-7f59-49ba-b14c-a8866b9195f4 v794) ==== 217+0+0 (secure 0 0 0) 0x7fc9100f58b0 con 0x7fc9200ffa30 2024-03-30T15:29:05.568 INFO:tasks.workunit.client.0.smithi072.stderr:set-quota max_bytes = 0 for pool 4e694c24-7f59-49ba-b14c-a8866b9195f4 2024-03-30T15:29:05.574 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.574+0000 7fc92699c640 1 -- 172.21.15.72:0/3640650829 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fc90c06dbc0 msgr2=0x7fc90c070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:29:05.574 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.574+0000 7fc92699c640 1 --2- 172.21.15.72:0/3640650829 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fc90c06dbc0 0x7fc90c070080 secure :-1 s=READY pgs=3246 cs=0 l=1 rev1=1 crypto rx=0x7fc9201029a0 tx=0x7fc90800b390 comp rx=0 tx=0).stop 2024-03-30T15:29:05.574 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.574+0000 7fc92699c640 1 -- 172.21.15.72:0/3640650829 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9200ffa30 msgr2=0x7fc92019bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:29:05.574 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.574+0000 7fc92699c640 1 --2- 172.21.15.72:0/3640650829 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9200ffa30 0x7fc92019bef0 secure :-1 s=READY pgs=3294 cs=0 l=1 rev1=1 crypto rx=0x7fc9100a8020 tx=0x7fc9100ad6f0 comp rx=0 tx=0).stop 2024-03-30T15:29:05.574 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.574+0000 7fc92699c640 1 -- 172.21.15.72:0/3640650829 shutdown_connections 2024-03-30T15:29:05.574 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.574+0000 7fc92699c640 1 --2- 172.21.15.72:0/3640650829 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc920109f50 0x7fc9201a07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:29:05.574 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.574+0000 7fc92699c640 1 --2- 172.21.15.72:0/3640650829 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7fc90c06dbc0 0x7fc90c070080 unknown :-1 s=CLOSED pgs=3246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:29:05.574 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.574+0000 7fc92699c640 1 --2- 172.21.15.72:0/3640650829 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9201003e0 0x7fc92019c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:29:05.574 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.574+0000 7fc92699c640 1 --2- 172.21.15.72:0/3640650829 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9200ffa30 0x7fc92019bef0 unknown :-1 s=CLOSED pgs=3294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:29:05.575 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.574+0000 7fc92699c640 1 -- 172.21.15.72:0/3640650829 >> 172.21.15.72:0/3640650829 conn(0x7fc920076710 msgr2=0x7fc920107a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:29:05.577 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.578+0000 7fc92699c640 1 -- 172.21.15.72:0/3640650829 shutdown_connections 2024-03-30T15:29:05.577 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.578+0000 7fc92699c640 1 -- 172.21.15.72:0/3640650829 wait complete. 2024-03-30T15:29:05.595 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph osd pool set-quota 4e694c24-7f59-49ba-b14c-a8866b9195f4 max_objects 0 2024-03-30T15:29:05.718 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.714+0000 7f241426c640 1 -- 172.21.15.72:0/2693182406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f240c101730 msgr2=0x7f240c10d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:29:05.718 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.714+0000 7f241426c640 1 --2- 172.21.15.72:0/2693182406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f240c101730 0x7f240c10d440 secure :-1 s=READY pgs=2420 cs=0 l=1 rev1=1 crypto rx=0x7f2404009c20 tx=0x7f240401ca80 comp rx=0 tx=0).stop 2024-03-30T15:29:05.718 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.714+0000 7f241426c640 1 -- 172.21.15.72:0/2693182406 shutdown_connections 2024-03-30T15:29:05.718 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.714+0000 7f241426c640 1 --2- 172.21.15.72:0/2693182406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f240c101730 0x7f240c10d440 unknown :-1 s=CLOSED pgs=2420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:29:05.718 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.714+0000 7f241426c640 1 --2- 172.21.15.72:0/2693182406 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f240c100d70 0x7f240c1011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:29:05.718 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.714+0000 7f241426c640 1 --2- 172.21.15.72:0/2693182406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f240c1055a0 0x7f240c105980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:29:05.718 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.714+0000 7f241426c640 1 -- 172.21.15.72:0/2693182406 >> 172.21.15.72:0/2693182406 conn(0x7f240c076b50 msgr2=0x7f240c0fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:29:05.718 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.714+0000 7f241426c640 1 -- 172.21.15.72:0/2693182406 shutdown_connections 2024-03-30T15:29:05.718 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.714+0000 7f241426c640 1 -- 172.21.15.72:0/2693182406 wait complete. 2024-03-30T15:29:05.719 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.714+0000 7f241426c640 1 Processor -- start 2024-03-30T15:29:05.719 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.714+0000 7f241426c640 1 -- start start 2024-03-30T15:29:05.719 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.714+0000 7f241426c640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f240c100d70 0x7f240c19f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:29:05.719 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.714+0000 7f241426c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f240c101730 0x7f240c19fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:29:05.719 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.714+0000 7f241426c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f240c1055a0 0x7f240c199ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:29:05.719 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.714+0000 7f241426c640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f240c112620 con 0x7f240c1055a0 2024-03-30T15:29:05.719 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.714+0000 7f241426c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f240c1124a0 con 0x7f240c101730 2024-03-30T15:29:05.719 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.714+0000 7f241426c640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f240c1127a0 con 0x7f240c100d70 2024-03-30T15:29:05.719 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.714+0000 7f2412008640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f240c100d70 0x7f240c19f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:29:05.719 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.714+0000 7f2412809640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f240c1055a0 0x7f240c199ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:29:05.719 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.714+0000 7f2412008640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f240c100d70 0x7f240c19f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:53152/0 (socket says 172.21.15.72:53152) 2024-03-30T15:29:05.719 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.714+0000 7f2412809640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f240c1055a0 0x7f240c199ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42674/0 (socket says 172.21.15.72:42674) 2024-03-30T15:29:05.719 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.714+0000 7f2412008640 1 -- 172.21.15.72:0/2800246200 learned_addr learned my addr 172.21.15.72:0/2800246200 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T15:29:05.720 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.714+0000 7f2411807640 1 --2- 172.21.15.72:0/2800246200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f240c101730 0x7f240c19fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:29:05.720 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.714+0000 7f2412008640 1 -- 172.21.15.72:0/2800246200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f240c101730 msgr2=0x7f240c19fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:29:05.720 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.714+0000 7f2412008640 1 --2- 172.21.15.72:0/2800246200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f240c101730 0x7f240c19fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:29:05.720 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.714+0000 7f2412008640 1 -- 172.21.15.72:0/2800246200 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f240c1055a0 msgr2=0x7f240c199ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:29:05.720 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.714+0000 7f2412008640 1 --2- 172.21.15.72:0/2800246200 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f240c1055a0 0x7f240c199ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:29:05.720 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.714+0000 7f2412008640 1 -- 172.21.15.72:0/2800246200 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f240c19a1f0 con 0x7f240c100d70 2024-03-30T15:29:05.720 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.714+0000 7f2411807640 1 --2- 172.21.15.72:0/2800246200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f240c101730 0x7f240c19fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T15:29:05.720 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.714+0000 7f2412809640 1 --2- 172.21.15.72:0/2800246200 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f240c1055a0 0x7f240c199ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T15:29:05.720 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.714+0000 7f2412008640 1 --2- 172.21.15.72:0/2800246200 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f240c100d70 0x7f240c19f900 secure :-1 s=READY pgs=3295 cs=0 l=1 rev1=1 crypto rx=0x7f240800b550 tx=0x7f240800ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:29:05.720 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.714+0000 7f24037fe640 1 -- 172.21.15.72:0/2800246200 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2408014070 con 0x7f240c100d70 2024-03-30T15:29:05.720 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.714+0000 7f24037fe640 1 -- 172.21.15.72:0/2800246200 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f2408010cf0 con 0x7f240c100d70 2024-03-30T15:29:05.720 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.714+0000 7f241426c640 1 -- 172.21.15.72:0/2800246200 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f240c19a4e0 con 0x7f240c100d70 2024-03-30T15:29:05.720 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.714+0000 7f24037fe640 1 -- 172.21.15.72:0/2800246200 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f240800fd00 con 0x7f240c100d70 2024-03-30T15:29:05.720 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.714+0000 7f241426c640 1 -- 172.21.15.72:0/2800246200 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f240c1a67d0 con 0x7f240c100d70 2024-03-30T15:29:05.721 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.718+0000 7f241426c640 1 -- 172.21.15.72:0/2800246200 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f240c067db0 con 0x7f240c100d70 2024-03-30T15:29:05.721 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.718+0000 7f24037fe640 1 -- 172.21.15.72:0/2800246200 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 21) ==== 91831+0+0 (secure 0 0 0) 0x7f2408017070 con 0x7f240c100d70 2024-03-30T15:29:05.722 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.718+0000 7f24037fe640 1 --2- 172.21.15.72:0/2800246200 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f23f806dbc0 0x7f23f8070080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:29:05.722 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.718+0000 7f24037fe640 1 -- 172.21.15.72:0/2800246200 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(794..794 src has 269..794) ==== 9484+0+0 (secure 0 0 0) 0x7f240808e310 con 0x7f240c100d70 2024-03-30T15:29:05.722 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.718+0000 7f2411807640 1 --2- 172.21.15.72:0/2800246200 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f23f806dbc0 0x7f23f8070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:29:05.722 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.718+0000 7f24037fe640 1 -- 172.21.15.72:0/2800246200 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=795}) -- 0x7f23f8079f50 con 0x7f240c100d70 2024-03-30T15:29:05.722 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.718+0000 7f2411807640 1 --2- 172.21.15.72:0/2800246200 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f23f806dbc0 0x7f23f8070080 secure :-1 s=READY pgs=3247 cs=0 l=1 rev1=1 crypto rx=0x7f240c0ff490 tx=0x7f23fc009260 comp rx=0 tx=0).ready entity=mgr.14526 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:29:05.725 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.726+0000 7f24037fe640 1 -- 172.21.15.72:0/2800246200 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f240805eb60 con 0x7f240c100d70 2024-03-30T15:29:05.896 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:05.894+0000 7f241426c640 1 -- 172.21.15.72:0/2800246200 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "0"} v 0) -- 0x7f240c19aff0 con 0x7f240c100d70 2024-03-30T15:29:05.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:05 smithi072 bash[28946]: cluster 2024-03-30T15:29:04.459163+0000 mgr.y (mgr.14526) 814 : cluster 0 pgmap v1339: 188 pgs: 188 active+clean; 863 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:29:05.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:05 smithi072 bash[28946]: audit 2024-03-30T15:29:04.557621+0000 mon.a (mon.0) 3766 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "0"}]': finished 2024-03-30T15:29:05.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:05 smithi072 bash[28946]: cluster 2024-03-30T15:29:04.565773+0000 mon.a (mon.0) 3767 : cluster 0 osdmap e793: 8 total, 8 up, 8 in 2024-03-30T15:29:05.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:05 smithi072 bash[28946]: audit 2024-03-30T15:29:04.676345+0000 mon.c (mon.2) 560 : audit 1 from='client.? 172.21.15.72:0/3640650829' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-30T15:29:05.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:05 smithi072 bash[28946]: audit 2024-03-30T15:29:04.676934+0000 mon.a (mon.0) 3768 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-30T15:29:05.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:05 smithi072 bash[21573]: cluster 2024-03-30T15:29:04.459163+0000 mgr.y (mgr.14526) 814 : cluster 0 pgmap v1339: 188 pgs: 188 active+clean; 863 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:29:05.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:05 smithi072 bash[21573]: audit 2024-03-30T15:29:04.557621+0000 mon.a (mon.0) 3766 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "0"}]': finished 2024-03-30T15:29:05.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:05 smithi072 bash[21573]: cluster 2024-03-30T15:29:04.565773+0000 mon.a (mon.0) 3767 : cluster 0 osdmap e793: 8 total, 8 up, 8 in 2024-03-30T15:29:05.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:05 smithi072 bash[21573]: audit 2024-03-30T15:29:04.676345+0000 mon.c (mon.2) 560 : audit 1 from='client.? 172.21.15.72:0/3640650829' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-30T15:29:05.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:05 smithi072 bash[21573]: audit 2024-03-30T15:29:04.676934+0000 mon.a (mon.0) 3768 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-30T15:29:05.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:05 smithi172 bash[23680]: cluster 2024-03-30T15:29:04.459163+0000 mgr.y (mgr.14526) 814 : cluster 0 pgmap v1339: 188 pgs: 188 active+clean; 863 KiB data, 824 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:29:05.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:05 smithi172 bash[23680]: audit 2024-03-30T15:29:04.557621+0000 mon.a (mon.0) 3766 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "0"}]': finished 2024-03-30T15:29:05.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:05 smithi172 bash[23680]: cluster 2024-03-30T15:29:04.565773+0000 mon.a (mon.0) 3767 : cluster 0 osdmap e793: 8 total, 8 up, 8 in 2024-03-30T15:29:05.970 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:05 smithi172 bash[23680]: audit 2024-03-30T15:29:04.676345+0000 mon.c (mon.2) 560 : audit 1 from='client.? 172.21.15.72:0/3640650829' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-30T15:29:05.970 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:05 smithi172 bash[23680]: audit 2024-03-30T15:29:04.676934+0000 mon.a (mon.0) 3768 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "0"}]: dispatch 2024-03-30T15:29:06.575 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:06.574+0000 7f24037fe640 1 -- 172.21.15.72:0/2800246200 <== mon.2 v2:172.21.15.72:3301/0 7 ==== osd_map(795..795 src has 269..795) ==== 628+0+0 (secure 0 0 0) 0x7f24080c2280 con 0x7f240c100d70 2024-03-30T15:29:06.575 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:06.574+0000 7f24037fe640 1 -- 172.21.15.72:0/2800246200 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=796}) -- 0x7f23f807ab00 con 0x7f240c100d70 2024-03-30T15:29:06.583 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:06.582+0000 7f24037fe640 1 -- 172.21.15.72:0/2800246200 <== mon.2 v2:172.21.15.72:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 4e694c24-7f59-49ba-b14c-a8866b9195f4 v795) ==== 221+0+0 (secure 0 0 0) 0x7f2408063390 con 0x7f240c100d70 2024-03-30T15:29:06.693 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:06.690+0000 7f241426c640 1 -- 172.21.15.72:0/2800246200 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "0"} v 0) -- 0x7f240c061de0 con 0x7f240c100d70 2024-03-30T15:29:06.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:06 smithi072 bash[21573]: audit 2024-03-30T15:29:05.560551+0000 mon.a (mon.0) 3769 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "0"}]': finished 2024-03-30T15:29:06.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:06 smithi072 bash[21573]: cluster 2024-03-30T15:29:05.568731+0000 mon.a (mon.0) 3770 : cluster 0 osdmap e794: 8 total, 8 up, 8 in 2024-03-30T15:29:06.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:06 smithi072 bash[21573]: audit 2024-03-30T15:29:05.900731+0000 mon.c (mon.2) 561 : audit 1 from='client.? 172.21.15.72:0/2800246200' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "0"}]: dispatch 2024-03-30T15:29:06.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:06 smithi072 bash[21573]: audit 2024-03-30T15:29:05.901342+0000 mon.a (mon.0) 3771 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "0"}]: dispatch 2024-03-30T15:29:06.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:06 smithi072 bash[28946]: audit 2024-03-30T15:29:05.560551+0000 mon.a (mon.0) 3769 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "0"}]': finished 2024-03-30T15:29:06.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:06 smithi072 bash[28946]: cluster 2024-03-30T15:29:05.568731+0000 mon.a (mon.0) 3770 : cluster 0 osdmap e794: 8 total, 8 up, 8 in 2024-03-30T15:29:06.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:06 smithi072 bash[28946]: audit 2024-03-30T15:29:05.900731+0000 mon.c (mon.2) 561 : audit 1 from='client.? 172.21.15.72:0/2800246200' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "0"}]: dispatch 2024-03-30T15:29:06.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:06 smithi072 bash[28946]: audit 2024-03-30T15:29:05.901342+0000 mon.a (mon.0) 3771 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "0"}]: dispatch 2024-03-30T15:29:06.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:06 smithi172 bash[23680]: audit 2024-03-30T15:29:05.560551+0000 mon.a (mon.0) 3769 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_bytes", "val": "0"}]': finished 2024-03-30T15:29:06.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:06 smithi172 bash[23680]: cluster 2024-03-30T15:29:05.568731+0000 mon.a (mon.0) 3770 : cluster 0 osdmap e794: 8 total, 8 up, 8 in 2024-03-30T15:29:06.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:06 smithi172 bash[23680]: audit 2024-03-30T15:29:05.900731+0000 mon.c (mon.2) 561 : audit 1 from='client.? 172.21.15.72:0/2800246200' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "0"}]: dispatch 2024-03-30T15:29:06.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:06 smithi172 bash[23680]: audit 2024-03-30T15:29:05.901342+0000 mon.a (mon.0) 3771 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "0"}]: dispatch 2024-03-30T15:29:07.602 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:07.601+0000 7f24037fe640 1 -- 172.21.15.72:0/2800246200 <== mon.2 v2:172.21.15.72:3301/0 9 ==== osd_map(796..796 src has 269..796) ==== 628+0+0 (secure 0 0 0) 0x7f2408058b60 con 0x7f240c100d70 2024-03-30T15:29:07.603 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:07.601+0000 7f24037fe640 1 -- 172.21.15.72:0/2800246200 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=797}) -- 0x7f23f807b100 con 0x7f240c100d70 2024-03-30T15:29:07.610 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:07.609+0000 7f24037fe640 1 -- 172.21.15.72:0/2800246200 <== mon.2 v2:172.21.15.72:3301/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 4e694c24-7f59-49ba-b14c-a8866b9195f4 v796) ==== 221+0+0 (secure 0 0 0) 0x7f240800f4c0 con 0x7f240c100d70 2024-03-30T15:29:07.610 INFO:tasks.workunit.client.0.smithi072.stderr:set-quota max_objects = 0 for pool 4e694c24-7f59-49ba-b14c-a8866b9195f4 2024-03-30T15:29:07.614 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:07.613+0000 7f241426c640 1 -- 172.21.15.72:0/2800246200 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f23f806dbc0 msgr2=0x7f23f8070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:29:07.614 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:07.613+0000 7f241426c640 1 --2- 172.21.15.72:0/2800246200 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f23f806dbc0 0x7f23f8070080 secure :-1 s=READY pgs=3247 cs=0 l=1 rev1=1 crypto rx=0x7f240c0ff490 tx=0x7f23fc009260 comp rx=0 tx=0).stop 2024-03-30T15:29:07.614 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:07.613+0000 7f241426c640 1 -- 172.21.15.72:0/2800246200 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f240c100d70 msgr2=0x7f240c19f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:29:07.614 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:07.613+0000 7f241426c640 1 --2- 172.21.15.72:0/2800246200 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f240c100d70 0x7f240c19f900 secure :-1 s=READY pgs=3295 cs=0 l=1 rev1=1 crypto rx=0x7f240800b550 tx=0x7f240800ba10 comp rx=0 tx=0).stop 2024-03-30T15:29:07.614 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:07.613+0000 7f241426c640 1 -- 172.21.15.72:0/2800246200 shutdown_connections 2024-03-30T15:29:07.614 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:07.613+0000 7f241426c640 1 --2- 172.21.15.72:0/2800246200 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f23f806dbc0 0x7f23f8070080 unknown :-1 s=CLOSED pgs=3247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:29:07.614 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:07.613+0000 7f241426c640 1 --2- 172.21.15.72:0/2800246200 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f240c1055a0 0x7f240c199ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:29:07.614 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:07.613+0000 7f241426c640 1 --2- 172.21.15.72:0/2800246200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f240c101730 0x7f240c19fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:29:07.615 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:07.613+0000 7f241426c640 1 --2- 172.21.15.72:0/2800246200 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f240c100d70 0x7f240c19f900 unknown :-1 s=CLOSED pgs=3295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:29:07.615 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:07.613+0000 7f241426c640 1 -- 172.21.15.72:0/2800246200 >> 172.21.15.72:0/2800246200 conn(0x7f240c076b50 msgr2=0x7f240c0ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:29:07.615 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:07.613+0000 7f241426c640 1 -- 172.21.15.72:0/2800246200 shutdown_connections 2024-03-30T15:29:07.615 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:07.613+0000 7f241426c640 1 -- 172.21.15.72:0/2800246200 wait complete. 2024-03-30T15:29:07.636 INFO:tasks.workunit.client.0.smithi072.stderr:+ sleep 30 2024-03-30T15:29:07.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:07 smithi072 bash[21573]: cluster 2024-03-30T15:29:06.461135+0000 mgr.y (mgr.14526) 815 : cluster 0 pgmap v1342: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 1 op/s 2024-03-30T15:29:07.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:07 smithi072 bash[21573]: audit 2024-03-30T15:29:06.575476+0000 mon.a (mon.0) 3772 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "0"}]': finished 2024-03-30T15:29:07.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:07 smithi072 bash[21573]: cluster 2024-03-30T15:29:06.583545+0000 mon.a (mon.0) 3773 : cluster 0 osdmap e795: 8 total, 8 up, 8 in 2024-03-30T15:29:07.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:07 smithi072 bash[21573]: audit 2024-03-30T15:29:06.695530+0000 mon.c (mon.2) 562 : audit 1 from='client.? 172.21.15.72:0/2800246200' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "0"}]: dispatch 2024-03-30T15:29:07.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:07 smithi072 bash[21573]: audit 2024-03-30T15:29:06.696325+0000 mon.a (mon.0) 3774 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "0"}]: dispatch 2024-03-30T15:29:07.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:07 smithi072 bash[28946]: cluster 2024-03-30T15:29:06.461135+0000 mgr.y (mgr.14526) 815 : cluster 0 pgmap v1342: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 1 op/s 2024-03-30T15:29:07.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:07 smithi072 bash[28946]: audit 2024-03-30T15:29:06.575476+0000 mon.a (mon.0) 3772 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "0"}]': finished 2024-03-30T15:29:07.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:07 smithi072 bash[28946]: cluster 2024-03-30T15:29:06.583545+0000 mon.a (mon.0) 3773 : cluster 0 osdmap e795: 8 total, 8 up, 8 in 2024-03-30T15:29:07.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:07 smithi072 bash[28946]: audit 2024-03-30T15:29:06.695530+0000 mon.c (mon.2) 562 : audit 1 from='client.? 172.21.15.72:0/2800246200' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "0"}]: dispatch 2024-03-30T15:29:07.921 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:07 smithi072 bash[28946]: audit 2024-03-30T15:29:06.696325+0000 mon.a (mon.0) 3774 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "0"}]: dispatch 2024-03-30T15:29:07.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:07 smithi172 bash[23680]: cluster 2024-03-30T15:29:06.461135+0000 mgr.y (mgr.14526) 815 : cluster 0 pgmap v1342: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 1 op/s 2024-03-30T15:29:07.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:07 smithi172 bash[23680]: audit 2024-03-30T15:29:06.575476+0000 mon.a (mon.0) 3772 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "0"}]': finished 2024-03-30T15:29:07.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:07 smithi172 bash[23680]: cluster 2024-03-30T15:29:06.583545+0000 mon.a (mon.0) 3773 : cluster 0 osdmap e795: 8 total, 8 up, 8 in 2024-03-30T15:29:07.970 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:07 smithi172 bash[23680]: audit 2024-03-30T15:29:06.695530+0000 mon.c (mon.2) 562 : audit 1 from='client.? 172.21.15.72:0/2800246200' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "0"}]: dispatch 2024-03-30T15:29:07.970 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:07 smithi172 bash[23680]: audit 2024-03-30T15:29:06.696325+0000 mon.a (mon.0) 3774 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "0"}]: dispatch 2024-03-30T15:29:08.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:08 smithi072 bash[21573]: audit 2024-03-30T15:29:07.603824+0000 mon.a (mon.0) 3775 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "0"}]': finished 2024-03-30T15:29:08.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:08 smithi072 bash[21573]: cluster 2024-03-30T15:29:07.612022+0000 mon.a (mon.0) 3776 : cluster 0 osdmap e796: 8 total, 8 up, 8 in 2024-03-30T15:29:08.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:08 smithi072 bash[21573]: audit 2024-03-30T15:29:07.948856+0000 mon.c (mon.2) 563 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:29:08.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:08 smithi072 bash[28946]: audit 2024-03-30T15:29:07.603824+0000 mon.a (mon.0) 3775 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "0"}]': finished 2024-03-30T15:29:08.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:08 smithi072 bash[28946]: cluster 2024-03-30T15:29:07.612022+0000 mon.a (mon.0) 3776 : cluster 0 osdmap e796: 8 total, 8 up, 8 in 2024-03-30T15:29:08.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:08 smithi072 bash[28946]: audit 2024-03-30T15:29:07.948856+0000 mon.c (mon.2) 563 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:29:08.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:08 smithi172 bash[23680]: audit 2024-03-30T15:29:07.603824+0000 mon.a (mon.0) 3775 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "field": "max_objects", "val": "0"}]': finished 2024-03-30T15:29:08.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:08 smithi172 bash[23680]: cluster 2024-03-30T15:29:07.612022+0000 mon.a (mon.0) 3776 : cluster 0 osdmap e796: 8 total, 8 up, 8 in 2024-03-30T15:29:08.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:08 smithi172 bash[23680]: audit 2024-03-30T15:29:07.948856+0000 mon.c (mon.2) 563 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:29:09.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:09 smithi072 bash[21573]: cluster 2024-03-30T15:29:08.461920+0000 mgr.y (mgr.14526) 816 : cluster 0 pgmap v1345: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.0 KiB/s wr, 1 op/s 2024-03-30T15:29:09.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:09 smithi072 bash[28946]: cluster 2024-03-30T15:29:08.461920+0000 mgr.y (mgr.14526) 816 : cluster 0 pgmap v1345: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.0 KiB/s wr, 1 op/s 2024-03-30T15:29:09.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:09 smithi172 bash[23680]: cluster 2024-03-30T15:29:08.461920+0000 mgr.y (mgr.14526) 816 : cluster 0 pgmap v1345: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.0 KiB/s wr, 1 op/s 2024-03-30T15:29:11.419 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:29:11 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:29:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:29:11.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:11 smithi072 bash[21573]: cluster 2024-03-30T15:29:10.462727+0000 mgr.y (mgr.14526) 817 : cluster 0 pgmap v1346: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 867 B/s rd, 2.0 KiB/s wr, 1 op/s 2024-03-30T15:29:11.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:11 smithi072 bash[28946]: cluster 2024-03-30T15:29:10.462727+0000 mgr.y (mgr.14526) 817 : cluster 0 pgmap v1346: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 867 B/s rd, 2.0 KiB/s wr, 1 op/s 2024-03-30T15:29:11.919 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:11 smithi172 bash[23680]: cluster 2024-03-30T15:29:10.462727+0000 mgr.y (mgr.14526) 817 : cluster 0 pgmap v1346: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 867 B/s rd, 2.0 KiB/s wr, 1 op/s 2024-03-30T15:29:12.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:29:11 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:29:13.719 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:13 smithi172 bash[23680]: audit 2024-03-30T15:29:11.921777+0000 mgr.y (mgr.14526) 818 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:29:13.719 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:13 smithi172 bash[23680]: cluster 2024-03-30T15:29:12.464816+0000 mgr.y (mgr.14526) 819 : cluster 0 pgmap v1347: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.7 KiB/s wr, 1 op/s 2024-03-30T15:29:13.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:13 smithi072 bash[21573]: audit 2024-03-30T15:29:11.921777+0000 mgr.y (mgr.14526) 818 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:29:13.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:13 smithi072 bash[21573]: cluster 2024-03-30T15:29:12.464816+0000 mgr.y (mgr.14526) 819 : cluster 0 pgmap v1347: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.7 KiB/s wr, 1 op/s 2024-03-30T15:29:13.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:13 smithi072 bash[28946]: audit 2024-03-30T15:29:11.921777+0000 mgr.y (mgr.14526) 818 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:29:13.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:13 smithi072 bash[28946]: cluster 2024-03-30T15:29:12.464816+0000 mgr.y (mgr.14526) 819 : cluster 0 pgmap v1347: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.7 KiB/s wr, 1 op/s 2024-03-30T15:29:15.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:15 smithi072 bash[21573]: cluster 2024-03-30T15:29:14.465617+0000 mgr.y (mgr.14526) 820 : cluster 0 pgmap v1348: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-30T15:29:15.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:15 smithi072 bash[28946]: cluster 2024-03-30T15:29:14.465617+0000 mgr.y (mgr.14526) 820 : cluster 0 pgmap v1348: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-30T15:29:15.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:15 smithi172 bash[23680]: cluster 2024-03-30T15:29:14.465617+0000 mgr.y (mgr.14526) 820 : cluster 0 pgmap v1348: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-30T15:29:17.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:17 smithi072 bash[21573]: cluster 2024-03-30T15:29:16.467565+0000 mgr.y (mgr.14526) 821 : cluster 0 pgmap v1349: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T15:29:17.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:17 smithi072 bash[28946]: cluster 2024-03-30T15:29:16.467565+0000 mgr.y (mgr.14526) 821 : cluster 0 pgmap v1349: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T15:29:17.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:17 smithi172 bash[23680]: cluster 2024-03-30T15:29:16.467565+0000 mgr.y (mgr.14526) 821 : cluster 0 pgmap v1349: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T15:29:19.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:19 smithi072 bash[21573]: cluster 2024-03-30T15:29:18.468354+0000 mgr.y (mgr.14526) 822 : cluster 0 pgmap v1350: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 942 B/s rd, 0 op/s 2024-03-30T15:29:19.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:19 smithi072 bash[28946]: cluster 2024-03-30T15:29:18.468354+0000 mgr.y (mgr.14526) 822 : cluster 0 pgmap v1350: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 942 B/s rd, 0 op/s 2024-03-30T15:29:19.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:19 smithi172 bash[23680]: cluster 2024-03-30T15:29:18.468354+0000 mgr.y (mgr.14526) 822 : cluster 0 pgmap v1350: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 942 B/s rd, 0 op/s 2024-03-30T15:29:21.419 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:29:21 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:29:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:29:21.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:21 smithi072 bash[21573]: cluster 2024-03-30T15:29:20.469320+0000 mgr.y (mgr.14526) 823 : cluster 0 pgmap v1351: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:29:21.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:21 smithi072 bash[28946]: cluster 2024-03-30T15:29:20.469320+0000 mgr.y (mgr.14526) 823 : cluster 0 pgmap v1351: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:29:21.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:21 smithi172 bash[23680]: cluster 2024-03-30T15:29:20.469320+0000 mgr.y (mgr.14526) 823 : cluster 0 pgmap v1351: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:29:22.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:29:21 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:29:23.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:23 smithi072 bash[21573]: audit 2024-03-30T15:29:21.930695+0000 mgr.y (mgr.14526) 824 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:29:23.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:23 smithi072 bash[21573]: cluster 2024-03-30T15:29:22.471246+0000 mgr.y (mgr.14526) 825 : cluster 0 pgmap v1352: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:29:23.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:23 smithi072 bash[21573]: audit 2024-03-30T15:29:22.981295+0000 mon.c (mon.2) 564 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:29:23.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:23 smithi072 bash[28946]: audit 2024-03-30T15:29:21.930695+0000 mgr.y (mgr.14526) 824 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:29:23.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:23 smithi072 bash[28946]: cluster 2024-03-30T15:29:22.471246+0000 mgr.y (mgr.14526) 825 : cluster 0 pgmap v1352: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:29:23.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:23 smithi072 bash[28946]: audit 2024-03-30T15:29:22.981295+0000 mon.c (mon.2) 564 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:29:23.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:23 smithi172 bash[23680]: audit 2024-03-30T15:29:21.930695+0000 mgr.y (mgr.14526) 824 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:29:23.970 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:23 smithi172 bash[23680]: cluster 2024-03-30T15:29:22.471246+0000 mgr.y (mgr.14526) 825 : cluster 0 pgmap v1352: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:29:23.970 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:23 smithi172 bash[23680]: audit 2024-03-30T15:29:22.981295+0000 mon.c (mon.2) 564 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:29:25.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:25 smithi072 bash[21573]: cluster 2024-03-30T15:29:24.472064+0000 mgr.y (mgr.14526) 826 : cluster 0 pgmap v1353: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:29:25.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:25 smithi072 bash[28946]: cluster 2024-03-30T15:29:24.472064+0000 mgr.y (mgr.14526) 826 : cluster 0 pgmap v1353: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:29:25.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:25 smithi172 bash[23680]: cluster 2024-03-30T15:29:24.472064+0000 mgr.y (mgr.14526) 826 : cluster 0 pgmap v1353: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:29:27.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:27 smithi072 bash[21573]: cluster 2024-03-30T15:29:26.473996+0000 mgr.y (mgr.14526) 827 : cluster 0 pgmap v1354: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:29:27.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:27 smithi072 bash[28946]: cluster 2024-03-30T15:29:26.473996+0000 mgr.y (mgr.14526) 827 : cluster 0 pgmap v1354: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:29:27.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:27 smithi172 bash[23680]: cluster 2024-03-30T15:29:26.473996+0000 mgr.y (mgr.14526) 827 : cluster 0 pgmap v1354: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:29:29.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:29 smithi072 bash[21573]: cluster 2024-03-30T15:29:28.474746+0000 mgr.y (mgr.14526) 828 : cluster 0 pgmap v1355: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:29:29.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:29 smithi072 bash[21573]: audit 2024-03-30T15:29:29.006578+0000 mon.c (mon.2) 565 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:29:29.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:29 smithi072 bash[28946]: cluster 2024-03-30T15:29:28.474746+0000 mgr.y (mgr.14526) 828 : cluster 0 pgmap v1355: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:29:29.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:29 smithi072 bash[28946]: audit 2024-03-30T15:29:29.006578+0000 mon.c (mon.2) 565 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:29:29.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:29 smithi172 bash[23680]: cluster 2024-03-30T15:29:28.474746+0000 mgr.y (mgr.14526) 828 : cluster 0 pgmap v1355: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:29:29.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:29 smithi172 bash[23680]: audit 2024-03-30T15:29:29.006578+0000 mon.c (mon.2) 565 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T15:29:30.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:30 smithi072 bash[21573]: audit 2024-03-30T15:29:29.744098+0000 mon.c (mon.2) 566 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:29:30.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:30 smithi072 bash[21573]: audit 2024-03-30T15:29:29.745762+0000 mon.c (mon.2) 567 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:29:30.919 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:30 smithi072 bash[21573]: audit 2024-03-30T15:29:29.754438+0000 mon.a (mon.0) 3777 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:29:30.919 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:30 smithi072 bash[28946]: audit 2024-03-30T15:29:29.744098+0000 mon.c (mon.2) 566 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:29:30.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:30 smithi072 bash[28946]: audit 2024-03-30T15:29:29.745762+0000 mon.c (mon.2) 567 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:29:30.920 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:30 smithi072 bash[28946]: audit 2024-03-30T15:29:29.754438+0000 mon.a (mon.0) 3777 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:29:30.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:30 smithi172 bash[23680]: audit 2024-03-30T15:29:29.744098+0000 mon.c (mon.2) 566 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T15:29:30.969 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:30 smithi172 bash[23680]: audit 2024-03-30T15:29:29.745762+0000 mon.c (mon.2) 567 : audit 1 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T15:29:30.970 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:30 smithi172 bash[23680]: audit 2024-03-30T15:29:29.754438+0000 mon.a (mon.0) 3777 : audit 1 from='mgr.14526 ' entity='mgr.y' 2024-03-30T15:29:31.419 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:29:31 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:29:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:29:32.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:31 smithi072 bash[21573]: cluster 2024-03-30T15:29:30.475531+0000 mgr.y (mgr.14526) 829 : cluster 0 pgmap v1356: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:29:32.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:31 smithi072 bash[28946]: cluster 2024-03-30T15:29:30.475531+0000 mgr.y (mgr.14526) 829 : cluster 0 pgmap v1356: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:29:32.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:29:31 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:29:32.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:31 smithi172 bash[23680]: cluster 2024-03-30T15:29:30.475531+0000 mgr.y (mgr.14526) 829 : cluster 0 pgmap v1356: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:29:34.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:33 smithi072 bash[21573]: audit 2024-03-30T15:29:31.933314+0000 mgr.y (mgr.14526) 830 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:29:34.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:33 smithi072 bash[21573]: cluster 2024-03-30T15:29:32.477545+0000 mgr.y (mgr.14526) 831 : cluster 0 pgmap v1357: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:29:34.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:33 smithi072 bash[28946]: audit 2024-03-30T15:29:31.933314+0000 mgr.y (mgr.14526) 830 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:29:34.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:33 smithi072 bash[28946]: cluster 2024-03-30T15:29:32.477545+0000 mgr.y (mgr.14526) 831 : cluster 0 pgmap v1357: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:29:34.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:33 smithi172 bash[23680]: audit 2024-03-30T15:29:31.933314+0000 mgr.y (mgr.14526) 830 : audit 0 from='client.24397 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T15:29:34.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:33 smithi172 bash[23680]: cluster 2024-03-30T15:29:32.477545+0000 mgr.y (mgr.14526) 831 : cluster 0 pgmap v1357: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:29:36.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:35 smithi072 bash[21573]: cluster 2024-03-30T15:29:34.478361+0000 mgr.y (mgr.14526) 832 : cluster 0 pgmap v1358: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:29:36.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:35 smithi072 bash[28946]: cluster 2024-03-30T15:29:34.478361+0000 mgr.y (mgr.14526) 832 : cluster 0 pgmap v1358: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:29:36.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:35 smithi172 bash[23680]: cluster 2024-03-30T15:29:34.478361+0000 mgr.y (mgr.14526) 832 : cluster 0 pgmap v1358: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:29:37.637 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph osd pool delete 4e694c24-7f59-49ba-b14c-a8866b9195f4 4e694c24-7f59-49ba-b14c-a8866b9195f4 --yes-i-really-really-mean-it 2024-03-30T15:29:37.767 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:37.765+0000 7f7f767bd640 1 -- 172.21.15.72:0/1402895918 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f7010bcc0 msgr2=0x7f7f7010e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:29:37.767 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:37.765+0000 7f7f767bd640 1 --2- 172.21.15.72:0/1402895918 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f7010bcc0 0x7f7f7010e160 secure :-1 s=READY pgs=3296 cs=0 l=1 rev1=1 crypto rx=0x7f7f68009cb0 tx=0x7f7f6801cd30 comp rx=0 tx=0).stop 2024-03-30T15:29:37.767 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:37.765+0000 7f7f767bd640 1 -- 172.21.15.72:0/1402895918 shutdown_connections 2024-03-30T15:29:37.767 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:37.765+0000 7f7f767bd640 1 --2- 172.21.15.72:0/1402895918 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f7010bcc0 0x7f7f7010e160 unknown :-1 s=CLOSED pgs=3296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:29:37.768 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:37.765+0000 7f7f767bd640 1 --2- 172.21.15.72:0/1402895918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f701031b0 0x7f7f7010b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:29:37.768 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:37.765+0000 7f7f767bd640 1 --2- 172.21.15.72:0/1402895918 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f70102890 0x7f7f70102c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:29:37.768 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:37.765+0000 7f7f767bd640 1 -- 172.21.15.72:0/1402895918 >> 172.21.15.72:0/1402895918 conn(0x7f7f700fc0c0 msgr2=0x7f7f700fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:29:37.768 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:37.765+0000 7f7f767bd640 1 -- 172.21.15.72:0/1402895918 shutdown_connections 2024-03-30T15:29:37.768 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:37.765+0000 7f7f767bd640 1 -- 172.21.15.72:0/1402895918 wait complete. 2024-03-30T15:29:37.768 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:37.765+0000 7f7f767bd640 1 Processor -- start 2024-03-30T15:29:37.768 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:37.765+0000 7f7f767bd640 1 -- start start 2024-03-30T15:29:37.769 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:37.765+0000 7f7f767bd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f70102890 0x7f7f7019f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:29:37.769 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:37.765+0000 7f7f767bd640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f701031b0 0x7f7f7019fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:29:37.769 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:37.765+0000 7f7f767bd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f7010bcc0 0x7f7f70199ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:29:37.770 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:37.765+0000 7f7f767bd640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7f70113700 con 0x7f7f7010bcc0 2024-03-30T15:29:37.770 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:37.765+0000 7f7f767bd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7f70113580 con 0x7f7f70102890 2024-03-30T15:29:37.770 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:37.765+0000 7f7f767bd640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f7f70113880 con 0x7f7f701031b0 2024-03-30T15:29:37.770 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:37.765+0000 7f7f6f7fe640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f701031b0 0x7f7f7019fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:29:37.770 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:37.765+0000 7f7f74d5a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f7010bcc0 0x7f7f70199ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:29:37.770 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:37.765+0000 7f7f6f7fe640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f701031b0 0x7f7f7019fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48750/0 (socket says 172.21.15.72:48750) 2024-03-30T15:29:37.770 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:37.765+0000 7f7f6f7fe640 1 -- 172.21.15.72:0/1224997040 learned_addr learned my addr 172.21.15.72:0/1224997040 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T15:29:37.770 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:37.765+0000 7f7f6ffff640 1 --2- 172.21.15.72:0/1224997040 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f70102890 0x7f7f7019f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:29:37.770 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:37.765+0000 7f7f6f7fe640 1 -- 172.21.15.72:0/1224997040 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f70102890 msgr2=0x7f7f7019f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:29:37.770 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:37.765+0000 7f7f6f7fe640 1 --2- 172.21.15.72:0/1224997040 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f70102890 0x7f7f7019f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:29:37.770 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:37.765+0000 7f7f6f7fe640 1 -- 172.21.15.72:0/1224997040 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f7010bcc0 msgr2=0x7f7f70199ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:29:37.770 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:37.765+0000 7f7f6f7fe640 1 --2- 172.21.15.72:0/1224997040 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f7010bcc0 0x7f7f70199ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:29:37.770 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:37.765+0000 7f7f6f7fe640 1 -- 172.21.15.72:0/1224997040 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f7019a1e0 con 0x7f7f701031b0 2024-03-30T15:29:37.770 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:37.765+0000 7f7f6f7fe640 1 --2- 172.21.15.72:0/1224997040 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f701031b0 0x7f7f7019fe30 secure :-1 s=READY pgs=3297 cs=0 l=1 rev1=1 crypto rx=0x7f7f6400c940 tx=0x7f7f6400ce00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:29:37.771 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:37.769+0000 7f7f6d7fa640 1 -- 172.21.15.72:0/1224997040 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f64004230 con 0x7f7f701031b0 2024-03-30T15:29:37.771 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:37.769+0000 7f7f6d7fa640 1 -- 172.21.15.72:0/1224997040 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f7f64007e30 con 0x7f7f701031b0 2024-03-30T15:29:37.771 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:37.769+0000 7f7f767bd640 1 -- 172.21.15.72:0/1224997040 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f7019a4d0 con 0x7f7f701031b0 2024-03-30T15:29:37.772 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:37.769+0000 7f7f6d7fa640 1 -- 172.21.15.72:0/1224997040 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f64003d80 con 0x7f7f701031b0 2024-03-30T15:29:37.772 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:37.769+0000 7f7f767bd640 1 -- 172.21.15.72:0/1224997040 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f70100420 con 0x7f7f701031b0 2024-03-30T15:29:37.772 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:37.769+0000 7f7f767bd640 1 -- 172.21.15.72:0/1224997040 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f70068a90 con 0x7f7f701031b0 2024-03-30T15:29:37.772 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:37.769+0000 7f7f6d7fa640 1 -- 172.21.15.72:0/1224997040 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 21) ==== 91831+0+0 (secure 0 0 0) 0x7f7f640079b0 con 0x7f7f701031b0 2024-03-30T15:29:37.773 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:37.769+0000 7f7f6d7fa640 1 --2- 172.21.15.72:0/1224997040 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f7f5806dbc0 0x7f7f58070080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:29:37.773 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:37.773+0000 7f7f6ffff640 1 --2- 172.21.15.72:0/1224997040 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f7f5806dbc0 0x7f7f58070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:29:37.773 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:37.773+0000 7f7f6d7fa640 1 -- 172.21.15.72:0/1224997040 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(796..796 src has 269..796) ==== 9484+0+0 (secure 0 0 0) 0x7f7f6408e460 con 0x7f7f701031b0 2024-03-30T15:29:37.774 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:37.773+0000 7f7f6d7fa640 1 -- 172.21.15.72:0/1224997040 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=797}) -- 0x7f7f58079f70 con 0x7f7f701031b0 2024-03-30T15:29:37.774 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:37.773+0000 7f7f6ffff640 1 --2- 172.21.15.72:0/1224997040 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f7f5806dbc0 0x7f7f58070080 secure :-1 s=READY pgs=3248 cs=0 l=1 rev1=1 crypto rx=0x7f7f7019abf0 tx=0x7f7f600091e0 comp rx=0 tx=0).ready entity=mgr.14526 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:29:37.778 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:37.777+0000 7f7f6d7fa640 1 -- 172.21.15.72:0/1224997040 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f7f64014070 con 0x7f7f701031b0 2024-03-30T15:29:37.948 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:37.945+0000 7f7f767bd640 1 -- 172.21.15.72:0/1224997040 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd pool delete", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "pool2": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7f70100680 con 0x7f7f701031b0 2024-03-30T15:29:38.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:37 smithi072 bash[21573]: cluster 2024-03-30T15:29:36.480476+0000 mgr.y (mgr.14526) 833 : cluster 0 pgmap v1359: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:29:38.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:37 smithi072 bash[28946]: cluster 2024-03-30T15:29:36.480476+0000 mgr.y (mgr.14526) 833 : cluster 0 pgmap v1359: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:29:38.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:37 smithi172 bash[23680]: cluster 2024-03-30T15:29:36.480476+0000 mgr.y (mgr.14526) 833 : cluster 0 pgmap v1359: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T15:29:38.783 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:38.781+0000 7f7f6d7fa640 1 -- 172.21.15.72:0/1224997040 <== mon.2 v2:172.21.15.72:3301/0 7 ==== osd_map(797..797 src has 269..797) ==== 296+0+0 (secure 0 0 0) 0x7f7f640c2280 con 0x7f7f701031b0 2024-03-30T15:29:38.784 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:38.781+0000 7f7f6d7fa640 1 -- 172.21.15.72:0/1224997040 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=798}) -- 0x7f7f5807a840 con 0x7f7f701031b0 2024-03-30T15:29:38.790 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:38.789+0000 7f7f6d7fa640 1 -- 172.21.15.72:0/1224997040 <== mon.2 v2:172.21.15.72:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "pool2": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "yes_i_really_really_mean_it": true}]=0 pool '4e694c24-7f59-49ba-b14c-a8866b9195f4' removed v797) ==== 248+0+0 (secure 0 0 0) 0x7f7f6405b2e0 con 0x7f7f701031b0 2024-03-30T15:29:38.902 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:38.901+0000 7f7f767bd640 1 -- 172.21.15.72:0/1224997040 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd pool delete", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "pool2": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7f70100900 con 0x7f7f701031b0 2024-03-30T15:29:38.903 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:38.901+0000 7f7f6d7fa640 1 -- 172.21.15.72:0/1224997040 <== mon.2 v2:172.21.15.72:3301/0 9 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "pool2": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "yes_i_really_really_mean_it": true}]=0 pool '4e694c24-7f59-49ba-b14c-a8866b9195f4' does not exist v797) ==== 255+0+0 (secure 0 0 0) 0x7f7f6405ed30 con 0x7f7f701031b0 2024-03-30T15:29:38.904 INFO:tasks.workunit.client.0.smithi072.stderr:pool '4e694c24-7f59-49ba-b14c-a8866b9195f4' does not exist 2024-03-30T15:29:38.906 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:38.905+0000 7f7f767bd640 1 -- 172.21.15.72:0/1224997040 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f7f5806dbc0 msgr2=0x7f7f58070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:29:38.906 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:38.905+0000 7f7f767bd640 1 --2- 172.21.15.72:0/1224997040 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f7f5806dbc0 0x7f7f58070080 secure :-1 s=READY pgs=3248 cs=0 l=1 rev1=1 crypto rx=0x7f7f7019abf0 tx=0x7f7f600091e0 comp rx=0 tx=0).stop 2024-03-30T15:29:38.906 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:38.905+0000 7f7f767bd640 1 -- 172.21.15.72:0/1224997040 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f701031b0 msgr2=0x7f7f7019fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:29:38.906 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:38.905+0000 7f7f767bd640 1 --2- 172.21.15.72:0/1224997040 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f701031b0 0x7f7f7019fe30 secure :-1 s=READY pgs=3297 cs=0 l=1 rev1=1 crypto rx=0x7f7f6400c940 tx=0x7f7f6400ce00 comp rx=0 tx=0).stop 2024-03-30T15:29:38.906 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:38.905+0000 7f7f767bd640 1 -- 172.21.15.72:0/1224997040 shutdown_connections 2024-03-30T15:29:38.906 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:38.905+0000 7f7f767bd640 1 --2- 172.21.15.72:0/1224997040 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f7f5806dbc0 0x7f7f58070080 unknown :-1 s=CLOSED pgs=3248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:29:38.907 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:38.905+0000 7f7f767bd640 1 --2- 172.21.15.72:0/1224997040 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f7010bcc0 0x7f7f70199ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:29:38.907 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:38.905+0000 7f7f767bd640 1 --2- 172.21.15.72:0/1224997040 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f701031b0 0x7f7f7019fe30 unknown :-1 s=CLOSED pgs=3297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:29:38.907 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:38.905+0000 7f7f767bd640 1 --2- 172.21.15.72:0/1224997040 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f70102890 0x7f7f7019f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:29:38.907 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:38.905+0000 7f7f767bd640 1 -- 172.21.15.72:0/1224997040 >> 172.21.15.72:0/1224997040 conn(0x7f7f700fc0c0 msgr2=0x7f7f7010d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:29:38.907 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:38.905+0000 7f7f767bd640 1 -- 172.21.15.72:0/1224997040 shutdown_connections 2024-03-30T15:29:38.907 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:38.905+0000 7f7f767bd640 1 -- 172.21.15.72:0/1224997040 wait complete. 2024-03-30T15:29:38.921 INFO:tasks.workunit.client.0.smithi072.stderr:+ ceph osd pool delete f4a77c40-1619-47cc-9a4a-97c81ff0ea60 f4a77c40-1619-47cc-9a4a-97c81ff0ea60 --yes-i-really-really-mean-it 2024-03-30T15:29:39.041 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.037+0000 7f0e74f83640 1 -- 172.21.15.72:0/1035322019 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0e701031b0 msgr2=0x7f0e7010b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:29:39.041 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.037+0000 7f0e74f83640 1 --2- 172.21.15.72:0/1035322019 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0e701031b0 0x7f0e7010b6a0 secure :-1 s=READY pgs=3298 cs=0 l=1 rev1=1 crypto rx=0x7f0e58009930 tx=0x7f0e5801c870 comp rx=0 tx=0).stop 2024-03-30T15:29:39.041 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.037+0000 7f0e74f83640 1 -- 172.21.15.72:0/1035322019 shutdown_connections 2024-03-30T15:29:39.042 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.037+0000 7f0e74f83640 1 --2- 172.21.15.72:0/1035322019 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e7010bcc0 0x7f0e7010e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:29:39.042 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.037+0000 7f0e74f83640 1 --2- 172.21.15.72:0/1035322019 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0e701031b0 0x7f0e7010b6a0 unknown :-1 s=CLOSED pgs=3298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:29:39.042 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.037+0000 7f0e74f83640 1 --2- 172.21.15.72:0/1035322019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e70102890 0x7f0e70102c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:29:39.042 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.037+0000 7f0e74f83640 1 -- 172.21.15.72:0/1035322019 >> 172.21.15.72:0/1035322019 conn(0x7f0e700fc0c0 msgr2=0x7f0e700fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:29:39.042 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.037+0000 7f0e74f83640 1 -- 172.21.15.72:0/1035322019 shutdown_connections 2024-03-30T15:29:39.042 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.037+0000 7f0e74f83640 1 -- 172.21.15.72:0/1035322019 wait complete. 2024-03-30T15:29:39.042 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.037+0000 7f0e74f83640 1 Processor -- start 2024-03-30T15:29:39.042 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.037+0000 7f0e74f83640 1 -- start start 2024-03-30T15:29:39.042 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.037+0000 7f0e74f83640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e70102890 0x7f0e70199da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:29:39.042 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.037+0000 7f0e74f83640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0e701031b0 0x7f0e7019a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:29:39.042 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.037+0000 7f0e74f83640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e7010bcc0 0x7f0e7019e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:29:39.042 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.037+0000 7f0e74f83640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0e70113740 con 0x7f0e70102890 2024-03-30T15:29:39.042 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.037+0000 7f0e74f83640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0e701135c0 con 0x7f0e7010bcc0 2024-03-30T15:29:39.042 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.037+0000 7f0e74f83640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f0e701138c0 con 0x7f0e701031b0 2024-03-30T15:29:39.043 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.037+0000 7f0e6e59c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e70102890 0x7f0e70199da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:29:39.043 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.037+0000 7f0e65d9b640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0e701031b0 0x7f0e7019a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:29:39.043 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.037+0000 7f0e65d9b640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0e701031b0 0x7f0e7019a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48766/0 (socket says 172.21.15.72:48766) 2024-03-30T15:29:39.043 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.037+0000 7f0e65d9b640 1 -- 172.21.15.72:0/2643086766 learned_addr learned my addr 172.21.15.72:0/2643086766 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-30T15:29:39.043 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.037+0000 7f0e6e59c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e70102890 0x7f0e70199da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35002/0 (socket says 172.21.15.72:35002) 2024-03-30T15:29:39.043 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.037+0000 7f0e6ed9d640 1 --2- 172.21.15.72:0/2643086766 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e7010bcc0 0x7f0e7019e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:29:39.043 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.037+0000 7f0e65d9b640 1 -- 172.21.15.72:0/2643086766 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e7010bcc0 msgr2=0x7f0e7019e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:29:39.043 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.037+0000 7f0e65d9b640 1 --2- 172.21.15.72:0/2643086766 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e7010bcc0 0x7f0e7019e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:29:39.043 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.037+0000 7f0e65d9b640 1 -- 172.21.15.72:0/2643086766 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e70102890 msgr2=0x7f0e70199da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:29:39.043 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.037+0000 7f0e65d9b640 1 --2- 172.21.15.72:0/2643086766 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e70102890 0x7f0e70199da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:29:39.043 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.037+0000 7f0e65d9b640 1 -- 172.21.15.72:0/2643086766 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e7019ed50 con 0x7f0e701031b0 2024-03-30T15:29:39.043 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.037+0000 7f0e6e59c640 1 --2- 172.21.15.72:0/2643086766 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e70102890 0x7f0e70199da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T15:29:39.043 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.037+0000 7f0e65d9b640 1 --2- 172.21.15.72:0/2643086766 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0e701031b0 0x7f0e7019a2e0 secure :-1 s=READY pgs=3299 cs=0 l=1 rev1=1 crypto rx=0x7f0e5801cde0 tx=0x7f0e58004430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:29:39.043 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.037+0000 7f0e67fff640 1 -- 172.21.15.72:0/2643086766 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e580bc020 con 0x7f0e701031b0 2024-03-30T15:29:39.043 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.037+0000 7f0e67fff640 1 -- 172.21.15.72:0/2643086766 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(24 keys) ==== 1042+0+0 (secure 0 0 0) 0x7f0e580ad440 con 0x7f0e701031b0 2024-03-30T15:29:39.044 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.037+0000 7f0e74f83640 1 -- 172.21.15.72:0/2643086766 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e7019efe0 con 0x7f0e701031b0 2024-03-30T15:29:39.044 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.037+0000 7f0e67fff640 1 -- 172.21.15.72:0/2643086766 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e580b2040 con 0x7f0e701031b0 2024-03-30T15:29:39.044 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.037+0000 7f0e74f83640 1 -- 172.21.15.72:0/2643086766 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e701a6920 con 0x7f0e701031b0 2024-03-30T15:29:39.045 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.041+0000 7f0e74f83640 1 -- 172.21.15.72:0/2643086766 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e70069370 con 0x7f0e701031b0 2024-03-30T15:29:39.045 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.041+0000 7f0e67fff640 1 -- 172.21.15.72:0/2643086766 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 21) ==== 91831+0+0 (secure 0 0 0) 0x7f0e580bf070 con 0x7f0e701031b0 2024-03-30T15:29:39.045 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.041+0000 7f0e67fff640 1 --2- 172.21.15.72:0/2643086766 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f0e5c06dbc0 0x7f0e5c070080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T15:29:39.045 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.041+0000 7f0e67fff640 1 -- 172.21.15.72:0/2643086766 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(797..797 src has 269..797) ==== 9096+0+0 (secure 0 0 0) 0x7f0e581285c0 con 0x7f0e701031b0 2024-03-30T15:29:39.045 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.041+0000 7f0e6e59c640 1 --2- 172.21.15.72:0/2643086766 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f0e5c06dbc0 0x7f0e5c070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T15:29:39.045 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.041+0000 7f0e67fff640 1 -- 172.21.15.72:0/2643086766 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=798}) -- 0x7f0e5c0796d0 con 0x7f0e701031b0 2024-03-30T15:29:39.045 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.041+0000 7f0e6e59c640 1 --2- 172.21.15.72:0/2643086766 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f0e5c06dbc0 0x7f0e5c070080 secure :-1 s=READY pgs=3249 cs=0 l=1 rev1=1 crypto rx=0x7f0e60009d60 tx=0x7f0e60009110 comp rx=0 tx=0).ready entity=mgr.14526 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T15:29:39.047 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.045+0000 7f0e67fff640 1 -- 172.21.15.72:0/2643086766 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184932 (secure 0 0 0) 0x7f0e580c6080 con 0x7f0e701031b0 2024-03-30T15:29:39.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:38 smithi072 bash[21573]: audit 2024-03-30T15:29:37.951789+0000 mon.c (mon.2) 568 : audit 1 from='client.? 172.21.15.72:0/1224997040' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "pool2": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-30T15:29:39.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:38 smithi072 bash[21573]: audit 2024-03-30T15:29:37.952510+0000 mon.a (mon.0) 3778 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "pool2": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-30T15:29:39.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:38 smithi072 bash[21573]: audit 2024-03-30T15:29:38.013609+0000 mon.c (mon.2) 569 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:29:39.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:38 smithi072 bash[28946]: audit 2024-03-30T15:29:37.951789+0000 mon.c (mon.2) 568 : audit 1 from='client.? 172.21.15.72:0/1224997040' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "pool2": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-30T15:29:39.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:38 smithi072 bash[28946]: audit 2024-03-30T15:29:37.952510+0000 mon.a (mon.0) 3778 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "pool2": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-30T15:29:39.169 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:38 smithi072 bash[28946]: audit 2024-03-30T15:29:38.013609+0000 mon.c (mon.2) 569 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:29:39.217 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.213+0000 7f0e74f83640 1 -- 172.21.15.72:0/2643086766 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd pool delete", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "pool2": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0e7019b100 con 0x7f0e701031b0 2024-03-30T15:29:39.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:38 smithi172 bash[23680]: audit 2024-03-30T15:29:37.951789+0000 mon.c (mon.2) 568 : audit 1 from='client.? 172.21.15.72:0/1224997040' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "pool2": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-30T15:29:39.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:38 smithi172 bash[23680]: audit 2024-03-30T15:29:37.952510+0000 mon.a (mon.0) 3778 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "pool2": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-30T15:29:39.219 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:38 smithi172 bash[23680]: audit 2024-03-30T15:29:38.013609+0000 mon.c (mon.2) 569 : audit 0 from='mgr.14526 172.21.15.72:0/1335289398' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T15:29:39.786 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.785+0000 7f0e67fff640 1 -- 172.21.15.72:0/2643086766 <== mon.2 v2:172.21.15.72:3301/0 7 ==== osd_map(798..798 src has 269..798) ==== 296+0+0 (secure 0 0 0) 0x7f0e580f2f60 con 0x7f0e701031b0 2024-03-30T15:29:39.786 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.785+0000 7f0e67fff640 1 -- 172.21.15.72:0/2643086766 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=799}) -- 0x7f0e5c079f90 con 0x7f0e701031b0 2024-03-30T15:29:39.791 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.789+0000 7f0e67fff640 1 -- 172.21.15.72:0/2643086766 <== mon.2 v2:172.21.15.72:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "pool2": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "yes_i_really_really_mean_it": true}]=0 pool 'f4a77c40-1619-47cc-9a4a-97c81ff0ea60' removed v798) ==== 248+0+0 (secure 0 0 0) 0x7f0e580164f0 con 0x7f0e701031b0 2024-03-30T15:29:39.902 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.901+0000 7f0e74f83640 1 -- 172.21.15.72:0/2643086766 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd pool delete", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "pool2": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0e701a6af0 con 0x7f0e701031b0 2024-03-30T15:29:39.904 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.901+0000 7f0e67fff640 1 -- 172.21.15.72:0/2643086766 <== mon.2 v2:172.21.15.72:3301/0 9 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "pool2": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "yes_i_really_really_mean_it": true}]=0 pool 'f4a77c40-1619-47cc-9a4a-97c81ff0ea60' does not exist v798) ==== 255+0+0 (secure 0 0 0) 0x7f0e580164f0 con 0x7f0e701031b0 2024-03-30T15:29:39.904 INFO:tasks.workunit.client.0.smithi072.stderr:pool 'f4a77c40-1619-47cc-9a4a-97c81ff0ea60' does not exist 2024-03-30T15:29:39.907 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.905+0000 7f0e74f83640 1 -- 172.21.15.72:0/2643086766 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f0e5c06dbc0 msgr2=0x7f0e5c070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:29:39.907 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.905+0000 7f0e74f83640 1 --2- 172.21.15.72:0/2643086766 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f0e5c06dbc0 0x7f0e5c070080 secure :-1 s=READY pgs=3249 cs=0 l=1 rev1=1 crypto rx=0x7f0e60009d60 tx=0x7f0e60009110 comp rx=0 tx=0).stop 2024-03-30T15:29:39.907 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.905+0000 7f0e74f83640 1 -- 172.21.15.72:0/2643086766 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0e701031b0 msgr2=0x7f0e7019a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T15:29:39.907 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.905+0000 7f0e74f83640 1 --2- 172.21.15.72:0/2643086766 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0e701031b0 0x7f0e7019a2e0 secure :-1 s=READY pgs=3299 cs=0 l=1 rev1=1 crypto rx=0x7f0e5801cde0 tx=0x7f0e58004430 comp rx=0 tx=0).stop 2024-03-30T15:29:39.907 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.905+0000 7f0e74f83640 1 -- 172.21.15.72:0/2643086766 shutdown_connections 2024-03-30T15:29:39.907 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.905+0000 7f0e74f83640 1 --2- 172.21.15.72:0/2643086766 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e7010bcc0 0x7f0e7019e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:29:39.907 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.905+0000 7f0e74f83640 1 --2- 172.21.15.72:0/2643086766 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0e701031b0 0x7f0e7019a2e0 unknown :-1 s=CLOSED pgs=3299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:29:39.907 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.905+0000 7f0e74f83640 1 --2- 172.21.15.72:0/2643086766 >> [v2:172.21.15.72:6800/2033000132,v1:172.21.15.72:6801/2033000132] conn(0x7f0e5c06dbc0 0x7f0e5c070080 unknown :-1 s=CLOSED pgs=3249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:29:39.907 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.905+0000 7f0e74f83640 1 --2- 172.21.15.72:0/2643086766 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e70102890 0x7f0e70199da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T15:29:39.907 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.905+0000 7f0e74f83640 1 -- 172.21.15.72:0/2643086766 >> 172.21.15.72:0/2643086766 conn(0x7f0e700fc0c0 msgr2=0x7f0e70103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T15:29:39.907 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.905+0000 7f0e74f83640 1 -- 172.21.15.72:0/2643086766 shutdown_connections 2024-03-30T15:29:39.907 INFO:tasks.workunit.client.0.smithi072.stderr:2024-03-30T15:29:39.905+0000 7f0e74f83640 1 -- 172.21.15.72:0/2643086766 wait complete. 2024-03-30T15:29:39.921 INFO:tasks.workunit.client.0.smithi072.stderr:+ echo OK 2024-03-30T15:29:39.921 INFO:tasks.workunit.client.0.smithi072.stdout:OK 2024-03-30T15:29:39.922 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-30T15:29:39.922 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-30T15:29:39.976 INFO:tasks.workunit:Stopping ['rados/test.sh', 'rados/test_pool_quota.sh'] on client.0... 2024-03-30T15:29:39.977 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-30T15:29:40.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:39 smithi072 bash[21573]: cluster 2024-03-30T15:29:38.481283+0000 mgr.y (mgr.14526) 834 : cluster 0 pgmap v1360: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:29:40.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:39 smithi072 bash[21573]: audit 2024-03-30T15:29:38.782926+0000 mon.a (mon.0) 3779 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "pool2": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "yes_i_really_really_mean_it": true}]': finished 2024-03-30T15:29:40.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:39 smithi072 bash[21573]: cluster 2024-03-30T15:29:38.793145+0000 mon.a (mon.0) 3780 : cluster 0 osdmap e797: 8 total, 8 up, 8 in 2024-03-30T15:29:40.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:39 smithi072 bash[21573]: audit 2024-03-30T15:29:38.906039+0000 mon.c (mon.2) 570 : audit 1 from='client.? 172.21.15.72:0/1224997040' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "pool2": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-30T15:29:40.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:39 smithi072 bash[21573]: audit 2024-03-30T15:29:38.906763+0000 mon.a (mon.0) 3781 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "pool2": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-30T15:29:40.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:39 smithi072 bash[21573]: audit 2024-03-30T15:29:39.221071+0000 mon.c (mon.2) 571 : audit 1 from='client.? 172.21.15.72:0/2643086766' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "pool2": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-30T15:29:40.169 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:39 smithi072 bash[21573]: audit 2024-03-30T15:29:39.221873+0000 mon.a (mon.0) 3782 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "pool2": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-30T15:29:40.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:39 smithi072 bash[28946]: cluster 2024-03-30T15:29:38.481283+0000 mgr.y (mgr.14526) 834 : cluster 0 pgmap v1360: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:29:40.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:39 smithi072 bash[28946]: audit 2024-03-30T15:29:38.782926+0000 mon.a (mon.0) 3779 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "pool2": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "yes_i_really_really_mean_it": true}]': finished 2024-03-30T15:29:40.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:39 smithi072 bash[28946]: cluster 2024-03-30T15:29:38.793145+0000 mon.a (mon.0) 3780 : cluster 0 osdmap e797: 8 total, 8 up, 8 in 2024-03-30T15:29:40.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:39 smithi072 bash[28946]: audit 2024-03-30T15:29:38.906039+0000 mon.c (mon.2) 570 : audit 1 from='client.? 172.21.15.72:0/1224997040' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "pool2": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-30T15:29:40.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:39 smithi072 bash[28946]: audit 2024-03-30T15:29:38.906763+0000 mon.a (mon.0) 3781 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "pool2": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-30T15:29:40.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:39 smithi072 bash[28946]: audit 2024-03-30T15:29:39.221071+0000 mon.c (mon.2) 571 : audit 1 from='client.? 172.21.15.72:0/2643086766' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "pool2": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-30T15:29:40.170 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:39 smithi072 bash[28946]: audit 2024-03-30T15:29:39.221873+0000 mon.a (mon.0) 3782 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "pool2": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-30T15:29:40.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:39 smithi172 bash[23680]: cluster 2024-03-30T15:29:38.481283+0000 mgr.y (mgr.14526) 834 : cluster 0 pgmap v1360: 188 pgs: 188 active+clean; 875 KiB data, 825 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T15:29:40.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:39 smithi172 bash[23680]: audit 2024-03-30T15:29:38.782926+0000 mon.a (mon.0) 3779 : audit 1 from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "pool2": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "yes_i_really_really_mean_it": true}]': finished 2024-03-30T15:29:40.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:39 smithi172 bash[23680]: cluster 2024-03-30T15:29:38.793145+0000 mon.a (mon.0) 3780 : cluster 0 osdmap e797: 8 total, 8 up, 8 in 2024-03-30T15:29:40.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:39 smithi172 bash[23680]: audit 2024-03-30T15:29:38.906039+0000 mon.c (mon.2) 570 : audit 1 from='client.? 172.21.15.72:0/1224997040' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "pool2": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-30T15:29:40.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:39 smithi172 bash[23680]: audit 2024-03-30T15:29:38.906763+0000 mon.a (mon.0) 3781 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "pool2": "4e694c24-7f59-49ba-b14c-a8866b9195f4", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-30T15:29:40.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:39 smithi172 bash[23680]: audit 2024-03-30T15:29:39.221071+0000 mon.c (mon.2) 571 : audit 1 from='client.? 172.21.15.72:0/2643086766' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "pool2": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-30T15:29:40.220 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:39 smithi172 bash[23680]: audit 2024-03-30T15:29:39.221873+0000 mon.a (mon.0) 3782 : audit 1 from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "pool2": "f4a77c40-1619-47cc-9a4a-97c81ff0ea60", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-30T15:29:40.301 DEBUG:teuthology.parallel:result is None 2024-03-30T15:29:40.302 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-03-30T15:29:40.315 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-03-30T15:29:40.315 DEBUG:teuthology.orchestra.run.smithi072:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-03-30T15:29:40.371 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-03-30T15:29:40.371 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-03-30T15:29:40.381 INFO:tasks.cephadm:Teardown begin 2024-03-30T15:29:40.381 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-30T15:29:40.428 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-30T15:29:40.443 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-03-30T15:29:40.443 DEBUG:teuthology.orchestra.run.smithi072:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-03-30T15:29:40.477 DEBUG:teuthology.orchestra.run.smithi172:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-03-30T15:29:40.491 INFO:tasks.cephadm:Stopping all daemons... 2024-03-30T15:29:40.492 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-03-30T15:29:40.492 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@mon.a 2024-03-30T15:29:40.669 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:40 smithi072 systemd[1]: Stopping Ceph mon.a for 97f8e564-eea5-11ee-b647-cb9ed24678a4... 2024-03-30T15:29:40.874 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:40 smithi072 bash[21573]: debug 2024-03-30T15:29:40.709+0000 7fbe5b778700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-03-30T15:29:40.874 INFO:journalctl@ceph.mon.a.smithi072.stdout:Mar 30 15:29:40 smithi072 bash[21573]: debug 2024-03-30T15:29:40.709+0000 7fbe5b778700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-03-30T15:29:41.169 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:29:41 smithi072 bash[21828]: ::ffff:172.21.15.172 - - [30/Mar/2024:15:29:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-03-30T15:29:41.469 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:29:41 smithi172 bash[50795]: logger=cleanup t=2024-03-30T15:29:41.157360422Z level=info msg="Completed cleanup jobs" duration=55.84171ms 2024-03-30T15:29:42.003 DEBUG:teuthology.orchestra.run.smithi072:> sudo pkill -f 'journalctl -f -n 0 -u ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@mon.a.service' 2024-03-30T15:29:42.030 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-30T15:29:42.031 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-03-30T15:29:42.031 INFO:tasks.cephadm.mon.b:Stopping mon.c... 2024-03-30T15:29:42.031 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@mon.c 2024-03-30T15:29:42.219 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:29:41 smithi172 bash[47790]: debug there is no tcmu-runner data available 2024-03-30T15:29:42.259 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:29:42 smithi072 bash[21828]: [30/Mar/2024:15:29:42] ENGINE Bus STOPPING 2024-03-30T15:29:42.260 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:42 smithi072 systemd[1]: Stopping Ceph mon.c for 97f8e564-eea5-11ee-b647-cb9ed24678a4... 2024-03-30T15:29:42.260 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:42 smithi072 bash[28946]: debug 2024-03-30T15:29:42.225+0000 7ff05185f700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-03-30T15:29:42.260 INFO:journalctl@ceph.mon.c.smithi072.stdout:Mar 30 15:29:42 smithi072 bash[28946]: debug 2024-03-30T15:29:42.225+0000 7ff05185f700 -1 mon.c@2(peon) e3 *** Got Signal Terminated *** 2024-03-30T15:29:42.362 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:29:42 smithi072 bash[21828]: [30/Mar/2024:15:29:42] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-30T15:29:42.362 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:29:42 smithi072 bash[21828]: [30/Mar/2024:15:29:42] ENGINE Bus STOPPED 2024-03-30T15:29:42.362 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:29:42 smithi072 bash[21828]: [30/Mar/2024:15:29:42] ENGINE Bus STARTING 2024-03-30T15:29:42.362 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:29:42 smithi072 bash[21828]: [30/Mar/2024:15:29:42] ENGINE Serving on http://:::9283 2024-03-30T15:29:42.669 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:29:42 smithi072 bash[21828]: [30/Mar/2024:15:29:42] ENGINE Bus STARTED 2024-03-30T15:29:43.367 DEBUG:teuthology.orchestra.run.smithi072:> sudo pkill -f 'journalctl -f -n 0 -u ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@mon.c.service' 2024-03-30T15:29:43.392 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-30T15:29:43.392 INFO:tasks.cephadm.mon.b:Stopped mon.c 2024-03-30T15:29:43.392 INFO:tasks.cephadm.mon.b:Stopping mon.b... 2024-03-30T15:29:43.392 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@mon.b 2024-03-30T15:29:43.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:43 smithi172 systemd[1]: Stopping Ceph mon.b for 97f8e564-eea5-11ee-b647-cb9ed24678a4... 2024-03-30T15:29:43.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:43 smithi172 bash[23680]: debug 2024-03-30T15:29:43.543+0000 7f17a3ee0700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-03-30T15:29:43.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:Mar 30 15:29:43 smithi172 bash[23680]: debug 2024-03-30T15:29:43.543+0000 7f17a3ee0700 -1 mon.b@1(peon) e3 *** Got Signal Terminated *** 2024-03-30T15:29:44.538 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@mon.b.service' 2024-03-30T15:29:44.569 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-30T15:29:44.569 INFO:tasks.cephadm.mon.b:Stopped mon.b 2024-03-30T15:29:44.569 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-03-30T15:29:44.569 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@mgr.y 2024-03-30T15:29:44.919 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:29:44 smithi072 systemd[1]: Stopping Ceph mgr.y for 97f8e564-eea5-11ee-b647-cb9ed24678a4... 2024-03-30T15:29:44.919 INFO:journalctl@ceph.mgr.y.smithi072.stdout:Mar 30 15:29:44 smithi072 bash[21828]: debug 2024-03-30T15:29:44.709+0000 7f1745030700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mgr -n mgr.y -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-03-30T15:29:45.667 DEBUG:teuthology.orchestra.run.smithi072:> sudo pkill -f 'journalctl -f -n 0 -u ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@mgr.y.service' 2024-03-30T15:29:45.690 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-30T15:29:45.690 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-03-30T15:29:45.690 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-03-30T15:29:45.690 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@mgr.x 2024-03-30T15:29:45.969 INFO:journalctl@ceph.mgr.x.smithi172.stdout:Mar 30 15:29:45 smithi172 systemd[1]: Stopping Ceph mgr.x for 97f8e564-eea5-11ee-b647-cb9ed24678a4... 2024-03-30T15:29:46.707 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@mgr.x.service' 2024-03-30T15:29:46.731 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-30T15:29:46.732 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-03-30T15:29:46.732 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-03-30T15:29:46.732 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@osd.0 2024-03-30T15:29:47.169 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 30 15:29:46 smithi072 systemd[1]: Stopping Ceph osd.0 for 97f8e564-eea5-11ee-b647-cb9ed24678a4... 2024-03-30T15:29:47.169 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 30 15:29:46 smithi072 bash[31967]: debug 2024-03-30T15:29:46.877+0000 7f15b2a93700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-03-30T15:29:47.169 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 30 15:29:46 smithi072 bash[31967]: debug 2024-03-30T15:29:46.877+0000 7f15b2a93700 -1 osd.0 798 *** Got signal Terminated *** 2024-03-30T15:29:47.169 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 30 15:29:46 smithi072 bash[31967]: debug 2024-03-30T15:29:46.877+0000 7f15b2a93700 -1 osd.0 798 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-30T15:29:53.303 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 30 15:29:53 smithi072 bash[133226]: ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4-osd-0 2024-03-30T15:29:53.303 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 30 15:29:53 smithi072 bash[133290]: Error response from daemon: No such container: ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4-osd-0 2024-03-30T15:29:55.547 DEBUG:teuthology.orchestra.run.smithi072:> sudo pkill -f 'journalctl -f -n 0 -u ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@osd.0.service' 2024-03-30T15:29:55.577 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-30T15:29:55.578 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-03-30T15:29:55.578 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-03-30T15:29:55.578 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@osd.1 2024-03-30T15:29:55.919 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 30 15:29:55 smithi072 systemd[1]: Stopping Ceph osd.1 for 97f8e564-eea5-11ee-b647-cb9ed24678a4... 2024-03-30T15:29:55.919 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 30 15:29:55 smithi072 bash[37707]: debug 2024-03-30T15:29:55.741+0000 7f6d58ed8700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-03-30T15:29:55.919 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 30 15:29:55 smithi072 bash[37707]: debug 2024-03-30T15:29:55.741+0000 7f6d58ed8700 -1 osd.1 798 *** Got signal Terminated *** 2024-03-30T15:29:55.919 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 30 15:29:55 smithi072 bash[37707]: debug 2024-03-30T15:29:55.741+0000 7f6d58ed8700 -1 osd.1 798 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-30T15:30:02.215 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 30 15:30:01 smithi072 bash[133425]: ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4-osd-1 2024-03-30T15:30:02.215 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 30 15:30:02 smithi072 bash[133487]: Error response from daemon: No such container: ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4-osd-1 2024-03-30T15:30:04.134 DEBUG:teuthology.orchestra.run.smithi072:> sudo pkill -f 'journalctl -f -n 0 -u ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@osd.1.service' 2024-03-30T15:30:04.159 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-30T15:30:04.159 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-03-30T15:30:04.159 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-03-30T15:30:04.159 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@osd.2 2024-03-30T15:30:04.419 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 30 15:30:04 smithi072 systemd[1]: Stopping Ceph osd.2 for 97f8e564-eea5-11ee-b647-cb9ed24678a4... 2024-03-30T15:30:04.419 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 30 15:30:04 smithi072 bash[43232]: debug 2024-03-30T15:30:04.340+0000 7efe51759700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-03-30T15:30:04.419 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 30 15:30:04 smithi072 bash[43232]: debug 2024-03-30T15:30:04.340+0000 7efe51759700 -1 osd.2 798 *** Got signal Terminated *** 2024-03-30T15:30:04.419 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 30 15:30:04 smithi072 bash[43232]: debug 2024-03-30T15:30:04.340+0000 7efe51759700 -1 osd.2 798 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-30T15:30:10.919 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 30 15:30:10 smithi072 bash[133621]: ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4-osd-2 2024-03-30T15:30:10.919 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 30 15:30:10 smithi072 bash[133684]: Error response from daemon: No such container: ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4-osd-2 2024-03-30T15:30:12.620 DEBUG:teuthology.orchestra.run.smithi072:> sudo pkill -f 'journalctl -f -n 0 -u ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@osd.2.service' 2024-03-30T15:30:12.648 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-30T15:30:12.648 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-03-30T15:30:12.648 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-03-30T15:30:12.648 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@osd.3 2024-03-30T15:30:12.919 INFO:journalctl@ceph.osd.3.smithi072.stdout:Mar 30 15:30:12 smithi072 systemd[1]: Stopping Ceph osd.3 for 97f8e564-eea5-11ee-b647-cb9ed24678a4... 2024-03-30T15:30:12.919 INFO:journalctl@ceph.osd.3.smithi072.stdout:Mar 30 15:30:12 smithi072 bash[48729]: debug 2024-03-30T15:30:12.824+0000 7f0e90a6e700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-03-30T15:30:12.919 INFO:journalctl@ceph.osd.3.smithi072.stdout:Mar 30 15:30:12 smithi072 bash[48729]: debug 2024-03-30T15:30:12.824+0000 7f0e90a6e700 -1 osd.3 798 *** Got signal Terminated *** 2024-03-30T15:30:12.919 INFO:journalctl@ceph.osd.3.smithi072.stdout:Mar 30 15:30:12 smithi072 bash[48729]: debug 2024-03-30T15:30:12.824+0000 7f0e90a6e700 -1 osd.3 798 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-30T15:30:13.470 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:12 smithi172 bash[38096]: debug 2024-03-30T15:30:12.990+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.313455+0000 front 2024-03-30T15:29:50.313329+0000 (oldest deadline 2024-03-30T15:30:12.613462+0000) 2024-03-30T15:30:13.919 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:30:13 smithi072 bash[59916]: ts=2024-03-30T15:30:13.583Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi072.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.72:8443: connect: connection refused" 2024-03-30T15:30:13.919 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:30:13 smithi072 bash[59916]: ts=2024-03-30T15:30:13.585Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi172.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.172:8443: connect: connection refused" 2024-03-30T15:30:14.220 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:13 smithi172 bash[38096]: debug 2024-03-30T15:30:13.954+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.313455+0000 front 2024-03-30T15:29:50.313329+0000 (oldest deadline 2024-03-30T15:30:12.613462+0000) 2024-03-30T15:30:14.970 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:30:14 smithi172 bash[32737]: debug 2024-03-30T15:30:14.490+0000 7f6fce406700 -1 osd.5 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:51.356620+0000 front 2024-03-30T15:29:51.356651+0000 (oldest deadline 2024-03-30T15:30:13.656135+0000) 2024-03-30T15:30:15.419 INFO:journalctl@ceph.osd.3.smithi072.stdout:Mar 30 15:30:14 smithi072 bash[48729]: debug 2024-03-30T15:30:14.932+0000 7f0e8905a700 -1 osd.3 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:49.496764+0000 front 2024-03-30T15:29:49.496964+0000 (oldest deadline 2024-03-30T15:30:14.797088+0000) 2024-03-30T15:30:15.470 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:15 smithi172 bash[38096]: debug 2024-03-30T15:30:14.998+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.313455+0000 front 2024-03-30T15:29:50.313329+0000 (oldest deadline 2024-03-30T15:30:12.613462+0000) 2024-03-30T15:30:15.470 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:15 smithi172 bash[43622]: debug 2024-03-30T15:30:15.126+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.612104+0000 front 2024-03-30T15:29:50.612074+0000 (oldest deadline 2024-03-30T15:30:14.711797+0000) 2024-03-30T15:30:15.970 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:30:15 smithi172 bash[32737]: debug 2024-03-30T15:30:15.542+0000 7f6fce406700 -1 osd.5 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:51.356620+0000 front 2024-03-30T15:29:51.356651+0000 (oldest deadline 2024-03-30T15:30:13.656135+0000) 2024-03-30T15:30:15.970 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 30 15:30:15 smithi172 bash[27186]: debug 2024-03-30T15:30:15.494+0000 7f3e4c449700 -1 osd.4 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.780656+0000 front 2024-03-30T15:29:50.780292+0000 (oldest deadline 2024-03-30T15:30:14.880310+0000) 2024-03-30T15:30:16.419 INFO:journalctl@ceph.osd.3.smithi072.stdout:Mar 30 15:30:15 smithi072 bash[48729]: debug 2024-03-30T15:30:15.948+0000 7f0e8905a700 -1 osd.3 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:49.496764+0000 front 2024-03-30T15:29:49.496964+0000 (oldest deadline 2024-03-30T15:30:14.797088+0000) 2024-03-30T15:30:16.464 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:16 smithi172 bash[38096]: debug 2024-03-30T15:30:16.042+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.313455+0000 front 2024-03-30T15:29:50.313329+0000 (oldest deadline 2024-03-30T15:30:12.613462+0000) 2024-03-30T15:30:16.464 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:16 smithi172 bash[43622]: debug 2024-03-30T15:30:16.146+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.612104+0000 front 2024-03-30T15:29:50.612074+0000 (oldest deadline 2024-03-30T15:30:14.711797+0000) 2024-03-30T15:30:16.720 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 30 15:30:16 smithi172 bash[27186]: debug 2024-03-30T15:30:16.462+0000 7f3e4c449700 -1 osd.4 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.780656+0000 front 2024-03-30T15:29:50.780292+0000 (oldest deadline 2024-03-30T15:30:14.880310+0000) 2024-03-30T15:30:16.720 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:30:16 smithi172 bash[32737]: debug 2024-03-30T15:30:16.542+0000 7f6fce406700 -1 osd.5 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:51.356620+0000 front 2024-03-30T15:29:51.356651+0000 (oldest deadline 2024-03-30T15:30:13.656135+0000) 2024-03-30T15:30:17.169 INFO:journalctl@ceph.osd.3.smithi072.stdout:Mar 30 15:30:16 smithi072 bash[48729]: debug 2024-03-30T15:30:16.904+0000 7f0e8905a700 -1 osd.3 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:49.496764+0000 front 2024-03-30T15:29:49.496964+0000 (oldest deadline 2024-03-30T15:30:14.797088+0000) 2024-03-30T15:30:17.454 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:17 smithi172 bash[38096]: debug 2024-03-30T15:30:17.018+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.313455+0000 front 2024-03-30T15:29:50.313329+0000 (oldest deadline 2024-03-30T15:30:12.613462+0000) 2024-03-30T15:30:17.455 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:17 smithi172 bash[43622]: debug 2024-03-30T15:30:17.186+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.612104+0000 front 2024-03-30T15:29:50.612074+0000 (oldest deadline 2024-03-30T15:30:14.711797+0000) 2024-03-30T15:30:17.720 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 30 15:30:17 smithi172 bash[27186]: debug 2024-03-30T15:30:17.454+0000 7f3e4c449700 -1 osd.4 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.780656+0000 front 2024-03-30T15:29:50.780292+0000 (oldest deadline 2024-03-30T15:30:14.880310+0000) 2024-03-30T15:30:17.720 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:30:17 smithi172 bash[32737]: debug 2024-03-30T15:30:17.530+0000 7f6fce406700 -1 osd.5 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:51.356620+0000 front 2024-03-30T15:29:51.356651+0000 (oldest deadline 2024-03-30T15:30:13.656135+0000) 2024-03-30T15:30:18.441 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:18 smithi172 bash[38096]: debug 2024-03-30T15:30:18.006+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.313455+0000 front 2024-03-30T15:29:50.313329+0000 (oldest deadline 2024-03-30T15:30:12.613462+0000) 2024-03-30T15:30:18.441 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:18 smithi172 bash[43622]: debug 2024-03-30T15:30:18.198+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.612104+0000 front 2024-03-30T15:29:50.612074+0000 (oldest deadline 2024-03-30T15:30:14.711797+0000) 2024-03-30T15:30:18.720 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 30 15:30:18 smithi172 bash[27186]: debug 2024-03-30T15:30:18.442+0000 7f3e4c449700 -1 osd.4 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.780656+0000 front 2024-03-30T15:29:50.780292+0000 (oldest deadline 2024-03-30T15:30:14.880310+0000) 2024-03-30T15:30:18.720 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:30:18 smithi172 bash[32737]: debug 2024-03-30T15:30:18.570+0000 7f6fce406700 -1 osd.5 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:51.356620+0000 front 2024-03-30T15:29:51.356651+0000 (oldest deadline 2024-03-30T15:30:13.656135+0000) 2024-03-30T15:30:19.419 INFO:journalctl@ceph.osd.3.smithi072.stdout:Mar 30 15:30:18 smithi072 bash[133817]: ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4-osd-3 2024-03-30T15:30:19.419 INFO:journalctl@ceph.osd.3.smithi072.stdout:Mar 30 15:30:19 smithi072 bash[133881]: Error response from daemon: No such container: ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4-osd-3 2024-03-30T15:30:19.443 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:19 smithi172 bash[38096]: debug 2024-03-30T15:30:19.014+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.313455+0000 front 2024-03-30T15:29:50.313329+0000 (oldest deadline 2024-03-30T15:30:12.613462+0000) 2024-03-30T15:30:19.443 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:19 smithi172 bash[43622]: debug 2024-03-30T15:30:19.210+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.612104+0000 front 2024-03-30T15:29:50.612074+0000 (oldest deadline 2024-03-30T15:30:14.711797+0000) 2024-03-30T15:30:19.720 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 30 15:30:19 smithi172 bash[27186]: debug 2024-03-30T15:30:19.438+0000 7f3e4c449700 -1 osd.4 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.780656+0000 front 2024-03-30T15:29:50.780292+0000 (oldest deadline 2024-03-30T15:30:14.880310+0000) 2024-03-30T15:30:19.720 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:30:19 smithi172 bash[32737]: debug 2024-03-30T15:30:19.562+0000 7f6fce406700 -1 osd.5 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:51.356620+0000 front 2024-03-30T15:29:51.356651+0000 (oldest deadline 2024-03-30T15:30:13.656135+0000) 2024-03-30T15:30:20.228 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:19 smithi172 bash[38096]: debug 2024-03-30T15:30:19.970+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.313455+0000 front 2024-03-30T15:29:50.313329+0000 (oldest deadline 2024-03-30T15:30:12.613462+0000) 2024-03-30T15:30:20.554 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 30 15:30:20 smithi172 bash[27186]: debug 2024-03-30T15:30:20.426+0000 7f3e4c449700 -1 osd.4 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.780656+0000 front 2024-03-30T15:29:50.780292+0000 (oldest deadline 2024-03-30T15:30:14.880310+0000) 2024-03-30T15:30:20.555 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:20 smithi172 bash[43622]: debug 2024-03-30T15:30:20.226+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.612104+0000 front 2024-03-30T15:29:50.612074+0000 (oldest deadline 2024-03-30T15:30:14.711797+0000) 2024-03-30T15:30:20.970 DEBUG:teuthology.orchestra.run.smithi072:> sudo pkill -f 'journalctl -f -n 0 -u ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@osd.3.service' 2024-03-30T15:30:20.971 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:30:20 smithi172 bash[32737]: debug 2024-03-30T15:30:20.554+0000 7f6fce406700 -1 osd.5 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:51.356620+0000 front 2024-03-30T15:29:51.356651+0000 (oldest deadline 2024-03-30T15:30:13.656135+0000) 2024-03-30T15:30:20.996 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-30T15:30:20.996 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-03-30T15:30:20.997 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-03-30T15:30:20.997 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@osd.4 2024-03-30T15:30:21.391 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:21 smithi172 bash[38096]: debug 2024-03-30T15:30:21.006+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.313455+0000 front 2024-03-30T15:29:50.313329+0000 (oldest deadline 2024-03-30T15:30:12.613462+0000) 2024-03-30T15:30:21.391 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:21 smithi172 bash[43622]: debug 2024-03-30T15:30:21.198+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.612104+0000 front 2024-03-30T15:29:50.612074+0000 (oldest deadline 2024-03-30T15:30:14.711797+0000) 2024-03-30T15:30:21.391 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 30 15:30:21 smithi172 systemd[1]: Stopping Ceph osd.4 for 97f8e564-eea5-11ee-b647-cb9ed24678a4... 2024-03-30T15:30:21.391 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 30 15:30:21 smithi172 bash[27186]: debug 2024-03-30T15:30:21.162+0000 7f3e53e5d700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-03-30T15:30:21.391 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 30 15:30:21 smithi172 bash[27186]: debug 2024-03-30T15:30:21.162+0000 7f3e53e5d700 -1 osd.4 798 *** Got signal Terminated *** 2024-03-30T15:30:21.391 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 30 15:30:21 smithi172 bash[27186]: debug 2024-03-30T15:30:21.162+0000 7f3e53e5d700 -1 osd.4 798 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-30T15:30:21.391 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 30 15:30:21 smithi172 bash[27186]: debug 2024-03-30T15:30:21.386+0000 7f3e4c449700 -1 osd.4 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.780656+0000 front 2024-03-30T15:29:50.780292+0000 (oldest deadline 2024-03-30T15:30:14.880310+0000) 2024-03-30T15:30:21.720 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:30:21 smithi172 bash[32737]: debug 2024-03-30T15:30:21.522+0000 7f6fce406700 -1 osd.5 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:51.356620+0000 front 2024-03-30T15:29:51.356651+0000 (oldest deadline 2024-03-30T15:30:13.656135+0000) 2024-03-30T15:30:22.253 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:21 smithi172 bash[38096]: debug 2024-03-30T15:30:21.978+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.313455+0000 front 2024-03-30T15:29:50.313329+0000 (oldest deadline 2024-03-30T15:30:12.613462+0000) 2024-03-30T15:30:22.253 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:21 smithi172 bash[38096]: debug 2024-03-30T15:30:21.978+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:30:00.116157+0000 front 2024-03-30T15:30:00.116572+0000 (oldest deadline 2024-03-30T15:30:21.816284+0000) 2024-03-30T15:30:22.537 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 30 15:30:22 smithi172 bash[27186]: debug 2024-03-30T15:30:22.406+0000 7f3e4c449700 -1 osd.4 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.780656+0000 front 2024-03-30T15:29:50.780292+0000 (oldest deadline 2024-03-30T15:30:14.880310+0000) 2024-03-30T15:30:22.538 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:22 smithi172 bash[43622]: debug 2024-03-30T15:30:22.250+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.612104+0000 front 2024-03-30T15:29:50.612074+0000 (oldest deadline 2024-03-30T15:30:14.711797+0000) 2024-03-30T15:30:22.970 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:30:22 smithi172 bash[32737]: debug 2024-03-30T15:30:22.534+0000 7f6fce406700 -1 osd.5 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:51.356620+0000 front 2024-03-30T15:29:51.356651+0000 (oldest deadline 2024-03-30T15:30:13.656135+0000) 2024-03-30T15:30:22.970 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:30:22 smithi172 bash[32737]: debug 2024-03-30T15:30:22.534+0000 7f6fce406700 -1 osd.5 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:29:57.757664+0000 front 2024-03-30T15:29:57.757791+0000 (oldest deadline 2024-03-30T15:30:22.457639+0000) 2024-03-30T15:30:23.272 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:23 smithi172 bash[38096]: debug 2024-03-30T15:30:23.010+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.313455+0000 front 2024-03-30T15:29:50.313329+0000 (oldest deadline 2024-03-30T15:30:12.613462+0000) 2024-03-30T15:30:23.272 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:23 smithi172 bash[38096]: debug 2024-03-30T15:30:23.010+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:30:00.116157+0000 front 2024-03-30T15:30:00.116572+0000 (oldest deadline 2024-03-30T15:30:21.816284+0000) 2024-03-30T15:30:23.569 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 30 15:30:23 smithi172 bash[27186]: debug 2024-03-30T15:30:23.458+0000 7f3e4c449700 -1 osd.4 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.780656+0000 front 2024-03-30T15:29:50.780292+0000 (oldest deadline 2024-03-30T15:30:14.880310+0000) 2024-03-30T15:30:23.569 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:23 smithi172 bash[43622]: debug 2024-03-30T15:30:23.270+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.612104+0000 front 2024-03-30T15:29:50.612074+0000 (oldest deadline 2024-03-30T15:30:14.711797+0000) 2024-03-30T15:30:23.569 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:23 smithi172 bash[43622]: debug 2024-03-30T15:30:23.270+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:29:57.013706+0000 front 2024-03-30T15:29:57.013420+0000 (oldest deadline 2024-03-30T15:30:22.313431+0000) 2024-03-30T15:30:23.919 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:30:23 smithi072 bash[59916]: ts=2024-03-30T15:30:23.583Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://smithi072.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.72:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://smithi172.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.172:8443: connect: connection refused" 2024-03-30T15:30:23.919 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:30:23 smithi072 bash[59916]: ts=2024-03-30T15:30:23.584Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi072.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.72:8443: connect: connection refused" 2024-03-30T15:30:23.919 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:30:23 smithi072 bash[59916]: ts=2024-03-30T15:30:23.586Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi172.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.172:8443: connect: connection refused" 2024-03-30T15:30:23.970 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:30:23 smithi172 bash[32737]: debug 2024-03-30T15:30:23.570+0000 7f6fce406700 -1 osd.5 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:51.356620+0000 front 2024-03-30T15:29:51.356651+0000 (oldest deadline 2024-03-30T15:30:13.656135+0000) 2024-03-30T15:30:23.970 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:30:23 smithi172 bash[32737]: debug 2024-03-30T15:30:23.570+0000 7f6fce406700 -1 osd.5 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:29:57.757664+0000 front 2024-03-30T15:29:57.757791+0000 (oldest deadline 2024-03-30T15:30:22.457639+0000) 2024-03-30T15:30:24.274 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:23 smithi172 bash[38096]: debug 2024-03-30T15:30:23.978+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.313455+0000 front 2024-03-30T15:29:50.313329+0000 (oldest deadline 2024-03-30T15:30:12.613462+0000) 2024-03-30T15:30:24.274 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:23 smithi172 bash[38096]: debug 2024-03-30T15:30:23.978+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:30:00.116157+0000 front 2024-03-30T15:30:00.116572+0000 (oldest deadline 2024-03-30T15:30:21.816284+0000) 2024-03-30T15:30:24.551 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 30 15:30:24 smithi172 bash[27186]: debug 2024-03-30T15:30:24.458+0000 7f3e4c449700 -1 osd.4 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.780656+0000 front 2024-03-30T15:29:50.780292+0000 (oldest deadline 2024-03-30T15:30:14.880310+0000) 2024-03-30T15:30:24.551 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:24 smithi172 bash[43622]: debug 2024-03-30T15:30:24.274+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.612104+0000 front 2024-03-30T15:29:50.612074+0000 (oldest deadline 2024-03-30T15:30:14.711797+0000) 2024-03-30T15:30:24.551 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:24 smithi172 bash[43622]: debug 2024-03-30T15:30:24.274+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:29:57.013706+0000 front 2024-03-30T15:29:57.013420+0000 (oldest deadline 2024-03-30T15:30:22.313431+0000) 2024-03-30T15:30:24.970 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:30:24 smithi172 bash[32737]: debug 2024-03-30T15:30:24.546+0000 7f6fce406700 -1 osd.5 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:51.356620+0000 front 2024-03-30T15:29:51.356651+0000 (oldest deadline 2024-03-30T15:30:13.656135+0000) 2024-03-30T15:30:24.970 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:30:24 smithi172 bash[32737]: debug 2024-03-30T15:30:24.546+0000 7f6fce406700 -1 osd.5 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:29:57.757664+0000 front 2024-03-30T15:29:57.757791+0000 (oldest deadline 2024-03-30T15:30:22.457639+0000) 2024-03-30T15:30:25.296 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:25 smithi172 bash[38096]: debug 2024-03-30T15:30:25.030+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.313455+0000 front 2024-03-30T15:29:50.313329+0000 (oldest deadline 2024-03-30T15:30:12.613462+0000) 2024-03-30T15:30:25.296 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:25 smithi172 bash[38096]: debug 2024-03-30T15:30:25.030+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:30:00.116157+0000 front 2024-03-30T15:30:00.116572+0000 (oldest deadline 2024-03-30T15:30:21.816284+0000) 2024-03-30T15:30:25.557 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 30 15:30:25 smithi172 bash[27186]: debug 2024-03-30T15:30:25.466+0000 7f3e4c449700 -1 osd.4 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.780656+0000 front 2024-03-30T15:29:50.780292+0000 (oldest deadline 2024-03-30T15:30:14.880310+0000) 2024-03-30T15:30:25.557 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 30 15:30:25 smithi172 bash[27186]: debug 2024-03-30T15:30:25.466+0000 7f3e4c449700 -1 osd.4 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:30:00.082424+0000 front 2024-03-30T15:30:00.082378+0000 (oldest deadline 2024-03-30T15:30:25.382278+0000) 2024-03-30T15:30:25.557 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:25 smithi172 bash[43622]: debug 2024-03-30T15:30:25.294+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.612104+0000 front 2024-03-30T15:29:50.612074+0000 (oldest deadline 2024-03-30T15:30:14.711797+0000) 2024-03-30T15:30:25.557 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:25 smithi172 bash[43622]: debug 2024-03-30T15:30:25.294+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:29:57.013706+0000 front 2024-03-30T15:29:57.013420+0000 (oldest deadline 2024-03-30T15:30:22.313431+0000) 2024-03-30T15:30:25.970 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:30:25 smithi172 bash[32737]: debug 2024-03-30T15:30:25.554+0000 7f6fce406700 -1 osd.5 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:51.356620+0000 front 2024-03-30T15:29:51.356651+0000 (oldest deadline 2024-03-30T15:30:13.656135+0000) 2024-03-30T15:30:25.970 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:30:25 smithi172 bash[32737]: debug 2024-03-30T15:30:25.554+0000 7f6fce406700 -1 osd.5 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:29:57.757664+0000 front 2024-03-30T15:29:57.757791+0000 (oldest deadline 2024-03-30T15:30:22.457639+0000) 2024-03-30T15:30:26.470 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:26 smithi172 bash[43622]: debug 2024-03-30T15:30:26.282+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.612104+0000 front 2024-03-30T15:29:50.612074+0000 (oldest deadline 2024-03-30T15:30:14.711797+0000) 2024-03-30T15:30:26.470 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:26 smithi172 bash[43622]: debug 2024-03-30T15:30:26.282+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:29:57.013706+0000 front 2024-03-30T15:29:57.013420+0000 (oldest deadline 2024-03-30T15:30:22.313431+0000) 2024-03-30T15:30:26.470 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:26 smithi172 bash[38096]: debug 2024-03-30T15:30:26.062+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.313455+0000 front 2024-03-30T15:29:50.313329+0000 (oldest deadline 2024-03-30T15:30:12.613462+0000) 2024-03-30T15:30:26.470 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:26 smithi172 bash[38096]: debug 2024-03-30T15:30:26.062+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:30:00.116157+0000 front 2024-03-30T15:30:00.116572+0000 (oldest deadline 2024-03-30T15:30:21.816284+0000) 2024-03-30T15:30:26.970 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:30:26 smithi172 bash[32737]: debug 2024-03-30T15:30:26.594+0000 7f6fce406700 -1 osd.5 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:51.356620+0000 front 2024-03-30T15:29:51.356651+0000 (oldest deadline 2024-03-30T15:30:13.656135+0000) 2024-03-30T15:30:26.970 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:30:26 smithi172 bash[32737]: debug 2024-03-30T15:30:26.594+0000 7f6fce406700 -1 osd.5 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:29:57.757664+0000 front 2024-03-30T15:29:57.757791+0000 (oldest deadline 2024-03-30T15:30:22.457639+0000) 2024-03-30T15:30:27.344 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 30 15:30:27 smithi172 bash[52937]: ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4-osd-4 2024-03-30T15:30:27.344 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 30 15:30:27 smithi172 bash[53000]: Error response from daemon: No such container: ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4-osd-4 2024-03-30T15:30:27.344 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:27 smithi172 bash[43622]: debug 2024-03-30T15:30:27.322+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.612104+0000 front 2024-03-30T15:29:50.612074+0000 (oldest deadline 2024-03-30T15:30:14.711797+0000) 2024-03-30T15:30:27.344 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:27 smithi172 bash[43622]: debug 2024-03-30T15:30:27.322+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:29:57.013706+0000 front 2024-03-30T15:29:57.013420+0000 (oldest deadline 2024-03-30T15:30:22.313431+0000) 2024-03-30T15:30:27.344 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:27 smithi172 bash[38096]: debug 2024-03-30T15:30:27.082+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.313455+0000 front 2024-03-30T15:29:50.313329+0000 (oldest deadline 2024-03-30T15:30:12.613462+0000) 2024-03-30T15:30:27.344 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:27 smithi172 bash[38096]: debug 2024-03-30T15:30:27.082+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:30:00.116157+0000 front 2024-03-30T15:30:00.116572+0000 (oldest deadline 2024-03-30T15:30:21.816284+0000) 2024-03-30T15:30:27.720 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:30:27 smithi172 bash[32737]: debug 2024-03-30T15:30:27.570+0000 7f6fce406700 -1 osd.5 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:51.356620+0000 front 2024-03-30T15:29:51.356651+0000 (oldest deadline 2024-03-30T15:30:13.656135+0000) 2024-03-30T15:30:27.720 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:30:27 smithi172 bash[32737]: debug 2024-03-30T15:30:27.570+0000 7f6fce406700 -1 osd.5 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:29:57.757664+0000 front 2024-03-30T15:29:57.757791+0000 (oldest deadline 2024-03-30T15:30:22.457639+0000) 2024-03-30T15:30:28.470 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:28 smithi172 bash[38096]: debug 2024-03-30T15:30:28.130+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.313455+0000 front 2024-03-30T15:29:50.313329+0000 (oldest deadline 2024-03-30T15:30:12.613462+0000) 2024-03-30T15:30:28.470 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:28 smithi172 bash[38096]: debug 2024-03-30T15:30:28.130+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:30:00.116157+0000 front 2024-03-30T15:30:00.116572+0000 (oldest deadline 2024-03-30T15:30:21.816284+0000) 2024-03-30T15:30:28.470 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:28 smithi172 bash[43622]: debug 2024-03-30T15:30:28.354+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.612104+0000 front 2024-03-30T15:29:50.612074+0000 (oldest deadline 2024-03-30T15:30:14.711797+0000) 2024-03-30T15:30:28.470 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:28 smithi172 bash[43622]: debug 2024-03-30T15:30:28.354+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:29:57.013706+0000 front 2024-03-30T15:29:57.013420+0000 (oldest deadline 2024-03-30T15:30:22.313431+0000) 2024-03-30T15:30:28.970 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:30:28 smithi172 bash[32737]: debug 2024-03-30T15:30:28.594+0000 7f6fce406700 -1 osd.5 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:51.356620+0000 front 2024-03-30T15:29:51.356651+0000 (oldest deadline 2024-03-30T15:30:13.656135+0000) 2024-03-30T15:30:28.970 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:30:28 smithi172 bash[32737]: debug 2024-03-30T15:30:28.594+0000 7f6fce406700 -1 osd.5 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:29:57.757664+0000 front 2024-03-30T15:29:57.757791+0000 (oldest deadline 2024-03-30T15:30:22.457639+0000) 2024-03-30T15:30:29.253 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@osd.4.service' 2024-03-30T15:30:29.282 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-30T15:30:29.283 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-03-30T15:30:29.283 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-03-30T15:30:29.283 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@osd.5 2024-03-30T15:30:29.466 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:29 smithi172 bash[38096]: debug 2024-03-30T15:30:29.094+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.313455+0000 front 2024-03-30T15:29:50.313329+0000 (oldest deadline 2024-03-30T15:30:12.613462+0000) 2024-03-30T15:30:29.466 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:29 smithi172 bash[38096]: debug 2024-03-30T15:30:29.094+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:30:00.116157+0000 front 2024-03-30T15:30:00.116572+0000 (oldest deadline 2024-03-30T15:30:21.816284+0000) 2024-03-30T15:30:29.466 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:29 smithi172 bash[43622]: debug 2024-03-30T15:30:29.334+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.612104+0000 front 2024-03-30T15:29:50.612074+0000 (oldest deadline 2024-03-30T15:30:14.711797+0000) 2024-03-30T15:30:29.466 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:29 smithi172 bash[43622]: debug 2024-03-30T15:30:29.334+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:29:57.013706+0000 front 2024-03-30T15:29:57.013420+0000 (oldest deadline 2024-03-30T15:30:22.313431+0000) 2024-03-30T15:30:29.466 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:30:29 smithi172 systemd[1]: Stopping Ceph osd.5 for 97f8e564-eea5-11ee-b647-cb9ed24678a4... 2024-03-30T15:30:29.559 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:30:29 smithi172 bash[32737]: debug 2024-03-30T15:30:29.462+0000 7f6fd5e1a700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-03-30T15:30:29.559 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:30:29 smithi172 bash[32737]: debug 2024-03-30T15:30:29.462+0000 7f6fd5e1a700 -1 osd.5 798 *** Got signal Terminated *** 2024-03-30T15:30:29.559 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:30:29 smithi172 bash[32737]: debug 2024-03-30T15:30:29.462+0000 7f6fd5e1a700 -1 osd.5 798 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-30T15:30:29.720 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:30:29 smithi172 bash[32737]: debug 2024-03-30T15:30:29.554+0000 7f6fce406700 -1 osd.5 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:51.356620+0000 front 2024-03-30T15:29:51.356651+0000 (oldest deadline 2024-03-30T15:30:13.656135+0000) 2024-03-30T15:30:29.720 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:30:29 smithi172 bash[32737]: debug 2024-03-30T15:30:29.554+0000 7f6fce406700 -1 osd.5 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:29:57.757664+0000 front 2024-03-30T15:29:57.757791+0000 (oldest deadline 2024-03-30T15:30:22.457639+0000) 2024-03-30T15:30:30.470 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:30 smithi172 bash[38096]: debug 2024-03-30T15:30:30.090+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.313455+0000 front 2024-03-30T15:29:50.313329+0000 (oldest deadline 2024-03-30T15:30:12.613462+0000) 2024-03-30T15:30:30.470 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:30 smithi172 bash[38096]: debug 2024-03-30T15:30:30.090+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:30:00.116157+0000 front 2024-03-30T15:30:00.116572+0000 (oldest deadline 2024-03-30T15:30:21.816284+0000) 2024-03-30T15:30:30.470 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:30 smithi172 bash[38096]: debug 2024-03-30T15:30:30.090+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6822 osd.2 since back 2024-03-30T15:30:04.118310+0000 front 2024-03-30T15:30:04.118187+0000 (oldest deadline 2024-03-30T15:30:29.918223+0000) 2024-03-30T15:30:30.470 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:30 smithi172 bash[43622]: debug 2024-03-30T15:30:30.326+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.612104+0000 front 2024-03-30T15:29:50.612074+0000 (oldest deadline 2024-03-30T15:30:14.711797+0000) 2024-03-30T15:30:30.470 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:30 smithi172 bash[43622]: debug 2024-03-30T15:30:30.326+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:29:57.013706+0000 front 2024-03-30T15:29:57.013420+0000 (oldest deadline 2024-03-30T15:30:22.313431+0000) 2024-03-30T15:30:30.970 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:30:30 smithi172 bash[32737]: debug 2024-03-30T15:30:30.522+0000 7f6fce406700 -1 osd.5 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:51.356620+0000 front 2024-03-30T15:29:51.356651+0000 (oldest deadline 2024-03-30T15:30:13.656135+0000) 2024-03-30T15:30:30.970 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:30:30 smithi172 bash[32737]: debug 2024-03-30T15:30:30.522+0000 7f6fce406700 -1 osd.5 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:29:57.757664+0000 front 2024-03-30T15:29:57.757791+0000 (oldest deadline 2024-03-30T15:30:22.457639+0000) 2024-03-30T15:30:31.361 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:31 smithi172 bash[38096]: debug 2024-03-30T15:30:31.066+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.313455+0000 front 2024-03-30T15:29:50.313329+0000 (oldest deadline 2024-03-30T15:30:12.613462+0000) 2024-03-30T15:30:31.362 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:31 smithi172 bash[38096]: debug 2024-03-30T15:30:31.066+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:30:00.116157+0000 front 2024-03-30T15:30:00.116572+0000 (oldest deadline 2024-03-30T15:30:21.816284+0000) 2024-03-30T15:30:31.362 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:31 smithi172 bash[38096]: debug 2024-03-30T15:30:31.066+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6822 osd.2 since back 2024-03-30T15:30:04.118310+0000 front 2024-03-30T15:30:04.118187+0000 (oldest deadline 2024-03-30T15:30:29.918223+0000) 2024-03-30T15:30:31.720 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:31 smithi172 bash[43622]: debug 2024-03-30T15:30:31.362+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.612104+0000 front 2024-03-30T15:29:50.612074+0000 (oldest deadline 2024-03-30T15:30:14.711797+0000) 2024-03-30T15:30:31.720 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:31 smithi172 bash[43622]: debug 2024-03-30T15:30:31.362+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:29:57.013706+0000 front 2024-03-30T15:29:57.013420+0000 (oldest deadline 2024-03-30T15:30:22.313431+0000) 2024-03-30T15:30:31.720 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:30:31 smithi172 bash[32737]: debug 2024-03-30T15:30:31.502+0000 7f6fce406700 -1 osd.5 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:51.356620+0000 front 2024-03-30T15:29:51.356651+0000 (oldest deadline 2024-03-30T15:30:13.656135+0000) 2024-03-30T15:30:31.720 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:30:31 smithi172 bash[32737]: debug 2024-03-30T15:30:31.502+0000 7f6fce406700 -1 osd.5 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:29:57.757664+0000 front 2024-03-30T15:29:57.757791+0000 (oldest deadline 2024-03-30T15:30:22.457639+0000) 2024-03-30T15:30:32.331 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:32 smithi172 bash[38096]: debug 2024-03-30T15:30:32.058+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.313455+0000 front 2024-03-30T15:29:50.313329+0000 (oldest deadline 2024-03-30T15:30:12.613462+0000) 2024-03-30T15:30:32.331 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:32 smithi172 bash[38096]: debug 2024-03-30T15:30:32.058+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:30:00.116157+0000 front 2024-03-30T15:30:00.116572+0000 (oldest deadline 2024-03-30T15:30:21.816284+0000) 2024-03-30T15:30:32.331 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:32 smithi172 bash[38096]: debug 2024-03-30T15:30:32.058+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6822 osd.2 since back 2024-03-30T15:30:04.118310+0000 front 2024-03-30T15:30:04.118187+0000 (oldest deadline 2024-03-30T15:30:29.918223+0000) 2024-03-30T15:30:32.720 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:30:32 smithi172 bash[32737]: debug 2024-03-30T15:30:32.486+0000 7f6fce406700 -1 osd.5 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:51.356620+0000 front 2024-03-30T15:29:51.356651+0000 (oldest deadline 2024-03-30T15:30:13.656135+0000) 2024-03-30T15:30:32.720 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:30:32 smithi172 bash[32737]: debug 2024-03-30T15:30:32.486+0000 7f6fce406700 -1 osd.5 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:29:57.757664+0000 front 2024-03-30T15:29:57.757791+0000 (oldest deadline 2024-03-30T15:30:22.457639+0000) 2024-03-30T15:30:32.720 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:30:32 smithi172 bash[32737]: debug 2024-03-30T15:30:32.486+0000 7f6fce406700 -1 osd.5 798 heartbeat_check: no reply from 172.21.15.72:6822 osd.2 since back 2024-03-30T15:30:07.159396+0000 front 2024-03-30T15:30:07.159509+0000 (oldest deadline 2024-03-30T15:30:32.459269+0000) 2024-03-30T15:30:32.720 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:32 smithi172 bash[43622]: debug 2024-03-30T15:30:32.330+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.612104+0000 front 2024-03-30T15:29:50.612074+0000 (oldest deadline 2024-03-30T15:30:14.711797+0000) 2024-03-30T15:30:32.720 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:32 smithi172 bash[43622]: debug 2024-03-30T15:30:32.330+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:29:57.013706+0000 front 2024-03-30T15:29:57.013420+0000 (oldest deadline 2024-03-30T15:30:22.313431+0000) 2024-03-30T15:30:32.720 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:32 smithi172 bash[43622]: debug 2024-03-30T15:30:32.330+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6822 osd.2 since back 2024-03-30T15:30:08.115934+0000 front 2024-03-30T15:30:08.115625+0000 (oldest deadline 2024-03-30T15:30:31.615713+0000) 2024-03-30T15:30:33.470 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:33 smithi172 bash[43622]: debug 2024-03-30T15:30:33.290+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.612104+0000 front 2024-03-30T15:29:50.612074+0000 (oldest deadline 2024-03-30T15:30:14.711797+0000) 2024-03-30T15:30:33.470 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:33 smithi172 bash[43622]: debug 2024-03-30T15:30:33.290+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:29:57.013706+0000 front 2024-03-30T15:29:57.013420+0000 (oldest deadline 2024-03-30T15:30:22.313431+0000) 2024-03-30T15:30:33.470 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:33 smithi172 bash[43622]: debug 2024-03-30T15:30:33.290+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6822 osd.2 since back 2024-03-30T15:30:08.115934+0000 front 2024-03-30T15:30:08.115625+0000 (oldest deadline 2024-03-30T15:30:31.615713+0000) 2024-03-30T15:30:33.470 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:33 smithi172 bash[38096]: debug 2024-03-30T15:30:33.086+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.313455+0000 front 2024-03-30T15:29:50.313329+0000 (oldest deadline 2024-03-30T15:30:12.613462+0000) 2024-03-30T15:30:33.470 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:33 smithi172 bash[38096]: debug 2024-03-30T15:30:33.086+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:30:00.116157+0000 front 2024-03-30T15:30:00.116572+0000 (oldest deadline 2024-03-30T15:30:21.816284+0000) 2024-03-30T15:30:33.471 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:33 smithi172 bash[38096]: debug 2024-03-30T15:30:33.086+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6822 osd.2 since back 2024-03-30T15:30:04.118310+0000 front 2024-03-30T15:30:04.118187+0000 (oldest deadline 2024-03-30T15:30:29.918223+0000) 2024-03-30T15:30:33.919 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:30:33 smithi072 bash[59916]: ts=2024-03-30T15:30:33.584Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi172.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.172:8443: connect: connection refused; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://smithi072.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.72:8443: connect: connection refused" 2024-03-30T15:30:33.919 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:30:33 smithi072 bash[59916]: ts=2024-03-30T15:30:33.585Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi072.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.72:8443: connect: connection refused" 2024-03-30T15:30:33.919 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:30:33 smithi072 bash[59916]: ts=2024-03-30T15:30:33.586Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi172.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.172:8443: connect: connection refused" 2024-03-30T15:30:33.970 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:30:33 smithi172 bash[32737]: debug 2024-03-30T15:30:33.478+0000 7f6fce406700 -1 osd.5 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:51.356620+0000 front 2024-03-30T15:29:51.356651+0000 (oldest deadline 2024-03-30T15:30:13.656135+0000) 2024-03-30T15:30:33.970 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:30:33 smithi172 bash[32737]: debug 2024-03-30T15:30:33.478+0000 7f6fce406700 -1 osd.5 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:29:57.757664+0000 front 2024-03-30T15:29:57.757791+0000 (oldest deadline 2024-03-30T15:30:22.457639+0000) 2024-03-30T15:30:33.970 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:30:33 smithi172 bash[32737]: debug 2024-03-30T15:30:33.478+0000 7f6fce406700 -1 osd.5 798 heartbeat_check: no reply from 172.21.15.72:6822 osd.2 since back 2024-03-30T15:30:07.159396+0000 front 2024-03-30T15:30:07.159509+0000 (oldest deadline 2024-03-30T15:30:32.459269+0000) 2024-03-30T15:30:34.463 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:34 smithi172 bash[38096]: debug 2024-03-30T15:30:34.106+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.313455+0000 front 2024-03-30T15:29:50.313329+0000 (oldest deadline 2024-03-30T15:30:12.613462+0000) 2024-03-30T15:30:34.463 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:34 smithi172 bash[38096]: debug 2024-03-30T15:30:34.106+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:30:00.116157+0000 front 2024-03-30T15:30:00.116572+0000 (oldest deadline 2024-03-30T15:30:21.816284+0000) 2024-03-30T15:30:34.463 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:34 smithi172 bash[38096]: debug 2024-03-30T15:30:34.106+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6822 osd.2 since back 2024-03-30T15:30:04.118310+0000 front 2024-03-30T15:30:04.118187+0000 (oldest deadline 2024-03-30T15:30:29.918223+0000) 2024-03-30T15:30:34.463 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:34 smithi172 bash[43622]: debug 2024-03-30T15:30:34.334+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.612104+0000 front 2024-03-30T15:29:50.612074+0000 (oldest deadline 2024-03-30T15:30:14.711797+0000) 2024-03-30T15:30:34.464 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:34 smithi172 bash[43622]: debug 2024-03-30T15:30:34.334+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:29:57.013706+0000 front 2024-03-30T15:29:57.013420+0000 (oldest deadline 2024-03-30T15:30:22.313431+0000) 2024-03-30T15:30:34.464 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:34 smithi172 bash[43622]: debug 2024-03-30T15:30:34.334+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6822 osd.2 since back 2024-03-30T15:30:08.115934+0000 front 2024-03-30T15:30:08.115625+0000 (oldest deadline 2024-03-30T15:30:31.615713+0000) 2024-03-30T15:30:34.720 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:30:34 smithi172 bash[32737]: debug 2024-03-30T15:30:34.458+0000 7f6fce406700 -1 osd.5 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:51.356620+0000 front 2024-03-30T15:29:51.356651+0000 (oldest deadline 2024-03-30T15:30:13.656135+0000) 2024-03-30T15:30:34.720 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:30:34 smithi172 bash[32737]: debug 2024-03-30T15:30:34.458+0000 7f6fce406700 -1 osd.5 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:29:57.757664+0000 front 2024-03-30T15:29:57.757791+0000 (oldest deadline 2024-03-30T15:30:22.457639+0000) 2024-03-30T15:30:34.720 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:30:34 smithi172 bash[32737]: debug 2024-03-30T15:30:34.458+0000 7f6fce406700 -1 osd.5 798 heartbeat_check: no reply from 172.21.15.72:6822 osd.2 since back 2024-03-30T15:30:07.159396+0000 front 2024-03-30T15:30:07.159509+0000 (oldest deadline 2024-03-30T15:30:32.459269+0000) 2024-03-30T15:30:35.220 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:35 smithi172 bash[38096]: debug 2024-03-30T15:30:35.114+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.313455+0000 front 2024-03-30T15:29:50.313329+0000 (oldest deadline 2024-03-30T15:30:12.613462+0000) 2024-03-30T15:30:35.220 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:35 smithi172 bash[38096]: debug 2024-03-30T15:30:35.114+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:30:00.116157+0000 front 2024-03-30T15:30:00.116572+0000 (oldest deadline 2024-03-30T15:30:21.816284+0000) 2024-03-30T15:30:35.220 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:35 smithi172 bash[38096]: debug 2024-03-30T15:30:35.114+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6822 osd.2 since back 2024-03-30T15:30:04.118310+0000 front 2024-03-30T15:30:04.118187+0000 (oldest deadline 2024-03-30T15:30:29.918223+0000) 2024-03-30T15:30:35.720 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:30:35 smithi172 bash[53135]: ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4-osd-5 2024-03-30T15:30:35.720 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:35 smithi172 bash[43622]: debug 2024-03-30T15:30:35.362+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.612104+0000 front 2024-03-30T15:29:50.612074+0000 (oldest deadline 2024-03-30T15:30:14.711797+0000) 2024-03-30T15:30:35.720 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:35 smithi172 bash[43622]: debug 2024-03-30T15:30:35.362+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:29:57.013706+0000 front 2024-03-30T15:29:57.013420+0000 (oldest deadline 2024-03-30T15:30:22.313431+0000) 2024-03-30T15:30:35.720 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:35 smithi172 bash[43622]: debug 2024-03-30T15:30:35.362+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6822 osd.2 since back 2024-03-30T15:30:08.115934+0000 front 2024-03-30T15:30:08.115625+0000 (oldest deadline 2024-03-30T15:30:31.615713+0000) 2024-03-30T15:30:36.153 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 30 15:30:35 smithi172 bash[53200]: Error response from daemon: No such container: ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4-osd-5 2024-03-30T15:30:36.412 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:36 smithi172 bash[38096]: debug 2024-03-30T15:30:36.154+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.313455+0000 front 2024-03-30T15:29:50.313329+0000 (oldest deadline 2024-03-30T15:30:12.613462+0000) 2024-03-30T15:30:36.413 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:36 smithi172 bash[38096]: debug 2024-03-30T15:30:36.154+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:30:00.116157+0000 front 2024-03-30T15:30:00.116572+0000 (oldest deadline 2024-03-30T15:30:21.816284+0000) 2024-03-30T15:30:36.413 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:36 smithi172 bash[38096]: debug 2024-03-30T15:30:36.154+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6822 osd.2 since back 2024-03-30T15:30:04.118310+0000 front 2024-03-30T15:30:04.118187+0000 (oldest deadline 2024-03-30T15:30:29.918223+0000) 2024-03-30T15:30:36.720 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:36 smithi172 bash[43622]: debug 2024-03-30T15:30:36.410+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.612104+0000 front 2024-03-30T15:29:50.612074+0000 (oldest deadline 2024-03-30T15:30:14.711797+0000) 2024-03-30T15:30:36.720 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:36 smithi172 bash[43622]: debug 2024-03-30T15:30:36.410+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:29:57.013706+0000 front 2024-03-30T15:29:57.013420+0000 (oldest deadline 2024-03-30T15:30:22.313431+0000) 2024-03-30T15:30:36.720 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:36 smithi172 bash[43622]: debug 2024-03-30T15:30:36.410+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6822 osd.2 since back 2024-03-30T15:30:08.115934+0000 front 2024-03-30T15:30:08.115625+0000 (oldest deadline 2024-03-30T15:30:31.615713+0000) 2024-03-30T15:30:37.458 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:37 smithi172 bash[38096]: debug 2024-03-30T15:30:37.157+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.313455+0000 front 2024-03-30T15:29:50.313329+0000 (oldest deadline 2024-03-30T15:30:12.613462+0000) 2024-03-30T15:30:37.458 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:37 smithi172 bash[38096]: debug 2024-03-30T15:30:37.157+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:30:00.116157+0000 front 2024-03-30T15:30:00.116572+0000 (oldest deadline 2024-03-30T15:30:21.816284+0000) 2024-03-30T15:30:37.458 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:37 smithi172 bash[38096]: debug 2024-03-30T15:30:37.157+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6822 osd.2 since back 2024-03-30T15:30:04.118310+0000 front 2024-03-30T15:30:04.118187+0000 (oldest deadline 2024-03-30T15:30:29.918223+0000) 2024-03-30T15:30:37.594 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@osd.5.service' 2024-03-30T15:30:37.622 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-30T15:30:37.623 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-03-30T15:30:37.623 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-03-30T15:30:37.623 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@osd.6 2024-03-30T15:30:37.720 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:37 smithi172 systemd[1]: Stopping Ceph osd.6 for 97f8e564-eea5-11ee-b647-cb9ed24678a4... 2024-03-30T15:30:37.720 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:37 smithi172 bash[43622]: debug 2024-03-30T15:30:37.453+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.612104+0000 front 2024-03-30T15:29:50.612074+0000 (oldest deadline 2024-03-30T15:30:14.711797+0000) 2024-03-30T15:30:37.720 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:37 smithi172 bash[43622]: debug 2024-03-30T15:30:37.453+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:29:57.013706+0000 front 2024-03-30T15:29:57.013420+0000 (oldest deadline 2024-03-30T15:30:22.313431+0000) 2024-03-30T15:30:37.720 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:37 smithi172 bash[43622]: debug 2024-03-30T15:30:37.453+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6822 osd.2 since back 2024-03-30T15:30:08.115934+0000 front 2024-03-30T15:30:08.115625+0000 (oldest deadline 2024-03-30T15:30:31.615713+0000) 2024-03-30T15:30:37.970 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:37 smithi172 bash[38096]: debug 2024-03-30T15:30:37.801+0000 7efc20e59700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-03-30T15:30:37.970 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:37 smithi172 bash[38096]: debug 2024-03-30T15:30:37.801+0000 7efc20e59700 -1 osd.6 798 *** Got signal Terminated *** 2024-03-30T15:30:37.970 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:37 smithi172 bash[38096]: debug 2024-03-30T15:30:37.801+0000 7efc20e59700 -1 osd.6 798 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-30T15:30:38.470 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:38 smithi172 bash[38096]: debug 2024-03-30T15:30:38.185+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.313455+0000 front 2024-03-30T15:29:50.313329+0000 (oldest deadline 2024-03-30T15:30:12.613462+0000) 2024-03-30T15:30:38.470 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:38 smithi172 bash[38096]: debug 2024-03-30T15:30:38.185+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:30:00.116157+0000 front 2024-03-30T15:30:00.116572+0000 (oldest deadline 2024-03-30T15:30:21.816284+0000) 2024-03-30T15:30:38.470 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:38 smithi172 bash[38096]: debug 2024-03-30T15:30:38.185+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6822 osd.2 since back 2024-03-30T15:30:04.118310+0000 front 2024-03-30T15:30:04.118187+0000 (oldest deadline 2024-03-30T15:30:29.918223+0000) 2024-03-30T15:30:38.970 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:38 smithi172 bash[43622]: debug 2024-03-30T15:30:38.485+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.612104+0000 front 2024-03-30T15:29:50.612074+0000 (oldest deadline 2024-03-30T15:30:14.711797+0000) 2024-03-30T15:30:38.970 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:38 smithi172 bash[43622]: debug 2024-03-30T15:30:38.485+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:29:57.013706+0000 front 2024-03-30T15:29:57.013420+0000 (oldest deadline 2024-03-30T15:30:22.313431+0000) 2024-03-30T15:30:38.970 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:38 smithi172 bash[43622]: debug 2024-03-30T15:30:38.485+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6822 osd.2 since back 2024-03-30T15:30:08.115934+0000 front 2024-03-30T15:30:08.115625+0000 (oldest deadline 2024-03-30T15:30:31.615713+0000) 2024-03-30T15:30:39.470 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:39 smithi172 bash[38096]: debug 2024-03-30T15:30:39.149+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.313455+0000 front 2024-03-30T15:29:50.313329+0000 (oldest deadline 2024-03-30T15:30:12.613462+0000) 2024-03-30T15:30:39.470 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:39 smithi172 bash[38096]: debug 2024-03-30T15:30:39.149+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:30:00.116157+0000 front 2024-03-30T15:30:00.116572+0000 (oldest deadline 2024-03-30T15:30:21.816284+0000) 2024-03-30T15:30:39.471 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:39 smithi172 bash[38096]: debug 2024-03-30T15:30:39.149+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6822 osd.2 since back 2024-03-30T15:30:04.118310+0000 front 2024-03-30T15:30:04.118187+0000 (oldest deadline 2024-03-30T15:30:29.918223+0000) 2024-03-30T15:30:39.970 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:39 smithi172 bash[43622]: debug 2024-03-30T15:30:39.521+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.612104+0000 front 2024-03-30T15:29:50.612074+0000 (oldest deadline 2024-03-30T15:30:14.711797+0000) 2024-03-30T15:30:39.970 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:39 smithi172 bash[43622]: debug 2024-03-30T15:30:39.521+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:29:57.013706+0000 front 2024-03-30T15:29:57.013420+0000 (oldest deadline 2024-03-30T15:30:22.313431+0000) 2024-03-30T15:30:39.970 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:39 smithi172 bash[43622]: debug 2024-03-30T15:30:39.521+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6822 osd.2 since back 2024-03-30T15:30:08.115934+0000 front 2024-03-30T15:30:08.115625+0000 (oldest deadline 2024-03-30T15:30:31.615713+0000) 2024-03-30T15:30:40.470 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:40 smithi172 bash[38096]: debug 2024-03-30T15:30:40.113+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.313455+0000 front 2024-03-30T15:29:50.313329+0000 (oldest deadline 2024-03-30T15:30:12.613462+0000) 2024-03-30T15:30:40.470 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:40 smithi172 bash[38096]: debug 2024-03-30T15:30:40.113+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:30:00.116157+0000 front 2024-03-30T15:30:00.116572+0000 (oldest deadline 2024-03-30T15:30:21.816284+0000) 2024-03-30T15:30:40.470 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:40 smithi172 bash[38096]: debug 2024-03-30T15:30:40.113+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6822 osd.2 since back 2024-03-30T15:30:04.118310+0000 front 2024-03-30T15:30:04.118187+0000 (oldest deadline 2024-03-30T15:30:29.918223+0000) 2024-03-30T15:30:40.470 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:40 smithi172 bash[38096]: debug 2024-03-30T15:30:40.113+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6830 osd.3 since back 2024-03-30T15:30:14.019819+0000 front 2024-03-30T15:30:14.019777+0000 (oldest deadline 2024-03-30T15:30:39.820161+0000) 2024-03-30T15:30:40.471 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:30:40 smithi172 bash[51546]: ts=2024-03-30T15:30:40.146Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=node msg="Unable to refresh target groups" err="Get \"http://172.21.15.72:8765/sd/prometheus/sd-config?service=node-exporter\": dial tcp 172.21.15.72:8765: connect: connection refused" 2024-03-30T15:30:40.471 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:30:40 smithi172 bash[51546]: ts=2024-03-30T15:30:40.149Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=ceph-exporter msg="Unable to refresh target groups" err="Get \"http://172.21.15.72:8765/sd/prometheus/sd-config?service=ceph-exporter\": dial tcp 172.21.15.72:8765: connect: connection refused" 2024-03-30T15:30:40.471 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:30:40 smithi172 bash[51546]: ts=2024-03-30T15:30:40.149Z caller=refresh.go:99 level=error component="discovery manager notify" discovery=http config=config-0 msg="Unable to refresh target groups" err="Get \"http://172.21.15.72:8765/sd/prometheus/sd-config?service=alertmanager\": dial tcp 172.21.15.72:8765: connect: connection refused" 2024-03-30T15:30:40.471 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:30:40 smithi172 bash[51546]: ts=2024-03-30T15:30:40.150Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=ceph msg="Unable to refresh target groups" err="Get \"http://172.21.15.72:8765/sd/prometheus/sd-config?service=mgr-prometheus\": dial tcp 172.21.15.72:8765: connect: connection refused" 2024-03-30T15:30:40.970 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:40 smithi172 bash[43622]: debug 2024-03-30T15:30:40.541+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.612104+0000 front 2024-03-30T15:29:50.612074+0000 (oldest deadline 2024-03-30T15:30:14.711797+0000) 2024-03-30T15:30:40.970 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:40 smithi172 bash[43622]: debug 2024-03-30T15:30:40.541+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:29:57.013706+0000 front 2024-03-30T15:29:57.013420+0000 (oldest deadline 2024-03-30T15:30:22.313431+0000) 2024-03-30T15:30:40.970 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:40 smithi172 bash[43622]: debug 2024-03-30T15:30:40.541+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6822 osd.2 since back 2024-03-30T15:30:08.115934+0000 front 2024-03-30T15:30:08.115625+0000 (oldest deadline 2024-03-30T15:30:31.615713+0000) 2024-03-30T15:30:41.470 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:41 smithi172 bash[38096]: debug 2024-03-30T15:30:41.109+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.313455+0000 front 2024-03-30T15:29:50.313329+0000 (oldest deadline 2024-03-30T15:30:12.613462+0000) 2024-03-30T15:30:41.470 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:41 smithi172 bash[38096]: debug 2024-03-30T15:30:41.109+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:30:00.116157+0000 front 2024-03-30T15:30:00.116572+0000 (oldest deadline 2024-03-30T15:30:21.816284+0000) 2024-03-30T15:30:41.470 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:41 smithi172 bash[38096]: debug 2024-03-30T15:30:41.109+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6822 osd.2 since back 2024-03-30T15:30:04.118310+0000 front 2024-03-30T15:30:04.118187+0000 (oldest deadline 2024-03-30T15:30:29.918223+0000) 2024-03-30T15:30:41.470 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:41 smithi172 bash[38096]: debug 2024-03-30T15:30:41.109+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6830 osd.3 since back 2024-03-30T15:30:14.019819+0000 front 2024-03-30T15:30:14.019777+0000 (oldest deadline 2024-03-30T15:30:39.820161+0000) 2024-03-30T15:30:41.970 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:41 smithi172 bash[43622]: debug 2024-03-30T15:30:41.537+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.612104+0000 front 2024-03-30T15:29:50.612074+0000 (oldest deadline 2024-03-30T15:30:14.711797+0000) 2024-03-30T15:30:41.970 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:41 smithi172 bash[43622]: debug 2024-03-30T15:30:41.537+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:29:57.013706+0000 front 2024-03-30T15:29:57.013420+0000 (oldest deadline 2024-03-30T15:30:22.313431+0000) 2024-03-30T15:30:41.970 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:41 smithi172 bash[43622]: debug 2024-03-30T15:30:41.537+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6822 osd.2 since back 2024-03-30T15:30:08.115934+0000 front 2024-03-30T15:30:08.115625+0000 (oldest deadline 2024-03-30T15:30:31.615713+0000) 2024-03-30T15:30:41.970 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:41 smithi172 bash[43622]: debug 2024-03-30T15:30:41.537+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6830 osd.3 since back 2024-03-30T15:30:17.517400+0000 front 2024-03-30T15:30:17.517185+0000 (oldest deadline 2024-03-30T15:30:41.016862+0000) 2024-03-30T15:30:42.470 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:42 smithi172 bash[38096]: debug 2024-03-30T15:30:42.137+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.313455+0000 front 2024-03-30T15:29:50.313329+0000 (oldest deadline 2024-03-30T15:30:12.613462+0000) 2024-03-30T15:30:42.470 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:42 smithi172 bash[38096]: debug 2024-03-30T15:30:42.137+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:30:00.116157+0000 front 2024-03-30T15:30:00.116572+0000 (oldest deadline 2024-03-30T15:30:21.816284+0000) 2024-03-30T15:30:42.470 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:42 smithi172 bash[38096]: debug 2024-03-30T15:30:42.137+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6822 osd.2 since back 2024-03-30T15:30:04.118310+0000 front 2024-03-30T15:30:04.118187+0000 (oldest deadline 2024-03-30T15:30:29.918223+0000) 2024-03-30T15:30:42.470 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:42 smithi172 bash[38096]: debug 2024-03-30T15:30:42.137+0000 7efc1d44d700 -1 osd.6 798 heartbeat_check: no reply from 172.21.15.72:6830 osd.3 since back 2024-03-30T15:30:14.019819+0000 front 2024-03-30T15:30:14.019777+0000 (oldest deadline 2024-03-30T15:30:39.820161+0000) 2024-03-30T15:30:42.970 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:42 smithi172 bash[43622]: debug 2024-03-30T15:30:42.569+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.612104+0000 front 2024-03-30T15:29:50.612074+0000 (oldest deadline 2024-03-30T15:30:14.711797+0000) 2024-03-30T15:30:42.970 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:42 smithi172 bash[43622]: debug 2024-03-30T15:30:42.569+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:29:57.013706+0000 front 2024-03-30T15:29:57.013420+0000 (oldest deadline 2024-03-30T15:30:22.313431+0000) 2024-03-30T15:30:42.970 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:42 smithi172 bash[43622]: debug 2024-03-30T15:30:42.569+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6822 osd.2 since back 2024-03-30T15:30:08.115934+0000 front 2024-03-30T15:30:08.115625+0000 (oldest deadline 2024-03-30T15:30:31.615713+0000) 2024-03-30T15:30:42.971 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:42 smithi172 bash[43622]: debug 2024-03-30T15:30:42.569+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6830 osd.3 since back 2024-03-30T15:30:17.517400+0000 front 2024-03-30T15:30:17.517185+0000 (oldest deadline 2024-03-30T15:30:41.016862+0000) 2024-03-30T15:30:43.919 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:30:43 smithi072 bash[59916]: ts=2024-03-30T15:30:43.585Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi172.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.172:8443: connect: connection refused; ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi072.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.72:8443: connect: connection refused" 2024-03-30T15:30:43.919 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:30:43 smithi072 bash[59916]: ts=2024-03-30T15:30:43.586Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi072.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.72:8443: connect: connection refused" 2024-03-30T15:30:43.919 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:30:43 smithi072 bash[59916]: ts=2024-03-30T15:30:43.587Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi172.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.172:8443: connect: connection refused" 2024-03-30T15:30:43.970 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:43 smithi172 bash[53333]: ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4-osd-6 2024-03-30T15:30:43.970 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:43 smithi172 bash[43622]: debug 2024-03-30T15:30:43.577+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.612104+0000 front 2024-03-30T15:29:50.612074+0000 (oldest deadline 2024-03-30T15:30:14.711797+0000) 2024-03-30T15:30:43.970 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:43 smithi172 bash[43622]: debug 2024-03-30T15:30:43.577+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:29:57.013706+0000 front 2024-03-30T15:29:57.013420+0000 (oldest deadline 2024-03-30T15:30:22.313431+0000) 2024-03-30T15:30:43.970 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:43 smithi172 bash[43622]: debug 2024-03-30T15:30:43.577+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6822 osd.2 since back 2024-03-30T15:30:08.115934+0000 front 2024-03-30T15:30:08.115625+0000 (oldest deadline 2024-03-30T15:30:31.615713+0000) 2024-03-30T15:30:43.970 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:43 smithi172 bash[43622]: debug 2024-03-30T15:30:43.577+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6830 osd.3 since back 2024-03-30T15:30:17.517400+0000 front 2024-03-30T15:30:17.517185+0000 (oldest deadline 2024-03-30T15:30:41.016862+0000) 2024-03-30T15:30:44.470 INFO:journalctl@ceph.osd.6.smithi172.stdout:Mar 30 15:30:44 smithi172 bash[53398]: Error response from daemon: No such container: ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4-osd-6 2024-03-30T15:30:44.901 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:44 smithi172 bash[43622]: debug 2024-03-30T15:30:44.589+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.612104+0000 front 2024-03-30T15:29:50.612074+0000 (oldest deadline 2024-03-30T15:30:14.711797+0000) 2024-03-30T15:30:44.901 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:44 smithi172 bash[43622]: debug 2024-03-30T15:30:44.589+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:29:57.013706+0000 front 2024-03-30T15:29:57.013420+0000 (oldest deadline 2024-03-30T15:30:22.313431+0000) 2024-03-30T15:30:44.901 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:44 smithi172 bash[43622]: debug 2024-03-30T15:30:44.589+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6822 osd.2 since back 2024-03-30T15:30:08.115934+0000 front 2024-03-30T15:30:08.115625+0000 (oldest deadline 2024-03-30T15:30:31.615713+0000) 2024-03-30T15:30:44.901 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:44 smithi172 bash[43622]: debug 2024-03-30T15:30:44.589+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6830 osd.3 since back 2024-03-30T15:30:17.517400+0000 front 2024-03-30T15:30:17.517185+0000 (oldest deadline 2024-03-30T15:30:41.016862+0000) 2024-03-30T15:30:45.965 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:45 smithi172 bash[43622]: debug 2024-03-30T15:30:45.597+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.612104+0000 front 2024-03-30T15:29:50.612074+0000 (oldest deadline 2024-03-30T15:30:14.711797+0000) 2024-03-30T15:30:45.965 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:45 smithi172 bash[43622]: debug 2024-03-30T15:30:45.597+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:29:57.013706+0000 front 2024-03-30T15:29:57.013420+0000 (oldest deadline 2024-03-30T15:30:22.313431+0000) 2024-03-30T15:30:45.966 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:45 smithi172 bash[43622]: debug 2024-03-30T15:30:45.597+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6822 osd.2 since back 2024-03-30T15:30:08.115934+0000 front 2024-03-30T15:30:08.115625+0000 (oldest deadline 2024-03-30T15:30:31.615713+0000) 2024-03-30T15:30:45.966 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:45 smithi172 bash[43622]: debug 2024-03-30T15:30:45.597+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6830 osd.3 since back 2024-03-30T15:30:17.517400+0000 front 2024-03-30T15:30:17.517185+0000 (oldest deadline 2024-03-30T15:30:41.016862+0000) 2024-03-30T15:30:45.968 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@osd.6.service' 2024-03-30T15:30:45.997 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-30T15:30:45.997 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-03-30T15:30:45.997 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-03-30T15:30:45.997 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@osd.7 2024-03-30T15:30:46.220 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:46 smithi172 systemd[1]: Stopping Ceph osd.7 for 97f8e564-eea5-11ee-b647-cb9ed24678a4... 2024-03-30T15:30:46.220 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:46 smithi172 bash[43622]: debug 2024-03-30T15:30:46.169+0000 7f8bda826700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-03-30T15:30:46.220 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:46 smithi172 bash[43622]: debug 2024-03-30T15:30:46.169+0000 7f8bda826700 -1 osd.7 798 *** Got signal Terminated *** 2024-03-30T15:30:46.220 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:46 smithi172 bash[43622]: debug 2024-03-30T15:30:46.169+0000 7f8bda826700 -1 osd.7 798 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-30T15:30:46.970 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:46 smithi172 bash[43622]: debug 2024-03-30T15:30:46.585+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.612104+0000 front 2024-03-30T15:29:50.612074+0000 (oldest deadline 2024-03-30T15:30:14.711797+0000) 2024-03-30T15:30:46.970 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:46 smithi172 bash[43622]: debug 2024-03-30T15:30:46.585+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:29:57.013706+0000 front 2024-03-30T15:29:57.013420+0000 (oldest deadline 2024-03-30T15:30:22.313431+0000) 2024-03-30T15:30:46.970 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:46 smithi172 bash[43622]: debug 2024-03-30T15:30:46.585+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6822 osd.2 since back 2024-03-30T15:30:08.115934+0000 front 2024-03-30T15:30:08.115625+0000 (oldest deadline 2024-03-30T15:30:31.615713+0000) 2024-03-30T15:30:46.970 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:46 smithi172 bash[43622]: debug 2024-03-30T15:30:46.585+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6830 osd.3 since back 2024-03-30T15:30:17.517400+0000 front 2024-03-30T15:30:17.517185+0000 (oldest deadline 2024-03-30T15:30:41.016862+0000) 2024-03-30T15:30:47.970 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:47 smithi172 bash[43622]: debug 2024-03-30T15:30:47.549+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.612104+0000 front 2024-03-30T15:29:50.612074+0000 (oldest deadline 2024-03-30T15:30:14.711797+0000) 2024-03-30T15:30:47.970 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:47 smithi172 bash[43622]: debug 2024-03-30T15:30:47.549+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:29:57.013706+0000 front 2024-03-30T15:29:57.013420+0000 (oldest deadline 2024-03-30T15:30:22.313431+0000) 2024-03-30T15:30:47.970 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:47 smithi172 bash[43622]: debug 2024-03-30T15:30:47.549+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6822 osd.2 since back 2024-03-30T15:30:08.115934+0000 front 2024-03-30T15:30:08.115625+0000 (oldest deadline 2024-03-30T15:30:31.615713+0000) 2024-03-30T15:30:47.970 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:47 smithi172 bash[43622]: debug 2024-03-30T15:30:47.549+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6830 osd.3 since back 2024-03-30T15:30:17.517400+0000 front 2024-03-30T15:30:17.517185+0000 (oldest deadline 2024-03-30T15:30:41.016862+0000) 2024-03-30T15:30:48.970 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:48 smithi172 bash[43622]: debug 2024-03-30T15:30:48.553+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.612104+0000 front 2024-03-30T15:29:50.612074+0000 (oldest deadline 2024-03-30T15:30:14.711797+0000) 2024-03-30T15:30:48.970 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:48 smithi172 bash[43622]: debug 2024-03-30T15:30:48.553+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:29:57.013706+0000 front 2024-03-30T15:29:57.013420+0000 (oldest deadline 2024-03-30T15:30:22.313431+0000) 2024-03-30T15:30:48.970 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:48 smithi172 bash[43622]: debug 2024-03-30T15:30:48.553+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6822 osd.2 since back 2024-03-30T15:30:08.115934+0000 front 2024-03-30T15:30:08.115625+0000 (oldest deadline 2024-03-30T15:30:31.615713+0000) 2024-03-30T15:30:48.970 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:48 smithi172 bash[43622]: debug 2024-03-30T15:30:48.553+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6830 osd.3 since back 2024-03-30T15:30:17.517400+0000 front 2024-03-30T15:30:17.517185+0000 (oldest deadline 2024-03-30T15:30:41.016862+0000) 2024-03-30T15:30:48.970 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:48 smithi172 bash[43622]: debug 2024-03-30T15:30:48.553+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.172:6804 osd.4 since back 2024-03-30T15:30:22.718262+0000 front 2024-03-30T15:30:22.718387+0000 (oldest deadline 2024-03-30T15:30:48.518606+0000) 2024-03-30T15:30:49.970 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:49 smithi172 bash[43622]: debug 2024-03-30T15:30:49.525+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.612104+0000 front 2024-03-30T15:29:50.612074+0000 (oldest deadline 2024-03-30T15:30:14.711797+0000) 2024-03-30T15:30:49.970 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:49 smithi172 bash[43622]: debug 2024-03-30T15:30:49.525+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:29:57.013706+0000 front 2024-03-30T15:29:57.013420+0000 (oldest deadline 2024-03-30T15:30:22.313431+0000) 2024-03-30T15:30:49.970 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:49 smithi172 bash[43622]: debug 2024-03-30T15:30:49.525+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6822 osd.2 since back 2024-03-30T15:30:08.115934+0000 front 2024-03-30T15:30:08.115625+0000 (oldest deadline 2024-03-30T15:30:31.615713+0000) 2024-03-30T15:30:49.970 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:49 smithi172 bash[43622]: debug 2024-03-30T15:30:49.525+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6830 osd.3 since back 2024-03-30T15:30:17.517400+0000 front 2024-03-30T15:30:17.517185+0000 (oldest deadline 2024-03-30T15:30:41.016862+0000) 2024-03-30T15:30:49.970 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:49 smithi172 bash[43622]: debug 2024-03-30T15:30:49.525+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.172:6804 osd.4 since back 2024-03-30T15:30:22.718262+0000 front 2024-03-30T15:30:22.718387+0000 (oldest deadline 2024-03-30T15:30:48.518606+0000) 2024-03-30T15:30:50.970 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:50 smithi172 bash[43622]: debug 2024-03-30T15:30:50.521+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-30T15:29:50.612104+0000 front 2024-03-30T15:29:50.612074+0000 (oldest deadline 2024-03-30T15:30:14.711797+0000) 2024-03-30T15:30:50.970 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:50 smithi172 bash[43622]: debug 2024-03-30T15:30:50.521+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-30T15:29:57.013706+0000 front 2024-03-30T15:29:57.013420+0000 (oldest deadline 2024-03-30T15:30:22.313431+0000) 2024-03-30T15:30:50.970 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:50 smithi172 bash[43622]: debug 2024-03-30T15:30:50.521+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6822 osd.2 since back 2024-03-30T15:30:08.115934+0000 front 2024-03-30T15:30:08.115625+0000 (oldest deadline 2024-03-30T15:30:31.615713+0000) 2024-03-30T15:30:50.970 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:50 smithi172 bash[43622]: debug 2024-03-30T15:30:50.521+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.72:6830 osd.3 since back 2024-03-30T15:30:17.517400+0000 front 2024-03-30T15:30:17.517185+0000 (oldest deadline 2024-03-30T15:30:41.016862+0000) 2024-03-30T15:30:50.970 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:50 smithi172 bash[43622]: debug 2024-03-30T15:30:50.521+0000 7f8bd6e1a700 -1 osd.7 798 heartbeat_check: no reply from 172.21.15.172:6804 osd.4 since back 2024-03-30T15:30:22.718262+0000 front 2024-03-30T15:30:22.718387+0000 (oldest deadline 2024-03-30T15:30:48.518606+0000) 2024-03-30T15:30:52.720 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:52 smithi172 bash[53533]: ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4-osd-7 2024-03-30T15:30:52.720 INFO:journalctl@ceph.osd.7.smithi172.stdout:Mar 30 15:30:52 smithi172 bash[53596]: Error response from daemon: No such container: ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4-osd-7 2024-03-30T15:30:53.919 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:30:53 smithi072 bash[59916]: ts=2024-03-30T15:30:53.586Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi172.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.172:8443: connect: connection refused; ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi072.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.72:8443: connect: connection refused" 2024-03-30T15:30:53.919 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:30:53 smithi072 bash[59916]: ts=2024-03-30T15:30:53.587Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi072.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.72:8443: connect: connection refused" 2024-03-30T15:30:53.919 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:30:53 smithi072 bash[59916]: ts=2024-03-30T15:30:53.588Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi172.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.172:8443: connect: connection refused" 2024-03-30T15:30:54.203 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@osd.7.service' 2024-03-30T15:30:54.230 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-30T15:30:54.230 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-03-30T15:30:54.230 INFO:tasks.cephadm.ceph.rgw.foo.a:Stopping rgw.foo.a... 2024-03-30T15:30:54.231 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@rgw.foo.a 2024-03-30T15:30:54.669 INFO:journalctl@ceph.rgw.foo.a.smithi072.stdout:Mar 30 15:30:54 smithi072 systemd[1]: Stopping Ceph rgw.foo.a for 97f8e564-eea5-11ee-b647-cb9ed24678a4... 2024-03-30T15:30:54.670 INFO:journalctl@ceph.rgw.foo.a.smithi072.stdout:Mar 30 15:30:54 smithi072 bash[53137]: debug 2024-03-30T15:30:54.359+0000 7f50b4739700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/radosgw -n client.rgw.foo.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-03-30T15:30:54.670 INFO:journalctl@ceph.rgw.foo.a.smithi072.stdout:Mar 30 15:30:54 smithi072 bash[53137]: debug 2024-03-30T15:30:54.359+0000 7f50c2fb8ac0 -1 shutting down 2024-03-30T15:31:03.919 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:31:03 smithi072 bash[59916]: ts=2024-03-30T15:31:03.586Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=4 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi172.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.172:8443: connect: connection refused; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://smithi072.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.72:8443: connect: connection refused" 2024-03-30T15:31:03.920 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:31:03 smithi072 bash[59916]: ts=2024-03-30T15:31:03.588Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi072.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.72:8443: connect: connection refused" 2024-03-30T15:31:03.920 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:31:03 smithi072 bash[59916]: ts=2024-03-30T15:31:03.589Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi172.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.172:8443: connect: connection refused" 2024-03-30T15:31:05.170 DEBUG:teuthology.orchestra.run.smithi072:> sudo pkill -f 'journalctl -f -n 0 -u ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@rgw.foo.a.service' 2024-03-30T15:31:05.191 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-30T15:31:05.191 INFO:tasks.cephadm.ceph.rgw.foo.a:Stopped rgw.foo.a 2024-03-30T15:31:05.192 INFO:tasks.cephadm.prometheus.a:Stopping prometheus.a... 2024-03-30T15:31:05.192 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@prometheus.a 2024-03-30T15:31:05.470 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:31:05 smithi172 systemd[1]: Stopping Ceph prometheus.a for 97f8e564-eea5-11ee-b647-cb9ed24678a4... 2024-03-30T15:31:05.470 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:31:05 smithi172 bash[51546]: ts=2024-03-30T15:31:05.359Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-03-30T15:31:05.470 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:31:05 smithi172 bash[51546]: ts=2024-03-30T15:31:05.359Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-03-30T15:31:05.470 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:31:05 smithi172 bash[51546]: ts=2024-03-30T15:31:05.359Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-03-30T15:31:05.471 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:31:05 smithi172 bash[51546]: ts=2024-03-30T15:31:05.359Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-03-30T15:31:05.471 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:31:05 smithi172 bash[51546]: ts=2024-03-30T15:31:05.359Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-03-30T15:31:05.471 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:31:05 smithi172 bash[51546]: ts=2024-03-30T15:31:05.359Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-03-30T15:31:05.471 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:31:05 smithi172 bash[51546]: ts=2024-03-30T15:31:05.359Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-03-30T15:31:05.471 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:31:05 smithi172 bash[51546]: ts=2024-03-30T15:31:05.359Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-03-30T15:31:05.471 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:31:05 smithi172 bash[51546]: ts=2024-03-30T15:31:05.359Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-03-30T15:31:05.471 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:31:05 smithi172 bash[51546]: ts=2024-03-30T15:31:05.360Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-03-30T15:31:05.471 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:31:05 smithi172 bash[51546]: ts=2024-03-30T15:31:05.360Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-03-30T15:31:05.471 INFO:journalctl@ceph.prometheus.a.smithi172.stdout:Mar 30 15:31:05 smithi172 bash[51546]: ts=2024-03-30T15:31:05.360Z caller=main.go:1147 level=info msg="See you next time!" 2024-03-30T15:31:06.050 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@prometheus.a.service' 2024-03-30T15:31:06.071 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-30T15:31:06.071 INFO:tasks.cephadm.prometheus.a:Stopped prometheus.a 2024-03-30T15:31:06.072 DEBUG:teuthology.orchestra.run.smithi072:> sudo cephadm rm-cluster --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 --force --keep-logs 2024-03-30T15:31:06.237 INFO:teuthology.orchestra.run.smithi072.stdout:Deleting cluster with fsid: 97f8e564-eea5-11ee-b647-cb9ed24678a4 2024-03-30T15:31:11.121 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:31:10 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:31:11.122 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:31:11 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:31:11.419 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:31:11 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:31:11.420 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:31:11 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:31:11.715 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:31:11 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:31:11.715 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:31:11 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:31:11.715 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:31:11 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:31:11.984 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:31:11 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:31:11.984 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:31:11 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:31:11.984 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:31:11 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:31:12.282 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:31:12 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:31:12.282 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:31:12 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:31:12.609 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:31:12 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:31:12.609 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:31:12 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:31:12.919 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:31:12 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:31:12.920 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:31:12 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:31:12.920 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:31:12 smithi072 systemd[1]: Stopping Ceph node-exporter.a for 97f8e564-eea5-11ee-b647-cb9ed24678a4... 2024-03-30T15:31:13.810 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:31:13 smithi072 bash[134429]: ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4-node-exporter-a 2024-03-30T15:31:13.810 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:31:13 smithi072 systemd[1]: ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2024-03-30T15:31:13.810 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:31:13 smithi072 bash[134490]: Error response from daemon: No such container: ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4-node-exporter-a 2024-03-30T15:31:13.811 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:31:13 smithi072 systemd[1]: ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@node-exporter.a.service: Failed with result 'exit-code'. 2024-03-30T15:31:13.811 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:31:13 smithi072 systemd[1]: Stopped Ceph node-exporter.a for 97f8e564-eea5-11ee-b647-cb9ed24678a4. 2024-03-30T15:31:13.811 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:31:13 smithi072 bash[59916]: ts=2024-03-30T15:31:13.587Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=4 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi072.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.72:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi172.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.172:8443: connect: connection refused" 2024-03-30T15:31:13.811 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:31:13 smithi072 bash[59916]: ts=2024-03-30T15:31:13.588Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi072.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.72:8443: connect: connection refused" 2024-03-30T15:31:13.811 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:31:13 smithi072 bash[59916]: ts=2024-03-30T15:31:13.589Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi172.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.172:8443: connect: connection refused" 2024-03-30T15:31:13.811 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:31:13 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:31:14.070 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:31:13 smithi072 systemd[1]: Stopping Ceph alertmanager.a for 97f8e564-eea5-11ee-b647-cb9ed24678a4... 2024-03-30T15:31:14.071 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:31:14 smithi072 bash[59916]: ts=2024-03-30T15:31:14.030Z caller=main.go:583 level=info msg="Received SIGTERM, exiting gracefully..." 2024-03-30T15:31:14.071 INFO:journalctl@ceph.node-exporter.a.smithi072.stdout:Mar 30 15:31:13 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:31:14.919 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:31:14 smithi072 bash[134559]: ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4-alertmanager-a 2024-03-30T15:31:14.919 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:31:14 smithi072 bash[134619]: Error response from daemon: No such container: ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4-alertmanager-a 2024-03-30T15:31:14.919 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:31:14 smithi072 systemd[1]: ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@alertmanager.a.service: Deactivated successfully. 2024-03-30T15:31:14.919 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:31:14 smithi072 systemd[1]: Stopped Ceph alertmanager.a for 97f8e564-eea5-11ee-b647-cb9ed24678a4. 2024-03-30T15:31:15.239 INFO:journalctl@ceph.alertmanager.a.smithi072.stdout:Mar 30 15:31:14 smithi072 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:31:15.476 DEBUG:teuthology.orchestra.run.smithi172:> sudo cephadm rm-cluster --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 --force --keep-logs 2024-03-30T15:31:15.654 INFO:teuthology.orchestra.run.smithi172.stdout:Deleting cluster with fsid: 97f8e564-eea5-11ee-b647-cb9ed24678a4 2024-03-30T15:31:20.542 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:31:20 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:31:20.542 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:31:20 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:31:20.542 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:31:20 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:31:20.891 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:31:20 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:31:20.891 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:31:20 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:31:20.892 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:31:20 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:31:21.183 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:31:20 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:31:21.183 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:31:21 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:31:21.184 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:31:20 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:31:21.184 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:31:21 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:31:21.184 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:31:20 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:31:21.184 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:31:21 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:31:21.470 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:31:21 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:31:21.471 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:31:21 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:31:21.471 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:31:21 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:31:21.806 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:31:21 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:31:21.806 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:31:21 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:31:21.806 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:31:21 smithi172 systemd[1]: Stopping Ceph iscsi.iscsi.a for 97f8e564-eea5-11ee-b647-cb9ed24678a4... 2024-03-30T15:31:21.806 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:31:21 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:31:22.220 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:31:21 smithi172 bash[47790]: debug Shutdown received 2024-03-30T15:31:32.795 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:31:32 smithi172 bash[54068]: ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4-iscsi-iscsi-a 2024-03-30T15:31:32.795 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:31:32 smithi172 systemd[1]: ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@iscsi.iscsi.a.service: Main process exited, code=exited, status=137/n/a 2024-03-30T15:31:32.795 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:31:32 smithi172 bash[54137]: Error response from daemon: No such container: ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4-iscsi-iscsi-a 2024-03-30T15:31:32.796 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:31:32 smithi172 systemd[1]: ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@iscsi.iscsi.a.service: Failed with result 'exit-code'. 2024-03-30T15:31:32.796 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:31:32 smithi172 systemd[1]: Stopped Ceph iscsi.iscsi.a for 97f8e564-eea5-11ee-b647-cb9ed24678a4. 2024-03-30T15:31:33.135 INFO:journalctl@ceph.iscsi.iscsi.a.smithi172.stdout:Mar 30 15:31:32 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:31:33.135 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:31:32 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:31:33.135 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:31:32 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:31:34.073 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:31:33 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:31:34.073 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:31:34 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:31:34.074 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:31:33 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:31:34.074 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:31:34 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:31:34.443 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:31:34 smithi172 systemd[1]: Stopping Ceph node-exporter.b for 97f8e564-eea5-11ee-b647-cb9ed24678a4... 2024-03-30T15:31:35.110 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:31:34 smithi172 bash[54338]: ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4-node-exporter-b 2024-03-30T15:31:35.110 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:31:34 smithi172 bash[54397]: ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4-node-exporter-b 2024-03-30T15:31:35.110 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:31:34 smithi172 systemd[1]: ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2024-03-30T15:31:35.110 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:31:34 smithi172 systemd[1]: ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@node-exporter.b.service: Failed with result 'exit-code'. 2024-03-30T15:31:35.110 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:31:34 smithi172 systemd[1]: Stopped Ceph node-exporter.b for 97f8e564-eea5-11ee-b647-cb9ed24678a4. 2024-03-30T15:31:35.372 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:31:35 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:31:35.372 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:31:35 smithi172 systemd[1]: Stopping Ceph grafana.a for 97f8e564-eea5-11ee-b647-cb9ed24678a4... 2024-03-30T15:31:35.372 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:31:35 smithi172 bash[50795]: logger=server t=2024-03-30T15:31:35.33549863Z level=info msg="Shutdown started" reason="System signal: terminated" 2024-03-30T15:31:35.372 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:31:35 smithi172 bash[50795]: logger=tracing t=2024-03-30T15:31:35.335595026Z level=info msg="Closing tracing" 2024-03-30T15:31:35.372 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:31:35 smithi172 bash[50795]: logger=ticker t=2024-03-30T15:31:35.335635191Z level=info msg=stopped last_tick=2024-03-30T15:31:30Z 2024-03-30T15:31:35.372 INFO:journalctl@ceph.node-exporter.b.smithi172.stdout:Mar 30 15:31:35 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:31:36.177 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:31:35 smithi172 bash[54465]: ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4-grafana-a 2024-03-30T15:31:36.178 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:31:36 smithi172 bash[54527]: Error response from daemon: No such container: ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4-grafana-a 2024-03-30T15:31:36.178 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:31:36 smithi172 systemd[1]: ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@grafana.a.service: Deactivated successfully. 2024-03-30T15:31:36.178 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:31:36 smithi172 systemd[1]: Stopped Ceph grafana.a for 97f8e564-eea5-11ee-b647-cb9ed24678a4. 2024-03-30T15:31:36.178 INFO:journalctl@ceph.grafana.a.smithi172.stdout:Mar 30 15:31:36 smithi172 systemd[1]: /etc/systemd/system/ceph-97f8e564-eea5-11ee-b647-cb9ed24678a4@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-30T15:31:36.703 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-30T15:31:36.717 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-30T15:31:36.729 INFO:tasks.cephadm:Archiving crash dumps... 2024-03-30T15:31:36.731 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/crash to /home/teuthworker/archive/teuthology-2024-03-29_21:08:02-orch-squid-distro-default-smithi/7630227/remote/smithi072/crash 2024-03-30T15:31:36.732 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/crash -- . 2024-03-30T15:31:36.770 INFO:teuthology.orchestra.run.smithi072.stderr:tar: /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/crash: Cannot open: No such file or directory 2024-03-30T15:31:36.770 INFO:teuthology.orchestra.run.smithi072.stderr:tar: Error is not recoverable: exiting now 2024-03-30T15:31:36.772 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/crash to /home/teuthworker/archive/teuthology-2024-03-29_21:08:02-orch-squid-distro-default-smithi/7630227/remote/smithi172/crash 2024-03-30T15:31:36.772 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/crash -- . 2024-03-30T15:31:36.783 INFO:teuthology.orchestra.run.smithi172.stderr:tar: /var/lib/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/crash: Cannot open: No such file or directory 2024-03-30T15:31:36.783 INFO:teuthology.orchestra.run.smithi172.stderr:tar: Error is not recoverable: exiting now 2024-03-30T15:31:36.784 INFO:tasks.cephadm:Checking cluster log for badness... 2024-03-30T15:31:36.784 DEBUG:teuthology.orchestra.run.smithi072:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2024-03-30T15:31:36.827 INFO:teuthology.orchestra.run.smithi072.stdout:2024-03-30T14:59:35.251374+0000 mon.a (mon.0) 198 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b 2024-03-30T15:31:36.828 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-03-30T15:31:36.828 DEBUG:teuthology.orchestra.run.smithi072:> sudo egrep '\[SEC\]' /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2024-03-30T15:31:36.884 DEBUG:teuthology.orchestra.run.smithi072:> sudo egrep '\[ERR\]' /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2024-03-30T15:31:36.939 DEBUG:teuthology.orchestra.run.smithi072:> sudo egrep '\[WRN\]' /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2024-03-30T15:31:36.995 INFO:teuthology.orchestra.run.smithi072.stdout:2024-03-30T14:59:35.251374+0000 mon.a (mon.0) 198 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b 2024-03-30T15:31:36.995 INFO:tasks.cephadm:Compressing logs... 2024-03-30T15:31:36.995 DEBUG:teuthology.orchestra.run.smithi072:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-30T15:31:37.040 DEBUG:teuthology.orchestra.run.smithi172:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-30T15:31:37.047 INFO:teuthology.orchestra.run.smithi072.stderr:find: '/var/log/rbd-target-api': No such file or directory 2024-03-30T15:31:37.054 INFO:teuthology.orchestra.run.smithi172.stderr:find: '/var/log/rbd-target-api': No such file or directory 2024-03-30T15:31:37.055 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-30T15:31:37.057 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-mgr.y.log 2024-03-30T15:31:37.057 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-osd.0.log 2024-03-30T15:31:37.057 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-osd.2.log 2024-03-30T15:31:37.057 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-mon.a.log 2024-03-30T15:31:37.059 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph.cephadm.log 2024-03-30T15:31:37.059 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-osd.3.log 2024-03-30T15:31:37.059 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-osd.1.log 2024-03-30T15:31:37.059 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-osd.3.log: 88.7% -- replaced with /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph.cephadm.log.gz 2024-03-30T15:31:37.059 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph.log 2024-03-30T15:31:37.060 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-volume.log 2024-03-30T15:31:37.066 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-osd.1.log: /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph.log: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-30T15:31:37.067 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-mon.c.log 2024-03-30T15:31:37.068 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-30T15:31:37.068 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-osd.7.log 2024-03-30T15:31:37.068 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-osd.6.log 2024-03-30T15:31:37.068 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph.cephadm.log 2024-03-30T15:31:37.070 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-volume.log: 92.8% -- replaced with /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph.log.gz 2024-03-30T15:31:37.070 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph.audit.log 2024-03-30T15:31:37.071 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-osd.5.log 2024-03-30T15:31:37.071 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-osd.6.log: /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/tcmu-runner.log 2024-03-30T15:31:37.071 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-osd.5.log: 80.5% -- replaced with /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph.cephadm.log.gz 2024-03-30T15:31:37.071 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-mgr.x.log 2024-03-30T15:31:37.072 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph.log 2024-03-30T15:31:37.072 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/tcmu-runner.log: /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-mgr.x.log: 68.0% -- replaced with /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/tcmu-runner.log.gz 2024-03-30T15:31:37.072 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-volume.log 2024-03-30T15:31:37.072 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph.log: gzip -5 --verbose -- /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph.audit.log 2024-03-30T15:31:37.072 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-mon.b.log 2024-03-30T15:31:37.077 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph.audit.log: 87.1% -- replaced with /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph.log.gz 2024-03-30T15:31:37.078 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-osd.4.log 2024-03-30T15:31:37.080 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-mon.c.log: 91.1% -- replaced with /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-volume.log.gz 2024-03-30T15:31:37.081 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-client.rgw.foo.a.log 2024-03-30T15:31:37.083 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-mon.b.log: 92.4% -- replaced with /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-mgr.x.log.gz 2024-03-30T15:31:37.083 INFO:teuthology.orchestra.run.smithi172.stderr: 92.0% -- replaced with /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph.audit.log.gz 2024-03-30T15:31:37.086 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-osd.4.log: 91.0% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-30T15:31:37.088 INFO:teuthology.orchestra.run.smithi172.stderr: 91.1% -- replaced with /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-volume.log.gz 2024-03-30T15:31:37.100 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph.audit.log: /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-client.rgw.foo.a.log: 95.1% -- replaced with /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph.audit.log.gz 2024-03-30T15:31:37.143 INFO:teuthology.orchestra.run.smithi072.stderr: 94.3% -- replaced with /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-client.rgw.foo.a.log.gz 2024-03-30T15:31:37.533 INFO:teuthology.orchestra.run.smithi072.stderr: 91.0% -- replaced with /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-mgr.y.log.gz 2024-03-30T15:31:38.491 INFO:teuthology.orchestra.run.smithi172.stderr: 93.1% -- replaced with /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-mon.b.log.gz 2024-03-30T15:31:38.527 INFO:teuthology.orchestra.run.smithi072.stderr: 92.7% -- replaced with /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-mon.c.log.gz 2024-03-30T15:31:39.068 INFO:teuthology.orchestra.run.smithi072.stderr: 92.1% -- replaced with /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-mon.a.log.gz 2024-03-30T15:31:43.477 INFO:teuthology.orchestra.run.smithi172.stderr: 93.7% -- replaced with /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-osd.6.log.gz 2024-03-30T15:31:43.715 INFO:teuthology.orchestra.run.smithi172.stderr: 93.7% -- replaced with /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-osd.5.log.gz 2024-03-30T15:31:43.828 INFO:teuthology.orchestra.run.smithi072.stderr: 93.8% -- replaced with /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-osd.2.log.gz 2024-03-30T15:31:44.045 INFO:teuthology.orchestra.run.smithi072.stderr: 93.9% -- replaced with /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-osd.1.log.gz 2024-03-30T15:31:44.301 INFO:teuthology.orchestra.run.smithi172.stderr: 93.9% -- replaced with /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-osd.4.log.gz 2024-03-30T15:31:44.466 INFO:teuthology.orchestra.run.smithi172.stderr: 93.9% -- replaced with /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-osd.7.log.gz 2024-03-30T15:31:44.467 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-03-30T15:31:44.467 INFO:teuthology.orchestra.run.smithi172.stderr:real 0m7.423s 2024-03-30T15:31:44.467 INFO:teuthology.orchestra.run.smithi172.stderr:user 0m28.150s 2024-03-30T15:31:44.467 INFO:teuthology.orchestra.run.smithi172.stderr:sys 0m1.034s 2024-03-30T15:31:44.796 INFO:teuthology.orchestra.run.smithi072.stderr: 93.9% -- replaced with /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-osd.0.log.gz 2024-03-30T15:31:44.968 INFO:teuthology.orchestra.run.smithi072.stderr: 93.9% -- replaced with /var/log/ceph/97f8e564-eea5-11ee-b647-cb9ed24678a4/ceph-osd.3.log.gz 2024-03-30T15:31:44.969 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-03-30T15:31:44.969 INFO:teuthology.orchestra.run.smithi072.stderr:real 0m7.928s 2024-03-30T15:31:44.969 INFO:teuthology.orchestra.run.smithi072.stderr:user 0m32.295s 2024-03-30T15:31:44.969 INFO:teuthology.orchestra.run.smithi072.stderr:sys 0m1.168s 2024-03-30T15:31:44.970 INFO:tasks.cephadm:Archiving logs... 2024-03-30T15:31:44.971 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-03-29_21:08:02-orch-squid-distro-default-smithi/7630227/remote/smithi072/log 2024-03-30T15:31:44.972 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-30T15:31:48.790 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-03-29_21:08:02-orch-squid-distro-default-smithi/7630227/remote/smithi172/log 2024-03-30T15:31:48.791 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-30T15:31:52.231 INFO:tasks.cephadm:Removing cluster... 2024-03-30T15:31:52.231 DEBUG:teuthology.orchestra.run.smithi072:> sudo cephadm rm-cluster --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 --force 2024-03-30T15:31:52.401 INFO:teuthology.orchestra.run.smithi072.stdout:Deleting cluster with fsid: 97f8e564-eea5-11ee-b647-cb9ed24678a4 2024-03-30T15:31:53.770 DEBUG:teuthology.orchestra.run.smithi172:> sudo cephadm rm-cluster --fsid 97f8e564-eea5-11ee-b647-cb9ed24678a4 --force 2024-03-30T15:31:53.938 INFO:teuthology.orchestra.run.smithi172.stdout:Deleting cluster with fsid: 97f8e564-eea5-11ee-b647-cb9ed24678a4 2024-03-30T15:31:55.287 INFO:tasks.cephadm:Teardown complete 2024-03-30T15:31:55.287 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-30T15:31:55.297 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-30T15:31:55.298 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-30T15:31:55.300 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-30T15:31:55.362 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-30T15:31:55.370 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-30T15:31:55.370 DEBUG:teuthology.orchestra.run.smithi072:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-30T15:31:55.373 DEBUG:teuthology.orchestra.run.smithi172:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-30T15:31:55.383 INFO:teuthology.orchestra.run.smithi072.stdout: remote refid st t when poll reach delay offset jitter 2024-03-30T15:31:55.383 INFO:teuthology.orchestra.run.smithi072.stdout:============================================================================== 2024-03-30T15:31:55.383 INFO:teuthology.orchestra.run.smithi072.stdout:*hv01.front.sepi 44.4.53.2 2 u 47 64 377 0.086 -3.178 0.676 2024-03-30T15:31:55.383 INFO:teuthology.orchestra.run.smithi072.stdout:+hv02.front.sepi 63.231.80.2 3 u 56 64 377 0.096 -4.751 0.716 2024-03-30T15:31:55.383 INFO:teuthology.orchestra.run.smithi072.stdout:+hv03.front.sepi 74.6.168.72 3 u 40 64 377 0.098 -4.011 0.307 2024-03-30T15:31:55.383 INFO:teuthology.orchestra.run.smithi072.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-03-30T15:31:55.384 INFO:teuthology.orchestra.run.smithi172.stdout: remote refid st t when poll reach delay offset jitter 2024-03-30T15:31:55.384 INFO:teuthology.orchestra.run.smithi172.stdout:============================================================================== 2024-03-30T15:31:55.384 INFO:teuthology.orchestra.run.smithi172.stdout:*hv01.front.sepi 44.4.53.2 2 u 58 64 377 0.096 -4.395 1.134 2024-03-30T15:31:55.385 INFO:teuthology.orchestra.run.smithi172.stdout:+hv02.front.sepi 63.231.80.2 3 u 50 64 377 0.106 -5.016 1.270 2024-03-30T15:31:55.385 INFO:teuthology.orchestra.run.smithi172.stdout:+hv03.front.sepi 74.6.168.72 3 u 64 64 377 0.089 -3.069 1.614 2024-03-30T15:31:55.385 INFO:teuthology.orchestra.run.smithi172.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-03-30T15:31:55.385 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-30T15:31:55.393 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-30T15:31:55.394 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-30T15:31:55.427 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-30T15:31:55.459 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-30T15:31:55.496 INFO:teuthology.task.internal:Duration was 2709.747106 seconds 2024-03-30T15:31:55.496 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-30T15:31:55.527 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-30T15:31:55.527 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-30T15:31:55.529 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-30T15:31:55.565 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-30T15:31:55.565 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi072.front.sepia.ceph.com 2024-03-30T15:31:55.565 DEBUG:teuthology.orchestra.run.smithi072:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-30T15:31:55.621 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi172.front.sepia.ceph.com 2024-03-30T15:31:55.621 DEBUG:teuthology.orchestra.run.smithi172:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-30T15:31:55.629 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-30T15:31:55.630 DEBUG:teuthology.orchestra.run.smithi072:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-30T15:31:55.664 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-30T15:31:55.732 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-30T15:31:55.733 DEBUG:teuthology.orchestra.run.smithi072:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-30T15:31:55.734 DEBUG:teuthology.orchestra.run.smithi172:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-30T15:31:55.936 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-30T15:31:55.946 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-30T15:31:55.946 DEBUG:teuthology.orchestra.run.smithi072:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-30T15:31:55.958 DEBUG:teuthology.orchestra.run.smithi172:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-30T15:31:55.971 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-30T15:31:55.981 DEBUG:teuthology.orchestra.run.smithi072:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-30T15:31:56.004 DEBUG:teuthology.orchestra.run.smithi172:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-30T15:31:56.012 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern = core 2024-03-30T15:31:56.026 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = core 2024-03-30T15:31:56.048 DEBUG:teuthology.orchestra.run.smithi072:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-30T15:31:56.070 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T15:31:56.071 DEBUG:teuthology.orchestra.run.smithi172:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-30T15:31:56.095 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T15:31:56.096 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-30T15:31:56.106 INFO:teuthology.task.internal:Transferring archived files... 2024-03-30T15:31:56.107 DEBUG:teuthology.misc:Transferring archived files from smithi072:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-03-29_21:08:02-orch-squid-distro-default-smithi/7630227/remote/smithi072 2024-03-30T15:31:56.107 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-30T15:31:56.163 DEBUG:teuthology.misc:Transferring archived files from smithi172:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-03-29_21:08:02-orch-squid-distro-default-smithi/7630227/remote/smithi172 2024-03-30T15:31:56.163 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-30T15:31:56.190 INFO:teuthology.task.internal:Removing archive directory... 2024-03-30T15:31:56.190 DEBUG:teuthology.orchestra.run.smithi072:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-30T15:31:56.196 DEBUG:teuthology.orchestra.run.smithi172:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-30T15:31:56.233 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-30T15:31:56.244 INFO:teuthology.task.internal:Not uploading archives. 2024-03-30T15:31:56.244 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-30T15:31:56.269 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-30T15:31:56.270 DEBUG:teuthology.orchestra.run.smithi072:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-30T15:31:56.272 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-30T15:31:56.277 INFO:teuthology.orchestra.run.smithi072.stdout: 658623 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 30 15:31 /home/ubuntu/cephtest 2024-03-30T15:31:56.280 INFO:teuthology.orchestra.run.smithi172.stdout: 658637 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 30 15:31 /home/ubuntu/cephtest 2024-03-30T15:31:56.281 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-30T15:31:56.302 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-30T15:31:56.370 INFO:teuthology.nuke:Checking targets against current locks 2024-03-30T15:31:56.399 DEBUG:teuthology.nuke:shortname: smithi072 2024-03-30T15:31:56.400 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-30T15:31:56.424 DEBUG:teuthology.nuke:shortname: smithi172 2024-03-30T15:31:56.425 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-30T15:31:56.428 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-03-29_21:08:02-orch-squid-distro-default-smithi/7630227', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-30 14:37:14.111235', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLDrGCM5YnTIRFCgd04DjIlbjuUUX8qdJclG7AvneYbXD/zwcX66oBqJ4zoICKCYSZKbPAemjdg7WqIG54kbzzw='} 2024-03-30T15:31:56.450 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-03-29_21:08:02-orch-squid-distro-default-smithi/7630227', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-30 14:37:14.113272', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHtUqScG8eLIjj/ltc4EDQqu/B9XXmVW+Pnfy6P/c+NblD9UrVykeBI/5QBS47J9t1C9Sdv1DQKTqfOTYnwuIVc='} 2024-03-30T15:31:56.482 INFO:teuthology.orchestra.console.smithi072:Power off 2024-03-30T15:31:56.482 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-30T15:31:56.505 DEBUG:teuthology.orchestra.console.smithi072:power off output: Chassis Power Control: Down/Off 2024-03-30T15:31:56.505 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T15:31:56.525 INFO:teuthology.orchestra.console.smithi172:Power off 2024-03-30T15:31:56.526 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-30T15:31:56.534 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2024-03-30T15:31:56.548 DEBUG:teuthology.orchestra.console.smithi172:power off output: Chassis Power Control: Down/Off 2024-03-30T15:31:56.549 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T15:31:56.573 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2024-03-30T15:32:00.535 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T15:32:00.575 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T15:32:00.647 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2024-03-30T15:32:00.684 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2024-03-30T15:32:04.653 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T15:32:04.686 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T15:32:04.763 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2024-03-30T15:32:04.796 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2024-03-30T15:32:08.766 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T15:32:08.797 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T15:32:08.877 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2024-03-30T15:32:08.907 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2024-03-30T15:32:08.978 INFO:teuthology.orchestra.console.smithi072:Power off completed 2024-03-30T15:32:09.009 INFO:teuthology.orchestra.console.smithi172:Power off completed 2024-03-30T15:32:09.113 INFO:teuthology.run:Summary data: description: orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} duration: 2709.7471058368683 failure_reason: '"2024-03-30T14:59:35.251374+0000 mon.a (mon.0) 198 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log' flavor: default owner: scheduled_teuthology@teuthology success: false 2024-03-30T15:32:09.114 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T15:32:09.197 INFO:teuthology.run:FAIL